[2025-10-08T17:00:01.672204] [INFO ] [MAIN ] Using last completed trading day: 2025-10-08 [2025-10-08T17:00:01.910373] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-08T17:00:01.910690] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-08T17:00:02.111151] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-08T17:00:02.111738] [WARN ] [STATE ] State set to: RUNNING [2025-10-08T17:00:02.111820] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-08T17:00:02.111868] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-08T17:00:02.111954] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-08T17:00:02.111990] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-08T17:00:03.782328] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-08T17:00:03.782504] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-08T17:00:03.782746] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-08T17:00:03.783419] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-08T17:00:03.783481] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-08T17:00:03.783513] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-08T17:00:03.783572] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-08T17:00:03.783606] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-08T17:00:03.783661] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-08T17:00:03.784098] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-08T17:00:03.784142] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-08T17:00:03.784298] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-08T17:00:03.784330] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-08T17:00:03.784360] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-08T17:00:03.784390] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-08T17:00:03.806474] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-08T17:00:03.828098] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-08T17:00:03.828183] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-08T17:00:03.828220] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-08T17:00:03.828248] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-08T17:00:03.828308] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-08T17:00:03.828741] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-08T17:00:03.828795] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-08T17:00:03.828829] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-10-08T17:00:03.828857] [INFO ] [MAIN ] Running in parallel mode [2025-10-08T17:00:03.829058] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-10-08T17:00:04.479808] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.504756] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.562294] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-08T17:00:04.588420] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-08T17:00:04.593247] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.589160] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-08T17:00:04.566122] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:04.595371] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-08T17:00:04.596885] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-08T17:00:04.595313] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-08T17:00:04.597034] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-08T17:00:04.597169] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-08T17:00:04.603031] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-08T17:00:04.610405] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-08T17:00:04.650108] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-08T17:00:04.667819] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-08T17:00:05.204705] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-08T17:00:05.255514] [INFO ] [MAIN ] AA: Loaded 53620 existing records. [2025-10-08T17:00:05.262315] [DEBUG] [LOCAL ] A: Loaded 50745 existing records from primary storage. [2025-10-08T17:00:05.346872] [INFO ] [MAIN ] A: Loaded 50745 existing records. [2025-10-08T17:00:05.544800] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:05.617418] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-08T17:00:05.712872] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:05.755606] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-08T17:00:05.841122] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:05.862364] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-08T17:00:05.862484] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-08T17:00:05.881130] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-08T17:00:05.890701] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-08T17:00:05.993002] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:06.016797] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-08T17:00:06.019070] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-08T17:00:06.025777] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-08T17:00:06.046303] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-08T17:00:06.250808] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T17:00:06.289201] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-08T17:00:06.451953] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:00:06.504850] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-08T17:00:06.525569] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:00:06.581954] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-08T17:00:06.628879] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:06.649672] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:00:06.667537] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-08T17:00:06.667638] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-08T17:00:06.685429] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-08T17:00:06.719993] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:06.720953] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-08T17:00:06.721265] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-08T17:00:06.722211] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-08T17:00:06.722334] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAMI took 2.8s. Estimated remaining: 1h 54m 17s. Rate: 20.7 symbols/min [2025-10-08T17:00:06.790863] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T17:00:06.810016] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-08T17:00:06.927704] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:07.014961] [DEBUG] [LOCAL ] AAP: Loaded 51875 existing records from primary storage. [2025-10-08T17:00:07.015394] [INFO ] [MAIN ] AAP: Loaded 51875 existing records. [2025-10-08T17:00:07.207735] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T17:00:07.216264] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-08T17:00:07.261994] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:07.262274] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-08T17:00:07.262352] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-08T17:00:07.263851] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-08T17:00:07.263937] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-08T17:00:07.634975] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:07.635329] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-08T17:00:07.678213] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T17:00:07.679259] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-08T17:00:07.959433] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-08T17:00:07.960478] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-08T17:00:08.195259] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-08T17:00:08.196291] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-08T17:00:08.465305] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T17:00:08.466509] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-08T17:00:08.515299] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:00:08.526776] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-08T17:00:08.601238] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T17:00:08.612022] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-08T17:00:08.813491] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:00:08.814467] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-08T17:00:09.226018] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T17:00:09.228955] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-08T17:00:09.227408] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:00:09.240439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-08T17:00:09.787552] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:00:09.788627] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-08T17:00:10.083047] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:00:10.093411] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-08T17:00:10.154037] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:00:10.154747] [INFO ] [REMOTE ] AAM: Full fetch complete (937 records). [2025-10-08T17:00:10.154824] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-08T17:00:10.155197] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:10.155283] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:10.155333] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:10.155399] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-08T17:00:10.155466] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-08T17:00:10.155502] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-08T17:00:10.155541] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-08T17:00:10.155596] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAM took 6.3s. Estimated remaining: 2h 4m 54s. Rate: 19.0 symbols/min [2025-10-08T17:00:10.332420] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:10.363505] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:00:10.374346] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-08T17:00:10.402054] [DEBUG] [LOCAL ] AAT: Loaded 30309 existing records from primary storage. [2025-10-08T17:00:10.402364] [INFO ] [MAIN ] AAT: Loaded 30309 existing records. [2025-10-08T17:00:10.586772] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:10.587005] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-08T17:00:10.587054] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-08T17:00:10.587926] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-08T17:00:10.587988] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-08T17:00:10.950500] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:10.950898] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-08T17:00:10.977816] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T17:00:10.987800] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-08T17:00:11.871951] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T17:00:11.878176] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-08T17:00:12.112920] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-08T17:00:12.124947] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-08T17:00:12.368479] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T17:00:12.383811] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-08T17:00:12.467329] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:00:12.477550] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-08T17:00:12.732161] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:00:12.737843] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-08T17:00:13.737409] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:00:13.743594] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-08T17:00:13.919382] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:00:13.931935] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-08T17:00:14.036378] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T17:00:14.048304] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-08T17:00:14.090221] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T17:00:14.102504] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-08T17:00:14.848199] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:00:14.855399] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-08T17:00:15.828123] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T17:00:15.840364] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-08T17:00:16.017562] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:00:16.025941] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-08T17:00:16.121744] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:00:16.135376] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-08T17:00:16.198240] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T17:00:16.211021] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-08T17:00:16.923202] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:00:16.932142] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-08T17:00:17.904383] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:00:17.945021] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-08T17:00:17.948263] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:00:17.962486] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-08T17:00:18.014305] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T17:00:18.044756] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-08T17:00:18.047225] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:00:18.054105] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-08T17:00:18.998343] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:00:19.007396] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-08T17:00:19.665345] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:00:19.676451] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-08T17:00:19.754804] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:00:19.765392] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-08T17:00:19.845961] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:00:19.856970] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-08T17:00:20.622423] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-08T17:00:20.635400] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-08T17:00:21.104438] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:00:21.115977] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-08T17:00:21.307984] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:00:21.320573] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-08T17:00:21.559570] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:00:21.572929] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-08T17:00:22.261430] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:00:22.274922] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-08T17:00:22.320748] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:00:22.323328] [INFO ] [REMOTE ] AAT: Full fetch complete (42716 records). [2025-10-08T17:00:22.323471] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-08T17:00:22.734310] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-08T17:00:22.734526] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-08T17:00:22.735090] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-08T17:00:22.735206] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-08T17:00:22.736765] [DEBUG] [LOCAL ] AAT: Trimmed 42716 records to 30285 (keeping 200 days of data) [2025-10-08T17:00:22.912705] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:00:22.977896] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-08T17:00:22.997774] [DEBUG] [LOCAL ] AAT: Primary data saved (30285 records). [2025-10-08T17:00:22.998167] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-08T17:00:22.998378] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAT took 12.8s. Estimated remaining: 4h 12m 11s. Rate: 9.4 symbols/min [2025-10-08T17:00:23.211685] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:23.207836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T17:00:23.221625] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-08T17:00:23.221750] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-08T17:00:23.221988] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-08T17:00:23.222252] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-08T17:00:23.222417] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-08T17:00:23.222510] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-08T17:00:23.267704] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-08T17:00:23.590525] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:23.590925] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-08T17:00:23.790188] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:00:23.790544] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-08T17:00:23.790672] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:00:23.790761] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-08T17:00:23.790845] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:00:23.790939] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-08T17:00:23.791053] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-08T17:00:23.791135] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-08T17:00:23.791232] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-08T17:00:23.791328] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 16m 53s. Rate: 12.0 symbols/min [2025-10-08T17:00:23.989415] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:24.022096] [DEBUG] [LOCAL ] AB: Loaded 26634 existing records from primary storage. [2025-10-08T17:00:24.022564] [INFO ] [MAIN ] AB: Loaded 26634 existing records. [2025-10-08T17:00:24.270588] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T17:00:24.275629] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:24.290687] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-08T17:00:24.290843] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-08T17:00:24.292215] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-08T17:00:24.292277] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-08T17:00:24.293880] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-08T17:00:24.701106] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:24.701770] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-08T17:00:24.756467] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:00:24.770308] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-08T17:00:24.998501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:00:25.020156] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-08T17:00:25.735904] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:00:25.743699] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-08T17:00:26.335594] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T17:00:26.356241] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-08T17:00:26.357142] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T17:00:26.362204] [INFO ] [REMOTE ] AAP: Full fetch complete (75021 records). [2025-10-08T17:00:26.362335] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-08T17:00:26.809485] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-08T17:00:26.809872] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-08T17:00:26.811328] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-08T17:00:26.811758] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-08T17:00:26.816007] [DEBUG] [LOCAL ] AAP: Trimmed 75021 records to 51882 (keeping 200 days of data) [2025-10-08T17:00:26.985679] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:00:26.996178] [INFO ] [REMOTE ] A: Full fetch complete (73119 records). [2025-10-08T17:00:27.009539] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-08T17:00:27.430141] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:00:27.517162] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-08T17:00:27.928086] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-08T17:00:27.928576] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-08T17:00:27.932608] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-08T17:00:27.932835] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-08T17:00:27.997676] [DEBUG] [LOCAL ] A: Trimmed 73119 records to 50744 (keeping 200 days of data) [2025-10-08T17:00:28.124009] [DEBUG] [LOCAL ] AAP: Primary data saved (51882 records). [2025-10-08T17:00:28.124499] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-08T17:00:28.125477] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAP took 21.4s. Estimated remaining: 3h 11m 37s. Rate: 12.3 symbols/min [2025-10-08T17:00:28.327684] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:28.455481] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-08T17:00:28.476599] [INFO ] [REMOTE ] AA: Full fetch complete (77541 records). [2025-10-08T17:00:28.477229] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-08T17:00:28.634411] [DEBUG] [LOCAL ] ABBV: Loaded 53685 existing records from primary storage. [2025-10-08T17:00:28.641171] [INFO ] [MAIN ] ABBV: Loaded 53685 existing records. [2025-10-08T17:00:29.179021] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:29.189303] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-08T17:00:29.194557] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-08T17:00:29.202955] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-08T17:00:29.203354] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-08T17:00:29.373359] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-08T17:00:29.378619] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-08T17:00:29.390117] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-08T17:00:29.395416] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-08T17:00:29.416614] [DEBUG] [LOCAL ] A: Primary data saved (50744 records). [2025-10-08T17:00:29.445034] [INFO ] [MAIN ] A: Full history saved. [2025-10-08T17:00:29.465940] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. A took 25.6s. Estimated remaining: 2h 48m 25s. Rate: 14.0 symbols/min [2025-10-08T17:00:29.464878] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:00:29.471895] [DEBUG] [LOCAL ] AA: Trimmed 77541 records to 53620 (keeping 200 days of data) [2025-10-08T17:00:29.812353] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-08T17:00:30.004675] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:30.010565] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-08T17:00:30.016302] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-08T17:00:30.016820] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-08T17:00:30.016902] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-08T17:00:30.023109] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-08T17:00:30.042394] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-08T17:00:30.098560] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:30.104687] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-08T17:00:30.502340] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:30.504061] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-08T17:00:30.745980] [DEBUG] [LOCAL ] AA: Primary data saved (53620 records). [2025-10-08T17:00:30.746160] [INFO ] [MAIN ] AA: Full history saved. [2025-10-08T17:00:30.746594] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AA took 26.9s. Estimated remaining: 2h 31m 30s. Rate: 15.6 symbols/min [2025-10-08T17:00:30.928073] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:30.984300] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-08T17:00:30.984776] [INFO ] [MAIN ] ABEV: Loaded 53279 existing records. [2025-10-08T17:00:31.174247] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:31.174851] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-08T17:00:31.175024] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-08T17:00:31.176983] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-08T17:00:31.177047] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-08T17:00:31.571661] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:31.572626] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-08T17:00:31.601211] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:00:31.613359] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-08T17:00:31.903952] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:00:31.911567] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-08T17:00:32.173744] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-08T17:00:32.184954] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-08T17:00:33.096688] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:00:33.105959] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-08T17:00:33.168528] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:00:33.175950] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-08T17:00:33.262906] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:00:33.274122] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-08T17:00:34.211282] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-08T17:00:34.223991] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-08T17:00:34.278144] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:00:34.285141] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-08T17:00:34.425575] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T17:00:34.431921] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-08T17:00:34.943740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:00:34.956195] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-08T17:00:35.081912] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:00:35.087400] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-08T17:00:35.708684] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:00:35.719935] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-08T17:00:35.926740] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T17:00:35.935948] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-08T17:00:36.075778] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:00:36.081977] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-08T17:00:36.407787] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T17:00:36.422916] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-08T17:00:37.121016] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:00:37.127167] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-08T17:00:37.426068] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:00:37.435234] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-08T17:00:37.544694] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:00:37.563611] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-08T17:00:38.200207] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:00:38.206004] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-08T17:00:38.303547] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:00:38.314847] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-08T17:00:38.353731] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T17:00:38.360237] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-08T17:00:39.025046] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:00:39.027661] [INFO ] [REMOTE ] AB: Full fetch complete (45028 records). [2025-10-08T17:00:39.027803] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-08T17:00:39.028841] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:39.028941] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:39.028986] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:39.029027] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-08T17:00:39.029145] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-08T17:00:39.029216] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-08T17:00:39.029507] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-08T17:00:39.029638] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 15.2s. Estimated remaining: 2h 53m 17s. Rate: 13.6 symbols/min [2025-10-08T17:00:39.211557] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:39.232735] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:00:39.240570] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-08T17:00:39.257769] [DEBUG] [LOCAL ] ABG: Loaded 18537 existing records from primary storage. [2025-10-08T17:00:39.258453] [INFO ] [MAIN ] ABG: Loaded 18537 existing records. [2025-10-08T17:00:39.449740] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:39.450192] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-08T17:00:39.450286] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-08T17:00:39.451110] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-08T17:00:39.451175] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-08T17:00:39.597862] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T17:00:39.626546] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-08T17:00:39.873293] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:39.873681] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-08T17:00:40.087244] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:00:40.098705] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-08T17:00:40.299762] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:00:40.309843] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-08T17:00:40.926066] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T17:00:40.929984] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-08T17:00:41.269902] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T17:00:41.277277] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-08T17:00:41.582881] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T17:00:41.594977] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-08T17:00:41.737911] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T17:00:41.751514] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-08T17:00:41.765615] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:00:41.771048] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-08T17:00:42.322938] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T17:00:42.331223] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-08T17:00:42.783607] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:00:42.787900] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-08T17:00:43.294290] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:00:43.314810] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:00:43.319983] [INFO ] [REMOTE ] ABCB: Full fetch complete (44383 records). [2025-10-08T17:00:43.320482] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-08T17:00:43.320959] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-08T17:00:43.323324] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:00:43.323548] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:00:43.323628] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:00:43.323744] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-08T17:00:43.323872] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-08T17:00:43.323950] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-08T17:00:43.324049] [DEBUG] [LOCAL ] ABCB: No derivative data file found to delete. [2025-10-08T17:00:43.324174] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 13.8s. Estimated remaining: 2h 52m 45s. Rate: 13.7 symbols/min [2025-10-08T17:00:43.549224] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:43.567370] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:00:43.573868] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-08T17:00:43.631706] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T17:00:43.643279] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-08T17:00:43.657086] [DEBUG] [LOCAL ] ABM: Loaded 32062 existing records from primary storage. [2025-10-08T17:00:43.657482] [INFO ] [MAIN ] ABM: Loaded 32062 existing records. [2025-10-08T17:00:43.866439] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:43.866777] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-08T17:00:43.866832] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-08T17:00:43.867276] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-08T17:00:43.867336] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-08T17:00:44.285457] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:44.285901] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-08T17:00:44.479087] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T17:00:44.485708] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-08T17:00:44.786874] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:00:44.798579] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-08T17:00:45.067589] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T17:00:45.071286] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-08T17:00:45.409460] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T17:00:45.424099] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-08T17:00:45.727170] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:00:45.733402] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-08T17:00:46.041449] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:00:46.046088] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-08T17:00:46.246702] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T17:00:46.258058] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-08T17:00:46.791826] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:00:46.798269] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-08T17:00:47.074284] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:00:47.105825] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:00:47.113522] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-08T17:00:47.112857] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-08T17:00:47.704397] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:00:47.710902] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-08T17:00:47.817721] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:00:47.843269] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-08T17:00:47.845918] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T17:00:47.851072] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-08T17:00:48.487386] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:00:48.491480] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-08T17:00:48.758929] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:00:48.770942] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-08T17:00:49.064557] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:00:49.071761] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-08T17:00:49.154451] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T17:00:49.161109] [INFO ] [REMOTE ] ABBV: Full fetch complete (77719 records). [2025-10-08T17:00:49.161308] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-08T17:00:49.408039] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:00:49.452944] [INFO ] [REMOTE ] ABEV: Full fetch complete (77220 records). [2025-10-08T17:00:49.480321] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:00:49.490420] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-08T17:00:49.544219] [INFO ] [REMOTE ] ABG: Full fetch complete (26605 records). [2025-10-08T17:00:49.622624] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-08T17:00:49.882978] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-08T17:00:49.983158] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-08T17:00:50.076892] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-08T17:00:50.168308] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-08T17:00:50.282112] [DEBUG] [LOCAL ] ABBV: Trimmed 77719 records to 53686 (keeping 200 days of data) [2025-10-08T17:00:50.535213] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-08T17:00:50.565901] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-08T17:00:50.566501] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-08T17:00:50.567124] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-08T17:00:50.568130] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-08T17:00:50.569087] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-08T17:00:50.569593] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-08T17:00:50.570496] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-08T17:00:50.572365] [DEBUG] [LOCAL ] ABG: Trimmed 26605 records to 18494 (keeping 200 days of data) [2025-10-08T17:00:50.576676] [DEBUG] [LOCAL ] ABEV: Trimmed 77220 records to 53281 (keeping 200 days of data) [2025-10-08T17:00:50.807901] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:00:50.820711] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-08T17:00:50.958450] [DEBUG] [LOCAL ] ABG: Primary data saved (18494 records). [2025-10-08T17:00:50.961718] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-08T17:00:50.967115] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 11.9s. Estimated remaining: 3h 5m 29s. Rate: 12.7 symbols/min [2025-10-08T17:00:51.269202] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:51.487278] [DEBUG] [LOCAL ] ABR: Loaded 51989 existing records from primary storage. [2025-10-08T17:00:51.494022] [INFO ] [MAIN ] ABR: Loaded 51989 existing records. [2025-10-08T17:00:51.581881] [DEBUG] [LOCAL ] ABEV: Primary data saved (53281 records). [2025-10-08T17:00:51.587737] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-08T17:00:51.594804] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 20.8s. Estimated remaining: 2h 50m 48s. Rate: 13.8 symbols/min [2025-10-08T17:00:51.788717] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:51.821347] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-08T17:00:51.837971] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-08T17:00:51.856179] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-08T17:00:51.857424] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-08T17:00:51.859502] [DEBUG] [LOCAL ] ABBV: Primary data saved (53686 records). [2025-10-08T17:00:51.909619] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-08T17:00:51.909429] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:51.925784] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABBV took 23.8s. Estimated remaining: 2h 37m 35s. Rate: 15.0 symbols/min [2025-10-08T17:00:52.316269] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:52.333171] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:00:52.434916] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-08T17:00:52.488869] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-08T17:00:52.516429] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-08T17:00:52.589894] [DEBUG] [LOCAL ] ACA: Loaded 23241 existing records from primary storage. [2025-10-08T17:00:52.647516] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:52.643191] [INFO ] [MAIN ] ACA: Loaded 23241 existing records. [2025-10-08T17:00:52.659741] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-08T17:00:52.924458] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:52.935421] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-08T17:00:52.939295] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-08T17:00:52.939611] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-08T17:00:52.945127] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-08T17:00:53.140966] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:00:53.141553] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-08T17:00:53.147022] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-08T17:00:53.162813] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-08T17:00:53.180678] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-08T17:00:53.630569] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:53.673261] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-08T17:00:53.895795] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:53.915789] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-08T17:00:53.918382] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T17:00:53.926911] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-08T17:00:54.723457] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T17:00:54.736120] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-08T17:00:55.054373] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:00:55.061766] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-08T17:00:55.088938] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:00:55.093385] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-08T17:00:55.225463] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:00:55.238227] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-08T17:00:55.944246] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:00:55.950243] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-08T17:00:56.144267] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:00:56.152526] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-08T17:00:56.429888] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:00:56.440392] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-08T17:00:56.764259] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:00:56.777100] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-08T17:00:56.803270] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:00:56.809436] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-08T17:00:57.339270] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T17:00:57.348161] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-08T17:00:57.938611] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:00:57.952026] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-08T17:00:58.108812] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:00:58.115415] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-08T17:00:58.551739] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T17:00:58.563356] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-08T17:00:58.590806] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:00:58.594875] [INFO ] [REMOTE ] ABM: Full fetch complete (44900 records). [2025-10-08T17:00:58.595026] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-08T17:00:59.008203] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-08T17:00:59.008312] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-08T17:00:59.008911] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-08T17:00:59.008981] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-08T17:00:59.010303] [DEBUG] [LOCAL ] ABM: Trimmed 44900 records to 31947 (keeping 200 days of data) [2025-10-08T17:00:59.205066] [DEBUG] [LOCAL ] ABM: Primary data saved (31947 records). [2025-10-08T17:00:59.205243] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-08T17:00:59.207003] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 15.9s. Estimated remaining: 2h 47m 25s. Rate: 14.1 symbols/min [2025-10-08T17:00:59.380583] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:00:59.380798] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-08T17:00:59.380871] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-08T17:00:59.381022] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-08T17:00:59.381081] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-08T17:00:59.381159] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-08T17:00:59.381314] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-08T17:00:59.517943] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:00:59.578795] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-08T17:00:59.829239] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:00:59.829820] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-08T17:00:59.859901] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:00:59.871415] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-08T17:01:00.380799] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:01:00.391919] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-08T17:01:00.934990] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T17:01:00.940708] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-08T17:01:01.098816] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:01:01.108500] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-08T17:01:01.638152] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:01:01.649853] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-08T17:01:01.684109] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T17:01:01.689167] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-08T17:01:02.487632] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:01:02.495403] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-08T17:01:02.605116] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T17:01:02.616454] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-08T17:01:02.993637] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T17:01:03.217557] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-08T17:01:03.268370] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:01:03.866339] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:01:04.017528] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-08T17:01:04.329370] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:01:04.358035] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:01:04.817618] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-08T17:01:05.341172] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T17:01:05.617583] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-08T17:01:05.885400] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:01:06.417581] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-08T17:01:07.217550] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-08T17:01:07.604884] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-08T17:01:08.017535] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-08T17:01:08.161563] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:01:08.163556] [INFO ] [REMOTE ] ACA: Full fetch complete (34166 records). [2025-10-08T17:01:08.163716] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-08T17:01:08.164395] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:08.164493] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:08.164541] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:08.164594] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-08T17:01:08.164698] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-08T17:01:08.164757] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-08T17:01:08.165001] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-08T17:01:08.165109] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ACA took 16.2s. Estimated remaining: 3h 0m 31s. Rate: 13.1 symbols/min [2025-10-08T17:01:08.345825] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:08.374419] [DEBUG] [LOCAL ] ACEL: Loaded 26706 existing records from primary storage. [2025-10-08T17:01:08.374771] [INFO ] [MAIN ] ACEL: Loaded 26706 existing records. [2025-10-08T17:01:08.583394] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:08.583821] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-08T17:01:08.583944] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-08T17:01:08.593970] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-08T17:01:08.608143] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-08T17:01:08.689288] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-08T17:01:08.824225] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-08T17:01:08.989236] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:09.617598] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-08T17:01:09.690031] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:01:10.417589] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-08T17:01:10.743503] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:01:11.083317] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-08T17:01:11.217596] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-08T17:01:11.309409] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:01:12.017593] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-08T17:01:12.779625] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T17:01:12.817525] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-08T17:01:13.207913] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:01:13.617577] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-08T17:01:14.417562] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-08T17:01:14.653664] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T17:01:14.701873] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:01:15.217577] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-08T17:01:16.017526] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-08T17:01:16.341159] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T17:01:16.597718] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T17:01:16.823310] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-08T17:01:16.828211] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T17:01:17.335786] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T17:01:17.339856] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-08T17:01:17.340055] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-08T17:01:17.622835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-08T17:01:17.741472] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-08T17:01:17.741603] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-08T17:01:17.742458] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-08T17:01:17.742528] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-08T17:01:17.744264] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 53623 (keeping 200 days of data) [2025-10-08T17:01:18.082309] [DEBUG] [LOCAL ] ABT: Primary data saved (53623 records). [2025-10-08T17:01:18.082471] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-08T17:01:18.082563] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABT took 26.5s. Estimated remaining: 3h 14m 23s. Rate: 12.1 symbols/min [2025-10-08T17:01:18.253344] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:18.304612] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-08T17:01:18.305030] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-08T17:01:18.422779] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-08T17:01:18.488134] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:18.491969] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-08T17:01:18.492057] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-08T17:01:18.492502] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-08T17:01:18.492562] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-08T17:01:18.868168] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:19.168857] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:01:19.217617] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-08T17:01:19.368473] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T17:01:20.017620] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-08T17:01:20.413320] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T17:01:20.817583] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-08T17:01:21.617568] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-08T17:01:21.847078] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T17:01:22.417580] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-08T17:01:23.021308] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:01:23.217508] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-08T17:01:23.289866] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T17:01:24.017537] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-08T17:01:24.201562] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T17:01:24.205989] [INFO ] [REMOTE ] ABR: Full fetch complete (75244 records). [2025-10-08T17:01:24.206145] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-08T17:01:24.505598] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:01:24.638951] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-08T17:01:24.639045] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-08T17:01:24.639819] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-08T17:01:24.639892] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-08T17:01:24.641521] [DEBUG] [LOCAL ] ABR: Trimmed 75244 records to 51958 (keeping 200 days of data) [2025-10-08T17:01:24.827459] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-08T17:01:24.972565] [DEBUG] [LOCAL ] ABR: Primary data saved (51958 records). [2025-10-08T17:01:24.972763] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-08T17:01:24.975800] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 34.0s. Estimated remaining: 3h 19m 4s. Rate: 11.8 symbols/min [2025-10-08T17:01:25.146810] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:25.147014] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-08T17:01:25.147052] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-08T17:01:25.147201] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-08T17:01:25.147244] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-08T17:01:25.147289] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-08T17:01:25.147323] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-08T17:01:25.503767] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:25.617538] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-08T17:01:26.323900] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:01:26.417606] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-08T17:01:26.474061] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-08T17:01:27.123754] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:01:27.217734] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-08T17:01:27.271362] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:01:28.017576] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-08T17:01:28.433128] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:01:28.436696] [INFO ] [REMOTE ] ACCO: Full fetch complete (53967 records). [2025-10-08T17:01:28.436805] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-08T17:01:28.820992] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-08T17:01:28.820542] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-08T17:01:28.822067] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-08T17:01:28.822629] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-08T17:01:28.822710] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-08T17:01:28.826082] [DEBUG] [LOCAL ] ACCO: Trimmed 53967 records to 37076 (keeping 200 days of data) [2025-10-08T17:01:29.051091] [DEBUG] [LOCAL ] ACCO: Primary data saved (37076 records). [2025-10-08T17:01:29.051307] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-08T17:01:29.051433] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 29.8s. Estimated remaining: 3h 16m 41s. Rate: 12.0 symbols/min [2025-10-08T17:01:29.274311] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:29.326443] [DEBUG] [LOCAL ] ACM: Loaded 43061 existing records from primary storage. [2025-10-08T17:01:29.327058] [INFO ] [MAIN ] ACM: Loaded 43061 existing records. [2025-10-08T17:01:29.515546] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:01:29.515907] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-08T17:01:29.516076] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-08T17:01:29.516508] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-08T17:01:29.516571] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-08T17:01:29.619676] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-08T17:01:29.940174] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:29.934226] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T17:01:29.965584] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:01:30.417620] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-08T17:01:31.217677] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-08T17:01:32.011204] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-08T17:01:32.021826] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-08T17:01:32.113287] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:01:32.526155] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T17:01:32.817568] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-08T17:01:33.233271] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T17:01:33.617686] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-08T17:01:34.368977] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:01:34.417540] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-08T17:01:34.697760] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:01:35.217610] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-08T17:01:35.990590] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:01:36.017520] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-08T17:01:36.817578] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-08T17:01:37.555179] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:01:37.617497] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-08T17:01:37.785555] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-08T17:01:38.373117] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:01:38.417562] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-08T17:01:38.834868] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:01:39.217612] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-08T17:01:39.616920] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T17:01:40.017534] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-08T17:01:40.197269] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:01:40.199332] [INFO ] [REMOTE ] ACEL: Full fetch complete (38527 records). [2025-10-08T17:01:40.199463] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-08T17:01:40.200280] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:40.200371] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:40.200415] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:40.200484] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-08T17:01:40.200564] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-08T17:01:40.200629] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-08T17:01:40.200918] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-10-08T17:01:40.201031] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 32.0s. Estimated remaining: 3h 29m 58s. Rate: 11.2 symbols/min [2025-10-08T17:01:40.400060] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:40.400280] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-08T17:01:40.400320] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-08T17:01:40.400440] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-08T17:01:40.400484] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-08T17:01:40.400535] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-08T17:01:40.400604] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-08T17:01:40.828098] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-08T17:01:40.833746] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:41.617561] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-08T17:01:41.771204] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T17:01:42.417587] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-08T17:01:43.190571] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-08T17:01:43.222716] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-08T17:01:43.238551] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:01:43.954693] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:01:44.017549] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-08T17:01:44.817580] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-08T17:01:45.097710] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T17:01:45.617556] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-08T17:01:46.347425] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T17:01:46.362834] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-08T17:01:46.417499] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-08T17:01:47.143126] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:01:47.217607] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-08T17:01:48.017613] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-08T17:01:48.736202] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T17:01:48.739866] [INFO ] [REMOTE ] ACI: Full fetch complete (76654 records). [2025-10-08T17:01:48.740050] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-08T17:01:48.741101] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:01:48.741236] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:01:48.741295] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:01:48.741353] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-08T17:01:48.741438] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-08T17:01:48.741476] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-08T17:01:48.741516] [DEBUG] [LOCAL ] ACI: No derivative data file found to delete. [2025-10-08T17:01:48.741614] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 23.8s. Estimated remaining: 3h 36m 27s. Rate: 10.9 symbols/min [2025-10-08T17:01:48.819527] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-08T17:01:48.924633] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:01:48.924840] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-08T17:01:48.925036] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-08T17:01:48.925215] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-08T17:01:48.925425] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-08T17:01:48.925487] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-08T17:01:48.925555] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-08T17:01:49.026445] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-08T17:01:49.335024] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:01:49.617582] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-08T17:01:49.843070] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T17:01:50.417526] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-08T17:01:50.596318] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:01:51.217636] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-08T17:01:52.017581] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-08T17:01:52.240012] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-08T17:01:52.325931] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:01:52.708252] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:01:52.817564] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-08T17:01:53.236036] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:01:53.617555] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-08T17:01:54.406619] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:01:54.417509] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-08T17:01:55.226774] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-08T17:01:55.232631] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T17:01:56.017521] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-08T17:01:56.126401] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:01:56.817625] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-08T17:01:56.952520] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:01:57.617536] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-08T17:01:58.085984] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:01:58.354315] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-08T17:01:58.417567] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-08T17:01:59.217543] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-08T17:01:59.413540] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T17:02:00.017611] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-08T17:02:00.205490] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:02:00.817575] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-08T17:02:01.432717] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-10-08T17:02:01.531687] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:02:01.617568] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-08T17:02:01.740347] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:02:02.417561] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-08T17:02:02.939866] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:02:03.217596] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-08T17:02:03.847329] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T17:02:04.017572] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-08T17:02:04.817523] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-08T17:02:05.077967] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T17:02:05.079603] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T17:02:05.617607] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-08T17:02:06.287314] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T17:02:06.417562] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-08T17:02:06.969417] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T17:02:07.217618] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-08T17:02:07.657598] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:02:07.662178] [INFO ] [REMOTE ] ACM: Full fetch complete (62495 records). [2025-10-08T17:02:07.662363] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-08T17:02:07.663632] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:02:07.663779] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:02:07.663869] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:02:07.663986] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-08T17:02:07.664101] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-08T17:02:07.664180] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-08T17:02:07.664485] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-08T17:02:07.664617] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 38.6s. Estimated remaining: 4h 2m 37s. Rate: 9.7 symbols/min [2025-10-08T17:02:07.839536] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:07.848535] [DEBUG] [LOCAL ] ACR: Loaded 5692 existing records from primary storage. [2025-10-08T17:02:07.848786] [INFO ] [MAIN ] ACR: Loaded 5692 existing records. [2025-10-08T17:02:08.031898] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-08T17:02:08.038219] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:08.039162] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-08T17:02:08.039231] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-08T17:02:08.039495] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-08T17:02:08.039563] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-08T17:02:08.400564] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:08.817593] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-08T17:02:09.418260] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:02:09.574547] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T17:02:09.592426] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T17:02:09.596366] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-08T17:02:09.596496] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-08T17:02:09.626690] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-08T17:02:09.998191] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-08T17:02:09.998386] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-08T17:02:09.999126] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-08T17:02:09.999199] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-08T17:02:10.000805] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-08T17:02:10.318392] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-08T17:02:10.318762] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-08T17:02:10.318856] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 52.2s. Estimated remaining: 3h 55m 55s. Rate: 10.0 symbols/min [2025-10-08T17:02:10.419173] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-08T17:02:10.496958] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:10.497162] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-08T17:02:10.497216] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-08T17:02:10.497348] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-08T17:02:10.497399] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-08T17:02:10.497466] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-08T17:02:10.497500] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-08T17:02:10.854465] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:10.870685] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:02:11.066712] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T17:02:11.217522] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-08T17:02:12.017597] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-08T17:02:12.817587] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-08T17:02:13.099469] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:02:13.272191] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:02:13.274872] [INFO ] [REMOTE ] ACP: Full fetch complete (46853 records). [2025-10-08T17:02:13.274988] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-08T17:02:13.624548] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-08T17:02:13.661031] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-08T17:02:13.661133] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-08T17:02:13.661626] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-08T17:02:13.661719] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-08T17:02:13.662952] [DEBUG] [LOCAL ] ACP: Trimmed 46853 records to 31022 (keeping 200 days of data) [2025-10-08T17:02:13.854104] [DEBUG] [LOCAL ] ACP: Primary data saved (31022 records). [2025-10-08T17:02:13.854331] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-08T17:02:13.854457] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACP took 25.1s. Estimated remaining: 3h 51m 23s. Rate: 10.2 symbols/min [2025-10-08T17:02:14.032269] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:14.043915] [DEBUG] [LOCAL ] ACV: Loaded 7506 existing records from primary storage. [2025-10-08T17:02:14.044166] [INFO ] [MAIN ] ACV: Loaded 7506 existing records. [2025-10-08T17:02:14.214595] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:02:14.235069] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:14.238386] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-08T17:02:14.238580] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-08T17:02:14.238877] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-08T17:02:14.246612] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-08T17:02:14.293978] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:02:14.425288] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-08T17:02:14.644038] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:15.217562] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-08T17:02:16.017534] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-08T17:02:16.510665] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T17:02:16.637913] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:02:16.732299] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T17:02:16.817821] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-08T17:02:17.548298] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T17:02:17.617559] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-08T17:02:18.417562] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-08T17:02:18.967898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T17:02:19.217567] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-08T17:02:19.681436] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T17:02:19.686552] [INFO ] [REMOTE ] ACN: Full fetch complete (77152 records). [2025-10-08T17:02:19.686994] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-08T17:02:20.022758] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-08T17:02:20.187921] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-08T17:02:20.188053] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-08T17:02:20.188971] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-08T17:02:20.189062] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-08T17:02:20.192039] [DEBUG] [LOCAL ] ACN: Trimmed 77152 records to 53428 (keeping 200 days of data) [2025-10-08T17:02:20.560541] [DEBUG] [LOCAL ] ACN: Primary data saved (53428 records). [2025-10-08T17:02:20.560733] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-08T17:02:20.560840] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACN took 40.4s. Estimated remaining: 3h 52m 39s. Rate: 10.1 symbols/min [2025-10-08T17:02:20.738118] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:02:20.777460] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:20.789780] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:02:20.794844] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-08T17:02:20.795839] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-08T17:02:20.796040] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-08T17:02:20.796102] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-08T17:02:20.796153] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-08T17:02:20.796206] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-08T17:02:20.827936] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-08T17:02:21.184973] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:21.486889] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T17:02:21.617567] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-08T17:02:22.144857] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:02:22.417606] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-08T17:02:22.866556] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:02:23.217562] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-08T17:02:23.635907] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T17:02:24.017585] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-08T17:02:24.621061] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:02:24.817625] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-08T17:02:25.617570] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-08T17:02:26.256478] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:02:26.417533] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-08T17:02:26.603394] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:02:27.217558] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-08T17:02:27.394629] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:02:27.787100] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:02:28.017606] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-08T17:02:28.578533] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T17:02:28.580082] [INFO ] [REMOTE ] ACR: Full fetch complete (8584 records). [2025-10-08T17:02:28.580203] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-08T17:02:28.827622] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-08T17:02:29.085429] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-08T17:02:29.085542] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-08T17:02:29.085801] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-08T17:02:29.085870] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-08T17:02:29.086575] [DEBUG] [LOCAL ] ACR: Trimmed 8584 records to 5619 (keeping 200 days of data) [2025-10-08T17:02:29.128186] [DEBUG] [LOCAL ] ACR: Primary data saved (5619 records). [2025-10-08T17:02:29.128381] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-08T17:02:29.128489] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 21.5s. Estimated remaining: 3h 56m 49s. Rate: 9.9 symbols/min [2025-10-08T17:02:29.343459] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:29.343740] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-08T17:02:29.343799] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-08T17:02:29.343929] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-08T17:02:29.343973] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-08T17:02:29.344017] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-08T17:02:29.344052] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-08T17:02:29.622724] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-08T17:02:29.758535] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:29.759028] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:02:30.417577] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-08T17:02:30.952227] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:02:31.191511] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:02:31.217509] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-08T17:02:31.927070] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:02:32.017615] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-08T17:02:32.469824] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:02:32.817606] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-08T17:02:33.617601] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-08T17:02:34.370088] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:02:34.417610] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-08T17:02:35.029420] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:02:35.150297] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:02:35.217601] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-08T17:02:36.017694] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-08T17:02:36.206794] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:02:36.207120] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-08T17:02:36.207208] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:02:36.207254] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-08T17:02:36.207314] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:02:36.207386] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-08T17:02:36.207450] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-08T17:02:36.207487] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-08T17:02:36.207543] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-08T17:02:36.207612] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. AD took 7.1s. Estimated remaining: 3h 58m 19s. Rate: 9.8 symbols/min [2025-10-08T17:02:36.388924] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:36.389152] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-08T17:02:36.389208] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-08T17:02:36.389319] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-08T17:02:36.389362] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-08T17:02:36.389404] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-08T17:02:36.389441] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-08T17:02:36.773804] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:36.817579] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-08T17:02:37.093391] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:02:37.617579] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-08T17:02:38.426289] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-08T17:02:38.433137] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:02:39.217582] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-08T17:02:39.237105] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T17:02:39.316375] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:02:40.017595] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-08T17:02:40.434424] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:02:40.656433] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T17:02:40.657852] [INFO ] [REMOTE ] ACV: Full fetch complete (10105 records). [2025-10-08T17:02:40.657931] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-08T17:02:40.658515] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:02:40.658603] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:02:40.658666] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:02:40.658750] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-08T17:02:40.658855] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-08T17:02:40.658928] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-08T17:02:40.659374] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-08T17:02:40.659513] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACV took 26.8s. Estimated remaining: 3h 55m 45s. Rate: 9.9 symbols/min [2025-10-08T17:02:40.819414] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-08T17:02:40.841417] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:40.842333] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-08T17:02:40.842395] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-08T17:02:40.842510] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-08T17:02:40.842554] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-08T17:02:40.842595] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-08T17:02:40.842626] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-08T17:02:41.214747] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:41.617637] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-08T17:02:42.417595] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-08T17:02:42.505316] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:02:43.217512] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-08T17:02:43.356678] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:02:43.419678] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:02:44.017574] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-08T17:02:44.789330] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:02:44.817531] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-08T17:02:45.001582] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T17:02:45.617609] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-08T17:02:46.417609] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-08T17:02:46.609985] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:02:47.180624] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:02:47.217551] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-08T17:02:47.439111] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:02:48.017571] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-08T17:02:48.817543] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-08T17:02:48.954582] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:02:49.387905] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:02:49.617599] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-08T17:02:50.145662] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:02:50.417560] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-08T17:02:50.721889] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:02:51.217549] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-08T17:02:51.815833] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:02:52.017620] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-08T17:02:52.458996] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:02:52.463142] [INFO ] [REMOTE ] ACRE: Full fetch complete (50356 records). [2025-10-08T17:02:52.463359] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-08T17:02:52.822673] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-08T17:02:52.915000] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-08T17:02:52.915103] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-08T17:02:52.915624] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-08T17:02:52.915699] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-08T17:02:52.916979] [DEBUG] [LOCAL ] ACRE: Trimmed 50356 records to 33676 (keeping 200 days of data) [2025-10-08T17:02:53.120004] [DEBUG] [LOCAL ] ACRE: Primary data saved (33676 records). [2025-10-08T17:02:53.120189] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-08T17:02:53.120274] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACRE took 42.8s. Estimated remaining: 4h 4m 57s. Rate: 9.6 symbols/min [2025-10-08T17:02:53.294192] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:02:53.348201] [DEBUG] [LOCAL ] ADM: Loaded 53390 existing records from primary storage. [2025-10-08T17:02:53.348704] [INFO ] [MAIN ] ADM: Loaded 53390 existing records. [2025-10-08T17:02:53.533025] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:02:53.533264] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-08T17:02:53.533319] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-08T17:02:53.533891] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-08T17:02:53.533952] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-08T17:02:53.631175] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-08T17:02:53.898297] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:02:53.942461] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:02:53.965736] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:02:54.417597] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-08T17:02:55.217526] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-08T17:02:55.380852] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T17:02:55.408822] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T17:02:56.017610] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-08T17:02:56.709583] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:02:56.817621] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-08T17:02:57.583484] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:02:57.617599] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-08T17:02:57.909678] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:02:58.417690] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-08T17:02:59.133426] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:02:59.217638] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-08T17:03:00.017530] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-08T17:03:00.133519] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:03:00.817539] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-08T17:03:00.902383] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:03:00.905870] [INFO ] [REMOTE ] ACVA: Full fetch complete (70176 records). [2025-10-08T17:03:00.906016] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-08T17:03:00.906792] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:03:00.906887] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:03:00.906929] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:03:00.906967] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-08T17:03:00.907052] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-08T17:03:00.907106] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-08T17:03:00.907149] [DEBUG] [LOCAL ] ACVA: No derivative data file found to delete. [2025-10-08T17:03:00.907207] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 40.3s. Estimated remaining: 4h 6m 58s. Rate: 9.5 symbols/min [2025-10-08T17:03:01.080227] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:01.128969] [DEBUG] [LOCAL ] ADNT: Loaded 47253 existing records from primary storage. [2025-10-08T17:03:01.129333] [INFO ] [MAIN ] ADNT: Loaded 47253 existing records. [2025-10-08T17:03:01.307404] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:01.307678] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-08T17:03:01.307736] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-08T17:03:01.308117] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-08T17:03:01.308185] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-08T17:03:01.624474] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-08T17:03:01.666102] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:02.315613] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:03:02.417535] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-08T17:03:02.555508] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T17:03:03.217602] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-08T17:03:03.653621] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T17:03:03.737504] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T17:03:04.017600] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-08T17:03:04.781690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T17:03:04.817632] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-08T17:03:05.617575] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-08T17:03:06.182458] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-08T17:03:06.224973] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:03:06.417569] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-08T17:03:07.217576] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-08T17:03:07.295438] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:03:08.017630] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-08T17:03:08.612013] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:03:08.791521] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:03:08.817581] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-08T17:03:09.244600] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:03:09.249761] [INFO ] [REMOTE ] ADC: Full fetch complete (66246 records). [2025-10-08T17:03:09.249985] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-08T17:03:09.625007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-08T17:03:09.668697] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-08T17:03:09.668817] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-08T17:03:09.669491] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-08T17:03:09.669555] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-08T17:03:09.671069] [DEBUG] [LOCAL ] ADC: Trimmed 66246 records to 46168 (keeping 200 days of data) [2025-10-08T17:03:09.967878] [DEBUG] [LOCAL ] ADC: Primary data saved (46168 records). [2025-10-08T17:03:09.968043] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-08T17:03:09.968122] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 33.8s. Estimated remaining: 4h 10m 32s. Rate: 9.3 symbols/min [2025-10-08T17:03:10.145109] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:10.145344] [DEBUG] [LOCAL ] ADT: No existing data file found in primary storage. [2025-10-08T17:03:10.145406] [WARN ] [MAIN ] ADT: No existing data found, performing full refresh instead. [2025-10-08T17:03:10.145701] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-08T17:03:10.145824] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-08T17:03:10.145985] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-08T17:03:10.146097] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-08T17:03:10.433980] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-08T17:03:10.449152] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:03:10.585681] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:11.126247] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T17:03:11.217566] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-08T17:03:12.020720] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-08T17:03:12.023759] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:03:12.780448] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:03:12.817516] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-08T17:03:13.617524] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-08T17:03:13.658818] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T17:03:14.283364] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:03:14.417588] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-08T17:03:15.217689] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-08T17:03:15.313350] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:03:15.858751] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T17:03:16.017604] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-08T17:03:16.786204] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T17:03:16.817538] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-08T17:03:17.617577] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-08T17:03:17.869615] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:03:18.319294] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:03:18.417611] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-08T17:03:18.768520] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:03:18.772493] [INFO ] [REMOTE ] ADCT: Full fetch complete (51456 records). [2025-10-08T17:03:18.772695] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-08T17:03:19.170538] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-08T17:03:19.170677] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-08T17:03:19.171218] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-08T17:03:19.171264] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-08T17:03:19.172572] [DEBUG] [LOCAL ] ADCT: Trimmed 51456 records to 35096 (keeping 200 days of data) [2025-10-08T17:03:19.223076] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-08T17:03:19.384466] [DEBUG] [LOCAL ] ADCT: Primary data saved (35096 records). [2025-10-08T17:03:19.384670] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-08T17:03:19.384788] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 38.7s. Estimated remaining: 4h 14m 20s. Rate: 9.2 symbols/min [2025-10-08T17:03:19.556946] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:19.583471] [DEBUG] [LOCAL ] ADX: Loaded 27503 existing records from primary storage. [2025-10-08T17:03:19.583792] [INFO ] [MAIN ] ADX: Loaded 27503 existing records. [2025-10-08T17:03:19.769978] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:19.770312] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-08T17:03:19.770373] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-08T17:03:19.770825] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-08T17:03:19.770883] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-08T17:03:20.028529] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-08T17:03:20.152610] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:20.546300] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T17:03:20.817616] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-08T17:03:21.206166] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:03:21.617751] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-08T17:03:22.006690] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:03:22.212676] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:03:22.417578] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-08T17:03:23.217570] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-08T17:03:23.505852] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:03:23.820600] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:03:24.017560] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-08T17:03:24.484364] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T17:03:24.817597] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-08T17:03:25.374169] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:03:25.617584] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-08T17:03:26.417621] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-08T17:03:26.501012] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T17:03:27.217532] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-08T17:03:27.274973] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:03:28.017637] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-08T17:03:28.486961] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T17:03:28.555919] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:03:28.817597] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-08T17:03:29.275292] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:03:29.617584] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-08T17:03:29.716590] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T17:03:30.417631] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-08T17:03:31.217624] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-08T17:03:31.623180] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-08T17:03:31.629147] [INFO ] [REMOTE ] ADM: Full fetch complete (77259 records). [2025-10-08T17:03:31.629351] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-08T17:03:32.026688] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-08T17:03:32.069590] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-08T17:03:32.069782] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-08T17:03:32.070600] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-08T17:03:32.070843] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-08T17:03:32.086564] [DEBUG] [LOCAL ] ADM: Trimmed 77259 records to 53388 (keeping 200 days of data) [2025-10-08T17:03:32.112299] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:03:32.454041] [DEBUG] [LOCAL ] ADM: Primary data saved (53388 records). [2025-10-08T17:03:32.454213] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-08T17:03:32.454302] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 39.3s. Estimated remaining: 4h 22m 28s. Rate: 8.9 symbols/min [2025-10-08T17:03:32.630318] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:32.667671] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:03:32.714012] [DEBUG] [LOCAL ] AEE: Loaded 50121 existing records from primary storage. [2025-10-08T17:03:32.714367] [INFO ] [MAIN ] AEE: Loaded 50121 existing records. [2025-10-08T17:03:32.818457] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-08T17:03:32.901415] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:32.901701] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-08T17:03:32.901760] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-08T17:03:32.902298] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-08T17:03:32.902357] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-08T17:03:33.265989] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:33.281962] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:03:33.617728] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-08T17:03:34.362295] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T17:03:34.366312] [INFO ] [REMOTE ] ADNT: Full fetch complete (67993 records). [2025-10-08T17:03:34.366474] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-08T17:03:34.423045] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-08T17:03:34.790346] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-08T17:03:34.790482] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-08T17:03:34.791207] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-08T17:03:34.791272] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-08T17:03:34.793186] [DEBUG] [LOCAL ] ADNT: Trimmed 67993 records to 47191 (keeping 200 days of data) [2025-10-08T17:03:35.091220] [DEBUG] [LOCAL ] ADNT: Primary data saved (47191 records). [2025-10-08T17:03:35.091584] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-08T17:03:35.091702] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 34.2s. Estimated remaining: 4h 17m 22s. Rate: 9.1 symbols/min [2025-10-08T17:03:35.217797] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-08T17:03:35.277068] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:35.288763] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-08T17:03:35.289728] [INFO ] [MAIN ] AEFC: Loaded 8446 existing records. [2025-10-08T17:03:35.474682] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:35.475194] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-08T17:03:35.496838] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-08T17:03:35.520822] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-08T17:03:35.521068] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-08T17:03:35.548996] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:03:35.955929] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:36.005809] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:03:36.017500] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-08T17:03:36.544329] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:03:36.817566] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-08T17:03:37.423547] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:03:37.617528] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-08T17:03:37.756706] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:03:38.417570] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-08T17:03:39.223040] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-08T17:03:39.237768] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:03:39.967058] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T17:03:40.017564] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-08T17:03:40.113613] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:03:40.817558] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-08T17:03:41.617617] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-08T17:03:41.925707] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T17:03:42.244547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:03:42.375365] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T17:03:42.417571] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-08T17:03:43.053135] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:03:43.217577] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-08T17:03:44.017596] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-08T17:03:44.634291] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:03:44.817577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-08T17:03:44.902580] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:03:45.294771] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T17:03:45.617554] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-08T17:03:46.417573] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-08T17:03:46.841528] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:03:47.217577] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-08T17:03:47.930276] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T17:03:47.937777] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:03:48.017556] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-08T17:03:48.817624] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-08T17:03:49.301483] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:03:49.521076] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:03:49.617563] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-08T17:03:50.417680] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-08T17:03:50.815446] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:03:50.818108] [INFO ] [REMOTE ] ADX: Full fetch complete (41888 records). [2025-10-08T17:03:50.818248] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-08T17:03:51.228130] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-08T17:03:51.225557] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-08T17:03:51.228298] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-08T17:03:51.229875] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-08T17:03:51.229943] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-08T17:03:51.231114] [DEBUG] [LOCAL ] ADX: Trimmed 41888 records to 27572 (keeping 200 days of data) [2025-10-08T17:03:51.406187] [DEBUG] [LOCAL ] ADX: Primary data saved (27572 records). [2025-10-08T17:03:51.406342] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-08T17:03:51.406460] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 32.0s. Estimated remaining: 4h 28m 44s. Rate: 8.7 symbols/min [2025-10-08T17:03:51.585310] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:51.635130] [DEBUG] [LOCAL ] AEG: Loaded 49613 existing records from primary storage. [2025-10-08T17:03:51.635534] [INFO ] [MAIN ] AEG: Loaded 49613 existing records. [2025-10-08T17:03:51.828268] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:51.828570] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-08T17:03:51.828672] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-08T17:03:51.829044] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-08T17:03:51.829124] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-08T17:03:52.032691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-08T17:03:52.065226] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:03:52.191780] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T17:03:52.241928] [INFO ] [REMOTE ] ADT: Full fetch complete (77186 records). [2025-10-08T17:03:52.264435] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-08T17:03:52.264325] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:52.685952] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-08T17:03:52.686058] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-08T17:03:52.686832] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-08T17:03:52.686904] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-08T17:03:52.688690] [DEBUG] [LOCAL ] ADT: Trimmed 77186 records to 53446 (keeping 200 days of data) [2025-10-08T17:03:52.817793] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-08T17:03:53.035541] [DEBUG] [LOCAL ] ADT: Primary data saved (53446 records). [2025-10-08T17:03:53.035756] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-08T17:03:53.035863] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADT took 43.1s. Estimated remaining: 4h 22m 35s. Rate: 8.9 symbols/min [2025-10-08T17:03:53.227620] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:53.288314] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-10-08T17:03:53.288760] [INFO ] [MAIN ] AEM: Loaded 53464 existing records. [2025-10-08T17:03:53.513888] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:53.514173] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-08T17:03:53.514222] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-08T17:03:53.514881] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-08T17:03:53.514938] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-08T17:03:53.619975] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-08T17:03:53.646265] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T17:03:53.973588] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:54.051738] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:03:54.417733] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-08T17:03:55.169053] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:03:55.217574] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-08T17:03:55.812249] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:03:55.813434] [INFO ] [REMOTE ] AEFC: Full fetch complete (11986 records). [2025-10-08T17:03:55.813506] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-08T17:03:56.018135] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-08T17:03:56.293311] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-08T17:03:56.293521] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-08T17:03:56.293817] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-08T17:03:56.293977] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-08T17:03:56.294724] [DEBUG] [LOCAL ] AEFC: Trimmed 11986 records to 8446 (keeping 200 days of data) [2025-10-08T17:03:56.368037] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:03:56.395204] [DEBUG] [LOCAL ] AEFC: Primary data saved (8446 records). [2025-10-08T17:03:56.395350] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-08T17:03:56.395472] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. AEFC took 21.3s. Estimated remaining: 4h 18m 42s. Rate: 9.0 symbols/min [2025-10-08T17:03:56.599670] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:03:56.663435] [DEBUG] [LOCAL ] AEO: Loaded 53560 existing records from primary storage. [2025-10-08T17:03:56.663844] [INFO ] [MAIN ] AEO: Loaded 53560 existing records. [2025-10-08T17:03:56.822766] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-08T17:03:56.901027] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:03:56.901289] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-08T17:03:56.901353] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-08T17:03:56.902322] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-08T17:03:56.902390] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-08T17:03:57.357863] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:03:57.596685] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:03:57.617532] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-08T17:03:58.211610] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:03:58.417624] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-08T17:03:59.156169] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:03:59.217543] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-08T17:04:00.017591] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-08T17:04:00.236831] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T17:04:00.817512] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-08T17:04:00.976303] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T17:04:01.424121] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:04:01.617604] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-08T17:04:02.417595] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-08T17:04:02.671760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T17:04:03.217603] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-08T17:04:03.369799] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T17:04:04.017711] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-08T17:04:04.559764] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-08T17:04:04.817611] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-08T17:04:04.912002] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:04:05.417139] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T17:04:05.617538] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-08T17:04:06.184318] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:04:06.417559] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-08T17:04:07.217564] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-08T17:04:07.450965] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:04:08.017578] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-08T17:04:08.131057] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T17:04:08.675256] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T17:04:08.817590] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-08T17:04:09.617550] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-08T17:04:09.941856] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T17:04:10.314433] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:04:10.417575] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-08T17:04:10.878214] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:04:10.882375] [INFO ] [REMOTE ] AEE: Full fetch complete (72342 records). [2025-10-08T17:04:10.882537] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-08T17:04:10.883962] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:04:10.884103] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:04:10.884151] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:04:10.884249] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-08T17:04:10.884395] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-08T17:04:10.884453] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-08T17:04:10.884755] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-10-08T17:04:10.884859] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 38.4s. Estimated remaining: 4h 27m 4s. Rate: 8.7 symbols/min [2025-10-08T17:04:11.052743] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:11.106902] [DEBUG] [LOCAL ] AER: Loaded 48272 existing records from primary storage. [2025-10-08T17:04:11.107239] [INFO ] [MAIN ] AER: Loaded 48272 existing records. [2025-10-08T17:04:11.222730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-08T17:04:11.293740] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:11.294360] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-08T17:04:11.294421] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-08T17:04:11.294753] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-08T17:04:11.294810] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-08T17:04:11.657781] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:11.993795] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:04:12.017496] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-08T17:04:12.817620] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-08T17:04:13.321071] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T17:04:13.617729] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-08T17:04:13.944738] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:04:14.417571] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-08T17:04:14.809747] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:04:15.047845] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:04:15.217567] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-08T17:04:15.895780] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T17:04:16.017573] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-08T17:04:16.817571] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-08T17:04:17.137314] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:04:17.617574] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-08T17:04:17.780137] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:04:18.027689] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:04:18.417575] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-08T17:04:19.217678] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-08T17:04:19.663087] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T17:04:20.017707] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-08T17:04:20.021351] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:04:20.818692] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-08T17:04:20.834412] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:04:21.617693] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-08T17:04:21.907553] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T17:04:22.417587] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-08T17:04:22.699625] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:04:23.167065] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:04:23.217621] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-08T17:04:23.745704] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:04:23.749576] [INFO ] [REMOTE ] AEG: Full fetch complete (69953 records). [2025-10-08T17:04:23.749758] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-08T17:04:23.751140] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:04:23.751232] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:04:23.751278] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:04:23.751322] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-08T17:04:23.751443] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-08T17:04:23.751502] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-10-08T17:04:23.751960] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-10-08T17:04:23.753450] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 32.3s. Estimated remaining: 4h 33m 16s. Rate: 8.5 symbols/min [2025-10-08T17:04:24.017631] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-08T17:04:24.817581] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-08T17:04:25.223614] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:04:25.617561] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-08T17:04:26.067611] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:04:26.417517] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-08T17:04:26.794011] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T17:04:26.797982] [INFO ] [REMOTE ] AEM: Full fetch complete (77193 records). [2025-10-08T17:04:26.798091] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-08T17:04:27.256295] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-08T17:04:27.256509] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-08T17:04:27.257622] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-08T17:04:27.257740] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-08T17:04:27.294184] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:04:27.292805] [DEBUG] [LOCAL ] AEM: Trimmed 77193 records to 53466 (keeping 200 days of data) [2025-10-08T17:04:27.308215] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-08T17:04:27.708798] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:04:27.732218] [DEBUG] [LOCAL ] AEM: Primary data saved (53466 records). [2025-10-08T17:04:27.732449] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-08T17:04:27.733945] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 34.7s. Estimated remaining: 4h 30m 2s. Rate: 8.6 symbols/min [2025-10-08T17:04:28.017572] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-08T17:04:29.279700] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:04:29.293081] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-08T17:04:29.579578] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:04:29.617567] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-08T17:04:31.083851] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:04:31.094764] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-08T17:04:31.483121] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-08T17:04:31.494740] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-08T17:04:32.350301] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:04:32.360542] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-08T17:04:33.596421] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T17:04:33.613303] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-08T17:04:34.068269] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T17:04:34.078381] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-08T17:04:35.389852] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:04:35.394054] [INFO ] [REMOTE ] AER: Full fetch complete (69583 records). [2025-10-08T17:04:35.394206] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-08T17:04:35.801952] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-08T17:04:35.811404] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-08T17:04:35.813180] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T17:04:35.812738] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-08T17:04:35.816555] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-08T17:04:35.817823] [INFO ] [REMOTE ] AEO: Full fetch complete (77446 records). [2025-10-08T17:04:35.818109] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-08T17:04:35.818231] [DEBUG] [LOCAL ] AER: Trimmed 69583 records to 48212 (keeping 200 days of data) [2025-10-08T17:04:36.336844] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-08T17:04:36.337548] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-08T17:04:36.338976] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-08T17:04:36.339088] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-08T17:04:36.343780] [DEBUG] [LOCAL ] AEO: Trimmed 77446 records to 53563 (keeping 200 days of data) [2025-10-08T17:04:36.877917] [DEBUG] [LOCAL ] AER: Primary data saved (48212 records). [2025-10-08T17:04:36.878120] [INFO ] [MAIN ] AER: Full history saved. [2025-10-08T17:04:36.878267] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 26.0s. Estimated remaining: 4h 32m 7s. Rate: 8.6 symbols/min [2025-10-08T17:04:36.931037] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-08T17:04:36.931284] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-08T17:04:36.931405] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 40.5s. Estimated remaining: 4h 25m 15s. Rate: 8.8 symbols/min [2025-10-08T17:04:37.698398] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.616375] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.701815] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.726403] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:37.727631] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-08T17:04:37.727932] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-08T17:04:37.728502] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-08T17:04:37.728589] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-08T17:04:37.728671] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-08T17:04:37.728739] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-08T17:04:37.878488] [DEBUG] [LOCAL ] AFB: Loaded 11472 existing records from primary storage. [2025-10-08T17:04:37.890416] [INFO ] [MAIN ] AFB: Loaded 11472 existing records. [2025-10-08T17:04:38.299329] [DEBUG] [LOCAL ] AESI: Loaded 49549 existing records from primary storage. [2025-10-08T17:04:38.348548] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.342690] [INFO ] [MAIN ] AESI: Loaded 49549 existing records. [2025-10-08T17:04:38.342781] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-08T17:04:38.359175] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-08T17:04:38.403622] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-08T17:04:38.403741] [INFO ] [MAIN ] AES: Loaded 53671 existing records. [2025-10-08T17:04:38.441430] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-08T17:04:38.478530] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:38.495468] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-08T17:04:38.495565] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-08T17:04:38.774990] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:04:38.867979] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.826781] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-08T17:04:38.925313] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:04:38.959146] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-08T17:04:38.959057] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:38.969759] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-08T17:04:38.925546] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-08T17:04:38.986581] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-08T17:04:39.026766] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:04:39.012309] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-08T17:04:39.026630] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-08T17:04:39.066193] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-08T17:04:39.071552] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-08T17:04:39.092564] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-08T17:04:39.111329] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-08T17:04:39.135956] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-08T17:04:39.132742] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-08T17:04:39.185464] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-08T17:04:39.242023] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 2.3s. Estimated remaining: 4h 20m 52s. Rate: 8.9 symbols/min [2025-10-08T17:04:39.471712] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:39.577999] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-08T17:04:39.760854] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:04:40.060359] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.118944] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-08T17:04:40.124177] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.125306] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-08T17:04:40.126243] [DEBUG] [LOCAL ] AFG: Loaded 32272 existing records from primary storage. [2025-10-08T17:04:40.127102] [INFO ] [MAIN ] AFG: Loaded 32272 existing records. [2025-10-08T17:04:40.311034] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:04:40.311240] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-08T17:04:40.311287] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-08T17:04:40.311669] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-08T17:04:40.311728] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-08T17:04:40.470246] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:04:40.507673] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-08T17:04:40.682798] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:04:40.683152] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-08T17:04:41.244321] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T17:04:41.247425] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-08T17:04:41.826372] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:04:41.829415] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-08T17:04:41.865853] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:04:41.875187] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-08T17:04:41.937612] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T17:04:41.943327] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-08T17:04:42.118493] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T17:04:42.417580] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-08T17:04:42.785180] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:04:42.785557] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T17:04:42.991779] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:04:43.217570] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-08T17:04:44.017511] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-08T17:04:44.131395] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:04:44.660408] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:04:44.817554] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-08T17:04:45.551035] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:04:45.617503] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-08T17:04:45.994875] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T17:04:46.417526] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-08T17:04:47.217507] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-08T17:04:47.252412] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:04:47.300418] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:04:48.017701] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-08T17:04:48.817586] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-08T17:04:49.296895] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T17:04:49.376030] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T17:04:49.617600] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-08T17:04:50.417577] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-08T17:04:50.510948] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:04:51.217540] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-08T17:04:51.352984] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:04:51.564840] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T17:04:52.017566] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-08T17:04:52.276952] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:04:52.817596] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-08T17:04:52.846892] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T17:04:53.617624] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-08T17:04:54.417600] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-08T17:04:54.646426] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:04:54.957948] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T17:04:55.217592] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-08T17:04:55.765905] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:04:56.017554] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-08T17:04:56.146734] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:04:56.817588] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-08T17:04:57.617525] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-08T17:04:57.652235] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:04:58.417583] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-08T17:04:58.703191] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:04:58.940333] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T17:04:59.217623] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-08T17:05:00.021063] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-08T17:05:00.024802] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:05:00.518970] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:05:00.817593] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-08T17:05:00.899322] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:05:01.617800] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-08T17:05:02.417530] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-08T17:05:02.535743] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:05:03.217701] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-08T17:05:03.745943] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-08T17:05:03.806084] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:05:03.810062] [INFO ] [REMOTE ] AFG: Full fetch complete (46217 records). [2025-10-08T17:05:03.810259] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-08T17:05:04.026281] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-08T17:05:04.257911] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-08T17:05:04.258209] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-08T17:05:04.258783] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-08T17:05:04.258851] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-08T17:05:04.260308] [DEBUG] [LOCAL ] AFG: Trimmed 46217 records to 32197 (keeping 200 days of data) [2025-10-08T17:05:04.468947] [DEBUG] [LOCAL ] AFG: Primary data saved (32197 records). [2025-10-08T17:05:04.469129] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-08T17:05:04.469220] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFG took 25.2s. Estimated remaining: 4h 37m 51s. Rate: 8.4 symbols/min [2025-10-08T17:05:04.653875] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:04.659227] [DEBUG] [LOCAL ] AFGB: Loaded 2311 existing records from primary storage. [2025-10-08T17:05:04.659584] [INFO ] [MAIN ] AFGB: Loaded 2311 existing records. [2025-10-08T17:05:04.821225] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-08T17:05:04.859117] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:04.860706] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-08T17:05:04.860819] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-08T17:05:04.861055] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-08T17:05:04.861512] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-08T17:05:05.001453] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:05:05.350187] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:05.617606] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-08T17:05:05.717275] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T17:05:06.221283] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-08T17:05:06.417593] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-08T17:05:07.217628] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-08T17:05:07.267511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:05:07.272319] [INFO ] [REMOTE ] AESI: Full fetch complete (70668 records). [2025-10-08T17:05:07.272565] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-08T17:05:07.715089] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-08T17:05:07.715183] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-08T17:05:07.715887] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-08T17:05:07.715951] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-08T17:05:07.717509] [DEBUG] [LOCAL ] AESI: Trimmed 70668 records to 49557 (keeping 200 days of data) [2025-10-08T17:05:08.027113] [DEBUG] [LOCAL ] AESI: Primary data saved (49557 records). [2025-10-08T17:05:08.027310] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-08T17:05:08.023741] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-08T17:05:08.029413] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 31.1s. Estimated remaining: 4h 34m 29s. Rate: 8.5 symbols/min [2025-10-08T17:05:08.081366] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:05:08.225709] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:08.274474] [DEBUG] [LOCAL ] AFGC: Loaded 2546 existing records from primary storage. [2025-10-08T17:05:08.276201] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:05:08.287438] [INFO ] [MAIN ] AFGC: Loaded 2546 existing records. [2025-10-08T17:05:08.469239] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:08.469520] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-08T17:05:08.469575] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-08T17:05:08.469794] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-08T17:05:08.469855] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-08T17:05:08.832957] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:08.828143] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-08T17:05:09.074149] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T17:05:09.617895] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-08T17:05:10.238818] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T17:05:10.417584] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-08T17:05:10.670277] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:05:10.893246] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T17:05:11.217559] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-08T17:05:11.969592] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:05:11.971817] [INFO ] [REMOTE ] AFB: Full fetch complete (16570 records). [2025-10-08T17:05:11.971970] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-08T17:05:12.022705] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-08T17:05:12.397526] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-08T17:05:12.397623] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-08T17:05:12.397955] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-08T17:05:12.398039] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-08T17:05:12.398871] [DEBUG] [LOCAL ] AFB: Trimmed 16570 records to 11448 (keeping 200 days of data) [2025-10-08T17:05:12.481535] [DEBUG] [LOCAL ] AFB: Primary data saved (11448 records). [2025-10-08T17:05:12.481760] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-08T17:05:12.481889] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AFB took 35.5s. Estimated remaining: 4h 32m 4s. Rate: 8.6 symbols/min [2025-10-08T17:05:12.695112] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:12.700135] [DEBUG] [LOCAL ] AFGD: Loaded 1808 existing records from primary storage. [2025-10-08T17:05:12.700409] [INFO ] [MAIN ] AFGD: Loaded 1808 existing records. [2025-10-08T17:05:12.823056] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-08T17:05:12.939529] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:12.939917] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-08T17:05:12.939979] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-08T17:05:12.940238] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-08T17:05:12.940297] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-08T17:05:13.375268] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T17:05:13.380959] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:13.617553] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-08T17:05:14.054526] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-08T17:05:14.058590] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-08T17:05:14.058734] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-08T17:05:14.161792] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:05:14.425949] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-08T17:05:14.488901] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-08T17:05:14.488989] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-08T17:05:14.489847] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-08T17:05:14.490224] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-08T17:05:14.492220] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 53671 (keeping 200 days of data) [2025-10-08T17:05:14.813505] [DEBUG] [LOCAL ] AES: Primary data saved (53671 records). [2025-10-08T17:05:14.813670] [INFO ] [MAIN ] AES: Full history saved. [2025-10-08T17:05:14.813777] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AES took 37.9s. Estimated remaining: 4h 27m 54s. Rate: 8.7 symbols/min [2025-10-08T17:05:15.003785] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:15.008587] [DEBUG] [LOCAL ] AFGE: Loaded 2430 existing records from primary storage. [2025-10-08T17:05:15.008831] [INFO ] [MAIN ] AFGE: Loaded 2430 existing records. [2025-10-08T17:05:15.199748] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:15.200015] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-08T17:05:15.200063] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-08T17:05:15.200261] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-08T17:05:15.200317] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-08T17:05:15.222609] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-08T17:05:15.263044] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:05:15.582366] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:15.738293] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T17:05:16.017598] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-08T17:05:16.598839] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T17:05:16.817565] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-08T17:05:17.271785] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:05:17.617562] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-08T17:05:18.046152] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:05:18.417576] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-08T17:05:18.965621] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:05:19.217556] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-08T17:05:19.616374] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-08T17:05:20.017600] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-08T17:05:20.656569] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:05:20.817591] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-08T17:05:21.241252] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T17:05:21.617552] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-08T17:05:22.072240] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T17:05:22.417565] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-08T17:05:22.753209] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T17:05:23.217583] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-08T17:05:23.674086] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:05:24.017567] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-08T17:05:24.474270] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T17:05:24.817581] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-08T17:05:25.310612] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T17:05:25.617559] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-08T17:05:25.993346] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T17:05:26.417557] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-08T17:05:26.984284] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:05:27.217550] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-08T17:05:27.725317] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-08T17:05:28.017572] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-08T17:05:28.484086] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:05:28.817548] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-08T17:05:29.403895] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T17:05:29.617610] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-08T17:05:30.169917] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T17:05:30.417608] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-08T17:05:31.217554] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-08T17:05:31.308453] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T17:05:31.788819] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:05:32.017605] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-08T17:05:32.442531] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T17:05:32.817557] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-08T17:05:33.282846] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:05:33.617556] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-08T17:05:34.059393] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T17:05:34.417554] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-08T17:05:34.841933] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T17:05:35.217589] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-08T17:05:35.669120] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:05:36.017568] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-08T17:05:36.561481] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T17:05:36.562254] [INFO ] [REMOTE ] AFGC: Full fetch complete (3701 records). [2025-10-08T17:05:36.562323] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-08T17:05:36.823888] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-08T17:05:36.973829] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-08T17:05:36.973914] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-08T17:05:36.974064] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-08T17:05:36.974125] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-08T17:05:36.974474] [DEBUG] [LOCAL ] AFGC: Trimmed 3701 records to 2549 (keeping 200 days of data) [2025-10-08T17:05:36.990104] [DEBUG] [LOCAL ] AFGC: Primary data saved (2549 records). [2025-10-08T17:05:36.990176] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-08T17:05:36.990252] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGC took 29.0s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-08T17:05:37.155963] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:37.156170] [DEBUG] [LOCAL ] AFL: No existing data file found in primary storage. [2025-10-08T17:05:37.156207] [WARN ] [MAIN ] AFL: No existing data found, performing full refresh instead. [2025-10-08T17:05:37.156357] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-08T17:05:37.156400] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-08T17:05:37.156457] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-08T17:05:37.156491] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-08T17:05:37.494564] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:05:37.615432] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:37.617495] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-08T17:05:38.417560] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-08T17:05:38.967156] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:05:39.193481] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:05:39.217500] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-08T17:05:40.017554] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-08T17:05:40.470383] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T17:05:40.817535] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-08T17:05:40.878781] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:05:41.183101] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:05:41.183860] [INFO ] [REMOTE ] AFGE: Full fetch complete (3460 records). [2025-10-08T17:05:41.183935] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-08T17:05:41.534863] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-08T17:05:41.534943] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-08T17:05:41.535060] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-08T17:05:41.535097] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-08T17:05:41.535434] [DEBUG] [LOCAL ] AFGE: Trimmed 3460 records to 2427 (keeping 200 days of data) [2025-10-08T17:05:41.550833] [DEBUG] [LOCAL ] AFGE: Primary data saved (2427 records). [2025-10-08T17:05:41.550902] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-08T17:05:41.550971] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGE took 26.7s. Estimated remaining: 4h 38m 19s. Rate: 8.4 symbols/min [2025-10-08T17:05:41.622783] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-08T17:05:41.722898] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:41.778519] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-08T17:05:41.779104] [INFO ] [MAIN ] AG: Loaded 53642 existing records. [2025-10-08T17:05:41.962595] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:41.962932] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-08T17:05:41.963019] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-08T17:05:41.963696] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-08T17:05:41.963778] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-08T17:05:42.216374] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T17:05:42.327400] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:42.417520] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-08T17:05:43.217606] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-08T17:05:43.566107] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-08T17:05:44.017521] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-08T17:05:44.519971] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-08T17:05:44.817681] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-08T17:05:45.170103] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T17:05:45.375095] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:05:45.617563] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-08T17:05:45.995856] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T17:05:45.996611] [INFO ] [REMOTE ] AFGD: Full fetch complete (3077 records). [2025-10-08T17:05:45.996706] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-08T17:05:46.374391] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-08T17:05:46.374508] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-08T17:05:46.374672] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-08T17:05:46.374733] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-08T17:05:46.375105] [DEBUG] [LOCAL ] AFGD: Trimmed 3077 records to 1807 (keeping 200 days of data) [2025-10-08T17:05:46.386771] [DEBUG] [LOCAL ] AFGD: Primary data saved (1807 records). [2025-10-08T17:05:46.386867] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-08T17:05:46.386945] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGD took 33.9s. Estimated remaining: 4h 36m 18s. Rate: 8.4 symbols/min [2025-10-08T17:05:46.422632] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-08T17:05:46.589518] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:46.636383] [DEBUG] [LOCAL ] AGCO: Loaded 42359 existing records from primary storage. [2025-10-08T17:05:46.636796] [INFO ] [MAIN ] AGCO: Loaded 42359 existing records. [2025-10-08T17:05:46.851892] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:46.852186] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-08T17:05:46.852248] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-08T17:05:46.852490] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-08T17:05:46.852547] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-08T17:05:47.034173] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:05:47.220302] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-08T17:05:47.220235] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:48.017556] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-08T17:05:48.453530] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T17:05:48.654953] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:05:48.817606] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-08T17:05:49.260290] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T17:05:49.261077] [INFO ] [REMOTE ] AFGB: Full fetch complete (3627 records). [2025-10-08T17:05:49.261146] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-08T17:05:49.613303] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-08T17:05:49.613382] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-08T17:05:49.613498] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-08T17:05:49.613587] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-08T17:05:49.613997] [DEBUG] [LOCAL ] AFGB: Trimmed 3627 records to 2309 (keeping 200 days of data) [2025-10-08T17:05:49.621801] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-08T17:05:49.629843] [DEBUG] [LOCAL ] AFGB: Primary data saved (2309 records). [2025-10-08T17:05:49.629913] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-08T17:05:49.630008] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGB took 45.2s. Estimated remaining: 4h 33m 7s. Rate: 8.5 symbols/min [2025-10-08T17:05:49.801079] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:05:49.819935] [DEBUG] [LOCAL ] AGD: Loaded 18378 existing records from primary storage. [2025-10-08T17:05:49.820205] [INFO ] [MAIN ] AGD: Loaded 18378 existing records. [2025-10-08T17:05:50.000990] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:05:50.001238] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-08T17:05:50.001300] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-08T17:05:50.001458] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-08T17:05:50.001502] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-08T17:05:50.358797] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:05:50.417622] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-08T17:05:51.208424] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:05:51.217737] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-08T17:05:51.421044] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:05:52.017584] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-08T17:05:52.493858] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:05:52.817592] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-08T17:05:53.617577] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-08T17:05:53.754297] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:05:53.800746] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:05:54.417600] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-08T17:05:55.106173] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:05:55.217594] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-08T17:05:56.017606] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-08T17:05:56.498114] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-08T17:05:56.817566] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-08T17:05:56.918463] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T17:05:56.959456] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:05:57.617587] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-08T17:05:58.386251] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T17:05:58.420052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-08T17:05:58.428835] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T17:05:59.217578] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-08T17:06:00.017568] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-08T17:06:00.097178] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:06:00.643287] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:06:00.676414] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:06:00.817603] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-08T17:06:01.617570] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-08T17:06:02.417563] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-08T17:06:02.635267] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:06:03.217547] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-08T17:06:03.450926] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T17:06:03.622445] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T17:06:04.017611] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-08T17:06:04.817519] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-08T17:06:05.227612] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T17:06:05.486230] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:06:05.617564] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-08T17:06:06.417593] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-08T17:06:07.007196] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:06:07.227951] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-08T17:06:07.234561] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:06:08.003243] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:06:08.017509] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-08T17:06:08.817635] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-08T17:06:08.987744] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:06:09.617590] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-08T17:06:09.676906] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T17:06:09.682803] [INFO ] [REMOTE ] AFL: Full fetch complete (76909 records). [2025-10-08T17:06:09.683042] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-08T17:06:10.097334] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-08T17:06:10.097440] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-08T17:06:10.098296] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-08T17:06:10.098405] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-08T17:06:10.100121] [DEBUG] [LOCAL ] AFL: Trimmed 76909 records to 53161 (keeping 200 days of data) [2025-10-08T17:06:10.361703] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:06:10.437853] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-08T17:06:10.489180] [DEBUG] [LOCAL ] AFL: Primary data saved (53161 records). [2025-10-08T17:06:10.489379] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-08T17:06:10.489484] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 33.5s. Estimated remaining: 4h 43m 40s. Rate: 8.2 symbols/min [2025-10-08T17:06:10.657498] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:10.709560] [DEBUG] [LOCAL ] AGI: Loaded 53421 existing records from primary storage. [2025-10-08T17:06:10.709940] [INFO ] [MAIN ] AGI: Loaded 53421 existing records. [2025-10-08T17:06:10.893134] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:10.893433] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-08T17:06:10.893489] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-08T17:06:10.893792] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-08T17:06:10.893851] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-08T17:06:11.218166] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-08T17:06:11.378328] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:11.446090] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T17:06:11.594991] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:06:12.017704] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-08T17:06:12.827192] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-08T17:06:12.835998] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T17:06:13.617519] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-08T17:06:13.843103] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T17:06:14.000248] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:06:14.417696] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-08T17:06:14.806245] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:06:15.217637] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-08T17:06:16.017520] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-08T17:06:16.254900] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:06:16.817516] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-08T17:06:16.909889] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:06:17.028271] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:06:17.617602] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-08T17:06:18.417559] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-08T17:06:18.759240] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T17:06:18.784310] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:06:18.793456] [INFO ] [REMOTE ] AGCO: Full fetch complete (61795 records). [2025-10-08T17:06:18.793747] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-08T17:06:19.217266] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-08T17:06:19.217387] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-08T17:06:19.218038] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-08T17:06:19.218435] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-08T17:06:19.218195] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-08T17:06:19.221039] [DEBUG] [LOCAL ] AGCO: Trimmed 61795 records to 42343 (keeping 200 days of data) [2025-10-08T17:06:19.499508] [DEBUG] [LOCAL ] AGCO: Primary data saved (42343 records). [2025-10-08T17:06:19.499684] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-08T17:06:19.499792] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGCO took 33.1s. Estimated remaining: 4h 44m 49s. Rate: 8.1 symbols/min [2025-10-08T17:06:19.678455] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:19.733207] [DEBUG] [LOCAL ] AGL: Loaded 52486 existing records from primary storage. [2025-10-08T17:06:19.733802] [INFO ] [MAIN ] AGL: Loaded 52486 existing records. [2025-10-08T17:06:19.913956] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:19.914501] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-08T17:06:19.914567] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-08T17:06:19.915083] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-08T17:06:19.915187] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-08T17:06:20.017925] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-08T17:06:20.317778] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:20.357406] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:06:20.372510] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T17:06:20.817572] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-08T17:06:21.617559] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-08T17:06:21.782848] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:06:21.785817] [INFO ] [REMOTE ] AGD: Full fetch complete (25884 records). [2025-10-08T17:06:21.785951] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-08T17:06:22.214530] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-08T17:06:22.214719] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-08T17:06:22.215472] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-08T17:06:22.227753] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-08T17:06:22.250120] [DEBUG] [LOCAL ] AGD: Trimmed 25884 records to 18490 (keeping 200 days of data) [2025-10-08T17:06:22.252864] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-08T17:06:22.383340] [DEBUG] [LOCAL ] AGD: Primary data saved (18490 records). [2025-10-08T17:06:22.383540] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-08T17:06:22.383681] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 32.8s. Estimated remaining: 4h 41m 22s. Rate: 8.2 symbols/min [2025-10-08T17:06:22.427437] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-08T17:06:22.563811] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:22.577251] [DEBUG] [LOCAL ] AGM: Loaded 10397 existing records from primary storage. [2025-10-08T17:06:22.577513] [INFO ] [MAIN ] AGM: Loaded 10397 existing records. [2025-10-08T17:06:22.763877] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:22.764166] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-08T17:06:22.764348] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-08T17:06:22.764555] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-08T17:06:22.764614] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-08T17:06:23.176147] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:23.170558] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:06:23.217546] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-08T17:06:24.017517] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-08T17:06:24.354162] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T17:06:24.824573] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-08T17:06:24.844226] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:06:24.869884] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:06:25.617608] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-08T17:06:26.417615] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-08T17:06:26.793076] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:06:26.797359] [INFO ] [REMOTE ] AG: Full fetch complete (77613 records). [2025-10-08T17:06:26.797578] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-08T17:06:27.227887] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-08T17:06:27.235609] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:06:27.261542] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-08T17:06:27.262119] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-08T17:06:27.265446] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-08T17:06:27.267698] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-08T17:06:27.295962] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T17:06:27.296133] [DEBUG] [LOCAL ] AG: Trimmed 77613 records to 53642 (keeping 200 days of data) [2025-10-08T17:06:27.628169] [DEBUG] [LOCAL ] AG: Primary data saved (53642 records). [2025-10-08T17:06:27.628319] [INFO ] [MAIN ] AG: Full history saved. [2025-10-08T17:06:27.629187] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AG took 46.1s. Estimated remaining: 4h 39m 46s. Rate: 8.3 symbols/min [2025-10-08T17:06:27.800234] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:27.832746] [DEBUG] [LOCAL ] AGO: Loaded 28004 existing records from primary storage. [2025-10-08T17:06:27.833035] [INFO ] [MAIN ] AGO: Loaded 28004 existing records. [2025-10-08T17:06:28.006371] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:28.006632] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-08T17:06:28.006723] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-08T17:06:28.006981] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-08T17:06:28.007037] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-08T17:06:28.027139] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-08T17:06:28.355443] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:28.817554] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-08T17:06:29.054282] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:06:29.258148] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:06:29.440551] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:06:29.617576] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-08T17:06:30.417579] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-08T17:06:30.798303] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:06:31.217583] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-08T17:06:32.017509] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-08T17:06:32.049467] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:06:32.444358] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T17:06:32.457514] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T17:06:32.817636] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-08T17:06:33.617580] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-08T17:06:33.660168] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T17:06:34.417590] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-08T17:06:35.217596] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-08T17:06:35.367225] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:06:35.427136] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:06:35.871578] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T17:06:36.017571] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-08T17:06:36.817568] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-08T17:06:37.617544] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-08T17:06:37.885243] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:06:38.325978] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:06:38.417549] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-08T17:06:38.672755] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T17:06:39.050386] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T17:06:39.217593] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-08T17:06:39.906326] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:06:40.017562] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-08T17:06:40.817570] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-08T17:06:41.617521] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-08T17:06:41.856332] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T17:06:42.417537] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-08T17:06:42.472148] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:06:42.515359] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T17:06:43.217618] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-08T17:06:44.017532] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-08T17:06:44.328936] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T17:06:44.804116] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T17:06:44.805577] [INFO ] [REMOTE ] AGM: Full fetch complete (13026 records). [2025-10-08T17:06:44.805679] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-08T17:06:44.826597] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-08T17:06:45.224253] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-08T17:06:45.224479] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-08T17:06:45.225409] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-08T17:06:45.235984] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-08T17:06:45.257039] [DEBUG] [LOCAL ] AGM: Trimmed 13026 records to 10458 (keeping 200 days of data) [2025-10-08T17:06:45.259178] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:06:45.346277] [DEBUG] [LOCAL ] AGM: Primary data saved (10458 records). [2025-10-08T17:06:45.346452] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-08T17:06:45.346592] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 23.0s. Estimated remaining: 4h 47m 8s. Rate: 8.1 symbols/min [2025-10-08T17:06:45.533636] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:45.570255] [DEBUG] [LOCAL ] AGRO: Loaded 33319 existing records from primary storage. [2025-10-08T17:06:45.570748] [INFO ] [MAIN ] AGRO: Loaded 33319 existing records. [2025-10-08T17:06:45.624678] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-08T17:06:45.756978] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:45.757217] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-08T17:06:45.757284] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-08T17:06:45.757504] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-08T17:06:45.757563] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-08T17:06:46.142220] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:46.417560] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-08T17:06:46.733038] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T17:06:46.811708] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:06:47.217588] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-08T17:06:48.017601] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-08T17:06:48.275426] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:06:48.817624] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-08T17:06:49.116903] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T17:06:49.175953] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T17:06:49.617601] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-08T17:06:49.989691] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:06:50.417554] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-08T17:06:51.027696] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:06:51.217531] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-08T17:06:51.677486] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:06:52.017558] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-08T17:06:52.817511] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-08T17:06:52.964397] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:06:53.065306] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:06:53.617694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-08T17:06:53.924195] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:06:54.417569] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-08T17:06:54.523595] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T17:06:55.217602] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-08T17:06:55.789528] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:06:56.017603] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-08T17:06:56.671096] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:06:56.675198] [INFO ] [REMOTE ] AGL: Full fetch complete (75588 records). [2025-10-08T17:06:56.675331] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-08T17:06:56.822676] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-08T17:06:57.078022] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-08T17:06:57.078109] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-08T17:06:57.078880] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-08T17:06:57.078946] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-08T17:06:57.080429] [DEBUG] [LOCAL ] AGL: Trimmed 75588 records to 52495 (keeping 200 days of data) [2025-10-08T17:06:57.382926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:06:57.400048] [DEBUG] [LOCAL ] AGL: Primary data saved (52495 records). [2025-10-08T17:06:57.400184] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-08T17:06:57.400280] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGL took 37.9s. Estimated remaining: 4h 50m 15s. Rate: 8.0 symbols/min [2025-10-08T17:06:57.577547] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:57.610625] [DEBUG] [LOCAL ] AGX: Loaded 33141 existing records from primary storage. [2025-10-08T17:06:57.610947] [INFO ] [MAIN ] AGX: Loaded 33141 existing records. [2025-10-08T17:06:57.623477] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-08T17:06:57.792236] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:57.792468] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-08T17:06:57.792514] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-08T17:06:57.792746] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-08T17:06:57.792803] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-08T17:06:58.150209] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:06:58.418114] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-08T17:06:58.572939] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T17:06:58.578881] [INFO ] [REMOTE ] AGI: Full fetch complete (76899 records). [2025-10-08T17:06:58.579066] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-08T17:06:59.022234] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:06:59.028779] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-08T17:06:59.029263] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-08T17:06:59.030287] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-08T17:06:59.030378] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-08T17:06:59.032581] [DEBUG] [LOCAL ] AGI: Trimmed 76899 records to 53420 (keeping 200 days of data) [2025-10-08T17:06:59.225456] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-08T17:06:59.375716] [DEBUG] [LOCAL ] AGI: Primary data saved (53420 records). [2025-10-08T17:06:59.375946] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-08T17:06:59.376084] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGI took 48.9s. Estimated remaining: 4h 46m 18s. Rate: 8.1 symbols/min [2025-10-08T17:06:59.550757] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:06:59.588751] [DEBUG] [LOCAL ] AHH: Loaded 40837 existing records from primary storage. [2025-10-08T17:06:59.589081] [INFO ] [MAIN ] AHH: Loaded 40837 existing records. [2025-10-08T17:06:59.763857] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:06:59.764077] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-08T17:06:59.764124] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-08T17:06:59.764392] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-08T17:06:59.764451] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-08T17:07:00.030060] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-08T17:07:00.123697] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:00.160990] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:07:00.409436] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:07:00.411892] [INFO ] [REMOTE ] AGO: Full fetch complete (39427 records). [2025-10-08T17:07:00.411971] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-08T17:07:00.818331] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-08T17:07:00.828964] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-08T17:07:00.829029] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-08T17:07:00.829468] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-08T17:07:00.829530] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-08T17:07:00.830592] [DEBUG] [LOCAL ] AGO: Trimmed 39427 records to 27924 (keeping 200 days of data) [2025-10-08T17:07:01.000424] [DEBUG] [LOCAL ] AGO: Primary data saved (27924 records). [2025-10-08T17:07:01.000564] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-08T17:07:01.001435] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGO took 33.4s. Estimated remaining: 4h 42m 16s. Rate: 8.2 symbols/min [2025-10-08T17:07:01.168005] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:01.168219] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-08T17:07:01.168262] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-08T17:07:01.168401] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-08T17:07:01.168454] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-08T17:07:01.168497] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-08T17:07:01.168529] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-08T17:07:01.534537] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:01.607392] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:07:01.617497] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-08T17:07:02.331937] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:07:02.417566] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-08T17:07:02.621046] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:07:02.621397] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-08T17:07:02.621493] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:07:02.621540] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-08T17:07:02.621611] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:07:02.621721] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-08T17:07:02.621818] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-08T17:07:02.621874] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-08T17:07:02.621944] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-08T17:07:02.622016] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AHL took 1.6s. Estimated remaining: 4h 38m 21s. Rate: 8.3 symbols/min [2025-10-08T17:07:02.815031] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:02.866505] [DEBUG] [LOCAL ] AHR: Loaded 49135 existing records from primary storage. [2025-10-08T17:07:02.867162] [INFO ] [MAIN ] AHR: Loaded 49135 existing records. [2025-10-08T17:07:03.050540] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:03.050858] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-08T17:07:03.051015] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-08T17:07:03.051523] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-08T17:07:03.051585] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-08T17:07:03.227927] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-08T17:07:03.450680] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:03.473491] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T17:07:04.017585] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-08T17:07:04.428557] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:07:04.817560] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-08T17:07:05.617577] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-08T17:07:05.765743] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:07:05.943139] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T17:07:06.417621] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-08T17:07:07.026254] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:07:07.217704] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-08T17:07:07.851821] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:07:08.017619] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-08T17:07:08.563614] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:07:08.817620] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-08T17:07:09.531831] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:07:09.617687] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-08T17:07:09.898851] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:07:10.417626] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-08T17:07:11.111629] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:07:11.217598] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-08T17:07:11.706998] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T17:07:12.017600] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-08T17:07:12.646175] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:07:12.817579] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-08T17:07:13.562938] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:07:13.617571] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-08T17:07:13.996928] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:07:14.417588] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-08T17:07:15.118498] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:07:15.217561] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-08T17:07:15.908287] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:07:16.017544] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-08T17:07:16.817548] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-08T17:07:16.897520] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:07:17.513313] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T17:07:17.617569] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-08T17:07:18.417526] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-08T17:07:18.514719] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:07:19.217571] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-08T17:07:19.308204] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:07:19.709621] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:07:20.017608] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-08T17:07:20.817535] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-08T17:07:20.925710] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:07:21.333084] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:07:21.617564] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-08T17:07:22.417624] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-08T17:07:22.450435] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:07:22.453769] [INFO ] [REMOTE ] AGRO: Full fetch complete (49136 records). [2025-10-08T17:07:22.454046] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-08T17:07:22.474370] [FATAL] [VALIDATOR ] AGRO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:07:22.477197] [FATAL] [MAIN ] AGRO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:07:22.477787] [WARN ] [MAIN ] AGRO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:07:22.479356] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T17:07:22.479434] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-08T17:07:22.487528] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-08T17:07:22.487635] [INFO ] [LOCAL ] AGRO: Starting deletion of derivative data. [2025-10-08T17:07:22.488287] [DEBUG] [LOCAL ] AGRO: Deleted derivative data file. [2025-10-08T17:07:22.488420] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 37.1s. Estimated remaining: 4h 46m 30s. Rate: 8.1 symbols/min [2025-10-08T17:07:22.708523] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:22.708860] [DEBUG] [LOCAL ] AHT: No existing data file found in primary storage. [2025-10-08T17:07:22.708919] [WARN ] [MAIN ] AHT: No existing data found, performing full refresh instead. [2025-10-08T17:07:22.709051] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-08T17:07:22.709094] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-08T17:07:22.709137] [DEBUG] [LOCAL ] AHT: No primary data file found to delete. [2025-10-08T17:07:22.709173] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-08T17:07:23.137906] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:23.217562] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-08T17:07:23.734689] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:07:24.017600] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-08T17:07:24.817547] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-08T17:07:24.872251] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T17:07:25.376800] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T17:07:25.562769] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:07:25.617589] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-08T17:07:26.417627] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-08T17:07:27.158035] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:07:27.217625] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-08T17:07:27.564736] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:07:28.017595] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-08T17:07:28.257396] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T17:07:28.259764] [INFO ] [REMOTE ] AGX: Full fetch complete (48639 records). [2025-10-08T17:07:28.259853] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-08T17:07:28.653081] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-08T17:07:28.653186] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-08T17:07:28.653893] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-08T17:07:28.653993] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-08T17:07:28.655339] [DEBUG] [LOCAL ] AGX: Trimmed 48639 records to 33176 (keeping 200 days of data) [2025-10-08T17:07:28.844500] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-08T17:07:28.903531] [DEBUG] [LOCAL ] AGX: Primary data saved (33176 records). [2025-10-08T17:07:28.903745] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-08T17:07:28.903887] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AGX took 31.5s. Estimated remaining: 4h 45m 43s. Rate: 8.1 symbols/min [2025-10-08T17:07:29.117013] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:29.117219] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-08T17:07:29.117273] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-08T17:07:29.117399] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-08T17:07:29.117440] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-08T17:07:29.117481] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-08T17:07:29.117512] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-08T17:07:29.573855] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:29.598079] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:07:29.617495] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-08T17:07:30.323278] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:07:30.417575] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-08T17:07:31.037527] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:07:31.217559] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-08T17:07:32.017528] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-08T17:07:32.198303] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:07:32.202846] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:07:32.217361] [INFO ] [REMOTE ] AHH: Full fetch complete (60018 records). [2025-10-08T17:07:32.217539] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-08T17:07:32.607446] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-08T17:07:32.607566] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-08T17:07:32.608209] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-08T17:07:32.608273] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-08T17:07:32.609619] [DEBUG] [LOCAL ] AHH: Trimmed 60018 records to 40772 (keeping 200 days of data) [2025-10-08T17:07:32.700074] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T17:07:32.818023] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-08T17:07:32.860154] [DEBUG] [LOCAL ] AHH: Primary data saved (40772 records). [2025-10-08T17:07:32.860300] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-08T17:07:32.861430] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHH took 33.5s. Estimated remaining: 4h 43m 24s. Rate: 8.2 symbols/min [2025-10-08T17:07:33.030483] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:33.092112] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-08T17:07:33.092495] [INFO ] [MAIN ] AIG: Loaded 53474 existing records. [2025-10-08T17:07:33.277620] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:33.277872] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-08T17:07:33.277919] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-08T17:07:33.278346] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-08T17:07:33.278425] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-08T17:07:33.618749] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-08T17:07:33.648665] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:34.332908] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:07:34.336712] [INFO ] [REMOTE ] AHR: Full fetch complete (70776 records). [2025-10-08T17:07:34.336835] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-08T17:07:34.425616] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-08T17:07:34.730671] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-08T17:07:34.730837] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-08T17:07:34.731534] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-08T17:07:34.731578] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-08T17:07:34.734709] [DEBUG] [LOCAL ] AHR: Trimmed 70776 records to 49109 (keeping 200 days of data) [2025-10-08T17:07:35.040926] [DEBUG] [LOCAL ] AHR: Primary data saved (49109 records). [2025-10-08T17:07:35.041081] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-08T17:07:35.041169] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 32.4s. Estimated remaining: 4h 40m 4s. Rate: 8.2 symbols/min [2025-10-08T17:07:35.157628] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T17:07:35.224001] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-08T17:07:35.223917] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:35.224355] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-08T17:07:35.225023] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-08T17:07:35.225183] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-08T17:07:35.225228] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-08T17:07:35.225268] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-08T17:07:35.225301] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-08T17:07:35.595032] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:35.958417] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:07:36.017620] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-08T17:07:36.295185] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-08T17:07:36.817623] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-08T17:07:37.455999] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:07:37.622693] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-08T17:07:37.639982] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:07:38.260159] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:07:38.417614] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-08T17:07:39.138707] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:07:39.217556] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-08T17:07:40.017580] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-08T17:07:40.817622] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-08T17:07:41.008289] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:07:41.008698] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-08T17:07:41.008817] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:07:41.008868] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-08T17:07:41.008926] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:07:41.009018] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-08T17:07:41.009119] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-08T17:07:41.009195] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-08T17:07:41.009276] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-08T17:07:41.009354] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AII took 6.0s. Estimated remaining: 4h 39m 9s. Rate: 8.3 symbols/min [2025-10-08T17:07:41.196902] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:41.223192] [DEBUG] [LOCAL ] AIN: Loaded 24587 existing records from primary storage. [2025-10-08T17:07:41.223522] [INFO ] [MAIN ] AIN: Loaded 24587 existing records. [2025-10-08T17:07:41.449746] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:41.450883] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-08T17:07:41.451146] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-08T17:07:41.451658] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-08T17:07:41.451813] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-08T17:07:41.625186] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-08T17:07:41.747932] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-08T17:07:41.915735] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:41.955281] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:07:42.417562] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-08T17:07:42.508279] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:07:43.217578] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-08T17:07:44.017628] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-08T17:07:44.477013] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T17:07:44.496271] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:07:44.530600] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T17:07:44.817575] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-08T17:07:45.617591] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-08T17:07:45.888908] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:07:46.417577] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-08T17:07:47.217629] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-08T17:07:47.398439] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:07:47.800268] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T17:07:48.017607] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-08T17:07:48.677898] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:07:48.817572] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-08T17:07:49.148162] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:07:49.617630] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-08T17:07:50.394460] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T17:07:50.417513] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-08T17:07:50.649900] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:07:51.217543] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-08T17:07:52.017584] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-08T17:07:52.481755] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:07:52.643309] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-08T17:07:52.817567] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-08T17:07:53.578468] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T17:07:53.617532] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-08T17:07:54.417571] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-08T17:07:54.836923] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T17:07:55.031679] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:07:55.049889] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T17:07:55.051294] [INFO ] [REMOTE ] AHT: Full fetch complete (9266 records). [2025-10-08T17:07:55.051387] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-08T17:07:55.218780] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-08T17:07:55.429624] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-08T17:07:55.429735] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-08T17:07:55.429930] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-08T17:07:55.429990] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-08T17:07:55.430405] [DEBUG] [LOCAL ] AHT: Trimmed 9266 records to 6227 (keeping 200 days of data) [2025-10-08T17:07:55.464839] [DEBUG] [LOCAL ] AHT: Primary data saved (6227 records). [2025-10-08T17:07:55.464928] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-08T17:07:55.464993] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AHT took 33.0s. Estimated remaining: 4h 43m 21s. Rate: 8.1 symbols/min [2025-10-08T17:07:55.650776] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:07:55.668564] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-08T17:07:55.668992] [INFO ] [MAIN ] AIO: Loaded 13422 existing records. [2025-10-08T17:07:55.862435] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:07:55.862746] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-08T17:07:55.862804] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-08T17:07:55.863167] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-08T17:07:55.863225] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-08T17:07:56.035397] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-08T17:07:56.217507] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:07:56.817524] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-08T17:07:57.096729] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T17:07:57.617532] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-08T17:07:57.855161] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T17:07:57.967693] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:07:58.417569] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-08T17:07:58.557747] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:07:59.217688] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-08T17:07:59.835638] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T17:08:00.017623] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-08T17:08:00.817569] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-08T17:08:01.159226] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T17:08:01.296384] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-08T17:08:01.617551] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-08T17:08:02.417576] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-08T17:08:02.610926] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:08:02.735507] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:08:03.022987] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T17:08:03.217566] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-08T17:08:04.017554] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-08T17:08:04.817512] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-08T17:08:05.047633] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:08:05.276410] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:08:05.617574] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-08T17:08:06.417563] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-08T17:08:07.207009] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:08:07.217581] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-08T17:08:07.373407] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-08T17:08:07.527718] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:08:07.954039] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:08:08.017505] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-08T17:08:08.817570] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-08T17:08:09.105402] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:08:09.107966] [INFO ] [REMOTE ] AIN: Full fetch complete (33541 records). [2025-10-08T17:08:09.108065] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-08T17:08:09.511879] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-08T17:08:09.512005] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-08T17:08:09.512404] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-08T17:08:09.512448] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-08T17:08:09.513472] [DEBUG] [LOCAL ] AIN: Trimmed 33541 records to 24522 (keeping 200 days of data) [2025-10-08T17:08:09.617775] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-08T17:08:09.668310] [DEBUG] [LOCAL ] AIN: Primary data saved (24522 records). [2025-10-08T17:08:09.668482] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-08T17:08:09.668577] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AIN took 28.7s. Estimated remaining: 4h 47m 16s. Rate: 8.0 symbols/min [2025-10-08T17:08:09.835451] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:09.862827] [DEBUG] [LOCAL ] AIR: Loaded 28749 existing records from primary storage. [2025-10-08T17:08:09.863111] [INFO ] [MAIN ] AIR: Loaded 28749 existing records. [2025-10-08T17:08:10.054201] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:10.054528] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-08T17:08:10.054590] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-08T17:08:10.054874] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-08T17:08:10.054933] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-08T17:08:10.420912] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-08T17:08:10.424800] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:10.617372] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:08:10.623961] [INFO ] [REMOTE ] AIG: Full fetch complete (77384 records). [2025-10-08T17:08:10.624177] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-08T17:08:11.033449] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-08T17:08:11.033562] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-08T17:08:11.034365] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-08T17:08:11.034438] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-08T17:08:11.036387] [DEBUG] [LOCAL ] AIG: Trimmed 77384 records to 53474 (keeping 200 days of data) [2025-10-08T17:08:11.222395] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-08T17:08:11.384818] [DEBUG] [LOCAL ] AIG: Primary data saved (53474 records). [2025-10-08T17:08:11.384986] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-08T17:08:11.386028] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIG took 38.5s. Estimated remaining: 4h 43m 48s. Rate: 8.1 symbols/min [2025-10-08T17:08:11.569410] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:11.587161] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:08:11.628695] [DEBUG] [LOCAL ] AIT: Loaded 27197 existing records from primary storage. [2025-10-08T17:08:11.629328] [INFO ] [MAIN ] AIT: Loaded 27197 existing records. [2025-10-08T17:08:11.825142] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:11.825570] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-08T17:08:11.825714] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-08T17:08:11.826068] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-08T17:08:11.826223] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-08T17:08:12.043161] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-08T17:08:12.187412] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-08T17:08:12.315794] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:12.330011] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:08:12.817542] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-08T17:08:13.021341] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:08:13.617520] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-08T17:08:14.002510] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:08:14.417608] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-08T17:08:15.017242] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:08:15.217593] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-08T17:08:16.017536] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-08T17:08:16.062920] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:08:16.560360] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T17:08:16.817534] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-08T17:08:17.064883] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-08T17:08:17.069361] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-08T17:08:17.069587] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-08T17:08:17.483402] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-08T17:08:17.483491] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-08T17:08:17.484244] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-08T17:08:17.484364] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-08T17:08:17.488262] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 53755 (keeping 200 days of data) [2025-10-08T17:08:17.617731] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-08T17:08:17.856622] [DEBUG] [LOCAL ] AI: Primary data saved (53755 records). [2025-10-08T17:08:17.856825] [INFO ] [MAIN ] AI: Full history saved. [2025-10-08T17:08:17.856934] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AI took 49.0s. Estimated remaining: 4h 43m 9s. Rate: 8.1 symbols/min [2025-10-08T17:08:18.028514] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:18.066493] [DEBUG] [LOCAL ] AIV: Loaded 40863 existing records from primary storage. [2025-10-08T17:08:18.066851] [INFO ] [MAIN ] AIV: Loaded 40863 existing records. [2025-10-08T17:08:18.199557] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:08:18.302819] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:18.303263] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-08T17:08:18.303382] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-08T17:08:18.311770] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-08T17:08:18.312498] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-08T17:08:18.312946] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T17:08:18.422696] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-08T17:08:18.705231] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:19.217606] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-08T17:08:19.759371] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:08:20.017603] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-08T17:08:20.756388] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:08:20.817511] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-08T17:08:20.885112] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:08:21.617593] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-08T17:08:22.374824] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:08:22.417501] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-08T17:08:22.439130] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:08:23.217620] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-08T17:08:23.347685] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:08:24.017563] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-08T17:08:24.502908] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:08:24.817512] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-08T17:08:24.908811] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T17:08:25.617562] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-08T17:08:26.211083] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:08:26.213424] [INFO ] [REMOTE ] AIO: Full fetch complete (20145 records). [2025-10-08T17:08:26.213561] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-08T17:08:26.368427] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:08:26.423251] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-08T17:08:26.662922] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-08T17:08:26.663033] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-08T17:08:26.663377] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-08T17:08:26.663424] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-08T17:08:26.664073] [DEBUG] [LOCAL ] AIO: Trimmed 20145 records to 13421 (keeping 200 days of data) [2025-10-08T17:08:26.752455] [DEBUG] [LOCAL ] AIO: Primary data saved (13421 records). [2025-10-08T17:08:26.752597] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-08T17:08:26.752705] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 31.3s. Estimated remaining: 4h 43m 53s. Rate: 8.1 symbols/min [2025-10-08T17:08:26.920180] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:26.952118] [DEBUG] [LOCAL ] AIZ: Loaded 29798 existing records from primary storage. [2025-10-08T17:08:26.952410] [INFO ] [MAIN ] AIZ: Loaded 29798 existing records. [2025-10-08T17:08:27.126601] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:27.126860] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-08T17:08:27.126908] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-08T17:08:27.127196] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-08T17:08:27.127253] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-08T17:08:27.222957] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-08T17:08:27.483592] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:27.660409] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:08:28.017621] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-08T17:08:28.555731] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:08:28.817572] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-08T17:08:29.322205] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T17:08:29.540279] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:08:29.617581] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-08T17:08:30.417588] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-08T17:08:30.699304] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:08:31.217605] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-08T17:08:31.828857] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:08:32.017560] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-08T17:08:32.610815] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T17:08:32.817619] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-08T17:08:33.491679] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:08:33.617528] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-08T17:08:34.109784] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:08:34.417577] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-08T17:08:35.018969] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:08:35.217620] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-08T17:08:35.558848] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T17:08:36.017591] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-08T17:08:36.275890] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T17:08:36.817564] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-08T17:08:37.295866] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:08:37.617607] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-08T17:08:38.249382] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:08:38.417579] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-08T17:08:38.725671] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:08:39.217566] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-08T17:08:39.709318] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T17:08:39.712848] [INFO ] [REMOTE ] AIR: Full fetch complete (39700 records). [2025-10-08T17:08:39.713024] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-08T17:08:40.020507] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-08T17:08:40.117123] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-08T17:08:40.117227] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-08T17:08:40.117779] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-08T17:08:40.117845] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-08T17:08:40.119553] [DEBUG] [LOCAL ] AIR: Trimmed 39700 records to 28818 (keeping 200 days of data) [2025-10-08T17:08:40.302446] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:08:40.319146] [DEBUG] [LOCAL ] AIR: Primary data saved (28818 records). [2025-10-08T17:08:40.319319] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-08T17:08:40.319431] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 30.7s. Estimated remaining: 4h 47m 11s. Rate: 8.0 symbols/min [2025-10-08T17:08:40.495074] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:40.502691] [DEBUG] [LOCAL ] AIZN: Loaded 4050 existing records from primary storage. [2025-10-08T17:08:40.502973] [INFO ] [MAIN ] AIZN: Loaded 4050 existing records. [2025-10-08T17:08:40.712320] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:40.712604] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-08T17:08:40.712691] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-08T17:08:40.712898] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-08T17:08:40.712961] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-08T17:08:40.817614] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-08T17:08:41.104831] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:41.617521] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-08T17:08:41.779031] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:08:41.833177] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T17:08:41.835207] [INFO ] [REMOTE ] AIT: Full fetch complete (39208 records). [2025-10-08T17:08:41.835293] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-08T17:08:42.205272] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-08T17:08:42.205353] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-08T17:08:42.205808] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-08T17:08:42.205869] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-08T17:08:42.206831] [DEBUG] [LOCAL ] AIT: Trimmed 39208 records to 27109 (keeping 200 days of data) [2025-10-08T17:08:42.377629] [DEBUG] [LOCAL ] AIT: Primary data saved (27109 records). [2025-10-08T17:08:42.377795] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-08T17:08:42.377893] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIT took 31.0s. Estimated remaining: 4h 44m 5s. Rate: 8.1 symbols/min [2025-10-08T17:08:42.422828] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-08T17:08:42.553190] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:42.603318] [DEBUG] [LOCAL ] AJG: Loaded 46742 existing records from primary storage. [2025-10-08T17:08:42.603703] [INFO ] [MAIN ] AJG: Loaded 46742 existing records. [2025-10-08T17:08:42.788080] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:08:42.788333] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-08T17:08:42.788442] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-08T17:08:42.788813] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-08T17:08:42.788874] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-08T17:08:43.159329] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:43.179223] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:08:43.217501] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-08T17:08:43.454376] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:08:44.017543] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-08T17:08:44.259845] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:08:44.817563] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-08T17:08:45.290009] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:08:45.525555] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:08:45.617583] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-08T17:08:46.417633] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-08T17:08:46.951378] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:08:47.124109] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:08:47.217605] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-08T17:08:48.017575] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-08T17:08:48.652422] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:08:48.817544] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-08T17:08:49.308243] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:08:49.617567] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-08T17:08:50.152238] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:08:50.417572] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-08T17:08:51.217604] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-08T17:08:51.597878] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T17:08:51.708916] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:08:52.019269] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-08T17:08:52.024128] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T17:08:52.817564] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-08T17:08:53.622753] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-08T17:08:53.643904] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:08:54.377620] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:08:54.381850] [INFO ] [REMOTE ] AIV: Full fetch complete (60121 records). [2025-10-08T17:08:54.382010] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-08T17:08:54.424975] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-08T17:08:54.858041] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-08T17:08:54.858212] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-08T17:08:54.859313] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-08T17:08:54.859548] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-08T17:08:54.867767] [DEBUG] [LOCAL ] AIV: Trimmed 60121 records to 40918 (keeping 200 days of data) [2025-10-08T17:08:54.880774] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:08:54.976961] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:08:55.124218] [DEBUG] [LOCAL ] AIV: Primary data saved (40918 records). [2025-10-08T17:08:55.124360] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-08T17:08:55.124453] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 37.3s. Estimated remaining: 4h 46m 51s. Rate: 8.0 symbols/min [2025-10-08T17:08:55.225474] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-08T17:08:55.301459] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:08:55.301685] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-08T17:08:55.301741] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-08T17:08:55.301859] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-08T17:08:55.301900] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-08T17:08:55.301941] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-08T17:08:55.301973] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-08T17:08:55.664456] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:08:56.017639] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-08T17:08:56.607507] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T17:08:56.607194] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T17:08:56.817587] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-08T17:08:57.324067] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-08T17:08:57.617618] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-08T17:08:58.238450] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:08:58.417563] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-08T17:08:59.217568] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-08T17:08:59.528029] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:08:59.744055] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T17:09:00.017576] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-08T17:09:00.511688] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T17:09:00.817553] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-08T17:09:01.617597] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-08T17:09:01.943275] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T17:09:02.165833] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:09:02.168195] [INFO ] [REMOTE ] AIZ: Full fetch complete (42857 records). [2025-10-08T17:09:02.168315] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-08T17:09:02.422775] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-08T17:09:02.556627] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-08T17:09:02.556784] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-08T17:09:02.557276] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-08T17:09:02.557320] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-08T17:09:02.558519] [DEBUG] [LOCAL ] AIZ: Trimmed 42857 records to 29684 (keeping 200 days of data) [2025-10-08T17:09:02.757428] [DEBUG] [LOCAL ] AIZ: Primary data saved (29684 records). [2025-10-08T17:09:02.757579] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-08T17:09:02.757695] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIZ took 36.0s. Estimated remaining: 4h 46m 48s. Rate: 8.0 symbols/min [2025-10-08T17:09:02.926626] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:02.971120] [DEBUG] [LOCAL ] AKR: Loaded 45872 existing records from primary storage. [2025-10-08T17:09:02.971492] [INFO ] [MAIN ] AKR: Loaded 45872 existing records. [2025-10-08T17:09:03.137935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T17:09:03.160394] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:03.161126] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-08T17:09:03.161223] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-08T17:09:03.161674] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-08T17:09:03.161736] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-08T17:09:03.228016] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-08T17:09:03.575517] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:04.017560] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-08T17:09:04.582212] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:09:04.817568] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-08T17:09:04.994782] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:09:05.617553] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-08T17:09:06.145100] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T17:09:06.417606] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-08T17:09:06.571866] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:09:07.217505] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-08T17:09:07.337032] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:09:07.338069] [INFO ] [REMOTE ] AIZN: Full fetch complete (5928 records). [2025-10-08T17:09:07.338138] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-08T17:09:07.707000] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-08T17:09:07.707103] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-08T17:09:07.707349] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-08T17:09:07.707391] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-08T17:09:07.707815] [DEBUG] [LOCAL ] AIZN: Trimmed 5928 records to 4106 (keeping 200 days of data) [2025-10-08T17:09:07.734241] [DEBUG] [LOCAL ] AIZN: Primary data saved (4106 records). [2025-10-08T17:09:07.734371] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-08T17:09:07.734456] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZN took 27.4s. Estimated remaining: 4h 45m 22s. Rate: 8.1 symbols/min [2025-10-08T17:09:07.906295] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:07.958866] [DEBUG] [LOCAL ] AL: Loaded 44440 existing records from primary storage. [2025-10-08T17:09:07.959282] [INFO ] [MAIN ] AL: Loaded 44440 existing records. [2025-10-08T17:09:08.022670] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-08T17:09:08.144845] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:08.145098] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-08T17:09:08.145153] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-08T17:09:08.145511] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-08T17:09:08.145569] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-08T17:09:08.522503] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:08.629854] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T17:09:08.629737] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:09:08.817547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-08T17:09:09.360778] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T17:09:09.617555] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-08T17:09:10.417597] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-08T17:09:11.217558] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-08T17:09:11.292866] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:09:11.798294] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T17:09:11.994512] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:09:12.017509] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-08T17:09:12.817614] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-08T17:09:13.617531] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-08T17:09:13.803166] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:09:14.322905] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:09:14.346417] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:09:14.417517] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-08T17:09:15.217602] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-08T17:09:15.600028] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T17:09:15.847482] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:09:16.017556] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-08T17:09:16.817575] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-08T17:09:17.228942] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:09:17.330036] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T17:09:17.617612] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-08T17:09:18.417605] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-08T17:09:19.107358] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:09:19.217575] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-08T17:09:20.017530] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-08T17:09:20.051162] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:09:20.471401] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:09:20.588411] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:09:20.817559] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-08T17:09:21.617573] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-08T17:09:21.872082] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:09:22.417566] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-08T17:09:23.217572] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-08T17:09:23.378013] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:09:23.541269] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:09:24.017597] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-08T17:09:24.817605] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-08T17:09:24.966390] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:09:25.341760] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T17:09:25.617580] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-08T17:09:26.323335] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:09:26.417590] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-08T17:09:27.215175] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T17:09:27.224517] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-08T17:09:27.700312] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T17:09:27.701505] [INFO ] [REMOTE ] AKA: Full fetch complete (2417 records). [2025-10-08T17:09:27.701721] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-08T17:09:27.914913] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T17:09:27.915308] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:09:27.915534] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:09:27.915686] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-08T17:09:27.916011] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-08T17:09:27.916123] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-08T17:09:27.916314] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-08T17:09:27.916445] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 32.8s. Estimated remaining: 4h 51m 50s. Rate: 7.9 symbols/min [2025-10-08T17:09:28.022547] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-08T17:09:28.096833] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:28.127304] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T17:09:28.181001] [DEBUG] [LOCAL ] ALB: Loaded 53275 existing records from primary storage. [2025-10-08T17:09:28.181418] [INFO ] [MAIN ] ALB: Loaded 53275 existing records. [2025-10-08T17:09:28.358205] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:28.358471] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-08T17:09:28.358525] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-08T17:09:28.358784] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-08T17:09:28.358842] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-08T17:09:28.707213] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:28.817581] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-08T17:09:29.617540] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-08T17:09:29.754232] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:09:30.417564] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-08T17:09:30.814982] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T17:09:31.217563] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-08T17:09:31.406705] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:09:31.618214] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:09:32.017735] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-08T17:09:32.817526] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-08T17:09:33.165830] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:09:33.617522] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-08T17:09:33.706123] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:09:33.709516] [INFO ] [REMOTE ] AJG: Full fetch complete (69154 records). [2025-10-08T17:09:33.709630] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-08T17:09:34.091058] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-08T17:09:34.091141] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-08T17:09:34.091821] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-08T17:09:34.091888] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-08T17:09:34.093253] [DEBUG] [LOCAL ] AJG: Trimmed 69154 records to 46653 (keeping 200 days of data) [2025-10-08T17:09:34.409321] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:09:34.421584] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-08T17:09:34.427426] [DEBUG] [LOCAL ] AJG: Primary data saved (46653 records). [2025-10-08T17:09:34.427510] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-08T17:09:34.428431] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 52.1s. Estimated remaining: 4h 51m 8s. Rate: 7.9 symbols/min [2025-10-08T17:09:34.599147] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:34.649890] [DEBUG] [LOCAL ] ALC: Loaded 50987 existing records from primary storage. [2025-10-08T17:09:34.650211] [INFO ] [MAIN ] ALC: Loaded 50987 existing records. [2025-10-08T17:09:34.852073] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:34.852394] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-08T17:09:34.852489] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-08T17:09:34.852892] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-08T17:09:34.853000] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-08T17:09:35.222250] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-08T17:09:35.248798] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T17:09:35.302936] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:35.958926] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:09:36.017502] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-08T17:09:36.817538] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-08T17:09:36.926446] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T17:09:37.617601] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-08T17:09:38.022009] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T17:09:38.259487] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:09:38.417589] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-08T17:09:39.217574] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-08T17:09:39.316153] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:09:40.017518] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-08T17:09:40.462823] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:09:40.817567] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-08T17:09:40.854364] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:09:41.468729] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:09:41.472571] [INFO ] [REMOTE ] AL: Full fetch complete (62860 records). [2025-10-08T17:09:41.472775] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-08T17:09:41.622755] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-08T17:09:41.857154] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-08T17:09:41.857244] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-08T17:09:41.857889] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-08T17:09:41.857953] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-08T17:09:41.859314] [DEBUG] [LOCAL ] AL: Trimmed 62860 records to 44474 (keeping 200 days of data) [2025-10-08T17:09:42.130771] [DEBUG] [LOCAL ] AL: Primary data saved (44474 records). [2025-10-08T17:09:42.130915] [INFO ] [MAIN ] AL: Full history saved. [2025-10-08T17:09:42.131896] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AL took 34.4s. Estimated remaining: 4h 51m 3s. Rate: 7.9 symbols/min [2025-10-08T17:09:42.297687] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:09:42.330872] [DEBUG] [LOCAL ] ALE: Loaded 31260 existing records from primary storage. [2025-10-08T17:09:42.331163] [INFO ] [MAIN ] ALE: Loaded 31260 existing records. [2025-10-08T17:09:42.428881] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-08T17:09:42.511993] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:09:42.512704] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-08T17:09:42.512760] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-08T17:09:42.513035] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-08T17:09:42.513091] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-08T17:09:42.891311] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:09:42.934492] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T17:09:43.217535] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-08T17:09:43.268395] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:09:43.272056] [INFO ] [REMOTE ] AKR: Full fetch complete (65340 records). [2025-10-08T17:09:43.272175] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-08T17:09:43.658716] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-08T17:09:43.658861] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-08T17:09:43.659585] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-08T17:09:43.659693] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-08T17:09:43.661427] [DEBUG] [LOCAL ] AKR: Trimmed 65340 records to 45857 (keeping 200 days of data) [2025-10-08T17:09:43.810882] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:09:43.986255] [DEBUG] [LOCAL ] AKR: Primary data saved (45857 records). [2025-10-08T17:09:43.986439] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-08T17:09:43.986543] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AKR took 41.2s. Estimated remaining: 4h 48m 4s. Rate: 8.0 symbols/min [2025-10-08T17:09:44.017545] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-08T17:09:44.226687] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:09:44.817550] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-08T17:09:45.516401] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:09:45.617554] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-08T17:09:46.402757] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:09:46.417502] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-08T17:09:47.217542] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-08T17:09:47.321366] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:09:48.017600] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-08T17:09:48.485188] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T17:09:48.541330] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:09:48.817565] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-08T17:09:49.588225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T17:09:49.617492] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-08T17:09:50.417555] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-08T17:09:50.915281] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T17:09:51.217564] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-08T17:09:51.293352] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:09:51.342362] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:09:52.017563] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-08T17:09:52.817535] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-08T17:09:53.123548] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:09:53.547734] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T17:09:53.617612] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-08T17:09:54.258048] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:09:54.417555] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-08T17:09:55.217555] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-08T17:09:55.777468] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-08T17:09:55.781580] [INFO ] [REMOTE ] ALB: Full fetch complete (76890 records). [2025-10-08T17:09:55.781737] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-08T17:09:56.215496] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-08T17:09:56.215832] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-08T17:09:56.216579] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-08T17:09:56.216663] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-08T17:09:56.246861] [DEBUG] [LOCAL ] ALB: Trimmed 76890 records to 53288 (keeping 200 days of data) [2025-10-08T17:09:56.246718] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:09:56.258680] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-08T17:09:56.593558] [DEBUG] [LOCAL ] ALB: Primary data saved (53288 records). [2025-10-08T17:09:56.593726] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-08T17:09:56.593824] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALB took 28.7s. Estimated remaining: 4h 50m 26s. Rate: 7.9 symbols/min [2025-10-08T17:09:56.699790] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:09:56.817561] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-08T17:09:58.051064] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:09:58.057405] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-08T17:09:58.200039] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T17:09:58.417608] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-08T17:09:59.041928] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:09:59.217612] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-08T17:09:59.945000] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:09:59.950587] [INFO ] [REMOTE ] ALC: Full fetch complete (73160 records). [2025-10-08T17:09:59.950820] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-08T17:10:00.378285] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-08T17:10:00.378425] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-08T17:10:00.379309] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-08T17:10:00.379379] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-08T17:10:00.384161] [DEBUG] [LOCAL ] ALC: Trimmed 73160 records to 51032 (keeping 200 days of data) [2025-10-08T17:10:00.707498] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:10:00.723954] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-08T17:10:00.854446] [DEBUG] [LOCAL ] ALC: Primary data saved (51032 records). [2025-10-08T17:10:00.854627] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-08T17:10:00.856090] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALC took 26.4s. Estimated remaining: 4h 48m 41s. Rate: 7.9 symbols/min [2025-10-08T17:10:02.113835] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:10:02.122231] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-08T17:10:03.232504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:10:03.241276] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-08T17:10:04.362485] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:10:04.366943] [INFO ] [REMOTE ] ALE: Full fetch complete (43372 records). [2025-10-08T17:10:04.367082] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-08T17:10:04.798496] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-08T17:10:04.798586] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-08T17:10:04.799065] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-08T17:10:04.799127] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-08T17:10:04.800055] [DEBUG] [LOCAL ] ALE: Trimmed 43372 records to 31298 (keeping 200 days of data) [2025-10-08T17:10:04.983246] [DEBUG] [LOCAL ] ALE: Primary data saved (31298 records). [2025-10-08T17:10:04.983389] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-08T17:10:04.983472] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALE took 22.9s. Estimated remaining: 4h 46m 56s. Rate: 8.0 symbols/min [2025-10-08T17:10:05.759235] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.821174] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.834276] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.838693] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:05.867976] [DEBUG] [LOCAL ] ALG: Loaded 9968 existing records from primary storage. [2025-10-08T17:10:05.868334] [INFO ] [MAIN ] ALG: Loaded 9968 existing records. [2025-10-08T17:10:05.974200] [DEBUG] [LOCAL ] ALEX: Loaded 31218 existing records from primary storage. [2025-10-08T17:10:05.997922] [INFO ] [MAIN ] ALEX: Loaded 31218 existing records. [2025-10-08T17:10:06.212310] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:06.281314] [DEBUG] [LOCAL ] ALK: Loaded 53059 existing records from primary storage. [2025-10-08T17:10:06.282901] [DEBUG] [LOCAL ] ALIT: Loaded 52769 existing records from primary storage. [2025-10-08T17:10:06.294125] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-08T17:10:06.300267] [INFO ] [MAIN ] ALK: Loaded 53059 existing records. [2025-10-08T17:10:06.305756] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-08T17:10:06.300016] [INFO ] [MAIN ] ALIT: Loaded 52769 existing records. [2025-10-08T17:10:06.384617] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-08T17:10:06.414300] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-08T17:10:06.423130] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:06.562494] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-08T17:10:06.612774] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-08T17:10:06.653142] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-08T17:10:06.709366] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-08T17:10:06.921629] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:07.150333] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-08T17:10:07.213712] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:07.224786] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-08T17:10:07.279347] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-08T17:10:07.279252] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-08T17:10:07.289553] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-08T17:10:07.289697] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-08T17:10:07.325252] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-08T17:10:07.330484] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-08T17:10:07.527612] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:07.638279] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-08T17:10:07.899598] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.004157] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-08T17:10:08.302463] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.312587] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-08T17:10:08.327502] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:08.327822] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-08T17:10:09.212199] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:10:09.215049] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-08T17:10:09.612218] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:10:09.620507] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-08T17:10:10.012961] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:10:10.023681] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-08T17:10:10.055977] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:10:10.060311] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-08T17:10:10.408207] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:10:10.418772] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-08T17:10:10.719873] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:10:10.725853] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-08T17:10:10.985112] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:10:10.987987] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-08T17:10:11.494295] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T17:10:11.505384] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-08T17:10:11.838413] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:10:11.912040] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:10:12.017523] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-08T17:10:12.047179] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:10:12.817581] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-08T17:10:13.153972] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:10:13.212154] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:10:13.617593] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-08T17:10:14.148322] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T17:10:14.417555] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-08T17:10:15.040270] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T17:10:15.217584] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-08T17:10:16.003321] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:10:16.017509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-08T17:10:16.817530] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-08T17:10:17.239148] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:10:17.431408] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-08T17:10:17.617535] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-08T17:10:18.417521] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-08T17:10:18.624827] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:10:19.184530] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:10:19.219256] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-08T17:10:19.221262] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:10:20.017617] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-08T17:10:20.817616] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-08T17:10:20.835256] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:10:21.017305] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T17:10:21.617610] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-08T17:10:21.901399] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T17:10:22.417561] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-08T17:10:23.217511] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-08T17:10:23.492286] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:10:23.519238] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:10:23.788162] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T17:10:24.017698] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-08T17:10:24.817576] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-08T17:10:25.297918] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:10:25.617559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-08T17:10:26.293118] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:10:26.417589] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-08T17:10:27.056927] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:10:27.217556] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-08T17:10:27.767231] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:10:28.017557] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-08T17:10:28.657751] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:10:28.817555] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-08T17:10:29.354819] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:10:29.357566] [INFO ] [REMOTE ] ALEX: Full fetch complete (44791 records). [2025-10-08T17:10:29.357714] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-08T17:10:29.622750] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-08T17:10:29.774436] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-08T17:10:29.774546] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-08T17:10:29.775179] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-08T17:10:29.775256] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-08T17:10:29.776578] [DEBUG] [LOCAL ] ALEX: Trimmed 44791 records to 31184 (keeping 200 days of data) [2025-10-08T17:10:29.976835] [DEBUG] [LOCAL ] ALEX: Primary data saved (31184 records). [2025-10-08T17:10:29.977013] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-08T17:10:29.977123] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALEX took 25.0s. Estimated remaining: 4h 55m 2s. Rate: 7.8 symbols/min [2025-10-08T17:10:30.146581] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:30.196665] [DEBUG] [LOCAL ] ALL: Loaded 49915 existing records from primary storage. [2025-10-08T17:10:30.197075] [INFO ] [MAIN ] ALL: Loaded 49915 existing records. [2025-10-08T17:10:30.377854] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:30.378083] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-08T17:10:30.378132] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-08T17:10:30.378580] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-08T17:10:30.378639] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-08T17:10:30.422715] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-08T17:10:30.811585] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:30.822601] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:10:30.859487] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:10:31.217570] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-08T17:10:32.017581] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-08T17:10:32.585532] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T17:10:32.817506] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-08T17:10:33.137829] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:10:33.237819] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T17:10:33.617593] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-08T17:10:34.417604] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-08T17:10:35.046562] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-08T17:10:35.217557] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-08T17:10:35.682302] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T17:10:35.688847] [INFO ] [REMOTE ] ALIT: Full fetch complete (76440 records). [2025-10-08T17:10:35.689084] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-08T17:10:36.023744] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-08T17:10:36.135848] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-08T17:10:36.136084] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-08T17:10:36.136973] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-08T17:10:36.137142] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-08T17:10:36.139017] [DEBUG] [LOCAL ] ALIT: Trimmed 76440 records to 52779 (keeping 200 days of data) [2025-10-08T17:10:36.260904] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T17:10:36.501546] [DEBUG] [LOCAL ] ALIT: Primary data saved (52779 records). [2025-10-08T17:10:36.501745] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-08T17:10:36.503213] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALIT took 31.5s. Estimated remaining: 4h 54m 21s. Rate: 7.8 symbols/min [2025-10-08T17:10:36.684125] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:36.731526] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T17:10:36.783848] [DEBUG] [LOCAL ] ALLE: Loaded 44491 existing records from primary storage. [2025-10-08T17:10:36.784211] [INFO ] [MAIN ] ALLE: Loaded 44491 existing records. [2025-10-08T17:10:36.822757] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-08T17:10:36.905279] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T17:10:36.987431] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:36.987716] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-08T17:10:36.987785] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-08T17:10:36.988153] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-08T17:10:36.988212] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-08T17:10:37.336898] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:37.617577] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-08T17:10:38.417632] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-08T17:10:38.743062] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T17:10:38.749766] [INFO ] [REMOTE ] ALK: Full fetch complete (76837 records). [2025-10-08T17:10:38.749968] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-08T17:10:39.105828] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:10:39.193487] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-08T17:10:39.193633] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-08T17:10:39.194734] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-08T17:10:39.194819] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-08T17:10:39.196739] [DEBUG] [LOCAL ] ALK: Trimmed 76837 records to 53058 (keeping 200 days of data) [2025-10-08T17:10:39.250476] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-08T17:10:39.320834] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:10:39.554475] [DEBUG] [LOCAL ] ALK: Primary data saved (53058 records). [2025-10-08T17:10:39.554667] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-08T17:10:39.554791] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 34.6s. Estimated remaining: 4h 52m 5s. Rate: 7.8 symbols/min [2025-10-08T17:10:39.725831] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:39.777430] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-08T17:10:39.777802] [INFO ] [MAIN ] ALLY: Loaded 53228 existing records. [2025-10-08T17:10:39.987325] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:39.987764] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-08T17:10:39.987835] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-08T17:10:39.988081] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-08T17:10:39.988140] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-08T17:10:40.022815] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-08T17:10:40.311108] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:10:40.333454] [INFO ] [REMOTE ] ALG: Full fetch complete (15672 records). [2025-10-08T17:10:40.353940] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-08T17:10:40.459825] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:40.773479] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-08T17:10:40.773586] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-08T17:10:40.774044] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-08T17:10:40.774101] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-08T17:10:40.774846] [DEBUG] [LOCAL ] ALG: Trimmed 15672 records to 9862 (keeping 200 days of data) [2025-10-08T17:10:40.825557] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-08T17:10:40.853548] [DEBUG] [LOCAL ] ALG: Primary data saved (9862 records). [2025-10-08T17:10:40.853815] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-08T17:10:40.853983] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALG took 35.9s. Estimated remaining: 4h 49m 4s. Rate: 7.9 symbols/min [2025-10-08T17:10:41.058664] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:10:41.119934] [DEBUG] [LOCAL ] ALSN: Loaded 43331 existing records from primary storage. [2025-10-08T17:10:41.120530] [INFO ] [MAIN ] ALSN: Loaded 43331 existing records. [2025-10-08T17:10:41.337730] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:10:41.338023] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-08T17:10:41.338077] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-08T17:10:41.338472] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-08T17:10:41.338532] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-08T17:10:41.622956] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-08T17:10:41.735816] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:10:41.851231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:10:42.417597] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-08T17:10:42.505280] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:10:43.217575] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-08T17:10:43.838596] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T17:10:44.017549] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-08T17:10:44.110404] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:10:44.797250] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:10:44.817515] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-08T17:10:45.457148] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T17:10:45.617567] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-08T17:10:46.135250] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:10:46.417576] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-08T17:10:47.228873] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-08T17:10:47.252431] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:10:47.614811] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T17:10:48.017561] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-08T17:10:48.817538] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-08T17:10:48.984565] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:10:49.572255] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:10:49.617531] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-08T17:10:50.210021] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T17:10:50.417609] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-08T17:10:50.934275] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:10:51.217620] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-08T17:10:51.800717] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:10:52.017573] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-08T17:10:52.817541] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-08T17:10:53.037595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:10:53.617634] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-08T17:10:53.763869] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:10:54.419557] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-08T17:10:54.425840] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:10:55.217540] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-08T17:10:55.323584] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:10:56.017561] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-08T17:10:56.155364] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:10:56.607571] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T17:10:56.817548] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-08T17:10:57.617599] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-08T17:10:57.704572] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T17:10:57.964366] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:10:58.417607] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-08T17:10:59.113085] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:10:59.217560] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-08T17:10:59.980626] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:11:00.017551] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-08T17:11:00.444618] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:11:00.817550] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-08T17:11:01.328490] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:11:01.332150] [INFO ] [REMOTE ] ALL: Full fetch complete (72401 records). [2025-10-08T17:11:01.332277] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-08T17:11:01.622630] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-08T17:11:01.726583] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-08T17:11:01.726723] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-08T17:11:01.727517] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-08T17:11:01.727583] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-08T17:11:01.729266] [DEBUG] [LOCAL ] ALL: Trimmed 72401 records to 49900 (keeping 200 days of data) [2025-10-08T17:11:02.091365] [DEBUG] [LOCAL ] ALL: Primary data saved (49900 records). [2025-10-08T17:11:02.091530] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-08T17:11:02.091630] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALL took 32.1s. Estimated remaining: 4h 55m 3s. Rate: 7.7 symbols/min [2025-10-08T17:11:02.261919] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:02.285006] [DEBUG] [LOCAL ] ALTG: Loaded 23593 existing records from primary storage. [2025-10-08T17:11:02.285468] [INFO ] [MAIN ] ALTG: Loaded 23593 existing records. [2025-10-08T17:11:02.429018] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-08T17:11:02.466863] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:02.467360] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-08T17:11:02.467519] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-08T17:11:02.467869] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-08T17:11:02.467972] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-08T17:11:02.750074] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T17:11:02.869019] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:03.217565] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-08T17:11:03.515142] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T17:11:03.626129] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:11:04.017556] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-08T17:11:04.706163] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:11:04.817522] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-08T17:11:05.193518] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:11:05.617547] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-08T17:11:06.112416] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T17:11:06.417567] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-08T17:11:07.028082] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:11:07.217602] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-08T17:11:08.017567] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T17:11:08.017674] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-08T17:11:08.066423] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:11:08.817555] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-08T17:11:09.306317] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T17:11:09.310438] [INFO ] [REMOTE ] ALSN: Full fetch complete (62229 records). [2025-10-08T17:11:09.310682] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-08T17:11:09.626535] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-08T17:11:09.732120] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-08T17:11:09.732208] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-08T17:11:09.732910] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-08T17:11:09.732977] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-08T17:11:09.734321] [DEBUG] [LOCAL ] ALSN: Trimmed 62229 records to 43352 (keeping 200 days of data) [2025-10-08T17:11:10.011617] [DEBUG] [LOCAL ] ALSN: Primary data saved (43352 records). [2025-10-08T17:11:10.012212] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-08T17:11:10.012443] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 29.2s. Estimated remaining: 4h 55m 0s. Rate: 7.7 symbols/min [2025-10-08T17:11:10.186970] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:10.198754] [DEBUG] [LOCAL ] ALUR: Loaded 10741 existing records from primary storage. [2025-10-08T17:11:10.198971] [INFO ] [MAIN ] ALUR: Loaded 10741 existing records. [2025-10-08T17:11:10.376818] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:10.377136] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-08T17:11:10.377213] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-08T17:11:10.377709] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-08T17:11:10.377777] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-08T17:11:10.422660] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-08T17:11:10.770705] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:10.783893] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:11:11.093035] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T17:11:11.217574] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-08T17:11:11.642306] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:11:11.646624] [INFO ] [REMOTE ] ALLE: Full fetch complete (64541 records). [2025-10-08T17:11:11.646825] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-08T17:11:12.026211] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-08T17:11:12.081718] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-08T17:11:12.081810] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-08T17:11:12.082479] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-08T17:11:12.082538] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-08T17:11:12.083926] [DEBUG] [LOCAL ] ALLE: Trimmed 64541 records to 44372 (keeping 200 days of data) [2025-10-08T17:11:12.365590] [DEBUG] [LOCAL ] ALLE: Primary data saved (44372 records). [2025-10-08T17:11:12.365741] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-08T17:11:12.367358] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLE took 35.9s. Estimated remaining: 4h 52m 31s. Rate: 7.8 symbols/min [2025-10-08T17:11:12.536762] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:12.581916] [DEBUG] [LOCAL ] ALV: Loaded 42166 existing records from primary storage. [2025-10-08T17:11:12.582259] [INFO ] [MAIN ] ALV: Loaded 42166 existing records. [2025-10-08T17:11:12.765113] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:12.765349] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-08T17:11:12.765397] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-08T17:11:12.766635] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-08T17:11:12.766804] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-08T17:11:12.822782] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-08T17:11:12.899908] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:11:13.169483] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:13.492815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:11:13.617546] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-08T17:11:14.126955] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:11:14.417549] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-08T17:11:15.130166] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:11:15.217604] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-08T17:11:15.482176] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:11:16.017552] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-08T17:11:16.571311] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:11:16.817552] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-08T17:11:17.182600] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T17:11:17.617597] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-08T17:11:18.417586] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-08T17:11:18.545490] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:11:18.574267] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:11:19.217586] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-08T17:11:19.940677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:11:20.017554] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-08T17:11:20.817529] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-08T17:11:21.116207] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T17:11:21.120507] [INFO ] [REMOTE ] ALLY: Full fetch complete (76948 records). [2025-10-08T17:11:21.120636] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-08T17:11:21.257277] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:11:21.531229] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-08T17:11:21.531415] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-08T17:11:21.532211] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-08T17:11:21.532290] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-08T17:11:21.534109] [DEBUG] [LOCAL ] ALLY: Trimmed 76948 records to 53228 (keeping 200 days of data) [2025-10-08T17:11:21.635248] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-08T17:11:21.640196] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T17:11:21.870015] [DEBUG] [LOCAL ] ALLY: Primary data saved (53228 records). [2025-10-08T17:11:21.870174] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-08T17:11:21.871388] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALLY took 42.3s. Estimated remaining: 4h 53m 11s. Rate: 7.8 symbols/min [2025-10-08T17:11:22.041942] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:22.050805] [DEBUG] [LOCAL ] ALX: Loaded 6461 existing records from primary storage. [2025-10-08T17:11:22.051048] [INFO ] [MAIN ] ALX: Loaded 6461 existing records. [2025-10-08T17:11:22.225583] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:22.225833] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-08T17:11:22.225880] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-08T17:11:22.226227] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-08T17:11:22.226284] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-08T17:11:22.422704] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-08T17:11:22.585731] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:22.717964] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:11:23.217548] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-08T17:11:23.295298] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T17:11:24.017546] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-08T17:11:24.556816] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:11:24.817571] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-08T17:11:25.283891] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:11:25.617578] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-08T17:11:25.930677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:11:26.417599] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-08T17:11:26.642524] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:11:26.938475] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T17:11:27.217579] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-08T17:11:28.017566] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-08T17:11:28.211937] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T17:11:28.764611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:11:28.817538] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-08T17:11:29.586664] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:11:29.617497] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-08T17:11:30.032369] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T17:11:30.417587] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-08T17:11:31.217593] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-08T17:11:31.792388] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T17:11:32.017592] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-08T17:11:32.175695] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:11:32.710827] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:11:32.712194] [INFO ] [REMOTE ] ALUR: Full fetch complete (20009 records). [2025-10-08T17:11:32.712273] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-08T17:11:32.822632] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-08T17:11:33.105377] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-08T17:11:33.105469] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-08T17:11:33.105820] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-08T17:11:33.105888] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-08T17:11:33.106530] [DEBUG] [LOCAL ] ALUR: Trimmed 20009 records to 10405 (keeping 200 days of data) [2025-10-08T17:11:33.174614] [DEBUG] [LOCAL ] ALUR: Primary data saved (10405 records). [2025-10-08T17:11:33.174809] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-08T17:11:33.174901] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALUR took 23.2s. Estimated remaining: 4h 54m 35s. Rate: 7.7 symbols/min [2025-10-08T17:11:33.379636] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:33.436369] [DEBUG] [LOCAL ] AM: Loaded 52017 existing records from primary storage. [2025-10-08T17:11:33.436779] [INFO ] [MAIN ] AM: Loaded 52017 existing records. [2025-10-08T17:11:33.622743] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-08T17:11:33.661524] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:33.662032] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-08T17:11:33.662092] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-08T17:11:33.662449] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-08T17:11:33.662508] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-08T17:11:34.054629] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:34.072778] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:11:34.417585] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-08T17:11:35.217513] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-08T17:11:35.328332] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:11:35.567434] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T17:11:35.769638] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:11:36.017542] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-08T17:11:36.562191] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T17:11:36.817568] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-08T17:11:37.617560] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-08T17:11:37.961941] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-08T17:11:38.310514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:11:38.417509] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-08T17:11:39.217537] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-08T17:11:39.921831] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:11:39.954850] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T17:11:40.017583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-08T17:11:40.612375] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T17:11:40.817585] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-08T17:11:41.617564] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-08T17:11:42.417520] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-08T17:11:42.529860] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:11:42.894712] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:11:43.217537] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-08T17:11:43.397337] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:11:43.399419] [INFO ] [REMOTE ] ALTG: Full fetch complete (33636 records). [2025-10-08T17:11:43.399498] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-08T17:11:43.777016] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-08T17:11:43.777134] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-08T17:11:43.777529] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-08T17:11:43.777568] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-08T17:11:43.778361] [DEBUG] [LOCAL ] ALTG: Trimmed 33636 records to 23572 (keeping 200 days of data) [2025-10-08T17:11:43.906079] [DEBUG] [LOCAL ] ALTG: Primary data saved (23572 records). [2025-10-08T17:11:43.906214] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-08T17:11:43.906297] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALTG took 41.8s. Estimated remaining: 4h 55m 43s. Rate: 7.7 symbols/min [2025-10-08T17:11:44.022738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-08T17:11:44.078210] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:44.112143] [DEBUG] [LOCAL ] AMBC: Loaded 36458 existing records from primary storage. [2025-10-08T17:11:44.112437] [INFO ] [MAIN ] AMBC: Loaded 36458 existing records. [2025-10-08T17:11:44.298870] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:44.299212] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-08T17:11:44.299293] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-08T17:11:44.300086] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-08T17:11:44.300165] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-08T17:11:44.685808] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:44.714923] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:11:44.817552] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-08T17:11:45.375814] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:11:45.617583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-08T17:11:46.422741] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-08T17:11:46.446895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:11:46.484291] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:11:47.217571] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-08T17:11:47.885990] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:11:48.017567] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-08T17:11:48.817568] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-08T17:11:49.048501] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:11:49.082747] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T17:11:49.284296] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T17:11:49.617556] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-08T17:11:50.417539] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-08T17:11:50.838619] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T17:11:51.217570] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-08T17:11:51.925239] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:11:52.017528] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-08T17:11:52.216893] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:11:52.817564] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-08T17:11:53.617525] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-08T17:11:53.705031] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:11:53.709047] [INFO ] [REMOTE ] ALV: Full fetch complete (61737 records). [2025-10-08T17:11:53.709254] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-08T17:11:54.141737] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-08T17:11:54.141998] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-08T17:11:54.142735] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-08T17:11:54.142825] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-08T17:11:54.174219] [DEBUG] [LOCAL ] ALV: Trimmed 61737 records to 42086 (keeping 200 days of data) [2025-10-08T17:11:54.174053] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T17:11:54.432279] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-08T17:11:54.485494] [DEBUG] [LOCAL ] ALV: Primary data saved (42086 records). [2025-10-08T17:11:54.485640] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-08T17:11:54.485766] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALV took 42.1s. Estimated remaining: 4h 56m 45s. Rate: 7.7 symbols/min [2025-10-08T17:11:54.651870] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:54.695191] [DEBUG] [LOCAL ] AMBP: Loaded 44811 existing records from primary storage. [2025-10-08T17:11:54.695565] [INFO ] [MAIN ] AMBP: Loaded 44811 existing records. [2025-10-08T17:11:54.886816] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:11:54.887088] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-08T17:11:54.887178] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-08T17:11:54.887857] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-08T17:11:54.887947] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-08T17:11:55.173706] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:11:55.219578] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-08T17:11:55.313484] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:11:55.858194] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T17:11:55.924031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:11:56.017542] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-08T17:11:56.817558] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-08T17:11:57.151753] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:11:57.548879] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T17:11:57.617552] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-08T17:11:58.417583] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-08T17:11:59.041328] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:11:59.042925] [INFO ] [REMOTE ] ALX: Full fetch complete (7360 records). [2025-10-08T17:11:59.043059] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-08T17:11:59.222300] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-08T17:11:59.467462] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-08T17:11:59.477096] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-08T17:11:59.477365] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-08T17:11:59.482585] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-08T17:11:59.495192] [DEBUG] [LOCAL ] ALX: Trimmed 7360 records to 6520 (keeping 200 days of data) [2025-10-08T17:11:59.498487] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:11:59.550523] [DEBUG] [LOCAL ] ALX: Primary data saved (6520 records). [2025-10-08T17:11:59.550701] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-08T17:11:59.550805] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 37.7s. Estimated remaining: 4h 55m 30s. Rate: 7.7 symbols/min [2025-10-08T17:11:59.725273] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:11:59.725450] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-08T17:11:59.725488] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-08T17:11:59.725622] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-08T17:11:59.725699] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-08T17:11:59.725756] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-08T17:11:59.725789] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-08T17:12:00.023088] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-08T17:12:00.111280] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:00.641943] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:12:00.817574] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-08T17:12:01.014173] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:12:01.014505] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-08T17:12:01.014607] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:12:01.014689] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-08T17:12:01.014740] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:12:01.014784] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-08T17:12:01.014878] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-08T17:12:01.014972] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-08T17:12:01.015058] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-08T17:12:01.015141] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 52m 47s. Rate: 7.8 symbols/min [2025-10-08T17:12:01.188493] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:01.222500] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:12:01.281859] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-08T17:12:01.282212] [INFO ] [MAIN ] AMC: Loaded 53761 existing records. [2025-10-08T17:12:01.456693] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:01.456905] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-08T17:12:01.456950] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-08T17:12:01.458252] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-08T17:12:01.458311] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-08T17:12:01.629191] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-08T17:12:01.822995] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:02.417580] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-08T17:12:03.217627] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-08T17:12:03.286200] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T17:12:04.017552] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-08T17:12:04.822715] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-08T17:12:04.846103] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-08T17:12:05.207296] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T17:12:05.258119] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:12:05.617569] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-08T17:12:06.315195] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:12:06.417586] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-08T17:12:07.217613] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-08T17:12:07.299776] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:12:07.487523] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T17:12:08.017626] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-08T17:12:08.817562] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-08T17:12:09.271387] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:12:09.435297] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-08T17:12:09.617586] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-08T17:12:10.144610] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:12:10.417598] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-08T17:12:10.801007] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:12:10.804403] [INFO ] [REMOTE ] AMBC: Full fetch complete (51478 records). [2025-10-08T17:12:10.804541] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-08T17:12:11.218639] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-08T17:12:11.218955] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-08T17:12:11.219829] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-08T17:12:11.220443] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-08T17:12:11.220507] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-08T17:12:11.221731] [DEBUG] [LOCAL ] AMBC: Trimmed 51478 records to 36338 (keeping 200 days of data) [2025-10-08T17:12:11.428966] [DEBUG] [LOCAL ] AMBC: Primary data saved (36338 records). [2025-10-08T17:12:11.429103] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-08T17:12:11.429187] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBC took 27.5s. Estimated remaining: 4h 53m 45s. Rate: 7.8 symbols/min [2025-10-08T17:12:11.647715] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:11.699359] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-08T17:12:11.699762] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-08T17:12:11.892692] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:11.892965] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-08T17:12:11.893040] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-08T17:12:11.894330] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-08T17:12:11.894395] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-08T17:12:12.003506] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:12:12.031599] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-08T17:12:12.305545] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:12.723799] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T17:12:12.817557] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-08T17:12:13.617554] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-08T17:12:14.417584] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-08T17:12:14.530142] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-08T17:12:14.583504] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T17:12:14.790475] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:12:15.217574] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-08T17:12:16.017578] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-08T17:12:16.266187] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:12:16.674401] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:12:16.817597] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-08T17:12:17.617562] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-08T17:12:17.652818] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:12:18.417591] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-08T17:12:19.217595] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-08T17:12:19.295570] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T17:12:19.349380] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-08T17:12:19.650202] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:12:19.655159] [INFO ] [REMOTE ] AM: Full fetch complete (75578 records). [2025-10-08T17:12:19.655401] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-08T17:12:20.022785] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-08T17:12:20.099862] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-08T17:12:20.099972] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-08T17:12:20.100801] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-08T17:12:20.100868] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-08T17:12:20.102409] [DEBUG] [LOCAL ] AM: Trimmed 75578 records to 51994 (keeping 200 days of data) [2025-10-08T17:12:20.419338] [DEBUG] [LOCAL ] AM: Primary data saved (51994 records). [2025-10-08T17:12:20.419504] [INFO ] [MAIN ] AM: Full history saved. [2025-10-08T17:12:20.419594] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 47.2s. Estimated remaining: 4h 54m 7s. Rate: 7.7 symbols/min [2025-10-08T17:12:20.591412] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:20.650741] [DEBUG] [LOCAL ] AME: Loaded 48666 existing records from primary storage. [2025-10-08T17:12:20.651625] [INFO ] [MAIN ] AME: Loaded 48666 existing records. [2025-10-08T17:12:20.843906] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-08T17:12:20.850367] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:20.852082] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-08T17:12:20.852164] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-08T17:12:20.852987] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-08T17:12:20.853054] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-08T17:12:21.066449] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:12:21.328668] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:21.622750] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-08T17:12:21.640527] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:12:22.417578] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-08T17:12:23.217533] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-08T17:12:23.316545] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:12:23.329780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-08T17:12:23.922947] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:12:24.017552] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-08T17:12:24.371103] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:12:24.374368] [INFO ] [REMOTE ] AMBP: Full fetch complete (65455 records). [2025-10-08T17:12:24.374472] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-08T17:12:24.765875] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-08T17:12:24.765979] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-08T17:12:24.766736] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-08T17:12:24.766805] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-08T17:12:24.769231] [DEBUG] [LOCAL ] AMBP: Trimmed 65455 records to 44668 (keeping 200 days of data) [2025-10-08T17:12:24.821913] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-08T17:12:25.034291] [DEBUG] [LOCAL ] AMBP: Primary data saved (44668 records). [2025-10-08T17:12:25.034431] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-08T17:12:25.034539] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 30.5s. Estimated remaining: 4h 52m 45s. Rate: 7.8 symbols/min [2025-10-08T17:12:25.201452] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:25.224399] [DEBUG] [LOCAL ] AMG: Loaded 20226 existing records from primary storage. [2025-10-08T17:12:25.224716] [INFO ] [MAIN ] AMG: Loaded 20226 existing records. [2025-10-08T17:12:25.406047] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:25.406282] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-08T17:12:25.406328] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-08T17:12:25.406990] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-08T17:12:25.407049] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-08T17:12:25.623773] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-08T17:12:25.763920] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:26.079431] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:12:26.417583] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-08T17:12:26.510958] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:12:27.217730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-08T17:12:27.320680] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:12:27.683971] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T17:12:28.017539] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-08T17:12:28.817522] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-08T17:12:28.904317] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T17:12:29.089899] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:12:29.617565] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-08T17:12:30.407629] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:12:30.417606] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-08T17:12:31.217621] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-08T17:12:31.741622] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-08T17:12:32.017515] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-08T17:12:32.146494] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:12:32.294451] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:12:32.817571] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-08T17:12:33.617570] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-08T17:12:34.135376] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T17:12:34.381426] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T17:12:34.417574] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-08T17:12:34.418581] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T17:12:35.217555] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-08T17:12:35.997000] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:12:36.017502] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-08T17:12:36.817608] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-08T17:12:37.533499] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:12:37.575213] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T17:12:37.617500] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-08T17:12:38.341756] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:12:38.417625] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-08T17:12:39.161418] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:12:39.217685] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-08T17:12:39.348831] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:12:40.017561] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-08T17:12:40.817552] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-08T17:12:41.417808] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-08T17:12:41.617528] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-08T17:12:41.714687] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:12:42.320415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:12:42.324497] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-08T17:12:42.324697] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-08T17:12:42.422628] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-08T17:12:42.745975] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-08T17:12:42.746102] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-08T17:12:42.746936] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-08T17:12:42.747001] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-08T17:12:42.748570] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 53669 (keeping 200 days of data) [2025-10-08T17:12:43.088178] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-08T17:12:43.088322] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-08T17:12:43.088441] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMCR took 31.7s. Estimated remaining: 4h 56m 40s. Rate: 7.7 symbols/min [2025-10-08T17:12:43.224840] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-08T17:12:43.256899] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:43.304351] [DEBUG] [LOCAL ] AMH: Loaded 51759 existing records from primary storage. [2025-10-08T17:12:43.304703] [INFO ] [MAIN ] AMH: Loaded 51759 existing records. [2025-10-08T17:12:43.482864] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:43.483326] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-08T17:12:43.483396] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-08T17:12:43.489921] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-08T17:12:43.497195] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-08T17:12:43.548694] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:12:43.863934] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:44.017522] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-08T17:12:44.166069] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-08T17:12:44.171583] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-08T17:12:44.171753] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-08T17:12:44.557710] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-08T17:12:44.557813] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-08T17:12:44.558628] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-08T17:12:44.558738] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-08T17:12:44.560397] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53761 (keeping 200 days of data) [2025-10-08T17:12:44.823830] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-08T17:12:44.869341] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:12:44.892802] [DEBUG] [LOCAL ] AMC: Primary data saved (53761 records). [2025-10-08T17:12:44.892955] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-08T17:12:44.893042] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMC took 43.9s. Estimated remaining: 4h 54m 12s. Rate: 7.7 symbols/min [2025-10-08T17:12:45.072477] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:45.072754] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-08T17:12:45.072897] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-08T17:12:45.073142] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-08T17:12:45.073214] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-08T17:12:45.073416] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-08T17:12:45.073513] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-08T17:12:45.289531] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T17:12:45.486197] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:45.617548] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-08T17:12:46.337146] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:12:46.417527] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-08T17:12:46.898700] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:12:47.217616] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-08T17:12:47.695176] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:12:48.017596] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-08T17:12:48.674374] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:12:48.817506] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-08T17:12:49.253096] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:12:49.617576] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-08T17:12:50.274834] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:12:50.417536] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-08T17:12:51.187735] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:12:51.217516] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-08T17:12:51.622522] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:12:52.017579] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-08T17:12:52.612863] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:12:52.817572] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-08T17:12:53.476941] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T17:12:53.480718] [INFO ] [REMOTE ] AME: Full fetch complete (69925 records). [2025-10-08T17:12:53.480845] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-08T17:12:53.623107] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-08T17:12:53.889948] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-08T17:12:53.890196] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-08T17:12:53.891251] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-08T17:12:53.891359] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-08T17:12:53.893515] [DEBUG] [LOCAL ] AME: Trimmed 69925 records to 48717 (keeping 200 days of data) [2025-10-08T17:12:54.023406] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T17:12:54.253310] [DEBUG] [LOCAL ] AME: Primary data saved (48717 records). [2025-10-08T17:12:54.253481] [INFO ] [MAIN ] AME: Full history saved. [2025-10-08T17:12:54.253569] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 33.8s. Estimated remaining: 4h 54m 41s. Rate: 7.7 symbols/min [2025-10-08T17:12:54.435274] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-08T17:12:54.455003] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:12:54.488504] [DEBUG] [LOCAL ] AMP: Loaded 32027 existing records from primary storage. [2025-10-08T17:12:54.488879] [INFO ] [MAIN ] AMP: Loaded 32027 existing records. [2025-10-08T17:12:54.628850] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:12:54.692290] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:12:54.692568] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-08T17:12:54.692673] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-08T17:12:54.693862] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-08T17:12:54.693937] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-08T17:12:55.052926] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:12:55.217552] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-08T17:12:55.667451] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:12:56.017565] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-08T17:12:56.722346] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T17:12:56.817624] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-08T17:12:57.261201] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:12:57.617614] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-08T17:12:57.811559] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:12:58.417569] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-08T17:12:59.009358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:12:59.217563] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-08T17:12:59.385570] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:12:59.387405] [INFO ] [REMOTE ] AMG: Full fetch complete (29782 records). [2025-10-08T17:12:59.387492] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-08T17:12:59.787702] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-08T17:12:59.787816] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-08T17:12:59.788189] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-08T17:12:59.788232] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-08T17:12:59.789282] [DEBUG] [LOCAL ] AMG: Trimmed 29782 records to 20177 (keeping 200 days of data) [2025-10-08T17:12:59.920521] [DEBUG] [LOCAL ] AMG: Primary data saved (20177 records). [2025-10-08T17:12:59.920687] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-08T17:12:59.920800] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 34.9s. Estimated remaining: 4h 53m 45s. Rate: 7.7 symbols/min [2025-10-08T17:13:00.024729] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-08T17:13:00.123601] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:00.177523] [DEBUG] [LOCAL ] AMPX: Loaded 52317 existing records from primary storage. [2025-10-08T17:13:00.177966] [INFO ] [MAIN ] AMPX: Loaded 52317 existing records. [2025-10-08T17:13:00.415169] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:00.415555] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-08T17:13:00.415743] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-08T17:13:00.416261] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-08T17:13:00.416405] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-08T17:13:00.620510] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:13:00.822737] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-08T17:13:00.883254] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:01.566381] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:13:01.617630] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-08T17:13:02.417575] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-08T17:13:02.586678] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:13:02.661213] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:13:03.217580] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-08T17:13:03.744798] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:13:04.017551] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-08T17:13:04.817562] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-08T17:13:04.918202] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:13:05.384480] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T17:13:05.617559] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-08T17:13:06.417615] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-08T17:13:06.675121] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:13:06.990513] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T17:13:07.217606] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-08T17:13:07.888885] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:13:08.017580] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-08T17:13:08.817551] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-08T17:13:09.067073] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T17:13:09.319862] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:13:09.617586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-08T17:13:10.417512] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-08T17:13:10.518499] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:13:11.051413] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:13:11.217592] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-08T17:13:12.017705] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-08T17:13:12.224954] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:13:12.604355] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T17:13:12.817596] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-08T17:13:13.324496] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-08T17:13:13.617576] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-08T17:13:14.061391] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:13:14.065025] [INFO ] [REMOTE ] AMN: Full fetch complete (60385 records). [2025-10-08T17:13:14.065191] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-08T17:13:14.423141] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-08T17:13:14.460500] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-08T17:13:14.460762] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-08T17:13:14.461451] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-08T17:13:14.461516] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-08T17:13:14.462970] [DEBUG] [LOCAL ] AMN: Trimmed 60385 records to 41756 (keeping 200 days of data) [2025-10-08T17:13:14.719398] [DEBUG] [LOCAL ] AMN: Primary data saved (41756 records). [2025-10-08T17:13:14.719543] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-08T17:13:14.719674] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMN took 29.8s. Estimated remaining: 4h 56m 15s. Rate: 7.7 symbols/min [2025-10-08T17:13:14.886090] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:14.923832] [DEBUG] [LOCAL ] AMPY: Loaded 38451 existing records from primary storage. [2025-10-08T17:13:14.924144] [INFO ] [MAIN ] AMPY: Loaded 38451 existing records. [2025-10-08T17:13:15.100005] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:15.100276] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-08T17:13:15.100347] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-08T17:13:15.100563] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-08T17:13:15.100622] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-08T17:13:15.217935] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-08T17:13:15.464800] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:15.507800] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T17:13:15.987100] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:13:16.017523] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-08T17:13:16.817520] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-08T17:13:16.932957] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:13:16.937006] [INFO ] [REMOTE ] AMH: Full fetch complete (74817 records). [2025-10-08T17:13:16.937192] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-08T17:13:17.328326] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-08T17:13:17.328493] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-08T17:13:17.329321] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-08T17:13:17.329398] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-08T17:13:17.331125] [DEBUG] [LOCAL ] AMH: Trimmed 74817 records to 51757 (keeping 200 days of data) [2025-10-08T17:13:17.465293] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:13:17.636101] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-08T17:13:17.680816] [DEBUG] [LOCAL ] AMH: Primary data saved (51757 records). [2025-10-08T17:13:17.680941] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-08T17:13:17.681023] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMH took 34.6s. Estimated remaining: 4h 54m 19s. Rate: 7.7 symbols/min [2025-10-08T17:13:17.846807] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:17.876290] [DEBUG] [LOCAL ] AMR: Loaded 29108 existing records from primary storage. [2025-10-08T17:13:17.876628] [INFO ] [MAIN ] AMR: Loaded 29108 existing records. [2025-10-08T17:13:18.050966] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:18.051239] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-08T17:13:18.051293] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-08T17:13:18.051503] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-08T17:13:18.051560] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-08T17:13:18.425577] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:18.420803] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-08T17:13:18.456099] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T17:13:19.033107] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:13:19.217560] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-08T17:13:19.642164] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:13:20.017592] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-08T17:13:20.628906] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:13:20.817614] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-08T17:13:21.273483] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:13:21.617558] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-08T17:13:22.417521] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-08T17:13:22.448390] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:13:22.499829] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:13:23.217549] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-08T17:13:23.593114] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:13:23.877419] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T17:13:24.017558] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-08T17:13:24.817593] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-08T17:13:25.120283] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:13:25.617527] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-08T17:13:25.781737] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:13:26.417551] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-08T17:13:27.217555] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-08T17:13:27.424450] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:13:27.942692] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:13:28.017514] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-08T17:13:28.700200] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:13:28.817602] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-08T17:13:29.076319] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:13:29.617568] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-08T17:13:29.804460] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:13:30.417585] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-08T17:13:30.934202] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:13:31.217578] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-08T17:13:31.427680] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:13:32.017605] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-08T17:13:32.792488] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T17:13:32.817505] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-08T17:13:33.076396] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:13:33.079152] [INFO ] [REMOTE ] AMP: Full fetch complete (47485 records). [2025-10-08T17:13:33.079296] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-08T17:13:33.503420] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-08T17:13:33.503548] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-08T17:13:33.504257] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-08T17:13:33.504331] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-08T17:13:33.506036] [DEBUG] [LOCAL ] AMP: Trimmed 47485 records to 31938 (keeping 200 days of data) [2025-10-08T17:13:33.617638] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-08T17:13:33.729124] [DEBUG] [LOCAL ] AMP: Primary data saved (31938 records). [2025-10-08T17:13:33.729301] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-08T17:13:33.729393] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 39.5s. Estimated remaining: 4h 57m 14s. Rate: 7.6 symbols/min [2025-10-08T17:13:33.911137] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:33.955233] [DEBUG] [LOCAL ] AMRC: Loaded 38121 existing records from primary storage. [2025-10-08T17:13:33.955729] [INFO ] [MAIN ] AMRC: Loaded 38121 existing records. [2025-10-08T17:13:34.160685] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:34.181246] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-08T17:13:34.182060] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-08T17:13:34.182957] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:13:34.190502] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-08T17:13:34.191146] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-08T17:13:34.422758] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-08T17:13:34.617981] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:35.217608] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-08T17:13:35.796751] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-08T17:13:35.858994] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T17:13:36.017545] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-08T17:13:36.664284] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:13:36.817582] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-08T17:13:37.617562] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-08T17:13:37.988024] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T17:13:38.256853] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:13:38.260747] [INFO ] [REMOTE ] AMPY: Full fetch complete (52071 records). [2025-10-08T17:13:38.260881] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-08T17:13:38.422621] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-08T17:13:38.704073] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-08T17:13:38.704193] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-08T17:13:38.704877] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-08T17:13:38.704947] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-08T17:13:38.706902] [DEBUG] [LOCAL ] AMPY: Trimmed 52071 records to 38587 (keeping 200 days of data) [2025-10-08T17:13:38.964352] [DEBUG] [LOCAL ] AMPY: Primary data saved (38587 records). [2025-10-08T17:13:38.964596] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-08T17:13:38.966307] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPY took 24.2s. Estimated remaining: 4h 56m 8s. Rate: 7.7 symbols/min [2025-10-08T17:13:39.094906] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:13:39.194383] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:39.194889] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-08T17:13:39.195175] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-08T17:13:39.195356] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-08T17:13:39.195411] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-08T17:13:39.195459] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-08T17:13:39.195497] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-08T17:13:39.222719] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-08T17:13:39.617035] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:39.644053] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:13:40.017568] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-08T17:13:40.817568] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-08T17:13:41.241342] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:13:41.495945] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-08T17:13:41.500350] [INFO ] [REMOTE ] AMPX: Full fetch complete (74937 records). [2025-10-08T17:13:41.500509] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-08T17:13:41.620863] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-08T17:13:41.979334] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-08T17:13:41.979229] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T17:13:41.979489] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-08T17:13:41.987584] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-08T17:13:41.988052] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-08T17:13:41.989575] [DEBUG] [LOCAL ] AMPX: Trimmed 74937 records to 52318 (keeping 200 days of data) [2025-10-08T17:13:42.316600] [DEBUG] [LOCAL ] AMPX: Primary data saved (52318 records). [2025-10-08T17:13:42.316864] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-08T17:13:42.317014] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPX took 42.4s. Estimated remaining: 4h 54m 24s. Rate: 7.7 symbols/min [2025-10-08T17:13:42.422783] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-08T17:13:42.502785] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:42.559502] [DEBUG] [LOCAL ] AMT: Loaded 52437 existing records from primary storage. [2025-10-08T17:13:42.560049] [INFO ] [MAIN ] AMT: Loaded 52437 existing records. [2025-10-08T17:13:42.639682] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:13:42.664042] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-08T17:13:42.674728] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:13:42.679960] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-08T17:13:42.680059] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:13:42.685312] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-08T17:13:42.707349] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-08T17:13:42.745519] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-08T17:13:42.750503] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:42.751248] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-08T17:13:42.751333] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-08T17:13:42.751100] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-08T17:13:42.751601] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRZ took 3.8s. Estimated remaining: 4h 51m 39s. Rate: 7.8 symbols/min [2025-10-08T17:13:42.757126] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-08T17:13:42.799629] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-08T17:13:43.135287] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:43.222881] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-08T17:13:43.397379] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:43.398488] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-08T17:13:43.415822] [INFO ] [MAIN ] AMTB: Loaded 20513 existing records. [2025-10-08T17:13:43.504441] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:13:43.623786] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:43.624087] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-08T17:13:43.624138] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-08T17:13:43.625146] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-08T17:13:43.625211] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-08T17:13:44.013830] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:44.017498] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-08T17:13:44.633315] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:13:44.817552] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-08T17:13:45.170965] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:13:45.617579] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-08T17:13:46.417581] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-08T17:13:46.783788] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T17:13:46.969988] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:13:47.217634] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-08T17:13:47.511463] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:13:48.017581] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-08T17:13:48.472158] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T17:13:48.817577] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-08T17:13:49.297141] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T17:13:49.617585] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-08T17:13:49.997692] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:13:50.417586] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-08T17:13:50.925062] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T17:13:51.217571] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-08T17:13:51.367521] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:13:52.017541] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-08T17:13:52.058482] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:13:52.061048] [INFO ] [REMOTE ] AMR: Full fetch complete (40393 records). [2025-10-08T17:13:52.061147] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-08T17:13:52.447218] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-08T17:13:52.447330] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-08T17:13:52.447824] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-08T17:13:52.447891] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-08T17:13:52.449235] [DEBUG] [LOCAL ] AMR: Trimmed 40393 records to 29039 (keeping 200 days of data) [2025-10-08T17:13:52.624553] [DEBUG] [LOCAL ] AMR: Primary data saved (29039 records). [2025-10-08T17:13:52.624735] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-08T17:13:52.624835] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 34.9s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-08T17:13:52.789890] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:13:52.795054] [DEBUG] [LOCAL ] AMTD: Loaded 3692 existing records from primary storage. [2025-10-08T17:13:52.795230] [INFO ] [MAIN ] AMTD: Loaded 3692 existing records. [2025-10-08T17:13:52.824884] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-08T17:13:52.973018] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:13:52.973278] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-08T17:13:52.973327] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-08T17:13:52.973562] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-08T17:13:52.973622] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-08T17:13:53.322187] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:13:53.617616] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-08T17:13:53.766602] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:13:53.831110] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:13:54.417685] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-08T17:13:55.061212] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:13:55.217565] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-08T17:13:55.582234] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:13:56.017607] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-08T17:13:56.058869] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:13:56.817503] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-08T17:13:57.177359] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:13:57.239726] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T17:13:57.617548] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-08T17:13:58.417583] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-08T17:13:59.217617] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-08T17:13:59.592202] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-08T17:13:59.723344] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T17:13:59.884545] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:14:00.017561] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-08T17:14:00.817617] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-08T17:14:00.996904] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:14:01.617690] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-08T17:14:02.417636] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-08T17:14:02.605704] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:14:03.226297] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-08T17:14:03.234742] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:14:03.262583] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:14:04.017579] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-08T17:14:04.817571] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-08T17:14:04.939367] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:14:05.156863] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T17:14:05.454287] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:14:05.458613] [INFO ] [REMOTE ] AMRC: Full fetch complete (53492 records). [2025-10-08T17:14:05.458812] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-08T17:14:05.626224] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-08T17:14:05.899149] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-08T17:14:05.899286] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-08T17:14:05.900366] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-08T17:14:05.900688] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-08T17:14:05.902150] [DEBUG] [LOCAL ] AMRC: Trimmed 53492 records to 38091 (keeping 200 days of data) [2025-10-08T17:14:06.142813] [DEBUG] [LOCAL ] AMRC: Primary data saved (38091 records). [2025-10-08T17:14:06.142988] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-08T17:14:06.143076] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRC took 32.4s. Estimated remaining: 4h 54m 10s. Rate: 7.7 symbols/min [2025-10-08T17:14:06.311886] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:06.312077] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-10-08T17:14:06.312113] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-10-08T17:14:06.312260] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-08T17:14:06.312301] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-08T17:14:06.312341] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-08T17:14:06.312373] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-08T17:14:06.422779] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-08T17:14:06.667735] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:07.124005] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T17:14:07.217554] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-08T17:14:07.363284] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:14:08.017591] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-08T17:14:08.583556] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T17:14:08.817628] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-08T17:14:08.851573] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T17:14:09.617586] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-08T17:14:10.417532] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-08T17:14:10.527607] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:14:10.705343] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-08T17:14:11.217531] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-08T17:14:11.361800] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:14:12.017542] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-08T17:14:12.817509] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-08T17:14:12.822604] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:14:13.001390] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T17:14:13.617581] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-08T17:14:14.417632] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-08T17:14:14.704489] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T17:14:15.217528] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-08T17:14:15.344777] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:14:15.416950] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:14:16.017585] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-08T17:14:16.817597] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-08T17:14:16.860221] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:14:16.862362] [INFO ] [REMOTE ] AMTB: Full fetch complete (29795 records). [2025-10-08T17:14:16.862449] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-08T17:14:17.230447] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T17:14:17.306082] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-08T17:14:17.306188] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-08T17:14:17.307110] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-08T17:14:17.307179] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-08T17:14:17.308098] [DEBUG] [LOCAL ] AMTB: Trimmed 29795 records to 20507 (keeping 200 days of data) [2025-10-08T17:14:17.441416] [DEBUG] [LOCAL ] AMTB: Primary data saved (20507 records). [2025-10-08T17:14:17.441874] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-08T17:14:17.441984] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 34.7s. Estimated remaining: 4h 55m 14s. Rate: 7.7 symbols/min [2025-10-08T17:14:17.628820] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:17.624826] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-08T17:14:17.640542] [DEBUG] [LOCAL ] AMWL: Loaded 9133 existing records from primary storage. [2025-10-08T17:14:17.640824] [INFO ] [MAIN ] AMWL: Loaded 9133 existing records. [2025-10-08T17:14:17.866907] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:17.867186] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-08T17:14:17.867235] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-08T17:14:17.867816] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-08T17:14:17.867882] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-08T17:14:18.251209] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:18.399945] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:14:18.417506] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-08T17:14:19.217612] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-08T17:14:19.554981] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T17:14:19.575266] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T17:14:20.017546] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-08T17:14:20.817702] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-08T17:14:20.902350] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:14:21.615099] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:14:21.617624] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-08T17:14:21.633218] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:14:21.638260] [INFO ] [REMOTE ] AMT: Full fetch complete (76029 records). [2025-10-08T17:14:21.638513] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-08T17:14:22.034945] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-08T17:14:22.035036] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-08T17:14:22.035788] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-08T17:14:22.035857] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-08T17:14:22.037403] [DEBUG] [LOCAL ] AMT: Trimmed 76029 records to 52439 (keeping 200 days of data) [2025-10-08T17:14:22.381720] [DEBUG] [LOCAL ] AMT: Primary data saved (52439 records). [2025-10-08T17:14:22.381890] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-08T17:14:22.383271] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 40.1s. Estimated remaining: 4h 54m 7s. Rate: 7.7 symbols/min [2025-10-08T17:14:22.423633] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-08T17:14:22.507926] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T17:14:22.585973] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:22.586242] [DEBUG] [LOCAL ] AMX: No existing data file found in primary storage. [2025-10-08T17:14:22.586306] [WARN ] [MAIN ] AMX: No existing data found, performing full refresh instead. [2025-10-08T17:14:22.586448] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-08T17:14:22.586525] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-08T17:14:22.586611] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-08T17:14:22.586702] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-08T17:14:22.977071] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:23.079969] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T17:14:23.217574] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-08T17:14:23.994197] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:14:24.017496] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-08T17:14:24.746304] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:14:24.817566] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-08T17:14:25.617568] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-08T17:14:26.411775] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:14:26.421180] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-08T17:14:27.217513] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-08T17:14:27.330483] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:14:27.369152] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:14:28.017536] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-08T17:14:28.483284] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T17:14:28.817575] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-08T17:14:29.461149] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:14:29.617602] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-08T17:14:29.745899] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:14:30.417568] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-08T17:14:31.122125] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:14:31.217552] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-08T17:14:31.945712] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T17:14:32.017558] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-08T17:14:32.182462] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:14:32.632170] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T17:14:32.817529] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-08T17:14:33.430850] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:14:33.617580] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-08T17:14:34.406010] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:14:34.417492] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-08T17:14:35.217566] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-08T17:14:35.352806] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:14:35.354470] [INFO ] [REMOTE ] AMWL: Full fetch complete (14258 records). [2025-10-08T17:14:35.354560] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-08T17:14:35.716917] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-08T17:14:35.717001] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-08T17:14:35.717256] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-08T17:14:35.717294] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-08T17:14:35.717812] [DEBUG] [LOCAL ] AMWL: Trimmed 14258 records to 9214 (keeping 200 days of data) [2025-10-08T17:14:35.771511] [DEBUG] [LOCAL ] AMWL: Primary data saved (9214 records). [2025-10-08T17:14:35.771729] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-08T17:14:35.771852] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMWL took 18.3s. Estimated remaining: 4h 55m 53s. Rate: 7.6 symbols/min [2025-10-08T17:14:35.941776] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:35.973598] [DEBUG] [LOCAL ] AN: Loaded 31743 existing records from primary storage. [2025-10-08T17:14:35.973918] [INFO ] [MAIN ] AN: Loaded 31743 existing records. [2025-10-08T17:14:36.028511] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-08T17:14:36.155220] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:36.155446] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-08T17:14:36.155492] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-08T17:14:36.156323] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-08T17:14:36.156383] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-08T17:14:36.523913] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:36.763256] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:14:36.817553] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-08T17:14:36.850186] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:14:37.617545] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-08T17:14:38.417522] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-08T17:14:38.482915] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:14:38.971813] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:14:38.984478] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:14:39.217596] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-08T17:14:39.812632] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:14:39.823122] [INFO ] [REMOTE ] AMTD: Full fetch complete (5577 records). [2025-10-08T17:14:39.823348] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-08T17:14:40.022798] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-08T17:14:40.383938] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-08T17:14:40.384033] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-08T17:14:40.384204] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-08T17:14:40.384264] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-08T17:14:40.384708] [DEBUG] [LOCAL ] AMTD: Trimmed 5577 records to 3706 (keeping 200 days of data) [2025-10-08T17:14:40.406437] [DEBUG] [LOCAL ] AMTD: Primary data saved (3706 records). [2025-10-08T17:14:40.406601] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-08T17:14:40.406719] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTD took 47.8s. Estimated remaining: 4h 54m 40s. Rate: 7.7 symbols/min [2025-10-08T17:14:40.578202] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:40.634928] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-08T17:14:40.635256] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-08T17:14:40.808679] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:40.808875] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-08T17:14:40.808921] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-08T17:14:40.809154] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-08T17:14:40.809211] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-08T17:14:40.822900] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-08T17:14:41.163406] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:41.617558] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-08T17:14:41.881675] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:14:42.241596] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:14:42.417606] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-08T17:14:43.217561] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-08T17:14:43.773863] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T17:14:43.945327] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T17:14:44.017548] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-08T17:14:44.280710] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T17:14:44.817568] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-08T17:14:45.452773] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T17:14:45.617556] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-08T17:14:46.417585] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-08T17:14:46.920491] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T17:14:47.217559] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-08T17:14:47.344733] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:14:47.787232] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:14:47.791222] [INFO ] [REMOTE ] AMTM: Full fetch complete (73931 records). [2025-10-08T17:14:47.791377] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-08T17:14:48.022843] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-08T17:14:48.192585] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-08T17:14:48.192832] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-08T17:14:48.193582] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-08T17:14:48.193661] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-08T17:14:48.195188] [DEBUG] [LOCAL ] AMTM: Trimmed 73931 records to 50653 (keeping 200 days of data) [2025-10-08T17:14:48.501181] [DEBUG] [LOCAL ] AMTM: Primary data saved (50653 records). [2025-10-08T17:14:48.501332] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-08T17:14:48.501443] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMTM took 42.4s. Estimated remaining: 4h 54m 38s. Rate: 7.7 symbols/min [2025-10-08T17:14:48.667329] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:48.716254] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-08T17:14:48.716678] [INFO ] [MAIN ] ANF: Loaded 52101 existing records. [2025-10-08T17:14:48.822781] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-08T17:14:48.895235] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:14:48.895438] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-08T17:14:48.895484] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-08T17:14:48.895707] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-08T17:14:48.895764] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-08T17:14:49.254927] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:49.452951] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:14:49.623092] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-08T17:14:49.628998] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-08T17:14:50.115927] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:14:50.417569] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-08T17:14:51.089227] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T17:14:51.217574] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-08T17:14:51.542629] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:14:52.017541] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-08T17:14:52.817530] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-08T17:14:52.947982] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:14:53.520039] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:14:53.523846] [INFO ] [REMOTE ] AMX: Full fetch complete (70731 records). [2025-10-08T17:14:53.524017] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-08T17:14:53.623015] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-08T17:14:53.937716] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-08T17:14:53.937849] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-08T17:14:53.938679] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-08T17:14:53.938761] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-08T17:14:53.940543] [DEBUG] [LOCAL ] AMX: Trimmed 70731 records to 49124 (keeping 200 days of data) [2025-10-08T17:14:54.058691] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:14:54.274933] [DEBUG] [LOCAL ] AMX: Primary data saved (49124 records). [2025-10-08T17:14:54.275108] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-08T17:14:54.275191] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 31.9s. Estimated remaining: 4h 53m 49s. Rate: 7.7 symbols/min [2025-10-08T17:14:54.428174] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-08T17:14:54.463102] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:54.463306] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-08T17:14:54.463364] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-08T17:14:54.463508] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-08T17:14:54.463574] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-08T17:14:54.463623] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-08T17:14:54.463700] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-08T17:14:54.830187] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:55.217562] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-08T17:14:55.572217] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:14:55.749216] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:14:56.017536] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-08T17:14:56.817585] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-08T17:14:57.009444] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:14:57.009822] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-08T17:14:57.009925] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:14:57.010011] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-08T17:14:57.010090] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:14:57.010179] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-08T17:14:57.010259] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-08T17:14:57.010298] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-08T17:14:57.010338] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-08T17:14:57.010386] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. ANGX took 2.7s. Estimated remaining: 4h 52m 2s. Rate: 7.7 symbols/min [2025-10-08T17:14:57.189428] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:14:57.189634] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-08T17:14:57.189711] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-08T17:14:57.189824] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-08T17:14:57.189868] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-08T17:14:57.189909] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-08T17:14:57.189941] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-08T17:14:57.575265] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:14:57.608295] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-08T17:14:57.618953] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-08T17:14:57.753878] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:14:58.417632] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-08T17:14:58.759068] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:14:59.217598] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-08T17:15:00.017707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-08T17:15:00.819628] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-08T17:15:00.822126] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-08T17:15:01.010037] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:15:01.162405] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T17:15:01.617619] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-08T17:15:02.353820] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T17:15:02.417548] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-08T17:15:03.217692] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-08T17:15:03.339667] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T17:15:03.937485] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T17:15:04.017545] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-08T17:15:04.817511] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-08T17:15:05.276832] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T17:15:05.617511] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-08T17:15:05.771411] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T17:15:06.115284] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T17:15:06.417584] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-08T17:15:06.568728] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T17:15:07.217531] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-08T17:15:07.258579] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:15:07.261308] [INFO ] [REMOTE ] AN: Full fetch complete (47151 records). [2025-10-08T17:15:07.261741] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-08T17:15:07.263568] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:15:07.263718] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:15:07.263776] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:15:07.263850] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-08T17:15:07.263922] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-08T17:15:07.263962] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-08T17:15:07.264245] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-10-08T17:15:07.264395] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. AN took 31.5s. Estimated remaining: 4h 52m 42s. Rate: 7.7 symbols/min [2025-10-08T17:15:07.434762] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:07.434989] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-10-08T17:15:07.435028] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-10-08T17:15:07.435146] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-08T17:15:07.435186] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-08T17:15:07.435227] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-08T17:15:07.435260] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-08T17:15:07.798104] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:08.017543] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-08T17:15:08.817577] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-08T17:15:09.100433] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T17:15:09.533998] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:15:09.617557] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-08T17:15:09.817108] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T17:15:10.417719] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-08T17:15:10.966233] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:15:11.217586] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-08T17:15:12.017536] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-08T17:15:12.259589] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:15:12.536371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T17:15:12.817564] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-08T17:15:13.540601] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:15:13.617554] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-08T17:15:14.264638] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:15:14.417560] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-08T17:15:15.217557] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-08T17:15:16.017533] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-08T17:15:16.078896] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-08T17:15:16.162800] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T17:15:16.472057] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T17:15:16.802093] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:15:16.817507] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-08T17:15:17.617565] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-08T17:15:18.417541] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-08T17:15:18.557000] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T17:15:18.720945] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:15:19.217508] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-08T17:15:19.307462] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:15:20.017541] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-08T17:15:20.817573] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-08T17:15:21.281738] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T17:15:21.307952] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T17:15:21.506522] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:15:21.617569] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-08T17:15:22.422080] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-08T17:15:22.426872] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:15:22.981043] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T17:15:23.217702] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-08T17:15:23.988835] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:15:24.017549] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-08T17:15:24.817561] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-08T17:15:24.980697] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T17:15:25.617609] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-08T17:15:26.417589] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-08T17:15:27.035148] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-08T17:15:27.040080] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-08T17:15:27.040300] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-08T17:15:27.225997] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-08T17:15:27.495407] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-08T17:15:27.496332] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-08T17:15:27.499060] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:15:27.498011] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-08T17:15:27.502154] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-08T17:15:27.502747] [INFO ] [REMOTE ] ANRO: Full fetch complete (29609 records). [2025-10-08T17:15:27.502884] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-08T17:15:27.611639] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 53766 (keeping 200 days of data) [2025-10-08T17:15:27.801246] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T17:15:27.840785] [INFO ] [REMOTE ] ANF: Full fetch complete (75610 records). [2025-10-08T17:15:27.871076] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-08T17:15:28.316085] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-08T17:15:28.317867] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-08T17:15:28.337469] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-08T17:15:28.388469] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-08T17:15:28.489989] [DEBUG] [LOCAL ] ANRO: Trimmed 29609 records to 19212 (keeping 200 days of data) [2025-10-08T17:15:28.704157] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T17:15:28.703457] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-08T17:15:28.754022] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-08T17:15:28.774971] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-08T17:15:28.775742] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-08T17:15:28.775630] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-08T17:15:28.788519] [DEBUG] [LOCAL ] ANF: Trimmed 75610 records to 52101 (keeping 200 days of data) [2025-10-08T17:15:28.958765] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-08T17:15:28.961558] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-08T17:15:28.967290] [DEBUG] [LOCAL ] ANRO: Primary data saved (19212 records). [2025-10-08T17:15:28.965302] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 48.6s. Estimated remaining: 4h 57m 3s. Rate: 7.6 symbols/min [2025-10-08T17:15:28.967948] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-08T17:15:28.968141] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 32.0s. Estimated remaining: 4h 54m 24s. Rate: 7.7 symbols/min [2025-10-08T17:15:29.170442] [DEBUG] [LOCAL ] ANF: Primary data saved (52101 records). [2025-10-08T17:15:29.170617] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-08T17:15:29.170760] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 40.7s. Estimated remaining: 4h 51m 52s. Rate: 7.7 symbols/min [2025-10-08T17:15:29.854630] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:15:29.859920] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-08T17:15:30.785197] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:15:30.789602] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-08T17:15:31.962545] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:15:31.965571] [INFO ] [REMOTE ] ANVS: Full fetch complete (35929 records). [2025-10-08T17:15:31.965801] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-08T17:15:31.966895] [FATAL] [VALIDATOR ] ANVS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:15:31.969572] [FATAL] [MAIN ] ANVS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:15:31.970590] [WARN ] [MAIN ] ANVS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:15:31.970777] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-08T17:15:31.970897] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-08T17:15:31.970951] [INFO ] [LOCAL ] ANVS: Starting deletion of derivative data. [2025-10-08T17:15:31.971021] [DEBUG] [LOCAL ] ANVS: No derivative data file found to delete. [2025-10-08T17:15:31.971163] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 24.7s. Estimated remaining: 4h 50m 10s. Rate: 7.8 symbols/min [2025-10-08T17:15:32.722802] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.828265] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.845406] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-08T17:15:32.875038] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-10-08T17:15:32.928511] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.933126] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-10-08T17:15:32.908871] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-08T17:15:32.932869] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:32.933468] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-08T17:15:32.934128] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-08T17:15:32.934000] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-08T17:15:32.934590] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-08T17:15:32.934502] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-08T17:15:32.935068] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-08T17:15:32.935170] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-08T17:15:32.935226] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-08T17:15:33.315874] [DEBUG] [LOCAL ] AOMR: Loaded 16462 existing records from primary storage. [2025-10-08T17:15:33.361924] [INFO ] [MAIN ] AOMR: Loaded 16462 existing records. [2025-10-08T17:15:33.617392] [DEBUG] [LOCAL ] AON: Loaded 45201 existing records from primary storage. [2025-10-08T17:15:33.665173] [INFO ] [MAIN ] AON: Loaded 45201 existing records. [2025-10-08T17:15:34.024733] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:15:34.029830] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.033276] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.033401] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-08T17:15:34.034497] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-08T17:15:34.034440] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-08T17:15:34.034233] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-08T17:15:34.058547] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-08T17:15:34.058805] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-08T17:15:34.184483] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:15:34.197313] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-08T17:15:34.197434] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-08T17:15:34.227861] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-08T17:15:34.230907] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-08T17:15:34.349377] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:15:34.384900] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-08T17:15:34.418875] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:15:34.444251] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-08T17:15:34.539987] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:15:34.595525] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-08T17:15:34.644986] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-08T17:15:34.683145] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-08T17:15:34.746247] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-08T17:15:34.789542] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.806473] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-08T17:15:34.789771] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 2.8s. Estimated remaining: 4h 48m 31s. Rate: 7.8 symbols/min [2025-10-08T17:15:34.960281] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:34.976702] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-08T17:15:35.073212] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:15:35.073469] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-08T17:15:35.073527] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-08T17:15:35.073661] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-08T17:15:35.073722] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-08T17:15:35.073768] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-08T17:15:35.073808] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-08T17:15:35.460875] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:15:35.489110] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-08T17:15:35.561582] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:15:35.562204] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-08T17:15:35.684322] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:15:35.687303] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-08T17:15:36.358518] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:15:36.367157] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-08T17:15:36.477914] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:15:36.706491] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:15:36.817533] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-08T17:15:36.873475] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:15:37.493204] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:15:37.617517] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-08T17:15:37.922101] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:15:38.417563] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-08T17:15:38.615825] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T17:15:39.217578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-08T17:15:39.597927] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:15:39.856097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:15:40.017567] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-08T17:15:40.817578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-08T17:15:41.580536] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T17:15:41.617542] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-08T17:15:41.696966] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:15:42.417584] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-08T17:15:42.865316] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T17:15:43.217566] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-08T17:15:43.890676] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:15:43.911278] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:15:44.017552] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-08T17:15:44.817617] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-08T17:15:45.310717] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:15:45.617573] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-08T17:15:46.235904] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:15:46.417595] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-08T17:15:46.999870] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:15:47.217553] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-08T17:15:48.017587] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-08T17:15:48.322099] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T17:15:48.352362] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:15:48.817569] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-08T17:15:48.844879] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:15:49.617621] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-08T17:15:50.157776] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:15:50.417601] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-08T17:15:51.217575] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-08T17:15:51.297334] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:15:51.518867] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:15:52.017620] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-08T17:15:52.256860] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:15:52.817628] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-08T17:15:53.176080] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:15:53.617524] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-08T17:15:53.826335] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:15:54.417618] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-08T17:15:54.633103] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:15:55.217585] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-08T17:15:55.248848] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:15:56.017591] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-08T17:15:56.817587] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-08T17:15:56.904381] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:15:57.617518] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-08T17:15:57.667164] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:15:58.016023] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:15:58.417604] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-08T17:15:59.173025] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:15:59.217585] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-08T17:15:59.278321] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T17:16:00.017551] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-08T17:16:00.443753] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:16:00.817569] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-08T17:16:01.551573] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:16:01.617495] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-08T17:16:01.826247] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:16:01.827825] [INFO ] [REMOTE ] AOMR: Full fetch complete (23164 records). [2025-10-08T17:16:01.827935] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-08T17:16:02.289473] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-08T17:16:02.289598] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-08T17:16:02.290097] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-08T17:16:02.290171] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-08T17:16:02.290921] [DEBUG] [LOCAL ] AOMR: Trimmed 23164 records to 16437 (keeping 200 days of data) [2025-10-08T17:16:02.404592] [DEBUG] [LOCAL ] AOMR: Primary data saved (16437 records). [2025-10-08T17:16:02.404782] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-08T17:16:02.404888] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 30.4s. Estimated remaining: 4h 54m 31s. Rate: 7.6 symbols/min [2025-10-08T17:16:02.419142] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-08T17:16:02.605304] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:02.658180] [DEBUG] [LOCAL ] AOS: Loaded 48724 existing records from primary storage. [2025-10-08T17:16:02.673473] [INFO ] [MAIN ] AOS: Loaded 48724 existing records. [2025-10-08T17:16:02.708358] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:16:02.867972] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:02.868231] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-08T17:16:02.868322] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-08T17:16:02.868635] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-08T17:16:02.868732] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-08T17:16:03.216019] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:03.217499] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-08T17:16:03.701163] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:16:03.703493] [INFO ] [REMOTE ] AORT: Full fetch complete (42066 records). [2025-10-08T17:16:03.703591] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-08T17:16:04.023765] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-08T17:16:04.073829] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-08T17:16:04.073924] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-08T17:16:04.074421] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-08T17:16:04.074464] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-08T17:16:04.075511] [DEBUG] [LOCAL ] AORT: Trimmed 42066 records to 29234 (keeping 200 days of data) [2025-10-08T17:16:04.244970] [DEBUG] [LOCAL ] AORT: Primary data saved (29234 records). [2025-10-08T17:16:04.245123] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-08T17:16:04.245200] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AORT took 29.4s. Estimated remaining: 4h 52m 33s. Rate: 7.7 symbols/min [2025-10-08T17:16:04.410260] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:04.410481] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-10-08T17:16:04.410535] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-10-08T17:16:04.410680] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-08T17:16:04.410738] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-08T17:16:04.410782] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-08T17:16:04.410813] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-08T17:16:04.756490] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:04.817502] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-08T17:16:05.125415] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T17:16:05.472623] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T17:16:05.504964] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:16:05.617524] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-08T17:16:06.417581] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-08T17:16:07.078464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T17:16:07.217522] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-08T17:16:07.257484] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:16:08.017568] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-08T17:16:08.563339] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:16:08.565891] [INFO ] [REMOTE ] AOD: Full fetch complete (44297 records). [2025-10-08T17:16:08.565985] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-08T17:16:08.566598] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:08.566718] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:08.566807] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:08.566879] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-08T17:16:08.566947] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-08T17:16:08.566982] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-10-08T17:16:08.567020] [DEBUG] [LOCAL ] AOD: No derivative data file found to delete. [2025-10-08T17:16:08.567076] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOD took 36.6s. Estimated remaining: 4h 51m 22s. Rate: 7.7 symbols/min [2025-10-08T17:16:08.731947] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:08.732116] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-08T17:16:08.732152] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-08T17:16:08.732261] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-08T17:16:08.732302] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-08T17:16:08.732342] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-08T17:16:08.732377] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-08T17:16:08.826770] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-08T17:16:09.164311] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:09.171309] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:16:09.174043] [INFO ] [REMOTE ] AON: Full fetch complete (64394 records). [2025-10-08T17:16:09.174128] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-08T17:16:09.174718] [FATAL] [VALIDATOR ] AON: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:09.174806] [FATAL] [MAIN ] AON: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:09.174848] [WARN ] [MAIN ] AON: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:09.174886] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-08T17:16:09.174965] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-08T17:16:09.175025] [INFO ] [LOCAL ] AON: Starting deletion of derivative data. [2025-10-08T17:16:09.175370] [DEBUG] [LOCAL ] AON: Deleted derivative data file. [2025-10-08T17:16:09.175476] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 37.2s. Estimated remaining: 4h 49m 5s. Rate: 7.8 symbols/min [2025-10-08T17:16:09.340824] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:09.340999] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-10-08T17:16:09.341036] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-10-08T17:16:09.341145] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-08T17:16:09.341185] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-08T17:16:09.341231] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-08T17:16:09.341297] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-08T17:16:09.622693] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-08T17:16:09.694821] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:10.368925] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:16:10.417522] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-08T17:16:11.017676] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T17:16:11.217704] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-08T17:16:12.017567] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-08T17:16:12.063755] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:16:12.394166] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:16:12.817558] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-08T17:16:12.929881] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:16:13.617502] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-08T17:16:14.099758] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:16:14.417573] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-08T17:16:15.217539] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-08T17:16:15.449960] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:16:15.833074] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T17:16:15.945232] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T17:16:16.017511] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-08T17:16:16.817556] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-08T17:16:17.311240] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T17:16:17.516494] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:16:17.617581] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-08T17:16:18.417573] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-08T17:16:19.133293] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:16:19.199256] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:16:19.217501] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-08T17:16:20.017578] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-08T17:16:20.155833] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T17:16:20.817625] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-08T17:16:21.617555] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-08T17:16:21.715856] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:16:22.277890] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:16:22.417550] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-08T17:16:23.217548] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-08T17:16:23.260798] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T17:16:23.883229] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:16:23.944256] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T17:16:24.017693] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-08T17:16:24.497626] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T17:16:24.817881] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-08T17:16:25.558278] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:16:25.617553] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-08T17:16:26.393952] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T17:16:26.394979] [INFO ] [REMOTE ] AP: Full fetch complete (8957 records). [2025-10-08T17:16:26.395071] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-08T17:16:26.425246] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-08T17:16:26.762219] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-08T17:16:26.762300] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-08T17:16:26.762518] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-08T17:16:26.762557] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-08T17:16:26.763016] [DEBUG] [LOCAL ] AP: Trimmed 8957 records to 7216 (keeping 200 days of data) [2025-10-08T17:16:26.803783] [DEBUG] [LOCAL ] AP: Primary data saved (7216 records). [2025-10-08T17:16:26.803908] [INFO ] [MAIN ] AP: Full history saved. [2025-10-08T17:16:26.803982] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 22.6s. Estimated remaining: 4h 51m 54s. Rate: 7.7 symbols/min [2025-10-08T17:16:26.977392] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:27.027783] [DEBUG] [LOCAL ] APG: Loaded 50426 existing records from primary storage. [2025-10-08T17:16:27.028160] [INFO ] [MAIN ] APG: Loaded 50426 existing records. [2025-10-08T17:16:27.224726] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-08T17:16:27.232401] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:27.232788] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-08T17:16:27.232895] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-08T17:16:27.233226] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-08T17:16:27.233287] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-08T17:16:27.593962] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:28.017520] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-08T17:16:28.314198] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T17:16:28.410749] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T17:16:28.817545] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-08T17:16:29.503883] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:16:29.617501] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-08T17:16:30.213812] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:16:30.417592] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-08T17:16:31.129492] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:16:31.217575] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-08T17:16:31.846966] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:16:32.017577] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-08T17:16:32.753720] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:16:32.817582] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-08T17:16:33.526634] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:16:33.617519] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-08T17:16:34.417519] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-08T17:16:34.467047] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T17:16:35.217558] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-08T17:16:35.567584] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T17:16:35.643477] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:16:36.017551] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-08T17:16:36.817531] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-08T17:16:36.910210] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:16:37.323937] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:16:37.327809] [INFO ] [REMOTE ] AOS: Full fetch complete (70320 records). [2025-10-08T17:16:37.327974] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-08T17:16:37.329106] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:16:37.329233] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:16:37.329277] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:16:37.329316] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-08T17:16:37.329376] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-08T17:16:37.329445] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-10-08T17:16:37.329754] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-10-08T17:16:37.329854] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 34.9s. Estimated remaining: 4h 52m 34s. Rate: 7.7 symbols/min [2025-10-08T17:16:37.527795] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:37.578053] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-08T17:16:37.578412] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-08T17:16:37.622715] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-08T17:16:37.770075] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:37.771178] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-08T17:16:37.771284] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-08T17:16:37.772021] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-08T17:16:37.772079] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-08T17:16:37.985511] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:16:38.180270] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:38.417548] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-08T17:16:39.217605] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-08T17:16:39.514000] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:16:40.017603] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-08T17:16:40.239250] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:16:40.386986] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T17:16:40.817617] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-08T17:16:41.286190] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T17:16:41.617561] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-08T17:16:41.978580] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:16:42.417591] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-08T17:16:43.217551] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-08T17:16:43.312099] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:16:44.017586] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-08T17:16:44.289465] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:16:44.809335] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:16:44.819718] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-08T17:16:45.617630] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-08T17:16:45.736685] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:16:46.417554] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-08T17:16:46.449179] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:16:47.217590] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-08T17:16:47.367940] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T17:16:48.017574] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-08T17:16:48.232252] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:16:48.344868] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:16:48.817591] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-08T17:16:49.617509] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-08T17:16:49.713057] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:16:50.417595] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-08T17:16:50.692358] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:16:51.217576] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-08T17:16:51.427486] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:16:51.562865] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:16:51.565938] [INFO ] [REMOTE ] APAM: Full fetch complete (51835 records). [2025-10-08T17:16:51.566087] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-08T17:16:52.024293] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-08T17:16:52.026267] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-08T17:16:52.026367] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-08T17:16:52.026960] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-08T17:16:52.027146] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-08T17:16:52.028521] [DEBUG] [LOCAL ] APAM: Trimmed 51835 records to 36012 (keeping 200 days of data) [2025-10-08T17:16:52.249406] [DEBUG] [LOCAL ] APAM: Primary data saved (36012 records). [2025-10-08T17:16:52.249572] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-08T17:16:52.249682] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 43.7s. Estimated remaining: 4h 54m 31s. Rate: 7.6 symbols/min [2025-10-08T17:16:52.415086] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:52.471426] [DEBUG] [LOCAL ] APLE: Loaded 51950 existing records from primary storage. [2025-10-08T17:16:52.471946] [INFO ] [MAIN ] APLE: Loaded 51950 existing records. [2025-10-08T17:16:52.536925] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:16:52.582809] [INFO ] [REMOTE ] APG: Full fetch complete (71791 records). [2025-10-08T17:16:52.593248] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-08T17:16:52.823287] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-08T17:16:52.936234] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:52.968365] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-08T17:16:53.021399] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-08T17:16:53.048443] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-08T17:16:53.048558] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-08T17:16:53.316724] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-08T17:16:53.414295] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-08T17:16:53.427130] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-08T17:16:53.443870] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-08T17:16:53.537911] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:53.539052] [DEBUG] [LOCAL ] APG: Trimmed 71791 records to 50463 (keeping 200 days of data) [2025-10-08T17:16:53.620997] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-08T17:16:53.664198] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:16:53.924294] [DEBUG] [LOCAL ] APG: Primary data saved (50463 records). [2025-10-08T17:16:53.924466] [INFO ] [MAIN ] APG: Full history saved. [2025-10-08T17:16:53.924582] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APG took 27.1s. Estimated remaining: 4h 52m 35s. Rate: 7.7 symbols/min [2025-10-08T17:16:54.130088] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:54.191105] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-08T17:16:54.191499] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-08T17:16:54.420348] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-08T17:16:54.424459] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:16:54.426216] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-08T17:16:54.426271] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-08T17:16:54.426593] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-08T17:16:54.426687] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-08T17:16:54.887561] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:54.925236] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T17:16:55.217545] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-08T17:16:55.496493] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:16:55.828264] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:16:56.017621] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-08T17:16:56.817524] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-08T17:16:56.913501] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:16:57.289221] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:16:57.292694] [INFO ] [REMOTE ] APD: Full fetch complete (66868 records). [2025-10-08T17:16:57.292841] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-08T17:16:57.630202] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-08T17:16:57.691444] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-08T17:16:57.691551] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-08T17:16:57.692320] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-08T17:16:57.692392] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-08T17:16:57.693922] [DEBUG] [LOCAL ] APD: Trimmed 66868 records to 45285 (keeping 200 days of data) [2025-10-08T17:16:57.998350] [DEBUG] [LOCAL ] APD: Primary data saved (45285 records). [2025-10-08T17:16:57.998531] [INFO ] [MAIN ] APD: Full history saved. [2025-10-08T17:16:57.998636] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APD took 48.8s. Estimated remaining: 4h 51m 23s. Rate: 7.7 symbols/min [2025-10-08T17:16:58.194069] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:16:58.194350] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-08T17:16:58.194460] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-08T17:16:58.194777] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-08T17:16:58.194917] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-08T17:16:58.195127] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-08T17:16:58.195204] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-08T17:16:58.426875] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-08T17:16:58.526119] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:16:58.620612] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:16:59.155896] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:16:59.217572] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-08T17:17:00.017617] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-08T17:17:00.114615] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:17:00.195040] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T17:17:00.817609] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-08T17:17:01.207504] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T17:17:01.617516] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-08T17:17:01.772935] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T17:17:02.096251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:17:02.417573] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-08T17:17:02.952555] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T17:17:03.217608] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-08T17:17:04.017576] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-08T17:17:04.817613] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-08T17:17:04.834236] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:17:05.373741] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T17:17:05.617631] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-08T17:17:06.417523] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-08T17:17:06.609558] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:17:06.913332] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:17:07.196445] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T17:17:07.217536] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-08T17:17:08.019435] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-08T17:17:08.020462] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:17:08.817553] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-08T17:17:09.506381] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:17:09.617591] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-08T17:17:10.125781] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T17:17:10.417557] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-08T17:17:11.110340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T17:17:11.217597] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-08T17:17:12.017634] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-08T17:17:12.420989] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T17:17:12.751356] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:17:12.817498] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-08T17:17:13.617525] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-08T17:17:14.098387] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:17:14.417545] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-08T17:17:14.710199] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:17:15.217555] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-08T17:17:15.795482] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T17:17:15.799450] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-08T17:17:15.799590] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-08T17:17:16.025041] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-08T17:17:16.194034] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-08T17:17:16.194131] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-08T17:17:16.194979] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-08T17:17:16.195049] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-08T17:17:16.196615] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 53691 (keeping 200 days of data) [2025-10-08T17:17:16.573793] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T17:17:16.595023] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-08T17:17:16.595177] [INFO ] [MAIN ] APH: Full history saved. [2025-10-08T17:17:16.595275] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 39.3s. Estimated remaining: 4h 54m 20s. Rate: 7.6 symbols/min [2025-10-08T17:17:16.771425] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:16.777222] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:17:16.824155] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-08T17:17:16.829271] [DEBUG] [LOCAL ] APTV: Loaded 52052 existing records from primary storage. [2025-10-08T17:17:16.829829] [INFO ] [MAIN ] APTV: Loaded 52052 existing records. [2025-10-08T17:17:17.011628] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:17.011949] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-08T17:17:17.012006] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-08T17:17:17.037593] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-08T17:17:17.037751] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-08T17:17:17.082675] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T17:17:17.431991] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:17.596690] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:17:17.617559] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-08T17:17:18.417604] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-08T17:17:19.144439] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T17:17:19.145455] [INFO ] [REMOTE ] APOS: Full fetch complete (10400 records). [2025-10-08T17:17:19.145546] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-08T17:17:19.222688] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-08T17:17:19.521753] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-08T17:17:19.521895] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-08T17:17:19.522247] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-08T17:17:19.522347] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-08T17:17:19.523220] [DEBUG] [LOCAL ] APOS: Trimmed 10400 records to 7519 (keeping 200 days of data) [2025-10-08T17:17:19.597038] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:17:19.599110] [DEBUG] [LOCAL ] APOS: Primary data saved (7519 records). [2025-10-08T17:17:19.609935] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-08T17:17:19.610557] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APOS took 21.6s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-08T17:17:19.775909] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:19.776111] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-08T17:17:19.776147] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-08T17:17:19.776263] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-08T17:17:19.776304] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-08T17:17:19.776343] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-08T17:17:19.776374] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-08T17:17:20.022717] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-08T17:17:20.136493] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:20.817518] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-08T17:17:21.058060] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:17:21.617533] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-08T17:17:21.717550] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:17:22.343134] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:17:22.417501] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-08T17:17:23.217517] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-08T17:17:23.266938] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T17:17:23.995105] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T17:17:24.017516] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-08T17:17:24.689813] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:17:24.817504] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-08T17:17:25.617520] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-08T17:17:25.661956] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:17:26.417574] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-08T17:17:26.841070] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-08T17:17:27.043833] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:17:27.217569] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-08T17:17:27.964570] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:17:28.017516] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-08T17:17:28.817565] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-08T17:17:29.165096] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T17:17:29.315530] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:17:29.617590] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-08T17:17:30.250193] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:17:30.417532] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-08T17:17:30.967404] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T17:17:31.217556] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-08T17:17:31.674630] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:17:31.678695] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-10-08T17:17:31.678809] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-08T17:17:32.022701] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-08T17:17:32.082410] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-08T17:17:32.082513] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-08T17:17:32.083351] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-08T17:17:32.083420] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-08T17:17:32.085293] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53383 (keeping 200 days of data) [2025-10-08T17:17:32.424194] [DEBUG] [LOCAL ] APO: Primary data saved (53383 records). [2025-10-08T17:17:32.424352] [INFO ] [MAIN ] APO: Full history saved. [2025-10-08T17:17:32.425323] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APO took 38.5s. Estimated remaining: 4h 54m 5s. Rate: 7.6 symbols/min [2025-10-08T17:17:32.599921] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:32.600164] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-10-08T17:17:32.600220] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-10-08T17:17:32.600401] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-08T17:17:32.600495] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-08T17:17:32.600584] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-10-08T17:17:32.600633] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-08T17:17:32.825491] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-08T17:17:32.964173] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:33.150941] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:17:33.617554] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-08T17:17:33.790573] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:17:34.339853] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:17:34.417589] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-08T17:17:34.439556] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:17:34.446062] [INFO ] [REMOTE ] APLE: Full fetch complete (74374 records). [2025-10-08T17:17:34.446511] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-08T17:17:34.822280] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T17:17:34.952113] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-08T17:17:34.952241] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-08T17:17:34.953168] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-08T17:17:34.953243] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-08T17:17:34.954938] [DEBUG] [LOCAL ] APLE: Trimmed 74374 records to 51926 (keeping 200 days of data) [2025-10-08T17:17:35.217553] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-08T17:17:35.312093] [DEBUG] [LOCAL ] APLE: Primary data saved (51926 records). [2025-10-08T17:17:35.312263] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-08T17:17:35.312376] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APLE took 43.1s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-08T17:17:35.506926] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:35.565023] [DEBUG] [LOCAL ] AR: Loaded 53589 existing records from primary storage. [2025-10-08T17:17:35.565460] [INFO ] [MAIN ] AR: Loaded 53589 existing records. [2025-10-08T17:17:35.776432] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:35.776762] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-08T17:17:35.776844] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-08T17:17:35.777174] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-08T17:17:35.777243] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-08T17:17:36.022673] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-08T17:17:36.205565] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:36.817608] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-08T17:17:36.876798] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:17:37.281120] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T17:17:37.527599] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:17:37.617585] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-08T17:17:38.169540] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:17:38.417621] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-08T17:17:39.217617] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-08T17:17:40.017557] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-08T17:17:40.279071] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:17:40.614232] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T17:17:40.615686] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:17:40.817594] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-08T17:17:41.617595] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-08T17:17:42.417516] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-08T17:17:42.599914] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:17:43.045078] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:17:43.217546] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-08T17:17:43.326945] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:17:43.817011] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:17:44.017515] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-08T17:17:44.817593] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-08T17:17:45.617578] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-08T17:17:45.862269] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:17:46.324090] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:17:46.417532] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-08T17:17:47.217550] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-08T17:17:47.311032] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:17:47.659513] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T17:17:48.017583] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-08T17:17:48.220477] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:17:48.817558] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-08T17:17:49.617596] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-08T17:17:49.643729] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:17:49.648361] [INFO ] [REMOTE ] AQN: Full fetch complete (75259 records). [2025-10-08T17:17:49.648593] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-08T17:17:50.112705] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-08T17:17:50.112907] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-08T17:17:50.113757] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-08T17:17:50.113867] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-08T17:17:50.115754] [DEBUG] [LOCAL ] AQN: Trimmed 75259 records to 51841 (keeping 200 days of data) [2025-10-08T17:17:50.238343] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:17:50.426837] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-08T17:17:50.469992] [DEBUG] [LOCAL ] AQN: Primary data saved (51841 records). [2025-10-08T17:17:50.470266] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-08T17:17:50.470392] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQN took 30.9s. Estimated remaining: 4h 54m 27s. Rate: 7.6 symbols/min [2025-10-08T17:17:50.641847] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:50.684867] [DEBUG] [LOCAL ] ARCO: Loaded 44383 existing records from primary storage. [2025-10-08T17:17:50.685245] [INFO ] [MAIN ] ARCO: Loaded 44383 existing records. [2025-10-08T17:17:50.877502] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:50.877774] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-08T17:17:50.877826] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-08T17:17:50.878159] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-08T17:17:50.878218] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-08T17:17:51.225817] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-08T17:17:51.273068] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:51.605075] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T17:17:51.819082] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T17:17:51.870673] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:17:52.017600] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-08T17:17:52.817630] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-08T17:17:53.406467] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:17:53.435546] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T17:17:53.617612] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-08T17:17:54.098767] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T17:17:54.099623] [INFO ] [REMOTE ] AQNB: Full fetch complete (5612 records). [2025-10-08T17:17:54.099726] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-08T17:17:54.423403] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-08T17:17:54.459408] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-08T17:17:54.459532] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-08T17:17:54.459768] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-08T17:17:54.459830] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-08T17:17:54.460360] [DEBUG] [LOCAL ] AQNB: Trimmed 5612 records to 4147 (keeping 200 days of data) [2025-10-08T17:17:54.491578] [DEBUG] [LOCAL ] AQNB: Primary data saved (4147 records). [2025-10-08T17:17:54.491738] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-08T17:17:54.491836] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQNB took 22.1s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-08T17:17:54.665152] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:17:54.687214] [DEBUG] [LOCAL ] ARDC: Loaded 15020 existing records from primary storage. [2025-10-08T17:17:54.687493] [INFO ] [MAIN ] ARDC: Loaded 15020 existing records. [2025-10-08T17:17:54.864804] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:17:54.865111] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-08T17:17:54.865164] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-08T17:17:54.865440] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-08T17:17:54.865499] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-08T17:17:55.219411] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-08T17:17:55.245032] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:17:56.017517] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-08T17:17:56.121416] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:17:56.817530] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-08T17:17:56.976102] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:17:57.552807] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:17:57.617520] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-08T17:17:58.417564] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-08T17:17:58.607824] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:17:58.608524] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T17:17:59.217576] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-08T17:17:59.441048] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:18:00.017616] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-08T17:18:00.817591] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-08T17:18:01.053301] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:18:01.603548] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T17:18:01.617501] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-08T17:18:02.417566] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-08T17:18:02.554860] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:18:03.217578] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-08T17:18:03.258725] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T17:18:03.308408] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T17:18:04.017604] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-08T17:18:04.817562] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-08T17:18:05.104969] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T17:18:05.443192] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T17:18:05.447210] [INFO ] [REMOTE ] APTV: Full fetch complete (75874 records). [2025-10-08T17:18:05.447347] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-08T17:18:05.622727] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-08T17:18:05.773750] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:18:05.858965] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-08T17:18:05.859054] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-08T17:18:05.859842] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-08T17:18:05.859908] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-08T17:18:05.861384] [DEBUG] [LOCAL ] APTV: Trimmed 75874 records to 52044 (keeping 200 days of data) [2025-10-08T17:18:06.173838] [DEBUG] [LOCAL ] APTV: Primary data saved (52044 records). [2025-10-08T17:18:06.174000] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-08T17:18:06.174089] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. APTV took 49.6s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-08T17:18:06.341793] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:06.368111] [DEBUG] [LOCAL ] ARDT: Loaded 27787 existing records from primary storage. [2025-10-08T17:18:06.368369] [INFO ] [MAIN ] ARDT: Loaded 27787 existing records. [2025-10-08T17:18:06.430546] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-08T17:18:06.548915] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:06.549124] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-08T17:18:06.549198] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-08T17:18:06.549521] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-08T17:18:06.549595] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-08T17:18:06.905580] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:07.158290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T17:18:07.217565] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-08T17:18:08.017522] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-08T17:18:08.295921] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:18:08.311837] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-08T17:18:08.316009] [INFO ] [REMOTE ] AR: Full fetch complete (77552 records). [2025-10-08T17:18:08.316170] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-08T17:18:08.708829] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-08T17:18:08.708919] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-08T17:18:08.709776] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-08T17:18:08.709845] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-08T17:18:08.711337] [DEBUG] [LOCAL ] AR: Trimmed 77552 records to 53590 (keeping 200 days of data) [2025-10-08T17:18:08.817802] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-08T17:18:09.031158] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:18:09.047987] [DEBUG] [LOCAL ] AR: Primary data saved (53590 records). [2025-10-08T17:18:09.048158] [INFO ] [MAIN ] AR: Full history saved. [2025-10-08T17:18:09.048249] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 33.7s. Estimated remaining: 4h 52m 40s. Rate: 7.6 symbols/min [2025-10-08T17:18:09.217319] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:09.266980] [DEBUG] [LOCAL ] ARE: Loaded 50729 existing records from primary storage. [2025-10-08T17:18:09.267322] [INFO ] [MAIN ] ARE: Loaded 50729 existing records. [2025-10-08T17:18:09.448056] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:09.448325] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-08T17:18:09.448373] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-08T17:18:09.452000] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-08T17:18:09.452082] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-08T17:18:09.625073] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-08T17:18:09.805073] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:10.288548] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:18:10.417571] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-08T17:18:10.663598] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:18:11.217556] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-08T17:18:12.017525] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-08T17:18:12.110485] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:18:12.121267] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:18:12.817592] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-08T17:18:13.097060] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:18:13.370178] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T17:18:13.617596] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-08T17:18:14.417583] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-08T17:18:14.640417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:18:15.217570] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-08T17:18:15.894449] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T17:18:15.903527] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:18:16.017616] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-08T17:18:16.817573] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-08T17:18:17.581563] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:18:17.617514] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-08T17:18:18.417559] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-08T17:18:18.554751] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T17:18:19.217513] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-08T17:18:19.362395] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:18:19.449863] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T17:18:20.017576] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-08T17:18:20.459088] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:18:20.817566] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-08T17:18:21.617542] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-08T17:18:21.678507] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T17:18:21.681466] [INFO ] [REMOTE ] ARDC: Full fetch complete (21086 records). [2025-10-08T17:18:21.681587] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-08T17:18:21.837599] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:18:22.103525] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-08T17:18:22.103606] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-08T17:18:22.103929] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-08T17:18:22.103989] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-08T17:18:22.104579] [DEBUG] [LOCAL ] ARDC: Trimmed 21086 records to 15046 (keeping 200 days of data) [2025-10-08T17:18:22.198271] [DEBUG] [LOCAL ] ARDC: Primary data saved (15046 records). [2025-10-08T17:18:22.198419] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-08T17:18:22.198553] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 27.7s. Estimated remaining: 4h 53m 57s. Rate: 7.6 symbols/min [2025-10-08T17:18:22.369185] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:22.369384] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-08T17:18:22.369424] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-08T17:18:22.369538] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-08T17:18:22.369578] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-08T17:18:22.369620] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-08T17:18:22.369680] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-08T17:18:22.423086] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-08T17:18:22.724460] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:23.193282] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:18:23.217518] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-08T17:18:23.828439] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:18:24.017561] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-08T17:18:24.542669] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:18:24.545779] [INFO ] [REMOTE ] ARCO: Full fetch complete (64933 records). [2025-10-08T17:18:24.545898] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-08T17:18:24.546758] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:18:24.546885] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:18:24.546954] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:18:24.547024] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-08T17:18:24.547090] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-08T17:18:24.547126] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-08T17:18:24.547371] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-08T17:18:24.548127] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 34.1s. Estimated remaining: 4h 52m 21s. Rate: 7.6 symbols/min [2025-10-08T17:18:24.716298] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:24.716521] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-08T17:18:24.716582] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-08T17:18:24.716723] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-08T17:18:24.716772] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-08T17:18:24.716815] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-08T17:18:24.716846] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-08T17:18:24.822659] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-08T17:18:25.087476] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:25.566846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:18:25.617501] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-08T17:18:26.214364] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:18:26.417632] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-08T17:18:27.217588] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-08T17:18:27.358886] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:18:27.580112] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:18:28.017553] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-08T17:18:28.797614] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:18:28.817499] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-08T17:18:29.617532] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-08T17:18:29.833723] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T17:18:30.417569] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-08T17:18:30.605514] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:18:31.217547] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-08T17:18:31.260320] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:18:32.017576] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-08T17:18:32.065437] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:18:32.416326] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T17:18:32.817613] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-08T17:18:33.617591] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-08T17:18:33.826325] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T17:18:34.322462] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:18:34.417552] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-08T17:18:34.903335] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T17:18:35.217600] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-08T17:18:35.538127] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:18:36.017579] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-08T17:18:36.808780] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:18:36.817670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-08T17:18:37.617622] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-08T17:18:37.962160] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:18:38.121728] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:18:38.417560] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-08T17:18:38.826336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:18:39.217585] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-08T17:18:40.017526] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-08T17:18:40.151151] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:18:40.817519] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-08T17:18:41.013329] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T17:18:41.041547] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:18:41.617564] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-08T17:18:42.378072] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:18:42.417577] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-08T17:18:42.721572] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:18:43.217560] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-08T17:18:43.780547] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T17:18:44.017614] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-08T17:18:44.817527] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-08T17:18:44.993045] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:18:45.097510] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:18:45.100344] [INFO ] [REMOTE ] ARDT: Full fetch complete (41588 records). [2025-10-08T17:18:45.100454] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-08T17:18:45.474532] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-08T17:18:45.474619] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-08T17:18:45.475144] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-08T17:18:45.475209] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-08T17:18:45.476192] [DEBUG] [LOCAL ] ARDT: Trimmed 41588 records to 27723 (keeping 200 days of data) [2025-10-08T17:18:45.624167] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-08T17:18:45.639101] [DEBUG] [LOCAL ] ARDT: Primary data saved (27723 records). [2025-10-08T17:18:45.639259] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-08T17:18:45.639349] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 39.5s. Estimated remaining: 4h 55m 42s. Rate: 7.5 symbols/min [2025-10-08T17:18:45.812297] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:45.852232] [DEBUG] [LOCAL ] ARIS: Loaded 42300 existing records from primary storage. [2025-10-08T17:18:45.852578] [INFO ] [MAIN ] ARIS: Loaded 42300 existing records. [2025-10-08T17:18:46.035514] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:46.035789] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-08T17:18:46.035842] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-08T17:18:46.036280] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-08T17:18:46.036342] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-08T17:18:46.421670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-08T17:18:46.425219] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:46.599293] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:18:47.217539] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-08T17:18:47.352473] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:18:47.681519] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:18:48.017551] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-08T17:18:48.709299] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:18:48.817553] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-08T17:18:49.270541] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:18:49.617572] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-08T17:18:50.195435] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:18:50.417591] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-08T17:18:51.217518] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-08T17:18:51.437335] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T17:18:51.528821] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:18:52.017620] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-08T17:18:52.533501] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:18:52.537452] [INFO ] [REMOTE ] ARE: Full fetch complete (72716 records). [2025-10-08T17:18:52.537561] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-08T17:18:52.825348] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-08T17:18:52.931701] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-08T17:18:52.931789] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-08T17:18:52.932522] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-08T17:18:52.932585] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-08T17:18:52.933949] [DEBUG] [LOCAL ] ARE: Trimmed 72716 records to 50757 (keeping 200 days of data) [2025-10-08T17:18:53.205553] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:18:53.301884] [DEBUG] [LOCAL ] ARE: Primary data saved (50757 records). [2025-10-08T17:18:53.302043] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-08T17:18:53.302133] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARE took 44.3s. Estimated remaining: 4h 55m 30s. Rate: 7.5 symbols/min [2025-10-08T17:18:53.471809] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:53.472001] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-08T17:18:53.472040] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-08T17:18:53.472219] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-08T17:18:53.472281] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-08T17:18:53.472325] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-08T17:18:53.472358] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-08T17:18:53.622760] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-08T17:18:53.873890] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:18:54.417565] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-08T17:18:54.486119] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:18:54.996594] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:18:55.217604] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-08T17:18:55.983956] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:18:56.017517] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-08T17:18:56.817542] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-08T17:18:56.841118] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:18:57.617559] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-08T17:18:57.641821] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:18:57.645946] [INFO ] [REMOTE ] ARES: Full fetch complete (70908 records). [2025-10-08T17:18:57.646105] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-08T17:18:58.060762] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-08T17:18:58.060851] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-08T17:18:58.061620] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-08T17:18:58.061705] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-08T17:18:58.064996] [DEBUG] [LOCAL ] ARES: Trimmed 70908 records to 49647 (keeping 200 days of data) [2025-10-08T17:18:58.203096] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:18:58.207815] [INFO ] [REMOTE ] ARI: Full fetch complete (62633 records). [2025-10-08T17:18:58.208733] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-08T17:18:58.440345] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-08T17:18:58.735738] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-08T17:18:58.735848] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-08T17:18:58.738504] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-08T17:18:58.739310] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-08T17:18:58.754869] [DEBUG] [LOCAL ] ARI: Trimmed 62633 records to 43669 (keeping 200 days of data) [2025-10-08T17:18:58.922428] [DEBUG] [LOCAL ] ARES: Primary data saved (49647 records). [2025-10-08T17:18:58.923211] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-08T17:18:58.923666] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 36.7s. Estimated remaining: 4h 54m 45s. Rate: 7.6 symbols/min [2025-10-08T17:18:59.193723] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:59.276325] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T17:18:59.301342] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-08T17:18:59.345708] [DEBUG] [LOCAL ] ARI: Primary data saved (43669 records). [2025-10-08T17:18:59.346512] [DEBUG] [LOCAL ] ARMK: Loaded 50378 existing records from primary storage. [2025-10-08T17:18:59.346607] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-08T17:18:59.346917] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARI took 34.8s. Estimated remaining: 4h 52m 41s. Rate: 7.6 symbols/min [2025-10-08T17:18:59.347099] [INFO ] [MAIN ] ARMK: Loaded 50378 existing records. [2025-10-08T17:18:59.734301] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:18:59.739554] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:18:59.740205] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-08T17:18:59.740424] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-08T17:18:59.740987] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-08T17:18:59.741050] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-08T17:19:00.130058] [DEBUG] [LOCAL ] AROC: Loaded 48944 existing records from primary storage. [2025-10-08T17:19:00.154611] [INFO ] [MAIN ] AROC: Loaded 48944 existing records. [2025-10-08T17:19:00.193638] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:00.246116] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-08T17:19:00.367281] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T17:19:00.449140] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:00.449386] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-08T17:19:00.449435] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-08T17:19:00.449914] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-08T17:19:00.449976] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-08T17:19:00.817669] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:00.817800] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-08T17:19:00.984263] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:19:01.617536] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-08T17:19:01.790667] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:19:01.988766] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T17:19:02.417554] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-08T17:19:03.146343] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:19:03.217519] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-08T17:19:04.017517] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-08T17:19:04.108212] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:19:04.507811] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T17:19:04.817577] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-08T17:19:05.610073] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:19:05.619209] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-08T17:19:06.417547] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-08T17:19:06.499905] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T17:19:06.792215] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:19:07.217545] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-08T17:19:08.017585] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-08T17:19:08.135840] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:19:08.618973] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:19:08.817569] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-08T17:19:09.428784] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:19:09.617554] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-08T17:19:10.417554] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-08T17:19:10.481506] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:19:10.889134] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:19:10.893073] [INFO ] [REMOTE ] ARIS: Full fetch complete (61081 records). [2025-10-08T17:19:10.893219] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-08T17:19:11.228349] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-08T17:19:11.294314] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-08T17:19:11.294412] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-08T17:19:11.295167] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-08T17:19:11.295234] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-08T17:19:11.296746] [DEBUG] [LOCAL ] ARIS: Trimmed 61081 records to 42358 (keeping 200 days of data) [2025-10-08T17:19:11.584877] [DEBUG] [LOCAL ] ARIS: Primary data saved (42358 records). [2025-10-08T17:19:11.585033] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-08T17:19:11.585139] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARIS took 25.9s. Estimated remaining: 4h 53m 40s. Rate: 7.6 symbols/min [2025-10-08T17:19:11.772949] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:11.838982] [DEBUG] [LOCAL ] ARR: Loaded 52067 existing records from primary storage. [2025-10-08T17:19:11.839436] [INFO ] [MAIN ] ARR: Loaded 52067 existing records. [2025-10-08T17:19:12.021245] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-08T17:19:12.030129] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:12.031953] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-08T17:19:12.032091] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-08T17:19:12.040479] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-08T17:19:12.054895] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-08T17:19:12.093772] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:19:12.470872] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:12.813395] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T17:19:12.822104] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-08T17:19:13.617546] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-08T17:19:13.688152] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T17:19:14.364794] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:19:14.417564] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-08T17:19:14.523634] [DEBUG] [REMOTE ] ARR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T17:19:14.523993] [WARN ] [REMOTE ] ARR: No data returned for month 2025-01 [2025-10-08T17:19:14.524081] [FATAL] [REMOTE ] ARR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:19:14.524158] [FATAL] [MAIN ] ARR: Failed to fetch primary data. [2025-10-08T17:19:14.524240] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:19:14.524312] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-08T17:19:14.524375] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-08T17:19:14.524409] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-08T17:19:14.524620] [DEBUG] [LOCAL ] ARR: Deleted derivative data file. [2025-10-08T17:19:14.524737] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARR took 2.9s. Estimated remaining: 4h 52m 16s. Rate: 7.6 symbols/min [2025-10-08T17:19:14.694841] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:14.731985] [DEBUG] [LOCAL ] ARW: Loaded 32930 existing records from primary storage. [2025-10-08T17:19:14.732315] [INFO ] [MAIN ] ARW: Loaded 32930 existing records. [2025-10-08T17:19:14.953341] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:14.953726] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-08T17:19:14.953865] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-08T17:19:14.954122] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-08T17:19:14.954192] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-08T17:19:15.163279] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T17:19:15.233126] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-08T17:19:15.371716] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:16.017572] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-08T17:19:16.817578] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-08T17:19:16.916032] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:19:17.139343] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:19:17.617568] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-08T17:19:18.313728] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:19:18.417579] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-08T17:19:19.217600] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-08T17:19:19.593984] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:19:20.017563] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-08T17:19:20.129521] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T17:19:20.817555] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-08T17:19:20.980689] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T17:19:21.343453] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T17:19:21.617554] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-08T17:19:22.118448] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:19:22.417560] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-08T17:19:23.229055] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-08T17:19:23.232099] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T17:19:23.860038] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:19:24.017577] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-08T17:19:24.626855] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T17:19:24.629893] [INFO ] [REMOTE ] ARLO: Full fetch complete (62648 records). [2025-10-08T17:19:24.630019] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-08T17:19:24.630995] [FATAL] [VALIDATOR ] ARLO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:19:24.631086] [FATAL] [MAIN ] ARLO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:19:24.631127] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:19:24.631165] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-08T17:19:24.631222] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-08T17:19:24.631256] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-10-08T17:19:24.631293] [DEBUG] [LOCAL ] ARLO: No derivative data file found to delete. [2025-10-08T17:19:24.631363] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARLO took 31.3s. Estimated remaining: 4h 52m 42s. Rate: 7.6 symbols/min [2025-10-08T17:19:24.798589] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:24.798818] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-08T17:19:24.798861] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-08T17:19:24.798974] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-08T17:19:24.799014] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-08T17:19:24.799055] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-08T17:19:24.799087] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-08T17:19:24.828787] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-08T17:19:25.170680] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:25.369738] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:19:25.617621] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-08T17:19:26.360323] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T17:19:26.417574] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-08T17:19:27.217517] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-08T17:19:27.320889] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T17:19:28.017533] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-08T17:19:28.175835] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T17:19:28.215780] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:19:28.216209] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-08T17:19:28.216325] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:19:28.216413] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-08T17:19:28.216503] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:19:28.216604] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-08T17:19:28.216731] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-08T17:19:28.216786] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-08T17:19:28.216832] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-08T17:19:28.216888] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARX took 3.6s. Estimated remaining: 4h 51m 29s. Rate: 7.6 symbols/min [2025-10-08T17:19:28.437206] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:28.495596] [DEBUG] [LOCAL ] AS: Loaded 53105 existing records from primary storage. [2025-10-08T17:19:28.496002] [INFO ] [MAIN ] AS: Loaded 53105 existing records. [2025-10-08T17:19:28.683253] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:19:28.732232] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:28.732953] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-08T17:19:28.733005] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-08T17:19:28.733261] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-08T17:19:28.733319] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-08T17:19:28.822778] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-08T17:19:29.098767] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:29.617551] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-08T17:19:30.417575] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-08T17:19:30.597848] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T17:19:31.227238] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-08T17:19:31.252463] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:19:31.935186] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:19:32.017581] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-08T17:19:32.354089] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:19:32.817561] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-08T17:19:33.617576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-08T17:19:33.670482] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:19:34.417554] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-08T17:19:34.507969] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:19:35.042136] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:19:35.217576] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-08T17:19:35.719545] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:19:36.017561] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-08T17:19:36.817548] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-08T17:19:36.863470] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:19:36.867354] [INFO ] [REMOTE ] AROC: Full fetch complete (71016 records). [2025-10-08T17:19:36.867512] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-08T17:19:37.284796] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-08T17:19:37.285178] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-08T17:19:37.286147] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-08T17:19:37.286241] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-08T17:19:37.287833] [DEBUG] [LOCAL ] AROC: Trimmed 71016 records to 48975 (keeping 200 days of data) [2025-10-08T17:19:37.417821] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:19:37.621168] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-08T17:19:37.639768] [DEBUG] [LOCAL ] AROC: Primary data saved (48975 records). [2025-10-08T17:19:37.639930] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-08T17:19:37.640669] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. AROC took 38.3s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-08T17:19:37.824136] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:37.844337] [DEBUG] [LOCAL ] ASA: Loaded 14503 existing records from primary storage. [2025-10-08T17:19:37.844615] [INFO ] [MAIN ] ASA: Loaded 14503 existing records. [2025-10-08T17:19:38.049019] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:38.049477] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-08T17:19:38.049603] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-08T17:19:38.049953] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-08T17:19:38.050153] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-08T17:19:38.366560] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:19:38.422709] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-08T17:19:38.502499] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:39.174343] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:19:39.178342] [INFO ] [REMOTE ] ARMK: Full fetch complete (72622 records). [2025-10-08T17:19:39.178514] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-08T17:19:39.222802] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-08T17:19:39.584520] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-08T17:19:39.584630] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-08T17:19:39.585463] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-08T17:19:39.585518] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-08T17:19:39.587097] [DEBUG] [LOCAL ] ARMK: Trimmed 72622 records to 50319 (keeping 200 days of data) [2025-10-08T17:19:39.825439] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:19:39.931043] [DEBUG] [LOCAL ] ARMK: Primary data saved (50319 records). [2025-10-08T17:19:39.931213] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-08T17:19:39.931332] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARMK took 41.0s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-08T17:19:40.022793] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-08T17:19:40.104125] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:40.155041] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-08T17:19:40.155383] [INFO ] [MAIN ] ASAN: Loaded 52722 existing records. [2025-10-08T17:19:40.331066] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:40.331308] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-08T17:19:40.331355] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-08T17:19:40.331754] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-08T17:19:40.331815] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-08T17:19:40.693278] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:40.828556] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-08T17:19:40.850234] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:19:41.021536] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:19:41.617609] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-08T17:19:42.417555] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-08T17:19:42.581913] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:19:42.977585] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T17:19:43.217569] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-08T17:19:43.305336] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:19:44.017599] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-08T17:19:44.817571] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-08T17:19:45.066890] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T17:19:45.558572] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:19:45.612982] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T17:19:45.617489] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-08T17:19:46.417611] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-08T17:19:46.438500] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:19:47.217593] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-08T17:19:48.017526] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-08T17:19:48.031014] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:19:48.194352] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T17:19:48.817552] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-08T17:19:48.974904] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:19:49.617617] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-08T17:19:50.319681] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:19:50.417548] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-08T17:19:50.572344] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T17:19:50.575155] [INFO ] [REMOTE ] ARW: Full fetch complete (48019 records). [2025-10-08T17:19:50.575266] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-08T17:19:50.958598] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-08T17:19:50.958722] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-08T17:19:50.959328] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-08T17:19:50.959395] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-08T17:19:50.960567] [DEBUG] [LOCAL ] ARW: Trimmed 48019 records to 32823 (keeping 200 days of data) [2025-10-08T17:19:51.167761] [DEBUG] [LOCAL ] ARW: Primary data saved (32823 records). [2025-10-08T17:19:51.167946] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-08T17:19:51.168052] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 36.6s. Estimated remaining: 4h 50m 56s. Rate: 7.6 symbols/min [2025-10-08T17:19:51.224793] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-08T17:19:51.346389] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:19:51.392536] [DEBUG] [LOCAL ] ASB: Loaded 49558 existing records from primary storage. [2025-10-08T17:19:51.392898] [INFO ] [MAIN ] ASB: Loaded 49558 existing records. [2025-10-08T17:19:51.573755] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:19:51.574030] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-08T17:19:51.574150] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-08T17:19:51.574601] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-08T17:19:51.574696] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-08T17:19:51.943621] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:19:52.017504] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-08T17:19:52.139096] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:19:52.305267] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T17:19:52.817577] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-08T17:19:53.514761] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T17:19:53.617552] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-08T17:19:54.417523] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-08T17:19:54.557764] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:19:54.966037] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T17:19:55.217583] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-08T17:19:55.867052] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T17:19:56.017512] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-08T17:19:56.214111] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T17:19:56.817558] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-08T17:19:57.617529] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-08T17:19:57.701216] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T17:19:58.417579] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-08T17:19:58.786103] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T17:19:58.922484] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T17:19:59.217544] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-08T17:20:00.017521] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-08T17:20:00.172329] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T17:20:00.174244] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:20:00.817544] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-08T17:20:01.612923] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:20:01.621958] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-08T17:20:01.838093] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:20:02.417730] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-08T17:20:03.217542] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-08T17:20:03.626852] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T17:20:04.017584] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-08T17:20:04.394699] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:20:04.546397] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T17:20:04.817559] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-08T17:20:05.501522] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T17:20:05.505702] [INFO ] [REMOTE ] AS: Full fetch complete (76559 records). [2025-10-08T17:20:05.505816] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-08T17:20:05.622730] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-08T17:20:05.904743] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-08T17:20:05.904836] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-08T17:20:05.905575] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-08T17:20:05.905616] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-08T17:20:05.907066] [DEBUG] [LOCAL ] AS: Trimmed 76559 records to 53122 (keeping 200 days of data) [2025-10-08T17:20:06.224273] [DEBUG] [LOCAL ] AS: Primary data saved (53122 records). [2025-10-08T17:20:06.224440] [INFO ] [MAIN ] AS: Full history saved. [2025-10-08T17:20:06.224540] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. AS took 38.0s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-08T17:20:06.395155] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:06.401347] [DEBUG] [LOCAL ] ASBA: Loaded 3471 existing records from primary storage. [2025-10-08T17:20:06.401511] [INFO ] [MAIN ] ASBA: Loaded 3471 existing records. [2025-10-08T17:20:06.432624] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-08T17:20:06.591369] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:06.591846] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-08T17:20:06.591927] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-08T17:20:06.592126] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-08T17:20:06.592220] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-08T17:20:06.927991] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-08T17:20:07.011107] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:07.217506] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-08T17:20:07.598776] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T17:20:07.609245] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:20:07.611268] [INFO ] [REMOTE ] ASA: Full fetch complete (19209 records). [2025-10-08T17:20:07.611344] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-08T17:20:07.612139] [FATAL] [VALIDATOR ] ASA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:20:07.612223] [FATAL] [MAIN ] ASA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:20:07.612265] [WARN ] [MAIN ] ASA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:20:07.612327] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-08T17:20:07.612390] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-08T17:20:07.612424] [INFO ] [LOCAL ] ASA: Starting deletion of derivative data. [2025-10-08T17:20:07.612621] [DEBUG] [LOCAL ] ASA: Deleted derivative data file. [2025-10-08T17:20:07.612740] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. ASA took 30.0s. Estimated remaining: 4h 50m 51s. Rate: 7.6 symbols/min [2025-10-08T17:20:07.783243] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:07.823005] [DEBUG] [LOCAL ] ASC: Loaded 37428 existing records from primary storage. [2025-10-08T17:20:07.823304] [INFO ] [MAIN ] ASC: Loaded 37428 existing records. [2025-10-08T17:20:08.011846] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:20:08.019604] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-08T17:20:08.025218] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:08.027754] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-08T17:20:08.028473] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-08T17:20:08.028771] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-08T17:20:08.028831] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-08T17:20:08.409197] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:08.817581] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-08T17:20:09.617578] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-08T17:20:10.301499] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T17:20:10.417553] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-08T17:20:10.600356] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T17:20:11.217537] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-08T17:20:11.614458] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T17:20:12.017613] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-08T17:20:12.063164] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:20:12.642413] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:20:12.734271] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T17:20:12.817551] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-08T17:20:13.617557] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-08T17:20:14.417547] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-08T17:20:14.458124] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T17:20:14.777447] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:20:15.217556] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-08T17:20:16.017536] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-08T17:20:16.345455] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T17:20:16.746488] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:20:16.817582] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-08T17:20:17.186860] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:20:17.617558] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-08T17:20:18.173144] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T17:20:18.417587] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-08T17:20:19.023376] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T17:20:19.217567] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-08T17:20:19.922536] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T17:20:20.017540] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-08T17:20:20.817521] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-08T17:20:21.037541] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T17:20:21.041693] [INFO ] [REMOTE ] ASAN: Full fetch complete (76527 records). [2025-10-08T17:20:21.041878] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-08T17:20:21.500552] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-08T17:20:21.500756] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-08T17:20:21.501735] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-08T17:20:21.501822] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-08T17:20:21.525553] [DEBUG] [LOCAL ] ASAN: Trimmed 76527 records to 52721 (keeping 200 days of data) [2025-10-08T17:20:21.525420] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:20:21.617512] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-08T17:20:21.855161] [DEBUG] [LOCAL ] ASAN: Primary data saved (52721 records). [2025-10-08T17:20:21.855357] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-08T17:20:21.855480] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 41.9s. Estimated remaining: 4h 52m 15s. Rate: 7.6 symbols/min [2025-10-08T17:20:22.026314] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:22.045459] [DEBUG] [LOCAL ] ASG: Loaded 19702 existing records from primary storage. [2025-10-08T17:20:22.045729] [INFO ] [MAIN ] ASG: Loaded 19702 existing records. [2025-10-08T17:20:22.224149] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:22.224394] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-08T17:20:22.224447] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-08T17:20:22.224678] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-08T17:20:22.224750] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-08T17:20:22.425915] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-08T17:20:22.593617] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:22.677430] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:20:22.863664] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T17:20:22.901239] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:20:23.217569] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-08T17:20:23.780443] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T17:20:24.017615] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-08T17:20:24.817587] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-08T17:20:25.425428] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T17:20:25.615296] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T17:20:25.618499] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-08T17:20:25.620062] [INFO ] [REMOTE ] ASB: Full fetch complete (71726 records). [2025-10-08T17:20:25.620142] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-08T17:20:26.024448] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-08T17:20:26.024546] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-08T17:20:26.025297] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-08T17:20:26.025368] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-08T17:20:26.026920] [DEBUG] [LOCAL ] ASB: Trimmed 71726 records to 49541 (keeping 200 days of data) [2025-10-08T17:20:26.259860] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:20:26.364937] [DEBUG] [LOCAL ] ASB: Primary data saved (49541 records). [2025-10-08T17:20:26.365151] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-08T17:20:26.365259] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 35.2s. Estimated remaining: 4h 51m 18s. Rate: 7.6 symbols/min [2025-10-08T17:20:26.423495] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-08T17:20:26.543965] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:26.570749] [DEBUG] [LOCAL ] ASGI: Loaded 22719 existing records from primary storage. [2025-10-08T17:20:26.571076] [INFO ] [MAIN ] ASGI: Loaded 22719 existing records. [2025-10-08T17:20:26.747815] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:26.748098] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-08T17:20:26.748168] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-08T17:20:26.748559] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-08T17:20:26.748673] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-08T17:20:27.102791] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:27.217526] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-08T17:20:27.461370] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T17:20:28.017628] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-08T17:20:28.710349] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:20:28.817557] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-08T17:20:29.237295] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:20:29.617571] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-08T17:20:30.210031] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:20:30.417540] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-08T17:20:30.908504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:20:31.084448] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T17:20:31.217593] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-08T17:20:32.017509] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-08T17:20:32.105809] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:20:32.817511] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-08T17:20:33.251590] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T17:20:33.278153] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T17:20:33.617556] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-08T17:20:34.417522] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-08T17:20:34.772856] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:20:34.974609] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:20:35.217585] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-08T17:20:35.676596] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T17:20:35.677441] [INFO ] [REMOTE ] ASBA: Full fetch complete (5215 records). [2025-10-08T17:20:35.677509] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-08T17:20:36.019447] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-08T17:20:36.047515] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-08T17:20:36.047674] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-08T17:20:36.047863] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-08T17:20:36.047904] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-08T17:20:36.048303] [DEBUG] [LOCAL ] ASBA: Trimmed 5215 records to 3456 (keeping 200 days of data) [2025-10-08T17:20:36.073516] [DEBUG] [LOCAL ] ASBA: Primary data saved (3456 records). [2025-10-08T17:20:36.073672] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-08T17:20:36.073780] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 29.8s. Estimated remaining: 4h 51m 36s. Rate: 7.6 symbols/min [2025-10-08T17:20:36.248267] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:20:36.283872] [DEBUG] [LOCAL ] ASGN: Loaded 36349 existing records from primary storage. [2025-10-08T17:20:36.284164] [INFO ] [MAIN ] ASGN: Loaded 36349 existing records. [2025-10-08T17:20:36.469246] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:20:36.469482] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-08T17:20:36.469528] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-08T17:20:36.469778] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-08T17:20:36.469836] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-08T17:20:36.833927] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-08T17:20:36.857837] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:20:37.116009] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:20:37.617617] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-08T17:20:38.394132] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:20:38.418536] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-08T17:20:38.423390] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:20:39.217599] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-08T17:20:39.642892] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T17:20:40.017569] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-08T17:20:40.045685] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T17:20:40.817587] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-08T17:20:41.243525] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:20:41.247271] [INFO ] [REMOTE ] ASC: Full fetch complete (56450 records). [2025-10-08T17:20:41.247386] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-08T17:20:41.624036] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-08T17:20:41.641332] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-08T17:20:41.642488] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-08T17:20:41.643222] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-08T17:20:41.643291] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-08T17:20:41.644751] [DEBUG] [LOCAL ] ASC: Trimmed 56450 records to 37471 (keeping 200 days of data) [2025-10-08T17:20:41.778489] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:20:41.893716] [DEBUG] [LOCAL ] ASC: Primary data saved (37471 records). [2025-10-08T17:20:41.893892] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-08T17:20:41.895055] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 34.3s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-08T17:20:42.417545] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-08T17:20:43.081239] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T17:20:43.217614] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-08T17:20:43.516691] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:20:44.017605] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-08T17:20:44.556548] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:20:44.817622] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-08T17:20:45.143893] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T17:20:45.617637] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-08T17:20:46.055754] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:20:46.417578] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-08T17:20:46.806406] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:20:47.217530] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-08T17:20:47.397068] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T17:20:48.017598] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-08T17:20:48.356857] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T17:20:48.817587] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-08T17:20:49.621866] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-08T17:20:49.634622] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:20:49.767602] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:20:50.417526] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-08T17:20:50.572193] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:20:51.217571] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-08T17:20:51.741791] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:20:51.892364] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T17:20:52.017575] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-08T17:20:52.817568] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-08T17:20:53.617519] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-08T17:20:53.722286] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:20:53.822863] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:20:53.824928] [INFO ] [REMOTE ] ASGI: Full fetch complete (33417 records). [2025-10-08T17:20:53.825008] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-08T17:20:54.234551] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-08T17:20:54.234632] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-08T17:20:54.235101] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-08T17:20:54.235165] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-08T17:20:54.235962] [DEBUG] [LOCAL ] ASGI: Trimmed 33417 records to 22731 (keeping 200 days of data) [2025-10-08T17:20:54.371964] [DEBUG] [LOCAL ] ASGI: Primary data saved (22731 records). [2025-10-08T17:20:54.372118] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-08T17:20:54.372199] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASGI took 28.0s. Estimated remaining: 4h 51m 56s. Rate: 7.6 symbols/min [2025-10-08T17:20:54.417528] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-08T17:20:54.459370] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T17:20:54.461082] [INFO ] [REMOTE ] ASG: Full fetch complete (31061 records). [2025-10-08T17:20:54.461166] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-08T17:20:54.821421] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-08T17:20:54.821507] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-08T17:20:54.821925] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-08T17:20:54.821988] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-08T17:20:54.822758] [DEBUG] [LOCAL ] ASG: Trimmed 31061 records to 19553 (keeping 200 days of data) [2025-10-08T17:20:54.934356] [DEBUG] [LOCAL ] ASG: Primary data saved (19553 records). [2025-10-08T17:20:54.934509] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-08T17:20:54.934595] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASG took 33.1s. Estimated remaining: 4h 50m 5s. Rate: 7.6 symbols/min [2025-10-08T17:20:55.758991] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T17:20:55.767086] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-08T17:20:56.856148] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:20:56.863359] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-08T17:20:58.076463] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:20:58.084992] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-08T17:20:59.479612] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:20:59.488077] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-08T17:21:01.022313] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T17:21:01.032261] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-08T17:21:02.266112] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:21:02.269312] [INFO ] [REMOTE ] ASGN: Full fetch complete (52614 records). [2025-10-08T17:21:02.269429] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-08T17:21:02.703838] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-08T17:21:02.703924] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-08T17:21:02.704614] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-08T17:21:02.704720] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-08T17:21:02.705909] [DEBUG] [LOCAL ] ASGN: Trimmed 52614 records to 36282 (keeping 200 days of data) [2025-10-08T17:21:02.918854] [DEBUG] [LOCAL ] ASGN: Primary data saved (36282 records). [2025-10-08T17:21:02.918994] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-08T17:21:02.920135] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 26.8s. Estimated remaining: 4h 49m 59s. Rate: 7.6 symbols/min [2025-10-08T17:21:03.530301] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.585032] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.635024] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.644010] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:03.665264] [DEBUG] [LOCAL ] ASR: Loaded 9354 existing records from primary storage. [2025-10-08T17:21:03.672156] [INFO ] [MAIN ] ASR: Loaded 9354 existing records. [2025-10-08T17:21:03.814766] [DEBUG] [LOCAL ] ASIX: Loaded 22844 existing records from primary storage. [2025-10-08T17:21:03.829979] [DEBUG] [LOCAL ] ASH: Loaded 37636 existing records from primary storage. [2025-10-08T17:21:03.830584] [INFO ] [MAIN ] ASH: Loaded 37636 existing records. [2025-10-08T17:21:03.830734] [INFO ] [MAIN ] ASIX: Loaded 22844 existing records. [2025-10-08T17:21:04.044563] [DEBUG] [LOCAL ] ASPN: Loaded 49688 existing records from primary storage. [2025-10-08T17:21:04.095310] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.148109] [INFO ] [MAIN ] ASPN: Loaded 49688 existing records. [2025-10-08T17:21:04.153693] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.159428] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-08T17:21:04.257671] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-08T17:21:04.346212] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-08T17:21:04.396415] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.472777] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.469120] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.494075] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-08T17:21:04.504017] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.509490] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-08T17:21:04.534171] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-08T17:21:04.539459] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-08T17:21:04.565399] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-08T17:21:04.555035] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-08T17:21:04.775031] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:04.870473] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-08T17:21:04.968321] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-08T17:21:04.994110] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-08T17:21:05.061137] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-08T17:21:05.757010] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:05.787405] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-08T17:21:06.049537] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.022610] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.055095] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-08T17:21:06.064621] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-08T17:21:06.202479] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:06.202927] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-08T17:21:06.935350] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:21:06.937502] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-08T17:21:07.147351] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:21:07.151132] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-08T17:21:07.383631] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:21:07.385704] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-08T17:21:07.588243] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:21:07.595455] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-08T17:21:07.784442] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:21:07.795191] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-08T17:21:07.839695] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T17:21:07.844068] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-08T17:21:07.892600] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T17:21:07.894787] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-08T17:21:08.342479] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T17:21:08.344757] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-08T17:21:08.717132] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:21:08.817608] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-08T17:21:08.834935] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T17:21:08.868834] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T17:21:09.495093] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:21:09.617565] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-08T17:21:10.213881] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T17:21:10.417697] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-08T17:21:11.217560] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-08T17:21:11.266744] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:21:11.295011] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:21:11.926680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T17:21:12.017566] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-08T17:21:12.817565] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-08T17:21:12.923334] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T17:21:13.617561] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-08T17:21:14.417571] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-08T17:21:14.534127] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:21:15.022193] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T17:21:15.217555] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-08T17:21:15.221555] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:21:16.017554] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-08T17:21:16.032375] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T17:21:16.817550] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-08T17:21:16.970692] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:21:17.617535] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-08T17:21:17.650584] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T17:21:18.417608] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-08T17:21:18.675977] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:21:19.217604] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-08T17:21:20.017700] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-08T17:21:20.303185] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T17:21:20.671727] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T17:21:20.672961] [INFO ] [REMOTE ] ASR: Full fetch complete (12386 records). [2025-10-08T17:21:20.673050] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-08T17:21:20.848706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-08T17:21:21.130712] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-08T17:21:21.130885] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-08T17:21:21.131158] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-08T17:21:21.131231] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-08T17:21:21.154576] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:21:21.154871] [DEBUG] [LOCAL ] ASR: Trimmed 12386 records to 9328 (keeping 200 days of data) [2025-10-08T17:21:21.223687] [DEBUG] [LOCAL ] ASR: Primary data saved (9328 records). [2025-10-08T17:21:21.223856] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-08T17:21:21.223944] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 18.3s. Estimated remaining: 4h 52m 14s. Rate: 7.6 symbols/min [2025-10-08T17:21:21.400277] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:21.400476] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-10-08T17:21:21.400512] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-10-08T17:21:21.400625] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-08T17:21:21.400699] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-08T17:21:21.400753] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-08T17:21:21.400787] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-08T17:21:21.619693] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-08T17:21:21.802199] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:21.814924] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:21:22.417635] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-08T17:21:23.217584] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-08T17:21:23.485709] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:21:24.005912] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:21:24.017504] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-08T17:21:24.323022] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T17:21:24.817576] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-08T17:21:25.617600] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-08T17:21:25.687441] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:21:25.982750] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:21:26.417629] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-08T17:21:26.893360] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T17:21:27.217601] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-08T17:21:27.520097] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:21:28.017594] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-08T17:21:28.639164] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:21:28.817590] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-08T17:21:29.617728] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-08T17:21:29.748683] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:21:30.229868] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:21:30.417570] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-08T17:21:31.217596] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-08T17:21:31.397373] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:21:31.878128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:21:32.017591] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-08T17:21:32.685792] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:21:32.817694] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-08T17:21:33.617522] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-08T17:21:33.818834] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:21:33.907824] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:21:33.910071] [INFO ] [REMOTE ] ASIX: Full fetch complete (30482 records). [2025-10-08T17:21:33.910208] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-08T17:21:34.295062] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-08T17:21:34.295198] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-08T17:21:34.295628] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-08T17:21:34.295712] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-08T17:21:34.296597] [DEBUG] [LOCAL ] ASIX: Trimmed 30482 records to 22842 (keeping 200 days of data) [2025-10-08T17:21:34.417781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-08T17:21:34.454894] [DEBUG] [LOCAL ] ASIX: Primary data saved (22842 records). [2025-10-08T17:21:34.455070] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-08T17:21:34.455185] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 31.5s. Estimated remaining: 4h 53m 19s. Rate: 7.5 symbols/min [2025-10-08T17:21:34.632523] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:34.674609] [DEBUG] [LOCAL ] ATEN: Loaded 38904 existing records from primary storage. [2025-10-08T17:21:34.674977] [INFO ] [MAIN ] ATEN: Loaded 38904 existing records. [2025-10-08T17:21:34.858361] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:34.858626] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-08T17:21:34.858711] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-08T17:21:34.859101] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-08T17:21:34.859162] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-08T17:21:35.222742] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-08T17:21:35.227638] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:35.587946] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T17:21:36.017560] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-08T17:21:36.090469] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:21:36.211046] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:21:36.817570] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-08T17:21:37.423409] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:21:37.617574] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-08T17:21:38.417563] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-08T17:21:38.461965] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T17:21:39.047439] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:21:39.217559] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-08T17:21:39.868367] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:21:39.872877] [INFO ] [REMOTE ] ASPN: Full fetch complete (72398 records). [2025-10-08T17:21:39.873077] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-08T17:21:40.026951] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-08T17:21:40.271362] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-08T17:21:40.271454] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-08T17:21:40.272206] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-08T17:21:40.272271] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-08T17:21:40.273751] [DEBUG] [LOCAL ] ASPN: Trimmed 72398 records to 49736 (keeping 200 days of data) [2025-10-08T17:21:40.567035] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T17:21:40.572406] [INFO ] [REMOTE ] ASH: Full fetch complete (55215 records). [2025-10-08T17:21:40.573698] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-08T17:21:40.582805] [DEBUG] [LOCAL ] ASPN: Primary data saved (49736 records). [2025-10-08T17:21:40.621591] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-08T17:21:40.648511] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASPN took 37.7s. Estimated remaining: 4h 52m 47s. Rate: 7.5 symbols/min [2025-10-08T17:21:40.819940] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-08T17:21:41.008713] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:41.174172] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-08T17:21:41.174255] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-08T17:21:41.174828] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-08T17:21:41.174892] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-08T17:21:41.176129] [DEBUG] [LOCAL ] ASH: Trimmed 55215 records to 37603 (keeping 200 days of data) [2025-10-08T17:21:41.253368] [DEBUG] [LOCAL ] ATGE: Loaded 31178 existing records from primary storage. [2025-10-08T17:21:41.282189] [INFO ] [MAIN ] ATGE: Loaded 31178 existing records. [2025-10-08T17:21:41.494191] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:41.496460] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-08T17:21:41.496521] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-08T17:21:41.496769] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-08T17:21:41.496834] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-08T17:21:41.814665] [DEBUG] [LOCAL ] ASH: Primary data saved (37603 records). [2025-10-08T17:21:41.830781] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-08T17:21:41.849959] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASH took 38.9s. Estimated remaining: 4h 51m 8s. Rate: 7.6 symbols/min [2025-10-08T17:21:42.089909] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:42.109411] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-08T17:21:42.227713] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T17:21:42.233012] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:42.280224] [DEBUG] [LOCAL ] ATHM: Loaded 31991 existing records from primary storage. [2025-10-08T17:21:42.280584] [INFO ] [MAIN ] ATHM: Loaded 31991 existing records. [2025-10-08T17:21:42.423446] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-08T17:21:42.464194] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:21:42.497055] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:42.506522] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-08T17:21:42.506613] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-08T17:21:42.506884] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-08T17:21:42.506943] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-08T17:21:42.877322] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:43.217541] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-08T17:21:43.375630] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:21:43.842961] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T17:21:44.017584] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-08T17:21:44.651025] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:21:44.817504] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-08T17:21:44.872694] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:21:45.617543] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-08T17:21:46.417512] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-08T17:21:46.670720] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:21:46.708984] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:21:47.217551] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-08T17:21:48.017516] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-08T17:21:48.084205] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:21:48.724809] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:21:48.817565] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-08T17:21:49.617602] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-08T17:21:49.690082] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:21:50.150208] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:21:50.417610] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-08T17:21:51.217587] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-08T17:21:51.418400] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T17:21:51.874812] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:21:52.017547] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-08T17:21:52.738977] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:21:52.817576] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-08T17:21:53.617610] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-08T17:21:53.745532] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:21:53.752468] [INFO ] [REMOTE ] ASX: Full fetch complete (76592 records). [2025-10-08T17:21:53.752621] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-08T17:21:54.152072] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-08T17:21:54.160743] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-08T17:21:54.166905] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-08T17:21:54.167001] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-08T17:21:54.178086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:21:54.188184] [DEBUG] [LOCAL ] ASX: Trimmed 76592 records to 52863 (keeping 200 days of data) [2025-10-08T17:21:54.417702] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-08T17:21:54.517081] [DEBUG] [LOCAL ] ASX: Primary data saved (52863 records). [2025-10-08T17:21:54.517216] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-08T17:21:54.517289] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ASX took 33.3s. Estimated remaining: 4h 52m 4s. Rate: 7.6 symbols/min [2025-10-08T17:21:54.695428] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:21:54.704515] [DEBUG] [LOCAL ] ATHS: Loaded 6795 existing records from primary storage. [2025-10-08T17:21:54.705062] [INFO ] [MAIN ] ATHS: Loaded 6795 existing records. [2025-10-08T17:21:54.888691] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:21:54.889134] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-08T17:21:54.889250] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-08T17:21:54.889479] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-08T17:21:54.889673] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-08T17:21:54.998121] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:21:55.222767] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-08T17:21:55.357832] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:21:55.733336] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:21:56.017570] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-08T17:21:56.561307] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:21:56.817543] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-08T17:21:57.467782] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:21:57.617572] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-08T17:21:58.283380] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:21:58.417559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-08T17:21:58.940034] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:21:59.217603] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-08T17:22:00.017564] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-08T17:22:00.040229] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T17:22:00.123011] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:22:00.817567] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-08T17:22:01.082611] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:22:01.617583] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-08T17:22:02.417596] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-08T17:22:02.490982] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T17:22:02.814395] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:22:02.817192] [INFO ] [REMOTE ] ATGE: Full fetch complete (46180 records). [2025-10-08T17:22:02.817547] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-08T17:22:03.222812] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-08T17:22:03.282946] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-08T17:22:03.283062] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-08T17:22:03.283820] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-08T17:22:03.283889] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-08T17:22:03.285483] [DEBUG] [LOCAL ] ATGE: Trimmed 46180 records to 31120 (keeping 200 days of data) [2025-10-08T17:22:03.496955] [DEBUG] [LOCAL ] ATGE: Primary data saved (31120 records). [2025-10-08T17:22:03.497186] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-08T17:22:03.497310] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATGE took 22.8s. Estimated remaining: 4h 52m 9s. Rate: 7.5 symbols/min [2025-10-08T17:22:03.697121] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:03.697568] [DEBUG] [LOCAL ] ATI: No existing data file found in primary storage. [2025-10-08T17:22:03.697627] [WARN ] [MAIN ] ATI: No existing data found, performing full refresh instead. [2025-10-08T17:22:03.697783] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-08T17:22:03.697827] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-08T17:22:03.697870] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-08T17:22:03.697904] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-08T17:22:04.018483] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-08T17:22:04.124736] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:04.126347] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:22:04.526318] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T17:22:04.526581] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T17:22:04.817554] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-08T17:22:05.422296] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:22:05.617592] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-08T17:22:06.417553] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-08T17:22:06.542547] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:22:07.217592] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-08T17:22:07.612844] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-08T17:22:07.864600] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:22:08.017546] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-08T17:22:08.573391] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:22:08.817548] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-08T17:22:09.617514] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-08T17:22:09.964026] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:22:10.257802] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:22:10.417559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-08T17:22:11.217557] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-08T17:22:11.394978] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:22:12.017548] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-08T17:22:12.636661] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T17:22:12.817547] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-08T17:22:13.525141] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:22:13.617597] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-08T17:22:14.275882] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:22:14.417593] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-08T17:22:14.973830] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:22:14.979367] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:22:15.217583] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-08T17:22:16.017610] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-08T17:22:16.536032] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:22:16.538990] [INFO ] [REMOTE ] ATEN: Full fetch complete (57056 records). [2025-10-08T17:22:16.539136] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-08T17:22:16.824177] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-08T17:22:16.999610] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-08T17:22:16.999901] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-08T17:22:17.000595] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-08T17:22:17.000692] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-08T17:22:17.002435] [DEBUG] [LOCAL ] ATEN: Trimmed 57056 records to 38823 (keeping 200 days of data) [2025-10-08T17:22:17.279785] [DEBUG] [LOCAL ] ATEN: Primary data saved (38823 records). [2025-10-08T17:22:17.279997] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-08T17:22:17.280201] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATEN took 42.8s. Estimated remaining: 4h 53m 18s. Rate: 7.5 symbols/min [2025-10-08T17:22:17.410269] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T17:22:17.498042] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:17.537773] [DEBUG] [LOCAL ] ATKR: Loaded 35515 existing records from primary storage. [2025-10-08T17:22:17.538248] [INFO ] [MAIN ] ATKR: Loaded 35515 existing records. [2025-10-08T17:22:17.621120] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-08T17:22:17.755810] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:17.756234] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-08T17:22:17.756316] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-08T17:22:17.756869] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-08T17:22:17.756943] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-08T17:22:17.925411] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T17:22:18.230425] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:18.285958] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T17:22:18.417573] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-08T17:22:19.217584] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-08T17:22:19.647723] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T17:22:20.017584] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-08T17:22:20.709732] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:22:20.710901] [INFO ] [REMOTE ] ATHS: Full fetch complete (9755 records). [2025-10-08T17:22:20.711016] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-08T17:22:20.819063] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-08T17:22:21.143375] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:22:21.143580] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-08T17:22:21.143705] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-08T17:22:21.153977] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-08T17:22:21.154480] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-08T17:22:21.155245] [DEBUG] [LOCAL ] ATHS: Trimmed 9755 records to 6780 (keeping 200 days of data) [2025-10-08T17:22:21.197756] [DEBUG] [LOCAL ] ATHS: Primary data saved (6780 records). [2025-10-08T17:22:21.197869] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-08T17:22:21.197982] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHS took 26.7s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-08T17:22:21.363882] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:21.364117] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-10-08T17:22:21.364159] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-10-08T17:22:21.364268] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-08T17:22:21.364308] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-08T17:22:21.364348] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-08T17:22:21.364380] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-08T17:22:21.623731] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-08T17:22:21.714088] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:22.380914] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:22:22.417508] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-08T17:22:22.976418] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T17:22:23.217629] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-08T17:22:23.596022] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:22:24.017621] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-08T17:22:24.383155] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:22:24.817585] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-08T17:22:25.540905] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:22:25.617520] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-08T17:22:26.430291] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-08T17:22:26.436944] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:22:26.759142] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T17:22:26.761768] [INFO ] [REMOTE ] ATHM: Full fetch complete (50660 records). [2025-10-08T17:22:26.761875] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-08T17:22:27.133073] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-08T17:22:27.133156] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-08T17:22:27.133746] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-08T17:22:27.133829] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-08T17:22:27.134935] [DEBUG] [LOCAL ] ATHM: Trimmed 50660 records to 31820 (keeping 200 days of data) [2025-10-08T17:22:27.217703] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-08T17:22:27.318131] [DEBUG] [LOCAL ] ATHM: Primary data saved (31820 records). [2025-10-08T17:22:27.318276] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-08T17:22:27.318363] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHM took 45.5s. Estimated remaining: 4h 51m 45s. Rate: 7.5 symbols/min [2025-10-08T17:22:27.484830] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:27.485014] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-08T17:22:27.485056] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-08T17:22:27.485202] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-08T17:22:27.485264] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-08T17:22:27.485310] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-08T17:22:27.485343] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-08T17:22:27.843757] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:27.973452] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T17:22:28.017533] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-08T17:22:28.817712] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-08T17:22:29.001996] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:22:29.134736] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:22:29.617568] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-08T17:22:30.011774] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:22:30.417608] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-08T17:22:31.217577] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-08T17:22:31.329507] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:22:31.600883] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:22:32.017575] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-08T17:22:32.372851] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T17:22:32.817588] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-08T17:22:33.617529] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-08T17:22:33.912019] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:22:34.071510] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T17:22:34.417562] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-08T17:22:34.977080] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:22:35.217611] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-08T17:22:35.710326] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:22:36.017623] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-08T17:22:36.634680] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:22:36.817561] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-08T17:22:37.585239] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T17:22:37.617516] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-08T17:22:38.063611] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:22:38.417614] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-08T17:22:39.159825] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T17:22:39.217568] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-08T17:22:39.639405] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:22:40.017583] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-08T17:22:40.484963] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:22:40.817589] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-08T17:22:41.001728] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:22:41.004691] [INFO ] [REMOTE ] ATKR: Full fetch complete (53531 records). [2025-10-08T17:22:41.004851] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-08T17:22:41.383366] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-08T17:22:41.383457] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-08T17:22:41.384060] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-08T17:22:41.384129] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-08T17:22:41.385319] [DEBUG] [LOCAL ] ATKR: Trimmed 53531 records to 35380 (keeping 200 days of data) [2025-10-08T17:22:41.602381] [DEBUG] [LOCAL ] ATKR: Primary data saved (35380 records). [2025-10-08T17:22:41.602531] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-08T17:22:41.602618] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATKR took 24.3s. Estimated remaining: 4h 52m 59s. Rate: 7.5 symbols/min [2025-10-08T17:22:41.623729] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-08T17:22:41.775746] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:41.807483] [DEBUG] [LOCAL ] ATR: Loaded 30585 existing records from primary storage. [2025-10-08T17:22:41.807972] [INFO ] [MAIN ] ATR: Loaded 30585 existing records. [2025-10-08T17:22:41.988168] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:41.988404] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-08T17:22:41.988481] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-08T17:22:41.988806] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-08T17:22:41.988864] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-08T17:22:42.403597] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:42.428358] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-08T17:22:42.434462] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T17:22:43.217630] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-08T17:22:43.304709] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:22:44.017595] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-08T17:22:44.052430] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:22:44.056618] [INFO ] [REMOTE ] ATI: Full fetch complete (73899 records). [2025-10-08T17:22:44.056826] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-08T17:22:44.473177] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-08T17:22:44.473360] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-08T17:22:44.474208] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-08T17:22:44.474281] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-08T17:22:44.476053] [DEBUG] [LOCAL ] ATI: Trimmed 73899 records to 51415 (keeping 200 days of data) [2025-10-08T17:22:44.732860] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:22:44.819695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-08T17:22:44.854629] [DEBUG] [LOCAL ] ATI: Primary data saved (51415 records). [2025-10-08T17:22:44.854870] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-08T17:22:44.854998] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATI took 41.4s. Estimated remaining: 4h 51m 50s. Rate: 7.5 symbols/min [2025-10-08T17:22:45.068136] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:22:45.088467] [DEBUG] [LOCAL ] ATS: Loaded 17751 existing records from primary storage. [2025-10-08T17:22:45.088814] [INFO ] [MAIN ] ATS: Loaded 17751 existing records. [2025-10-08T17:22:45.340096] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:22:45.340510] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-08T17:22:45.340662] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-08T17:22:45.355925] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-08T17:22:45.356688] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T17:22:45.356998] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-08T17:22:45.622760] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-08T17:22:45.786202] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:22:46.293581] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:22:46.417593] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-08T17:22:47.002317] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:22:47.217569] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-08T17:22:47.533202] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:22:48.017547] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-08T17:22:48.299388] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:22:48.817627] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-08T17:22:49.617590] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-08T17:22:49.662736] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:22:50.417570] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-08T17:22:50.488475] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:22:51.027797] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:22:51.217596] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-08T17:22:51.392889] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:22:52.017576] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-08T17:22:52.817593] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-08T17:22:53.617575] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-08T17:23:05.225234] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (11.61 seconds). [2025-10-08T17:23:05.237294] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-08T17:23:06.505418] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (13.69 seconds). [2025-10-08T17:23:06.516917] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-08T17:23:07.315822] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T17:23:07.325918] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-08T17:23:07.342271] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (15.32 seconds). [2025-10-08T17:23:07.347561] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-08T17:23:07.817145] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:23:07.820669] [INFO ] [REMOTE ] ATO: Full fetch complete (60508 records). [2025-10-08T17:23:07.820820] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-08T17:23:08.250021] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-08T17:23:08.250224] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-08T17:23:08.250991] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-08T17:23:08.251059] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-08T17:23:08.252397] [DEBUG] [LOCAL ] ATO: Trimmed 60508 records to 41855 (keeping 200 days of data) [2025-10-08T17:23:08.382564] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:23:08.388423] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-08T17:23:08.595224] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:23:08.608525] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-08T17:23:08.634687] [DEBUG] [LOCAL ] ATO: Primary data saved (41855 records). [2025-10-08T17:23:08.634861] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-08T17:23:08.634965] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATO took 41.3s. Estimated remaining: 4h 55m 5s. Rate: 7.5 symbols/min [2025-10-08T17:23:08.831673] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:08.891729] [DEBUG] [LOCAL ] ATUS: Loaded 49494 existing records from primary storage. [2025-10-08T17:23:08.892391] [INFO ] [MAIN ] ATUS: Loaded 49494 existing records. [2025-10-08T17:23:09.063052] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (17.85 seconds). [2025-10-08T17:23:09.105718] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-08T17:23:09.137296] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:09.139254] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-08T17:23:09.139376] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-08T17:23:09.140803] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-08T17:23:09.140972] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-08T17:23:09.478015] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T17:23:09.530845] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-08T17:23:09.536369] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:09.536839] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-08T17:23:10.532894] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T17:23:10.537787] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-08T17:23:10.894309] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:23:10.904834] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-08T17:23:11.609487] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T17:23:11.613987] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-08T17:23:12.317816] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:23:12.328913] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-08T17:23:12.595906] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:23:12.600448] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-08T17:23:13.008850] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (3.90 seconds). [2025-10-08T17:23:13.015950] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-08T17:23:13.115590] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (4.51 seconds). [2025-10-08T17:23:13.126129] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-08T17:23:13.608947] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T17:23:13.619887] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-08T17:23:13.636625] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:23:13.642507] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-08T17:23:13.954407] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T17:23:13.961535] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-08T17:23:14.135528] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:23:14.138686] [INFO ] [REMOTE ] ATMU: Full fetch complete (56673 records). [2025-10-08T17:23:14.138824] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-08T17:23:14.540527] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-08T17:23:14.540696] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-08T17:23:14.541500] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-08T17:23:14.541567] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-08T17:23:14.542878] [DEBUG] [LOCAL ] ATMU: Trimmed 56673 records to 39145 (keeping 200 days of data) [2025-10-08T17:23:14.767586] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:23:14.775666] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-08T17:23:14.827559] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:23:14.841513] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-08T17:23:14.845731] [DEBUG] [LOCAL ] ATMU: Primary data saved (39145 records). [2025-10-08T17:23:14.847120] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-08T17:23:14.847322] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 53.6s. Estimated remaining: 4h 54m 33s. Rate: 7.5 symbols/min [2025-10-08T17:23:15.020402] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:15.040331] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:23:15.047437] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-08T17:23:15.097004] [DEBUG] [LOCAL ] AU: Loaded 52994 existing records from primary storage. [2025-10-08T17:23:15.097373] [INFO ] [MAIN ] AU: Loaded 52994 existing records. [2025-10-08T17:23:15.278899] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:15.279177] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-08T17:23:15.279236] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-08T17:23:15.279736] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-08T17:23:15.279799] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-08T17:23:15.630197] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:15.630518] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-08T17:23:15.915786] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:23:15.919726] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-08T17:23:16.154032] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T17:23:16.161320] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-08T17:23:16.514163] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:23:16.524922] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-08T17:23:16.786211] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:23:16.787794] [INFO ] [REMOTE ] ATS: Full fetch complete (25644 records). [2025-10-08T17:23:16.787884] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-08T17:23:17.190035] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-08T17:23:17.190200] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-08T17:23:17.190570] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-08T17:23:17.190610] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-08T17:23:17.191397] [DEBUG] [LOCAL ] ATS: Trimmed 25644 records to 17730 (keeping 200 days of data) [2025-10-08T17:23:17.316837] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:23:17.328535] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-08T17:23:17.349966] [DEBUG] [LOCAL ] ATS: Primary data saved (17730 records). [2025-10-08T17:23:17.350137] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-08T17:23:17.350269] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 32.5s. Estimated remaining: 4h 53m 15s. Rate: 7.5 symbols/min [2025-10-08T17:23:17.550860] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:17.592153] [DEBUG] [LOCAL ] AUB: Loaded 46248 existing records from primary storage. [2025-10-08T17:23:17.592501] [INFO ] [MAIN ] AUB: Loaded 46248 existing records. [2025-10-08T17:23:17.735243] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:23:17.845890] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-08T17:23:17.845297] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:17.847093] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-08T17:23:17.847170] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-08T17:23:17.847524] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-08T17:23:17.847678] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-08T17:23:18.080952] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:23:18.202231] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-08T17:23:18.287741] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:18.288052] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-08T17:23:18.947899] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:23:18.955962] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-08T17:23:19.038161] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:23:19.217610] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-08T17:23:19.639804] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T17:23:19.883136] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T17:23:20.017582] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-08T17:23:20.370803] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:23:20.373504] [INFO ] [REMOTE ] ATR: Full fetch complete (43755 records). [2025-10-08T17:23:20.373669] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-08T17:23:20.776637] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-08T17:23:20.776796] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-08T17:23:20.777441] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-08T17:23:20.777523] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-08T17:23:20.779500] [DEBUG] [LOCAL ] ATR: Trimmed 43755 records to 30573 (keeping 200 days of data) [2025-10-08T17:23:20.875687] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-08T17:23:20.919215] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:23:21.032930] [DEBUG] [LOCAL ] ATR: Primary data saved (30573 records). [2025-10-08T17:23:21.033112] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-08T17:23:21.033206] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 39.4s. Estimated remaining: 4h 52m 13s. Rate: 7.5 symbols/min [2025-10-08T17:23:21.228933] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:21.235450] [DEBUG] [LOCAL ] AUNA: Loaded 5054 existing records from primary storage. [2025-10-08T17:23:21.235707] [INFO ] [MAIN ] AUNA: Loaded 5054 existing records. [2025-10-08T17:23:21.425406] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:21.425734] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-08T17:23:21.425880] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-08T17:23:21.426097] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-08T17:23:21.426154] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-08T17:23:21.618125] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-08T17:23:21.829833] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:21.864245] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:23:22.062441] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:23:22.417710] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-08T17:23:23.162357] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T17:23:23.217547] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-08T17:23:23.425540] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T17:23:23.917769] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T17:23:24.017573] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-08T17:23:24.817561] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-08T17:23:25.617631] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-08T17:23:25.760399] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:23:26.417601] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-08T17:23:26.665145] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T17:23:26.849140] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:23:26.873130] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:23:27.217595] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-08T17:23:28.017616] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-08T17:23:28.683185] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T17:23:28.755435] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:23:28.817498] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-08T17:23:29.617572] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-08T17:23:30.417535] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-08T17:23:30.439846] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:23:30.443854] [INFO ] [REMOTE ] ATUS: Full fetch complete (71048 records). [2025-10-08T17:23:30.444016] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-08T17:23:30.851130] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-08T17:23:30.851230] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-08T17:23:30.852000] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-08T17:23:30.852065] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-08T17:23:30.853522] [DEBUG] [LOCAL ] ATUS: Trimmed 71048 records to 49482 (keeping 200 days of data) [2025-10-08T17:23:31.156609] [DEBUG] [LOCAL ] ATUS: Primary data saved (49482 records). [2025-10-08T17:23:31.156775] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-08T17:23:31.156897] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 22.5s. Estimated remaining: 4h 52m 32s. Rate: 7.5 symbols/min [2025-10-08T17:23:31.224308] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-08T17:23:31.340594] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:31.371852] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T17:23:31.413741] [DEBUG] [LOCAL ] AVA: Loaded 39243 existing records from primary storage. [2025-10-08T17:23:31.414107] [INFO ] [MAIN ] AVA: Loaded 39243 existing records. [2025-10-08T17:23:31.600598] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:31.601063] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-08T17:23:31.601120] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-08T17:23:31.601381] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-08T17:23:31.601440] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-08T17:23:31.865721] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:23:31.984389] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:32.017554] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-08T17:23:32.474185] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:23:32.516433] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T17:23:32.817578] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-08T17:23:33.617563] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-08T17:23:34.417530] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-08T17:23:34.432188] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:23:34.561292] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:23:35.217540] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-08T17:23:35.851749] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:23:36.017561] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-08T17:23:36.817526] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-08T17:23:37.005621] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:23:37.617520] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-08T17:23:37.667790] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:23:37.967340] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:23:38.189740] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:23:38.417560] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-08T17:23:39.217593] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-08T17:23:39.846932] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T17:23:40.017565] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-08T17:23:40.317351] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:23:40.817586] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-08T17:23:41.381826] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:23:41.454584] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:23:41.617553] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-08T17:23:42.417553] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-08T17:23:43.107146] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:23:43.108497] [INFO ] [REMOTE ] AUNA: Full fetch complete (7820 records). [2025-10-08T17:23:43.108736] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-08T17:23:43.222809] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-08T17:23:43.242625] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:23:43.517266] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-08T17:23:43.517382] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-08T17:23:43.517637] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-08T17:23:43.517717] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-08T17:23:43.518109] [DEBUG] [LOCAL ] AUNA: Trimmed 7820 records to 5056 (keeping 200 days of data) [2025-10-08T17:23:43.546002] [DEBUG] [LOCAL ] AUNA: Primary data saved (5056 records). [2025-10-08T17:23:43.546094] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-08T17:23:43.546170] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUNA took 22.5s. Estimated remaining: 4h 53m 18s. Rate: 7.5 symbols/min [2025-10-08T17:23:43.713807] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:43.713999] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-08T17:23:43.714036] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-08T17:23:43.714144] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-08T17:23:43.714185] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-08T17:23:43.714225] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-08T17:23:43.714256] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-08T17:23:44.024113] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-08T17:23:44.065266] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:44.595678] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:23:44.817608] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-08T17:23:45.402929] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T17:23:45.617537] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-08T17:23:45.779031] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T17:23:46.417622] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-08T17:23:46.772392] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T17:23:47.116582] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T17:23:47.217555] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-08T17:23:48.017573] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-08T17:23:48.807491] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:23:48.820822] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-08T17:23:49.617532] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-08T17:23:49.716412] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T17:23:49.786555] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:23:50.417556] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-08T17:23:51.217607] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-08T17:23:51.950319] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T17:23:51.975195] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:23:51.997003] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:23:52.017530] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-08T17:23:52.717040] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:23:52.817575] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-08T17:23:53.617590] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-08T17:23:54.172100] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T17:23:54.417564] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-08T17:23:54.639278] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T17:23:54.643615] [INFO ] [REMOTE ] AU: Full fetch complete (76290 records). [2025-10-08T17:23:54.643776] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-08T17:23:55.155843] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-08T17:23:55.155993] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-08T17:23:55.157060] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-08T17:23:55.157128] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-08T17:23:55.159441] [DEBUG] [LOCAL ] AU: Trimmed 76290 records to 52990 (keeping 200 days of data) [2025-10-08T17:23:55.223405] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-08T17:23:55.527276] [DEBUG] [LOCAL ] AU: Primary data saved (52990 records). [2025-10-08T17:23:55.527475] [INFO ] [MAIN ] AU: Full history saved. [2025-10-08T17:23:55.527627] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 40.7s. Estimated remaining: 4h 53m 59s. Rate: 7.5 symbols/min [2025-10-08T17:23:55.718311] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:23:55.765539] [DEBUG] [LOCAL ] AVB: Loaded 42115 existing records from primary storage. [2025-10-08T17:23:55.766183] [INFO ] [MAIN ] AVB: Loaded 42115 existing records. [2025-10-08T17:23:55.968946] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:23:55.969314] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-08T17:23:55.969427] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-08T17:23:55.970410] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-08T17:23:55.970472] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-08T17:23:56.022321] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-08T17:23:56.108070] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T17:23:56.313790] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:23:56.416581] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:23:56.817555] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-08T17:23:57.617611] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-08T17:23:57.691257] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:23:57.842192] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:23:58.417602] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-08T17:23:59.017213] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:23:59.130077] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T17:23:59.217571] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-08T17:24:00.011806] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:24:00.017483] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-08T17:24:00.681080] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T17:24:00.682726] [INFO ] [REMOTE ] AVAL: Full fetch complete (14703 records). [2025-10-08T17:24:00.682811] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-08T17:24:00.817726] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-08T17:24:01.094457] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-08T17:24:01.094550] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-08T17:24:01.094864] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-08T17:24:01.094926] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-08T17:24:01.095583] [DEBUG] [LOCAL ] AVAL: Trimmed 14703 records to 8653 (keeping 200 days of data) [2025-10-08T17:24:01.149741] [DEBUG] [LOCAL ] AVAL: Primary data saved (8653 records). [2025-10-08T17:24:01.149899] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-08T17:24:01.149976] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AVAL took 17.6s. Estimated remaining: 4h 53m 21s. Rate: 7.5 symbols/min [2025-10-08T17:24:01.330023] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:01.330219] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-08T17:24:01.330273] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-08T17:24:01.330425] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-08T17:24:01.330498] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-08T17:24:01.330569] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-08T17:24:01.330603] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-08T17:24:01.622614] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-08T17:24:01.700165] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:02.140232] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:24:02.145814] [INFO ] [REMOTE ] AVA: Full fetch complete (55633 records). [2025-10-08T17:24:02.146062] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-08T17:24:02.422737] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-08T17:24:02.589574] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-08T17:24:02.589696] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-08T17:24:02.590686] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-08T17:24:02.590764] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-08T17:24:02.591907] [DEBUG] [LOCAL ] AVA: Trimmed 55633 records to 39116 (keeping 200 days of data) [2025-10-08T17:24:02.684946] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:24:02.688857] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-08T17:24:02.689864] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:24:02.690248] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-08T17:24:02.690609] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:24:02.691227] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-08T17:24:02.691579] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-08T17:24:02.691946] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-08T17:24:02.692768] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-08T17:24:02.693099] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVBC took 1.5s. Estimated remaining: 4h 51m 54s. Rate: 7.5 symbols/min [2025-10-08T17:24:02.904302] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:02.936080] [DEBUG] [LOCAL ] AVD: Loaded 22358 existing records from primary storage. [2025-10-08T17:24:02.937709] [INFO ] [MAIN ] AVD: Loaded 22358 existing records. [2025-10-08T17:24:03.189637] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:03.226170] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-08T17:24:03.225999] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-08T17:24:03.229244] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-08T17:24:03.231723] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-08T17:24:03.233805] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-08T17:24:03.365220] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:24:03.695346] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:03.703202] [DEBUG] [LOCAL ] AVA: Primary data saved (39116 records). [2025-10-08T17:24:03.703338] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-08T17:24:03.703420] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 32.5s. Estimated remaining: 4h 50m 22s. Rate: 7.5 symbols/min [2025-10-08T17:24:03.877304] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:03.898586] [DEBUG] [LOCAL ] AVK: Loaded 18202 existing records from primary storage. [2025-10-08T17:24:03.898917] [INFO ] [MAIN ] AVK: Loaded 18202 existing records. [2025-10-08T17:24:04.022663] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-08T17:24:04.081048] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:04.081349] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-08T17:24:04.081431] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-08T17:24:04.082169] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-08T17:24:04.082235] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-08T17:24:04.449195] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:04.706359] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:24:04.817560] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-08T17:24:05.265090] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:24:05.617575] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-08T17:24:05.846236] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:24:06.417568] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-08T17:24:07.135491] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:24:07.217552] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-08T17:24:07.718381] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:24:08.017566] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-08T17:24:08.780414] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T17:24:08.786278] [INFO ] [REMOTE ] AUB: Full fetch complete (65774 records). [2025-10-08T17:24:08.786464] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-08T17:24:08.827527] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-08T17:24:09.210617] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-08T17:24:09.210762] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-08T17:24:09.211529] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-08T17:24:09.211580] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-08T17:24:09.213192] [DEBUG] [LOCAL ] AUB: Trimmed 65774 records to 46185 (keeping 200 days of data) [2025-10-08T17:24:09.349639] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T17:24:09.552915] [DEBUG] [LOCAL ] AUB: Primary data saved (46185 records). [2025-10-08T17:24:09.553079] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-08T17:24:09.554004] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AUB took 52.2s. Estimated remaining: 4h 49m 48s. Rate: 7.6 symbols/min [2025-10-08T17:24:09.623019] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-08T17:24:09.737527] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:09.779585] [DEBUG] [LOCAL ] AVNS: Loaded 33660 existing records from primary storage. [2025-10-08T17:24:09.780001] [INFO ] [MAIN ] AVNS: Loaded 33660 existing records. [2025-10-08T17:24:09.988961] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:09.989240] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-08T17:24:09.989305] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-08T17:24:09.990316] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-08T17:24:09.990393] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-08T17:24:10.421312] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-08T17:24:10.416407] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:24:10.421192] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:10.724472] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:24:11.217595] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-08T17:24:12.022101] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-08T17:24:12.040718] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T17:24:12.061904] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:24:12.817615] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-08T17:24:13.428755] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:24:13.617561] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-08T17:24:14.367024] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T17:24:14.417565] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-08T17:24:14.964056] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:24:15.217600] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-08T17:24:15.927445] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:24:16.017555] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-08T17:24:16.426162] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T17:24:16.817587] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-08T17:24:16.895934] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:24:17.617610] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-08T17:24:18.398285] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:24:18.417501] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-08T17:24:19.031091] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:24:19.217589] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-08T17:24:20.017594] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-08T17:24:20.079755] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:24:20.384579] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:24:20.817567] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-08T17:24:21.064800] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:24:21.617613] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-08T17:24:22.399006] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:24:22.417498] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-08T17:24:22.592516] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:24:23.217622] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-08T17:24:24.017594] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-08T17:24:24.290322] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T17:24:24.293937] [INFO ] [REMOTE ] AVB: Full fetch complete (58797 records). [2025-10-08T17:24:24.294061] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-08T17:24:24.690940] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:24:24.756877] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-08T17:24:24.757011] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-08T17:24:24.757718] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-08T17:24:24.757781] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-08T17:24:24.759212] [DEBUG] [LOCAL ] AVB: Trimmed 58797 records to 42092 (keeping 200 days of data) [2025-10-08T17:24:24.823601] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-08T17:24:25.026146] [DEBUG] [LOCAL ] AVB: Primary data saved (42092 records). [2025-10-08T17:24:25.026424] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-08T17:24:25.026535] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 29.5s. Estimated remaining: 4h 51m 10s. Rate: 7.5 symbols/min [2025-10-08T17:24:25.199232] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:25.221529] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-10-08T17:24:25.221711] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-10-08T17:24:25.222071] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-08T17:24:25.222144] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-08T17:24:25.222222] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-08T17:24:25.222949] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-08T17:24:25.223974] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:24:25.588409] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:25.623433] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-08T17:24:25.637493] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:24:26.417565] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-08T17:24:26.665564] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:24:27.217630] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-08T17:24:27.595149] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:24:28.017691] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-08T17:24:28.292570] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:24:28.817583] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-08T17:24:29.218783] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:24:29.617615] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-08T17:24:30.198608] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:24:30.417617] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-08T17:24:31.093625] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:24:31.217493] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-08T17:24:31.801800] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:24:32.017585] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-08T17:24:32.385985] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T17:24:32.817507] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-08T17:24:33.205398] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:24:33.617576] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-08T17:24:34.109727] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:24:34.417556] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-08T17:24:34.917352] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:24:34.920520] [INFO ] [REMOTE ] AVNS: Full fetch complete (48430 records). [2025-10-08T17:24:34.920688] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-08T17:24:35.219050] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-08T17:24:35.347930] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-08T17:24:35.348100] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-08T17:24:35.348772] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-08T17:24:35.348838] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-08T17:24:35.350104] [DEBUG] [LOCAL ] AVNS: Trimmed 48430 records to 33577 (keeping 200 days of data) [2025-10-08T17:24:35.544741] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:24:35.572488] [DEBUG] [LOCAL ] AVNS: Primary data saved (33577 records). [2025-10-08T17:24:35.572681] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-08T17:24:35.573730] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVNS took 26.0s. Estimated remaining: 4h 51m 33s. Rate: 7.5 symbols/min [2025-10-08T17:24:35.745506] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:35.802787] [DEBUG] [LOCAL ] AVTR: Loaded 53566 existing records from primary storage. [2025-10-08T17:24:35.803185] [INFO ] [MAIN ] AVTR: Loaded 53566 existing records. [2025-10-08T17:24:35.982386] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:35.982603] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-08T17:24:35.982675] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-08T17:24:35.982994] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-08T17:24:35.983051] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-08T17:24:36.022858] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-08T17:24:36.365308] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:24:36.364730] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:36.763904] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T17:24:36.817547] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-08T17:24:37.617557] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-08T17:24:37.898185] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T17:24:38.417606] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-08T17:24:39.217605] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-08T17:24:39.270850] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:24:39.835423] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:24:40.017547] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-08T17:24:40.213379] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T17:24:40.817569] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-08T17:24:41.363267] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T17:24:41.617515] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-08T17:24:41.807440] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:24:42.417522] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-08T17:24:42.744924] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:24:43.217552] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-08T17:24:43.667026] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:24:44.017584] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-08T17:24:44.795582] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:24:44.817493] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-08T17:24:44.986803] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T17:24:45.617610] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-08T17:24:46.422709] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-08T17:24:46.443262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:24:46.501947] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:24:47.217574] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-08T17:24:47.552467] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:24:47.554701] [INFO ] [REMOTE ] AVK: Full fetch complete (26738 records). [2025-10-08T17:24:47.554786] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-08T17:24:47.938376] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-08T17:24:47.938499] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-08T17:24:47.938903] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-08T17:24:47.938965] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-08T17:24:47.939821] [DEBUG] [LOCAL ] AVK: Trimmed 26738 records to 18294 (keeping 200 days of data) [2025-10-08T17:24:48.018220] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-08T17:24:48.050463] [DEBUG] [LOCAL ] AVK: Primary data saved (18294 records). [2025-10-08T17:24:48.050603] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-08T17:24:48.050720] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVK took 44.3s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-08T17:24:48.232573] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:48.269344] [DEBUG] [LOCAL ] AVY: Loaded 37557 existing records from primary storage. [2025-10-08T17:24:48.269697] [INFO ] [MAIN ] AVY: Loaded 37557 existing records. [2025-10-08T17:24:48.442754] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:48.442985] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-08T17:24:48.443038] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-08T17:24:48.444333] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-08T17:24:48.444394] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-08T17:24:48.798975] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:48.817495] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-08T17:24:49.022587] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T17:24:49.024254] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:24:49.036828] [INFO ] [REMOTE ] AVD: Full fetch complete (33259 records). [2025-10-08T17:24:49.037512] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-08T17:24:49.420516] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-08T17:24:49.420598] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-08T17:24:49.421191] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-08T17:24:49.421275] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-08T17:24:49.422160] [DEBUG] [LOCAL ] AVD: Trimmed 33259 records to 22246 (keeping 200 days of data) [2025-10-08T17:24:49.547349] [DEBUG] [LOCAL ] AVD: Primary data saved (22246 records). [2025-10-08T17:24:49.547498] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-08T17:24:49.547588] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVD took 46.9s. Estimated remaining: 4h 50m 53s. Rate: 7.5 symbols/min [2025-10-08T17:24:49.622828] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-08T17:24:49.716210] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:24:49.743446] [DEBUG] [LOCAL ] AWF: Loaded 24241 existing records from primary storage. [2025-10-08T17:24:49.743729] [INFO ] [MAIN ] AWF: Loaded 24241 existing records. [2025-10-08T17:24:49.921225] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:24:49.921532] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-08T17:24:49.921866] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-08T17:24:49.922280] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-08T17:24:49.922340] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-08T17:24:50.293050] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:24:50.307334] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:24:50.417526] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-08T17:24:51.217599] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-08T17:24:51.552638] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:24:51.960539] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:24:52.017542] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-08T17:24:52.296065] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T17:24:52.817589] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-08T17:24:53.538603] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T17:24:53.617529] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-08T17:24:54.290621] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:24:54.417549] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-08T17:24:55.211256] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:24:55.217428] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-08T17:24:55.243558] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:24:56.017511] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-08T17:24:56.312179] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:24:56.817592] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-08T17:24:57.617625] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-08T17:24:57.850694] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:24:58.325925] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:24:58.417609] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-08T17:24:59.032793] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:24:59.217559] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-08T17:24:59.818311] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:25:00.017621] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-08T17:25:00.815682] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T17:25:00.823237] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-08T17:25:01.617587] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-08T17:25:02.174544] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T17:25:02.417588] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-08T17:25:02.482046] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:25:02.832113] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T17:25:03.217619] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-08T17:25:03.547550] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:25:04.017548] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-08T17:25:04.559510] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:25:04.817610] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-08T17:25:05.558508] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:25:05.617519] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-08T17:25:05.926280] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:25:06.417622] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-08T17:25:07.217672] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-08T17:25:07.412660] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:25:07.434140] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T17:25:07.438713] [INFO ] [REMOTE ] AVNT: Full fetch complete (56365 records). [2025-10-08T17:25:07.438891] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-08T17:25:07.899093] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-08T17:25:07.899196] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-08T17:25:07.899859] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-08T17:25:07.899924] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-08T17:25:07.901290] [DEBUG] [LOCAL ] AVNT: Trimmed 56365 records to 39051 (keeping 200 days of data) [2025-10-08T17:25:08.021086] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-08T17:25:08.167621] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:25:08.189412] [DEBUG] [LOCAL ] AVNT: Primary data saved (39051 records). [2025-10-08T17:25:08.189636] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-08T17:25:08.189774] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 43.2s. Estimated remaining: 4h 52m 50s. Rate: 7.5 symbols/min [2025-10-08T17:25:08.368460] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:08.394383] [DEBUG] [LOCAL ] AWI: Loaded 25292 existing records from primary storage. [2025-10-08T17:25:08.394662] [INFO ] [MAIN ] AWI: Loaded 25292 existing records. [2025-10-08T17:25:08.567666] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:08.567891] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-08T17:25:08.567938] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-08T17:25:08.568166] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-08T17:25:08.568225] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-08T17:25:08.822840] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-08T17:25:08.918546] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:09.617528] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-08T17:25:09.697058] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:25:09.701412] [INFO ] [REMOTE ] AVTR: Full fetch complete (77441 records). [2025-10-08T17:25:09.701568] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-08T17:25:10.080414] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:25:10.129074] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-08T17:25:10.129159] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-08T17:25:10.129941] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-08T17:25:10.130010] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-08T17:25:10.131568] [DEBUG] [LOCAL ] AVTR: Trimmed 77441 records to 53563 (keeping 200 days of data) [2025-10-08T17:25:10.429476] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-08T17:25:10.455485] [DEBUG] [LOCAL ] AVTR: Primary data saved (53563 records). [2025-10-08T17:25:10.455628] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-08T17:25:10.455751] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVTR took 34.9s. Estimated remaining: 4h 51m 35s. Rate: 7.5 symbols/min [2025-10-08T17:25:10.632413] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:10.680665] [DEBUG] [LOCAL ] AWK: Loaded 48693 existing records from primary storage. [2025-10-08T17:25:10.681039] [INFO ] [MAIN ] AWK: Loaded 48693 existing records. [2025-10-08T17:25:10.867043] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:10.867342] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-08T17:25:10.867396] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-08T17:25:10.869124] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-08T17:25:10.869196] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-08T17:25:11.231510] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-08T17:25:11.241845] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:11.284798] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:25:11.521372] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:25:12.017592] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-08T17:25:12.366905] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T17:25:12.817557] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-08T17:25:13.086198] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:25:13.617592] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-08T17:25:14.157291] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:25:14.417615] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-08T17:25:14.976018] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:25:15.217597] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-08T17:25:15.578170] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:25:16.017531] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-08T17:25:16.253293] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:25:16.817569] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-08T17:25:17.260087] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:25:17.617565] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-08T17:25:17.722362] [DEBUG] [REMOTE ] AVY: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T17:25:17.722769] [WARN ] [REMOTE ] AVY: No data returned for month 2025-10 [2025-10-08T17:25:17.722877] [FATAL] [REMOTE ] AVY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:25:17.723007] [FATAL] [MAIN ] AVY: Failed to fetch primary data. [2025-10-08T17:25:17.723094] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:25:17.723190] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-08T17:25:17.723271] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-08T17:25:17.723307] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-08T17:25:17.723586] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-08T17:25:17.724740] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVY took 29.7s. Estimated remaining: 4h 51m 18s. Rate: 7.5 symbols/min [2025-10-08T17:25:17.901166] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:17.923546] [DEBUG] [LOCAL ] AWP: Loaded 21505 existing records from primary storage. [2025-10-08T17:25:17.923884] [INFO ] [MAIN ] AWP: Loaded 21505 existing records. [2025-10-08T17:25:18.043957] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:25:18.128324] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:18.128563] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-08T17:25:18.128613] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-08T17:25:18.129307] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-08T17:25:18.129369] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-08T17:25:18.422734] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-08T17:25:18.478863] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:19.217594] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-08T17:25:19.884846] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:25:20.017622] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-08T17:25:20.261922] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T17:25:20.817572] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-08T17:25:21.106516] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T17:25:21.617548] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-08T17:25:21.638357] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:25:21.640459] [INFO ] [REMOTE ] AWF: Full fetch complete (36025 records). [2025-10-08T17:25:21.640531] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-08T17:25:22.010897] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-08T17:25:22.011127] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-08T17:25:22.011569] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-08T17:25:22.011610] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-08T17:25:22.012405] [DEBUG] [LOCAL ] AWF: Trimmed 36025 records to 24261 (keeping 200 days of data) [2025-10-08T17:25:22.153890] [DEBUG] [LOCAL ] AWF: Primary data saved (24261 records). [2025-10-08T17:25:22.154017] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-08T17:25:22.154095] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWF took 32.6s. Estimated remaining: 4h 50m 29s. Rate: 7.5 symbols/min [2025-10-08T17:25:22.318985] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:22.340124] [DEBUG] [LOCAL ] AWR: Loaded 22714 existing records from primary storage. [2025-10-08T17:25:22.340378] [INFO ] [MAIN ] AWR: Loaded 22714 existing records. [2025-10-08T17:25:22.422742] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-08T17:25:22.519697] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:22.519952] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-08T17:25:22.520000] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-08T17:25:22.520860] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-08T17:25:22.520943] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-08T17:25:22.878391] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:22.894837] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:25:23.217561] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-08T17:25:23.953564] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:25:24.017515] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-08T17:25:24.524536] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:25:24.817599] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-08T17:25:25.488011] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:25:25.617589] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-08T17:25:26.029251] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:25:26.417565] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-08T17:25:26.662983] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T17:25:27.217590] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-08T17:25:28.031634] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-08T17:25:28.037966] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:25:28.267241] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T17:25:28.817595] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-08T17:25:28.868004] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:25:29.617525] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-08T17:25:30.078566] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T17:25:30.417558] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-08T17:25:30.792695] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:25:31.104604] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:25:31.217545] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-08T17:25:32.017529] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-08T17:25:32.268617] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T17:25:32.271161] [INFO ] [REMOTE ] AWI: Full fetch complete (35681 records). [2025-10-08T17:25:32.271338] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-08T17:25:32.722671] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-08T17:25:32.722787] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-08T17:25:32.723259] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-08T17:25:32.723304] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-08T17:25:32.724439] [DEBUG] [LOCAL ] AWI: Trimmed 35681 records to 25305 (keeping 200 days of data) [2025-10-08T17:25:32.817577] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-08T17:25:32.895201] [DEBUG] [LOCAL ] AWI: Primary data saved (25305 records). [2025-10-08T17:25:32.895388] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-08T17:25:32.895517] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 24.7s. Estimated remaining: 4h 50m 52s. Rate: 7.5 symbols/min [2025-10-08T17:25:33.075319] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:33.102720] [DEBUG] [LOCAL ] AX: Loaded 28121 existing records from primary storage. [2025-10-08T17:25:33.103019] [INFO ] [MAIN ] AX: Loaded 28121 existing records. [2025-10-08T17:25:33.282875] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:25:33.283141] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-08T17:25:33.283191] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-08T17:25:33.283981] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-08T17:25:33.284043] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-08T17:25:33.618174] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-08T17:25:33.663308] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:33.765976] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:25:33.913823] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:25:34.417573] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-08T17:25:34.443279] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T17:25:35.217588] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-08T17:25:35.748047] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:25:36.017612] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-08T17:25:36.270835] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:25:36.817615] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-08T17:25:37.617629] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-08T17:25:37.705948] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T17:25:37.942026] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:25:38.417568] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-08T17:25:39.062095] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:25:39.217518] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-08T17:25:39.271093] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:25:40.017554] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-08T17:25:40.326785] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T17:25:40.817597] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-08T17:25:41.318485] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:25:41.582841] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:25:41.617499] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-08T17:25:42.417518] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-08T17:25:42.530522] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T17:25:43.217599] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-08T17:25:43.985898] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T17:25:44.017541] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-08T17:25:44.400808] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T17:25:44.817568] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-08T17:25:45.617532] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-08T17:25:45.891859] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T17:25:45.917512] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:25:46.417516] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-08T17:25:46.724967] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T17:25:47.217521] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-08T17:25:47.251921] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:25:47.254401] [INFO ] [REMOTE ] AWP: Full fetch complete (32134 records). [2025-10-08T17:25:47.254489] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-08T17:25:47.626188] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-08T17:25:47.626272] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-08T17:25:47.626734] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-08T17:25:47.626795] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-08T17:25:47.627540] [DEBUG] [LOCAL ] AWP: Trimmed 32134 records to 21500 (keeping 200 days of data) [2025-10-08T17:25:47.767159] [DEBUG] [LOCAL ] AWP: Primary data saved (21500 records). [2025-10-08T17:25:47.767301] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-08T17:25:47.767387] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWP took 30.0s. Estimated remaining: 4h 52m 2s. Rate: 7.5 symbols/min [2025-10-08T17:25:47.971552] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:25:47.971774] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-10-08T17:25:47.971868] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-10-08T17:25:47.972014] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-08T17:25:47.972057] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-08T17:25:47.972098] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-08T17:25:47.972130] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-08T17:25:48.025176] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-08T17:25:48.343271] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T17:25:48.342517] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:25:48.817611] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-08T17:25:49.484573] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:25:49.617543] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-08T17:25:49.838672] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:25:50.417564] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-08T17:25:50.439405] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T17:25:51.217575] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-08T17:25:51.850960] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:25:52.017554] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-08T17:25:52.598998] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:25:52.817549] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-08T17:25:53.144548] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:25:53.617574] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-08T17:25:54.235760] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:25:54.410014] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T17:25:54.417492] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-08T17:25:55.217512] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-08T17:25:55.620261] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T17:25:56.017576] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-08T17:25:56.765833] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:25:56.817622] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-08T17:25:57.617571] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-08T17:25:57.679158] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:25:58.325106] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:25:58.417625] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-08T17:25:58.743096] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T17:25:59.217636] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-08T17:25:59.344069] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:26:00.017623] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-08T17:26:00.787729] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:26:00.817509] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-08T17:26:00.874112] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:26:01.617581] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-08T17:26:02.305809] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T17:26:02.417574] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-08T17:26:02.437667] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T17:26:02.439875] [INFO ] [REMOTE ] AWR: Full fetch complete (32273 records). [2025-10-08T17:26:02.439972] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-08T17:26:02.837153] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-08T17:26:02.837243] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-08T17:26:02.837741] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-08T17:26:02.837806] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-08T17:26:02.838571] [DEBUG] [LOCAL ] AWR: Trimmed 32273 records to 22687 (keeping 200 days of data) [2025-10-08T17:26:02.983632] [DEBUG] [LOCAL ] AWR: Primary data saved (22687 records). [2025-10-08T17:26:02.983799] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-08T17:26:02.983937] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWR took 40.8s. Estimated remaining: 4h 53m 15s. Rate: 7.4 symbols/min [2025-10-08T17:26:03.150843] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:03.203313] [DEBUG] [LOCAL ] AXP: Loaded 53170 existing records from primary storage. [2025-10-08T17:26:03.203698] [INFO ] [MAIN ] AXP: Loaded 53170 existing records. [2025-10-08T17:26:03.224521] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-08T17:26:03.386784] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:03.387056] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-08T17:26:03.387105] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-08T17:26:03.387411] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-08T17:26:03.387470] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-08T17:26:03.748353] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:03.820516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:26:04.017583] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-08T17:26:04.558841] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:26:04.562621] [INFO ] [REMOTE ] AWK: Full fetch complete (70690 records). [2025-10-08T17:26:04.562781] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-08T17:26:04.822687] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-08T17:26:04.953203] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-08T17:26:04.953300] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-08T17:26:04.954108] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-08T17:26:04.954176] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-08T17:26:04.955734] [DEBUG] [LOCAL ] AWK: Trimmed 70690 records to 48684 (keeping 200 days of data) [2025-10-08T17:26:05.266486] [DEBUG] [LOCAL ] AWK: Primary data saved (48684 records). [2025-10-08T17:26:05.266779] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-08T17:26:05.267596] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWK took 54.8s. Estimated remaining: 4h 52m 2s. Rate: 7.5 symbols/min [2025-10-08T17:26:05.451019] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:05.458594] [DEBUG] [LOCAL ] AXR: Loaded 2994 existing records from primary storage. [2025-10-08T17:26:05.458956] [INFO ] [MAIN ] AXR: Loaded 2994 existing records. [2025-10-08T17:26:05.620301] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-08T17:26:05.690872] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:05.691489] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-08T17:26:05.691695] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-08T17:26:05.692078] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-08T17:26:05.692147] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-08T17:26:05.805153] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:26:06.107666] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:06.417535] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-08T17:26:06.576183] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T17:26:06.782061] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:26:06.784312] [INFO ] [REMOTE ] AX: Full fetch complete (42382 records). [2025-10-08T17:26:06.784395] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-08T17:26:07.167902] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-08T17:26:07.167994] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-08T17:26:07.168673] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-08T17:26:07.168737] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-08T17:26:07.169606] [DEBUG] [LOCAL ] AX: Trimmed 42382 records to 28069 (keeping 200 days of data) [2025-10-08T17:26:07.224193] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-08T17:26:07.341059] [DEBUG] [LOCAL ] AX: Primary data saved (28069 records). [2025-10-08T17:26:07.341202] [INFO ] [MAIN ] AX: Full history saved. [2025-10-08T17:26:07.341316] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 34.4s. Estimated remaining: 4h 50m 47s. Rate: 7.5 symbols/min [2025-10-08T17:26:07.528549] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:07.570285] [DEBUG] [LOCAL ] AXS: Loaded 38558 existing records from primary storage. [2025-10-08T17:26:07.570664] [INFO ] [MAIN ] AXS: Loaded 38558 existing records. [2025-10-08T17:26:07.781812] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:07.782180] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-08T17:26:07.782268] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-08T17:26:07.782613] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-08T17:26:07.782730] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-08T17:26:08.009835] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:26:08.025127] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-08T17:26:08.214347] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:26:08.220703] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:08.817687] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-08T17:26:09.617506] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-08T17:26:10.073351] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T17:26:10.120899] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T17:26:10.162162] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T17:26:10.417539] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-08T17:26:11.217558] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-08T17:26:11.693518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:26:12.017604] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-08T17:26:12.415588] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T17:26:12.611171] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T17:26:12.817638] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-08T17:26:13.617556] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-08T17:26:14.422835] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:26:14.421623] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-08T17:26:15.217547] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-08T17:26:15.596509] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T17:26:15.839947] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:26:16.017543] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-08T17:26:16.060679] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T17:26:16.064541] [INFO ] [REMOTE ] AXL: Full fetch complete (72785 records). [2025-10-08T17:26:16.064709] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-08T17:26:16.465885] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-08T17:26:16.466089] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-08T17:26:16.466947] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-08T17:26:16.467012] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-08T17:26:16.468674] [DEBUG] [LOCAL ] AXL: Trimmed 72785 records to 50517 (keeping 200 days of data) [2025-10-08T17:26:16.743839] [DEBUG] [LOCAL ] AXL: Primary data saved (50517 records). [2025-10-08T17:26:16.743993] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-08T17:26:16.744069] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 29.0s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-08T17:26:16.822879] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-08T17:26:16.922324] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:16.972907] [DEBUG] [LOCAL ] AXTA: Loaded 52161 existing records from primary storage. [2025-10-08T17:26:16.973262] [INFO ] [MAIN ] AXTA: Loaded 52161 existing records. [2025-10-08T17:26:17.158152] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:17.158594] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-08T17:26:17.158709] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-08T17:26:17.159771] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-08T17:26:17.159836] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-08T17:26:17.379551] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:26:17.546726] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:17.570719] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:26:17.617596] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-08T17:26:18.417564] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-08T17:26:18.975905] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:26:19.217572] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-08T17:26:19.908756] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:26:20.017620] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-08T17:26:20.435208] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T17:26:20.483139] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T17:26:20.817567] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-08T17:26:21.617559] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-08T17:26:22.055366] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T17:26:22.427675] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-08T17:26:22.434617] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:26:23.217621] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-08T17:26:24.017613] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-08T17:26:24.513324] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-08T17:26:24.817577] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-08T17:26:24.927409] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:26:25.166562] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T17:26:25.301141] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T17:26:25.617546] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-08T17:26:26.417549] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-08T17:26:26.910001] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:26:26.910807] [INFO ] [REMOTE ] AXR: Full fetch complete (4640 records). [2025-10-08T17:26:26.910879] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-08T17:26:27.223752] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-08T17:26:27.417437] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-08T17:26:27.417541] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-08T17:26:27.417778] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-08T17:26:27.417885] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-08T17:26:27.418585] [DEBUG] [LOCAL ] AXR: Trimmed 4640 records to 2986 (keeping 200 days of data) [2025-10-08T17:26:27.437455] [DEBUG] [LOCAL ] AXR: Primary data saved (2986 records). [2025-10-08T17:26:27.437668] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-08T17:26:27.437780] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 22.2s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-08T17:26:27.470708] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:26:28.017560] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-08T17:26:28.791825] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:26:28.817500] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-08T17:26:29.617540] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-08T17:26:29.737851] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T17:26:30.294943] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T17:26:30.417584] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-08T17:26:31.198210] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:26:31.217498] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-08T17:26:31.806470] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:26:32.017627] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-08T17:26:32.817590] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-08T17:26:32.973762] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T17:26:33.513391] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:26:33.617549] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-08T17:26:34.417544] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-08T17:26:34.559509] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:26:35.023070] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T17:26:35.217595] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-08T17:26:35.883591] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:26:36.017547] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-08T17:26:36.470145] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T17:26:36.817554] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-08T17:26:37.617568] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-08T17:26:37.668010] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:26:37.946172] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:26:37.949579] [INFO ] [REMOTE ] AXS: Full fetch complete (55723 records). [2025-10-08T17:26:37.949777] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-08T17:26:38.354294] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-08T17:26:38.354393] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-08T17:26:38.355114] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-08T17:26:38.355183] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-08T17:26:38.356478] [DEBUG] [LOCAL ] AXS: Trimmed 55723 records to 38632 (keeping 200 days of data) [2025-10-08T17:26:38.422215] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-08T17:26:38.635796] [DEBUG] [LOCAL ] AXS: Primary data saved (38632 records). [2025-10-08T17:26:38.635979] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-08T17:26:38.636095] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXS took 31.3s. Estimated remaining: 4h 51m 43s. Rate: 7.4 symbols/min [2025-10-08T17:26:39.761840] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T17:26:39.775254] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-08T17:26:40.159800] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:26:40.170789] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-08T17:26:41.726320] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T17:26:41.732305] [INFO ] [REMOTE ] AXP: Full fetch complete (76912 records). [2025-10-08T17:26:41.732513] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-08T17:26:42.106792] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-08T17:26:42.151305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-08T17:26:42.232184] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-08T17:26:42.232297] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-08T17:26:42.233156] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-08T17:26:42.233341] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-08T17:26:42.235117] [DEBUG] [LOCAL ] AXP: Trimmed 76912 records to 53172 (keeping 200 days of data) [2025-10-08T17:26:42.586928] [DEBUG] [LOCAL ] AXP: Primary data saved (53172 records). [2025-10-08T17:26:42.587171] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-08T17:26:42.587335] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXP took 39.6s. Estimated remaining: 4h 50m 50s. Rate: 7.5 symbols/min [2025-10-08T17:26:44.060803] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T17:26:44.073162] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-08T17:26:45.745047] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:26:45.757374] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-08T17:26:47.368533] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:26:47.372568] [INFO ] [REMOTE ] AXTA: Full fetch complete (75117 records). [2025-10-08T17:26:47.372730] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-08T17:26:47.758343] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-08T17:26:47.758476] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-08T17:26:47.759359] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-08T17:26:47.759426] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-08T17:26:47.760987] [DEBUG] [LOCAL ] AXTA: Trimmed 75117 records to 52183 (keeping 200 days of data) [2025-10-08T17:26:48.055182] [DEBUG] [LOCAL ] AXTA: Primary data saved (52183 records). [2025-10-08T17:26:48.055322] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-08T17:26:48.055405] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 31.3s. Estimated remaining: 4h 50m 14s. Rate: 7.5 symbols/min [2025-10-08T17:26:48.706203] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.699124] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.695666] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.719837] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-08T17:26:48.756356] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:48.756478] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-08T17:26:48.757059] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-08T17:26:48.757484] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-08T17:26:48.757673] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-08T17:26:48.757729] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-08T17:26:48.920077] [DEBUG] [LOCAL ] AYI: Loaded 25223 existing records from primary storage. [2025-10-08T17:26:48.932464] [INFO ] [MAIN ] AYI: Loaded 25223 existing records. [2025-10-08T17:26:48.938025] [DEBUG] [LOCAL ] AZZ: Loaded 22027 existing records from primary storage. [2025-10-08T17:26:48.919283] [DEBUG] [LOCAL ] AZO: Loaded 11286 existing records from primary storage. [2025-10-08T17:26:48.995856] [INFO ] [MAIN ] AZZ: Loaded 22027 existing records. [2025-10-08T17:26:48.977245] [INFO ] [MAIN ] AZO: Loaded 11286 existing records. [2025-10-08T17:26:49.626497] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.587816] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.647008] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.706944] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-08T17:26:49.727484] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.733179] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:49.727327] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:49.733802] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-08T17:26:49.733720] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-08T17:26:49.734972] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-08T17:26:49.735094] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-08T17:26:49.746206] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-08T17:26:49.746390] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-08T17:26:49.733912] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-08T17:26:49.775977] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-08T17:26:49.789713] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-08T17:26:49.888604] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-08T17:26:50.740334] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.785232] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-08T17:26:50.801815] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.807274] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-08T17:26:50.871222] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:50.871733] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-08T17:26:51.050125] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T17:26:51.056884] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-08T17:26:51.680489] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T17:26:51.686917] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-08T17:26:51.758142] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:26:51.765744] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-08T17:26:51.876792] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:26:51.888556] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-08T17:26:52.027690] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T17:26:52.033620] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-08T17:26:52.079824] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:26:52.080250] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-08T17:26:52.080357] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:26:52.080462] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-08T17:26:52.080527] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:26:52.080589] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-08T17:26:52.080732] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-08T17:26:52.080805] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-08T17:26:52.080905] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-08T17:26:52.081013] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. B took 4.0s. Estimated remaining: 4h 49m 23s. Rate: 7.5 symbols/min [2025-10-08T17:26:52.381216] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:26:52.393629] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:26:52.398290] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-08T17:26:52.454432] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-08T17:26:52.454946] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-08T17:26:52.660888] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:26:52.661225] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-08T17:26:52.661284] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-08T17:26:52.663007] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-08T17:26:52.663074] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-08T17:26:52.995317] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:26:53.038941] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T17:26:53.081828] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:26:53.059867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-08T17:26:53.085552] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-08T17:26:53.087313] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-08T17:26:53.164397] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:26:53.617614] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-08T17:26:53.970889] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:26:54.221843] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:26:54.417628] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-08T17:26:54.713237] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:26:55.217705] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-08T17:26:55.281907] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T17:26:55.581072] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:26:56.017527] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-08T17:26:56.134212] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:26:56.817510] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-08T17:26:56.841614] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:26:57.617595] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-08T17:26:58.217792] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:26:58.370457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T17:26:58.417580] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-08T17:26:59.217594] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-08T17:26:59.491620] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:27:00.017530] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-08T17:27:00.219185] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:27:00.817564] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-08T17:27:01.617586] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-08T17:27:02.103229] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:27:02.417519] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-08T17:27:02.456050] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-08T17:27:02.917975] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T17:27:03.217563] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-08T17:27:03.580020] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:27:04.017540] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-08T17:27:04.345801] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T17:27:04.790625] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:27:04.817500] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-08T17:27:05.617522] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-08T17:27:05.682633] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:27:06.417554] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-08T17:27:06.714734] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T17:27:07.217551] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-08T17:27:08.017562] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-08T17:27:08.083430] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:27:08.370885] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:27:08.817595] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-08T17:27:09.011025] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:27:09.617556] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-08T17:27:09.648307] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T17:27:10.417557] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-08T17:27:11.217551] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-08T17:27:11.585892] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T17:27:12.017537] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-08T17:27:12.060010] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-08T17:27:12.314288] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T17:27:12.316555] [INFO ] [REMOTE ] AZZ: Full fetch complete (31152 records). [2025-10-08T17:27:12.316682] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-08T17:27:12.692975] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-08T17:27:12.693086] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-08T17:27:12.693514] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-08T17:27:12.693557] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-08T17:27:12.694488] [DEBUG] [LOCAL ] AZZ: Trimmed 31152 records to 22128 (keeping 200 days of data) [2025-10-08T17:27:12.818363] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-08T17:27:12.832442] [DEBUG] [LOCAL ] AZZ: Primary data saved (22128 records). [2025-10-08T17:27:12.832607] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-08T17:27:12.832873] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 24.8s. Estimated remaining: 4h 51m 32s. Rate: 7.4 symbols/min [2025-10-08T17:27:13.002203] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:13.002421] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-08T17:27:13.002464] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-08T17:27:13.002538] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-08T17:27:13.002574] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-08T17:27:13.002615] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-08T17:27:13.002673] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-08T17:27:13.304788] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:27:13.390772] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:13.617535] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-08T17:27:13.751559] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:27:14.417630] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-08T17:27:15.217566] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-08T17:27:15.571537] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:27:15.574605] [INFO ] [REMOTE ] AYI: Full fetch complete (37107 records). [2025-10-08T17:27:15.574782] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-08T17:27:15.989036] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-08T17:27:15.989227] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-08T17:27:15.989790] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-08T17:27:15.989906] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-08T17:27:15.991275] [DEBUG] [LOCAL ] AYI: Trimmed 37107 records to 25246 (keeping 200 days of data) [2025-10-08T17:27:16.049627] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-08T17:27:16.134546] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-08T17:27:16.200768] [DEBUG] [LOCAL ] AYI: Primary data saved (25246 records). [2025-10-08T17:27:16.200927] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-08T17:27:16.201019] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 28.1s. Estimated remaining: 4h 50m 33s. Rate: 7.5 symbols/min [2025-10-08T17:27:16.372269] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:16.423273] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-08T17:27:16.423638] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-08T17:27:16.607697] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:16.607919] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-08T17:27:16.607966] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-08T17:27:16.609863] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-08T17:27:16.609923] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-08T17:27:16.822736] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-08T17:27:16.976532] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:17.011305] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T17:27:17.012843] [INFO ] [REMOTE ] AZO: Full fetch complete (16053 records). [2025-10-08T17:27:17.012928] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-08T17:27:17.438704] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-08T17:27:17.438797] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-08T17:27:17.439190] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-08T17:27:17.439230] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-08T17:27:17.440094] [DEBUG] [LOCAL ] AZO: Trimmed 16053 records to 11256 (keeping 200 days of data) [2025-10-08T17:27:17.523047] [DEBUG] [LOCAL ] AZO: Primary data saved (11256 records). [2025-10-08T17:27:17.523235] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-08T17:27:17.523341] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AZO took 29.5s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-08T17:27:17.631863] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-08T17:27:17.731774] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:17.732272] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-08T17:27:17.732396] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-08T17:27:17.732672] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-08T17:27:17.732775] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-08T17:27:17.732919] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-08T17:27:17.733099] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-08T17:27:18.169264] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-08T17:27:18.167197] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:18.417616] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-08T17:27:19.217553] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-08T17:27:19.332303] [DEBUG] [REMOTE ] BAH: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T17:27:19.332614] [WARN ] [REMOTE ] BAH: No data returned for month 2024-12 [2025-10-08T17:27:19.332740] [FATAL] [REMOTE ] BAH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:27:19.332786] [FATAL] [MAIN ] BAH: Failed to fetch primary data. [2025-10-08T17:27:19.332818] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:27:19.332887] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-08T17:27:19.332950] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-08T17:27:19.332984] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-08T17:27:19.333048] [DEBUG] [LOCAL ] BAH: No derivative data file found to delete. [2025-10-08T17:27:19.333118] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BAH took 1.8s. Estimated remaining: 4h 48m 0s. Rate: 7.5 symbols/min [2025-10-08T17:27:19.509557] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:19.545028] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-08T17:27:19.587061] [DEBUG] [LOCAL ] BAK: Loaded 39374 existing records from primary storage. [2025-10-08T17:27:19.587402] [INFO ] [MAIN ] BAK: Loaded 39374 existing records. [2025-10-08T17:27:19.781399] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:19.781681] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-08T17:27:19.781755] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-08T17:27:19.782021] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-08T17:27:19.782084] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-08T17:27:20.024078] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-08T17:27:20.160559] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:20.189876] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-08T17:27:20.817510] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-08T17:27:21.171950] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-08T17:27:21.617570] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-08T17:27:22.417596] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-08T17:27:22.587287] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-08T17:27:23.094893] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-08T17:27:23.217569] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-08T17:27:23.654185] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T17:27:23.732191] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T17:27:24.017637] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-08T17:27:24.817560] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-08T17:27:25.179997] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T17:27:25.495983] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-08T17:27:25.617560] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-08T17:27:26.417609] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-08T17:27:26.705666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T17:27:26.752005] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T17:27:27.217543] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-08T17:27:28.017581] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-08T17:27:28.817541] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-08T17:27:29.136676] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-08T17:27:29.396631] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:27:29.514980] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-08T17:27:29.617554] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-08T17:27:30.417565] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-08T17:27:31.113209] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-08T17:27:31.217538] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-08T17:27:31.648993] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:27:32.017577] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-08T17:27:32.396888] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-08T17:27:32.817755] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-08T17:27:33.290863] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:27:33.630678] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-08T17:27:33.637394] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T17:27:34.417558] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-08T17:27:35.217508] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-08T17:27:35.269749] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-08T17:27:35.309572] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:27:36.017604] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-08T17:27:36.666859] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-08T17:27:36.817550] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-08T17:27:37.128002] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T17:27:37.132696] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-08T17:27:37.132883] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-08T17:27:37.579570] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-08T17:27:37.585163] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-08T17:27:37.596148] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-08T17:27:37.596374] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-08T17:27:37.598380] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:27:37.611313] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 53790 (keeping 200 days of data) [2025-10-08T17:27:37.669258] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-08T17:27:37.753995] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-08T17:27:38.030969] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-08T17:27:38.031285] [INFO ] [MAIN ] BA: Full history saved. [2025-10-08T17:27:38.031447] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BA took 46.0s. Estimated remaining: 4h 49m 45s. Rate: 7.5 symbols/min [2025-10-08T17:27:38.217420] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:38.217722] [DEBUG] [LOCAL ] BALL: No existing data file found in primary storage. [2025-10-08T17:27:38.217780] [WARN ] [MAIN ] BALL: No existing data found, performing full refresh instead. [2025-10-08T17:27:38.217999] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-08T17:27:38.218048] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-08T17:27:38.218092] [DEBUG] [LOCAL ] BALL: No primary data file found to delete. [2025-10-08T17:27:38.218125] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-08T17:27:38.422817] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-08T17:27:38.612839] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:39.217580] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-08T17:27:40.032219] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-08T17:27:40.034881] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:27:40.152666] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-08T17:27:40.817570] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-08T17:27:41.617553] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-08T17:27:41.683149] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:27:41.920895] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T17:27:42.028086] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-10-08T17:27:42.417553] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-08T17:27:43.217549] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-08T17:27:43.693975] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T17:27:43.758218] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:27:43.762237] [INFO ] [REMOTE ] BAK: Full fetch complete (57099 records). [2025-10-08T17:27:43.762879] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-08T17:27:44.026231] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-08T17:27:44.220973] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-08T17:27:44.221098] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-08T17:27:44.222200] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-08T17:27:44.222283] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-08T17:27:44.223790] [DEBUG] [LOCAL ] BAK: Trimmed 57099 records to 39408 (keeping 200 days of data) [2025-10-08T17:27:44.546181] [DEBUG] [LOCAL ] BAK: Primary data saved (39408 records). [2025-10-08T17:27:44.546419] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-08T17:27:44.546595] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAK took 25.2s. Estimated remaining: 4h 49m 21s. Rate: 7.5 symbols/min [2025-10-08T17:27:44.820484] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-08T17:27:44.848992] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:44.849438] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-08T17:27:44.849547] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-08T17:27:44.849735] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-08T17:27:44.849826] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-08T17:27:44.850094] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-08T17:27:44.850232] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-08T17:27:45.230327] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-08T17:27:45.383079] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:45.617586] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-08T17:27:46.417552] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-08T17:27:46.616176] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-08T17:27:46.645661] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:27:47.217578] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-08T17:27:47.431672] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-08T17:27:48.017531] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-08T17:27:48.064877] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:27:48.182427] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:27:48.817576] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-08T17:27:49.617573] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-08T17:27:50.145733] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T17:27:50.283998] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T17:27:50.370389] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T17:27:50.417518] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-08T17:27:51.217578] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-08T17:27:52.017520] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-08T17:27:52.300330] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:27:52.817587] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-08T17:27:53.619667] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-08T17:27:53.637366] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-08T17:27:53.691370] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T17:27:54.417538] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-08T17:27:54.629540] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-08T17:27:54.938767] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:27:55.217539] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-08T17:27:56.017626] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-08T17:27:56.660662] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-08T17:27:56.664833] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-08T17:27:56.664973] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-08T17:27:56.820056] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-08T17:27:57.072948] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-08T17:27:57.073098] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-08T17:27:57.073952] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-08T17:27:57.074044] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-08T17:27:57.101418] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T17:27:57.111354] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 53808 (keeping 200 days of data) [2025-10-08T17:27:57.450897] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-08T17:27:57.451038] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-08T17:27:57.451175] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAC took 41.3s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-08T17:27:57.621816] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-08T17:27:57.624464] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:27:57.630984] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T17:27:57.679984] [DEBUG] [LOCAL ] BAM: Loaded 52009 existing records from primary storage. [2025-10-08T17:27:57.680301] [INFO ] [MAIN ] BAM: Loaded 52009 existing records. [2025-10-08T17:27:57.855997] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:27:57.856218] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-08T17:27:57.856294] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-08T17:27:57.858151] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-08T17:27:57.858218] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-08T17:27:58.210366] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:27:58.417544] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-08T17:27:58.998637] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-08T17:27:59.002867] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-08T17:27:59.003012] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-08T17:27:59.222760] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-08T17:27:59.405539] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-08T17:27:59.405893] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-08T17:27:59.407323] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-08T17:27:59.407510] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-08T17:27:59.410723] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 53820 (keeping 200 days of data) [2025-10-08T17:27:59.443235] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:27:59.798508] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:27:59.833798] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-08T17:27:59.833910] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-08T17:27:59.833977] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BABA took 47.0s. Estimated remaining: 4h 48m 57s. Rate: 7.5 symbols/min [2025-10-08T17:28:00.016716] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:00.022625] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-08T17:28:00.030621] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T17:28:00.081840] [DEBUG] [LOCAL ] BANC: Loaded 51275 existing records from primary storage. [2025-10-08T17:28:00.082217] [INFO ] [MAIN ] BANC: Loaded 51275 existing records. [2025-10-08T17:28:00.262092] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:00.262341] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-08T17:28:00.262389] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-08T17:28:00.262598] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-08T17:28:00.262692] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-08T17:28:00.628470] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:00.817623] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-08T17:28:01.616483] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T17:28:01.625685] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-08T17:28:01.635595] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T17:28:02.417609] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-08T17:28:03.217572] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-08T17:28:03.297570] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:28:03.469514] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T17:28:04.017563] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-08T17:28:04.536483] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T17:28:04.605873] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T17:28:04.817577] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-08T17:28:05.405321] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T17:28:05.617549] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-08T17:28:06.417707] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-08T17:28:07.217566] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-08T17:28:07.395411] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T17:28:07.788077] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:28:08.017562] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-08T17:28:08.275933] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:28:08.277404] [INFO ] [REMOTE ] BALY: Full fetch complete (16797 records). [2025-10-08T17:28:08.277496] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-08T17:28:08.460781] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T17:28:08.461100] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:28:08.461170] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:28:08.461238] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-08T17:28:08.461300] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-08T17:28:08.461336] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-08T17:28:08.461375] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-08T17:28:08.461442] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 23.9s. Estimated remaining: 4h 48m 56s. Rate: 7.5 symbols/min [2025-10-08T17:28:08.624206] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:08.651287] [DEBUG] [LOCAL ] BAP: Loaded 25960 existing records from primary storage. [2025-10-08T17:28:08.651539] [INFO ] [MAIN ] BAP: Loaded 25960 existing records. [2025-10-08T17:28:08.825387] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:08.821798] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-08T17:28:08.825775] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-08T17:28:08.825872] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-08T17:28:08.826899] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-08T17:28:08.826965] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-08T17:28:09.173429] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:09.413221] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T17:28:09.418379] [INFO ] [REMOTE ] BALL: Full fetch complete (75372 records). [2025-10-08T17:28:09.418626] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-08T17:28:09.622719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-08T17:28:09.824951] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-08T17:28:09.825085] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-08T17:28:09.825906] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-08T17:28:09.825974] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-08T17:28:09.827955] [DEBUG] [LOCAL ] BALL: Trimmed 75372 records to 51825 (keeping 200 days of data) [2025-10-08T17:28:10.163078] [DEBUG] [LOCAL ] BALL: Primary data saved (51825 records). [2025-10-08T17:28:10.163294] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-08T17:28:10.163388] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALL took 32.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-08T17:28:10.337051] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:10.374399] [DEBUG] [LOCAL ] BARK: Loaded 37946 existing records from primary storage. [2025-10-08T17:28:10.374771] [INFO ] [MAIN ] BARK: Loaded 37946 existing records. [2025-10-08T17:28:10.432792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-08T17:28:10.560517] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:10.560921] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-08T17:28:10.561048] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-08T17:28:10.561419] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-08T17:28:10.561483] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-08T17:28:10.930386] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:10.967049] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T17:28:11.012048] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:28:11.217532] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-08T17:28:11.430927] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:28:12.017566] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-08T17:28:12.821160] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-08T17:28:12.827275] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T17:28:13.552222] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:28:13.617521] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-08T17:28:14.424797] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-08T17:28:14.427306] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:28:14.823225] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:28:15.217535] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-08T17:28:16.017520] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-08T17:28:16.244907] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T17:28:16.699257] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:28:16.817521] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-08T17:28:16.934220] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:28:17.617560] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-08T17:28:18.009605] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:28:18.417627] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-08T17:28:18.971339] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:28:19.217586] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-08T17:28:20.017564] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-08T17:28:20.251976] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:28:20.324431] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:28:20.817551] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-08T17:28:21.273708] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:28:21.617602] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-08T17:28:22.249764] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T17:28:22.417551] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-08T17:28:23.217525] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-08T17:28:23.423392] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:28:23.511903] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T17:28:24.017630] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-08T17:28:24.281839] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:28:24.817545] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-08T17:28:25.190389] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:28:25.617555] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-08T17:28:26.417534] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-08T17:28:26.448435] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:28:26.880418] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:28:27.217599] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-08T17:28:28.022728] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-08T17:28:28.047222] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:28:28.817610] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-08T17:28:29.039095] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:28:29.617596] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-08T17:28:29.689682] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:28:30.201196] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T17:28:30.417567] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-08T17:28:31.190238] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T17:28:31.217496] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-08T17:28:31.440897] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T17:28:32.017591] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-08T17:28:32.817574] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-08T17:28:32.929982] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T17:28:33.392183] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T17:28:33.617551] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-08T17:28:34.417552] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-08T17:28:34.502139] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T17:28:34.852977] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T17:28:35.217565] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-08T17:28:35.401494] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:28:36.017572] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-08T17:28:36.261176] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T17:28:36.263350] [INFO ] [REMOTE ] BAP: Full fetch complete (37363 records). [2025-10-08T17:28:36.263446] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-08T17:28:36.676397] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-08T17:28:36.676520] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-08T17:28:36.677123] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-08T17:28:36.677187] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-08T17:28:36.678131] [DEBUG] [LOCAL ] BAP: Trimmed 37363 records to 25923 (keeping 200 days of data) [2025-10-08T17:28:36.825934] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-08T17:28:36.852521] [DEBUG] [LOCAL ] BAP: Primary data saved (25923 records). [2025-10-08T17:28:36.852756] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-08T17:28:36.852855] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAP took 28.4s. Estimated remaining: 4h 50m 45s. Rate: 7.4 symbols/min [2025-10-08T17:28:37.019407] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:37.074672] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-08T17:28:37.075040] [INFO ] [MAIN ] BAX: Loaded 53504 existing records. [2025-10-08T17:28:37.252858] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:37.253104] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-08T17:28:37.253164] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-08T17:28:37.253427] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-08T17:28:37.253484] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-08T17:28:37.361267] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:28:37.396270] [INFO ] [REMOTE ] BARK: Full fetch complete (55987 records). [2025-10-08T17:28:37.418589] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-08T17:28:37.628726] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-08T17:28:37.832279] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:38.022189] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-08T17:28:38.022281] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-08T17:28:38.022865] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-08T17:28:38.022927] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-08T17:28:38.024115] [DEBUG] [LOCAL ] BARK: Trimmed 55987 records to 37978 (keeping 200 days of data) [2025-10-08T17:28:38.240127] [DEBUG] [LOCAL ] BARK: Primary data saved (37978 records). [2025-10-08T17:28:38.240285] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-08T17:28:38.240374] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BARK took 28.1s. Estimated remaining: 4h 49m 29s. Rate: 7.5 symbols/min [2025-10-08T17:28:38.446689] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-08T17:28:38.453500] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:38.499310] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T17:28:38.550551] [DEBUG] [LOCAL ] BB: Loaded 52944 existing records from primary storage. [2025-10-08T17:28:38.550947] [INFO ] [MAIN ] BB: Loaded 52944 existing records. [2025-10-08T17:28:38.724133] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:38.724352] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-08T17:28:38.724398] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-08T17:28:38.724674] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-08T17:28:38.724734] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-08T17:28:39.075221] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:39.217568] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-08T17:28:39.438955] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:28:40.017570] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-08T17:28:40.424750] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:28:40.817525] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-08T17:28:41.263140] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T17:28:41.325144] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:28:41.617553] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-08T17:28:42.322457] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:28:42.326448] [INFO ] [REMOTE ] BAM: Full fetch complete (74544 records). [2025-10-08T17:28:42.326587] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-08T17:28:42.422673] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-08T17:28:42.739411] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-08T17:28:42.739526] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-08T17:28:42.740485] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-08T17:28:42.740585] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-08T17:28:42.742566] [DEBUG] [LOCAL ] BAM: Trimmed 74544 records to 52011 (keeping 200 days of data) [2025-10-08T17:28:43.006993] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:28:43.014211] [INFO ] [REMOTE ] BANC: Full fetch complete (74327 records). [2025-10-08T17:28:43.015172] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-08T17:28:43.221261] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-08T17:28:43.444885] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-08T17:28:43.445540] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-08T17:28:43.446430] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-08T17:28:43.446510] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-08T17:28:43.452403] [DEBUG] [LOCAL ] BANC: Trimmed 74327 records to 51277 (keeping 200 days of data) [2025-10-08T17:28:43.644229] [DEBUG] [LOCAL ] BAM: Primary data saved (52011 records). [2025-10-08T17:28:43.644708] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-08T17:28:43.645340] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAM took 46.2s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-08T17:28:43.845944] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:44.012812] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-08T17:28:44.015383] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-08T17:28:44.244575] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:44.245985] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-08T17:28:44.246361] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-08T17:28:44.247683] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-08T17:28:44.248077] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-08T17:28:44.632612] [DEBUG] [LOCAL ] BANC: Primary data saved (51277 records). [2025-10-08T17:28:44.637961] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-08T17:28:44.638403] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BANC took 44.8s. Estimated remaining: 4h 47m 36s. Rate: 7.5 symbols/min [2025-10-08T17:28:44.763823] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-08T17:28:44.883809] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-08T17:28:44.952627] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:44.977913] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-08T17:28:44.977280] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:28:45.018749] [DEBUG] [LOCAL ] BBAR: Loaded 41683 existing records from primary storage. [2025-10-08T17:28:45.019093] [INFO ] [MAIN ] BBAR: Loaded 41683 existing records. [2025-10-08T17:28:45.201681] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:28:45.202079] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-08T17:28:45.202126] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-08T17:28:45.219334] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-08T17:28:45.224587] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-08T17:28:45.361918] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-08T17:28:45.619500] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-08T17:28:45.640723] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:28:46.417591] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-08T17:28:46.982869] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-08T17:28:47.217555] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-08T17:28:47.338719] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:28:47.463531] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-08T17:28:47.696213] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:28:48.017693] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-08T17:28:48.817590] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-08T17:28:49.019897] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:28:49.617609] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-08T17:28:49.761231] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:28:50.417722] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-08T17:28:51.224766] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-08T17:28:51.230422] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-08T17:28:51.370759] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:28:52.017628] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-08T17:28:52.435533] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T17:28:52.483492] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:28:52.817604] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-08T17:28:53.617618] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-08T17:28:54.264337] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T17:28:54.305013] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T17:28:54.417545] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-08T17:28:55.130873] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:28:55.217519] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-08T17:28:55.552176] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:28:56.017574] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-08T17:28:56.817509] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-08T17:28:57.223522] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:28:57.346285] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T17:28:57.617597] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-08T17:28:58.417508] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-08T17:28:58.602384] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:28:59.217590] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-08T17:28:59.796090] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:28:59.923141] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-08T17:29:00.017562] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-08T17:29:00.817561] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-08T17:29:01.206162] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-08T17:29:01.617590] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-08T17:29:02.425310] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-08T17:29:02.449207] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-08T17:29:02.527272] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:29:03.072427] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:29:03.217596] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-08T17:29:04.017580] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-08T17:29:04.252458] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:29:04.600809] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T17:29:04.817627] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-08T17:29:05.617583] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-08T17:29:06.180310] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:29:06.417513] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-08T17:29:06.536703] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-08T17:29:07.068252] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T17:29:07.217550] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-08T17:29:08.017566] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-08T17:29:08.098100] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T17:29:08.543974] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:29:08.548183] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-10-08T17:29:08.548334] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-08T17:29:08.825926] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-08T17:29:08.950494] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-08T17:29:08.950581] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-08T17:29:08.951370] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-08T17:29:08.951434] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-08T17:29:08.953050] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 53504 (keeping 200 days of data) [2025-10-08T17:29:09.286540] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:29:09.313394] [DEBUG] [LOCAL ] BAX: Primary data saved (53504 records). [2025-10-08T17:29:09.313517] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-08T17:29:09.313610] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 32.5s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-08T17:29:09.483956] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:09.533153] [DEBUG] [LOCAL ] BBD: Loaded 53239 existing records from primary storage. [2025-10-08T17:29:09.533478] [INFO ] [MAIN ] BBD: Loaded 53239 existing records. [2025-10-08T17:29:09.627588] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-08T17:29:09.708411] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:09.708627] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-08T17:29:09.708707] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-08T17:29:09.708996] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-08T17:29:09.709059] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-08T17:29:10.055854] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:10.417583] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-08T17:29:11.217545] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-08T17:29:11.687151] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T17:29:11.787080] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.96 seconds). [2025-10-08T17:29:12.017540] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-08T17:29:12.104351] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:29:12.711022] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T17:29:12.817526] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-08T17:29:13.617545] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-08T17:29:13.989306] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T17:29:13.994089] [INFO ] [REMOTE ] BB: Full fetch complete (76990 records). [2025-10-08T17:29:13.994276] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-08T17:29:14.259423] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:29:14.307441] [INFO ] [REMOTE ] BBAR: Full fetch complete (60999 records). [2025-10-08T17:29:14.324817] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-08T17:29:14.426220] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-08T17:29:14.639892] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-08T17:29:14.645192] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-08T17:29:14.646327] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-08T17:29:14.706622] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-08T17:29:14.772438] [DEBUG] [LOCAL ] BB: Trimmed 76990 records to 52939 (keeping 200 days of data) [2025-10-08T17:29:14.925682] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-08T17:29:14.926218] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-08T17:29:14.927144] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-08T17:29:14.927483] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-08T17:29:14.934613] [DEBUG] [LOCAL ] BBAR: Trimmed 60999 records to 41817 (keeping 200 days of data) [2025-10-08T17:29:15.412353] [DEBUG] [LOCAL ] BB: Primary data saved (52939 records). [2025-10-08T17:29:15.415145] [INFO ] [MAIN ] BB: Full history saved. [2025-10-08T17:29:15.420708] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 37.2s. Estimated remaining: 4h 49m 47s. Rate: 7.4 symbols/min [2025-10-08T17:29:15.525239] [DEBUG] [LOCAL ] BBAR: Primary data saved (41817 records). [2025-10-08T17:29:15.528045] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-08T17:29:15.533637] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 30.9s. Estimated remaining: 4h 48m 20s. Rate: 7.5 symbols/min [2025-10-08T17:29:15.700041] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:15.771073] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:15.792461] [DEBUG] [LOCAL ] BBDO: Loaded 4997 existing records from primary storage. [2025-10-08T17:29:15.792964] [INFO ] [MAIN ] BBDO: Loaded 4997 existing records. [2025-10-08T17:29:15.922040] [DEBUG] [LOCAL ] BBDC: Loaded 32890 existing records from primary storage. [2025-10-08T17:29:15.957806] [INFO ] [MAIN ] BBDC: Loaded 32890 existing records. [2025-10-08T17:29:15.985896] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:16.006976] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-08T17:29:16.029469] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-08T17:29:16.066972] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-08T17:29:16.093673] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-08T17:29:16.264696] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:16.280340] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-08T17:29:16.280669] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-08T17:29:16.320001] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-08T17:29:16.341031] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-08T17:29:16.750552] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:16.754101] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-08T17:29:16.753826] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T17:29:16.863891] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-08T17:29:16.911775] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-10-08T17:29:16.933819] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-08T17:29:17.006056] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:17.600298] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:29:17.617536] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-08T17:29:18.417629] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-08T17:29:18.598322] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:29:18.822577] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T17:29:18.888861] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:29:19.133794] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-08T17:29:19.217521] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-08T17:29:20.017557] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-08T17:29:20.484035] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:29:20.817560] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-08T17:29:20.927018] [DEBUG] [REMOTE ] BBDO: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-08T17:29:20.940487] [WARN ] [REMOTE ] BBDO: No data returned for month 2025-03 [2025-10-08T17:29:20.942991] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T17:29:20.943263] [FATAL] [REMOTE ] BBDO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:29:20.955314] [FATAL] [MAIN ] BBDO: Failed to fetch primary data. [2025-10-08T17:29:20.956030] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:29:20.956527] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-08T17:29:20.956635] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-08T17:29:20.956737] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-08T17:29:20.957072] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-08T17:29:20.957189] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBDO took 5.4s. Estimated remaining: 4h 47m 46s. Rate: 7.5 symbols/min [2025-10-08T17:29:21.153505] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:21.153758] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-08T17:29:21.153804] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-08T17:29:21.153916] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-08T17:29:21.153958] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-08T17:29:21.154003] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-08T17:29:21.154035] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-08T17:29:21.499459] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:21.617512] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-08T17:29:22.417638] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-08T17:29:22.869471] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T17:29:23.217547] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-08T17:29:23.272739] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:29:24.017554] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-08T17:29:24.817554] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-08T17:29:25.617533] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-08T17:29:25.635122] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T17:29:25.901444] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:29:26.012966] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-08T17:29:26.417562] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-08T17:29:26.554324] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T17:29:27.217551] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-08T17:29:28.017569] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-08T17:29:28.690455] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:29:28.778542] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T17:29:28.817685] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-08T17:29:29.129833] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-08T17:29:29.133884] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-08T17:29:29.133996] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-08T17:29:29.585799] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-08T17:29:29.585902] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-08T17:29:29.586827] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-08T17:29:29.586896] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-08T17:29:29.588524] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-08T17:29:29.638435] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-08T17:29:29.685675] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T17:29:29.934012] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-08T17:29:29.934169] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-08T17:29:29.934259] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBAI took 46.3s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-08T17:29:30.101386] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:30.101594] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-08T17:29:30.101631] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-08T17:29:30.101770] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-08T17:29:30.101811] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-08T17:29:30.101851] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-08T17:29:30.101885] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-08T17:29:30.422736] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-08T17:29:30.480391] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:31.193731] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:29:31.217493] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-08T17:29:31.340453] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:29:32.017555] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-08T17:29:32.817551] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-08T17:29:32.974445] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:29:33.243437] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:29:33.617532] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-08T17:29:33.899524] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T17:29:34.417558] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-08T17:29:34.961698] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T17:29:35.217534] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-08T17:29:35.884575] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:29:36.017533] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-08T17:29:36.450167] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:29:36.468514] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-08T17:29:36.470092] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T17:29:36.480935] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:29:36.481389] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-08T17:29:36.481566] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:29:36.481670] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-08T17:29:36.481760] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-08T17:29:36.482115] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-08T17:29:36.482172] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-08T17:29:36.482220] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBT took 6.5s. Estimated remaining: 4h 47m 25s. Rate: 7.5 symbols/min [2025-10-08T17:29:36.650421] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:36.657265] [DEBUG] [LOCAL ] BBU: Loaded 5038 existing records from primary storage. [2025-10-08T17:29:36.657555] [INFO ] [MAIN ] BBU: Loaded 5038 existing records. [2025-10-08T17:29:36.828394] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-08T17:29:36.833450] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:36.833694] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-08T17:29:36.833769] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-08T17:29:36.834586] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-08T17:29:36.834688] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-08T17:29:37.197079] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:37.617550] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-08T17:29:38.289121] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T17:29:38.417549] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-08T17:29:39.189068] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:29:39.217540] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-08T17:29:39.611798] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T17:29:40.017549] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-08T17:29:40.817575] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-08T17:29:40.901317] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:29:41.236744] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-08T17:29:41.312902] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T17:29:41.617574] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-08T17:29:42.417580] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-08T17:29:42.710195] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:29:43.217552] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-08T17:29:44.017591] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-08T17:29:44.132516] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T17:29:44.136697] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-08T17:29:44.136879] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-08T17:29:44.467139] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:29:44.595559] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-08T17:29:44.595684] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-08T17:29:44.596622] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-08T17:29:44.596718] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-08T17:29:44.598558] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53245 (keeping 200 days of data) [2025-10-08T17:29:44.824372] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-08T17:29:44.997663] [DEBUG] [LOCAL ] BBD: Primary data saved (53245 records). [2025-10-08T17:29:44.998126] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-08T17:29:44.998235] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBD took 35.7s. Estimated remaining: 4h 47m 22s. Rate: 7.5 symbols/min [2025-10-08T17:29:45.246910] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:45.266935] [DEBUG] [LOCAL ] BBUC: Loaded 13427 existing records from primary storage. [2025-10-08T17:29:45.267233] [INFO ] [MAIN ] BBUC: Loaded 13427 existing records. [2025-10-08T17:29:45.449757] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T17:29:45.512461] [INFO ] [REMOTE ] BBDC: Full fetch complete (48555 records). [2025-10-08T17:29:45.520219] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-08T17:29:45.545685] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:45.552616] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-08T17:29:45.582231] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-08T17:29:45.619689] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-08T17:29:45.614168] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-08T17:29:45.670852] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-08T17:29:46.103359] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:29:46.221200] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:29:46.383149] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-08T17:29:46.397218] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-08T17:29:46.413499] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-08T17:29:46.418161] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:46.418318] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-08T17:29:46.418265] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-08T17:29:46.420383] [DEBUG] [LOCAL ] BBDC: Trimmed 48555 records to 33016 (keeping 200 days of data) [2025-10-08T17:29:46.613159] [DEBUG] [LOCAL ] BBDC: Primary data saved (33016 records). [2025-10-08T17:29:46.613302] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-08T17:29:46.613388] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBDC took 31.2s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-10-08T17:29:46.788787] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:46.834722] [DEBUG] [LOCAL ] BBVA: Loaded 49183 existing records from primary storage. [2025-10-08T17:29:46.835052] [INFO ] [MAIN ] BBVA: Loaded 49183 existing records. [2025-10-08T17:29:47.010343] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:47.010544] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-08T17:29:47.010600] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-08T17:29:47.012051] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-08T17:29:47.012112] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-08T17:29:47.223135] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-08T17:29:47.381560] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:47.453713] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T17:29:47.970592] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:29:48.017517] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-08T17:29:48.817568] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-08T17:29:48.928157] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T17:29:48.929793] [INFO ] [REMOTE ] BBN: Full fetch complete (26200 records). [2025-10-08T17:29:48.929915] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-08T17:29:49.306280] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-08T17:29:49.306374] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-08T17:29:49.306803] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-08T17:29:49.306866] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-08T17:29:49.307750] [DEBUG] [LOCAL ] BBN: Trimmed 26200 records to 18059 (keeping 200 days of data) [2025-10-08T17:29:49.421361] [DEBUG] [LOCAL ] BBN: Primary data saved (18059 records). [2025-10-08T17:29:49.421505] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-08T17:29:49.421583] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 28.5s. Estimated remaining: 4h 45m 15s. Rate: 7.5 symbols/min [2025-10-08T17:29:49.602237] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:29:49.617543] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-08T17:29:49.629921] [DEBUG] [LOCAL ] BBW: Loaded 27006 existing records from primary storage. [2025-10-08T17:29:49.630203] [INFO ] [MAIN ] BBW: Loaded 27006 existing records. [2025-10-08T17:29:49.753833] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:29:49.822595] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:29:49.822821] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-08T17:29:49.822869] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-08T17:29:49.823788] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-08T17:29:49.823852] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-08T17:29:50.184725] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:29:50.417551] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-08T17:29:51.217556] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-08T17:29:51.543400] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T17:29:51.685768] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:29:51.700568] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:29:52.017593] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-08T17:29:52.817554] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-08T17:29:52.935399] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T17:29:53.617518] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-08T17:29:53.757628] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:29:54.417569] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-08T17:29:55.191340] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:29:55.217507] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-08T17:29:55.336818] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:29:55.885699] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:29:56.017571] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-08T17:29:56.817517] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-08T17:29:56.894527] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:29:57.617551] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-08T17:29:58.080149] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:29:58.417589] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-08T17:29:58.738601] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-08T17:29:58.954901] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:29:59.217544] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-08T17:29:59.999539] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T17:30:00.017578] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-08T17:30:00.817525] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-08T17:30:00.947307] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T17:30:01.617579] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-08T17:30:02.417552] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-08T17:30:02.718279] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T17:30:02.787418] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:30:02.920556] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T17:30:03.217628] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-08T17:30:04.017573] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-08T17:30:04.817530] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-08T17:30:04.903933] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:30:05.054945] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T17:30:05.617591] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-08T17:30:06.018517] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:30:06.417591] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-08T17:30:07.217525] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-08T17:30:07.298092] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T17:30:07.366913] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T17:30:08.017520] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-08T17:30:08.212737] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:30:08.621360] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:30:08.817516] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-08T17:30:09.617623] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-08T17:30:10.147002] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:30:10.417610] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-08T17:30:10.593020] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:30:11.217574] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-08T17:30:11.375873] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:30:12.017613] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-08T17:30:12.817542] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-08T17:30:12.891617] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:30:12.893956] [INFO ] [REMOTE ] BBUC: Full fetch complete (18465 records). [2025-10-08T17:30:12.894119] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-08T17:30:13.171750] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:30:13.312185] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-08T17:30:13.312278] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-08T17:30:13.312627] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-08T17:30:13.312770] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-08T17:30:13.313372] [DEBUG] [LOCAL ] BBUC: Trimmed 18465 records to 13474 (keeping 200 days of data) [2025-10-08T17:30:13.400604] [DEBUG] [LOCAL ] BBUC: Primary data saved (13474 records). [2025-10-08T17:30:13.400760] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-08T17:30:13.400860] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBUC took 28.4s. Estimated remaining: 4h 47m 39s. Rate: 7.5 symbols/min [2025-10-08T17:30:13.569903] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:13.622352] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-08T17:30:13.624170] [DEBUG] [LOCAL ] BBWI: Loaded 53581 existing records from primary storage. [2025-10-08T17:30:13.624545] [INFO ] [MAIN ] BBWI: Loaded 53581 existing records. [2025-10-08T17:30:13.808298] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:13.808581] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-08T17:30:13.808671] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-08T17:30:13.809000] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-08T17:30:13.809059] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-08T17:30:14.168057] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:14.379713] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:30:14.417539] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-08T17:30:15.217509] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-08T17:30:15.457052] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T17:30:16.017609] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-08T17:30:16.604237] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T17:30:16.639739] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T17:30:16.817606] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-08T17:30:16.852676] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:30:17.617615] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-08T17:30:18.330376] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T17:30:18.417523] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-08T17:30:18.963085] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T17:30:19.217571] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-08T17:30:19.820867] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T17:30:20.017568] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-08T17:30:20.189974] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T17:30:20.817576] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-08T17:30:21.214342] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T17:30:21.217304] [INFO ] [REMOTE ] BBW: Full fetch complete (39576 records). [2025-10-08T17:30:21.217388] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-08T17:30:21.598579] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-08T17:30:21.604740] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-08T17:30:21.604969] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:30:21.607484] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-08T17:30:21.608193] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-08T17:30:21.609094] [DEBUG] [LOCAL ] BBW: Trimmed 39576 records to 27086 (keeping 200 days of data) [2025-10-08T17:30:21.662719] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-08T17:30:21.778896] [DEBUG] [LOCAL ] BBW: Primary data saved (27086 records). [2025-10-08T17:30:21.779084] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-08T17:30:21.779207] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBW took 32.4s. Estimated remaining: 4h 47m 34s. Rate: 7.5 symbols/min [2025-10-08T17:30:21.950783] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:22.006605] [DEBUG] [LOCAL ] BBY: Loaded 53455 existing records from primary storage. [2025-10-08T17:30:22.007013] [INFO ] [MAIN ] BBY: Loaded 53455 existing records. [2025-10-08T17:30:22.186124] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:22.186356] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-08T17:30:22.186404] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-08T17:30:22.186757] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-08T17:30:22.186818] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-08T17:30:22.429896] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-08T17:30:22.572686] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:22.578242] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:30:22.580328] [INFO ] [REMOTE ] BBU: Full fetch complete (6999 records). [2025-10-08T17:30:22.580562] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-08T17:30:22.942671] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-08T17:30:22.942761] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-08T17:30:22.942940] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-08T17:30:22.942976] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-08T17:30:22.943363] [DEBUG] [LOCAL ] BBU: Trimmed 6999 records to 5128 (keeping 200 days of data) [2025-10-08T17:30:22.974727] [DEBUG] [LOCAL ] BBU: Primary data saved (5128 records). [2025-10-08T17:30:22.974894] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-08T17:30:22.975019] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBU took 46.5s. Estimated remaining: 4h 46m 22s. Rate: 7.5 symbols/min [2025-10-08T17:30:23.143335] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:23.186346] [DEBUG] [LOCAL ] BC: Loaded 44173 existing records from primary storage. [2025-10-08T17:30:23.186690] [INFO ] [MAIN ] BC: Loaded 44173 existing records. [2025-10-08T17:30:23.222709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-08T17:30:23.367905] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:23.368111] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-08T17:30:23.368160] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-08T17:30:23.368341] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-08T17:30:23.368381] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-08T17:30:23.732497] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:24.017512] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-08T17:30:24.046093] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:30:24.817527] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-08T17:30:25.169493] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T17:30:25.617504] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-08T17:30:25.706139] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:30:26.417603] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-08T17:30:26.537861] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:30:26.542453] [INFO ] [REMOTE ] BBVA: Full fetch complete (71598 records). [2025-10-08T17:30:26.542667] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-08T17:30:27.029216] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-08T17:30:27.029353] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-08T17:30:27.030407] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-08T17:30:27.030496] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-08T17:30:27.032714] [DEBUG] [LOCAL ] BBVA: Trimmed 71598 records to 49165 (keeping 200 days of data) [2025-10-08T17:30:27.170087] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T17:30:27.262486] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-08T17:30:27.399245] [DEBUG] [LOCAL ] BBVA: Primary data saved (49165 records). [2025-10-08T17:30:27.399457] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-08T17:30:27.399579] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 40.8s. Estimated remaining: 4h 45m 40s. Rate: 7.5 symbols/min [2025-10-08T17:30:27.582373] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:27.619322] [DEBUG] [LOCAL ] BCAT: Loaded 34059 existing records from primary storage. [2025-10-08T17:30:27.619768] [INFO ] [MAIN ] BCAT: Loaded 34059 existing records. [2025-10-08T17:30:27.801501] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:27.801800] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-08T17:30:27.801865] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-08T17:30:27.802114] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-08T17:30:27.802171] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-08T17:30:28.037762] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-08T17:30:28.173812] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:28.207875] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T17:30:28.817558] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-08T17:30:29.127801] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T17:30:29.617612] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-08T17:30:29.689718] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:30:30.350174] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:30:30.417557] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-08T17:30:31.217514] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-08T17:30:31.469153] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T17:30:31.729312] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T17:30:32.017550] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-08T17:30:32.164449] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T17:30:32.817555] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-08T17:30:33.617550] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-08T17:30:33.756323] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T17:30:34.259458] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:30:34.417530] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-08T17:30:35.217531] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-08T17:30:35.274371] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:30:36.017556] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-08T17:30:36.137457] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T17:30:36.817578] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-08T17:30:36.889003] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T17:30:37.396477] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T17:30:37.617626] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-08T17:30:38.417539] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-08T17:30:38.701561] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:30:39.217593] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-08T17:30:39.523030] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T17:30:39.568864] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:30:40.017563] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-08T17:30:40.682858] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:30:40.817609] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-08T17:30:41.617574] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-08T17:30:41.816428] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T17:30:42.390292] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:30:42.417570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-08T17:30:43.217576] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-08T17:30:43.358791] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T17:30:43.806259] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:30:44.017573] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-08T17:30:44.594988] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T17:30:44.817562] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-08T17:30:45.183894] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:30:45.617554] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-08T17:30:46.153971] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T17:30:46.417600] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-08T17:30:47.057953] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:30:47.064928] [INFO ] [REMOTE ] BBWI: Full fetch complete (77440 records). [2025-10-08T17:30:47.065206] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-08T17:30:47.228702] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-08T17:30:47.508265] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-08T17:30:47.508370] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-08T17:30:47.509217] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-08T17:30:47.509293] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-08T17:30:47.510966] [DEBUG] [LOCAL ] BBWI: Trimmed 77440 records to 53582 (keeping 200 days of data) [2025-10-08T17:30:47.851523] [DEBUG] [LOCAL ] BBWI: Primary data saved (53582 records). [2025-10-08T17:30:47.851734] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-08T17:30:47.851849] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 34.5s. Estimated remaining: 4h 47m 28s. Rate: 7.5 symbols/min [2025-10-08T17:30:48.021325] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-08T17:30:48.025244] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:48.026264] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-10-08T17:30:48.026333] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-10-08T17:30:48.026482] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-08T17:30:48.026544] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-08T17:30:48.026592] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-10-08T17:30:48.026674] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-08T17:30:48.399045] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:48.431159] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-08T17:30:48.610111] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T17:30:48.817557] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-08T17:30:49.272308] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:30:49.617587] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-08T17:30:50.251518] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:30:50.417570] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-08T17:30:51.074244] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:30:51.217554] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-08T17:30:51.999574] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T17:30:52.017516] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-08T17:30:52.417312] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T17:30:52.817609] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-08T17:30:53.297636] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:30:53.300805] [INFO ] [REMOTE ] BCAT: Full fetch complete (50031 records). [2025-10-08T17:30:53.300981] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-08T17:30:53.622675] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-08T17:30:53.796035] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-08T17:30:53.796136] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-08T17:30:53.796763] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-08T17:30:53.796832] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-08T17:30:53.798078] [DEBUG] [LOCAL ] BCAT: Trimmed 50031 records to 34116 (keeping 200 days of data) [2025-10-08T17:30:54.023349] [DEBUG] [LOCAL ] BCAT: Primary data saved (34116 records). [2025-10-08T17:30:54.023807] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-08T17:30:54.023973] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BCAT took 26.6s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-08T17:30:54.206958] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:54.256541] [DEBUG] [LOCAL ] BCE: Loaded 52205 existing records from primary storage. [2025-10-08T17:30:54.256947] [INFO ] [MAIN ] BCE: Loaded 52205 existing records. [2025-10-08T17:30:54.423488] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-08T17:30:54.447351] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:54.462143] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-08T17:30:54.469060] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-08T17:30:54.472027] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-08T17:30:54.472372] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-08T17:30:54.473446] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:30:54.859762] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:55.217568] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-08T17:30:55.705574] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:30:55.857215] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-08T17:30:56.017560] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-08T17:30:56.336672] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:30:56.339918] [INFO ] [REMOTE ] BC: Full fetch complete (63652 records). [2025-10-08T17:30:56.340045] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-08T17:30:56.734391] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-08T17:30:56.734533] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-08T17:30:56.735264] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-08T17:30:56.735328] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-08T17:30:56.736572] [DEBUG] [LOCAL ] BC: Trimmed 63652 records to 44121 (keeping 200 days of data) [2025-10-08T17:30:56.826404] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-08T17:30:57.007849] [DEBUG] [LOCAL ] BC: Primary data saved (44121 records). [2025-10-08T17:30:57.007992] [INFO ] [MAIN ] BC: Full history saved. [2025-10-08T17:30:57.008078] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 34.0s. Estimated remaining: 4h 46m 8s. Rate: 7.5 symbols/min [2025-10-08T17:30:57.242705] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:30:57.272561] [DEBUG] [LOCAL ] BCH: Loaded 29740 existing records from primary storage. [2025-10-08T17:30:57.272909] [INFO ] [MAIN ] BCH: Loaded 29740 existing records. [2025-10-08T17:30:57.455688] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:30:57.456161] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-08T17:30:57.456292] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-08T17:30:57.456543] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-08T17:30:57.456602] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-08T17:30:57.621458] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-08T17:30:57.880022] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:30:57.886134] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:30:58.417586] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-08T17:30:58.780501] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T17:30:58.858028] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:30:59.217565] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-08T17:30:59.344595] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T17:31:00.017565] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-08T17:31:00.158626] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:31:00.804028] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T17:31:00.817488] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-08T17:31:01.617581] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-08T17:31:01.999403] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:31:02.417686] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-08T17:31:03.132630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:31:03.217634] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-08T17:31:03.481945] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T17:31:04.017559] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-08T17:31:04.817527] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-08T17:31:04.855965] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:31:05.172698] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T17:31:05.617575] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-08T17:31:06.253386] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:31:06.417548] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-08T17:31:07.217533] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-08T17:31:07.451366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:31:07.647021] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:31:08.017581] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-08T17:31:08.824311] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-08T17:31:08.828050] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:31:08.846998] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:31:08.852372] [INFO ] [REMOTE ] BBY: Full fetch complete (77230 records). [2025-10-08T17:31:08.852560] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-08T17:31:09.242928] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-08T17:31:09.243020] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-08T17:31:09.243852] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-08T17:31:09.243924] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-08T17:31:09.245449] [DEBUG] [LOCAL ] BBY: Trimmed 77230 records to 53453 (keeping 200 days of data) [2025-10-08T17:31:09.580098] [DEBUG] [LOCAL ] BBY: Primary data saved (53453 records). [2025-10-08T17:31:09.580245] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-08T17:31:09.580329] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BBY took 47.8s. Estimated remaining: 4h 46m 42s. Rate: 7.5 symbols/min [2025-10-08T17:31:09.623551] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-08T17:31:09.757823] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:09.757998] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-10-08T17:31:09.758035] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-10-08T17:31:09.758154] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-08T17:31:09.758195] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-08T17:31:09.758234] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-10-08T17:31:09.758264] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-08T17:31:10.118569] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:10.134474] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:31:10.417608] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-08T17:31:10.864971] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T17:31:11.217612] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-08T17:31:11.666479] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:31:12.017577] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-08T17:31:12.390264] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:31:12.817606] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-08T17:31:13.607484] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:31:13.617490] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-08T17:31:14.417556] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-08T17:31:14.634950] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:31:14.686592] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:31:15.217623] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-08T17:31:15.499291] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T17:31:16.017533] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-08T17:31:16.252585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:31:16.817582] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-08T17:31:17.288255] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T17:31:17.617560] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-08T17:31:17.736343] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T17:31:17.738998] [INFO ] [REMOTE ] BCC: Full fetch complete (41002 records). [2025-10-08T17:31:17.739082] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-08T17:31:18.103952] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-08T17:31:18.104032] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-08T17:31:18.104503] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-08T17:31:18.104543] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-08T17:31:18.105424] [DEBUG] [LOCAL ] BCC: Trimmed 41002 records to 28199 (keeping 200 days of data) [2025-10-08T17:31:18.276296] [DEBUG] [LOCAL ] BCC: Primary data saved (28199 records). [2025-10-08T17:31:18.276430] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-08T17:31:18.276504] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 30.4s. Estimated remaining: 4h 46m 40s. Rate: 7.5 symbols/min [2025-10-08T17:31:18.422662] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-08T17:31:18.450790] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:18.450921] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-08T17:31:18.450977] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-08T17:31:18.451109] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-08T17:31:18.451166] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-08T17:31:18.451215] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-08T17:31:18.451260] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-08T17:31:18.572174] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T17:31:18.590885] [INFO ] [REMOTE ] BCH: Full fetch complete (40728 records). [2025-10-08T17:31:18.601398] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-08T17:31:18.633743] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:31:18.660222] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:31:18.723316] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:31:18.744824] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-08T17:31:18.754965] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-08T17:31:18.755027] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-08T17:31:18.771144] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-10-08T17:31:18.781589] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCH took 21.8s. Estimated remaining: 4h 45m 23s. Rate: 7.5 symbols/min [2025-10-08T17:31:18.912537] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:19.007772] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:19.007989] [DEBUG] [LOCAL ] BCSF: No existing data file found in primary storage. [2025-10-08T17:31:19.008078] [WARN ] [MAIN ] BCSF: No existing data found, performing full refresh instead. [2025-10-08T17:31:19.008197] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-08T17:31:19.008238] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-08T17:31:19.008279] [DEBUG] [LOCAL ] BCSF: No primary data file found to delete. [2025-10-08T17:31:19.008310] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-08T17:31:19.228953] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-08T17:31:19.400030] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:20.017526] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-08T17:31:20.053531] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T17:31:20.098586] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T17:31:20.817572] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-08T17:31:21.083036] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T17:31:21.617539] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-08T17:31:21.810923] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:31:22.417562] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-08T17:31:23.217592] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-08T17:31:23.432914] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T17:31:24.017526] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-08T17:31:24.139801] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T17:31:24.303790] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T17:31:24.817559] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-08T17:31:25.415119] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:31:25.617557] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-08T17:31:26.417545] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-08T17:31:26.521009] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:31:26.628302] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T17:31:27.217559] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-08T17:31:27.950775] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:31:28.017548] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-08T17:31:28.175479] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T17:31:28.817568] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-08T17:31:29.335540] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:31:29.617550] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-08T17:31:30.417691] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-08T17:31:30.619406] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:31:30.625448] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:31:31.217611] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-08T17:31:32.017538] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-08T17:31:32.102460] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T17:31:32.153607] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:31:32.817560] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-08T17:31:33.617582] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-08T17:31:33.931305] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:31:34.417590] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-08T17:31:34.573846] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T17:31:34.737438] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:31:35.217549] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-08T17:31:35.471376] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T17:31:36.017565] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-08T17:31:36.813705] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:31:36.818430] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-08T17:31:36.984897] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T17:31:37.617553] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-08T17:31:37.965272] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T17:31:38.417551] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-08T17:31:39.217549] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-08T17:31:39.702369] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:31:39.908075] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T17:31:40.017537] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-08T17:31:40.381237] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:31:40.817565] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-08T17:31:41.617510] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-08T17:31:41.923368] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:31:42.073617] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T17:31:42.417515] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-08T17:31:42.552549] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T17:31:42.554688] [INFO ] [REMOTE ] BCO: Full fetch complete (36480 records). [2025-10-08T17:31:42.554787] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-08T17:31:43.010915] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-08T17:31:43.010998] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-08T17:31:43.011464] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-08T17:31:43.011529] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-08T17:31:43.012561] [DEBUG] [LOCAL ] BCO: Trimmed 36480 records to 25786 (keeping 200 days of data) [2025-10-08T17:31:43.177188] [DEBUG] [LOCAL ] BCO: Primary data saved (25786 records). [2025-10-08T17:31:43.177326] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-08T17:31:43.177399] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCO took 33.6s. Estimated remaining: 4h 47m 44s. Rate: 7.4 symbols/min [2025-10-08T17:31:43.222790] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-08T17:31:43.347259] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:43.347451] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-10-08T17:31:43.347488] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-10-08T17:31:43.347626] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-08T17:31:43.347754] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-08T17:31:43.347817] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-10-08T17:31:43.347853] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-08T17:31:43.691873] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:44.017578] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-08T17:31:44.194636] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T17:31:44.817531] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-08T17:31:44.907005] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:31:44.910898] [INFO ] [REMOTE ] BCE: Full fetch complete (75956 records). [2025-10-08T17:31:44.911017] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-08T17:31:45.308413] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-08T17:31:45.308608] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-08T17:31:45.309483] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-08T17:31:45.309540] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-08T17:31:45.311093] [DEBUG] [LOCAL ] BCE: Trimmed 75956 records to 52209 (keeping 200 days of data) [2025-10-08T17:31:45.560776] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:31:45.630971] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-08T17:31:45.673823] [DEBUG] [LOCAL ] BCE: Primary data saved (52209 records). [2025-10-08T17:31:45.673970] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-08T17:31:45.674056] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCE took 51.6s. Estimated remaining: 4h 46m 45s. Rate: 7.4 symbols/min [2025-10-08T17:31:45.839680] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:31:45.866021] [DEBUG] [LOCAL ] BDC: Loaded 24590 existing records from primary storage. [2025-10-08T17:31:45.866279] [INFO ] [MAIN ] BDC: Loaded 24590 existing records. [2025-10-08T17:31:46.046704] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:31:46.047139] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-08T17:31:46.047332] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-08T17:31:46.047737] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-08T17:31:46.047799] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-08T17:31:46.252207] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:31:46.425237] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-08T17:31:46.449662] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:31:47.034799] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T17:31:47.217587] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-08T17:31:48.017499] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-08T17:31:48.374419] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T17:31:48.433625] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:31:48.817531] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-08T17:31:49.006363] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T17:31:49.617598] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-08T17:31:50.417512] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-08T17:31:50.794337] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T17:31:50.819304] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:31:51.217602] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-08T17:31:51.391132] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:31:52.017516] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-08T17:31:52.484562] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T17:31:52.817618] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-08T17:31:53.197148] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:31:53.199936] [INFO ] [REMOTE ] BCSF: Full fetch complete (38843 records). [2025-10-08T17:31:53.200023] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-08T17:31:53.584359] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-08T17:31:53.584444] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-08T17:31:53.585000] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-08T17:31:53.585065] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-08T17:31:53.586178] [DEBUG] [LOCAL ] BCSF: Trimmed 38843 records to 27944 (keeping 200 days of data) [2025-10-08T17:31:53.641525] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-08T17:31:53.767740] [DEBUG] [LOCAL ] BCSF: Primary data saved (27944 records). [2025-10-08T17:31:53.767878] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-08T17:31:53.767955] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 35.0s. Estimated remaining: 4h 46m 38s. Rate: 7.4 symbols/min [2025-10-08T17:31:53.789750] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T17:31:54.417569] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-08T17:31:55.217722] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-08T17:31:55.414611] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:31:55.572502] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:31:55.975591] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T17:31:56.017616] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-08T17:31:56.817617] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-08T17:31:57.358354] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:31:57.617552] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-08T17:31:58.417611] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-08T17:31:58.616370] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:31:58.620669] [INFO ] [REMOTE ] BCS: Full fetch complete (77329 records). [2025-10-08T17:31:58.620820] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-08T17:31:59.018734] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:31:59.050239] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-08T17:31:59.050767] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-08T17:31:59.051573] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-08T17:31:59.051617] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-08T17:31:59.053017] [DEBUG] [LOCAL ] BCS: Trimmed 77329 records to 53444 (keeping 200 days of data) [2025-10-08T17:31:59.234981] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-08T17:31:59.394972] [DEBUG] [LOCAL ] BCS: Primary data saved (53444 records). [2025-10-08T17:31:59.395132] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-08T17:31:59.395231] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCS took 41.1s. Estimated remaining: 4h 46m 8s. Rate: 7.5 symbols/min [2025-10-08T17:31:59.470762] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:32:00.017609] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-08T17:32:00.487680] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:32:00.817602] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-08T17:32:00.945844] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:32:01.617579] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-08T17:32:02.023882] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T17:32:02.410790] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T17:32:02.417593] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-08T17:32:03.217545] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-08T17:32:03.260581] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:32:04.017622] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-08T17:32:04.436490] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T17:32:04.817633] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-08T17:32:05.081063] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:32:05.083322] [INFO ] [REMOTE ] BCX: Full fetch complete (33701 records). [2025-10-08T17:32:05.083431] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-08T17:32:05.513710] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-08T17:32:05.513821] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-08T17:32:05.514305] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-08T17:32:05.514366] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-08T17:32:05.515303] [DEBUG] [LOCAL ] BCX: Trimmed 33701 records to 21636 (keeping 200 days of data) [2025-10-08T17:32:05.658710] [DEBUG] [LOCAL ] BCX: Primary data saved (21636 records). [2025-10-08T17:32:05.658901] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-08T17:32:05.659011] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCX took 22.5s. Estimated remaining: 4h 45m 44s. Rate: 7.5 symbols/min [2025-10-08T17:32:05.843923] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:32:05.850072] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-08T17:32:06.731156] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:32:06.736677] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-08T17:32:07.702852] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T17:32:07.704998] [INFO ] [REMOTE ] BDC: Full fetch complete (35933 records). [2025-10-08T17:32:07.705084] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-08T17:32:08.072564] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-08T17:32:08.072667] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-08T17:32:08.073141] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-08T17:32:08.073183] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-08T17:32:08.074076] [DEBUG] [LOCAL ] BDC: Trimmed 35933 records to 24540 (keeping 200 days of data) [2025-10-08T17:32:08.228262] [DEBUG] [LOCAL ] BDC: Primary data saved (24540 records). [2025-10-08T17:32:08.228400] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-08T17:32:08.228506] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 22.6s. Estimated remaining: 4h 44m 47s. Rate: 7.5 symbols/min [2025-10-08T17:32:08.816941] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.907132] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.950790] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:08.998152] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:09.033482] [DEBUG] [LOCAL ] BDJ: Loaded 29018 existing records from primary storage. [2025-10-08T17:32:09.034283] [INFO ] [MAIN ] BDJ: Loaded 29018 existing records. [2025-10-08T17:32:09.212512] [DEBUG] [LOCAL ] BDX: Loaded 52271 existing records from primary storage. [2025-10-08T17:32:09.268751] [INFO ] [MAIN ] BDX: Loaded 52271 existing records. [2025-10-08T17:32:09.362864] [DEBUG] [LOCAL ] BDN: Loaded 47541 existing records from primary storage. [2025-10-08T17:32:09.383466] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-08T17:32:09.400281] [INFO ] [MAIN ] BDN: Loaded 47541 existing records. [2025-10-08T17:32:09.405729] [INFO ] [MAIN ] BE: Loaded 53659 existing records. [2025-10-08T17:32:09.389438] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:09.411309] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-08T17:32:09.500839] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-08T17:32:09.634413] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-08T17:32:09.715779] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-08T17:32:09.826020] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:09.922822] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-08T17:32:09.972298] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-08T17:32:10.007447] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:10.049914] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-08T17:32:10.050772] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-08T17:32:10.050856] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-08T17:32:10.061778] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:10.076461] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-08T17:32:10.091561] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-08T17:32:10.127555] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-08T17:32:10.175529] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-08T17:32:10.237829] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-08T17:32:10.202289] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-08T17:32:10.272951] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-08T17:32:11.033364] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.129404] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-08T17:32:11.279079] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.328205] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-08T17:32:11.457696] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.476268] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-08T17:32:11.503766] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:11.504326] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-08T17:32:12.785349] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T17:32:12.796014] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-08T17:32:12.886730] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:32:12.897634] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-08T17:32:12.960089] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:32:12.971608] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-08T17:32:13.209746] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T17:32:13.221466] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-08T17:32:14.255492] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:32:14.264578] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-08T17:32:14.625000] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:32:14.635284] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-08T17:32:14.727433] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T17:32:14.851735] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:32:15.217549] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-08T17:32:15.428511] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:32:15.780708] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:32:16.017617] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-08T17:32:16.438149] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T17:32:16.817547] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-08T17:32:17.149338] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:32:17.617577] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-08T17:32:18.417520] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-08T17:32:18.549259] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T17:32:19.217572] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-08T17:32:19.258768] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T17:32:19.652144] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:32:20.017556] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-08T17:32:20.817577] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-08T17:32:21.152474] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T17:32:21.187779] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T17:32:21.617561] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-08T17:32:22.261401] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T17:32:22.417586] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-08T17:32:22.502690] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:32:23.217565] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-08T17:32:24.017527] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-08T17:32:24.336523] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T17:32:24.618533] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T17:32:24.817571] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-08T17:32:25.617586] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-08T17:32:25.714945] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:32:26.417538] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-08T17:32:26.481813] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T17:32:27.217536] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-08T17:32:27.701084] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-08T17:32:28.017528] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-08T17:32:28.068956] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:32:28.817543] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-08T17:32:29.011479] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:32:29.617589] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-08T17:32:29.762944] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T17:32:30.039723] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T17:32:30.417617] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-08T17:32:31.225239] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-08T17:32:31.231206] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T17:32:31.474289] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T17:32:32.017563] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-08T17:32:32.817567] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-08T17:32:32.963197] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:32:33.617542] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-08T17:32:33.912568] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-08T17:32:34.027188] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T17:32:34.417569] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-08T17:32:35.038307] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T17:32:35.217510] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-08T17:32:35.494980] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:32:35.497480] [INFO ] [REMOTE ] BDJ: Full fetch complete (42996 records). [2025-10-08T17:32:35.497623] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-08T17:32:35.892050] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-08T17:32:35.892148] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-08T17:32:35.892706] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-08T17:32:35.892770] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-08T17:32:35.893883] [DEBUG] [LOCAL ] BDJ: Trimmed 42996 records to 29178 (keeping 200 days of data) [2025-10-08T17:32:36.036725] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-08T17:32:36.074485] [DEBUG] [LOCAL ] BDJ: Primary data saved (29178 records). [2025-10-08T17:32:36.074674] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-08T17:32:36.074808] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 27.8s. Estimated remaining: 4h 47m 34s. Rate: 7.4 symbols/min [2025-10-08T17:32:36.240755] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:36.240955] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-08T17:32:36.240993] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-08T17:32:36.241102] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-08T17:32:36.241142] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-08T17:32:36.241182] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-08T17:32:36.241214] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-08T17:32:36.592336] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:36.817597] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-08T17:32:37.600456] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-08T17:32:37.617507] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-08T17:32:38.072396] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:32:38.326399] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T17:32:38.417550] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-08T17:32:39.218538] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-08T17:32:39.786811] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:32:39.792717] [INFO ] [REMOTE ] BDN: Full fetch complete (69255 records). [2025-10-08T17:32:39.792921] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-08T17:32:39.916373] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T17:32:40.024624] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-08T17:32:40.149997] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T17:32:40.259106] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-08T17:32:40.259247] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-08T17:32:40.260059] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-08T17:32:40.260163] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-08T17:32:40.261726] [DEBUG] [LOCAL ] BDN: Trimmed 69255 records to 47560 (keeping 200 days of data) [2025-10-08T17:32:40.538241] [DEBUG] [LOCAL ] BDN: Primary data saved (47560 records). [2025-10-08T17:32:40.538376] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-08T17:32:40.538497] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 32.3s. Estimated remaining: 4h 46m 54s. Rate: 7.4 symbols/min [2025-10-08T17:32:40.705586] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:40.757488] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-08T17:32:40.757879] [INFO ] [MAIN ] BEKE: Loaded 53231 existing records. [2025-10-08T17:32:40.822963] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-08T17:32:40.935667] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:40.935871] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-08T17:32:40.935917] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-08T17:32:40.936125] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-08T17:32:40.936183] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-08T17:32:41.289077] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:41.570144] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T17:32:41.617595] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-08T17:32:42.417567] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-08T17:32:42.702619] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-08T17:32:43.217564] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-08T17:32:43.280352] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T17:32:43.303018] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-08T17:32:43.307537] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-08T17:32:43.307777] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-08T17:32:43.603923] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T17:32:43.733013] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-08T17:32:43.733140] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-08T17:32:43.734086] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-08T17:32:43.734153] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-08T17:32:43.735970] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 53659 (keeping 200 days of data) [2025-10-08T17:32:44.032333] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-08T17:32:44.058072] [DEBUG] [LOCAL ] BE: Primary data saved (53659 records). [2025-10-08T17:32:44.058169] [INFO ] [MAIN ] BE: Full history saved. [2025-10-08T17:32:44.059071] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BE took 35.8s. Estimated remaining: 4h 46m 6s. Rate: 7.4 symbols/min [2025-10-08T17:32:44.227964] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:44.279300] [DEBUG] [LOCAL ] BEN: Loaded 53046 existing records from primary storage. [2025-10-08T17:32:44.279638] [INFO ] [MAIN ] BEN: Loaded 53046 existing records. [2025-10-08T17:32:44.442706] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:32:44.462191] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:44.463598] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-08T17:32:44.463687] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-08T17:32:44.463995] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-08T17:32:44.464051] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-08T17:32:44.817839] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-08T17:32:44.817719] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:45.617600] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-08T17:32:46.417535] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-08T17:32:46.494451] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:32:46.498919] [INFO ] [REMOTE ] BDX: Full fetch complete (75600 records). [2025-10-08T17:32:46.499125] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-08T17:32:46.801953] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-08T17:32:46.927252] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-08T17:32:46.927372] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-08T17:32:46.928522] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-08T17:32:46.928600] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-08T17:32:46.930683] [DEBUG] [LOCAL ] BDX: Trimmed 75600 records to 52250 (keeping 200 days of data) [2025-10-08T17:32:47.217615] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-08T17:32:47.305445] [DEBUG] [LOCAL ] BDX: Primary data saved (52250 records). [2025-10-08T17:32:47.305722] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-08T17:32:47.307337] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BDX took 39.1s. Estimated remaining: 4h 45m 16s. Rate: 7.5 symbols/min [2025-10-08T17:32:47.520077] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:47.582278] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T17:32:47.586717] [DEBUG] [LOCAL ] BEP: Loaded 38827 existing records from primary storage. [2025-10-08T17:32:47.587356] [INFO ] [MAIN ] BEP: Loaded 38827 existing records. [2025-10-08T17:32:47.833828] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T17:32:47.859741] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:32:47.872913] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-08T17:32:47.873046] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-08T17:32:47.873384] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-08T17:32:47.873446] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-08T17:32:48.022739] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-08T17:32:48.327375] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:48.395497] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-08T17:32:48.817566] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-08T17:32:49.056459] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-08T17:32:49.617599] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-08T17:32:49.913998] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-08T17:32:50.417547] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-08T17:32:50.803090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T17:32:51.217572] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-08T17:32:52.017581] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-08T17:32:52.631443] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:32:52.632319] [INFO ] [REMOTE ] BEDU: Full fetch complete (1403 records). [2025-10-08T17:32:52.632391] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-08T17:32:52.782196] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:32:52.817622] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-08T17:32:52.846139] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-08T17:32:52.847028] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:32:52.847099] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:32:52.847174] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-08T17:32:52.847234] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-08T17:32:52.847271] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-08T17:32:52.847328] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-08T17:32:52.847419] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 16.8s. Estimated remaining: 4h 44m 46s. Rate: 7.5 symbols/min [2025-10-08T17:32:53.018508] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:32:53.018803] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-08T17:32:53.018859] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-08T17:32:53.018974] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-08T17:32:53.019017] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-08T17:32:53.019058] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-08T17:32:53.019089] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-08T17:32:53.366281] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:32:53.617498] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-08T17:32:54.417594] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-08T17:32:54.746493] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T17:32:55.205456] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T17:32:55.218806] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-08T17:32:56.017584] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-08T17:32:56.242444] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:32:56.505933] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:32:56.817697] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-08T17:32:57.615734] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T17:32:57.631154] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-08T17:32:57.865008] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:32:58.417563] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-08T17:32:59.217571] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-08T17:32:59.365532] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:32:59.895771] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T17:33:00.017556] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-08T17:33:00.179556] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:33:00.817563] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-08T17:33:01.617567] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-08T17:33:01.777099] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T17:33:02.317802] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:33:02.417568] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-08T17:33:03.217558] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-08T17:33:03.495120] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T17:33:04.017982] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-08T17:33:04.019633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:33:04.819303] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-08T17:33:04.822899] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T17:33:05.617515] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-08T17:33:05.810858] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:33:06.422665] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-08T17:33:06.444205] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T17:33:06.820746] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T17:33:07.217556] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-08T17:33:07.780431] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:33:08.017563] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-08T17:33:08.737809] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:33:08.817561] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-08T17:33:09.229474] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:33:09.617559] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-08T17:33:09.921751] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:33:10.417551] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-08T17:33:11.217515] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-08T17:33:11.461573] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:33:12.005098] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:33:12.017494] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-08T17:33:12.817583] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-08T17:33:13.111409] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T17:33:13.402525] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:33:13.617518] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-08T17:33:14.334861] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:33:14.417550] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-08T17:33:15.217567] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-08T17:33:15.557744] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T17:33:15.964046] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:33:16.017535] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-08T17:33:16.562049] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:33:16.817570] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-08T17:33:17.259781] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:33:17.617565] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-08T17:33:18.417571] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-08T17:33:18.490034] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:33:19.028370] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:33:19.217549] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-08T17:33:20.017549] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-08T17:33:20.244362] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:33:20.817514] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-08T17:33:21.018154] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:33:21.083210] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:33:21.617566] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-08T17:33:22.422658] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-08T17:33:22.439906] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T17:33:22.836082] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:33:23.217550] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-08T17:33:23.320827] [DEBUG] [REMOTE ] BEPC: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T17:33:23.321146] [WARN ] [REMOTE ] BEPC: No data returned for month 2025-10 [2025-10-08T17:33:23.321233] [FATAL] [REMOTE ] BEPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:33:23.321340] [FATAL] [MAIN ] BEPC: Failed to fetch primary data. [2025-10-08T17:33:23.321419] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:33:23.321504] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-08T17:33:23.321611] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-08T17:33:23.321707] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-08T17:33:23.321798] [DEBUG] [LOCAL ] BEPC: No derivative data file found to delete. [2025-10-08T17:33:23.321900] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEPC took 30.5s. Estimated remaining: 4h 47m 52s. Rate: 7.4 symbols/min [2025-10-08T17:33:23.497039] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:23.505626] [DEBUG] [LOCAL ] BEPH: Loaded 5357 existing records from primary storage. [2025-10-08T17:33:23.505907] [INFO ] [MAIN ] BEPH: Loaded 5357 existing records. [2025-10-08T17:33:23.690527] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:23.690903] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-08T17:33:23.690999] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-08T17:33:23.691264] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-08T17:33:23.691338] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-08T17:33:23.791744] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:33:23.819108] [INFO ] [REMOTE ] BEP: Full fetch complete (58643 records). [2025-10-08T17:33:23.834735] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-08T17:33:24.034213] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-08T17:33:24.253856] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:24.493071] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-08T17:33:24.493162] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-08T17:33:24.493784] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-08T17:33:24.493846] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-08T17:33:24.494999] [DEBUG] [LOCAL ] BEP: Trimmed 58643 records to 38922 (keeping 200 days of data) [2025-10-08T17:33:24.728905] [DEBUG] [LOCAL ] BEP: Primary data saved (38922 records). [2025-10-08T17:33:24.729047] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-08T17:33:24.729132] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 37.4s. Estimated remaining: 4h 46m 46s. Rate: 7.4 symbols/min [2025-10-08T17:33:24.825506] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-08T17:33:24.898156] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:24.903975] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-08T17:33:24.904125] [INFO ] [MAIN ] BEPI: Loaded 3587 existing records. [2025-10-08T17:33:25.077315] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:25.077560] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-08T17:33:25.077613] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-08T17:33:25.077803] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-08T17:33:25.077860] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-08T17:33:25.428958] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:25.559234] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:33:25.617595] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-08T17:33:25.996271] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T17:33:26.128094] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T17:33:26.417597] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-08T17:33:27.217594] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-08T17:33:27.795226] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T17:33:27.897214] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T17:33:27.902240] [INFO ] [REMOTE ] BEKE: Full fetch complete (77189 records). [2025-10-08T17:33:27.902388] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-08T17:33:28.022748] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-08T17:33:28.329028] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-08T17:33:28.329122] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-08T17:33:28.330003] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-08T17:33:28.330073] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-08T17:33:28.331683] [DEBUG] [LOCAL ] BEKE: Trimmed 77189 records to 53231 (keeping 200 days of data) [2025-10-08T17:33:28.546298] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T17:33:28.663866] [DEBUG] [LOCAL ] BEKE: Primary data saved (53231 records). [2025-10-08T17:33:28.664038] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-08T17:33:28.664143] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 48.1s. Estimated remaining: 4h 46m 2s. Rate: 7.4 symbols/min [2025-10-08T17:33:28.823587] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-08T17:33:28.846170] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:28.853188] [DEBUG] [LOCAL ] BEPJ: Loaded 3141 existing records from primary storage. [2025-10-08T17:33:28.853381] [INFO ] [MAIN ] BEPJ: Loaded 3141 existing records. [2025-10-08T17:33:29.031928] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:29.032201] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-08T17:33:29.032251] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-08T17:33:29.032420] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-08T17:33:29.032476] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-08T17:33:29.389866] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:29.547217] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T17:33:29.617574] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-08T17:33:30.164413] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T17:33:30.417550] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-08T17:33:31.217634] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-08T17:33:31.689412] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:33:31.698391] [INFO ] [REMOTE ] BEN: Full fetch complete (76522 records). [2025-10-08T17:33:31.699085] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-08T17:33:31.700567] [FATAL] [VALIDATOR ] BEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:33:31.700748] [FATAL] [MAIN ] BEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:33:31.700817] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:33:31.702612] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-08T17:33:31.702768] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-08T17:33:31.702840] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-10-08T17:33:31.703130] [DEBUG] [LOCAL ] BEN: Deleted derivative data file. [2025-10-08T17:33:31.703426] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEN took 47.6s. Estimated remaining: 4h 45m 11s. Rate: 7.4 symbols/min [2025-10-08T17:33:31.915942] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T17:33:31.949321] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:31.995335] [DEBUG] [LOCAL ] BFAM: Loaded 33486 existing records from primary storage. [2025-10-08T17:33:31.995794] [INFO ] [MAIN ] BFAM: Loaded 33486 existing records. [2025-10-08T17:33:32.022705] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-08T17:33:32.208019] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:32.208270] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-08T17:33:32.208318] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-08T17:33:32.208580] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-08T17:33:32.208639] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-08T17:33:32.564773] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:33:32.593865] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:32.817544] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-08T17:33:33.617689] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-08T17:33:34.254697] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:33:34.417554] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-08T17:33:34.929163] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:33:34.999792] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:33:35.217547] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-08T17:33:35.634581] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T17:33:36.017599] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-08T17:33:36.614369] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:33:36.817594] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-08T17:33:37.380046] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T17:33:37.617573] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-08T17:33:38.205110] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T17:33:38.417580] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-08T17:33:38.972697] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:33:39.217561] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-08T17:33:39.843892] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:33:40.017551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-08T17:33:40.581406] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T17:33:40.817514] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-08T17:33:41.290781] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T17:33:41.617554] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-08T17:33:42.076115] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-08T17:33:42.417537] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-08T17:33:43.049092] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T17:33:43.217607] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-08T17:33:44.017565] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-08T17:33:44.433482] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T17:33:44.639397] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:33:44.817575] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-08T17:33:45.617551] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-08T17:33:46.154868] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:33:46.222194] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T17:33:46.417580] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-08T17:33:46.925146] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T17:33:47.217571] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-08T17:33:48.017598] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-08T17:33:48.364167] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:33:48.624664] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T17:33:48.817569] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-08T17:33:49.617585] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-08T17:33:49.888424] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:33:50.115076] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T17:33:50.417548] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-08T17:33:50.961018] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T17:33:51.217581] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-08T17:33:52.017569] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-08T17:33:52.572527] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:33:52.817529] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-08T17:33:52.889199] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:33:53.617560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-08T17:33:53.962752] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:33:54.185661] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T17:33:54.417560] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-08T17:33:55.186325] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:33:55.187406] [INFO ] [REMOTE ] BEPH: Full fetch complete (7648 records). [2025-10-08T17:33:55.187478] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-08T17:33:55.222773] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-08T17:33:55.558134] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-08T17:33:55.558216] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-08T17:33:55.558433] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-08T17:33:55.558503] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-08T17:33:55.558951] [DEBUG] [LOCAL ] BEPH: Trimmed 7648 records to 5349 (keeping 200 days of data) [2025-10-08T17:33:55.590889] [DEBUG] [LOCAL ] BEPH: Primary data saved (5349 records). [2025-10-08T17:33:55.590976] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-08T17:33:55.591051] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 32.3s. Estimated remaining: 4h 47m 17s. Rate: 7.4 symbols/min [2025-10-08T17:33:55.766919] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:55.770336] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:33:55.810002] [DEBUG] [LOCAL ] BFH: Loaded 41518 existing records from primary storage. [2025-10-08T17:33:55.810309] [INFO ] [MAIN ] BFH: Loaded 41518 existing records. [2025-10-08T17:33:55.988498] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:55.988729] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-08T17:33:55.988783] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-08T17:33:55.989117] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-08T17:33:55.989175] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-08T17:33:56.022634] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-08T17:33:56.349242] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:56.643281] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:33:56.644407] [INFO ] [REMOTE ] BEPI: Full fetch complete (4849 records). [2025-10-08T17:33:56.644502] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-08T17:33:56.818288] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-08T17:33:57.027639] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-08T17:33:57.027753] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-08T17:33:57.027907] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-08T17:33:57.027946] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-08T17:33:57.028329] [DEBUG] [LOCAL ] BEPI: Trimmed 4849 records to 3606 (keeping 200 days of data) [2025-10-08T17:33:57.051306] [DEBUG] [LOCAL ] BEPI: Primary data saved (3606 records). [2025-10-08T17:33:57.051440] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-08T17:33:57.051526] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPI took 32.3s. Estimated remaining: 4h 46m 13s. Rate: 7.4 symbols/min [2025-10-08T17:33:57.226348] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:33:57.241706] [DEBUG] [LOCAL ] BFK: Loaded 13628 existing records from primary storage. [2025-10-08T17:33:57.241969] [INFO ] [MAIN ] BFK: Loaded 13628 existing records. [2025-10-08T17:33:57.422222] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:33:57.422456] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-08T17:33:57.422586] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-08T17:33:57.422812] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-08T17:33:57.422872] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-08T17:33:57.624063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-08T17:33:57.783833] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:33:58.258721] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:33:58.417572] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-08T17:33:58.714132] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T17:33:58.725307] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T17:33:59.217608] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-08T17:34:00.017584] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-08T17:34:00.359549] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:34:00.817553] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-08T17:34:01.605234] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:34:01.617499] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-08T17:34:01.757530] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:34:02.417548] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-08T17:34:02.836916] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:34:03.217575] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-08T17:34:03.894329] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:34:04.017510] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-08T17:34:04.459882] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:34:04.462803] [INFO ] [REMOTE ] BFAM: Full fetch complete (47031 records). [2025-10-08T17:34:04.462926] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-08T17:34:04.819630] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-08T17:34:04.830066] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T17:34:04.872155] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-08T17:34:04.872252] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-08T17:34:04.872877] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-08T17:34:04.872972] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-08T17:34:04.874245] [DEBUG] [LOCAL ] BFAM: Trimmed 47031 records to 33473 (keeping 200 days of data) [2025-10-08T17:34:05.073872] [DEBUG] [LOCAL ] BFAM: Primary data saved (33473 records). [2025-10-08T17:34:05.074021] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-08T17:34:05.074108] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BFAM took 33.4s. Estimated remaining: 4h 46m 4s. Rate: 7.4 symbols/min [2025-10-08T17:34:05.247002] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:05.318989] [DEBUG] [LOCAL ] BFLY: Loaded 51810 existing records from primary storage. [2025-10-08T17:34:05.319328] [INFO ] [MAIN ] BFLY: Loaded 51810 existing records. [2025-10-08T17:34:05.502233] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:05.502839] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-08T17:34:05.502951] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-08T17:34:05.503323] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-08T17:34:05.503383] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-08T17:34:05.622806] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-08T17:34:05.871376] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:06.417549] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-08T17:34:06.439388] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:34:06.545207] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T17:34:06.907485] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:34:06.908243] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4471 records). [2025-10-08T17:34:06.908314] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-08T17:34:07.222637] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-08T17:34:07.285175] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-08T17:34:07.285253] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-08T17:34:07.285394] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-08T17:34:07.285430] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-08T17:34:07.285825] [DEBUG] [LOCAL ] BEPJ: Trimmed 4471 records to 3132 (keeping 200 days of data) [2025-10-08T17:34:07.305521] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3132 records). [2025-10-08T17:34:07.305615] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-08T17:34:07.305724] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BEPJ took 38.6s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-08T17:34:07.474362] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:07.485201] [DEBUG] [LOCAL ] BFS: Loaded 9327 existing records from primary storage. [2025-10-08T17:34:07.485406] [INFO ] [MAIN ] BFS: Loaded 9327 existing records. [2025-10-08T17:34:07.660729] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:07.660992] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-08T17:34:07.661055] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-08T17:34:07.661255] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-08T17:34:07.661314] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-08T17:34:08.023626] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-08T17:34:08.023541] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:08.786999] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:34:08.817505] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-08T17:34:09.081994] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:34:09.553659] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T17:34:09.617506] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-08T17:34:10.417571] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-08T17:34:11.039600] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T17:34:11.217529] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-08T17:34:11.314676] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T17:34:12.017613] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-08T17:34:12.626697] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T17:34:12.641527] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T17:34:12.817611] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-08T17:34:13.617566] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-08T17:34:14.417515] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-08T17:34:14.479542] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T17:34:14.520354] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:34:15.217549] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-08T17:34:16.017522] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-08T17:34:16.239437] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T17:34:16.275617] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:34:16.817531] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-08T17:34:16.900314] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:34:17.617614] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-08T17:34:18.417567] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-08T17:34:18.484682] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T17:34:18.652218] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:34:19.080499] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T17:34:19.217533] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-08T17:34:20.017612] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-08T17:34:20.616427] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:34:20.632583] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T17:34:20.817543] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-08T17:34:21.502620] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:34:21.617518] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-08T17:34:22.417579] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-08T17:34:23.029683] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:34:23.217545] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-08T17:34:23.353295] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:34:23.906447] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:34:24.017584] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-08T17:34:24.786250] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T17:34:24.817502] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-08T17:34:25.511204] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T17:34:25.513002] [INFO ] [REMOTE ] BFS: Full fetch complete (12725 records). [2025-10-08T17:34:25.513074] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-08T17:34:25.513830] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:34:25.513976] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:34:25.514043] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:34:25.514089] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-08T17:34:25.514345] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-08T17:34:25.514410] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-08T17:34:25.515036] [DEBUG] [LOCAL ] BFS: Deleted derivative data file. [2025-10-08T17:34:25.515125] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFS took 18.2s. Estimated remaining: 4h 46m 23s. Rate: 7.4 symbols/min [2025-10-08T17:34:25.622686] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-08T17:34:25.687549] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:25.702913] [DEBUG] [LOCAL ] BFZ: Loaded 11914 existing records from primary storage. [2025-10-08T17:34:25.703596] [INFO ] [MAIN ] BFZ: Loaded 11914 existing records. [2025-10-08T17:34:25.877403] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:25.877606] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-08T17:34:25.877680] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-08T17:34:25.877964] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-08T17:34:25.878021] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-08T17:34:26.235253] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:26.417558] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-08T17:34:27.217544] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-08T17:34:27.290208] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T17:34:27.313253] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T17:34:28.017532] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-08T17:34:28.183966] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T17:34:28.817569] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-08T17:34:29.617613] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-08T17:34:29.678055] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:34:29.714631] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:34:30.417560] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-08T17:34:31.217610] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-08T17:34:31.262821] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:34:31.311477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:34:31.780677] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T17:34:32.017578] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-08T17:34:32.817602] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-08T17:34:33.611702] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:34:33.617444] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-08T17:34:33.645236] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:34:34.304474] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:34:34.417762] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-08T17:34:35.217558] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-08T17:34:35.841417] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:34:36.017527] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-08T17:34:36.489589] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T17:34:36.817577] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-08T17:34:36.867428] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T17:34:36.868991] [INFO ] [REMOTE ] BFK: Full fetch complete (19105 records). [2025-10-08T17:34:36.869084] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-08T17:34:37.261416] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-08T17:34:37.261501] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-08T17:34:37.261862] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-08T17:34:37.261923] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-08T17:34:37.262515] [DEBUG] [LOCAL ] BFK: Trimmed 19105 records to 13712 (keeping 200 days of data) [2025-10-08T17:34:37.344328] [DEBUG] [LOCAL ] BFK: Primary data saved (13712 records). [2025-10-08T17:34:37.344490] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-08T17:34:37.344577] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 40.3s. Estimated remaining: 4h 46m 46s. Rate: 7.4 symbols/min [2025-10-08T17:34:37.509635] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:37.554841] [DEBUG] [LOCAL ] BG: Loaded 50444 existing records from primary storage. [2025-10-08T17:34:37.555166] [INFO ] [MAIN ] BG: Loaded 50444 existing records. [2025-10-08T17:34:37.627063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-08T17:34:37.732424] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:37.732679] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-08T17:34:37.732743] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-08T17:34:37.732981] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-08T17:34:37.733040] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-08T17:34:38.083610] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:38.417517] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-08T17:34:38.663746] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T17:34:38.837029] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T17:34:39.217581] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-08T17:34:39.927351] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:34:40.017615] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-08T17:34:40.817562] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-08T17:34:40.864166] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:34:41.381716] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:34:41.617562] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-08T17:34:42.417524] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-08T17:34:42.464348] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:34:42.564373] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:34:43.217594] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-08T17:34:44.017544] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-08T17:34:44.280082] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T17:34:44.284246] [INFO ] [REMOTE ] BFLY: Full fetch complete (75302 records). [2025-10-08T17:34:44.284392] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-08T17:34:44.700200] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-08T17:34:44.700380] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-08T17:34:44.701280] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-08T17:34:44.701347] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-08T17:34:44.703103] [DEBUG] [LOCAL ] BFLY: Trimmed 75302 records to 51825 (keeping 200 days of data) [2025-10-08T17:34:44.817537] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-08T17:34:45.014856] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:34:45.021180] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T17:34:45.047409] [DEBUG] [LOCAL ] BFLY: Primary data saved (51825 records). [2025-10-08T17:34:45.047542] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-08T17:34:45.047624] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 40.0s. Estimated remaining: 4h 46m 34s. Rate: 7.4 symbols/min [2025-10-08T17:34:45.213808] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:45.232476] [DEBUG] [LOCAL ] BGB: Loaded 17853 existing records from primary storage. [2025-10-08T17:34:45.232756] [INFO ] [MAIN ] BGB: Loaded 17853 existing records. [2025-10-08T17:34:45.410621] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:45.410928] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-08T17:34:45.410996] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-08T17:34:45.411155] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-08T17:34:45.411193] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-08T17:34:45.622803] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-08T17:34:45.764769] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:46.058030] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:34:46.061202] [INFO ] [REMOTE ] BFH: Full fetch complete (59735 records). [2025-10-08T17:34:46.061294] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-08T17:34:46.424441] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-08T17:34:46.444352] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-08T17:34:46.444436] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-08T17:34:46.445110] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-08T17:34:46.445176] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-08T17:34:46.446461] [DEBUG] [LOCAL ] BFH: Trimmed 59735 records to 41446 (keeping 200 days of data) [2025-10-08T17:34:46.699053] [DEBUG] [LOCAL ] BFH: Primary data saved (41446 records). [2025-10-08T17:34:46.699181] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-08T17:34:46.699272] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFH took 51.1s. Estimated remaining: 4h 45m 33s. Rate: 7.4 symbols/min [2025-10-08T17:34:46.864556] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:46.864760] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-08T17:34:46.864804] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-08T17:34:46.864912] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-08T17:34:46.864954] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-08T17:34:46.864999] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-08T17:34:46.865031] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-08T17:34:47.221557] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-08T17:34:47.259145] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:47.356300] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:34:47.422768] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:34:48.017502] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-08T17:34:48.406964] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:34:48.817514] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-08T17:34:49.005001] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:34:49.511344] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:34:49.617628] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-08T17:34:50.417589] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-08T17:34:50.462902] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T17:34:51.217557] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-08T17:34:52.017527] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-08T17:34:52.215571] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T17:34:52.238225] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:34:52.805604] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:34:52.817489] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-08T17:34:53.617524] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-08T17:34:53.794687] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:34:54.417547] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-08T17:34:55.053403] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T17:34:55.217552] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-08T17:34:55.487355] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T17:34:55.915451] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T17:34:56.017576] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-08T17:34:56.817522] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-08T17:34:56.878227] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T17:34:56.879566] [INFO ] [REMOTE ] BFZ: Full fetch complete (17788 records). [2025-10-08T17:34:56.879680] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-08T17:34:57.305664] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-08T17:34:57.305754] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-08T17:34:57.306098] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-08T17:34:57.306160] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-08T17:34:57.306732] [DEBUG] [LOCAL ] BFZ: Trimmed 17788 records to 11932 (keeping 200 days of data) [2025-10-08T17:34:57.388791] [DEBUG] [LOCAL ] BFZ: Primary data saved (11932 records). [2025-10-08T17:34:57.388926] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-08T17:34:57.389032] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 31.9s. Estimated remaining: 4h 45m 46s. Rate: 7.4 symbols/min [2025-10-08T17:34:57.558687] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:34:57.575229] [DEBUG] [LOCAL ] BGR: Loaded 13482 existing records from primary storage. [2025-10-08T17:34:57.575490] [INFO ] [MAIN ] BGR: Loaded 13482 existing records. [2025-10-08T17:34:57.618608] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-08T17:34:57.757984] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:34:57.758339] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-08T17:34:57.758394] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-08T17:34:57.758702] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-08T17:34:57.768586] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-08T17:34:57.812287] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T17:34:58.131040] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:34:58.417560] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-08T17:34:59.143397] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:34:59.217516] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-08T17:34:59.253572] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:35:00.017569] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-08T17:35:00.122056] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:35:00.817608] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-08T17:35:01.031470] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:35:01.542828] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T17:35:01.617618] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-08T17:35:02.417580] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-08T17:35:02.477985] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T17:35:03.151435] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T17:35:03.217562] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-08T17:35:04.017517] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-08T17:35:04.217806] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:35:04.817572] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-08T17:35:05.617607] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-08T17:35:05.800547] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:35:05.870864] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:35:06.417589] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-08T17:35:06.652378] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:35:07.217553] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-08T17:35:08.017537] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-08T17:35:08.057741] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:35:08.103685] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T17:35:08.817611] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-08T17:35:09.256705] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:35:09.625070] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-08T17:35:09.627982] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T17:35:10.417549] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-08T17:35:11.217528] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-08T17:35:11.389447] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:35:11.428746] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T17:35:12.017577] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-08T17:35:12.259385] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T17:35:12.817549] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-08T17:35:12.935115] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T17:35:13.617528] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-08T17:35:13.781122] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T17:35:14.417056] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:35:14.421038] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-08T17:35:15.217530] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-08T17:35:15.398543] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:35:15.400861] [INFO ] [REMOTE ] BGH: Full fetch complete (22703 records). [2025-10-08T17:35:15.400938] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-08T17:35:15.792577] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-08T17:35:15.792784] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-08T17:35:15.793338] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-08T17:35:15.793428] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-08T17:35:15.794525] [DEBUG] [LOCAL ] BGH: Trimmed 22703 records to 17188 (keeping 200 days of data) [2025-10-08T17:35:15.910492] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T17:35:15.931717] [DEBUG] [LOCAL ] BGH: Primary data saved (17188 records). [2025-10-08T17:35:15.931906] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-08T17:35:15.931991] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 29.2s. Estimated remaining: 4h 47m 3s. Rate: 7.4 symbols/min [2025-10-08T17:35:16.023025] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-08T17:35:16.233768] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:16.296814] [DEBUG] [LOCAL ] BGS: Loaded 50456 existing records from primary storage. [2025-10-08T17:35:16.297312] [INFO ] [MAIN ] BGS: Loaded 50456 existing records. [2025-10-08T17:35:16.588695] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:16.589037] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-08T17:35:16.589113] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-08T17:35:16.589542] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-08T17:35:16.589613] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-08T17:35:16.822993] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-08T17:35:16.984769] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T17:35:17.047954] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:17.617553] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-08T17:35:17.927179] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T17:35:17.929674] [INFO ] [REMOTE ] BGB: Full fetch complete (27067 records). [2025-10-08T17:35:17.929943] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-08T17:35:18.316444] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-08T17:35:18.316582] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-08T17:35:18.317424] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-08T17:35:18.317513] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-08T17:35:18.318626] [DEBUG] [LOCAL ] BGB: Trimmed 27067 records to 17893 (keeping 200 days of data) [2025-10-08T17:35:18.417777] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-08T17:35:18.433765] [DEBUG] [LOCAL ] BGB: Primary data saved (17893 records). [2025-10-08T17:35:18.433912] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-08T17:35:18.434000] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 33.4s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-08T17:35:18.601509] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:18.611364] [DEBUG] [LOCAL ] BGSF: Loaded 7706 existing records from primary storage. [2025-10-08T17:35:18.611551] [INFO ] [MAIN ] BGSF: Loaded 7706 existing records. [2025-10-08T17:35:18.827670] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:18.828061] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-08T17:35:18.828131] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-08T17:35:18.828315] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-08T17:35:18.828373] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-08T17:35:19.201279] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:19.217494] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-08T17:35:19.236211] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:35:19.331980] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T17:35:19.335932] [INFO ] [REMOTE ] BG: Full fetch complete (72747 records). [2025-10-08T17:35:19.336095] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-08T17:35:19.742086] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-08T17:35:19.742166] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-08T17:35:19.742889] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-08T17:35:19.742951] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-08T17:35:19.744270] [DEBUG] [LOCAL ] BG: Trimmed 72747 records to 50428 (keeping 200 days of data) [2025-10-08T17:35:19.968582] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:35:20.025683] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-08T17:35:20.061507] [DEBUG] [LOCAL ] BG: Primary data saved (50428 records). [2025-10-08T17:35:20.061667] [INFO ] [MAIN ] BG: Full history saved. [2025-10-08T17:35:20.061773] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BG took 42.7s. Estimated remaining: 4h 45m 8s. Rate: 7.4 symbols/min [2025-10-08T17:35:20.232126] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:20.232275] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-10-08T17:35:20.232321] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-10-08T17:35:20.232430] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-08T17:35:20.232470] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-08T17:35:20.232510] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-10-08T17:35:20.232540] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-08T17:35:20.576802] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:20.583789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T17:35:20.817552] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-08T17:35:21.617548] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-08T17:35:21.697860] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:35:22.417553] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-08T17:35:23.217527] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-08T17:35:23.301362] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:35:23.348692] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:35:24.017572] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-08T17:35:24.352202] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T17:35:24.676396] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T17:35:24.677838] [INFO ] [REMOTE ] BGR: Full fetch complete (20159 records). [2025-10-08T17:35:24.677927] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-08T17:35:24.825495] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-08T17:35:25.054083] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-08T17:35:25.054163] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-08T17:35:25.054482] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-08T17:35:25.054522] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-08T17:35:25.055100] [DEBUG] [LOCAL ] BGR: Trimmed 20159 records to 13572 (keeping 200 days of data) [2025-10-08T17:35:25.138401] [DEBUG] [LOCAL ] BGR: Primary data saved (13572 records). [2025-10-08T17:35:25.138584] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-08T17:35:25.138704] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 27.7s. Estimated remaining: 4h 44m 36s. Rate: 7.4 symbols/min [2025-10-08T17:35:25.307405] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:25.310439] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T17:35:25.322523] [DEBUG] [LOCAL ] BGX: Loaded 11063 existing records from primary storage. [2025-10-08T17:35:25.322775] [INFO ] [MAIN ] BGX: Loaded 11063 existing records. [2025-10-08T17:35:25.501200] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:25.501427] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-08T17:35:25.501474] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-08T17:35:25.501695] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-08T17:35:25.501759] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-08T17:35:25.622695] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-08T17:35:25.871909] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:26.417556] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-08T17:35:27.217613] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-08T17:35:27.304416] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:35:27.348709] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:35:27.941460] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:35:28.017537] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-08T17:35:28.817566] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-08T17:35:29.617551] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-08T17:35:29.665475] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T17:35:29.840469] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:35:30.377085] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T17:35:30.417543] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-08T17:35:31.217600] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-08T17:35:31.925296] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T17:35:32.011136] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:35:32.017489] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-08T17:35:32.817529] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-08T17:35:32.897426] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T17:35:33.617555] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-08T17:35:34.309605] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T17:35:34.417558] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-08T17:35:34.595000] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:35:35.217548] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-08T17:35:35.297753] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:35:36.017555] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-08T17:35:36.333935] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:35:36.655089] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:35:36.817563] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-08T17:35:37.267991] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T17:35:37.617561] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-08T17:35:38.417567] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-08T17:35:38.617274] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:35:39.191869] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:35:39.217516] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-08T17:35:39.680463] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:35:40.017601] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-08T17:35:40.817564] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-08T17:35:41.015313] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T17:35:41.617561] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-08T17:35:42.175037] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:35:42.207524] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:35:42.417537] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-08T17:35:43.193516] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T17:35:43.217496] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-08T17:35:43.799781] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T17:35:44.017576] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-08T17:35:44.817522] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-08T17:35:45.116687] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T17:35:45.617581] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-08T17:35:46.356048] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T17:35:46.417541] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-08T17:35:46.486489] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:35:47.217526] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-08T17:35:47.366376] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:35:48.015865] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T17:35:48.018384] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-08T17:35:48.817621] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-08T17:35:49.617517] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-08T17:35:49.688712] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:35:49.748633] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:35:50.417571] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-08T17:35:51.021541] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T17:35:51.035105] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T17:35:51.037607] [INFO ] [REMOTE ] BGX: Full fetch complete (16339 records). [2025-10-08T17:35:51.037730] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-08T17:35:51.218715] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-08T17:35:51.430029] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-08T17:35:51.430109] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-08T17:35:51.430421] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-08T17:35:51.430461] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-08T17:35:51.431018] [DEBUG] [LOCAL ] BGX: Trimmed 16339 records to 11113 (keeping 200 days of data) [2025-10-08T17:35:51.498702] [DEBUG] [LOCAL ] BGX: Primary data saved (11113 records). [2025-10-08T17:35:51.498836] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-08T17:35:51.498931] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGX took 26.4s. Estimated remaining: 4h 46m 54s. Rate: 7.3 symbols/min [2025-10-08T17:35:51.680141] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:51.702636] [DEBUG] [LOCAL ] BGY: Loaded 22024 existing records from primary storage. [2025-10-08T17:35:51.702968] [INFO ] [MAIN ] BGY: Loaded 22024 existing records. [2025-10-08T17:35:51.886943] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:51.887225] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-08T17:35:51.887287] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-08T17:35:51.887514] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-08T17:35:51.887573] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-08T17:35:52.027285] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-08T17:35:52.295111] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:52.305806] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:35:52.817578] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-08T17:35:53.338711] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:35:53.340578] [INFO ] [REMOTE ] BGSF: Full fetch complete (9266 records). [2025-10-08T17:35:53.340672] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-08T17:35:53.622822] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-08T17:35:53.698701] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-08T17:35:53.698792] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-08T17:35:53.699053] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-08T17:35:53.699092] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-08T17:35:53.699583] [DEBUG] [LOCAL ] BGSF: Trimmed 9266 records to 7730 (keeping 200 days of data) [2025-10-08T17:35:53.747035] [DEBUG] [LOCAL ] BGSF: Primary data saved (7730 records). [2025-10-08T17:35:53.747163] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-08T17:35:53.747260] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGSF took 35.3s. Estimated remaining: 4h 45m 59s. Rate: 7.4 symbols/min [2025-10-08T17:35:53.927695] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:53.945634] [DEBUG] [LOCAL ] BH: Loaded 16167 existing records from primary storage. [2025-10-08T17:35:53.945929] [INFO ] [MAIN ] BH: Loaded 16167 existing records. [2025-10-08T17:35:54.077119] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T17:35:54.145724] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:54.146010] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-08T17:35:54.146067] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-08T17:35:54.146416] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-08T17:35:54.146474] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-08T17:35:54.423181] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-08T17:35:54.506496] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:54.602121] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:35:54.603675] [INFO ] [REMOTE ] BGT: Full fetch complete (24332 records). [2025-10-08T17:35:54.603755] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-08T17:35:55.029107] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-08T17:35:55.029196] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-08T17:35:55.029584] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-08T17:35:55.029674] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-08T17:35:55.030487] [DEBUG] [LOCAL ] BGT: Trimmed 24332 records to 16621 (keeping 200 days of data) [2025-10-08T17:35:55.147821] [DEBUG] [LOCAL ] BGT: Primary data saved (16621 records). [2025-10-08T17:35:55.147963] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-08T17:35:55.148040] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 35.1s. Estimated remaining: 4h 44m 57s. Rate: 7.4 symbols/min [2025-10-08T17:35:55.225457] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-08T17:35:55.362812] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:35:55.408628] [DEBUG] [LOCAL ] BHC: Loaded 46839 existing records from primary storage. [2025-10-08T17:35:55.409239] [INFO ] [MAIN ] BHC: Loaded 46839 existing records. [2025-10-08T17:35:55.570322] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T17:35:55.611427] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:35:55.611737] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-08T17:35:55.611793] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-08T17:35:55.612026] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-08T17:35:55.612084] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-08T17:35:55.963380] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:35:56.017498] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-08T17:35:56.817568] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-08T17:35:57.081447] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:35:57.617523] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-08T17:35:57.683688] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T17:35:57.736817] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:35:58.417551] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-08T17:35:59.217531] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-08T17:35:59.379698] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:35:59.437532] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:36:00.017562] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-08T17:36:00.822739] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-08T17:36:00.838027] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T17:36:01.317085] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T17:36:01.617519] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-08T17:36:01.848583] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:36:02.417515] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-08T17:36:02.498098] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:36:03.122956] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:36:03.217524] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-08T17:36:04.017550] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-08T17:36:04.821204] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-08T17:36:04.823136] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:36:04.827541] [INFO ] [REMOTE ] BGS: Full fetch complete (72518 records). [2025-10-08T17:36:04.827739] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-08T17:36:05.227568] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-08T17:36:05.227692] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-08T17:36:05.228436] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-08T17:36:05.228504] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-08T17:36:05.229973] [DEBUG] [LOCAL ] BGS: Trimmed 72518 records to 50497 (keeping 200 days of data) [2025-10-08T17:36:05.463528] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:36:05.551624] [DEBUG] [LOCAL ] BGS: Primary data saved (50497 records). [2025-10-08T17:36:05.551799] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-08T17:36:05.551886] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGS took 49.6s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-08T17:36:05.624476] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-08T17:36:05.722411] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:05.748038] [DEBUG] [LOCAL ] BHE: Loaded 24238 existing records from primary storage. [2025-10-08T17:36:05.748328] [INFO ] [MAIN ] BHE: Loaded 24238 existing records. [2025-10-08T17:36:05.974716] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:05.974956] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-08T17:36:05.975008] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-08T17:36:05.975495] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-08T17:36:05.975554] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-08T17:36:06.418289] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-08T17:36:06.418165] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:06.494175] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:36:06.669426] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:36:06.811451] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T17:36:07.217560] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-08T17:36:08.017517] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-08T17:36:08.386051] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:36:08.817518] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-08T17:36:08.817425] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:36:09.617569] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-08T17:36:10.417521] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-08T17:36:10.475227] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:36:10.646200] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:36:11.168740] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T17:36:11.217501] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-08T17:36:12.017510] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-08T17:36:12.412683] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:36:12.817532] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-08T17:36:13.012174] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:36:13.617519] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-08T17:36:14.004139] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:36:14.417553] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-08T17:36:14.508218] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T17:36:14.510298] [INFO ] [REMOTE ] BGY: Full fetch complete (32974 records). [2025-10-08T17:36:14.510386] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-08T17:36:14.876128] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-08T17:36:14.876211] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-08T17:36:14.876661] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-08T17:36:14.876725] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-08T17:36:14.877475] [DEBUG] [LOCAL ] BGY: Trimmed 32974 records to 21967 (keeping 200 days of data) [2025-10-08T17:36:15.004187] [DEBUG] [LOCAL ] BGY: Primary data saved (21967 records). [2025-10-08T17:36:15.004332] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-08T17:36:15.004416] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 23.5s. Estimated remaining: 4h 45m 9s. Rate: 7.4 symbols/min [2025-10-08T17:36:15.176523] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:15.200433] [DEBUG] [LOCAL ] BHK: Loaded 23307 existing records from primary storage. [2025-10-08T17:36:15.200754] [INFO ] [MAIN ] BHK: Loaded 23307 existing records. [2025-10-08T17:36:15.222691] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-08T17:36:15.400528] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:15.400802] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-08T17:36:15.400853] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-08T17:36:15.401063] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-08T17:36:15.401121] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-08T17:36:15.783369] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:15.802625] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:36:16.017525] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-08T17:36:16.337472] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T17:36:16.817512] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-08T17:36:17.131247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:36:17.617554] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-08T17:36:18.417552] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-08T17:36:18.558244] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:36:18.602269] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:36:19.217575] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-08T17:36:19.396893] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T17:36:19.806901] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:36:20.017683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-08T17:36:20.817532] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-08T17:36:21.075040] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:36:21.617536] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-08T17:36:21.832187] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:36:22.417624] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-08T17:36:22.684484] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T17:36:23.217557] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-08T17:36:23.621361] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T17:36:24.017567] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-08T17:36:24.817541] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-08T17:36:24.910446] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T17:36:24.953196] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:36:25.617531] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-08T17:36:25.840734] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T17:36:26.417820] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-08T17:36:27.005121] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:36:27.217587] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-08T17:36:27.684350] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T17:36:28.017583] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-08T17:36:28.582283] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:36:28.817584] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-08T17:36:29.319299] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:36:29.320908] [INFO ] [REMOTE ] BH: Full fetch complete (19763 records). [2025-10-08T17:36:29.320979] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-08T17:36:29.621162] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-08T17:36:29.707422] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-08T17:36:29.707511] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-08T17:36:29.707919] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-08T17:36:29.707982] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-08T17:36:29.708676] [DEBUG] [LOCAL ] BH: Trimmed 19763 records to 16182 (keeping 200 days of data) [2025-10-08T17:36:29.809748] [DEBUG] [LOCAL ] BH: Primary data saved (16182 records). [2025-10-08T17:36:29.809913] [INFO ] [MAIN ] BH: Full history saved. [2025-10-08T17:36:29.810002] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 36.1s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-08T17:36:29.979566] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:30.030087] [DEBUG] [LOCAL ] BHP: Loaded 53371 existing records from primary storage. [2025-10-08T17:36:30.030426] [INFO ] [MAIN ] BHP: Loaded 53371 existing records. [2025-10-08T17:36:30.207664] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:30.207890] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-08T17:36:30.207936] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-08T17:36:30.208159] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-08T17:36:30.208216] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-08T17:36:30.419982] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-08T17:36:30.573736] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:30.614279] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:36:30.673461] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:36:31.217568] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-08T17:36:31.425204] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:36:32.017528] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-08T17:36:32.393247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:36:32.817595] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-08T17:36:33.617524] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-08T17:36:33.818919] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T17:36:34.071985] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T17:36:34.417630] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-08T17:36:35.008292] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T17:36:35.217570] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-08T17:36:36.017507] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-08T17:36:36.362694] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:36:36.501272] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:36:36.817617] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-08T17:36:37.563202] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:36:37.566598] [INFO ] [REMOTE ] BHC: Full fetch complete (67051 records). [2025-10-08T17:36:37.566754] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-08T17:36:37.625019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-08T17:36:37.970202] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-08T17:36:37.970288] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-08T17:36:37.971007] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-08T17:36:37.971070] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-08T17:36:37.972464] [DEBUG] [LOCAL ] BHC: Trimmed 67051 records to 46776 (keeping 200 days of data) [2025-10-08T17:36:38.250493] [DEBUG] [LOCAL ] BHC: Primary data saved (46776 records). [2025-10-08T17:36:38.250663] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-08T17:36:38.250774] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHC took 43.1s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-10-08T17:36:38.425572] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:38.422904] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-08T17:36:38.448237] [DEBUG] [LOCAL ] BHR: Loaded 21777 existing records from primary storage. [2025-10-08T17:36:38.448675] [INFO ] [MAIN ] BHR: Loaded 21777 existing records. [2025-10-08T17:36:38.634487] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:38.634910] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-08T17:36:38.634985] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-08T17:36:38.635272] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-08T17:36:38.635420] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-08T17:36:38.767861] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T17:36:39.037524] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T17:36:39.073886] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:39.217538] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-08T17:36:39.277348] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T17:36:40.017501] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-08T17:36:40.246562] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:36:40.817574] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-08T17:36:41.090439] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T17:36:41.617512] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-08T17:36:41.858053] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T17:36:42.417514] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-08T17:36:42.491370] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:36:42.493191] [INFO ] [REMOTE ] BHE: Full fetch complete (36433 records). [2025-10-08T17:36:42.493266] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-08T17:36:42.865994] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-08T17:36:42.866097] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-08T17:36:42.866552] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-08T17:36:42.866590] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-08T17:36:42.867393] [DEBUG] [LOCAL ] BHE: Trimmed 36433 records to 24052 (keeping 200 days of data) [2025-10-08T17:36:43.022001] [DEBUG] [LOCAL ] BHE: Primary data saved (24052 records). [2025-10-08T17:36:43.022283] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-08T17:36:43.022399] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 37.5s. Estimated remaining: 4h 45m 13s. Rate: 7.4 symbols/min [2025-10-08T17:36:43.201394] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:43.206697] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-08T17:36:43.207212] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:36:43.206761] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-08T17:36:43.211263] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-08T17:36:43.211659] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-08T17:36:43.211731] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-08T17:36:43.211767] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-08T17:36:43.222676] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-08T17:36:43.567884] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:44.017583] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-08T17:36:44.200465] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T17:36:44.492216] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:36:44.817602] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-08T17:36:45.617552] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-08T17:36:45.974341] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:36:46.417568] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-08T17:36:47.217560] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-08T17:36:47.556758] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T17:36:47.708247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T17:36:47.813306] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T17:36:48.017524] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-08T17:36:48.367812] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T17:36:48.817558] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-08T17:36:49.617547] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-08T17:36:50.417522] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-08T17:36:50.799873] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T17:36:50.905560] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T17:36:51.217502] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-08T17:36:51.395497] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:36:51.398140] [INFO ] [REMOTE ] BHK: Full fetch complete (30627 records). [2025-10-08T17:36:51.398302] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-08T17:36:51.842734] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-08T17:36:51.842876] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-08T17:36:51.843298] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-08T17:36:51.843338] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-08T17:36:51.844068] [DEBUG] [LOCAL ] BHK: Trimmed 30627 records to 23435 (keeping 200 days of data) [2025-10-08T17:36:51.984764] [DEBUG] [LOCAL ] BHK: Primary data saved (23435 records). [2025-10-08T17:36:51.984905] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-08T17:36:51.984996] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 37.0s. Estimated remaining: 4h 45m 11s. Rate: 7.4 symbols/min [2025-10-08T17:36:52.027548] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-08T17:36:52.156919] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:36:52.209491] [DEBUG] [LOCAL ] BHVN: Loaded 50123 existing records from primary storage. [2025-10-08T17:36:52.209897] [INFO ] [MAIN ] BHVN: Loaded 50123 existing records. [2025-10-08T17:36:52.387894] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:36:52.388165] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-08T17:36:52.388240] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-08T17:36:52.388592] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-08T17:36:52.388687] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-08T17:36:52.744468] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:36:52.817512] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-08T17:36:53.105785] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:36:53.130463] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T17:36:53.617621] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-08T17:36:54.312377] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:36:54.417601] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-08T17:36:54.788029] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T17:36:55.217548] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-08T17:36:55.505492] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T17:36:56.017546] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-08T17:36:56.522069] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T17:36:56.817570] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-08T17:36:57.617561] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-08T17:36:57.852754] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:36:57.897723] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-08T17:36:58.282282] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:36:58.417521] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-08T17:36:59.217553] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-08T17:36:59.952432] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T17:37:00.017547] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-08T17:37:00.817539] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-08T17:37:01.196080] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T17:37:01.539687] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:37:01.617523] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-08T17:37:01.660708] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:37:02.417553] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-08T17:37:03.127855] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T17:37:03.217497] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-08T17:37:04.024601] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-08T17:37:04.030920] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T17:37:04.817567] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-08T17:37:05.035637] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:37:05.060069] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T17:37:05.617557] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-08T17:37:06.417570] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-08T17:37:06.503461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:37:06.507514] [INFO ] [REMOTE ] BHP: Full fetch complete (77263 records). [2025-10-08T17:37:06.507676] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-08T17:37:06.899734] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-08T17:37:06.899868] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-08T17:37:06.900968] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-08T17:37:06.901100] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-08T17:37:06.903968] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T17:37:06.906378] [DEBUG] [LOCAL ] BHP: Trimmed 77263 records to 53372 (keeping 200 days of data) [2025-10-08T17:37:07.232446] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-08T17:37:07.282242] [DEBUG] [LOCAL ] BHP: Primary data saved (53372 records). [2025-10-08T17:37:07.282418] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-08T17:37:07.282538] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHP took 37.5s. Estimated remaining: 4h 45m 58s. Rate: 7.3 symbols/min [2025-10-08T17:37:07.465459] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:07.495767] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:37:07.547146] [DEBUG] [LOCAL ] BILL: Loaded 52380 existing records from primary storage. [2025-10-08T17:37:07.547511] [INFO ] [MAIN ] BILL: Loaded 52380 existing records. [2025-10-08T17:37:07.719819] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:07.720023] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-08T17:37:07.720070] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-08T17:37:07.720344] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-08T17:37:07.720401] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-08T17:37:08.031692] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-08T17:37:08.073325] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:08.351801] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T17:37:08.415478] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:37:08.817562] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-08T17:37:09.617556] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-08T17:37:10.417536] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-08T17:37:10.460185] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T17:37:11.184552] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:37:11.217496] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-08T17:37:11.577781] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:37:11.580290] [INFO ] [REMOTE ] BHR: Full fetch complete (31189 records). [2025-10-08T17:37:11.580392] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-08T17:37:11.954000] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-08T17:37:11.954150] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-08T17:37:11.954575] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-08T17:37:11.955262] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-08T17:37:11.956211] [DEBUG] [LOCAL ] BHR: Trimmed 31189 records to 21855 (keeping 200 days of data) [2025-10-08T17:37:12.040483] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-08T17:37:12.086156] [DEBUG] [LOCAL ] BHR: Primary data saved (21855 records). [2025-10-08T17:37:12.086272] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-08T17:37:12.086349] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHR took 33.8s. Estimated remaining: 4h 45m 24s. Rate: 7.4 symbols/min [2025-10-08T17:37:12.256501] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:12.281129] [DEBUG] [LOCAL ] BIO: Loaded 24515 existing records from primary storage. [2025-10-08T17:37:12.281403] [INFO ] [MAIN ] BIO: Loaded 24515 existing records. [2025-10-08T17:37:12.390797] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T17:37:12.469627] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:12.469869] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-08T17:37:12.469926] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-08T17:37:12.470130] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-08T17:37:12.470190] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-08T17:37:12.834965] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-08T17:37:12.841737] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:12.900725] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T17:37:13.617552] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-08T17:37:14.136702] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T17:37:14.392908] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T17:37:14.417509] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-08T17:37:15.217543] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-08T17:37:15.931029] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:37:15.936530] [INFO ] [REMOTE ] BHVN: Full fetch complete (70093 records). [2025-10-08T17:37:15.936696] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-08T17:37:16.019048] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-08T17:37:16.404786] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:37:16.432995] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-08T17:37:16.433070] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-08T17:37:16.434054] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-08T17:37:16.434125] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-08T17:37:16.438679] [DEBUG] [LOCAL ] BHVN: Trimmed 70093 records to 50190 (keeping 200 days of data) [2025-10-08T17:37:16.769244] [DEBUG] [LOCAL ] BHVN: Primary data saved (50190 records). [2025-10-08T17:37:16.769449] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-08T17:37:16.769568] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHVN took 24.8s. Estimated remaining: 4h 44m 49s. Rate: 7.4 symbols/min [2025-10-08T17:37:16.822638] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-08T17:37:16.952332] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:16.988793] [DEBUG] [LOCAL ] BIP: Loaded 39410 existing records from primary storage. [2025-10-08T17:37:16.989134] [INFO ] [MAIN ] BIP: Loaded 39410 existing records. [2025-10-08T17:37:17.169063] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:17.169291] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-08T17:37:17.169351] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-08T17:37:17.169562] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-08T17:37:17.169618] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-08T17:37:17.516345] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:17.617500] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-08T17:37:17.857207] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:37:17.959514] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T17:37:18.417551] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-08T17:37:18.754400] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T17:37:19.217618] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-08T17:37:19.732422] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T17:37:20.017521] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-08T17:37:20.161095] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:37:20.390200] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T17:37:20.390956] [INFO ] [REMOTE ] BHV: Full fetch complete (1377 records). [2025-10-08T17:37:20.391028] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-08T17:37:20.571123] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-08T17:37:20.571388] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:37:20.571478] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:37:20.571573] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-08T17:37:20.571680] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-08T17:37:20.571736] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-08T17:37:20.571808] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-08T17:37:20.571893] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHV took 37.5s. Estimated remaining: 4h 44m 8s. Rate: 7.4 symbols/min [2025-10-08T17:37:20.742360] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:20.783354] [DEBUG] [LOCAL ] BIPC: Loaded 41252 existing records from primary storage. [2025-10-08T17:37:20.783738] [INFO ] [MAIN ] BIPC: Loaded 41252 existing records. [2025-10-08T17:37:20.822983] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-08T17:37:20.972948] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:20.973177] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-08T17:37:20.973222] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-08T17:37:20.973427] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-08T17:37:20.973482] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-08T17:37:21.329238] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:21.617500] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-08T17:37:22.009447] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:37:22.417589] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-08T17:37:23.143823] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:37:23.217499] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-08T17:37:24.017617] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-08T17:37:24.071347] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:37:24.665376] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T17:37:24.817585] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-08T17:37:25.156833] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:37:25.617565] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-08T17:37:26.417534] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-08T17:37:26.608738] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:37:26.993072] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:37:27.217626] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-08T17:37:27.441472] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T17:37:28.017625] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-08T17:37:28.179519] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T17:37:28.817622] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-08T17:37:29.617597] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-08T17:37:29.686624] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:37:30.327745] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:37:30.417542] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-08T17:37:30.877889] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:37:31.217583] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-08T17:37:31.714341] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:37:32.017576] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-08T17:37:32.801604] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:37:32.817489] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-08T17:37:33.617558] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-08T17:37:33.861064] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T17:37:34.417539] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-08T17:37:34.464164] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:37:34.584964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:37:35.217568] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-08T17:37:36.017536] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-08T17:37:36.231581] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:37:36.758670] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:37:36.817578] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-08T17:37:37.262499] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T17:37:37.617567] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-08T17:37:37.854813] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:37:38.417535] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-08T17:37:39.047526] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:37:39.217541] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-08T17:37:40.017565] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-08T17:37:40.280058] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:37:40.733237] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T17:37:40.817528] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-08T17:37:41.597580] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T17:37:41.617496] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-08T17:37:41.994842] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:37:42.417575] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-08T17:37:42.622873] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T17:37:43.217520] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-08T17:37:43.533901] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T17:37:44.017613] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-08T17:37:44.534722] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:37:44.817568] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-08T17:37:45.518576] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:37:45.617521] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-08T17:37:45.676058] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T17:37:46.417571] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-08T17:37:46.939462] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:37:47.118770] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T17:37:47.120544] [INFO ] [REMOTE ] BIO: Full fetch complete (34093 records). [2025-10-08T17:37:47.120698] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-08T17:37:47.222608] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-08T17:37:47.518420] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-08T17:37:47.518546] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-08T17:37:47.519022] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-08T17:37:47.519089] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-08T17:37:47.519861] [DEBUG] [LOCAL ] BIO: Trimmed 34093 records to 24324 (keeping 200 days of data) [2025-10-08T17:37:47.669480] [DEBUG] [LOCAL ] BIO: Primary data saved (24324 records). [2025-10-08T17:37:47.669625] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-08T17:37:47.669749] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BIO took 35.6s. Estimated remaining: 4h 46m 24s. Rate: 7.3 symbols/min [2025-10-08T17:37:47.835720] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:47.840795] [DEBUG] [LOCAL ] BIPH: Loaded 2558 existing records from primary storage. [2025-10-08T17:37:47.840954] [INFO ] [MAIN ] BIPH: Loaded 2558 existing records. [2025-10-08T17:37:48.014613] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:37:48.014849] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-08T17:37:48.014897] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-08T17:37:48.015136] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-08T17:37:48.015211] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-08T17:37:48.026233] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-08T17:37:48.390357] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:37:48.632831] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:37:48.636112] [INFO ] [REMOTE ] BIPC: Full fetch complete (60012 records). [2025-10-08T17:37:48.636207] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-08T17:37:48.824902] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-08T17:37:49.029278] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-08T17:37:49.029368] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-08T17:37:49.030077] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-08T17:37:49.030142] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-08T17:37:49.031564] [DEBUG] [LOCAL ] BIPC: Trimmed 60012 records to 41294 (keeping 200 days of data) [2025-10-08T17:37:49.281845] [DEBUG] [LOCAL ] BIPC: Primary data saved (41294 records). [2025-10-08T17:37:49.281980] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-08T17:37:49.282060] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIPC took 28.7s. Estimated remaining: 4h 45m 26s. Rate: 7.3 symbols/min [2025-10-08T17:37:49.617526] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-08T17:37:49.784227] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T17:37:49.788782] [INFO ] [REMOTE ] BILL: Full fetch complete (75889 records). [2025-10-08T17:37:49.788905] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-08T17:37:50.182350] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-08T17:37:50.182534] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-08T17:37:50.183386] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-08T17:37:50.183455] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-08T17:37:50.185177] [DEBUG] [LOCAL ] BILL: Trimmed 75889 records to 52405 (keeping 200 days of data) [2025-10-08T17:37:50.483424] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T17:37:50.489854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-08T17:37:50.517553] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T17:37:50.540898] [DEBUG] [LOCAL ] BILL: Primary data saved (52405 records). [2025-10-08T17:37:50.541041] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-08T17:37:50.541147] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BILL took 43.3s. Estimated remaining: 4h 44m 26s. Rate: 7.4 symbols/min [2025-10-08T17:37:51.092233] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:37:51.217543] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-08T17:37:51.660639] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:37:52.017577] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-08T17:37:52.418176] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T17:37:52.817605] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-08T17:37:53.617579] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-08T17:37:54.271185] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:37:54.274468] [INFO ] [REMOTE ] BIP: Full fetch complete (57013 records). [2025-10-08T17:37:54.274589] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-08T17:37:54.384311] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T17:37:54.426478] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-08T17:37:54.675718] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-08T17:37:54.675801] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-08T17:37:54.676427] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-08T17:37:54.676467] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-08T17:37:54.677549] [DEBUG] [LOCAL ] BIP: Trimmed 57013 records to 39333 (keeping 200 days of data) [2025-10-08T17:37:54.920391] [DEBUG] [LOCAL ] BIP: Primary data saved (39333 records). [2025-10-08T17:37:54.920561] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-08T17:37:54.920691] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIP took 38.2s. Estimated remaining: 4h 43m 49s. Rate: 7.4 symbols/min [2025-10-08T17:37:55.014939] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T17:37:55.217572] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-08T17:37:55.668283] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:37:56.017634] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-08T17:37:56.445190] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:37:56.817556] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-08T17:37:57.269433] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T17:37:57.617612] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-08T17:37:58.064439] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:37:58.417546] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-08T17:37:58.873719] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T17:37:58.874626] [INFO ] [REMOTE ] BIPH: Full fetch complete (4200 records). [2025-10-08T17:37:58.874728] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-08T17:37:59.275512] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-08T17:37:59.275592] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-08T17:37:59.275739] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-08T17:37:59.275800] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-08T17:37:59.276153] [DEBUG] [LOCAL ] BIPH: Trimmed 4200 records to 2566 (keeping 200 days of data) [2025-10-08T17:37:59.292217] [DEBUG] [LOCAL ] BIPH: Primary data saved (2566 records). [2025-10-08T17:37:59.292312] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-08T17:37:59.292387] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPH took 11.6s. Estimated remaining: 4h 43m 13s. Rate: 7.4 symbols/min [2025-10-08T17:37:59.908223] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:59.965444] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:37:59.992758] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:00.048853] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:00.052261] [DEBUG] [LOCAL ] BIPJ: Loaded 3146 existing records from primary storage. [2025-10-08T17:38:00.052792] [INFO ] [MAIN ] BIPJ: Loaded 3146 existing records. [2025-10-08T17:38:00.130735] [DEBUG] [LOCAL ] BIPI: Loaded 3159 existing records from primary storage. [2025-10-08T17:38:00.165169] [INFO ] [MAIN ] BIPI: Loaded 3159 existing records. [2025-10-08T17:38:00.199457] [DEBUG] [LOCAL ] BIT: Loaded 23137 existing records from primary storage. [2025-10-08T17:38:00.266484] [INFO ] [MAIN ] BIT: Loaded 23137 existing records. [2025-10-08T17:38:00.349086] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.416960] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.431103] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-08T17:38:00.480354] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-08T17:38:00.508219] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-08T17:38:00.629508] [DEBUG] [LOCAL ] BIRK: Loaded 50954 existing records from primary storage. [2025-10-08T17:38:00.592680] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.683383] [INFO ] [MAIN ] BIRK: Loaded 50954 existing records. [2025-10-08T17:38:00.683493] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.694607] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-08T17:38:00.763269] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-08T17:38:00.815542] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:00.805864] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-08T17:38:00.844024] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-08T17:38:00.849301] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-08T17:38:00.961519] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-08T17:38:01.011229] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-08T17:38:01.274625] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:01.334542] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-08T17:38:01.398375] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-08T17:38:01.468700] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-08T17:38:01.563978] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-08T17:38:01.718498] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:01.789698] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-08T17:38:02.085433] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.090574] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-08T17:38:02.271134] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.328752] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-08T17:38:02.482150] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:02.482769] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-08T17:38:02.626703] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:38:02.629089] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-08T17:38:03.084071] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:38:03.093032] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T17:38:03.217623] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-08T17:38:03.540814] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T17:38:03.682956] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:38:04.017543] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-08T17:38:04.384438] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T17:38:04.620210] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T17:38:04.817548] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-08T17:38:05.617592] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-08T17:38:05.678814] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:38:06.186801] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:38:06.417574] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-08T17:38:06.912132] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:38:07.217558] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-08T17:38:07.833263] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:38:08.017565] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-08T17:38:08.817532] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-08T17:38:08.993002] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:38:09.206721] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T17:38:09.617570] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-08T17:38:10.417589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-08T17:38:10.982465] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:38:11.041032] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:38:11.217589] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-08T17:38:11.778227] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:38:12.017550] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-08T17:38:12.817530] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-08T17:38:13.378207] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:38:13.543440] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T17:38:13.617596] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-08T17:38:14.271044] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:38:14.417573] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-08T17:38:15.217571] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-08T17:38:15.609581] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T17:38:15.765725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:38:16.017605] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-08T17:38:16.817588] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-08T17:38:17.060321] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T17:38:17.307765] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:38:17.308582] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4367 records). [2025-10-08T17:38:17.308678] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-08T17:38:17.619483] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-08T17:38:17.713856] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-08T17:38:17.713969] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-08T17:38:17.714132] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-08T17:38:17.714175] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-08T17:38:17.714561] [DEBUG] [LOCAL ] BIPJ: Trimmed 4367 records to 3153 (keeping 200 days of data) [2025-10-08T17:38:17.734868] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3153 records). [2025-10-08T17:38:17.734994] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-08T17:38:17.735096] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 18.4s. Estimated remaining: 4h 44m 21s. Rate: 7.3 symbols/min [2025-10-08T17:38:17.924199] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:17.974986] [DEBUG] [LOCAL ] BJ: Loaded 51495 existing records from primary storage. [2025-10-08T17:38:17.975324] [INFO ] [MAIN ] BJ: Loaded 51495 existing records. [2025-10-08T17:38:18.147240] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:18.147499] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-08T17:38:18.147556] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-08T17:38:18.147798] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-08T17:38:18.147855] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-08T17:38:18.422875] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-08T17:38:18.493812] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:19.216850] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T17:38:19.217680] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T17:38:19.217779] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-08T17:38:20.017577] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-08T17:38:20.043901] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T17:38:20.817565] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-08T17:38:21.271551] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T17:38:21.543367] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:38:21.617563] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-08T17:38:22.417621] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-08T17:38:23.060518] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T17:38:23.217545] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-08T17:38:23.462788] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:38:24.017553] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-08T17:38:24.400873] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:38:24.817800] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-08T17:38:24.887579] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:38:25.617553] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-08T17:38:26.417550] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-08T17:38:26.527327] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T17:38:27.111529] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:38:27.113748] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:38:27.217502] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-08T17:38:28.017567] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-08T17:38:28.817624] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-08T17:38:28.938870] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T17:38:29.466552] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:38:29.617589] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-08T17:38:29.801762] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:38:30.417582] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-08T17:38:31.174832] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T17:38:31.217563] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-08T17:38:31.475264] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T17:38:32.017563] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-08T17:38:32.803618] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:38:32.817490] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-08T17:38:33.392136] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:38:33.617553] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-08T17:38:34.417541] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-08T17:38:34.482315] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T17:38:34.721149] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:38:34.731884] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T17:38:35.217562] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-08T17:38:35.719763] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T17:38:35.720842] [INFO ] [REMOTE ] BIPI: Full fetch complete (5000 records). [2025-10-08T17:38:35.720925] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-08T17:38:36.022696] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-08T17:38:36.115731] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-08T17:38:36.115833] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-08T17:38:36.115999] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-08T17:38:36.116038] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-08T17:38:36.116741] [DEBUG] [LOCAL ] BIPI: Trimmed 5000 records to 3152 (keeping 200 days of data) [2025-10-08T17:38:36.138111] [DEBUG] [LOCAL ] BIPI: Primary data saved (3152 records). [2025-10-08T17:38:36.138261] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-08T17:38:36.138365] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 36.8s. Estimated remaining: 4h 45m 29s. Rate: 7.3 symbols/min [2025-10-08T17:38:36.320409] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:36.373776] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-08T17:38:36.374206] [INFO ] [MAIN ] BK: Loaded 53536 existing records. [2025-10-08T17:38:36.568210] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:36.568453] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-08T17:38:36.568541] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-08T17:38:36.568883] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-08T17:38:36.568943] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-08T17:38:36.823608] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-08T17:38:36.959749] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:37.506608] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:38:37.617597] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-08T17:38:38.128132] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:38:38.417576] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-08T17:38:38.809242] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:38:38.811821] [INFO ] [REMOTE ] BIT: Full fetch complete (31947 records). [2025-10-08T17:38:38.811897] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-08T17:38:39.176380] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-08T17:38:39.176466] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-08T17:38:39.176901] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-08T17:38:39.176963] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-08T17:38:39.177785] [DEBUG] [LOCAL ] BIT: Trimmed 31947 records to 23233 (keeping 200 days of data) [2025-10-08T17:38:39.230802] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-08T17:38:39.328954] [DEBUG] [LOCAL ] BIT: Primary data saved (23233 records). [2025-10-08T17:38:39.329103] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-08T17:38:39.329205] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 40.0s. Estimated remaining: 4h 44m 44s. Rate: 7.3 symbols/min [2025-10-08T17:38:39.495447] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:39.541549] [DEBUG] [LOCAL ] BKD: Loaded 50321 existing records from primary storage. [2025-10-08T17:38:39.541892] [INFO ] [MAIN ] BKD: Loaded 50321 existing records. [2025-10-08T17:38:39.718087] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:39.718319] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-08T17:38:39.718366] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-08T17:38:39.718952] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-08T17:38:39.719011] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-08T17:38:40.020758] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-08T17:38:40.096124] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:40.128785] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T17:38:40.817512] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-08T17:38:40.964277] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:38:40.968790] [INFO ] [REMOTE ] BIRK: Full fetch complete (73058 records). [2025-10-08T17:38:40.968927] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-08T17:38:41.445357] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-08T17:38:41.445485] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-08T17:38:41.446455] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-08T17:38:41.446524] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-08T17:38:41.448343] [DEBUG] [LOCAL ] BIRK: Trimmed 73058 records to 50994 (keeping 200 days of data) [2025-10-08T17:38:41.641480] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-08T17:38:41.789944] [DEBUG] [LOCAL ] BIRK: Primary data saved (50994 records). [2025-10-08T17:38:41.790148] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-08T17:38:41.790276] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 42.5s. Estimated remaining: 4h 43m 54s. Rate: 7.4 symbols/min [2025-10-08T17:38:41.965785] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:42.002213] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T17:38:42.044749] [DEBUG] [LOCAL ] BKE: Loaded 34102 existing records from primary storage. [2025-10-08T17:38:42.045088] [INFO ] [MAIN ] BKE: Loaded 34102 existing records. [2025-10-08T17:38:42.229520] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:42.229879] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-08T17:38:42.230008] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-08T17:38:42.230424] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-08T17:38:42.230504] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-08T17:38:42.418382] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-08T17:38:42.548800] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:38:42.640919] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:43.114369] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:43.217559] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-08T17:38:44.017521] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-08T17:38:44.259681] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T17:38:44.760471] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:38:44.817540] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-08T17:38:45.617585] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-08T17:38:45.743747] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T17:38:46.006181] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:38:46.417631] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-08T17:38:47.034078] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T17:38:47.217555] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-08T17:38:47.887597] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:48.017575] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-08T17:38:48.817546] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-08T17:38:49.031005] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T17:38:49.617585] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-08T17:38:49.680906] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:38:49.870965] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:38:50.417711] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-08T17:38:51.217581] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-08T17:38:51.351122] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T17:38:51.422275] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:38:52.017528] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-08T17:38:52.817574] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-08T17:38:53.379612] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T17:38:53.452449] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:38:53.617549] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-08T17:38:54.388443] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T17:38:54.393028] [INFO ] [REMOTE ] BJ: Full fetch complete (74006 records). [2025-10-08T17:38:54.393183] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-08T17:38:54.422800] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-08T17:38:54.804235] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-08T17:38:54.804333] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-08T17:38:54.805140] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-08T17:38:54.805209] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-08T17:38:54.806840] [DEBUG] [LOCAL ] BJ: Trimmed 74006 records to 51508 (keeping 200 days of data) [2025-10-08T17:38:55.118944] [DEBUG] [LOCAL ] BJ: Primary data saved (51508 records). [2025-10-08T17:38:55.119116] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-08T17:38:55.119210] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 37.4s. Estimated remaining: 4h 44m 23s. Rate: 7.3 symbols/min [2025-10-08T17:38:55.220083] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-08T17:38:55.325434] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:38:55.359508] [DEBUG] [LOCAL ] BKH: Loaded 36861 existing records from primary storage. [2025-10-08T17:38:55.386949] [INFO ] [MAIN ] BKH: Loaded 36861 existing records. [2025-10-08T17:38:55.486898] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T17:38:55.591362] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:38:55.591918] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-08T17:38:55.592096] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-08T17:38:55.592507] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-08T17:38:55.592756] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-08T17:38:55.794326] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T17:38:55.982726] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:38:56.017498] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-08T17:38:56.658811] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:38:56.817515] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-08T17:38:57.487260] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T17:38:57.617520] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-08T17:38:58.263373] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:38:58.417537] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-08T17:38:59.118049] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:38:59.217544] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-08T17:38:59.403854] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:39:00.017588] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-08T17:39:00.817581] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-08T17:39:00.872367] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T17:39:01.582287] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T17:39:01.617546] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-08T17:39:02.210261] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:39:02.417549] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-08T17:39:03.217607] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-08T17:39:03.308356] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T17:39:03.930490] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:39:04.017570] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-08T17:39:04.461181] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T17:39:04.817556] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-08T17:39:05.617560] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-08T17:39:05.908412] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:39:06.041436] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T17:39:06.417537] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-08T17:39:06.958553] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:39:07.217548] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-08T17:39:08.017577] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-08T17:39:08.184569] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:39:08.817555] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-08T17:39:08.993298] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T17:39:09.623247] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-08T17:39:09.637339] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T17:39:10.099069] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T17:39:10.417553] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-08T17:39:11.080890] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T17:39:11.084933] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-08T17:39:11.085090] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-08T17:39:11.227867] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-08T17:39:11.531371] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-08T17:39:11.531505] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-08T17:39:11.532383] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-08T17:39:11.532513] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-08T17:39:11.534282] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53532 (keeping 200 days of data) [2025-10-08T17:39:11.790411] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T17:39:11.908417] [DEBUG] [LOCAL ] BK: Primary data saved (53532 records). [2025-10-08T17:39:11.908611] [INFO ] [MAIN ] BK: Full history saved. [2025-10-08T17:39:11.908734] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 35.8s. Estimated remaining: 4h 45m 18s. Rate: 7.3 symbols/min [2025-10-08T17:39:12.022742] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-08T17:39:12.091543] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:12.126109] [DEBUG] [LOCAL ] BKKT: Loaded 35633 existing records from primary storage. [2025-10-08T17:39:12.126445] [INFO ] [MAIN ] BKKT: Loaded 35633 existing records. [2025-10-08T17:39:12.307298] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:12.307580] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-08T17:39:12.307626] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-08T17:39:12.308589] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-08T17:39:12.308688] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-08T17:39:12.674317] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:12.698606] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T17:39:12.817549] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-08T17:39:13.015306] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T17:39:13.018320] [INFO ] [REMOTE ] BKE: Full fetch complete (50120 records). [2025-10-08T17:39:13.018425] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-08T17:39:13.464517] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-08T17:39:13.464863] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-08T17:39:13.465445] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-08T17:39:13.465508] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-08T17:39:13.466563] [DEBUG] [LOCAL ] BKE: Trimmed 50120 records to 33971 (keeping 200 days of data) [2025-10-08T17:39:13.622771] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-08T17:39:13.672216] [DEBUG] [LOCAL ] BKE: Primary data saved (33971 records). [2025-10-08T17:39:13.672373] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-08T17:39:13.672465] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKE took 31.9s. Estimated remaining: 4h 44m 23s. Rate: 7.3 symbols/min [2025-10-08T17:39:13.840673] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:13.851924] [DEBUG] [LOCAL ] BKN: Loaded 7685 existing records from primary storage. [2025-10-08T17:39:13.852152] [INFO ] [MAIN ] BKN: Loaded 7685 existing records. [2025-10-08T17:39:14.071095] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:14.071457] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-08T17:39:14.071514] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-08T17:39:14.071892] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-08T17:39:14.071958] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-08T17:39:14.430708] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-08T17:39:14.479899] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T17:39:14.556186] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:15.217565] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-08T17:39:15.658805] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T17:39:15.726895] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:39:15.730835] [INFO ] [REMOTE ] BKD: Full fetch complete (71771 records). [2025-10-08T17:39:15.730982] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-08T17:39:15.947526] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:39:16.022839] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-08T17:39:16.160780] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-08T17:39:16.160859] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-08T17:39:16.161723] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-08T17:39:16.161792] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-08T17:39:16.163293] [DEBUG] [LOCAL ] BKD: Trimmed 71771 records to 50322 (keeping 200 days of data) [2025-10-08T17:39:16.452174] [DEBUG] [LOCAL ] BKD: Primary data saved (50322 records). [2025-10-08T17:39:16.452346] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-08T17:39:16.452453] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKD took 37.1s. Estimated remaining: 4h 43m 36s. Rate: 7.3 symbols/min [2025-10-08T17:39:16.623761] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:16.672038] [DEBUG] [LOCAL ] BKSY: Loaded 48400 existing records from primary storage. [2025-10-08T17:39:16.672416] [INFO ] [MAIN ] BKSY: Loaded 48400 existing records. [2025-10-08T17:39:16.822699] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-08T17:39:16.862252] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:16.862639] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-08T17:39:16.862732] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-08T17:39:16.862983] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-08T17:39:16.863058] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-08T17:39:16.982385] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:39:17.249314] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:17.617597] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-08T17:39:18.123819] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T17:39:18.189391] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T17:39:18.417616] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-08T17:39:19.217590] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-08T17:39:20.017603] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-08T17:39:20.089311] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:39:20.817618] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-08T17:39:21.051248] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T17:39:21.617524] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-08T17:39:21.728139] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:39:21.787043] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T17:39:22.281822] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T17:39:22.417599] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-08T17:39:23.217595] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-08T17:39:24.017518] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-08T17:39:24.163386] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T17:39:24.801855] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:39:24.817500] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-08T17:39:25.288862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:39:25.617541] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-08T17:39:25.924185] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T17:39:26.417591] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-08T17:39:27.217530] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-08T17:39:27.400710] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:39:27.600538] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:39:28.017570] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-08T17:39:28.221989] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T17:39:28.224986] [INFO ] [REMOTE ] BKH: Full fetch complete (52526 records). [2025-10-08T17:39:28.225107] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-08T17:39:28.606105] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-08T17:39:28.606196] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-08T17:39:28.606815] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-08T17:39:28.606876] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-08T17:39:28.608015] [DEBUG] [LOCAL ] BKH: Trimmed 52526 records to 36923 (keeping 200 days of data) [2025-10-08T17:39:28.821393] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-08T17:39:28.831936] [DEBUG] [LOCAL ] BKH: Primary data saved (36923 records). [2025-10-08T17:39:28.832037] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-08T17:39:28.832117] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKH took 33.7s. Estimated remaining: 4h 43m 58s. Rate: 7.3 symbols/min [2025-10-08T17:39:29.000217] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:29.000393] [DEBUG] [LOCAL ] BKT: No existing data file found in primary storage. [2025-10-08T17:39:29.000429] [WARN ] [MAIN ] BKT: No existing data found, performing full refresh instead. [2025-10-08T17:39:29.000553] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-08T17:39:29.000593] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-08T17:39:29.000633] [DEBUG] [LOCAL ] BKT: No primary data file found to delete. [2025-10-08T17:39:29.000704] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-08T17:39:29.356902] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:29.588554] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T17:39:29.617492] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-08T17:39:29.761065] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T17:39:30.212120] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T17:39:30.417565] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-08T17:39:31.172224] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T17:39:31.217548] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-08T17:39:32.017614] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-08T17:39:32.122582] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T17:39:32.817614] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-08T17:39:33.178078] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:39:33.617554] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-08T17:39:34.327366] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:39:34.417612] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-08T17:39:34.673859] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:39:35.108024] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:39:35.217582] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-08T17:39:36.017572] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-08T17:39:36.574795] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:39:36.727338] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T17:39:36.817575] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-08T17:39:37.617549] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-08T17:39:38.417532] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-08T17:39:38.790798] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:39:39.164324] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:39:39.165369] [INFO ] [REMOTE ] BKN: Full fetch complete (11703 records). [2025-10-08T17:39:39.165440] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-08T17:39:39.228077] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-08T17:39:39.585696] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-08T17:39:39.586396] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-08T17:39:39.586900] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-08T17:39:39.587968] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-08T17:39:39.587884] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:39:39.598301] [DEBUG] [LOCAL ] BKN: Trimmed 11703 records to 7681 (keeping 200 days of data) [2025-10-08T17:39:39.648547] [DEBUG] [LOCAL ] BKN: Primary data saved (7681 records). [2025-10-08T17:39:39.648789] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-08T17:39:39.648893] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 26.0s. Estimated remaining: 4h 44m 9s. Rate: 7.3 symbols/min [2025-10-08T17:39:39.766859] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T17:39:39.827769] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:39.872471] [DEBUG] [LOCAL ] BKU: Loaded 41591 existing records from primary storage. [2025-10-08T17:39:39.872831] [INFO ] [MAIN ] BKU: Loaded 41591 existing records. [2025-10-08T17:39:40.022698] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-08T17:39:40.053024] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:40.053274] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-08T17:39:40.053323] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-08T17:39:40.053612] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-08T17:39:40.053699] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-08T17:39:40.429784] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:40.721623] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T17:39:40.817563] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-08T17:39:41.397236] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T17:39:41.617561] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-08T17:39:42.417544] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-08T17:39:43.217592] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-08T17:39:43.726963] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T17:39:43.909489] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:39:44.017499] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-08T17:39:44.344979] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T17:39:44.739284] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T17:39:44.817559] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-08T17:39:45.617512] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-08T17:39:45.676946] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:39:46.417559] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-08T17:39:46.963251] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:39:47.162673] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T17:39:47.217517] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-08T17:39:48.017604] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-08T17:39:48.812019] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T17:39:48.817486] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-08T17:39:49.617555] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-08T17:39:49.780087] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-08T17:39:49.901211] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T17:39:50.417606] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-08T17:39:50.804560] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T17:39:51.217565] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-08T17:39:52.017564] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-08T17:39:52.176517] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T17:39:52.178426] [INFO ] [REMOTE ] BKT: Full fetch complete (15835 records). [2025-10-08T17:39:52.178540] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-08T17:39:52.581510] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-08T17:39:52.581636] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-08T17:39:52.581985] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-08T17:39:52.582028] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-08T17:39:52.582662] [DEBUG] [LOCAL ] BKT: Trimmed 15835 records to 11941 (keeping 200 days of data) [2025-10-08T17:39:52.665111] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-08T17:39:52.695008] [DEBUG] [LOCAL ] BKT: Primary data saved (11941 records). [2025-10-08T17:39:52.695128] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-08T17:39:52.695207] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKT took 23.9s. Estimated remaining: 4h 44m 35s. Rate: 7.3 symbols/min [2025-10-08T17:39:52.833098] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-08T17:39:52.863933] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:52.892062] [DEBUG] [LOCAL ] BKV: Loaded 29802 existing records from primary storage. [2025-10-08T17:39:52.892332] [INFO ] [MAIN ] BKV: Loaded 29802 existing records. [2025-10-08T17:39:53.073946] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:53.074192] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-08T17:39:53.074244] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-08T17:39:53.074421] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-08T17:39:53.074476] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-08T17:39:53.421183] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:53.617492] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-08T17:39:53.894113] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T17:39:54.417517] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-08T17:39:54.697686] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T17:39:55.023555] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:39:55.217602] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-08T17:39:56.017580] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-08T17:39:56.366061] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T17:39:56.370975] [INFO ] [REMOTE ] BKKT: Full fetch complete (50619 records). [2025-10-08T17:39:56.371382] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-08T17:39:56.822171] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-08T17:39:56.822594] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-08T17:39:56.823831] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-08T17:39:56.824578] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-08T17:39:56.824666] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-08T17:39:56.826074] [DEBUG] [LOCAL ] BKKT: Trimmed 50619 records to 35721 (keeping 200 days of data) [2025-10-08T17:39:57.038453] [DEBUG] [LOCAL ] BKKT: Primary data saved (35721 records). [2025-10-08T17:39:57.038633] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-08T17:39:57.038762] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKKT took 45.1s. Estimated remaining: 4h 43m 59s. Rate: 7.3 symbols/min [2025-10-08T17:39:57.229384] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-08T17:39:57.232997] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:57.238129] [INFO ] [REMOTE ] BKSY: Full fetch complete (69959 records). [2025-10-08T17:39:57.238256] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-08T17:39:57.518946] [DEBUG] [LOCAL ] BLCO: Loaded 35528 existing records from primary storage. [2025-10-08T17:39:57.556215] [INFO ] [MAIN ] BLCO: Loaded 35528 existing records. [2025-10-08T17:39:57.771103] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T17:39:57.888333] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-08T17:39:57.908889] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-08T17:39:57.917606] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:57.918183] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-08T17:39:57.920848] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-08T17:39:57.919103] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-08T17:39:57.921232] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-08T17:39:57.921139] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-08T17:39:57.922015] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-08T17:39:57.922242] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-08T17:39:58.058185] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:39:58.051118] [DEBUG] [LOCAL ] BKSY: Trimmed 69959 records to 48470 (keeping 200 days of data) [2025-10-08T17:39:58.424985] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-08T17:39:58.460677] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:58.685104] [DEBUG] [LOCAL ] BKSY: Primary data saved (48470 records). [2025-10-08T17:39:58.685493] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-08T17:39:58.685691] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 42.2s. Estimated remaining: 4h 43m 5s. Rate: 7.3 symbols/min [2025-10-08T17:39:58.879636] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:39:58.912328] [DEBUG] [LOCAL ] BLD: Loaded 27585 existing records from primary storage. [2025-10-08T17:39:58.912939] [INFO ] [MAIN ] BLD: Loaded 27585 existing records. [2025-10-08T17:39:59.110240] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:39:59.110883] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-08T17:39:59.111013] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-08T17:39:59.111294] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-08T17:39:59.111357] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-08T17:39:59.218282] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-08T17:39:59.520169] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:39:59.547851] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T17:39:59.590405] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T17:40:00.017608] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-08T17:40:00.550301] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:40:00.817558] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-08T17:40:01.390471] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T17:40:01.617546] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-08T17:40:01.965289] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T17:40:02.417562] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-08T17:40:02.957913] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T17:40:03.217556] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-08T17:40:03.654396] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:40:04.017555] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-08T17:40:04.638958] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:40:04.817556] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-08T17:40:05.479077] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:40:05.617560] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-08T17:40:06.047712] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T17:40:06.417612] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-08T17:40:06.782914] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:40:07.217570] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-08T17:40:07.335981] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T17:40:08.017581] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-08T17:40:08.538966] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T17:40:08.817574] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-08T17:40:09.418407] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T17:40:09.617570] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-08T17:40:10.417548] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-08T17:40:10.551797] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T17:40:10.889719] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T17:40:11.217575] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-08T17:40:11.807095] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T17:40:12.017611] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-08T17:40:12.823029] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-08T17:40:12.830843] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T17:40:13.479325] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T17:40:13.617578] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-08T17:40:14.083542] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T17:40:14.417568] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-08T17:40:15.008594] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T17:40:15.217533] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-08T17:40:15.658099] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T17:40:16.017565] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-08T17:40:16.433708] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:40:16.817570] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-08T17:40:17.202350] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T17:40:17.617557] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-08T17:40:18.185763] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T17:40:18.189407] [INFO ] [REMOTE ] BKU: Full fetch complete (60161 records). [2025-10-08T17:40:18.189500] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-08T17:40:18.421243] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-08T17:40:18.582293] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-08T17:40:18.582437] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-08T17:40:18.583111] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-08T17:40:18.583174] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-08T17:40:18.584361] [DEBUG] [LOCAL ] BKU: Trimmed 60161 records to 41680 (keeping 200 days of data) [2025-10-08T17:40:18.841975] [DEBUG] [LOCAL ] BKU: Primary data saved (41680 records). [2025-10-08T17:40:18.842122] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-08T17:40:18.842217] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 39.2s. Estimated remaining: 4h 44m 21s. Rate: 7.3 symbols/min [2025-10-08T17:40:18.968258] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T17:40:19.048874] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:19.098444] [DEBUG] [LOCAL ] BLDR: Loaded 51691 existing records from primary storage. [2025-10-08T17:40:19.098847] [INFO ] [MAIN ] BLDR: Loaded 51691 existing records. [2025-10-08T17:40:19.222775] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-08T17:40:19.285366] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:19.285586] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-08T17:40:19.285676] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-08T17:40:19.285902] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-08T17:40:19.285960] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-08T17:40:19.659304] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:19.673632] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:40:20.017561] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-08T17:40:20.251309] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T17:40:20.817584] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-08T17:40:21.617516] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-08T17:40:21.859356] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T17:40:21.991269] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T17:40:22.417584] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-08T17:40:23.085674] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T17:40:23.217566] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-08T17:40:23.654686] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T17:40:23.657307] [INFO ] [REMOTE ] BKV: Full fetch complete (44813 records). [2025-10-08T17:40:23.657389] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-08T17:40:24.024881] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-08T17:40:24.024147] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-08T17:40:24.025138] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-08T17:40:24.026319] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-08T17:40:24.026383] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-08T17:40:24.027502] [DEBUG] [LOCAL ] BKV: Trimmed 44813 records to 29885 (keeping 200 days of data) [2025-10-08T17:40:24.213804] [DEBUG] [LOCAL ] BKV: Primary data saved (29885 records). [2025-10-08T17:40:24.213982] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-08T17:40:24.214107] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 31.5s. Estimated remaining: 4h 43m 53s. Rate: 7.3 symbols/min [2025-10-08T17:40:24.398543] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:24.414860] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-08T17:40:24.415136] [INFO ] [MAIN ] BLE: Loaded 14063 existing records. [2025-10-08T17:40:24.542075] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:40:24.628902] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:24.629183] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-08T17:40:24.629238] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-08T17:40:24.629415] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-08T17:40:24.629471] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-08T17:40:24.827430] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-08T17:40:24.996462] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:25.617602] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-08T17:40:25.675635] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T17:40:26.415409] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:40:26.421515] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-08T17:40:26.750997] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:40:27.217594] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-08T17:40:27.323088] [DEBUG] [REMOTE ] BLD: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T17:40:27.323373] [WARN ] [REMOTE ] BLD: No data returned for month 2025-09 [2025-10-08T17:40:27.323462] [FATAL] [REMOTE ] BLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:40:27.323544] [FATAL] [MAIN ] BLD: Failed to fetch primary data. [2025-10-08T17:40:27.323609] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:40:27.323705] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-08T17:40:27.323802] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-08T17:40:27.323871] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-08T17:40:27.324172] [DEBUG] [LOCAL ] BLD: Deleted derivative data file. [2025-10-08T17:40:27.324272] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 28.6s. Estimated remaining: 4h 43m 9s. Rate: 7.3 symbols/min [2025-10-08T17:40:27.497458] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:27.533820] [DEBUG] [LOCAL ] BLK: Loaded 34141 existing records from primary storage. [2025-10-08T17:40:27.534148] [INFO ] [MAIN ] BLK: Loaded 34141 existing records. [2025-10-08T17:40:27.732247] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:27.732679] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-08T17:40:27.732755] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-08T17:40:27.733057] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-08T17:40:27.733129] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-08T17:40:28.022733] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-08T17:40:28.118043] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:28.154685] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:40:28.741449] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T17:40:28.817572] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-08T17:40:29.570542] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T17:40:29.617574] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-08T17:40:30.417573] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-08T17:40:31.217554] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-08T17:40:31.405736] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:40:31.853933] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T17:40:32.017579] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-08T17:40:32.160524] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T17:40:32.817611] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-08T17:40:33.567687] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:40:33.617502] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-08T17:40:34.238205] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:40:34.417746] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-08T17:40:34.646690] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T17:40:35.217567] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-08T17:40:36.017555] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-08T17:40:36.169247] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:40:36.817508] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-08T17:40:36.850697] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T17:40:37.306759] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T17:40:37.617561] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-08T17:40:38.417551] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-08T17:40:38.789372] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:40:38.827678] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T17:40:39.217560] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-08T17:40:40.017524] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-08T17:40:40.083402] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T17:40:40.124676] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:40:40.817528] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-08T17:40:41.178291] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:40:41.180915] [INFO ] [REMOTE ] BLCO: Full fetch complete (52264 records). [2025-10-08T17:40:41.181003] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-08T17:40:41.557985] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-08T17:40:41.558074] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-08T17:40:41.558694] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-08T17:40:41.558755] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-08T17:40:41.559769] [DEBUG] [LOCAL ] BLCO: Trimmed 52264 records to 35542 (keeping 200 days of data) [2025-10-08T17:40:41.642597] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-08T17:40:41.763340] [DEBUG] [LOCAL ] BLCO: Primary data saved (35542 records). [2025-10-08T17:40:41.763474] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-08T17:40:41.763560] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 44.7s. Estimated remaining: 4h 43m 44s. Rate: 7.3 symbols/min [2025-10-08T17:40:41.933560] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:41.987019] [DEBUG] [LOCAL ] BLND: Loaded 49214 existing records from primary storage. [2025-10-08T17:40:41.987360] [INFO ] [MAIN ] BLND: Loaded 49214 existing records. [2025-10-08T17:40:42.160982] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:42.161238] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-08T17:40:42.161285] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-08T17:40:42.161504] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-08T17:40:42.161562] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-08T17:40:42.426282] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-08T17:40:42.518629] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:42.683224] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:40:43.217611] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-08T17:40:43.449365] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T17:40:43.493712] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:40:44.017693] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-08T17:40:44.731640] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T17:40:44.806407] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:40:44.817501] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-08T17:40:45.617586] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-08T17:40:46.318360] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T17:40:46.355971] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:40:46.417544] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-08T17:40:47.217619] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-08T17:40:47.900275] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:40:48.016682] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:40:48.019479] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-08T17:40:48.817556] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-08T17:40:49.617565] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-08T17:40:49.800452] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:40:49.801845] [INFO ] [REMOTE ] BLE: Full fetch complete (20099 records). [2025-10-08T17:40:49.801920] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-08T17:40:49.955157] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T17:40:50.198057] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-08T17:40:50.198137] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-08T17:40:50.198542] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-08T17:40:50.198617] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-08T17:40:50.199220] [DEBUG] [LOCAL ] BLE: Trimmed 20099 records to 14063 (keeping 200 days of data) [2025-10-08T17:40:50.283974] [DEBUG] [LOCAL ] BLE: Primary data saved (14063 records). [2025-10-08T17:40:50.284135] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-08T17:40:50.284223] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 26.1s. Estimated remaining: 4h 43m 38s. Rate: 7.3 symbols/min [2025-10-08T17:40:50.425813] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-08T17:40:50.464307] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:50.464585] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-08T17:40:50.464725] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-08T17:40:50.464877] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-08T17:40:50.464949] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-08T17:40:50.465036] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-08T17:40:50.465125] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-08T17:40:50.871834] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:51.086628] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:40:51.217572] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-08T17:40:51.422489] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:40:51.422975] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-08T17:40:51.423077] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:40:51.423127] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-08T17:40:51.423161] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:40:51.423201] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-08T17:40:51.423513] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-08T17:40:51.423793] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-08T17:40:51.423855] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-08T17:40:51.423924] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLSH took 1.1s. Estimated remaining: 4h 42m 41s. Rate: 7.3 symbols/min [2025-10-08T17:40:51.604073] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:40:51.620379] [DEBUG] [LOCAL ] BLW: Loaded 13323 existing records from primary storage. [2025-10-08T17:40:51.620705] [INFO ] [MAIN ] BLW: Loaded 13323 existing records. [2025-10-08T17:40:51.833440] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:40:51.833784] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-08T17:40:51.833850] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-08T17:40:51.834111] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-08T17:40:51.834182] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-08T17:40:52.021877] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-08T17:40:52.225305] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:40:52.462335] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T17:40:52.817562] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-08T17:40:53.617690] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-08T17:40:53.646041] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:40:53.700671] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T17:40:54.417577] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-08T17:40:55.217566] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-08T17:40:55.503009] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:40:55.522843] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T17:40:56.017559] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-08T17:40:56.817592] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-08T17:40:56.873524] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T17:40:57.617525] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-08T17:40:57.710535] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T17:40:57.862245] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:40:58.417545] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-08T17:40:59.056538] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:40:59.217555] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-08T17:40:59.905197] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T17:40:59.909247] [INFO ] [REMOTE ] BLDR: Full fetch complete (74506 records). [2025-10-08T17:40:59.909366] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-08T17:41:00.022629] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-08T17:41:00.315674] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-08T17:41:00.315786] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-08T17:41:00.316568] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-08T17:41:00.316613] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-08T17:41:00.318223] [DEBUG] [LOCAL ] BLDR: Trimmed 74506 records to 51707 (keeping 200 days of data) [2025-10-08T17:41:00.662292] [DEBUG] [LOCAL ] BLDR: Primary data saved (51707 records). [2025-10-08T17:41:00.662483] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-08T17:41:00.662585] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLDR took 41.8s. Estimated remaining: 4h 42m 40s. Rate: 7.3 symbols/min [2025-10-08T17:41:00.819903] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-08T17:41:00.840390] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:00.863469] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T17:41:00.883989] [DEBUG] [LOCAL ] BLX: Loaded 15607 existing records from primary storage. [2025-10-08T17:41:00.884377] [INFO ] [MAIN ] BLX: Loaded 15607 existing records. [2025-10-08T17:41:01.050469] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T17:41:01.132813] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:01.133049] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-08T17:41:01.133098] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-08T17:41:01.133291] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-08T17:41:01.133349] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-08T17:41:01.510048] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:01.617605] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-08T17:41:02.417578] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-08T17:41:02.573535] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:41:02.749495] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:41:03.217589] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-08T17:41:03.734371] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T17:41:03.737235] [INFO ] [REMOTE ] BLK: Full fetch complete (52504 records). [2025-10-08T17:41:03.737377] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-08T17:41:04.022612] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-08T17:41:04.080933] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:41:04.185687] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-08T17:41:04.185795] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-08T17:41:04.186490] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-08T17:41:04.186534] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-08T17:41:04.187944] [DEBUG] [LOCAL ] BLK: Trimmed 52504 records to 34039 (keeping 200 days of data) [2025-10-08T17:41:04.417796] [DEBUG] [LOCAL ] BLK: Primary data saved (34039 records). [2025-10-08T17:41:04.417956] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-08T17:41:04.418043] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLK took 37.1s. Estimated remaining: 4h 42m 2s. Rate: 7.3 symbols/min [2025-10-08T17:41:04.588240] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:04.639304] [DEBUG] [LOCAL ] BMA: Loaded 35599 existing records from primary storage. [2025-10-08T17:41:04.639623] [INFO ] [MAIN ] BMA: Loaded 35599 existing records. [2025-10-08T17:41:04.831795] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-08T17:41:04.839512] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:04.840070] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-08T17:41:04.840136] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-08T17:41:04.841176] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-08T17:41:04.841237] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-08T17:41:05.359071] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:05.605179] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:41:05.620113] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-08T17:41:05.828302] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:41:06.417614] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-08T17:41:06.482112] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T17:41:07.217593] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-08T17:41:08.019816] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-08T17:41:08.025500] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:41:08.419256] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T17:41:08.817580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-08T17:41:08.932958] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T17:41:09.617553] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-08T17:41:10.292495] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:41:10.417517] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-08T17:41:10.640694] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T17:41:11.217553] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-08T17:41:11.960216] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T17:41:11.984077] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T17:41:12.017531] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-08T17:41:12.781825] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T17:41:12.817508] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-08T17:41:13.617618] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-08T17:41:13.720163] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T17:41:14.417567] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-08T17:41:14.812436] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T17:41:15.220262] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-08T17:41:15.221467] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T17:41:16.017549] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-08T17:41:16.241984] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:41:16.817562] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-08T17:41:17.149880] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:41:17.151793] [INFO ] [REMOTE ] BLW: Full fetch complete (19446 records). [2025-10-08T17:41:17.151868] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-08T17:41:17.528574] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-08T17:41:17.528735] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-08T17:41:17.529315] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-08T17:41:17.529505] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-08T17:41:17.540768] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T17:41:17.540975] [DEBUG] [LOCAL ] BLW: Trimmed 19446 records to 13372 (keeping 200 days of data) [2025-10-08T17:41:17.617606] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-08T17:41:17.627760] [DEBUG] [LOCAL ] BLW: Primary data saved (13372 records). [2025-10-08T17:41:17.627859] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-08T17:41:17.627936] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 26.2s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-08T17:41:17.793845] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:17.806569] [DEBUG] [LOCAL ] BME: Loaded 11037 existing records from primary storage. [2025-10-08T17:41:17.806818] [INFO ] [MAIN ] BME: Loaded 11037 existing records. [2025-10-08T17:41:17.983542] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:17.983817] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-08T17:41:17.983874] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-08T17:41:17.984218] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-08T17:41:17.984276] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-08T17:41:18.349809] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:18.420189] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-08T17:41:18.422196] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T17:41:19.217598] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-08T17:41:20.017579] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-08T17:41:20.056146] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:41:20.076484] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T17:41:20.817580] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-08T17:41:21.556296] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T17:41:21.617547] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-08T17:41:22.417564] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-08T17:41:22.508332] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:41:22.512423] [INFO ] [REMOTE ] BLND: Full fetch complete (72221 records). [2025-10-08T17:41:22.512558] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-08T17:41:22.922880] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-08T17:41:22.923014] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-08T17:41:22.923800] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-08T17:41:22.923948] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-08T17:41:22.944921] [DEBUG] [LOCAL ] BLND: Trimmed 72221 records to 49201 (keeping 200 days of data) [2025-10-08T17:41:22.944784] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T17:41:23.065495] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T17:41:23.225040] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-08T17:41:23.245396] [DEBUG] [LOCAL ] BLND: Primary data saved (49201 records). [2025-10-08T17:41:23.245558] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-08T17:41:23.246382] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 41.5s. Estimated remaining: 4h 42m 2s. Rate: 7.3 symbols/min [2025-10-08T17:41:23.425384] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:23.454264] [DEBUG] [LOCAL ] BMEZ: Loaded 26653 existing records from primary storage. [2025-10-08T17:41:23.454515] [INFO ] [MAIN ] BMEZ: Loaded 26653 existing records. [2025-10-08T17:41:23.643077] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:23.643334] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-08T17:41:23.643383] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-08T17:41:23.643679] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-08T17:41:23.643744] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-08T17:41:24.043266] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:24.031038] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-08T17:41:24.044114] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T17:41:24.817544] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-08T17:41:25.390288] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T17:41:25.600933] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T17:41:25.617522] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-08T17:41:26.417683] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-08T17:41:27.108375] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:41:27.217548] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-08T17:41:27.559784] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:41:28.017586] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-08T17:41:28.548957] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T17:41:28.817598] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-08T17:41:29.076198] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T17:41:29.617543] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-08T17:41:30.264144] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:41:30.417536] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-08T17:41:30.772620] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T17:41:30.774586] [INFO ] [REMOTE ] BLX: Full fetch complete (22566 records). [2025-10-08T17:41:30.774774] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-08T17:41:31.178364] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T17:41:31.178012] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-08T17:41:31.178559] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-08T17:41:31.182096] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-08T17:41:31.182503] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-08T17:41:31.183264] [DEBUG] [LOCAL ] BLX: Trimmed 22566 records to 15620 (keeping 200 days of data) [2025-10-08T17:41:31.230834] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-08T17:41:31.294882] [DEBUG] [LOCAL ] BLX: Primary data saved (15620 records). [2025-10-08T17:41:31.295078] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-08T17:41:31.295186] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 30.6s. Estimated remaining: 4h 41m 53s. Rate: 7.3 symbols/min [2025-10-08T17:41:31.481617] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:31.507777] [DEBUG] [LOCAL ] BMI: Loaded 24368 existing records from primary storage. [2025-10-08T17:41:31.508108] [INFO ] [MAIN ] BMI: Loaded 24368 existing records. [2025-10-08T17:41:31.694985] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:31.695247] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-08T17:41:31.695302] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-08T17:41:31.695527] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-08T17:41:31.695584] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-08T17:41:32.022187] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-08T17:41:32.081384] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:32.090699] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T17:41:32.817583] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-08T17:41:33.300462] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T17:41:33.573898] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T17:41:33.617607] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-08T17:41:34.417566] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-08T17:41:34.833708] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T17:41:35.217580] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-08T17:41:35.352680] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T17:41:35.973532] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T17:41:36.017555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-08T17:41:36.817582] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-08T17:41:37.617835] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-08T17:41:37.617763] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T17:41:38.161899] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:41:38.417529] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-08T17:41:38.550356] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T17:41:39.211947] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:41:39.217492] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-08T17:41:40.017542] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-08T17:41:40.145926] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T17:41:40.817561] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-08T17:41:41.072779] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:41:41.617524] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-08T17:41:41.987000] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T17:41:42.417563] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-08T17:41:42.667405] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T17:41:43.217583] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-08T17:41:43.888117] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T17:41:44.017555] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-08T17:41:44.376550] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:41:44.817583] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-08T17:41:45.350249] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:41:45.617592] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-08T17:41:45.986695] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:41:46.401023] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T17:41:46.417510] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-08T17:41:47.217568] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-08T17:41:47.311574] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T17:41:47.313044] [INFO ] [REMOTE ] BME: Full fetch complete (16032 records). [2025-10-08T17:41:47.313137] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-08T17:41:47.677411] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-08T17:41:47.677497] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-08T17:41:47.677908] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-08T17:41:47.677972] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-08T17:41:47.678524] [DEBUG] [LOCAL ] BME: Trimmed 16032 records to 11075 (keeping 200 days of data) [2025-10-08T17:41:47.749478] [DEBUG] [LOCAL ] BME: Primary data saved (11075 records). [2025-10-08T17:41:47.749626] [INFO ] [MAIN ] BME: Full history saved. [2025-10-08T17:41:47.749759] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BME took 30.1s. Estimated remaining: 4h 42m 41s. Rate: 7.3 symbols/min [2025-10-08T17:41:47.926329] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:47.931582] [DEBUG] [LOCAL ] BMN: Loaded 2582 existing records from primary storage. [2025-10-08T17:41:47.931789] [INFO ] [MAIN ] BMN: Loaded 2582 existing records. [2025-10-08T17:41:48.022634] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-08T17:41:48.117637] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:48.117912] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-08T17:41:48.118046] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-08T17:41:48.118288] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-08T17:41:48.118358] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-08T17:41:48.489927] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:48.754893] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:41:48.817516] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-08T17:41:49.145615] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:41:49.617507] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-08T17:41:49.642362] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T17:41:50.417551] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-08T17:41:51.192314] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T17:41:51.195496] [INFO ] [REMOTE ] BMA: Full fetch complete (51400 records). [2025-10-08T17:41:51.195600] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-08T17:41:51.226562] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-08T17:41:51.582955] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-08T17:41:51.583051] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-08T17:41:51.583681] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-08T17:41:51.583745] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-08T17:41:51.584998] [DEBUG] [LOCAL ] BMA: Trimmed 51400 records to 35575 (keeping 200 days of data) [2025-10-08T17:41:51.697594] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:41:51.832152] [DEBUG] [LOCAL ] BMA: Primary data saved (35575 records). [2025-10-08T17:41:51.832323] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-08T17:41:51.832426] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMA took 47.4s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-10-08T17:41:51.944824] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:41:52.022157] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-08T17:41:52.022075] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:41:52.070349] [DEBUG] [LOCAL ] BMO: Loaded 41146 existing records from primary storage. [2025-10-08T17:41:52.070699] [INFO ] [MAIN ] BMO: Loaded 41146 existing records. [2025-10-08T17:41:52.254849] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:41:52.255111] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-08T17:41:52.255175] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-08T17:41:52.255435] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-08T17:41:52.255513] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-08T17:41:52.553605] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T17:41:52.632178] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:41:52.817554] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-08T17:41:53.227058] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T17:41:53.617559] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-08T17:41:54.050743] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-08T17:41:54.417569] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-08T17:41:55.217583] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-08T17:41:55.700057] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:41:56.017505] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-08T17:41:56.089441] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:41:56.558577] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T17:41:56.817733] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-08T17:41:57.617636] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-08T17:41:57.840335] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T17:41:58.089685] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:41:58.417553] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-08T17:41:58.797877] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:41:59.217576] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-08T17:42:00.017618] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-08T17:42:00.466866] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:42:00.470516] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40788 records). [2025-10-08T17:42:00.470709] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-08T17:42:00.818914] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-08T17:42:00.852477] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-08T17:42:00.852570] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-08T17:42:00.853273] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-08T17:42:00.853339] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-08T17:42:00.854339] [DEBUG] [LOCAL ] BMEZ: Trimmed 40788 records to 26610 (keeping 200 days of data) [2025-10-08T17:42:01.019573] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26610 records). [2025-10-08T17:42:01.019746] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-08T17:42:01.019840] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMEZ took 37.8s. Estimated remaining: 4h 42m 3s. Rate: 7.3 symbols/min [2025-10-08T17:42:01.196557] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:01.250250] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-08T17:42:01.250587] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-08T17:42:01.437056] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T17:42:01.442437] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:01.445009] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-08T17:42:01.445086] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-08T17:42:01.445307] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-08T17:42:01.445365] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-08T17:42:01.618376] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-08T17:42:01.806504] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:01.840866] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T17:42:02.281353] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:42:02.417611] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-08T17:42:03.217618] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-08T17:42:03.635946] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:42:03.893369] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:42:04.017547] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-08T17:42:04.817606] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-08T17:42:05.453957] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T17:42:05.617588] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-08T17:42:06.060042] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:42:06.417608] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-08T17:42:06.976192] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T17:42:06.977025] [INFO ] [REMOTE ] BMN: Full fetch complete (3716 records). [2025-10-08T17:42:06.977095] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-08T17:42:07.229686] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-08T17:42:07.404058] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-08T17:42:07.404171] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-08T17:42:07.404354] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-08T17:42:07.404441] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-08T17:42:07.405038] [DEBUG] [LOCAL ] BMN: Trimmed 3716 records to 2586 (keeping 200 days of data) [2025-10-08T17:42:07.424223] [DEBUG] [LOCAL ] BMN: Primary data saved (2586 records). [2025-10-08T17:42:07.424426] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-08T17:42:07.424569] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMN took 19.7s. Estimated remaining: 4h 41m 43s. Rate: 7.3 symbols/min [2025-10-08T17:42:07.603028] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:07.699898] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:42:07.712820] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-08T17:42:07.714142] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-08T17:42:07.907886] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:07.908162] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-08T17:42:07.908215] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-08T17:42:07.908525] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-08T17:42:07.908586] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-08T17:42:08.022681] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-08T17:42:08.259198] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:08.817543] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-08T17:42:09.009790] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T17:42:09.617531] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-08T17:42:09.730607] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:42:10.417516] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-08T17:42:10.515491] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:42:10.978372] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:42:11.217568] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-08T17:42:12.017549] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-08T17:42:12.170473] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:42:12.364947] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T17:42:12.367014] [INFO ] [REMOTE ] BMI: Full fetch complete (33019 records). [2025-10-08T17:42:12.367094] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-08T17:42:12.743061] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-08T17:42:12.743162] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-08T17:42:12.743687] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-08T17:42:12.743750] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-08T17:42:12.744518] [DEBUG] [LOCAL ] BMI: Trimmed 33019 records to 24334 (keeping 200 days of data) [2025-10-08T17:42:12.836868] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-08T17:42:12.898986] [DEBUG] [LOCAL ] BMI: Primary data saved (24334 records). [2025-10-08T17:42:12.899119] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-08T17:42:12.899214] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMI took 41.6s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-08T17:42:13.067210] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:13.095086] [DEBUG] [LOCAL ] BNED: Loaded 29337 existing records from primary storage. [2025-10-08T17:42:13.095389] [INFO ] [MAIN ] BNED: Loaded 29337 existing records. [2025-10-08T17:42:13.275994] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:13.276241] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-08T17:42:13.276319] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-08T17:42:13.276585] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-08T17:42:13.276687] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-08T17:42:13.620081] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-08T17:42:13.646172] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:13.879598] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T17:42:14.220680] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T17:42:14.417606] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-08T17:42:15.217550] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-08T17:42:15.246585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:42:15.975777] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:42:16.017586] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-08T17:42:16.817527] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-08T17:42:17.352308] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T17:42:17.432057] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:42:17.617564] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-08T17:42:17.815313] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T17:42:18.417596] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-08T17:42:18.923127] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T17:42:19.217605] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-08T17:42:19.721805] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:42:20.017599] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-08T17:42:20.817563] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-08T17:42:21.266567] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T17:42:21.539754] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:42:21.617559] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-08T17:42:22.114132] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:42:22.417572] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-08T17:42:23.217601] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-08T17:42:23.598955] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:42:24.017859] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-08T17:42:24.093858] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T17:42:24.587633] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:42:24.817570] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-08T17:42:25.617616] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-08T17:42:25.953078] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T17:42:26.234307] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T17:42:26.417545] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-08T17:42:26.945339] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T17:42:27.217555] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-08T17:42:28.017731] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-08T17:42:28.183681] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:42:28.817534] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-08T17:42:28.860978] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T17:42:28.923128] [DEBUG] [REMOTE ] BN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-08T17:42:28.923443] [WARN ] [REMOTE ] BN: No data returned for month 2025-06 [2025-10-08T17:42:28.923537] [FATAL] [REMOTE ] BN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:42:28.923611] [FATAL] [MAIN ] BN: Failed to fetch primary data. [2025-10-08T17:42:28.923711] [WARN ] [MAIN ] BN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:42:28.923787] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-08T17:42:28.923893] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-08T17:42:28.923949] [INFO ] [LOCAL ] BN: Starting deletion of derivative data. [2025-10-08T17:42:28.924206] [DEBUG] [LOCAL ] BN: Deleted derivative data file. [2025-10-08T17:42:28.924294] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BN took 21.5s. Estimated remaining: 4h 42m 1s. Rate: 7.3 symbols/min [2025-10-08T17:42:29.103310] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:29.126408] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T17:42:29.141431] [DEBUG] [LOCAL ] BNH: Loaded 5256 existing records from primary storage. [2025-10-08T17:42:29.141745] [INFO ] [MAIN ] BNH: Loaded 5256 existing records. [2025-10-08T17:42:29.318560] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:29.318814] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-08T17:42:29.318885] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-08T17:42:29.319100] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-08T17:42:29.319158] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-08T17:42:29.622916] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-08T17:42:29.683041] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:30.417586] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-08T17:42:31.151165] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:42:31.217534] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-08T17:42:31.307495] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T17:42:31.310751] [INFO ] [REMOTE ] BMO: Full fetch complete (59697 records). [2025-10-08T17:42:31.310844] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-08T17:42:31.699776] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-08T17:42:31.699901] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-08T17:42:31.700609] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-08T17:42:31.700680] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-08T17:42:31.701968] [DEBUG] [LOCAL ] BMO: Trimmed 59697 records to 41139 (keeping 200 days of data) [2025-10-08T17:42:31.799511] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T17:42:31.975892] [DEBUG] [LOCAL ] BMO: Primary data saved (41139 records). [2025-10-08T17:42:31.976027] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-08T17:42:31.976121] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMO took 40.1s. Estimated remaining: 4h 41m 18s. Rate: 7.3 symbols/min [2025-10-08T17:42:32.022680] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-08T17:42:32.149153] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:32.154220] [DEBUG] [LOCAL ] BNJ: Loaded 2661 existing records from primary storage. [2025-10-08T17:42:32.154394] [INFO ] [MAIN ] BNJ: Loaded 2661 existing records. [2025-10-08T17:42:32.332254] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:32.332513] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-08T17:42:32.332568] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-08T17:42:32.332758] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-08T17:42:32.332817] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-08T17:42:32.435972] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T17:42:32.691382] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:32.817519] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-08T17:42:33.366106] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T17:42:33.617594] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-08T17:42:34.215466] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T17:42:34.417602] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-08T17:42:35.217600] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-08T17:42:35.534623] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:42:35.773151] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:42:36.017541] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-08T17:42:36.817531] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-08T17:42:37.207347] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:42:37.617571] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-08T17:42:38.369169] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T17:42:38.417570] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-08T17:42:38.715671] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:42:38.899180] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T17:42:39.217605] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-08T17:42:40.017568] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-08T17:42:40.817582] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-08T17:42:41.084779] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T17:42:41.136322] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T17:42:41.488973] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T17:42:41.617583] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-08T17:42:42.181056] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T17:42:42.417588] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-08T17:42:43.217573] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-08T17:42:44.017518] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-08T17:42:44.101560] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T17:42:44.106086] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-08T17:42:44.106258] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-08T17:42:44.562557] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-08T17:42:44.563296] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-08T17:42:44.565095] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T17:42:44.564209] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-08T17:42:44.565244] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-08T17:42:44.573481] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 53757 (keeping 200 days of data) [2025-10-08T17:42:44.810262] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:42:44.817540] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-08T17:42:44.924057] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-08T17:42:44.924282] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-08T17:42:44.924867] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BMY took 43.9s. Estimated remaining: 4h 41m 42s. Rate: 7.3 symbols/min [2025-10-08T17:42:45.104418] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:45.167612] [DEBUG] [LOCAL ] BNL: Loaded 47159 existing records from primary storage. [2025-10-08T17:42:45.168019] [INFO ] [MAIN ] BNL: Loaded 47159 existing records. [2025-10-08T17:42:45.347362] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:45.347593] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-08T17:42:45.347697] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-08T17:42:45.347997] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-08T17:42:45.348070] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-08T17:42:45.622705] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-08T17:42:45.725136] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:45.826896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T17:42:46.230890] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:42:46.417552] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-08T17:42:47.217560] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-08T17:42:47.510013] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:42:47.513019] [INFO ] [REMOTE ] BNED: Full fetch complete (43294 records). [2025-10-08T17:42:47.513149] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-08T17:42:47.640243] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:42:47.915850] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-08T17:42:47.915949] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-08T17:42:47.916480] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-08T17:42:47.916532] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-08T17:42:47.917705] [DEBUG] [LOCAL ] BNED: Trimmed 43294 records to 29154 (keeping 200 days of data) [2025-10-08T17:42:48.017633] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-08T17:42:48.088101] [DEBUG] [LOCAL ] BNED: Primary data saved (29154 records). [2025-10-08T17:42:48.088259] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-08T17:42:48.088347] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNED took 35.2s. Estimated remaining: 4h 41m 0s. Rate: 7.3 symbols/min [2025-10-08T17:42:48.260134] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:48.317845] [DEBUG] [LOCAL ] BNS: Loaded 51478 existing records from primary storage. [2025-10-08T17:42:48.318278] [INFO ] [MAIN ] BNS: Loaded 51478 existing records. [2025-10-08T17:42:48.536617] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:48.536935] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-08T17:42:48.536994] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-08T17:42:48.537289] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-08T17:42:48.537353] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-08T17:42:48.822718] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-08T17:42:48.895689] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:49.589520] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T17:42:49.617569] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-08T17:42:49.723444] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T17:42:50.417560] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-08T17:42:51.015580] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:42:51.017713] [INFO ] [REMOTE ] BNH: Full fetch complete (6960 records). [2025-10-08T17:42:51.017968] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-08T17:42:51.218764] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-08T17:42:51.425436] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-08T17:42:51.425539] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-08T17:42:51.425774] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-08T17:42:51.425952] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-08T17:42:51.426576] [DEBUG] [LOCAL ] BNH: Trimmed 6960 records to 5238 (keeping 200 days of data) [2025-10-08T17:42:51.487745] [DEBUG] [LOCAL ] BNH: Primary data saved (5238 records). [2025-10-08T17:42:51.487959] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-08T17:42:51.488092] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNH took 22.6s. Estimated remaining: 4h 40m 21s. Rate: 7.3 symbols/min [2025-10-08T17:42:51.565668] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:42:51.680191] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:42:51.686280] [DEBUG] [LOCAL ] BNT: Loaded 3349 existing records from primary storage. [2025-10-08T17:42:51.686468] [INFO ] [MAIN ] BNT: Loaded 3349 existing records. [2025-10-08T17:42:51.881669] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:42:51.882028] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-08T17:42:51.882101] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-08T17:42:51.885792] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-08T17:42:51.885754] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T17:42:51.885948] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-08T17:42:52.027763] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-08T17:42:52.259598] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:42:52.817607] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-08T17:42:53.359293] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:42:53.617565] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-08T17:42:54.417588] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-08T17:42:54.496688] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T17:42:55.064998] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T17:42:55.092017] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:42:55.217562] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-08T17:42:55.638125] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T17:42:56.017588] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-08T17:42:56.476420] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:42:56.817623] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-08T17:42:57.617633] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-08T17:42:58.072758] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T17:42:58.417525] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-08T17:42:58.521854] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:42:59.217540] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-08T17:43:00.017598] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-08T17:43:00.261999] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T17:43:00.798549] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T17:43:00.817554] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-08T17:43:01.008867] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:43:01.249383] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:43:01.617617] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-08T17:43:02.184967] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T17:43:02.417618] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-08T17:43:02.961533] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T17:43:03.217604] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-08T17:43:04.017554] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-08T17:43:04.817620] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-08T17:43:05.039011] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T17:43:05.251792] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T17:43:05.612983] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T17:43:05.617489] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-08T17:43:06.176212] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T17:43:06.417559] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-08T17:43:07.217597] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-08T17:43:07.794069] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T17:43:08.017548] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-08T17:43:08.069879] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:43:08.817608] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-08T17:43:09.597781] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T17:43:09.617519] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-08T17:43:10.426105] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-08T17:43:10.433372] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:43:11.070630] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T17:43:11.173620] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T17:43:11.174479] [INFO ] [REMOTE ] BNJ: Full fetch complete (4234 records). [2025-10-08T17:43:11.174548] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-08T17:43:11.227857] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-08T17:43:11.544763] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-08T17:43:11.544845] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-08T17:43:11.544978] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-08T17:43:11.545021] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-08T17:43:11.545371] [DEBUG] [LOCAL ] BNJ: Trimmed 4234 records to 2673 (keeping 200 days of data) [2025-10-08T17:43:11.563905] [DEBUG] [LOCAL ] BNJ: Primary data saved (2673 records). [2025-10-08T17:43:11.564050] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-08T17:43:11.564141] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 39.6s. Estimated remaining: 4h 41m 30s. Rate: 7.3 symbols/min [2025-10-08T17:43:11.740840] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:11.750265] [DEBUG] [LOCAL ] BNY: Loaded 7242 existing records from primary storage. [2025-10-08T17:43:11.750514] [INFO ] [MAIN ] BNY: Loaded 7242 existing records. [2025-10-08T17:43:11.931736] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:11.931955] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-08T17:43:11.932001] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-08T17:43:11.932155] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-08T17:43:11.932193] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-08T17:43:12.023420] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-08T17:43:12.307479] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:12.472469] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:43:12.750059] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T17:43:12.817616] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-08T17:43:13.617557] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-08T17:43:14.309265] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T17:43:14.417531] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-08T17:43:15.217551] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-08T17:43:15.343033] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T17:43:15.693935] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:43:16.017586] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-08T17:43:16.330568] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:43:16.356060] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T17:43:16.817573] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-08T17:43:17.617614] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-08T17:43:18.367496] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T17:43:18.371268] [INFO ] [REMOTE ] BNS: Full fetch complete (73977 records). [2025-10-08T17:43:18.371386] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-08T17:43:18.372217] [FATAL] [VALIDATOR ] BNS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:43:18.372363] [FATAL] [MAIN ] BNS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:43:18.372408] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:43:18.372447] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-08T17:43:18.372505] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-08T17:43:18.372539] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-10-08T17:43:18.372844] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-10-08T17:43:18.372939] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNS took 30.3s. Estimated remaining: 4h 41m 13s. Rate: 7.3 symbols/min [2025-10-08T17:43:18.428737] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-08T17:43:18.579871] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:18.598218] [DEBUG] [LOCAL ] BOC: Loaded 18321 existing records from primary storage. [2025-10-08T17:43:18.598461] [INFO ] [MAIN ] BOC: Loaded 18321 existing records. [2025-10-08T17:43:18.774903] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:18.775308] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-08T17:43:18.775356] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-08T17:43:18.775599] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-08T17:43:18.775690] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-08T17:43:19.148390] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:19.189526] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T17:43:19.217508] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-08T17:43:19.265735] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:43:20.017568] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-08T17:43:20.246443] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T17:43:20.755871] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:43:20.817583] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-08T17:43:21.617557] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-08T17:43:22.149120] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T17:43:22.150041] [INFO ] [REMOTE ] BNT: Full fetch complete (4522 records). [2025-10-08T17:43:22.150111] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-08T17:43:22.427853] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-08T17:43:22.556327] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-08T17:43:22.556502] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-08T17:43:22.556747] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-08T17:43:22.556907] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-08T17:43:22.557858] [DEBUG] [LOCAL ] BNT: Trimmed 4522 records to 3347 (keeping 200 days of data) [2025-10-08T17:43:22.605699] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T17:43:22.621270] [DEBUG] [LOCAL ] BNT: Primary data saved (3347 records). [2025-10-08T17:43:22.621388] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-08T17:43:22.621480] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 31.1s. Estimated remaining: 4h 40m 39s. Rate: 7.3 symbols/min [2025-10-08T17:43:23.217501] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-08T17:43:23.304921] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T17:43:23.827705] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T17:43:24.017605] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-08T17:43:24.817598] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-08T17:43:25.400438] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T17:43:25.487734] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T17:43:25.491494] [INFO ] [REMOTE ] BNL: Full fetch complete (67123 records). [2025-10-08T17:43:25.491594] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-08T17:43:25.630998] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-08T17:43:25.886925] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-08T17:43:25.887105] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-08T17:43:25.888019] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-08T17:43:25.888094] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-08T17:43:25.889770] [DEBUG] [LOCAL ] BNL: Trimmed 67123 records to 47176 (keeping 200 days of data) [2025-10-08T17:43:26.199059] [DEBUG] [LOCAL ] BNL: Primary data saved (47176 records). [2025-10-08T17:43:26.199225] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-08T17:43:26.199332] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNL took 41.3s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-08T17:43:26.417561] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-08T17:43:26.536186] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:43:27.217598] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-08T17:43:27.314829] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T17:43:28.017611] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-08T17:43:28.461000] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:43:28.734595] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T17:43:28.817567] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-08T17:43:29.617561] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-08T17:43:29.850807] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:43:30.417572] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-08T17:43:30.577354] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T17:43:31.217524] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-08T17:43:31.395067] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:43:31.616960] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T17:43:32.017548] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-08T17:43:32.817603] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-08T17:43:32.968892] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T17:43:33.522162] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T17:43:33.617537] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-08T17:43:34.384019] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:43:34.417493] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-08T17:43:35.217525] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-08T17:43:35.295599] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T17:43:36.017572] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-08T17:43:36.135399] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T17:43:36.799388] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T17:43:36.800841] [INFO ] [REMOTE ] BNY: Full fetch complete (10542 records). [2025-10-08T17:43:36.800914] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-08T17:43:36.836139] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-08T17:43:37.179250] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-08T17:43:37.179333] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-08T17:43:37.179599] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-08T17:43:37.179637] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-08T17:43:37.180182] [DEBUG] [LOCAL ] BNY: Trimmed 10542 records to 7144 (keeping 200 days of data) [2025-10-08T17:43:37.223612] [DEBUG] [LOCAL ] BNY: Primary data saved (7144 records). [2025-10-08T17:43:37.223796] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-08T17:43:37.223886] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 25.7s. Estimated remaining: 4h 40m 11s. Rate: 7.3 symbols/min [2025-10-08T17:43:37.819795] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:43:37.824873] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-08T17:43:38.735796] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T17:43:38.740379] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-08T17:43:39.586592] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T17:43:39.588434] [INFO ] [REMOTE ] BOC: Full fetch complete (25706 records). [2025-10-08T17:43:39.588552] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-08T17:43:39.964998] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-08T17:43:39.965093] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-08T17:43:39.965579] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-08T17:43:39.965665] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-08T17:43:39.966412] [DEBUG] [LOCAL ] BOC: Trimmed 25706 records to 18353 (keeping 200 days of data) [2025-10-08T17:43:40.091141] [DEBUG] [LOCAL ] BOC: Primary data saved (18353 records). [2025-10-08T17:43:40.091626] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-08T17:43:40.091769] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 21.7s. Estimated remaining: 4h 39m 29s. Rate: 7.3 symbols/min [2025-10-08T17:43:40.735624] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.798574] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.860351] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.869144] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-08T17:43:40.869254] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-08T17:43:40.895076] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:43:40.895255] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-08T17:43:40.895335] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-08T17:43:40.895882] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-08T17:43:40.896166] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-08T17:43:41.139684] [DEBUG] [LOCAL ] BOH: Loaded 30506 existing records from primary storage. [2025-10-08T17:43:41.149529] [INFO ] [MAIN ] BOH: Loaded 30506 existing records. [2025-10-08T17:43:41.146610] [DEBUG] [LOCAL ] BOND: Loaded 32226 existing records from primary storage. [2025-10-08T17:43:41.147517] [DEBUG] [LOCAL ] BOOT: Loaded 40234 existing records from primary storage. [2025-10-08T17:43:41.202070] [INFO ] [MAIN ] BOOT: Loaded 40234 existing records. [2025-10-08T17:43:41.202456] [INFO ] [MAIN ] BOND: Loaded 32226 existing records. [2025-10-08T17:43:41.868802] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:41.943235] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-08T17:43:41.952241] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.972983] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.972776] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.998362] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-08T17:43:41.998077] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:43:41.999099] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.999035] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-08T17:43:41.999172] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-08T17:43:41.999310] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-08T17:43:41.999278] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-08T17:43:41.999476] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-08T17:43:42.004970] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-08T17:43:42.012123] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-08T17:43:42.012285] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-08T17:43:42.037332] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-08T17:43:43.088148] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.113131] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-08T17:43:43.209902] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.248118] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-08T17:43:43.253790] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:43:43.254410] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-08T17:43:43.270451] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:43:43.275697] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-08T17:43:44.391134] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:43:44.396190] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-08T17:43:44.489824] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:43:44.496300] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-08T17:43:44.603924] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:43:44.605439] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T17:43:44.817576] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-08T17:43:45.028000] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T17:43:45.617551] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-08T17:43:45.678276] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T17:43:46.364947] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:43:46.417517] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-08T17:43:46.447594] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T17:43:47.217628] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-08T17:43:47.775072] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:43:48.017586] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-08T17:43:48.426028] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:43:48.817520] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-08T17:43:49.052860] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T17:43:49.617564] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-08T17:43:50.159396] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:43:50.417558] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-08T17:43:51.052084] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T17:43:51.217589] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-08T17:43:51.654496] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T17:43:51.818198] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T17:43:52.017591] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-08T17:43:52.817602] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-08T17:43:53.622744] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-08T17:43:53.645035] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T17:43:53.675683] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:43:54.417564] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-08T17:43:55.034959] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:43:55.217549] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-08T17:43:56.017586] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-08T17:43:56.178621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T17:43:56.344504] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:43:56.817544] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-08T17:43:56.843612] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:43:57.617571] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-08T17:43:58.134034] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T17:43:58.417595] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-08T17:43:58.526742] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:43:59.217707] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-08T17:43:59.723205] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:44:00.017613] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-08T17:44:00.572750] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:44:00.817600] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-08T17:44:01.301704] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T17:44:01.617607] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-08T17:44:02.005485] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T17:44:02.417582] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-08T17:44:03.120214] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:44:03.217565] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-08T17:44:03.813799] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:44:04.017570] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-08T17:44:04.322199] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T17:44:04.817718] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-08T17:44:05.435405] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:44:05.617703] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-08T17:44:05.993630] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:44:06.417560] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-08T17:44:06.741782] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:44:06.743931] [INFO ] [REMOTE ] BOE: Full fetch complete (26747 records). [2025-10-08T17:44:06.744066] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-08T17:44:07.214332] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-08T17:44:07.214459] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-08T17:44:07.215135] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-08T17:44:07.215232] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-08T17:44:07.216232] [DEBUG] [LOCAL ] BOE: Trimmed 26747 records to 18088 (keeping 200 days of data) [2025-10-08T17:44:07.217577] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-08T17:44:07.342115] [DEBUG] [LOCAL ] BOE: Primary data saved (18088 records). [2025-10-08T17:44:07.342283] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-08T17:44:07.342366] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOE took 27.2s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-08T17:44:07.568868] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:07.628915] [DEBUG] [LOCAL ] BORR: Loaded 51100 existing records from primary storage. [2025-10-08T17:44:07.629364] [INFO ] [MAIN ] BORR: Loaded 51100 existing records. [2025-10-08T17:44:07.849249] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:07.849704] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-08T17:44:07.849794] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-08T17:44:07.850214] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-08T17:44:07.850270] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-08T17:44:08.022715] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-08T17:44:08.254669] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:44:08.274295] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:08.312770] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T17:44:08.817605] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-08T17:44:09.489258] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T17:44:09.617609] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-08T17:44:10.181980] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T17:44:10.184884] [INFO ] [REMOTE ] BOOT: Full fetch complete (60054 records). [2025-10-08T17:44:10.185007] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-08T17:44:10.422731] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-08T17:44:10.578762] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-08T17:44:10.578866] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-08T17:44:10.579601] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-08T17:44:10.579666] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-08T17:44:10.581095] [DEBUG] [LOCAL ] BOOT: Trimmed 60054 records to 40139 (keeping 200 days of data) [2025-10-08T17:44:10.827536] [DEBUG] [LOCAL ] BOOT: Primary data saved (40139 records). [2025-10-08T17:44:10.827693] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-08T17:44:10.827813] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOOT took 30.7s. Estimated remaining: 4h 40m 44s. Rate: 7.3 symbols/min [2025-10-08T17:44:10.994707] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:11.018783] [DEBUG] [LOCAL ] BOW: Loaded 23806 existing records from primary storage. [2025-10-08T17:44:11.019059] [INFO ] [MAIN ] BOW: Loaded 23806 existing records. [2025-10-08T17:44:11.197010] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:11.197271] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-08T17:44:11.197357] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-08T17:44:11.197638] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-08T17:44:11.197727] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-08T17:44:11.229841] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-08T17:44:11.571460] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:11.781710] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T17:44:11.963104] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:44:12.017528] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-08T17:44:12.593894] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:44:12.817540] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-08T17:44:13.335400] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T17:44:13.617628] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-08T17:44:13.965773] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T17:44:14.417708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-08T17:44:15.217558] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-08T17:44:15.313400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:44:15.516472] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T17:44:16.017789] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-08T17:44:16.699030] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:44:16.817512] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-08T17:44:16.918164] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:44:17.617579] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-08T17:44:18.043948] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:44:18.417725] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-08T17:44:18.629069] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:44:18.633182] [INFO ] [REMOTE ] BOND: Full fetch complete (46475 records). [2025-10-08T17:44:18.633356] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-08T17:44:19.071060] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-08T17:44:19.071144] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-08T17:44:19.071740] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-08T17:44:19.071805] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-08T17:44:19.072865] [DEBUG] [LOCAL ] BOND: Trimmed 46475 records to 32252 (keeping 200 days of data) [2025-10-08T17:44:19.237714] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-08T17:44:19.284969] [DEBUG] [LOCAL ] BOND: Primary data saved (32252 records). [2025-10-08T17:44:19.285095] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-08T17:44:19.285176] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOND took 39.2s. Estimated remaining: 4h 40m 37s. Rate: 7.3 symbols/min [2025-10-08T17:44:19.464857] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:19.465094] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-08T17:44:19.465145] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-08T17:44:19.465260] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-08T17:44:19.465318] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-08T17:44:19.465426] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-08T17:44:19.465477] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-08T17:44:19.849929] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:20.017542] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-08T17:44:20.134073] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T17:44:20.300846] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:44:20.817577] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-08T17:44:21.288526] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:44:21.291915] [INFO ] [REMOTE ] BOH: Full fetch complete (44722 records). [2025-10-08T17:44:21.292144] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-08T17:44:21.622938] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-08T17:44:21.716118] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-08T17:44:21.716277] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-08T17:44:21.717067] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-08T17:44:21.717152] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-08T17:44:21.718513] [DEBUG] [LOCAL ] BOH: Trimmed 44722 records to 30374 (keeping 200 days of data) [2025-10-08T17:44:21.847455] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T17:44:21.941250] [DEBUG] [LOCAL ] BOH: Primary data saved (30374 records). [2025-10-08T17:44:21.941427] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-08T17:44:21.941519] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOH took 41.8s. Estimated remaining: 4h 39m 54s. Rate: 7.3 symbols/min [2025-10-08T17:44:22.118702] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:22.172273] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-08T17:44:22.172682] [INFO ] [MAIN ] BP: Loaded 53709 existing records. [2025-10-08T17:44:22.359740] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:22.359997] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-08T17:44:22.360046] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-08T17:44:22.360333] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-08T17:44:22.360392] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-08T17:44:22.422834] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-08T17:44:22.740854] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:23.217561] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-08T17:44:23.582705] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T17:44:24.017719] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-08T17:44:24.303727] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T17:44:24.817613] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-08T17:44:25.463423] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T17:44:25.505091] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T17:44:25.617588] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-08T17:44:25.724423] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T17:44:26.417566] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-08T17:44:27.049246] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:44:27.217551] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-08T17:44:27.986812] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T17:44:28.017508] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-08T17:44:28.792414] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T17:44:28.817492] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-08T17:44:29.273756] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:44:29.617554] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-08T17:44:30.417524] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-08T17:44:30.515209] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:44:31.217521] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-08T17:44:31.253851] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:44:31.676467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T17:44:32.017575] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-08T17:44:32.803607] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T17:44:32.817793] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-08T17:44:33.617627] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-08T17:44:33.992717] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:44:34.324025] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T17:44:34.417576] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-08T17:44:35.217525] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-08T17:44:35.326342] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:44:35.503463] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:44:36.017563] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-08T17:44:36.587179] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T17:44:36.817518] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-08T17:44:36.855302] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:44:37.617566] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-08T17:44:38.417523] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-08T17:44:38.475772] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:44:39.217561] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-08T17:44:39.442750] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T17:44:40.017545] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-08T17:44:40.191411] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:44:40.496538] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:44:40.817614] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-08T17:44:41.617537] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-08T17:44:41.910884] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:44:41.914338] [INFO ] [REMOTE ] BOW: Full fetch complete (32015 records). [2025-10-08T17:44:41.914434] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-08T17:44:42.295224] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-08T17:44:42.295367] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-08T17:44:42.295883] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-08T17:44:42.295994] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-08T17:44:42.297064] [DEBUG] [LOCAL ] BOW: Trimmed 32015 records to 23766 (keeping 200 days of data) [2025-10-08T17:44:42.422121] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-08T17:44:42.417467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-08T17:44:42.486090] [DEBUG] [LOCAL ] BOW: Primary data saved (23766 records). [2025-10-08T17:44:42.486239] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-08T17:44:42.486342] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 31.7s. Estimated remaining: 4h 41m 3s. Rate: 7.3 symbols/min [2025-10-08T17:44:42.652739] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:42.687030] [DEBUG] [LOCAL ] BR: Loaded 34891 existing records from primary storage. [2025-10-08T17:44:42.687335] [INFO ] [MAIN ] BR: Loaded 34891 existing records. [2025-10-08T17:44:42.873129] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:42.873418] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-08T17:44:42.873480] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-08T17:44:42.873764] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-08T17:44:42.873827] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-08T17:44:43.067028] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T17:44:43.157820] [INFO ] [REMOTE ] BORR: Full fetch complete (74575 records). [2025-10-08T17:44:43.183084] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-08T17:44:43.222911] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-08T17:44:43.393290] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:43.694754] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-08T17:44:43.694863] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-08T17:44:43.695789] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-08T17:44:43.695870] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-08T17:44:43.697913] [DEBUG] [LOCAL ] BORR: Trimmed 74575 records to 51092 (keeping 200 days of data) [2025-10-08T17:44:43.989846] [DEBUG] [LOCAL ] BORR: Primary data saved (51092 records). [2025-10-08T17:44:43.989999] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-08T17:44:43.990110] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BORR took 36.6s. Estimated remaining: 4h 40m 13s. Rate: 7.3 symbols/min [2025-10-08T17:44:44.022373] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-08T17:44:44.178318] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:44.213758] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:44:44.267331] [DEBUG] [LOCAL ] BRBR: Loaded 51420 existing records from primary storage. [2025-10-08T17:44:44.267739] [INFO ] [MAIN ] BRBR: Loaded 51420 existing records. [2025-10-08T17:44:44.450132] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:44.450385] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-08T17:44:44.450431] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-08T17:44:44.450676] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-08T17:44:44.450762] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-08T17:44:44.806435] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:44.817505] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-08T17:44:45.157669] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T17:44:45.367591] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T17:44:45.617593] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-08T17:44:46.359558] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:44:46.417509] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-08T17:44:46.597740] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:44:47.217597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-08T17:44:47.897789] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T17:44:48.017508] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-08T17:44:48.060366] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:44:48.817604] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-08T17:44:49.617625] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-08T17:44:50.417531] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-08T17:44:50.467636] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-08T17:44:50.638096] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T17:44:51.079085] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:44:51.217597] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-08T17:44:51.352881] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T17:44:52.017637] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-08T17:44:52.817587] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-08T17:44:53.265113] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T17:44:53.534904] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:44:53.617621] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-08T17:44:54.195679] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T17:44:54.417544] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-08T17:44:55.217561] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-08T17:44:55.413251] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T17:44:55.583448] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T17:44:56.017599] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-08T17:44:56.411324] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T17:44:56.817602] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-08T17:44:57.236308] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:44:57.240110] [INFO ] [REMOTE ] BOX: Full fetch complete (72115 records). [2025-10-08T17:44:57.240217] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-08T17:44:57.642002] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-08T17:44:57.642169] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-08T17:44:57.620826] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-08T17:44:57.642980] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-08T17:44:57.644081] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-08T17:44:57.645972] [DEBUG] [LOCAL ] BOX: Trimmed 72115 records to 50230 (keeping 200 days of data) [2025-10-08T17:44:57.938264] [DEBUG] [LOCAL ] BOX: Primary data saved (50230 records). [2025-10-08T17:44:57.938404] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-08T17:44:57.938549] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BOX took 38.7s. Estimated remaining: 4h 40m 40s. Rate: 7.3 symbols/min [2025-10-08T17:44:58.108780] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:44:58.128079] [DEBUG] [LOCAL ] BRC: Loaded 18876 existing records from primary storage. [2025-10-08T17:44:58.128316] [INFO ] [MAIN ] BRC: Loaded 18876 existing records. [2025-10-08T17:44:58.308589] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:44:58.308818] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-08T17:44:58.308900] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-08T17:44:58.309153] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-08T17:44:58.309230] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-08T17:44:58.422703] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-08T17:44:58.675418] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:44:58.918659] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T17:44:59.013201] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T17:44:59.217554] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-08T17:45:00.025590] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-08T17:45:00.045543] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:45:00.482206] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T17:45:00.817588] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-08T17:45:01.236401] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T17:45:01.617597] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-08T17:45:01.958559] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T17:45:02.417579] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-08T17:45:02.796635] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:45:03.217581] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-08T17:45:04.026637] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-08T17:45:04.047728] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:45:04.817531] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-08T17:45:05.074332] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T17:45:05.336501] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-08T17:45:05.342460] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-08T17:45:05.342726] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-08T17:45:05.622594] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-08T17:45:05.747100] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-08T17:45:05.747200] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-08T17:45:05.748076] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-08T17:45:05.748147] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-08T17:45:05.749839] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 53709 (keeping 200 days of data) [2025-10-08T17:45:06.094092] [DEBUG] [LOCAL ] BP: Primary data saved (53709 records). [2025-10-08T17:45:06.094292] [INFO ] [MAIN ] BP: Full history saved. [2025-10-08T17:45:06.094396] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BP took 44.2s. Estimated remaining: 4h 40m 31s. Rate: 7.3 symbols/min [2025-10-08T17:45:06.305028] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:06.301292] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T17:45:06.352293] [DEBUG] [LOCAL ] BRCC: Loaded 40149 existing records from primary storage. [2025-10-08T17:45:06.352594] [INFO ] [MAIN ] BRCC: Loaded 40149 existing records. [2025-10-08T17:45:06.422679] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-08T17:45:06.533701] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:06.533926] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-08T17:45:06.533973] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-08T17:45:06.534228] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-08T17:45:06.534287] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-08T17:45:06.944232] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:07.217508] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-08T17:45:07.545302] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T17:45:07.669520] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T17:45:08.017569] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-08T17:45:08.757523] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T17:45:08.817566] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-08T17:45:09.080750] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:45:09.617629] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-08T17:45:10.417543] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-08T17:45:10.739473] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T17:45:10.943717] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:45:10.946508] [INFO ] [REMOTE ] BR: Full fetch complete (49457 records). [2025-10-08T17:45:10.946594] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-08T17:45:11.222748] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-08T17:45:11.423730] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-08T17:45:11.436533] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-08T17:45:11.437511] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-08T17:45:11.437615] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-08T17:45:11.439385] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T17:45:11.447238] [DEBUG] [LOCAL ] BR: Trimmed 49457 records to 34795 (keeping 200 days of data) [2025-10-08T17:45:11.674662] [DEBUG] [LOCAL ] BR: Primary data saved (34795 records). [2025-10-08T17:45:11.675030] [INFO ] [MAIN ] BR: Full history saved. [2025-10-08T17:45:11.675121] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 29.2s. Estimated remaining: 4h 40m 7s. Rate: 7.3 symbols/min [2025-10-08T17:45:11.851941] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:11.902381] [DEBUG] [LOCAL ] BRO: Loaded 51940 existing records from primary storage. [2025-10-08T17:45:11.902774] [INFO ] [MAIN ] BRO: Loaded 51940 existing records. [2025-10-08T17:45:12.022787] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-08T17:45:12.087109] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:12.087427] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-08T17:45:12.087478] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-08T17:45:12.087821] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-08T17:45:12.087882] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-08T17:45:12.488975] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:12.817594] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-08T17:45:12.884506] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T17:45:12.993163] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T17:45:13.617574] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-08T17:45:14.206991] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T17:45:14.417554] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-08T17:45:15.083459] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T17:45:15.091606] [INFO ] [REMOTE ] BRBR: Full fetch complete (72229 records). [2025-10-08T17:45:15.091900] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-08T17:45:15.222716] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-08T17:45:15.549831] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-08T17:45:15.549564] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:45:15.555009] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-08T17:45:15.556112] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-08T17:45:15.556218] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-08T17:45:15.557798] [DEBUG] [LOCAL ] BRBR: Trimmed 72229 records to 51454 (keeping 200 days of data) [2025-10-08T17:45:15.871069] [DEBUG] [LOCAL ] BRBR: Primary data saved (51454 records). [2025-10-08T17:45:15.871232] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-08T17:45:15.871323] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 31.9s. Estimated remaining: 4h 39m 34s. Rate: 7.3 symbols/min [2025-10-08T17:45:16.032173] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-08T17:45:16.068417] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:16.119319] [DEBUG] [LOCAL ] BROS: Loaded 53293 existing records from primary storage. [2025-10-08T17:45:16.119743] [INFO ] [MAIN ] BROS: Loaded 53293 existing records. [2025-10-08T17:45:16.329567] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:16.329753] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-08T17:45:16.329805] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-08T17:45:16.329975] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-08T17:45:16.330015] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-08T17:45:16.726991] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:16.817524] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-08T17:45:16.897782] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:45:16.935214] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T17:45:17.617606] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-08T17:45:18.417545] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-08T17:45:18.936421] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-08T17:45:19.100518] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T17:45:19.217564] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-08T17:45:19.667441] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T17:45:20.007247] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T17:45:20.009187] [INFO ] [REMOTE ] BRC: Full fetch complete (28818 records). [2025-10-08T17:45:20.009269] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-08T17:45:20.022711] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-08T17:45:20.394487] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-08T17:45:20.394609] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-08T17:45:20.395175] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-08T17:45:20.395281] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-08T17:45:20.396309] [DEBUG] [LOCAL ] BRC: Trimmed 28818 records to 18784 (keeping 200 days of data) [2025-10-08T17:45:20.518591] [DEBUG] [LOCAL ] BRC: Primary data saved (18784 records). [2025-10-08T17:45:20.518783] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-08T17:45:20.518881] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 22.6s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-08T17:45:20.717625] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:20.717874] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-08T17:45:20.717931] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-08T17:45:20.718049] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-08T17:45:20.718094] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-08T17:45:20.718136] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-08T17:45:20.718169] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-08T17:45:20.823808] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-08T17:45:21.138086] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:21.617536] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-08T17:45:21.817054] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:45:21.817563] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-08T17:45:21.817690] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:45:21.817749] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-08T17:45:21.817810] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:45:21.817886] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-08T17:45:21.817961] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-08T17:45:21.817999] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-08T17:45:21.818040] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-08T17:45:21.818092] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRSL took 1.3s. Estimated remaining: 4h 38m 13s. Rate: 7.3 symbols/min [2025-10-08T17:45:22.029995] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:22.070169] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T17:45:22.117008] [DEBUG] [LOCAL ] BRSP: Loaded 36656 existing records from primary storage. [2025-10-08T17:45:22.117325] [INFO ] [MAIN ] BRSP: Loaded 36656 existing records. [2025-10-08T17:45:22.328601] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T17:45:22.334707] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:22.335001] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-08T17:45:22.343167] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-08T17:45:22.344467] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-08T17:45:22.344530] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-08T17:45:22.422674] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-08T17:45:22.726197] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:23.217568] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-08T17:45:23.998521] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:45:24.017521] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-08T17:45:24.817529] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-08T17:45:25.096914] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:45:25.450900] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T17:45:25.617565] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-08T17:45:26.417552] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-08T17:45:26.668304] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T17:45:27.113432] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T17:45:27.217562] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-08T17:45:27.584839] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:45:28.017550] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-08T17:45:28.307914] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:45:28.817570] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-08T17:45:29.617558] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-08T17:45:30.097506] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T17:45:30.417521] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-08T17:45:30.730616] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T17:45:31.064251] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T17:45:31.217555] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-08T17:45:32.017511] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-08T17:45:32.107418] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:45:32.663561] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T17:45:32.817541] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-08T17:45:33.096401] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T17:45:33.617556] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-08T17:45:34.169322] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T17:45:34.417556] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-08T17:45:34.621346] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T17:45:35.217608] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-08T17:45:35.841449] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T17:45:35.844586] [INFO ] [REMOTE ] BRCC: Full fetch complete (57522 records). [2025-10-08T17:45:35.844770] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-08T17:45:36.027772] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-08T17:45:36.258316] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-08T17:45:36.258424] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-08T17:45:36.259278] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-08T17:45:36.259366] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-08T17:45:36.260813] [DEBUG] [LOCAL ] BRCC: Trimmed 57522 records to 40168 (keeping 200 days of data) [2025-10-08T17:45:36.530669] [DEBUG] [LOCAL ] BRCC: Primary data saved (40168 records). [2025-10-08T17:45:36.531136] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-08T17:45:36.531287] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRCC took 30.4s. Estimated remaining: 4h 38m 44s. Rate: 7.3 symbols/min [2025-10-08T17:45:36.729392] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:36.729817] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-08T17:45:36.730005] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-08T17:45:36.737575] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-08T17:45:36.751520] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-08T17:45:36.752230] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-08T17:45:36.752276] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-08T17:45:36.785574] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:45:36.818427] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-08T17:45:37.144559] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:37.617499] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-08T17:45:37.944171] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T17:45:38.417563] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-08T17:45:38.786812] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:45:39.178627] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T17:45:39.217533] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-08T17:45:40.017586] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-08T17:45:40.309309] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T17:45:40.396307] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:45:40.817573] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-08T17:45:41.617503] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-08T17:45:41.682458] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T17:45:41.702834] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T17:45:42.417571] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-08T17:45:42.927179] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:45:43.217610] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-08T17:45:44.017530] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-08T17:45:44.129443] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:45:44.691974] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T17:45:44.817635] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-08T17:45:45.547695] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T17:45:45.617613] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-08T17:45:46.121117] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T17:45:46.255105] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T17:45:46.417550] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-08T17:45:46.856171] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T17:45:47.217619] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-08T17:45:48.017580] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-08T17:45:48.817598] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-08T17:45:49.072191] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T17:45:49.416551] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T17:45:49.617566] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-08T17:45:49.787675] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T17:45:50.417550] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-08T17:45:50.919935] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T17:45:50.923787] [INFO ] [REMOTE ] BRO: Full fetch complete (74023 records). [2025-10-08T17:45:50.923911] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-08T17:45:50.924834] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:45:50.924932] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:45:50.924977] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:45:50.925018] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-08T17:45:50.925079] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-08T17:45:50.925115] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-08T17:45:50.925552] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-10-08T17:45:50.925679] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 39.3s. Estimated remaining: 4h 39m 14s. Rate: 7.3 symbols/min [2025-10-08T17:45:51.144576] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:51.144805] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-08T17:45:51.144850] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-08T17:45:51.144965] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-08T17:45:51.145008] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-08T17:45:51.145050] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-08T17:45:51.145084] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-08T17:45:51.227803] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-08T17:45:51.524845] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:45:51.916462] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T17:45:52.017566] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-08T17:45:52.718174] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-08T17:45:52.817623] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-08T17:45:53.294629] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T17:45:53.617695] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-08T17:45:53.980781] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:45:54.073584] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T17:45:54.417568] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-08T17:45:54.863703] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T17:45:55.217581] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-08T17:45:56.017585] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-08T17:45:56.513155] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:45:56.547264] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T17:45:56.817614] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-08T17:45:57.617565] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-08T17:45:58.024185] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T17:45:58.417586] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-08T17:45:58.737111] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T17:45:58.740359] [INFO ] [REMOTE ] BRSP: Full fetch complete (54237 records). [2025-10-08T17:45:58.740487] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-08T17:45:59.060358] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T17:45:59.136596] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-08T17:45:59.136712] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-08T17:45:59.137335] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-08T17:45:59.137377] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-08T17:45:59.138445] [DEBUG] [LOCAL ] BRSP: Trimmed 54237 records to 36626 (keeping 200 days of data) [2025-10-08T17:45:59.223507] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-08T17:45:59.352491] [DEBUG] [LOCAL ] BRSP: Primary data saved (36626 records). [2025-10-08T17:45:59.352632] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-08T17:45:59.352752] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSP took 37.5s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-08T17:45:59.524449] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:45:59.577063] [DEBUG] [LOCAL ] BRX: Loaded 51770 existing records from primary storage. [2025-10-08T17:45:59.577414] [INFO ] [MAIN ] BRX: Loaded 51770 existing records. [2025-10-08T17:45:59.753796] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:45:59.754076] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-08T17:45:59.754138] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-08T17:45:59.754680] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-08T17:45:59.754740] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-08T17:46:00.027261] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-08T17:46:00.110795] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:00.668749] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:46:00.817574] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-08T17:46:01.435184] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T17:46:01.617508] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-08T17:46:01.850752] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:46:02.417586] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-08T17:46:02.546929] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T17:46:02.548038] [INFO ] [REMOTE ] BRT: Full fetch complete (6836 records). [2025-10-08T17:46:02.548112] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-08T17:46:02.912295] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-08T17:46:02.912375] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-08T17:46:02.912572] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-08T17:46:02.912610] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-08T17:46:02.913071] [DEBUG] [LOCAL ] BRT: Trimmed 6836 records to 4995 (keeping 200 days of data) [2025-10-08T17:46:02.944050] [DEBUG] [LOCAL ] BRT: Primary data saved (4995 records). [2025-10-08T17:46:02.944169] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-08T17:46:02.944241] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRT took 26.4s. Estimated remaining: 4h 38m 31s. Rate: 7.3 symbols/min [2025-10-08T17:46:03.120896] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:03.154957] [DEBUG] [LOCAL ] BSAC: Loaded 32827 existing records from primary storage. [2025-10-08T17:46:03.155267] [INFO ] [MAIN ] BSAC: Loaded 32827 existing records. [2025-10-08T17:46:03.226091] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-08T17:46:03.383817] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:03.384087] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-08T17:46:03.384156] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-08T17:46:03.384466] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-08T17:46:03.384524] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-08T17:46:03.850237] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:04.017575] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-08T17:46:04.273667] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:46:04.321844] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:46:04.817610] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-08T17:46:05.149034] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T17:46:05.617572] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-08T17:46:06.417559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-08T17:46:06.579439] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:46:06.900269] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T17:46:06.904356] [INFO ] [REMOTE ] BROS: Full fetch complete (77066 records). [2025-10-08T17:46:06.904494] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-08T17:46:07.245441] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-08T17:46:07.343306] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-08T17:46:07.343406] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-08T17:46:07.344258] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-08T17:46:07.344329] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-08T17:46:07.346113] [DEBUG] [LOCAL ] BROS: Trimmed 77066 records to 53299 (keeping 200 days of data) [2025-10-08T17:46:07.684983] [DEBUG] [LOCAL ] BROS: Primary data saved (53299 records). [2025-10-08T17:46:07.685138] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-08T17:46:07.685225] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BROS took 51.8s. Estimated remaining: 4h 38m 2s. Rate: 7.3 symbols/min [2025-10-08T17:46:07.857162] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:07.857331] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-08T17:46:07.857368] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-08T17:46:07.857476] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-08T17:46:07.857520] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-08T17:46:07.857576] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-08T17:46:07.857609] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-08T17:46:08.029870] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-08T17:46:08.216212] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:08.249453] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:46:08.486176] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:46:08.817597] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-08T17:46:08.942416] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T17:46:09.617565] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-08T17:46:09.920295] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:46:10.417542] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-08T17:46:10.933422] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T17:46:11.217555] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-08T17:46:12.022700] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-08T17:46:12.041673] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T17:46:12.228090] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T17:46:12.817553] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-08T17:46:12.908989] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T17:46:13.617575] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-08T17:46:14.139900] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T17:46:14.417559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-08T17:46:14.909917] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T17:46:15.217590] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-08T17:46:16.017604] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-08T17:46:16.235545] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:46:16.284535] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:46:16.817602] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-08T17:46:17.602783] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T17:46:17.617508] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-08T17:46:18.417533] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-08T17:46:18.585255] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:46:18.767751] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:46:19.217600] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-08T17:46:19.563271] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T17:46:20.017572] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-08T17:46:20.670400] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T17:46:20.817559] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-08T17:46:21.298373] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T17:46:21.617509] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-08T17:46:22.424483] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-08T17:46:22.430540] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T17:46:22.489463] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T17:46:23.217561] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-08T17:46:23.736367] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T17:46:23.865493] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T17:46:24.017543] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-08T17:46:24.817554] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-08T17:46:25.278975] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T17:46:25.617519] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-08T17:46:25.708026] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T17:46:26.417531] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-08T17:46:26.898475] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:46:26.902052] [INFO ] [REMOTE ] BRW: Full fetch complete (30514 records). [2025-10-08T17:46:26.902153] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-08T17:46:27.222727] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-08T17:46:27.295457] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-08T17:46:27.295572] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-08T17:46:27.296042] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-08T17:46:27.296106] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-08T17:46:27.296918] [DEBUG] [LOCAL ] BRW: Trimmed 30514 records to 20738 (keeping 200 days of data) [2025-10-08T17:46:27.423417] [DEBUG] [LOCAL ] BRW: Primary data saved (20738 records). [2025-10-08T17:46:27.423543] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-08T17:46:27.423634] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 36.5s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-08T17:46:27.606617] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:27.606866] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-08T17:46:27.606976] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-08T17:46:27.614101] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-08T17:46:27.627060] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-08T17:46:27.627945] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-08T17:46:27.629056] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:46:27.636304] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-08T17:46:27.999027] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:28.017500] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-08T17:46:28.615793] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:46:28.618679] [INFO ] [REMOTE ] BSAC: Full fetch complete (44113 records). [2025-10-08T17:46:28.618776] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-08T17:46:28.725738] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T17:46:28.822622] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-08T17:46:29.026279] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-08T17:46:29.026362] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-08T17:46:29.026907] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-08T17:46:29.026970] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-08T17:46:29.027901] [DEBUG] [LOCAL ] BSAC: Trimmed 44113 records to 32782 (keeping 200 days of data) [2025-10-08T17:46:29.220253] [DEBUG] [LOCAL ] BSAC: Primary data saved (32782 records). [2025-10-08T17:46:29.220422] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-08T17:46:29.220529] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSAC took 26.3s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-08T17:46:29.390046] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:29.423131] [DEBUG] [LOCAL ] BSM: Loaded 32094 existing records from primary storage. [2025-10-08T17:46:29.423411] [INFO ] [MAIN ] BSM: Loaded 32094 existing records. [2025-10-08T17:46:29.600676] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:29.600898] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-08T17:46:29.600944] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-08T17:46:29.601179] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-08T17:46:29.601237] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-08T17:46:29.622832] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-08T17:46:29.964896] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:30.059533] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T17:46:30.417540] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-08T17:46:31.217599] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-08T17:46:31.548604] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T17:46:32.021286] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T17:46:32.019086] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-08T17:46:32.030681] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T17:46:32.817616] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-08T17:46:33.342977] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:46:33.617528] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-08T17:46:33.659059] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T17:46:34.417538] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-08T17:46:35.042857] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:46:35.217603] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-08T17:46:35.689869] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:46:36.017625] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-08T17:46:36.541398] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:46:36.817628] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-08T17:46:37.307915] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T17:46:37.617635] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-08T17:46:38.417542] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-08T17:46:38.519720] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T17:46:38.918959] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:46:39.036287] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T17:46:39.217555] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-08T17:46:40.017619] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-08T17:46:40.527100] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:46:40.529959] [INFO ] [REMOTE ] BSBR: Full fetch complete (50544 records). [2025-10-08T17:46:40.530068] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-08T17:46:40.822728] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-08T17:46:40.908174] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-08T17:46:40.908270] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-08T17:46:40.908929] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-08T17:46:40.908991] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-08T17:46:40.910110] [DEBUG] [LOCAL ] BSBR: Trimmed 50544 records to 35362 (keeping 200 days of data) [2025-10-08T17:46:41.115470] [DEBUG] [LOCAL ] BSBR: Primary data saved (35362 records). [2025-10-08T17:46:41.115670] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-08T17:46:41.115793] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BSBR took 33.4s. Estimated remaining: 4h 38m 30s. Rate: 7.3 symbols/min [2025-10-08T17:46:41.288837] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:41.308770] [DEBUG] [LOCAL ] BST: Loaded 19001 existing records from primary storage. [2025-10-08T17:46:41.309097] [INFO ] [MAIN ] BST: Loaded 19001 existing records. [2025-10-08T17:46:41.518826] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:46:41.520704] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-08T17:46:41.520891] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-08T17:46:41.522891] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T17:46:41.532847] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-08T17:46:41.533058] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-08T17:46:41.622847] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-08T17:46:41.646158] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:46:41.902716] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:42.417593] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-08T17:46:43.217528] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-08T17:46:43.363160] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T17:46:43.367939] [INFO ] [REMOTE ] BRX: Full fetch complete (74965 records). [2025-10-08T17:46:43.368115] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-08T17:46:43.742401] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T17:46:43.817029] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-08T17:46:43.816809] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T17:46:43.827593] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-08T17:46:43.829718] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-08T17:46:43.829802] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-08T17:46:43.831306] [DEBUG] [LOCAL ] BRX: Trimmed 74965 records to 51779 (keeping 200 days of data) [2025-10-08T17:46:44.027194] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-08T17:46:44.174904] [DEBUG] [LOCAL ] BRX: Primary data saved (51779 records). [2025-10-08T17:46:44.175055] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-08T17:46:44.175170] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BRX took 44.8s. Estimated remaining: 4h 37m 51s. Rate: 7.3 symbols/min [2025-10-08T17:46:44.344188] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:44.344385] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-08T17:46:44.344421] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-08T17:46:44.344533] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-08T17:46:44.344574] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-08T17:46:44.344614] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-08T17:46:44.344670] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-08T17:46:44.689157] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:44.817566] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-08T17:46:45.567189] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T17:46:45.617531] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-08T17:46:45.789906] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T17:46:46.417609] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-08T17:46:46.554237] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:46:47.217584] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-08T17:46:47.244765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:46:48.017509] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-08T17:46:48.335109] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:46:48.803977] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T17:46:48.817534] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-08T17:46:49.617581] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-08T17:46:49.648445] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T17:46:50.417624] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-08T17:46:50.692405] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T17:46:51.217621] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-08T17:46:51.766770] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:46:51.780493] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T17:46:52.017606] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-08T17:46:52.817572] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-08T17:46:53.230309] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T17:46:53.574040] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T17:46:53.617561] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-08T17:46:54.333105] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T17:46:54.334381] [INFO ] [REMOTE ] BSL: Full fetch complete (12702 records). [2025-10-08T17:46:54.334451] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-08T17:46:54.422731] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-08T17:46:54.699752] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-08T17:46:54.699838] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-08T17:46:54.700132] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-08T17:46:54.700171] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-08T17:46:54.700625] [DEBUG] [LOCAL ] BSL: Trimmed 12702 records to 8181 (keeping 200 days of data) [2025-10-08T17:46:54.750779] [DEBUG] [LOCAL ] BSL: Primary data saved (8181 records). [2025-10-08T17:46:54.750910] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-08T17:46:54.751019] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 27.3s. Estimated remaining: 4h 37m 56s. Rate: 7.3 symbols/min [2025-10-08T17:46:54.927437] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:46:54.927683] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-08T17:46:54.927742] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-08T17:46:54.927857] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-08T17:46:54.927900] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-08T17:46:54.927942] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-08T17:46:54.927979] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-08T17:46:55.222784] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-08T17:46:55.280327] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:46:56.017625] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-08T17:46:56.042705] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:46:56.488840] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:46:56.817709] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-08T17:46:56.963225] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:46:57.617601] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-08T17:46:58.417516] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-08T17:46:58.622825] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:46:58.767479] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:46:59.217600] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-08T17:46:59.981083] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T17:47:00.017542] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-08T17:47:00.492431] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T17:47:00.817603] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-08T17:47:01.474856] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T17:47:01.617547] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-08T17:47:02.417575] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-08T17:47:02.774156] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T17:47:02.828997] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:47:03.217618] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-08T17:47:03.496766] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T17:47:04.017588] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-08T17:47:04.817525] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-08T17:47:04.913341] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:47:05.054688] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:47:05.617560] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-08T17:47:05.914139] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:47:06.331039] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T17:47:06.417566] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-08T17:47:07.217557] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-08T17:47:07.635105] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T17:47:08.017614] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-08T17:47:08.443707] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:47:08.817602] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-08T17:47:09.617705] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-08T17:47:09.824743] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T17:47:09.826882] [INFO ] [REMOTE ] BST: Full fetch complete (28720 records). [2025-10-08T17:47:09.826967] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-08T17:47:09.976841] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T17:47:10.247003] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-08T17:47:10.247089] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-08T17:47:10.247526] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-08T17:47:10.247565] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-08T17:47:10.248425] [DEBUG] [LOCAL ] BST: Trimmed 28720 records to 18984 (keeping 200 days of data) [2025-10-08T17:47:10.362405] [DEBUG] [LOCAL ] BST: Primary data saved (18984 records). [2025-10-08T17:47:10.362559] [INFO ] [MAIN ] BST: Full history saved. [2025-10-08T17:47:10.362666] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BST took 29.2s. Estimated remaining: 4h 38m 32s. Rate: 7.3 symbols/min [2025-10-08T17:47:10.427213] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-08T17:47:10.539682] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:10.547484] [DEBUG] [LOCAL ] BTA: Loaded 5458 existing records from primary storage. [2025-10-08T17:47:10.547696] [INFO ] [MAIN ] BTA: Loaded 5458 existing records. [2025-10-08T17:47:10.732790] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:10.733068] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-08T17:47:10.733122] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-08T17:47:10.733307] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-08T17:47:10.733363] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-08T17:47:11.110789] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:11.166371] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T17:47:11.217556] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-08T17:47:11.343450] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T17:47:12.017566] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-08T17:47:12.817518] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-08T17:47:12.869345] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T17:47:12.956489] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:47:13.617560] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-08T17:47:13.976456] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T17:47:14.417594] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-08T17:47:14.839182] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:47:14.843133] [INFO ] [REMOTE ] BSM: Full fetch complete (47150 records). [2025-10-08T17:47:14.843313] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-08T17:47:15.221717] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-08T17:47:15.238629] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-08T17:47:15.238864] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-08T17:47:15.239586] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-08T17:47:15.239836] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-08T17:47:15.241046] [DEBUG] [LOCAL ] BSM: Trimmed 47150 records to 32179 (keeping 200 days of data) [2025-10-08T17:47:15.349194] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T17:47:15.449203] [DEBUG] [LOCAL ] BSM: Primary data saved (32179 records). [2025-10-08T17:47:15.449374] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-08T17:47:15.449479] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSM took 46.2s. Estimated remaining: 4h 38m 5s. Rate: 7.3 symbols/min [2025-10-08T17:47:15.620314] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:15.620556] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-10-08T17:47:15.620601] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-10-08T17:47:15.620741] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-08T17:47:15.620786] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-08T17:47:15.620830] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-08T17:47:15.620863] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-08T17:47:15.975760] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:16.017505] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-08T17:47:16.366054] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:47:16.817571] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-08T17:47:16.853434] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:47:17.617611] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-08T17:47:17.952130] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T17:47:17.955425] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36844 records). [2025-10-08T17:47:17.955536] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-08T17:47:18.348126] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-08T17:47:18.348206] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-08T17:47:18.348710] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-08T17:47:18.348771] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-08T17:47:18.349560] [DEBUG] [LOCAL ] BSTZ: Trimmed 36844 records to 24965 (keeping 200 days of data) [2025-10-08T17:47:18.436981] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-08T17:47:18.481079] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T17:47:18.521121] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24965 records). [2025-10-08T17:47:18.521270] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-08T17:47:18.521353] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BSTZ took 34.3s. Estimated remaining: 4h 37m 27s. Rate: 7.3 symbols/min [2025-10-08T17:47:18.690325] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:18.739814] [DEBUG] [LOCAL ] BTE: Loaded 52715 existing records from primary storage. [2025-10-08T17:47:18.740189] [INFO ] [MAIN ] BTE: Loaded 52715 existing records. [2025-10-08T17:47:18.915699] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:18.916016] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-08T17:47:18.916073] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-08T17:47:18.916372] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-08T17:47:18.916451] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-08T17:47:19.218635] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-08T17:47:19.315204] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T17:47:19.348425] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:19.900628] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T17:47:20.017562] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-08T17:47:20.817601] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-08T17:47:21.404823] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T17:47:21.617566] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-08T17:47:22.061578] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T17:47:22.281998] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:47:22.417554] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-08T17:47:23.217606] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-08T17:47:24.017570] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-08T17:47:24.335261] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T17:47:24.750799] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T17:47:24.817548] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-08T17:47:25.077233] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T17:47:25.617565] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-08T17:47:26.222935] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T17:47:26.417512] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-08T17:47:26.624008] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:47:27.083239] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T17:47:27.217588] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-08T17:47:27.872832] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:47:28.017564] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-08T17:47:28.695217] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T17:47:28.817568] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-08T17:47:29.617558] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-08T17:47:30.417522] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-08T17:47:30.707477] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T17:47:31.217149] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T17:47:31.226741] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-08T17:47:31.257241] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T17:47:31.843402] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T17:47:32.017543] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-08T17:47:32.755812] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T17:47:32.817507] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-08T17:47:33.369545] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T17:47:33.617538] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-08T17:47:34.417554] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-08T17:47:35.190157] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:47:35.191227] [INFO ] [REMOTE ] BTA: Full fetch complete (9500 records). [2025-10-08T17:47:35.191300] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-08T17:47:35.222799] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-08T17:47:35.595844] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-08T17:47:35.596431] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-08T17:47:35.597085] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T17:47:35.597384] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-08T17:47:35.604185] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-08T17:47:35.605532] [DEBUG] [LOCAL ] BTA: Trimmed 9500 records to 5488 (keeping 200 days of data) [2025-10-08T17:47:35.638082] [DEBUG] [LOCAL ] BTA: Primary data saved (5488 records). [2025-10-08T17:47:35.638185] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-08T17:47:35.638267] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 25.3s. Estimated remaining: 4h 38m 11s. Rate: 7.3 symbols/min [2025-10-08T17:47:35.804803] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:35.855464] [DEBUG] [LOCAL ] BTI: Loaded 53572 existing records from primary storage. [2025-10-08T17:47:35.855883] [INFO ] [MAIN ] BTI: Loaded 53572 existing records. [2025-10-08T17:47:36.025522] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-08T17:47:36.071078] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:36.072218] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-08T17:47:36.072309] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-08T17:47:36.072602] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-08T17:47:36.072694] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-08T17:47:36.431539] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:36.817553] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-08T17:47:37.062314] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:47:37.617721] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-08T17:47:38.004221] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T17:47:38.070330] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T17:47:38.210609] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T17:47:38.214883] [INFO ] [REMOTE ] BSX: Full fetch complete (77309 records). [2025-10-08T17:47:38.215097] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-08T17:47:38.216143] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:47:38.216288] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:47:38.216336] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:47:38.216412] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-08T17:47:38.216527] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-08T17:47:38.216586] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-08T17:47:38.216629] [DEBUG] [LOCAL ] BSX: No derivative data file found to delete. [2025-10-08T17:47:38.216737] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 43.5s. Estimated remaining: 4h 37m 29s. Rate: 7.3 symbols/min [2025-10-08T17:47:38.424336] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-08T17:47:38.439676] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:38.439927] [DEBUG] [LOCAL ] BTO: No existing data file found in primary storage. [2025-10-08T17:47:38.439984] [WARN ] [MAIN ] BTO: No existing data found, performing full refresh instead. [2025-10-08T17:47:38.440094] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-08T17:47:38.440148] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-08T17:47:38.440239] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-10-08T17:47:38.440307] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-08T17:47:38.899291] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:39.217549] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-08T17:47:39.845736] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T17:47:39.909988] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:47:40.017548] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-08T17:47:40.817522] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-08T17:47:40.997483] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T17:47:41.617555] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-08T17:47:42.396202] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:47:42.417522] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-08T17:47:42.911402] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T17:47:43.217587] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-08T17:47:43.827612] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:47:43.829803] [INFO ] [REMOTE ] BTCM: Full fetch complete (19637 records). [2025-10-08T17:47:43.829886] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-08T17:47:44.021936] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-08T17:47:44.248009] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-08T17:47:44.248093] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-08T17:47:44.248432] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-08T17:47:44.248473] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-08T17:47:44.249190] [DEBUG] [LOCAL ] BTCM: Trimmed 19637 records to 16133 (keeping 200 days of data) [2025-10-08T17:47:44.342787] [DEBUG] [LOCAL ] BTCM: Primary data saved (16133 records). [2025-10-08T17:47:44.342950] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-08T17:47:44.343031] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 28.9s. Estimated remaining: 4h 37m 9s. Rate: 7.3 symbols/min [2025-10-08T17:47:44.516542] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:44.533545] [DEBUG] [LOCAL ] BTT: Loaded 15845 existing records from primary storage. [2025-10-08T17:47:44.533839] [INFO ] [MAIN ] BTT: Loaded 15845 existing records. [2025-10-08T17:47:44.714028] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:44.714258] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-08T17:47:44.714304] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-08T17:47:44.714502] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-08T17:47:44.714558] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-08T17:47:44.822689] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-08T17:47:45.078864] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:45.156870] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:47:45.566345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T17:47:45.617597] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-08T17:47:46.008194] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:47:46.417631] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-08T17:47:46.546549] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T17:47:47.217619] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-08T17:47:47.430884] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:47:48.017702] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-08T17:47:48.817530] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-08T17:47:48.962636] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T17:47:49.576385] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T17:47:49.617546] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-08T17:47:49.828053] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:47:50.417525] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-08T17:47:51.217588] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-08T17:47:51.440159] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T17:47:51.725786] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T17:47:52.017545] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-08T17:47:52.101909] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T17:47:52.817560] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-08T17:47:52.853422] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:47:53.363345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T17:47:53.617585] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-08T17:47:54.417573] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-08T17:47:55.157417] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T17:47:55.217522] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-08T17:47:55.436581] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:47:56.017556] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-08T17:47:56.027574] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T17:47:56.817512] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-08T17:47:56.863196] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T17:47:57.522750] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T17:47:57.523918] [INFO ] [REMOTE ] BTO: Full fetch complete (13155 records). [2025-10-08T17:47:57.523989] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-08T17:47:57.622274] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-08T17:47:57.884436] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-08T17:47:57.884516] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-08T17:47:57.884807] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-08T17:47:57.884869] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-08T17:47:57.885378] [DEBUG] [LOCAL ] BTO: Trimmed 13155 records to 8691 (keeping 200 days of data) [2025-10-08T17:47:57.936389] [DEBUG] [LOCAL ] BTO: Primary data saved (8691 records). [2025-10-08T17:47:57.936500] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-08T17:47:57.936571] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 19.7s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-08T17:47:58.102892] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:47:58.156189] [DEBUG] [LOCAL ] BTU: Loaded 53316 existing records from primary storage. [2025-10-08T17:47:58.156538] [INFO ] [MAIN ] BTU: Loaded 53316 existing records. [2025-10-08T17:47:58.340590] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:47:58.340832] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-08T17:47:58.340879] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-08T17:47:58.341122] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-08T17:47:58.341180] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-08T17:47:58.421997] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-08T17:47:58.682995] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T17:47:58.726073] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:47:59.217614] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-08T17:48:00.017636] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-08T17:48:00.478455] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T17:48:00.627262] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T17:48:00.817553] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-08T17:48:01.550902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T17:48:01.617519] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-08T17:48:01.928478] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T17:48:02.417599] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-08T17:48:03.035302] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:48:03.217591] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-08T17:48:04.017584] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-08T17:48:04.428695] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:48:04.485822] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:48:04.817568] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-08T17:48:05.617525] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-08T17:48:05.824013] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T17:48:06.417514] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-08T17:48:06.491308] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:48:06.626947] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:48:07.217556] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-08T17:48:07.988666] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:48:08.017491] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-08T17:48:08.740064] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T17:48:08.817514] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-08T17:48:09.617605] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-08T17:48:09.641611] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:48:09.645542] [INFO ] [REMOTE ] BTE: Full fetch complete (76124 records). [2025-10-08T17:48:09.645674] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-08T17:48:10.032741] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-08T17:48:10.032824] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-08T17:48:10.033602] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-08T17:48:10.033661] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-08T17:48:10.035062] [DEBUG] [LOCAL ] BTE: Trimmed 76124 records to 52713 (keeping 200 days of data) [2025-10-08T17:48:10.342454] [DEBUG] [LOCAL ] BTE: Primary data saved (52713 records). [2025-10-08T17:48:10.342580] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-08T17:48:10.342682] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 51.8s. Estimated remaining: 4h 37m 48s. Rate: 7.3 symbols/min [2025-10-08T17:48:10.422194] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-08T17:48:10.523465] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:10.523783] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-08T17:48:10.523842] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-08T17:48:10.524009] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-08T17:48:10.524092] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-08T17:48:10.524155] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-08T17:48:10.524189] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-08T17:48:10.916048] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:10.945510] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T17:48:11.217613] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T17:48:11.217770] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-08T17:48:11.986827] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-08T17:48:12.017497] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-08T17:48:12.817509] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-08T17:48:13.229857] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T17:48:13.372010] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T17:48:13.616901] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T17:48:13.617748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-08T17:48:14.417524] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-08T17:48:14.532191] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:48:15.217568] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-08T17:48:16.017521] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-08T17:48:16.134277] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T17:48:16.817638] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-08T17:48:17.005390] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T17:48:17.163542] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T17:48:17.617512] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-08T17:48:18.417526] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-08T17:48:18.873051] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:48:18.901345] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-08T17:48:18.901541] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:48:18.903485] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T17:48:18.902239] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-08T17:48:18.915708] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:48:18.916192] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-08T17:48:18.916289] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-08T17:48:18.916348] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-08T17:48:18.916761] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-08T17:48:18.916821] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTX took 8.6s. Estimated remaining: 4h 37m 41s. Rate: 7.3 symbols/min [2025-10-08T17:48:19.085803] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:19.112128] [DEBUG] [LOCAL ] BTZ: Loaded 22735 existing records from primary storage. [2025-10-08T17:48:19.112438] [INFO ] [MAIN ] BTZ: Loaded 22735 existing records. [2025-10-08T17:48:19.222727] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-08T17:48:19.311436] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:19.311704] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-08T17:48:19.311760] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-08T17:48:19.312143] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-08T17:48:19.312201] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-08T17:48:19.611427] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T17:48:19.654703] [INFO ] [REMOTE ] BTI: Full fetch complete (77467 records). [2025-10-08T17:48:19.685250] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-08T17:48:19.685160] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:20.022634] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-08T17:48:20.110170] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-08T17:48:20.110257] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-08T17:48:20.111182] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-08T17:48:20.111254] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-08T17:48:20.112973] [DEBUG] [LOCAL ] BTI: Trimmed 77467 records to 53576 (keeping 200 days of data) [2025-10-08T17:48:20.307348] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T17:48:20.334957] [INFO ] [REMOTE ] BTT: Full fetch complete (23525 records). [2025-10-08T17:48:20.335570] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-08T17:48:20.337430] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:48:20.338073] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:48:20.338673] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:48:20.339296] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-08T17:48:20.339632] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-08T17:48:20.340023] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-08T17:48:20.341077] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-10-08T17:48:20.341187] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTT took 36.0s. Estimated remaining: 4h 36m 54s. Rate: 7.3 symbols/min [2025-10-08T17:48:20.523046] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:20.647580] [DEBUG] [LOCAL ] BUD: Loaded 52706 existing records from primary storage. [2025-10-08T17:48:20.648922] [INFO ] [MAIN ] BUD: Loaded 52706 existing records. [2025-10-08T17:48:20.824692] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-08T17:48:20.856453] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:20.858293] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-08T17:48:20.858671] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-08T17:48:20.859956] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-08T17:48:20.860313] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-08T17:48:20.979039] [DEBUG] [LOCAL ] BTI: Primary data saved (53576 records). [2025-10-08T17:48:20.984905] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-08T17:48:20.990155] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTI took 45.4s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-08T17:48:21.415311] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:21.437054] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:21.448186] [DEBUG] [LOCAL ] BUI: Loaded 11784 existing records from primary storage. [2025-10-08T17:48:21.448400] [INFO ] [MAIN ] BUI: Loaded 11784 existing records. [2025-10-08T17:48:21.631836] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:21.626006] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-08T17:48:21.632919] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-08T17:48:21.632982] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-08T17:48:21.633286] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-08T17:48:21.633345] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-08T17:48:21.931702] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T17:48:22.027128] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T17:48:22.056957] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:22.417614] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-08T17:48:23.217510] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-08T17:48:23.261977] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T17:48:23.708125] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T17:48:24.017571] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-08T17:48:24.822612] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-08T17:48:24.829544] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T17:48:25.091960] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T17:48:25.617593] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-08T17:48:26.085846] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:48:26.417557] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-08T17:48:27.217583] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-08T17:48:27.517164] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T17:48:27.520706] [INFO ] [REMOTE ] BTU: Full fetch complete (76649 records). [2025-10-08T17:48:27.520813] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-08T17:48:27.521463] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T17:48:27.521578] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:48:27.521621] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:48:27.521725] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-08T17:48:27.521790] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-08T17:48:27.521826] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-08T17:48:27.522035] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-08T17:48:27.522127] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTU took 29.6s. Estimated remaining: 4h 35m 44s. Rate: 7.3 symbols/min [2025-10-08T17:48:27.692460] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:27.692691] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-10-08T17:48:27.692787] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-10-08T17:48:27.692911] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-08T17:48:27.692952] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-08T17:48:27.693021] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-10-08T17:48:27.693065] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-08T17:48:28.003831] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T17:48:28.019532] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-08T17:48:28.110868] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:28.149305] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T17:48:28.817537] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-08T17:48:29.131059] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T17:48:29.616789] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:48:29.619023] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-08T17:48:30.417523] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-08T17:48:30.754614] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T17:48:30.996402] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T17:48:31.217566] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-08T17:48:32.017555] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-08T17:48:32.796390] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:48:32.817543] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-08T17:48:32.961829] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T17:48:33.617561] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-08T17:48:34.233314] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T17:48:34.303726] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T17:48:34.417605] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-08T17:48:35.217565] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-08T17:48:35.423688] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:48:36.017598] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-08T17:48:36.151910] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T17:48:36.817531] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-08T17:48:36.945923] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:48:37.617639] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-08T17:48:37.667839] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:48:38.417619] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-08T17:48:39.217570] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-08T17:48:39.592863] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T17:48:39.760488] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:48:39.840989] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T17:48:40.017577] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-08T17:48:40.817609] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-08T17:48:41.617525] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-08T17:48:42.010551] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T17:48:42.092502] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T17:48:42.321629] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T17:48:42.417573] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-08T17:48:43.217625] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-08T17:48:43.348766] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T17:48:44.017562] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-08T17:48:44.817569] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-08T17:48:44.932868] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:48:45.617606] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-08T17:48:45.832316] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T17:48:46.417585] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-08T17:48:46.527814] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T17:48:46.529394] [INFO ] [REMOTE ] BUI: Full fetch complete (16495 records). [2025-10-08T17:48:46.529466] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-08T17:48:46.982935] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-08T17:48:46.997340] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-08T17:48:46.998254] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-08T17:48:46.998373] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-08T17:48:47.002231] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T17:48:47.002836] [DEBUG] [LOCAL ] BUI: Trimmed 16495 records to 11839 (keeping 200 days of data) [2025-10-08T17:48:47.100178] [DEBUG] [LOCAL ] BUI: Primary data saved (11839 records). [2025-10-08T17:48:47.100389] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-08T17:48:47.100499] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUI took 26.1s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-08T17:48:47.222748] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-08T17:48:47.289574] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:47.339142] [DEBUG] [LOCAL ] BURL: Loaded 45815 existing records from primary storage. [2025-10-08T17:48:47.339588] [INFO ] [MAIN ] BURL: Loaded 45815 existing records. [2025-10-08T17:48:47.533263] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:47.533579] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-08T17:48:47.533630] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-08T17:48:47.534022] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-08T17:48:47.534083] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-08T17:48:47.935456] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:48.025355] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-08T17:48:48.042673] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:48:48.817610] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-08T17:48:49.083392] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T17:48:49.131667] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:48:49.617557] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-08T17:48:50.417522] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-08T17:48:50.451720] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T17:48:50.707349] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T17:48:50.709717] [INFO ] [REMOTE ] BTZ: Full fetch complete (33662 records). [2025-10-08T17:48:50.709823] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-08T17:48:51.073269] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-08T17:48:51.073352] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-08T17:48:51.073832] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-08T17:48:51.073895] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-08T17:48:51.074807] [DEBUG] [LOCAL ] BTZ: Trimmed 33662 records to 22689 (keeping 200 days of data) [2025-10-08T17:48:51.217686] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-08T17:48:51.220073] [DEBUG] [LOCAL ] BTZ: Primary data saved (22689 records). [2025-10-08T17:48:51.220167] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-08T17:48:51.220304] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTZ took 32.3s. Estimated remaining: 4h 36m 9s. Rate: 7.3 symbols/min [2025-10-08T17:48:51.394359] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:48:51.411025] [DEBUG] [LOCAL ] BUXX: Loaded 15298 existing records from primary storage. [2025-10-08T17:48:51.411280] [INFO ] [MAIN ] BUXX: Loaded 15298 existing records. [2025-10-08T17:48:51.588463] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:48:51.588746] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-08T17:48:51.588804] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-08T17:48:51.589010] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-08T17:48:51.589068] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-08T17:48:51.958978] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:48:52.022634] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-08T17:48:52.040704] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T17:48:52.715194] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:48:52.817578] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-08T17:48:52.981300] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T17:48:53.617547] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-08T17:48:54.181103] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T17:48:54.417574] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-08T17:48:55.171779] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:48:55.217560] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-08T17:48:56.017515] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-08T17:48:56.206937] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T17:48:56.817505] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-08T17:48:56.963743] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T17:48:57.460904] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T17:48:57.523235] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T17:48:57.617573] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-08T17:48:58.291373] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:48:58.417607] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-08T17:48:59.208298] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T17:48:59.217487] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-08T17:49:00.017540] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-08T17:49:00.200550] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:49:00.817563] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-08T17:49:01.558714] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T17:49:01.617546] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-08T17:49:02.417561] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-08T17:49:02.468337] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T17:49:02.688139] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T17:49:03.217559] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-08T17:49:04.017524] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-08T17:49:04.393897] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T17:49:04.817608] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-08T17:49:05.023814] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T17:49:05.266524] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:49:05.617575] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-08T17:49:05.910330] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:49:06.417606] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-08T17:49:07.217576] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-08T17:49:07.346445] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T17:49:07.426067] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T17:49:07.430344] [INFO ] [REMOTE ] BUD: Full fetch complete (76464 records). [2025-10-08T17:49:07.430511] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-08T17:49:07.843685] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-08T17:49:07.843820] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-08T17:49:07.844952] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-08T17:49:07.845025] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-08T17:49:07.846708] [DEBUG] [LOCAL ] BUD: Trimmed 76464 records to 52698 (keeping 200 days of data) [2025-10-08T17:49:08.026033] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-08T17:49:08.174556] [DEBUG] [LOCAL ] BUD: Primary data saved (52698 records). [2025-10-08T17:49:08.174741] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-08T17:49:08.175605] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUD took 47.8s. Estimated remaining: 4h 36m 50s. Rate: 7.3 symbols/min [2025-10-08T17:49:08.713224] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T17:49:08.817534] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-08T17:49:08.898953] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T17:49:09.364624] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:49:09.617606] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-08T17:49:10.417551] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-08T17:49:11.023148] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:49:11.217570] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-08T17:49:11.826897] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T17:49:11.830349] [INFO ] [REMOTE ] BUR: Full fetch complete (63621 records). [2025-10-08T17:49:11.830478] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-08T17:49:11.990273] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T17:49:12.041559] [INFO ] [REMOTE ] BUXX: Full fetch complete (20407 records). [2025-10-08T17:49:12.049972] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-08T17:49:12.075378] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-08T17:49:12.409518] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-08T17:49:12.410724] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-08T17:49:12.426572] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-08T17:49:12.441234] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-08T17:49:12.554252] [DEBUG] [LOCAL ] BUR: Trimmed 63621 records to 45195 (keeping 200 days of data) [2025-10-08T17:49:12.737566] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-08T17:49:12.740794] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-08T17:49:12.741538] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-08T17:49:12.742394] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-08T17:49:12.745102] [DEBUG] [LOCAL ] BUXX: Trimmed 20407 records to 15250 (keeping 200 days of data) [2025-10-08T17:49:12.944984] [DEBUG] [LOCAL ] BUXX: Primary data saved (15250 records). [2025-10-08T17:49:12.945970] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-08T17:49:12.946321] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUXX took 21.7s. Estimated remaining: 4h 36m 23s. Rate: 7.3 symbols/min [2025-10-08T17:49:13.006873] [DEBUG] [LOCAL ] BUR: Primary data saved (45195 records). [2025-10-08T17:49:13.007006] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-08T17:49:13.007081] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 45.5s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-08T17:49:13.866032] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T17:49:13.876053] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-08T17:49:15.562224] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T17:49:15.572085] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-08T17:49:17.157566] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:49:17.167533] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-08T17:49:18.690116] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T17:49:18.693417] [INFO ] [REMOTE ] BURL: Full fetch complete (65648 records). [2025-10-08T17:49:18.693559] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-08T17:49:19.116311] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-08T17:49:19.116413] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-08T17:49:19.117380] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-08T17:49:19.117452] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-08T17:49:19.119328] [DEBUG] [LOCAL ] BURL: Trimmed 65648 records to 45738 (keeping 200 days of data) [2025-10-08T17:49:19.405523] [DEBUG] [LOCAL ] BURL: Primary data saved (45738 records). [2025-10-08T17:49:19.405700] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-08T17:49:19.405843] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 32.3s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-08T17:49:20.154745] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.164743] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.215819] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.241089] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-08T17:49:20.240993] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:20.241465] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-08T17:49:20.243820] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-08T17:49:20.243892] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-08T17:49:20.243972] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-08T17:49:20.244014] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-08T17:49:20.489811] [DEBUG] [LOCAL ] BW: Loaded 40087 existing records from primary storage. [2025-10-08T17:49:20.506638] [DEBUG] [LOCAL ] BVN: Loaded 44028 existing records from primary storage. [2025-10-08T17:49:20.525513] [INFO ] [MAIN ] BW: Loaded 40087 existing records. [2025-10-08T17:49:20.595091] [INFO ] [MAIN ] BVN: Loaded 44028 existing records. [2025-10-08T17:49:20.662010] [DEBUG] [LOCAL ] BWA: Loaded 52171 existing records from primary storage. [2025-10-08T17:49:20.825776] [INFO ] [MAIN ] BWA: Loaded 52171 existing records. [2025-10-08T17:49:21.125629] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:21.161941] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-08T17:49:21.192395] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.224504] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.258910] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-08T17:49:21.347675] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-08T17:49:21.350812] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.351158] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.350986] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-08T17:49:21.351285] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-08T17:49:21.328027] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:21.393384] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-08T17:49:21.405354] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-08T17:49:21.509736] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-08T17:49:21.569902] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-08T17:49:21.619548] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-08T17:49:21.655037] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-08T17:49:22.087559] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.098181] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-08T17:49:22.333546] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.348640] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-08T17:49:22.466550] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:22.466877] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-08T17:49:22.685077] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:49:22.691912] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-08T17:49:23.741797] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:49:23.748106] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-08T17:49:23.864959] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T17:49:23.875736] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-08T17:49:23.953023] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T17:49:23.962228] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-08T17:49:24.297361] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T17:49:24.307806] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-08T17:49:24.730039] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T17:49:24.737762] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-08T17:49:24.995417] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T17:49:25.004207] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-08T17:49:25.484825] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:49:25.494612] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-08T17:49:25.667044] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:49:25.677454] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-08T17:49:26.036275] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:49:26.045013] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-08T17:49:26.073729] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T17:49:26.417571] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-08T17:49:26.731489] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T17:49:27.144988] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T17:49:27.217497] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-08T17:49:27.252789] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T17:49:27.458071] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T17:49:28.017619] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-08T17:49:28.817587] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-08T17:49:29.063669] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T17:49:29.543091] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T17:49:29.617571] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-08T17:49:30.033331] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T17:49:30.418492] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-08T17:49:31.217597] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-08T17:49:31.291503] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T17:49:31.697890] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T17:49:32.017611] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-08T17:49:32.791288] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T17:49:32.817504] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-08T17:49:33.363490] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T17:49:33.617693] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-08T17:49:34.403297] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:49:34.417500] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-08T17:49:35.028921] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:49:35.217574] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-08T17:49:35.820092] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T17:49:36.017559] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-08T17:49:36.401901] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T17:49:36.817605] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-08T17:49:37.617528] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-08T17:49:37.645395] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T17:49:38.246885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T17:49:38.417507] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-08T17:49:38.590164] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T17:49:39.217594] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-08T17:49:40.024423] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-08T17:49:40.029947] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:49:40.650930] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T17:49:40.817530] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-08T17:49:41.539903] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T17:49:41.617502] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-08T17:49:42.148601] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T17:49:42.417568] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-08T17:49:43.199534] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T17:49:43.217500] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-08T17:49:43.661458] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T17:49:44.017561] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-08T17:49:44.715298] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:49:44.817547] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-08T17:49:45.552388] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:49:45.617584] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-08T17:49:46.082776] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:49:46.086447] [INFO ] [REMOTE ] BW: Full fetch complete (58927 records). [2025-10-08T17:49:46.086554] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-08T17:49:46.426925] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-08T17:49:46.470454] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-08T17:49:46.470547] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-08T17:49:46.471263] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-08T17:49:46.471346] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-08T17:49:46.472582] [DEBUG] [LOCAL ] BW: Trimmed 58927 records to 40183 (keeping 200 days of data) [2025-10-08T17:49:46.705904] [DEBUG] [LOCAL ] BW: Primary data saved (40183 records). [2025-10-08T17:49:46.706081] [INFO ] [MAIN ] BW: Full history saved. [2025-10-08T17:49:46.706201] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BW took 27.3s. Estimated remaining: 4h 36m 48s. Rate: 7.3 symbols/min [2025-10-08T17:49:46.879431] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:46.917016] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T17:49:46.932638] [DEBUG] [LOCAL ] BWG: Loaded 12612 existing records from primary storage. [2025-10-08T17:49:46.933322] [INFO ] [MAIN ] BWG: Loaded 12612 existing records. [2025-10-08T17:49:47.114004] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:47.114293] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-08T17:49:47.114342] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-08T17:49:47.114560] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-08T17:49:47.114617] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-08T17:49:47.222811] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-08T17:49:47.473991] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:47.804508] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T17:49:48.017561] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-08T17:49:48.663786] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T17:49:48.667395] [INFO ] [REMOTE ] BVN: Full fetch complete (62856 records). [2025-10-08T17:49:48.667519] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-08T17:49:48.844731] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-08T17:49:48.970974] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T17:49:49.066624] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-08T17:49:49.066739] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-08T17:49:49.067440] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-08T17:49:49.067504] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-08T17:49:49.068844] [DEBUG] [LOCAL ] BVN: Trimmed 62856 records to 44059 (keeping 200 days of data) [2025-10-08T17:49:49.331528] [DEBUG] [LOCAL ] BVN: Primary data saved (44059 records). [2025-10-08T17:49:49.331769] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-08T17:49:49.331913] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 29.9s. Estimated remaining: 4h 36m 9s. Rate: 7.3 symbols/min [2025-10-08T17:49:49.519340] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:49.551031] [DEBUG] [LOCAL ] BWLP: Loaded 32303 existing records from primary storage. [2025-10-08T17:49:49.551402] [INFO ] [MAIN ] BWLP: Loaded 32303 existing records. [2025-10-08T17:49:49.623236] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-08T17:49:49.767026] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:49.767307] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-08T17:49:49.767355] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-08T17:49:49.768228] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-08T17:49:49.768313] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-08T17:49:50.059358] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T17:49:50.102403] [INFO ] [REMOTE ] BV: Full fetch complete (54458 records). [2025-10-08T17:49:50.122934] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-08T17:49:50.146302] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:50.427350] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-08T17:49:50.529218] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-08T17:49:50.529312] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-08T17:49:50.529995] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-08T17:49:50.530060] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-08T17:49:50.531390] [DEBUG] [LOCAL ] BV: Trimmed 54458 records to 38524 (keeping 200 days of data) [2025-10-08T17:49:50.755842] [DEBUG] [LOCAL ] BV: Primary data saved (38524 records). [2025-10-08T17:49:50.756004] [INFO ] [MAIN ] BV: Full history saved. [2025-10-08T17:49:50.756085] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BV took 31.3s. Estimated remaining: 4h 35m 23s. Rate: 7.3 symbols/min [2025-10-08T17:49:50.924257] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:49:50.932746] [DEBUG] [LOCAL ] BWMX: Loaded 7672 existing records from primary storage. [2025-10-08T17:49:50.932927] [INFO ] [MAIN ] BWMX: Loaded 7672 existing records. [2025-10-08T17:49:51.111215] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:49:51.111454] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-08T17:49:51.111501] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-08T17:49:51.111717] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-08T17:49:51.111775] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-08T17:49:51.222720] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-08T17:49:51.471011] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:49:51.528567] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T17:49:51.869385] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:49:52.017531] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-08T17:49:52.237312] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T17:49:52.706906] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:49:52.817565] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-08T17:49:53.303613] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:49:53.617623] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-08T17:49:54.220343] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:49:54.417554] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-08T17:49:55.163270] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T17:49:55.217506] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-08T17:49:56.018672] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-08T17:49:56.019787] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T17:49:56.492403] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T17:49:56.817559] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-08T17:49:57.399484] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T17:49:57.617587] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-08T17:49:58.417566] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-08T17:49:59.214344] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T17:49:59.217978] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-08T17:49:59.219071] [INFO ] [REMOTE ] BWA: Full fetch complete (75700 records). [2025-10-08T17:49:59.219150] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-08T17:49:59.621963] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-08T17:49:59.622067] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-08T17:49:59.622932] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-08T17:49:59.623004] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-08T17:49:59.624639] [DEBUG] [LOCAL ] BWA: Trimmed 75700 records to 52154 (keeping 200 days of data) [2025-10-08T17:49:59.876247] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T17:49:59.978867] [DEBUG] [LOCAL ] BWA: Primary data saved (52154 records). [2025-10-08T17:49:59.979018] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-08T17:49:59.979931] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BWA took 40.5s. Estimated remaining: 4h 35m 20s. Rate: 7.3 symbols/min [2025-10-08T17:50:00.022613] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-08T17:50:00.141718] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:50:00.194006] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:00.201728] [DEBUG] [LOCAL ] BWNB: Loaded 4363 existing records from primary storage. [2025-10-08T17:50:00.201958] [INFO ] [MAIN ] BWNB: Loaded 4363 existing records. [2025-10-08T17:50:00.379453] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:00.379750] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-08T17:50:00.379804] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-08T17:50:00.380023] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-08T17:50:00.380082] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-08T17:50:00.727634] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:00.817505] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-08T17:50:01.408866] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T17:50:01.424476] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:50:01.617559] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-08T17:50:02.307245] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T17:50:02.417547] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-08T17:50:02.933297] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T17:50:03.217622] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-08T17:50:04.017510] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-08T17:50:04.272581] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:50:04.817589] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-08T17:50:04.862795] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:50:05.617556] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-08T17:50:06.116849] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:50:06.410906] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T17:50:06.417491] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-08T17:50:07.217568] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-08T17:50:07.264123] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T17:50:08.017523] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-08T17:50:08.055352] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T17:50:08.625010] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T17:50:08.817555] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-08T17:50:09.542438] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T17:50:09.543984] [INFO ] [REMOTE ] BWG: Full fetch complete (17849 records). [2025-10-08T17:50:09.544062] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-08T17:50:09.622630] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-08T17:50:09.903172] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-08T17:50:09.903249] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-08T17:50:09.903630] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-08T17:50:09.903712] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-08T17:50:09.904235] [DEBUG] [LOCAL ] BWG: Trimmed 17849 records to 12634 (keeping 200 days of data) [2025-10-08T17:50:09.975934] [DEBUG] [LOCAL ] BWG: Primary data saved (12634 records). [2025-10-08T17:50:09.976072] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-08T17:50:09.976156] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 23.3s. Estimated remaining: 4h 35m 21s. Rate: 7.3 symbols/min [2025-10-08T17:50:10.150406] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:10.156946] [DEBUG] [LOCAL ] BWSN: Loaded 5170 existing records from primary storage. [2025-10-08T17:50:10.157120] [INFO ] [MAIN ] BWSN: Loaded 5170 existing records. [2025-10-08T17:50:10.335491] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:10.335802] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-08T17:50:10.335859] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-08T17:50:10.336265] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-08T17:50:10.336324] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-08T17:50:10.425201] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-08T17:50:10.694463] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:10.970103] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T17:50:11.217528] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-08T17:50:11.233446] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T17:50:11.926563] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T17:50:12.017556] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-08T17:50:12.817514] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-08T17:50:13.442498] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T17:50:13.462847] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:50:13.617595] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-08T17:50:14.417586] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-08T17:50:15.155567] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T17:50:15.161384] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:50:15.217541] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-08T17:50:15.896354] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T17:50:15.897411] [INFO ] [REMOTE ] BWMX: Full fetch complete (10076 records). [2025-10-08T17:50:15.897480] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-08T17:50:16.023029] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-08T17:50:16.262724] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-08T17:50:16.262810] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-08T17:50:16.263060] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-08T17:50:16.263120] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-08T17:50:16.264690] [DEBUG] [LOCAL ] BWMX: Trimmed 10076 records to 7690 (keeping 200 days of data) [2025-10-08T17:50:16.310502] [DEBUG] [LOCAL ] BWMX: Primary data saved (7690 records). [2025-10-08T17:50:16.310638] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-08T17:50:16.310770] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWMX took 25.6s. Estimated remaining: 4h 35m 3s. Rate: 7.3 symbols/min [2025-10-08T17:50:16.476817] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:16.477014] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-10-08T17:50:16.477052] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-10-08T17:50:16.477214] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-08T17:50:16.477255] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-08T17:50:16.477295] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-08T17:50:16.477325] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-08T17:50:16.823697] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-08T17:50:16.828550] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:17.015863] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T17:50:17.617560] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-08T17:50:17.996016] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T17:50:18.347490] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:50:18.417562] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-08T17:50:18.851918] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T17:50:19.217584] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-08T17:50:20.017594] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-08T17:50:20.487408] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T17:50:20.656894] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T17:50:20.817557] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-08T17:50:21.617559] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-08T17:50:22.244082] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:50:22.417618] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-08T17:50:23.000472] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T17:50:23.217789] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-08T17:50:23.513384] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:50:23.729406] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T17:50:24.017598] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-08T17:50:24.683613] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:50:24.817595] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-08T17:50:25.617555] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-08T17:50:26.128248] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:50:26.200835] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T17:50:26.417604] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-08T17:50:27.217591] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-08T17:50:27.963160] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T17:50:28.017572] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-08T17:50:28.117472] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T17:50:28.301208] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T17:50:28.817583] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-08T17:50:29.193153] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T17:50:29.617582] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-08T17:50:30.417567] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-08T17:50:31.003704] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T17:50:31.006694] [INFO ] [REMOTE ] BWLP: Full fetch complete (47975 records). [2025-10-08T17:50:31.006812] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-08T17:50:31.123773] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T17:50:31.223751] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-08T17:50:31.416304] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-08T17:50:31.416398] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-08T17:50:31.417134] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-08T17:50:31.417199] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-08T17:50:31.418296] [DEBUG] [LOCAL ] BWLP: Trimmed 47975 records to 32306 (keeping 200 days of data) [2025-10-08T17:50:31.625356] [DEBUG] [LOCAL ] BWLP: Primary data saved (32306 records). [2025-10-08T17:50:31.625557] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-08T17:50:31.625693] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWLP took 42.3s. Estimated remaining: 4h 35m 33s. Rate: 7.3 symbols/min [2025-10-08T17:50:31.798971] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:31.853660] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-08T17:50:31.853994] [INFO ] [MAIN ] BX: Loaded 53479 existing records. [2025-10-08T17:50:32.024745] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-08T17:50:32.029500] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:32.029924] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-08T17:50:32.031233] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-08T17:50:32.032319] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-08T17:50:32.032396] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-08T17:50:32.377409] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:32.557285] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T17:50:32.817560] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-08T17:50:33.017887] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T17:50:33.617560] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-08T17:50:34.036089] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T17:50:34.417522] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-08T17:50:34.478609] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T17:50:35.217560] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-08T17:50:36.017514] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-08T17:50:36.129047] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:50:36.694366] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T17:50:36.750305] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:50:36.817549] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-08T17:50:37.617609] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-08T17:50:38.256225] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T17:50:38.417518] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-08T17:50:38.553798] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:50:39.217637] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-08T17:50:39.815618] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T17:50:39.816606] [INFO ] [REMOTE ] BWSN: Full fetch complete (6261 records). [2025-10-08T17:50:39.816721] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-08T17:50:40.028350] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-08T17:50:40.191426] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-08T17:50:40.191514] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-08T17:50:40.191714] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-08T17:50:40.191776] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-08T17:50:40.192173] [DEBUG] [LOCAL ] BWSN: Trimmed 6261 records to 5147 (keeping 200 days of data) [2025-10-08T17:50:40.223779] [DEBUG] [LOCAL ] BWSN: Primary data saved (5147 records). [2025-10-08T17:50:40.223924] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-08T17:50:40.224011] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWSN took 30.2s. Estimated remaining: 4h 35m 27s. Rate: 7.3 symbols/min [2025-10-08T17:50:40.396339] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:40.410387] [DEBUG] [LOCAL ] BXC: Loaded 13701 existing records from primary storage. [2025-10-08T17:50:40.410592] [INFO ] [MAIN ] BXC: Loaded 13701 existing records. [2025-10-08T17:50:40.588932] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:40.589140] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-08T17:50:40.589186] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-08T17:50:40.589601] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-08T17:50:40.589693] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-08T17:50:40.832958] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-08T17:50:40.948911] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:41.617546] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-08T17:50:42.012788] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T17:50:42.016573] [INFO ] [REMOTE ] BWNB: Full fetch complete (5676 records). [2025-10-08T17:50:42.016443] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (3.60 seconds). [2025-10-08T17:50:42.016843] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-08T17:50:42.404501] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T17:50:42.407312] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-08T17:50:42.407407] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-08T17:50:42.407624] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-08T17:50:42.407706] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-08T17:50:42.408178] [DEBUG] [LOCAL ] BWNB: Trimmed 5676 records to 4255 (keeping 200 days of data) [2025-10-08T17:50:42.421723] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-08T17:50:42.436558] [DEBUG] [LOCAL ] BWNB: Primary data saved (4255 records). [2025-10-08T17:50:42.436716] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-08T17:50:42.436814] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWNB took 42.5s. Estimated remaining: 4h 34m 46s. Rate: 7.3 symbols/min [2025-10-08T17:50:42.607544] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:50:42.656891] [DEBUG] [LOCAL ] BXMT: Loaded 47180 existing records from primary storage. [2025-10-08T17:50:42.657226] [INFO ] [MAIN ] BXMT: Loaded 47180 existing records. [2025-10-08T17:50:42.836373] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:50:42.836581] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-08T17:50:42.836627] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-08T17:50:42.836912] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-08T17:50:42.836969] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-08T17:50:43.222110] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-08T17:50:43.236210] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:50:44.017704] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-08T17:50:44.063278] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (4.03 seconds). [2025-10-08T17:50:44.294609] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:50:44.817531] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-08T17:50:45.382557] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T17:50:45.625742] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-08T17:50:45.631588] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T17:50:45.670094] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-08T17:50:46.417556] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-08T17:50:47.217640] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-08T17:50:47.815713] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T17:50:48.017535] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-08T17:50:48.265059] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T17:50:48.797015] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T17:50:48.817508] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-08T17:50:49.557920] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T17:50:49.617527] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-08T17:50:49.979378] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:50:50.417542] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-08T17:50:51.217569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-08T17:50:51.518008] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T17:50:52.017522] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-08T17:50:52.817530] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-08T17:50:52.856181] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-08T17:50:52.929405] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:50:53.059102] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T17:50:53.617609] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-08T17:50:54.417626] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-08T17:50:55.150110] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T17:50:55.173559] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T17:50:55.217511] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-08T17:50:55.357076] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T17:50:56.017576] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-08T17:50:56.817613] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-08T17:50:56.989850] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:50:57.617531] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-08T17:50:57.671219] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T17:50:57.808232] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T17:50:58.417617] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-08T17:50:59.223712] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-08T17:50:59.247693] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:51:00.017505] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-08T17:51:00.350835] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T17:51:00.817523] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-08T17:51:01.100400] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:51:01.305182] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T17:51:01.617587] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-08T17:51:02.417571] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-08T17:51:02.670201] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T17:51:02.676168] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-08T17:51:02.676363] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-08T17:51:03.070629] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-08T17:51:03.070749] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-08T17:51:03.071813] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-08T17:51:03.071910] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-08T17:51:03.073361] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53479 (keeping 200 days of data) [2025-10-08T17:51:03.257315] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-08T17:51:03.316805] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T17:51:03.425572] [DEBUG] [LOCAL ] BX: Primary data saved (53479 records). [2025-10-08T17:51:03.425797] [INFO ] [MAIN ] BX: Full history saved. [2025-10-08T17:51:03.425978] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BX took 31.8s. Estimated remaining: 4h 35m 47s. Rate: 7.3 symbols/min [2025-10-08T17:51:03.595550] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:03.623569] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T17:51:03.647573] [DEBUG] [LOCAL ] BXMX: Loaded 19513 existing records from primary storage. [2025-10-08T17:51:03.647848] [INFO ] [MAIN ] BXMX: Loaded 19513 existing records. [2025-10-08T17:51:03.828379] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:03.828757] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-08T17:51:03.828824] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-08T17:51:03.829082] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-08T17:51:03.829138] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-08T17:51:04.039387] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-08T17:51:04.241981] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:04.586795] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:51:04.817531] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-08T17:51:05.036132] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T17:51:05.617510] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-08T17:51:05.841028] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:51:06.417544] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-08T17:51:07.217508] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-08T17:51:07.479962] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:51:07.684570] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T17:51:08.017530] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-08T17:51:08.817537] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-08T17:51:08.853260] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T17:51:09.061431] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T17:51:09.065436] [INFO ] [REMOTE ] BWXT: Full fetch complete (67615 records). [2025-10-08T17:51:09.065563] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-08T17:51:09.476173] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-08T17:51:09.476262] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-08T17:51:09.477011] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-08T17:51:09.477079] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-08T17:51:09.478449] [DEBUG] [LOCAL ] BWXT: Trimmed 67615 records to 46822 (keeping 200 days of data) [2025-10-08T17:51:09.596347] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T17:51:09.617717] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-08T17:51:09.800821] [DEBUG] [LOCAL ] BWXT: Primary data saved (46822 records). [2025-10-08T17:51:09.800993] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-08T17:51:09.801097] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BWXT took 53.5s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-08T17:51:09.967575] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:10.014120] [DEBUG] [LOCAL ] BXP: Loaded 49822 existing records from primary storage. [2025-10-08T17:51:10.014470] [INFO ] [MAIN ] BXP: Loaded 49822 existing records. [2025-10-08T17:51:10.188234] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:10.188428] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-08T17:51:10.188490] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-08T17:51:10.188918] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-08T17:51:10.188975] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-08T17:51:10.429809] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-08T17:51:10.592272] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:10.772270] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T17:51:11.217515] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-08T17:51:11.346381] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T17:51:12.017607] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-08T17:51:12.379368] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T17:51:12.817551] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-08T17:51:13.617618] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-08T17:51:13.645407] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T17:51:13.649928] [INFO ] [REMOTE ] BXMT: Full fetch complete (69701 records). [2025-10-08T17:51:13.650070] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-08T17:51:13.801059] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:51:14.071286] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-08T17:51:14.071388] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-08T17:51:14.072182] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-08T17:51:14.072252] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-08T17:51:14.073833] [DEBUG] [LOCAL ] BXMT: Trimmed 69701 records to 47172 (keeping 200 days of data) [2025-10-08T17:51:14.366618] [DEBUG] [LOCAL ] BXMT: Primary data saved (47172 records). [2025-10-08T17:51:14.366815] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-08T17:51:14.366907] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BXMT took 31.9s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-08T17:51:14.430777] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-08T17:51:14.542311] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:14.591807] [DEBUG] [LOCAL ] BXSL: Loaded 47768 existing records from primary storage. [2025-10-08T17:51:14.592239] [INFO ] [MAIN ] BXSL: Loaded 47768 existing records. [2025-10-08T17:51:14.774509] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:14.774835] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-08T17:51:14.774948] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-08T17:51:14.776457] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-08T17:51:14.776523] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-08T17:51:15.132085] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:15.217518] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-08T17:51:15.258406] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T17:51:15.305595] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T17:51:15.307129] [INFO ] [REMOTE ] BXC: Full fetch complete (18127 records). [2025-10-08T17:51:15.307202] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-08T17:51:15.682105] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-08T17:51:15.682213] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-08T17:51:15.682847] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-08T17:51:15.682918] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-08T17:51:15.683882] [DEBUG] [LOCAL ] BXC: Trimmed 18127 records to 13686 (keeping 200 days of data) [2025-10-08T17:51:15.773674] [DEBUG] [LOCAL ] BXC: Primary data saved (13686 records). [2025-10-08T17:51:15.773852] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-08T17:51:15.773978] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BXC took 35.5s. Estimated remaining: 4h 34m 15s. Rate: 7.3 symbols/min [2025-10-08T17:51:15.965469] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:15.987673] [DEBUG] [LOCAL ] BY: Loaded 21734 existing records from primary storage. [2025-10-08T17:51:15.987955] [INFO ] [MAIN ] BY: Loaded 21734 existing records. [2025-10-08T17:51:16.022772] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-08T17:51:16.166660] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:16.166896] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-08T17:51:16.166942] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-08T17:51:16.167124] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-08T17:51:16.167180] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-08T17:51:16.548838] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:16.817524] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-08T17:51:16.868058] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T17:51:17.278843] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T17:51:17.617553] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-08T17:51:17.934440] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T17:51:18.417566] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-08T17:51:19.199951] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:51:19.217507] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-08T17:51:19.775214] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:51:20.017565] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-08T17:51:20.817544] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-08T17:51:21.123805] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T17:51:21.600304] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T17:51:21.617520] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-08T17:51:21.880439] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T17:51:22.417535] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-08T17:51:23.217534] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-08T17:51:23.318856] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:51:23.411109] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T17:51:24.017629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-08T17:51:24.237312] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T17:51:24.817609] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-08T17:51:24.843082] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T17:51:25.569077] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:51:25.617525] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-08T17:51:26.417634] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-08T17:51:26.686744] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T17:51:27.217557] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-08T17:51:28.017518] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-08T17:51:28.158310] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:51:28.567758] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T17:51:28.817518] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-08T17:51:29.160803] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T17:51:29.617601] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-08T17:51:30.417633] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-08T17:51:30.493138] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T17:51:31.217836] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-08T17:51:31.755460] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T17:51:31.955413] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T17:51:32.017676] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-08T17:51:32.194575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T17:51:32.197333] [INFO ] [REMOTE ] BXMX: Full fetch complete (28812 records). [2025-10-08T17:51:32.197457] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-08T17:51:32.691921] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-08T17:51:32.692005] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-08T17:51:32.692465] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-08T17:51:32.692529] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-08T17:51:32.693378] [DEBUG] [LOCAL ] BXMX: Trimmed 28812 records to 19532 (keeping 200 days of data) [2025-10-08T17:51:32.817774] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-08T17:51:32.823915] [DEBUG] [LOCAL ] BXMX: Primary data saved (19532 records). [2025-10-08T17:51:32.825858] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-08T17:51:32.826047] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 29.4s. Estimated remaining: 4h 34m 54s. Rate: 7.3 symbols/min [2025-10-08T17:51:33.015971] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:33.016602] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T17:51:33.061111] [DEBUG] [LOCAL ] BYD: Loaded 44885 existing records from primary storage. [2025-10-08T17:51:33.061431] [INFO ] [MAIN ] BYD: Loaded 44885 existing records. [2025-10-08T17:51:33.239700] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:33.239941] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-08T17:51:33.239989] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-08T17:51:33.241419] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-08T17:51:33.241482] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-08T17:51:33.608955] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:33.617491] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-08T17:51:33.725462] [DEBUG] [REMOTE ] BYD: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T17:51:33.725815] [WARN ] [REMOTE ] BYD: No data returned for month 2024-12 [2025-10-08T17:51:33.725922] [FATAL] [REMOTE ] BYD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:51:33.725976] [FATAL] [MAIN ] BYD: Failed to fetch primary data. [2025-10-08T17:51:33.726041] [WARN ] [MAIN ] BYD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:51:33.726141] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-08T17:51:33.726237] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-08T17:51:33.726285] [INFO ] [LOCAL ] BYD: Starting deletion of derivative data. [2025-10-08T17:51:33.726634] [DEBUG] [LOCAL ] BYD: Deleted derivative data file. [2025-10-08T17:51:33.726766] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BYD took 0.9s. Estimated remaining: 4h 34m 6s. Rate: 7.3 symbols/min [2025-10-08T17:51:33.947967] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:33.963197] [DEBUG] [LOCAL ] BYM: Loaded 11929 existing records from primary storage. [2025-10-08T17:51:33.963437] [INFO ] [MAIN ] BYM: Loaded 11929 existing records. [2025-10-08T17:51:34.192243] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:34.192559] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-08T17:51:34.192708] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-08T17:51:34.192958] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-08T17:51:34.193016] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-08T17:51:34.422954] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-08T17:51:34.606268] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T17:51:34.609993] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:35.217629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-08T17:51:36.017520] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-08T17:51:36.109338] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:51:36.312511] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T17:51:36.749469] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:51:36.817529] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-08T17:51:37.617570] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-08T17:51:38.417525] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-08T17:51:38.449505] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T17:51:38.956225] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T17:51:39.217549] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-08T17:51:39.567745] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T17:51:40.017590] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-08T17:51:40.822821] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-08T17:51:40.835607] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T17:51:40.856283] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T17:51:41.617558] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-08T17:51:42.417588] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-08T17:51:42.486499] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T17:51:42.547344] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:51:43.217569] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-08T17:51:44.017521] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-08T17:51:44.061576] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T17:51:44.099095] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T17:51:44.817557] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-08T17:51:45.111726] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:51:45.617581] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-08T17:51:46.417517] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-08T17:51:46.532586] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T17:51:46.536410] [INFO ] [REMOTE ] BXP: Full fetch complete (71777 records). [2025-10-08T17:51:46.536528] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-08T17:51:46.926661] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-08T17:51:46.926755] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-08T17:51:46.927519] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-08T17:51:46.927563] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-08T17:51:46.929310] [DEBUG] [LOCAL ] BXP: Trimmed 71777 records to 49803 (keeping 200 days of data) [2025-10-08T17:51:47.228707] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:51:47.244017] [INFO ] [REMOTE ] BY: Full fetch complete (29595 records). [2025-10-08T17:51:47.244077] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-08T17:51:47.246036] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-08T17:51:47.249307] [DEBUG] [LOCAL ] BXP: Primary data saved (49803 records). [2025-10-08T17:51:47.270310] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-08T17:51:47.271933] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 37.5s. Estimated remaining: 4h 34m 26s. Rate: 7.3 symbols/min [2025-10-08T17:51:47.620118] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:47.710939] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T17:51:47.835603] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-08T17:51:47.845949] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-08T17:51:47.846426] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-08T17:51:47.846533] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-08T17:51:47.847310] [DEBUG] [LOCAL ] BZH: Loaded 32402 existing records from primary storage. [2025-10-08T17:51:47.848046] [INFO ] [MAIN ] BZH: Loaded 32402 existing records. [2025-10-08T17:51:47.924525] [DEBUG] [LOCAL ] BY: Trimmed 29595 records to 21660 (keeping 200 days of data) [2025-10-08T17:51:48.022138] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-08T17:51:48.141401] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:48.142735] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-08T17:51:48.144095] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-08T17:51:48.145171] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-08T17:51:48.145600] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-08T17:51:48.514624] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:48.532848] [DEBUG] [LOCAL ] BY: Primary data saved (21660 records). [2025-10-08T17:51:48.532953] [INFO ] [MAIN ] BY: Full history saved. [2025-10-08T17:51:48.533025] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BY took 32.8s. Estimated remaining: 4h 33m 41s. Rate: 7.3 symbols/min [2025-10-08T17:51:48.710294] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:48.762932] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-08T17:51:48.763282] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-08T17:51:48.832775] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-08T17:51:48.948874] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:48.949290] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-08T17:51:48.949391] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-08T17:51:48.949688] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-08T17:51:48.949758] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-08T17:51:49.244707] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T17:51:49.278576] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T17:51:49.367122] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:49.617584] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-08T17:51:49.988111] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T17:51:50.417567] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-08T17:51:51.217522] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-08T17:51:51.727987] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-08T17:51:51.945025] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:51:51.948935] [INFO ] [REMOTE ] BXSL: Full fetch complete (69596 records). [2025-10-08T17:51:51.949060] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-08T17:51:52.023962] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-08T17:51:52.360109] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T17:51:52.406578] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-08T17:51:52.406686] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-08T17:51:52.407440] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-08T17:51:52.407483] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-08T17:51:52.408972] [DEBUG] [LOCAL ] BXSL: Trimmed 69596 records to 47831 (keeping 200 days of data) [2025-10-08T17:51:52.703372] [DEBUG] [LOCAL ] BXSL: Primary data saved (47831 records). [2025-10-08T17:51:52.703535] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-08T17:51:52.703639] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BXSL took 38.3s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-08T17:51:52.822749] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-08T17:51:52.877855] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:51:52.899182] [DEBUG] [LOCAL ] CAAP: Loaded 19823 existing records from primary storage. [2025-10-08T17:51:52.899453] [INFO ] [MAIN ] CAAP: Loaded 19823 existing records. [2025-10-08T17:51:53.075915] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:51:53.076169] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-08T17:51:53.076216] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-08T17:51:53.076410] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-08T17:51:53.076467] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-08T17:51:53.432311] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:51:53.617528] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-08T17:51:53.688592] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T17:51:53.973546] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T17:51:54.417591] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-08T17:51:55.094923] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T17:51:55.109125] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T17:51:55.217492] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-08T17:51:56.017587] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-08T17:51:56.606912] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T17:51:56.817576] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-08T17:51:57.617527] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-08T17:51:57.798766] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T17:51:57.887450] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T17:51:58.266741] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T17:51:58.417562] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-08T17:51:59.217544] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-08T17:51:59.440089] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:52:00.017564] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-08T17:52:00.817598] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-08T17:52:01.436263] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T17:52:01.617511] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-08T17:52:01.919999] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:52:02.097016] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T17:52:02.417562] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-08T17:52:03.196862] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T17:52:03.217502] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-08T17:52:04.017533] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-08T17:52:04.169403] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-08T17:52:04.194513] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T17:52:04.817541] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-08T17:52:05.415839] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T17:52:05.617508] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-08T17:52:05.744864] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T17:52:05.746289] [INFO ] [REMOTE ] BYM: Full fetch complete (17949 records). [2025-10-08T17:52:05.746362] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-08T17:52:06.105256] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-08T17:52:06.105335] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-08T17:52:06.105687] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-08T17:52:06.105754] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-08T17:52:06.106264] [DEBUG] [LOCAL ] BYM: Trimmed 17949 records to 11961 (keeping 200 days of data) [2025-10-08T17:52:06.180882] [DEBUG] [LOCAL ] BYM: Primary data saved (11961 records). [2025-10-08T17:52:06.181030] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-08T17:52:06.181111] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 32.5s. Estimated remaining: 4h 33m 31s. Rate: 7.3 symbols/min [2025-10-08T17:52:06.348215] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:06.365973] [DEBUG] [LOCAL ] CABO: Loaded 16889 existing records from primary storage. [2025-10-08T17:52:06.366220] [INFO ] [MAIN ] CABO: Loaded 16889 existing records. [2025-10-08T17:52:06.428176] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-08T17:52:06.547803] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:06.548012] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-08T17:52:06.548061] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-08T17:52:06.548326] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-08T17:52:06.548389] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-08T17:52:06.910673] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:06.928471] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T17:52:07.217612] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-08T17:52:08.017585] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-08T17:52:08.713364] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-08T17:52:08.817545] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-08T17:52:08.925555] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T17:52:09.025764] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:52:09.617584] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-08T17:52:10.417519] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-08T17:52:10.765303] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:52:10.945048] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T17:52:11.094867] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T17:52:11.217580] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-08T17:52:12.017572] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-08T17:52:12.718022] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T17:52:12.817549] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-08T17:52:13.617563] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-08T17:52:14.084753] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T17:52:14.087839] [INFO ] [REMOTE ] BZH: Full fetch complete (47041 records). [2025-10-08T17:52:14.087943] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-08T17:52:14.421582] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-08T17:52:14.499617] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T17:52:14.622464] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-08T17:52:14.622686] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-08T17:52:14.623367] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-08T17:52:14.628695] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-08T17:52:14.636385] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T17:52:14.642202] [DEBUG] [LOCAL ] BZH: Trimmed 47041 records to 32393 (keeping 200 days of data) [2025-10-08T17:52:14.853894] [DEBUG] [LOCAL ] BZH: Primary data saved (32393 records). [2025-10-08T17:52:14.854057] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-08T17:52:14.854148] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 27.6s. Estimated remaining: 4h 33m 25s. Rate: 7.3 symbols/min [2025-10-08T17:52:15.036961] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:15.064175] [DEBUG] [LOCAL ] CACI: Loaded 24024 existing records from primary storage. [2025-10-08T17:52:15.064572] [INFO ] [MAIN ] CACI: Loaded 24024 existing records. [2025-10-08T17:52:15.222718] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-08T17:52:15.294090] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:15.294631] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-08T17:52:15.294725] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-08T17:52:15.295044] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-08T17:52:15.295104] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-08T17:52:15.440494] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T17:52:15.701083] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:16.017694] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-08T17:52:16.817581] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-08T17:52:16.930634] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T17:52:17.260933] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T17:52:17.484565] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:52:17.617607] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-08T17:52:18.417533] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-08T17:52:18.444049] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T17:52:19.217589] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-08T17:52:19.712395] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T17:52:20.017598] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-08T17:52:20.285994] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:52:20.817571] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-08T17:52:21.617517] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-08T17:52:21.719381] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T17:52:22.043951] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T17:52:22.220835] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T17:52:22.417567] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-08T17:52:23.080582] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T17:52:23.217617] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-08T17:52:24.017615] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-08T17:52:24.535052] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:52:24.817580] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-08T17:52:25.617577] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-08T17:52:26.019982] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T17:52:26.036004] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T17:52:26.039940] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-08T17:52:26.040053] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-08T17:52:26.424929] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-08T17:52:26.444994] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-08T17:52:26.445055] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-08T17:52:26.445906] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-08T17:52:26.445969] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-08T17:52:26.447517] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 53740 (keeping 200 days of data) [2025-10-08T17:52:26.705287] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:52:26.831537] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-08T17:52:26.831729] [INFO ] [MAIN ] C: Full history saved. [2025-10-08T17:52:26.831828] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. C took 38.3s. Estimated remaining: 4h 33m 36s. Rate: 7.3 symbols/min [2025-10-08T17:52:27.005937] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:27.050605] [DEBUG] [LOCAL ] CADE: Loaded 49123 existing records from primary storage. [2025-10-08T17:52:27.051167] [INFO ] [MAIN ] CADE: Loaded 49123 existing records. [2025-10-08T17:52:27.224827] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-08T17:52:27.229920] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:27.230981] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-08T17:52:27.231037] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-08T17:52:27.231277] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-08T17:52:27.231333] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-08T17:52:27.592467] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:27.597775] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T17:52:27.599819] [INFO ] [REMOTE ] CAAP: Full fetch complete (27748 records). [2025-10-08T17:52:27.599893] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-08T17:52:27.974365] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-08T17:52:27.974444] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-08T17:52:27.974885] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-08T17:52:27.974947] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-08T17:52:27.975586] [DEBUG] [LOCAL ] CAAP: Trimmed 27748 records to 19804 (keeping 200 days of data) [2025-10-08T17:52:28.028224] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-08T17:52:28.097483] [DEBUG] [LOCAL ] CAAP: Primary data saved (19804 records). [2025-10-08T17:52:28.097611] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-08T17:52:28.097718] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CAAP took 35.4s. Estimated remaining: 4h 32m 52s. Rate: 7.3 symbols/min [2025-10-08T17:52:28.263742] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:28.299161] [DEBUG] [LOCAL ] CAE: Loaded 39206 existing records from primary storage. [2025-10-08T17:52:28.299456] [INFO ] [MAIN ] CAE: Loaded 39206 existing records. [2025-10-08T17:52:28.473441] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:28.473657] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-08T17:52:28.473719] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-08T17:52:28.475088] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-08T17:52:28.475149] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-08T17:52:28.841335] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-08T17:52:28.849260] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:28.910589] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:52:29.232827] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T17:52:29.617592] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-08T17:52:30.321679] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T17:52:30.417545] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-08T17:52:31.067507] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:52:31.217597] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-08T17:52:31.850748] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:52:32.017571] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-08T17:52:32.615801] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:52:32.817573] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-08T17:52:33.285866] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T17:52:33.617568] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-08T17:52:33.989624] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T17:52:34.417705] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-08T17:52:34.602032] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:52:35.217527] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-08T17:52:35.358318] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:52:36.017520] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-08T17:52:36.261897] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:52:36.817567] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-08T17:52:37.617524] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-08T17:52:37.718217] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:52:37.818957] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T17:52:38.417547] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-08T17:52:38.591223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T17:52:39.217587] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-08T17:52:39.359035] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T17:52:40.017565] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-08T17:52:40.310700] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T17:52:40.817548] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-08T17:52:41.617569] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-08T17:52:41.739820] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T17:52:41.869783] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T17:52:42.417578] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-08T17:52:42.916785] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T17:52:43.217580] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-08T17:52:43.243673] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:52:43.245435] [INFO ] [REMOTE ] CACI: Full fetch complete (38636 records). [2025-10-08T17:52:43.245511] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-08T17:52:43.621978] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-08T17:52:43.622067] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-08T17:52:43.622625] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-08T17:52:43.622710] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-08T17:52:43.623562] [DEBUG] [LOCAL ] CACI: Trimmed 38636 records to 23827 (keeping 200 days of data) [2025-10-08T17:52:43.767132] [DEBUG] [LOCAL ] CACI: Primary data saved (23827 records). [2025-10-08T17:52:43.767300] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-08T17:52:43.767449] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. CACI took 28.9s. Estimated remaining: 4h 33m 22s. Rate: 7.3 symbols/min [2025-10-08T17:52:43.938226] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:43.945288] [DEBUG] [LOCAL ] CAF: Loaded 3410 existing records from primary storage. [2025-10-08T17:52:43.945493] [INFO ] [MAIN ] CAF: Loaded 3410 existing records. [2025-10-08T17:52:44.019721] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-08T17:52:44.130582] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:44.130857] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-08T17:52:44.130987] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-08T17:52:44.131207] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-08T17:52:44.131274] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-08T17:52:44.182130] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:52:44.500284] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:44.817608] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-08T17:52:45.323323] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T17:52:45.548566] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T17:52:45.617549] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-08T17:52:46.217106] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T17:52:46.417552] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-08T17:52:47.016345] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T17:52:47.217559] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-08T17:52:48.017601] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-08T17:52:48.672497] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T17:52:48.777770] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T17:52:48.779237] [INFO ] [REMOTE ] CABO: Full fetch complete (23109 records). [2025-10-08T17:52:48.779331] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-08T17:52:48.822708] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-08T17:52:49.154866] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-08T17:52:49.154955] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-08T17:52:49.155415] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-08T17:52:49.155479] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-08T17:52:49.156223] [DEBUG] [LOCAL ] CABO: Trimmed 23109 records to 16872 (keeping 200 days of data) [2025-10-08T17:52:49.268254] [DEBUG] [LOCAL ] CABO: Primary data saved (16872 records). [2025-10-08T17:52:49.268400] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-08T17:52:49.268510] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CABO took 43.1s. Estimated remaining: 4h 32m 60s. Rate: 7.3 symbols/min [2025-10-08T17:52:49.440161] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:52:49.455662] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T17:52:49.499573] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-08T17:52:49.499946] [INFO ] [MAIN ] CAG: Loaded 53664 existing records. [2025-10-08T17:52:49.622613] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-08T17:52:49.677466] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:52:49.677671] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-08T17:52:49.677731] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-08T17:52:49.679271] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-08T17:52:49.679345] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-08T17:52:50.066245] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:52:50.417601] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-08T17:52:51.035201] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T17:52:51.217547] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-08T17:52:52.017568] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-08T17:52:52.144764] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T17:52:52.227834] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T17:52:52.817564] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-08T17:52:53.461538] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T17:52:53.617527] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-08T17:52:53.860386] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T17:52:54.417575] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-08T17:52:55.136972] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:52:55.217568] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-08T17:52:55.915592] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:52:56.017538] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-08T17:52:56.817549] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-08T17:52:56.959627] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:52:57.617525] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-08T17:52:57.973519] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T17:52:58.419503] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-08T17:52:58.421952] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T17:52:59.051000] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T17:52:59.217552] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-08T17:53:00.017524] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-08T17:53:00.138910] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:53:00.736018] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T17:53:00.817520] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-08T17:53:01.617576] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-08T17:53:01.760476] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T17:53:01.909296] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T17:53:02.285462] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T17:53:02.417595] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-08T17:53:03.217602] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-08T17:53:03.836580] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T17:53:03.840197] [INFO ] [REMOTE ] CAE: Full fetch complete (56214 records). [2025-10-08T17:53:03.840409] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-08T17:53:04.018393] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-08T17:53:04.327770] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-08T17:53:04.327964] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-08T17:53:04.329282] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-08T17:53:04.329475] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-08T17:53:04.331392] [DEBUG] [LOCAL ] CAE: Trimmed 56214 records to 39208 (keeping 200 days of data) [2025-10-08T17:53:04.585197] [DEBUG] [LOCAL ] CAE: Primary data saved (39208 records). [2025-10-08T17:53:04.585460] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-08T17:53:04.585620] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAE took 36.5s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-08T17:53:04.681428] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T17:53:04.800733] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:04.817608] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-08T17:53:04.866066] [DEBUG] [LOCAL ] CAH: Loaded 51479 existing records from primary storage. [2025-10-08T17:53:04.866718] [INFO ] [MAIN ] CAH: Loaded 51479 existing records. [2025-10-08T17:53:05.078233] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:05.078748] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-08T17:53:05.078830] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-08T17:53:05.080517] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-08T17:53:05.080619] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-08T17:53:05.426359] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T17:53:05.518480] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:05.617566] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-08T17:53:06.051211] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T17:53:06.417627] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-08T17:53:06.509062] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T17:53:06.514540] [INFO ] [REMOTE ] CADE: Full fetch complete (70123 records). [2025-10-08T17:53:06.514793] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-08T17:53:06.950589] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T17:53:06.977015] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-08T17:53:06.977128] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-08T17:53:06.977959] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-08T17:53:06.978026] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-08T17:53:06.979596] [DEBUG] [LOCAL ] CADE: Trimmed 70123 records to 49166 (keeping 200 days of data) [2025-10-08T17:53:07.217765] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-08T17:53:07.291635] [DEBUG] [LOCAL ] CADE: Primary data saved (49166 records). [2025-10-08T17:53:07.291840] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-08T17:53:07.291934] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 40.5s. Estimated remaining: 4h 32m 51s. Rate: 7.3 symbols/min [2025-10-08T17:53:07.465884] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:07.517179] [DEBUG] [LOCAL ] CAL: Loaded 43072 existing records from primary storage. [2025-10-08T17:53:07.517774] [INFO ] [MAIN ] CAL: Loaded 43072 existing records. [2025-10-08T17:53:07.701463] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:07.701773] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-08T17:53:07.701837] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-08T17:53:07.703185] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-08T17:53:07.703253] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-08T17:53:07.887711] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T17:53:08.022780] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-08T17:53:08.077558] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:08.817630] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-08T17:53:09.445001] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T17:53:09.445932] [INFO ] [REMOTE ] CAF: Full fetch complete (5559 records). [2025-10-08T17:53:09.446006] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-08T17:53:09.619863] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-08T17:53:09.846703] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-08T17:53:09.846875] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-08T17:53:09.847171] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-08T17:53:09.847347] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-08T17:53:09.848477] [DEBUG] [LOCAL ] CAF: Trimmed 5559 records to 3399 (keeping 200 days of data) [2025-10-08T17:53:09.890217] [DEBUG] [LOCAL ] CAF: Primary data saved (3399 records). [2025-10-08T17:53:09.903929] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-08T17:53:09.907188] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAF took 26.1s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-08T17:53:09.920502] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:53:10.093345] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:10.130283] [DEBUG] [LOCAL ] CALX: Loaded 37780 existing records from primary storage. [2025-10-08T17:53:10.130600] [INFO ] [MAIN ] CALX: Loaded 37780 existing records. [2025-10-08T17:53:10.309806] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:10.310111] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-08T17:53:10.310182] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-08T17:53:10.311314] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-08T17:53:10.311379] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-08T17:53:10.422781] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-08T17:53:10.678575] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:11.072268] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:53:11.217505] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-08T17:53:12.017551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-08T17:53:12.385194] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T17:53:12.547101] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:53:12.817591] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-08T17:53:13.617526] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-08T17:53:13.707358] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T17:53:14.246285] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T17:53:14.417552] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-08T17:53:15.217589] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-08T17:53:15.307175] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T17:53:15.763131] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T17:53:16.017631] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-08T17:53:16.626972] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T17:53:16.817678] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-08T17:53:17.617546] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-08T17:53:17.910475] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T17:53:18.265978] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T17:53:18.417597] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-08T17:53:18.943824] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T17:53:19.217619] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-08T17:53:19.964882] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T17:53:20.017514] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-08T17:53:20.817533] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-08T17:53:21.230552] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T17:53:21.628059] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-08T17:53:21.633559] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:53:22.184447] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T17:53:22.417534] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-08T17:53:23.217511] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-08T17:53:23.301331] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T17:53:23.930072] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:53:24.017754] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-08T17:53:24.789601] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:53:24.817489] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-08T17:53:25.457121] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T17:53:25.617555] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-08T17:53:26.069600] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T17:53:26.417551] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-08T17:53:27.217696] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-08T17:53:27.461944] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:53:27.857580] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T17:53:28.017537] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-08T17:53:28.346522] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T17:53:28.817553] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-08T17:53:29.617686] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-08T17:53:29.669951] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T17:53:30.401341] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T17:53:30.417503] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-08T17:53:30.836495] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T17:53:31.217579] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-08T17:53:32.017601] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-08T17:53:32.229058] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T17:53:32.817519] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-08T17:53:32.975829] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T17:53:33.617623] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-08T17:53:33.906010] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T17:53:33.911709] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-08T17:53:33.911848] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-08T17:53:34.315277] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-08T17:53:34.315373] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-08T17:53:34.316223] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-08T17:53:34.316289] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-08T17:53:34.317874] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 53664 (keeping 200 days of data) [2025-10-08T17:53:34.419235] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-08T17:53:34.582803] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T17:53:34.700244] [DEBUG] [LOCAL ] CAG: Primary data saved (53664 records). [2025-10-08T17:53:34.700420] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-08T17:53:34.700539] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAG took 45.4s. Estimated remaining: 4h 33m 30s. Rate: 7.3 symbols/min [2025-10-08T17:53:34.879327] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:34.901684] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T17:53:34.931582] [DEBUG] [LOCAL ] CANG: Loaded 26957 existing records from primary storage. [2025-10-08T17:53:34.931915] [INFO ] [MAIN ] CANG: Loaded 26957 existing records. [2025-10-08T17:53:35.106375] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:35.106581] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-08T17:53:35.106680] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-08T17:53:35.106945] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-08T17:53:35.107019] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-08T17:53:35.222617] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-08T17:53:35.482534] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:35.647989] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T17:53:35.651351] [INFO ] [REMOTE ] CAL: Full fetch complete (61805 records). [2025-10-08T17:53:35.651449] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-08T17:53:36.026413] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-08T17:53:36.047253] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-08T17:53:36.047335] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-08T17:53:36.048038] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-08T17:53:36.048104] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-08T17:53:36.049373] [DEBUG] [LOCAL ] CAL: Trimmed 61805 records to 43047 (keeping 200 days of data) [2025-10-08T17:53:36.308448] [DEBUG] [LOCAL ] CAL: Primary data saved (43047 records). [2025-10-08T17:53:36.308603] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-08T17:53:36.308720] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 29.0s. Estimated remaining: 4h 32m 48s. Rate: 7.3 symbols/min [2025-10-08T17:53:36.477042] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:36.484705] [DEBUG] [LOCAL ] CAPL: Loaded 5715 existing records from primary storage. [2025-10-08T17:53:36.484915] [INFO ] [MAIN ] CAPL: Loaded 5715 existing records. [2025-10-08T17:53:36.663354] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:36.663538] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-08T17:53:36.663583] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-08T17:53:36.663894] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-08T17:53:36.663953] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-08T17:53:36.846765] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-08T17:53:37.034827] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:37.062773] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T17:53:37.458885] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T17:53:37.617569] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-08T17:53:38.332807] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T17:53:38.358620] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T17:53:38.417519] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-08T17:53:39.028561] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T17:53:39.217621] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-08T17:53:40.017600] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-08T17:53:40.608486] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T17:53:40.768214] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T17:53:40.817555] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-08T17:53:41.617627] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-08T17:53:42.135867] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T17:53:42.148762] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T17:53:42.417578] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-08T17:53:43.217552] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-08T17:53:43.938715] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T17:53:44.020062] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-08T17:53:44.023615] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T17:53:44.028101] [INFO ] [REMOTE ] CAH: Full fetch complete (74596 records). [2025-10-08T17:53:44.028244] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-08T17:53:44.420595] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-08T17:53:44.420718] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-08T17:53:44.421516] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-08T17:53:44.421560] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-08T17:53:44.423009] [DEBUG] [LOCAL ] CAH: Trimmed 74596 records to 51469 (keeping 200 days of data) [2025-10-08T17:53:44.749095] [DEBUG] [LOCAL ] CAH: Primary data saved (51469 records). [2025-10-08T17:53:44.749242] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-08T17:53:44.749352] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 40.2s. Estimated remaining: 4h 32m 41s. Rate: 7.3 symbols/min [2025-10-08T17:53:44.822850] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-08T17:53:44.920258] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:44.969785] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-08T17:53:44.970131] [INFO ] [MAIN ] CARR: Loaded 53597 existing records. [2025-10-08T17:53:45.147923] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:45.148254] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-08T17:53:45.148418] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-08T17:53:45.150100] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-08T17:53:45.150186] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-08T17:53:45.515230] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:45.535286] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T17:53:45.617500] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-08T17:53:46.102008] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:53:46.104846] [INFO ] [REMOTE ] CALX: Full fetch complete (54037 records). [2025-10-08T17:53:46.104981] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-08T17:53:46.422608] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-08T17:53:46.490566] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-08T17:53:46.490882] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-08T17:53:46.491575] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-08T17:53:46.491636] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-08T17:53:46.492862] [DEBUG] [LOCAL ] CALX: Trimmed 54037 records to 37736 (keeping 200 days of data) [2025-10-08T17:53:46.714470] [DEBUG] [LOCAL ] CALX: Primary data saved (37736 records). [2025-10-08T17:53:46.714621] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-08T17:53:46.714750] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 36.8s. Estimated remaining: 4h 32m 0s. Rate: 7.3 symbols/min [2025-10-08T17:53:46.880956] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:46.920302] [DEBUG] [LOCAL ] CARS: Loaded 39739 existing records from primary storage. [2025-10-08T17:53:46.920625] [INFO ] [MAIN ] CARS: Loaded 39739 existing records. [2025-10-08T17:53:47.054391] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T17:53:47.109875] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:47.113393] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-08T17:53:47.114042] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-08T17:53:47.115182] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-08T17:53:47.115246] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-08T17:53:47.223414] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-08T17:53:47.497405] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:47.517306] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:53:47.619874] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T17:53:48.017564] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-08T17:53:48.817570] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-08T17:53:49.508238] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T17:53:49.617522] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-08T17:53:49.654844] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T17:53:50.314266] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T17:53:50.417540] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-08T17:53:51.217567] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-08T17:53:51.662208] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T17:53:51.942075] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T17:53:52.017558] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-08T17:53:52.817563] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-08T17:53:53.617558] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-08T17:53:53.844991] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T17:53:54.080184] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T17:53:54.083197] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T17:53:54.092867] [INFO ] [REMOTE ] CAPL: Full fetch complete (8729 records). [2025-10-08T17:53:54.092987] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-08T17:53:54.429940] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-08T17:53:54.445369] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-08T17:53:54.446602] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-08T17:53:54.446937] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-08T17:53:54.446993] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-08T17:53:54.447440] [DEBUG] [LOCAL ] CAPL: Trimmed 8729 records to 5700 (keeping 200 days of data) [2025-10-08T17:53:54.481997] [DEBUG] [LOCAL ] CAPL: Primary data saved (5700 records). [2025-10-08T17:53:54.482106] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-08T17:53:54.482188] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAPL took 18.2s. Estimated remaining: 4h 31m 50s. Rate: 7.3 symbols/min [2025-10-08T17:53:54.689052] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:53:54.738191] [DEBUG] [LOCAL ] CAT: Loaded 52913 existing records from primary storage. [2025-10-08T17:53:54.738520] [INFO ] [MAIN ] CAT: Loaded 52913 existing records. [2025-10-08T17:53:54.911611] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:53:54.911859] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-08T17:53:54.911915] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-08T17:53:54.912138] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-08T17:53:54.912196] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-08T17:53:55.221779] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-08T17:53:55.262230] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:53:55.476753] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T17:53:56.017551] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-08T17:53:56.817517] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-08T17:53:56.943918] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T17:53:57.048484] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T17:53:57.617556] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-08T17:53:57.777762] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:53:58.417548] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-08T17:53:58.474182] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T17:53:59.217544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-08T17:54:00.017557] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-08T17:54:00.285960] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T17:54:00.405023] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T17:54:00.817594] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-08T17:54:01.084028] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T17:54:01.617617] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-08T17:54:02.417527] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-08T17:54:02.911983] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T17:54:03.217515] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-08T17:54:03.305882] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:54:04.017509] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-08T17:54:04.200226] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T17:54:04.817492] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-08T17:54:05.159349] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T17:54:05.566621] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:54:05.617492] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-08T17:54:06.137173] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T17:54:06.417573] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-08T17:54:06.802215] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T17:54:07.217718] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-08T17:54:08.009525] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:54:08.019127] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-08T17:54:08.817544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-08T17:54:08.866769] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T17:54:09.617583] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-08T17:54:10.079676] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T17:54:10.403615] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T17:54:10.417504] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-08T17:54:10.491052] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:54:11.217576] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-08T17:54:12.017528] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-08T17:54:12.084520] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:54:12.817516] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-08T17:54:13.292603] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T17:54:13.292323] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-08T17:54:13.306508] [INFO ] [REMOTE ] CANG: Full fetch complete (40130 records). [2025-10-08T17:54:13.307107] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-08T17:54:13.631339] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-08T17:54:13.679722] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-08T17:54:13.679811] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-08T17:54:13.680243] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-08T17:54:13.680283] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-08T17:54:13.681124] [DEBUG] [LOCAL ] CANG: Trimmed 40130 records to 26953 (keeping 200 days of data) [2025-10-08T17:54:13.825240] [DEBUG] [LOCAL ] CANG: Primary data saved (26953 records). [2025-10-08T17:54:13.825381] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-08T17:54:13.825463] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CANG took 39.1s. Estimated remaining: 4h 32m 37s. Rate: 7.3 symbols/min [2025-10-08T17:54:13.996002] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:14.004939] [DEBUG] [LOCAL ] CATO: Loaded 6981 existing records from primary storage. [2025-10-08T17:54:14.005147] [INFO ] [MAIN ] CATO: Loaded 6981 existing records. [2025-10-08T17:54:14.185341] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:14.185845] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-08T17:54:14.185928] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-08T17:54:14.186169] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-08T17:54:14.186349] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-08T17:54:14.317081] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T17:54:14.428163] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-08T17:54:14.587870] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:15.217550] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:54:15.217727] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-08T17:54:16.017619] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-08T17:54:16.707332] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-08T17:54:16.751777] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T17:54:16.817544] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-08T17:54:17.617577] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-08T17:54:17.902605] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T17:54:18.249321] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:54:18.417577] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-08T17:54:19.217556] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-08T17:54:19.587595] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:54:20.017500] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-08T17:54:20.252342] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-08T17:54:20.256860] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-08T17:54:20.257000] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-08T17:54:20.384096] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:54:20.693324] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-08T17:54:20.693407] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-08T17:54:20.694228] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-08T17:54:20.694292] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-08T17:54:20.695754] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53597 (keeping 200 days of data) [2025-10-08T17:54:20.818725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-08T17:54:21.028855] [DEBUG] [LOCAL ] CARR: Primary data saved (53597 records). [2025-10-08T17:54:21.028997] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-08T17:54:21.029081] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARR took 36.3s. Estimated remaining: 4h 32m 24s. Rate: 7.3 symbols/min [2025-10-08T17:54:21.202067] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:21.209739] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:54:21.209428] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-08T17:54:21.212590] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-08T17:54:21.212849] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-08T17:54:21.212893] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-08T17:54:21.212936] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-08T17:54:21.212968] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-08T17:54:21.213050] [INFO ] [REMOTE ] CARS: Full fetch complete (55732 records). [2025-10-08T17:54:21.213170] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-08T17:54:21.655732] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-08T17:54:21.922933] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:54:21.940428] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:22.030140] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-08T17:54:22.030247] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-08T17:54:22.031001] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-08T17:54:22.031088] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-08T17:54:22.032458] [DEBUG] [LOCAL ] CARS: Trimmed 55732 records to 39698 (keeping 200 days of data) [2025-10-08T17:54:22.300995] [DEBUG] [LOCAL ] CARS: Primary data saved (39698 records). [2025-10-08T17:54:22.301159] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-08T17:54:22.301798] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARS took 35.6s. Estimated remaining: 4h 31m 41s. Rate: 7.3 symbols/min [2025-10-08T17:54:22.427758] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-08T17:54:22.502776] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:22.558912] [DEBUG] [LOCAL ] CB: Loaded 49930 existing records from primary storage. [2025-10-08T17:54:22.559326] [INFO ] [MAIN ] CB: Loaded 49930 existing records. [2025-10-08T17:54:22.738898] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:22.739199] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-08T17:54:22.739256] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-08T17:54:22.739499] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-08T17:54:22.739565] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-08T17:54:23.105899] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:23.217517] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-08T17:54:24.017711] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-08T17:54:24.123408] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-08T17:54:24.630574] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T17:54:24.679779] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T17:54:24.796787] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T17:54:24.817518] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-08T17:54:25.617550] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-08T17:54:26.378030] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T17:54:26.417559] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-08T17:54:27.120179] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T17:54:27.217592] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-08T17:54:28.017547] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-08T17:54:28.114337] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T17:54:28.816904] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T17:54:28.820895] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-08T17:54:29.072998] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T17:54:29.617610] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-08T17:54:30.417580] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-08T17:54:30.468206] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T17:54:30.783089] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T17:54:31.217611] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-08T17:54:32.017603] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-08T17:54:32.297539] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T17:54:32.641374] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T17:54:32.817519] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-08T17:54:33.097844] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T17:54:33.617581] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-08T17:54:34.148291] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T17:54:34.417521] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-08T17:54:34.952793] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T17:54:35.217546] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-08T17:54:36.017541] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-08T17:54:36.166853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T17:54:36.817595] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-08T17:54:37.150985] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T17:54:37.617559] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-08T17:54:38.009776] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T17:54:38.013797] [INFO ] [REMOTE ] CAT: Full fetch complete (76692 records). [2025-10-08T17:54:38.013945] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-08T17:54:38.160200] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:54:38.422827] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-08T17:54:38.426768] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-08T17:54:38.427104] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-08T17:54:38.428883] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-08T17:54:38.428955] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-08T17:54:38.430538] [DEBUG] [LOCAL ] CAT: Trimmed 76692 records to 52918 (keeping 200 days of data) [2025-10-08T17:54:38.729242] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T17:54:38.832136] [DEBUG] [LOCAL ] CAT: Primary data saved (52918 records). [2025-10-08T17:54:38.832301] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-08T17:54:38.832398] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CAT took 44.4s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-08T17:54:39.015032] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:54:39.028519] [DEBUG] [LOCAL ] CBAN: Loaded 10701 existing records from primary storage. [2025-10-08T17:54:39.028840] [INFO ] [MAIN ] CBAN: Loaded 10701 existing records. [2025-10-08T17:54:39.188621] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T17:54:39.218386] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-08T17:54:39.223618] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:54:39.224888] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-08T17:54:39.224938] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-08T17:54:39.225136] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-08T17:54:39.225194] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-08T17:54:39.653993] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:54:40.017616] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-08T17:54:40.817590] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-08T17:54:41.174763] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T17:54:41.273126] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T17:54:41.617519] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-08T17:54:41.688296] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:54:42.417561] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-08T17:54:43.217629] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-08T17:54:43.463610] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T17:54:43.899912] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T17:54:43.901094] [INFO ] [REMOTE ] CATO: Full fetch complete (11098 records). [2025-10-08T17:54:43.901185] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-08T17:54:44.020534] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-08T17:54:44.327029] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-08T17:54:44.327408] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-08T17:54:44.327851] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-08T17:54:44.327965] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-08T17:54:44.328784] [DEBUG] [LOCAL ] CATO: Trimmed 11098 records to 6871 (keeping 200 days of data) [2025-10-08T17:54:44.397766] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T17:54:44.416842] [DEBUG] [LOCAL ] CATO: Primary data saved (6871 records). [2025-10-08T17:54:44.417011] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-08T17:54:44.417107] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CATO took 30.6s. Estimated remaining: 4h 31m 52s. Rate: 7.3 symbols/min [2025-10-08T17:54:44.817634] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-08T17:54:44.964998] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T17:54:45.617560] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-08T17:54:46.417552] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-08T17:54:46.861978] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T17:54:47.217522] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-08T17:54:47.374177] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T17:54:47.374498] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T17:54:48.017566] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-08T17:54:48.817584] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-08T17:54:49.504277] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T17:54:49.584454] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:54:49.617531] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-08T17:54:49.677753] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T17:54:50.417552] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-08T17:54:51.217631] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-08T17:54:51.257492] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T17:54:51.450567] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T17:54:52.017615] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-08T17:54:52.561019] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T17:54:52.564837] [INFO ] [REMOTE ] CB: Full fetch complete (72605 records). [2025-10-08T17:54:52.564944] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-08T17:54:52.824459] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-08T17:54:52.899856] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T17:54:52.979632] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-08T17:54:52.979767] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-08T17:54:52.980580] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-08T17:54:52.980663] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-08T17:54:52.982088] [DEBUG] [LOCAL ] CB: Trimmed 72605 records to 49934 (keeping 200 days of data) [2025-10-08T17:54:53.301620] [DEBUG] [LOCAL ] CB: Primary data saved (49934 records). [2025-10-08T17:54:53.301810] [INFO ] [MAIN ] CB: Full history saved. [2025-10-08T17:54:53.302527] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CB took 31.0s. Estimated remaining: 4h 31m 47s. Rate: 7.3 symbols/min [2025-10-08T17:54:53.617559] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-08T17:54:54.593122] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T17:54:54.596340] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-08T17:54:54.845032] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T17:54:55.217545] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-08T17:54:55.253464] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T17:54:56.017572] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-08T17:54:56.796188] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T17:54:56.817512] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-08T17:54:57.197510] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T17:54:57.202882] [INFO ] [REMOTE ] CAVA: Full fetch complete (77322 records). [2025-10-08T17:54:57.203103] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-08T17:54:57.423564] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T17:54:57.633130] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-08T17:54:57.669261] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-08T17:54:57.669583] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-08T17:54:57.670893] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-08T17:54:57.671001] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-08T17:54:57.673896] [DEBUG] [LOCAL ] CAVA: Trimmed 77322 records to 53555 (keeping 200 days of data) [2025-10-08T17:54:58.054906] [DEBUG] [LOCAL ] CAVA: Primary data saved (53555 records). [2025-10-08T17:54:58.055129] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-08T17:54:58.055234] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CAVA took 37.0s. Estimated remaining: 4h 31m 21s. Rate: 7.3 symbols/min [2025-10-08T17:54:58.419377] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T17:54:58.422314] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-08T17:54:59.035549] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:54:59.036767] [INFO ] [REMOTE ] CBAN: Full fetch complete (16085 records). [2025-10-08T17:54:59.036840] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-08T17:54:59.399945] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-08T17:54:59.400027] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-08T17:54:59.400391] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-08T17:54:59.400464] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-08T17:54:59.400996] [DEBUG] [LOCAL ] CBAN: Trimmed 16085 records to 10649 (keeping 200 days of data) [2025-10-08T17:54:59.465772] [DEBUG] [LOCAL ] CBAN: Primary data saved (10649 records). [2025-10-08T17:54:59.465907] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-08T17:54:59.465990] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CBAN took 20.6s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-08T17:54:59.992974] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.042339] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-08T17:55:00.164063] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.164884] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.168019] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:00.165053] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-08T17:55:00.168976] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-08T17:55:00.169106] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-08T17:55:00.169440] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-08T17:55:00.169523] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-08T17:55:00.243420] [DEBUG] [LOCAL ] CBNA: Loaded 2906 existing records from primary storage. [2025-10-08T17:55:00.249996] [INFO ] [MAIN ] CBNA: Loaded 2906 existing records. [2025-10-08T17:55:00.357435] [DEBUG] [LOCAL ] CBL: Loaded 16300 existing records from primary storage. [2025-10-08T17:55:00.397939] [INFO ] [MAIN ] CBL: Loaded 16300 existing records. [2025-10-08T17:55:00.855021] [DEBUG] [LOCAL ] CBRE: Loaded 50455 existing records from primary storage. [2025-10-08T17:55:00.854913] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:00.898357] [INFO ] [MAIN ] CBRE: Loaded 50455 existing records. [2025-10-08T17:55:00.949600] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-08T17:55:00.983594] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-08T17:55:01.086699] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:01.089861] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:01.096260] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-08T17:55:01.095949] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-08T17:55:01.101825] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-08T17:55:01.112102] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-08T17:55:01.112203] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-08T17:55:01.133428] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-08T17:55:01.157716] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-08T17:55:01.437693] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:55:01.520225] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-08T17:55:01.534840] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:01.601124] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-08T17:55:01.638735] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:01.648278] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-08T17:55:01.669288] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-08T17:55:01.775941] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:01.791462] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-08T17:55:01.817517] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-08T17:55:01.837768] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-08T17:55:01.817437] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-08T17:55:01.856982] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-08T17:55:01.895115] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-08T17:55:01.921538] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 2.4s. Estimated remaining: 4h 30m 3s. Rate: 7.3 symbols/min [2025-10-08T17:55:02.160075] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.274157] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-08T17:55:02.322004] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.334298] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-08T17:55:02.650779] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:02.771225] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:02.771705] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-08T17:55:02.794497] [DEBUG] [LOCAL ] CBT: Loaded 30815 existing records from primary storage. [2025-10-08T17:55:02.794876] [INFO ] [MAIN ] CBT: Loaded 30815 existing records. [2025-10-08T17:55:02.983274] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:02.983528] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-08T17:55:02.983588] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-08T17:55:02.983938] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-08T17:55:02.984000] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-08T17:55:03.282922] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T17:55:03.290803] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-08T17:55:03.366287] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:03.366614] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-08T17:55:03.896567] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T17:55:03.982510] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T17:55:04.017567] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-08T17:55:04.560279] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T17:55:04.592807] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T17:55:04.817600] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-08T17:55:05.089245] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T17:55:05.617614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-08T17:55:06.417527] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-08T17:55:06.621796] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T17:55:06.649321] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T17:55:06.907196] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T17:55:07.217552] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-08T17:55:08.017601] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-08T17:55:08.817568] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-08T17:55:08.948209] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T17:55:09.230581] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:55:09.374868] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T17:55:09.617591] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-08T17:55:10.036255] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T17:55:10.417557] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-08T17:55:11.217572] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-08T17:55:11.857288] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T17:55:12.017522] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-08T17:55:12.184945] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T17:55:12.573104] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T17:55:12.817618] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-08T17:55:13.617604] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-08T17:55:14.159742] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T17:55:14.223688] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T17:55:14.417591] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-08T17:55:15.217612] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-08T17:55:16.017531] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-08T17:55:16.333623] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T17:55:16.765793] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:55:16.785504] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T17:55:16.817488] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-08T17:55:17.617597] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-08T17:55:18.024874] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T17:55:18.220182] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T17:55:18.417625] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-08T17:55:18.911558] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:55:18.912610] [INFO ] [REMOTE ] CBNA: Full fetch complete (4507 records). [2025-10-08T17:55:18.912729] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-08T17:55:19.222768] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-08T17:55:19.286533] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-08T17:55:19.286614] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-08T17:55:19.286796] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-08T17:55:19.286858] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-08T17:55:19.287212] [DEBUG] [LOCAL ] CBNA: Trimmed 4507 records to 2896 (keeping 200 days of data) [2025-10-08T17:55:19.306996] [DEBUG] [LOCAL ] CBNA: Primary data saved (2896 records). [2025-10-08T17:55:19.307122] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-08T17:55:19.307207] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 19.8s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-08T17:55:19.476499] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:19.501626] [DEBUG] [LOCAL ] CBU: Loaded 22579 existing records from primary storage. [2025-10-08T17:55:19.501912] [INFO ] [MAIN ] CBU: Loaded 22579 existing records. [2025-10-08T17:55:19.688509] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:19.688787] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-08T17:55:19.688838] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-08T17:55:19.689086] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-08T17:55:19.689144] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-08T17:55:20.022539] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-08T17:55:20.044176] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:20.784056] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T17:55:20.817502] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-08T17:55:21.181029] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T17:55:21.617579] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-08T17:55:21.974303] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T17:55:22.417575] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-08T17:55:22.884337] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:55:23.217613] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-08T17:55:23.639784] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T17:55:24.017551] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-08T17:55:24.227860] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T17:55:24.817593] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-08T17:55:25.311707] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T17:55:25.617580] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-08T17:55:25.879787] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T17:55:26.417597] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-08T17:55:26.773228] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:55:27.217562] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-08T17:55:27.384526] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T17:55:28.017601] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-08T17:55:28.817574] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-08T17:55:29.060330] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:55:29.204982] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T17:55:29.207560] [INFO ] [REMOTE ] CBT: Full fetch complete (45675 records). [2025-10-08T17:55:29.207718] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-08T17:55:29.584855] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-08T17:55:29.585002] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-08T17:55:29.585622] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-08T17:55:29.585751] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-08T17:55:29.586955] [DEBUG] [LOCAL ] CBT: Trimmed 45675 records to 30800 (keeping 200 days of data) [2025-10-08T17:55:29.655027] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-08T17:55:29.602369] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T17:55:29.802839] [DEBUG] [LOCAL ] CBT: Primary data saved (30800 records). [2025-10-08T17:55:29.802996] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-08T17:55:29.803124] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBT took 27.9s. Estimated remaining: 4h 30m 42s. Rate: 7.3 symbols/min [2025-10-08T17:55:29.970074] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:29.970326] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-08T17:55:29.970380] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-08T17:55:29.970456] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-08T17:55:29.970492] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-08T17:55:29.970531] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-08T17:55:29.970560] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-08T17:55:30.314062] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:30.417513] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-08T17:55:30.624169] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:55:30.624712] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-08T17:55:30.624818] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:30.624872] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-08T17:55:30.624905] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:30.624970] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-08T17:55:30.625078] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-08T17:55:30.625130] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-08T17:55:30.625172] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-08T17:55:30.625228] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBX took 0.8s. Estimated remaining: 4h 29m 58s. Rate: 7.3 symbols/min [2025-10-08T17:55:30.821943] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:30.855288] [DEBUG] [LOCAL ] CBZ: Loaded 33989 existing records from primary storage. [2025-10-08T17:55:30.855570] [INFO ] [MAIN ] CBZ: Loaded 33989 existing records. [2025-10-08T17:55:31.046218] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:31.046442] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-08T17:55:31.046518] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-08T17:55:31.046924] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-08T17:55:31.046999] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-08T17:55:31.225345] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-08T17:55:31.441709] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:31.470430] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:55:32.017530] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-08T17:55:32.343011] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T17:55:32.817574] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-08T17:55:33.200407] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T17:55:33.617603] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-08T17:55:34.417599] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-08T17:55:34.560898] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T17:55:34.853277] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T17:55:35.217581] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-08T17:55:35.473593] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T17:55:36.017552] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-08T17:55:36.126335] [DEBUG] [REMOTE ] CBRE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-08T17:55:36.126757] [WARN ] [REMOTE ] CBRE: No data returned for month 2025-08 [2025-10-08T17:55:36.126875] [FATAL] [REMOTE ] CBRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:55:36.127012] [FATAL] [MAIN ] CBRE: Failed to fetch primary data. [2025-10-08T17:55:36.127093] [WARN ] [MAIN ] CBRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:55:36.127168] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-08T17:55:36.127236] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-08T17:55:36.127272] [INFO ] [LOCAL ] CBRE: Starting deletion of derivative data. [2025-10-08T17:55:36.127543] [DEBUG] [LOCAL ] CBRE: Deleted derivative data file. [2025-10-08T17:55:36.127637] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBRE took 36.6s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-10-08T17:55:36.325364] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:36.349297] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T17:55:36.414635] [DEBUG] [LOCAL ] CC: Loaded 52991 existing records from primary storage. [2025-10-08T17:55:36.415204] [INFO ] [MAIN ] CC: Loaded 52991 existing records. [2025-10-08T17:55:36.618060] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:36.618324] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-08T17:55:36.618372] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-08T17:55:36.618616] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-08T17:55:36.618719] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-08T17:55:36.825798] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-08T17:55:36.988083] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:37.617555] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-08T17:55:37.929417] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T17:55:38.417527] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-08T17:55:38.711784] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T17:55:39.059593] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T17:55:39.217553] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-08T17:55:40.017566] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-08T17:55:40.580205] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:55:40.817617] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-08T17:55:41.617627] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-08T17:55:41.703237] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T17:55:41.808594] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T17:55:42.417513] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-08T17:55:42.883279] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T17:55:43.217511] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-08T17:55:43.381381] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T17:55:44.017513] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-08T17:55:44.471803] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T17:55:44.817563] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-08T17:55:45.432031] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T17:55:45.617560] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-08T17:55:45.978811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:55:46.417614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-08T17:55:46.990100] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:55:47.024512] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T17:55:47.026150] [INFO ] [REMOTE ] CBL: Full fetch complete (25401 records). [2025-10-08T17:55:47.026246] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-08T17:55:47.222769] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-08T17:55:47.410463] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-08T17:55:47.410563] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-08T17:55:47.411044] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-08T17:55:47.411112] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-08T17:55:47.412100] [DEBUG] [LOCAL ] CBL: Trimmed 25401 records to 16262 (keeping 200 days of data) [2025-10-08T17:55:47.523802] [DEBUG] [LOCAL ] CBL: Primary data saved (16262 records). [2025-10-08T17:55:47.523961] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-08T17:55:47.524046] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBL took 48.1s. Estimated remaining: 4h 29m 43s. Rate: 7.3 symbols/min [2025-10-08T17:55:47.718607] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:47.773880] [DEBUG] [LOCAL ] CCI: Loaded 53138 existing records from primary storage. [2025-10-08T17:55:47.774270] [INFO ] [MAIN ] CCI: Loaded 53138 existing records. [2025-10-08T17:55:47.967882] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:55:47.968214] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-08T17:55:47.968297] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-08T17:55:47.968877] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-08T17:55:47.968951] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-08T17:55:48.022687] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-08T17:55:48.395297] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:48.471360] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T17:55:48.473499] [INFO ] [REMOTE ] CBU: Full fetch complete (32355 records). [2025-10-08T17:55:48.473581] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-08T17:55:48.822615] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-08T17:55:48.903328] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-08T17:55:48.903443] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-08T17:55:48.904073] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-08T17:55:48.904139] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-08T17:55:48.905315] [DEBUG] [LOCAL ] CBU: Trimmed 32355 records to 22520 (keeping 200 days of data) [2025-10-08T17:55:49.059511] [DEBUG] [LOCAL ] CBU: Primary data saved (22520 records). [2025-10-08T17:55:49.059675] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-08T17:55:49.059800] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 29.8s. Estimated remaining: 4h 29m 3s. Rate: 7.3 symbols/min [2025-10-08T17:55:49.241138] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:55:49.241309] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-08T17:55:49.241353] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-08T17:55:49.241472] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-08T17:55:49.241519] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-08T17:55:49.241576] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-08T17:55:49.241614] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-08T17:55:49.621020] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:55:49.621141] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-08T17:55:49.688159] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:55:49.944312] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:55:50.417585] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-08T17:55:50.874884] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T17:55:51.217517] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-08T17:55:51.522480] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:55:51.645388] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T17:55:52.017571] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-08T17:55:52.332930] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T17:55:52.817620] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-08T17:55:53.617595] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-08T17:55:53.947235] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T17:55:54.417526] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-08T17:55:54.532211] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T17:55:54.867198] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T17:55:55.217595] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-08T17:55:56.017577] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-08T17:55:56.492705] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T17:55:56.817582] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-08T17:55:56.885515] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T17:55:57.617549] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-08T17:55:57.956364] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T17:55:58.417504] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-08T17:55:58.524462] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T17:55:58.683053] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T17:55:59.217564] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-08T17:56:00.017610] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-08T17:56:00.528454] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T17:56:00.817528] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-08T17:56:01.012611] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:56:01.336118] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T17:56:01.617576] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-08T17:56:02.069406] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T17:56:02.070667] [INFO ] [REMOTE ] CCIA: Full fetch complete (2134 records). [2025-10-08T17:56:02.070765] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-08T17:56:02.279055] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T17:56:02.279279] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T17:56:02.279351] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T17:56:02.279425] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-08T17:56:02.279491] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-08T17:56:02.279527] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-08T17:56:02.279584] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-08T17:56:02.279698] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CCIA took 13.2s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-08T17:56:02.423479] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-08T17:56:02.457605] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:02.476939] [DEBUG] [LOCAL ] CCIF: Loaded 15588 existing records from primary storage. [2025-10-08T17:56:02.477564] [INFO ] [MAIN ] CCIF: Loaded 15588 existing records. [2025-10-08T17:56:02.660365] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:02.660590] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-08T17:56:02.660639] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-08T17:56:02.660958] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-08T17:56:02.661019] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-08T17:56:03.033619] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:03.217505] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-08T17:56:03.603603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T17:56:04.017582] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-08T17:56:04.143352] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T17:56:04.817614] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-08T17:56:05.617604] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-08T17:56:05.722102] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T17:56:05.991176] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T17:56:06.417553] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-08T17:56:07.217577] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-08T17:56:07.304430] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T17:56:08.017586] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-08T17:56:08.244852] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T17:56:08.731932] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T17:56:08.817594] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-08T17:56:09.617563] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-08T17:56:09.803539] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:56:09.852601] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T17:56:10.417683] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-08T17:56:11.217632] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-08T17:56:11.436950] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T17:56:12.017515] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-08T17:56:12.145265] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T17:56:12.181552] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T17:56:12.817608] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-08T17:56:13.617568] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-08T17:56:13.897381] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:56:14.417530] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-08T17:56:14.803917] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T17:56:14.892556] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T17:56:15.130539] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T17:56:15.217600] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-08T17:56:16.017562] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-08T17:56:16.817594] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-08T17:56:17.079302] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T17:56:17.556413] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T17:56:17.617527] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-08T17:56:17.766034] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T17:56:18.417566] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-08T17:56:19.217531] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-08T17:56:19.423383] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T17:56:19.429834] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T17:56:20.017580] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-08T17:56:20.546632] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T17:56:20.549584] [INFO ] [REMOTE ] CBZ: Full fetch complete (45749 records). [2025-10-08T17:56:20.549702] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-08T17:56:20.825283] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-08T17:56:20.945034] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-08T17:56:20.945121] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-08T17:56:20.945837] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-08T17:56:20.945902] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-08T17:56:20.946979] [DEBUG] [LOCAL ] CBZ: Trimmed 45749 records to 34023 (keeping 200 days of data) [2025-10-08T17:56:21.149909] [DEBUG] [LOCAL ] CBZ: Primary data saved (34023 records). [2025-10-08T17:56:21.150061] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-08T17:56:21.150148] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBZ took 50.5s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-08T17:56:21.315422] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:21.366415] [DEBUG] [LOCAL ] CCJ: Loaded 53676 existing records from primary storage. [2025-10-08T17:56:21.366815] [INFO ] [MAIN ] CCJ: Loaded 53676 existing records. [2025-10-08T17:56:21.543176] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:21.543376] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-08T17:56:21.543457] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-08T17:56:21.543810] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-08T17:56:21.543868] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-08T17:56:21.618414] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-08T17:56:21.742969] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T17:56:21.824938] [INFO ] [REMOTE ] CC: Full fetch complete (75713 records). [2025-10-08T17:56:21.837675] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-08T17:56:22.072591] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:22.358463] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-08T17:56:22.358596] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-08T17:56:22.359497] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-08T17:56:22.359612] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-08T17:56:22.361181] [DEBUG] [LOCAL ] CC: Trimmed 75713 records to 52993 (keeping 200 days of data) [2025-10-08T17:56:22.419545] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-08T17:56:22.466218] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:56:22.722545] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:56:22.754998] [DEBUG] [LOCAL ] CC: Primary data saved (52993 records). [2025-10-08T17:56:22.755135] [INFO ] [MAIN ] CC: Full history saved. [2025-10-08T17:56:22.755234] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 46.6s. Estimated remaining: 4h 29m 21s. Rate: 7.3 symbols/min [2025-10-08T17:56:22.924164] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:22.966457] [DEBUG] [LOCAL ] CCK: Loaded 46302 existing records from primary storage. [2025-10-08T17:56:22.966893] [INFO ] [MAIN ] CCK: Loaded 46302 existing records. [2025-10-08T17:56:23.183923] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:23.184186] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-08T17:56:23.184241] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-08T17:56:23.184545] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-08T17:56:23.184604] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-08T17:56:23.226972] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-08T17:56:23.541075] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:24.017594] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-08T17:56:24.646033] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-08T17:56:24.751302] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T17:56:24.817520] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-08T17:56:24.978457] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T17:56:25.617564] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-08T17:56:26.417598] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-08T17:56:26.435636] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T17:56:26.439944] [INFO ] [REMOTE ] CCI: Full fetch complete (76987 records). [2025-10-08T17:56:26.440054] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-08T17:56:26.598439] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T17:56:26.857083] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-08T17:56:26.857183] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-08T17:56:26.858040] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-08T17:56:26.858106] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-08T17:56:26.859637] [DEBUG] [LOCAL ] CCI: Trimmed 76987 records to 53132 (keeping 200 days of data) [2025-10-08T17:56:27.196860] [DEBUG] [LOCAL ] CCI: Primary data saved (53132 records). [2025-10-08T17:56:27.197022] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-08T17:56:27.197110] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCI took 39.7s. Estimated remaining: 4h 28m 55s. Rate: 7.3 symbols/min [2025-10-08T17:56:27.226844] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-08T17:56:27.370350] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:27.423148] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-08T17:56:27.423490] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-08T17:56:27.601684] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:27.601933] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-08T17:56:27.601980] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-08T17:56:27.602342] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-08T17:56:27.602399] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-08T17:56:27.955481] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:28.017500] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-08T17:56:28.395752] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T17:56:28.817616] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-08T17:56:29.036824] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T17:56:29.617540] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-08T17:56:29.937256] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T17:56:30.417550] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-08T17:56:30.662404] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-08T17:56:31.223388] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-08T17:56:31.244424] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:56:31.246563] [INFO ] [REMOTE ] CCIF: Full fetch complete (21976 records). [2025-10-08T17:56:31.248478] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T17:56:31.248637] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-08T17:56:31.632965] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-08T17:56:31.633070] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-08T17:56:31.633514] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-08T17:56:31.633557] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-08T17:56:31.634514] [DEBUG] [LOCAL ] CCIF: Trimmed 21976 records to 15666 (keeping 200 days of data) [2025-10-08T17:56:31.731151] [DEBUG] [LOCAL ] CCIF: Primary data saved (15666 records). [2025-10-08T17:56:31.731306] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-08T17:56:31.731461] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 29.5s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-08T17:56:31.922985] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:31.974181] [DEBUG] [LOCAL ] CCO: Loaded 48007 existing records from primary storage. [2025-10-08T17:56:31.974503] [INFO ] [MAIN ] CCO: Loaded 48007 existing records. [2025-10-08T17:56:32.022691] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-08T17:56:32.179031] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:32.179256] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-08T17:56:32.179302] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-08T17:56:32.179854] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-08T17:56:32.179912] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-08T17:56:32.533785] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:32.817582] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-08T17:56:33.541037] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-08T17:56:33.617571] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-08T17:56:34.179118] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T17:56:34.256871] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T17:56:34.417505] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-08T17:56:35.217566] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-08T17:56:35.733419] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T17:56:35.773758] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T17:56:36.017566] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-08T17:56:36.817525] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-08T17:56:36.997952] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T17:56:37.199619] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T17:56:37.617552] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-08T17:56:38.368333] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T17:56:38.417502] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-08T17:56:39.217524] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-08T17:56:39.387586] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T17:56:39.754579] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T17:56:40.017582] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-08T17:56:40.817586] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-08T17:56:41.617548] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-08T17:56:41.698308] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-08T17:56:41.934721] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T17:56:42.417525] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-08T17:56:42.648462] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T17:56:42.742629] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T17:56:43.217600] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-08T17:56:44.017625] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-08T17:56:44.753156] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-08T17:56:44.822673] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-08T17:56:44.839245] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T17:56:45.617578] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-08T17:56:46.072352] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-08T17:56:46.417562] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-08T17:56:46.840430] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T17:56:47.119412] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T17:56:47.217551] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-08T17:56:48.017604] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-08T17:56:48.384594] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T17:56:48.764878] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T17:56:48.817517] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-08T17:56:49.617601] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-08T17:56:49.967057] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T17:56:50.426275] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-08T17:56:50.431984] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T17:56:51.217576] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-08T17:56:51.975733] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T17:56:52.017620] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-08T17:56:52.790150] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-08T17:56:52.817493] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-08T17:56:52.937250] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T17:56:53.361066] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T17:56:53.617556] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-08T17:56:54.417600] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-08T17:56:55.102525] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-08T17:56:55.217584] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-08T17:56:55.602578] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T17:56:55.624252] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T17:56:55.627620] [INFO ] [REMOTE ] CCK: Full fetch complete (67592 records). [2025-10-08T17:56:55.627736] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-08T17:56:56.026779] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-08T17:56:56.030425] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-08T17:56:56.030506] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-08T17:56:56.032160] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-08T17:56:56.032261] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-08T17:56:56.033811] [DEBUG] [LOCAL ] CCK: Trimmed 67592 records to 46300 (keeping 200 days of data) [2025-10-08T17:56:56.315904] [DEBUG] [LOCAL ] CCK: Primary data saved (46300 records). [2025-10-08T17:56:56.316055] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-08T17:56:56.316147] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCK took 33.6s. Estimated remaining: 4h 29m 38s. Rate: 7.3 symbols/min [2025-10-08T17:56:56.482427] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:56.492161] [DEBUG] [LOCAL ] CCRD: Loaded 9204 existing records from primary storage. [2025-10-08T17:56:56.492338] [INFO ] [MAIN ] CCRD: Loaded 9204 existing records. [2025-10-08T17:56:56.665263] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:56.665466] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-08T17:56:56.665512] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-08T17:56:56.665732] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-08T17:56:56.665789] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-08T17:56:56.821037] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-08T17:56:57.022513] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:57.558558] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T17:56:57.617547] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-08T17:56:57.821711] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T17:56:57.826076] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-10-08T17:56:57.826235] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-08T17:56:58.267796] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-08T17:56:58.267927] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-08T17:56:58.268812] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-08T17:56:58.268875] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-08T17:56:58.270377] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 53675 (keeping 200 days of data) [2025-10-08T17:56:58.443833] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-08T17:56:58.608740] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T17:56:58.639089] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-10-08T17:56:58.639266] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-08T17:56:58.640036] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCJ took 37.5s. Estimated remaining: 4h 29m 2s. Rate: 7.3 symbols/min [2025-10-08T17:56:58.807759] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:56:58.846408] [DEBUG] [LOCAL ] CCS: Loaded 30314 existing records from primary storage. [2025-10-08T17:56:58.846842] [INFO ] [MAIN ] CCS: Loaded 30314 existing records. [2025-10-08T17:56:59.035244] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:56:59.035531] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-08T17:56:59.035578] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-08T17:56:59.035858] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-08T17:56:59.035916] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-08T17:56:59.231867] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-08T17:56:59.420595] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:56:59.466044] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:56:59.876516] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-08T17:56:59.880922] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-08T17:56:59.881083] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-08T17:57:00.028135] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-08T17:57:00.288915] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-08T17:57:00.289021] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-08T17:57:00.289929] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-08T17:57:00.290016] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-08T17:57:00.291630] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 53800 (keeping 200 days of data) [2025-10-08T17:57:00.624889] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-08T17:57:00.625106] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-08T17:57:00.625204] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCL took 33.4s. Estimated remaining: 4h 28m 24s. Rate: 7.3 symbols/min [2025-10-08T17:57:00.814111] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:00.820795] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-08T17:57:00.853331] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:57:00.860160] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T17:57:00.887775] [DEBUG] [LOCAL ] CCU: Loaded 22981 existing records from primary storage. [2025-10-08T17:57:00.888042] [INFO ] [MAIN ] CCU: Loaded 22981 existing records. [2025-10-08T17:57:01.074566] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:01.074840] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-08T17:57:01.074890] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-08T17:57:01.075194] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-08T17:57:01.075274] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-08T17:57:01.441586] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:01.617569] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-08T17:57:02.087156] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:57:02.283326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T17:57:02.417622] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-08T17:57:03.217622] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-08T17:57:03.911148] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T17:57:04.017569] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-08T17:57:04.817561] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-08T17:57:05.003286] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T17:57:05.181710] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T17:57:05.232007] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T17:57:05.617567] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-08T17:57:06.417590] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-08T17:57:07.099817] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T17:57:07.217523] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-08T17:57:07.784262] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:57:08.017606] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-08T17:57:08.673352] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T17:57:08.817577] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-08T17:57:09.187871] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T17:57:09.617603] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-08T17:57:10.259338] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T17:57:10.320511] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T17:57:10.324126] [INFO ] [REMOTE ] CCO: Full fetch complete (66836 records). [2025-10-08T17:57:10.324221] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-08T17:57:10.423163] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-08T17:57:10.716970] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-08T17:57:10.717291] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-08T17:57:10.718817] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-08T17:57:10.718880] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-08T17:57:10.720222] [DEBUG] [LOCAL ] CCO: Trimmed 66836 records to 48014 (keeping 200 days of data) [2025-10-08T17:57:10.983861] [DEBUG] [LOCAL ] CCO: Primary data saved (48014 records). [2025-10-08T17:57:10.984016] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-08T17:57:10.984917] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 39.3s. Estimated remaining: 4h 28m 26s. Rate: 7.3 symbols/min [2025-10-08T17:57:11.151076] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:11.151244] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-08T17:57:11.151298] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-08T17:57:11.151463] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-08T17:57:11.151504] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-08T17:57:11.151544] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-08T17:57:11.151575] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-08T17:57:11.225146] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-08T17:57:11.510835] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:11.681722] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T17:57:12.017556] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-08T17:57:12.321322] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T17:57:12.817597] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-08T17:57:13.480872] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T17:57:13.617563] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-08T17:57:13.930857] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T17:57:14.417513] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-08T17:57:14.765062] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T17:57:15.131120] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T17:57:15.217529] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-08T17:57:16.017550] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-08T17:57:16.407251] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T17:57:16.817562] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-08T17:57:17.403433] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T17:57:17.534437] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T17:57:17.617514] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-08T17:57:18.417544] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-08T17:57:18.510114] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:57:19.217575] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-08T17:57:19.557902] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T17:57:19.626473] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T17:57:20.017576] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-08T17:57:20.817573] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-08T17:57:20.841285] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T17:57:21.617567] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-08T17:57:22.070280] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T17:57:22.417522] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-08T17:57:22.563959] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T17:57:22.700742] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-08T17:57:23.217606] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-08T17:57:23.505842] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T17:57:24.017624] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-08T17:57:24.817505] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-08T17:57:25.045588] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-08T17:57:25.071033] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T17:57:25.617539] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-08T17:57:26.417539] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-08T17:57:26.706064] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T17:57:27.217565] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-08T17:57:27.536405] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-08T17:57:27.722901] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T17:57:28.017616] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-08T17:57:28.817532] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-08T17:57:28.887171] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T17:57:29.056028] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-08T17:57:29.617550] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-08T17:57:30.075608] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:57:30.076004] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-08T17:57:30.076091] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:57:30.076175] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-08T17:57:30.076235] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:57:30.076307] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-08T17:57:30.076371] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-08T17:57:30.076406] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-08T17:57:30.076465] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-08T17:57:30.076535] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCZ took 19.1s. Estimated remaining: 4h 29m 9s. Rate: 7.3 symbols/min [2025-10-08T17:57:30.243426] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:30.304136] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-08T17:57:30.304482] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-08T17:57:30.422698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-08T17:57:30.488286] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:30.488478] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-08T17:57:30.488525] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-08T17:57:30.489058] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-08T17:57:30.489116] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-08T17:57:30.844551] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:31.217529] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-08T17:57:31.254796] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T17:57:31.255929] [INFO ] [REMOTE ] CCRD: Full fetch complete (11845 records). [2025-10-08T17:57:31.256011] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-08T17:57:31.641513] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-08T17:57:31.641615] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-08T17:57:31.641987] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-08T17:57:31.642062] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-08T17:57:31.642663] [DEBUG] [LOCAL ] CCRD: Trimmed 11845 records to 9219 (keeping 200 days of data) [2025-10-08T17:57:31.699085] [DEBUG] [LOCAL ] CCRD: Primary data saved (9219 records). [2025-10-08T17:57:31.699248] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-08T17:57:31.699392] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCRD took 35.4s. Estimated remaining: 4h 28m 29s. Rate: 7.3 symbols/min [2025-10-08T17:57:31.898952] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:31.911889] [DEBUG] [LOCAL ] CDLR: Loaded 9880 existing records from primary storage. [2025-10-08T17:57:31.912145] [INFO ] [MAIN ] CDLR: Loaded 9880 existing records. [2025-10-08T17:57:32.022684] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-08T17:57:32.117126] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:32.117356] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-08T17:57:32.117405] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-08T17:57:32.117581] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-08T17:57:32.117638] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-08T17:57:32.523471] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:32.524542] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T17:57:32.817563] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-08T17:57:33.512140] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:57:33.617549] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-08T17:57:34.069821] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T17:57:34.115300] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T17:57:34.417628] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-08T17:57:35.217622] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-08T17:57:35.635736] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T17:57:35.638114] [INFO ] [REMOTE ] CCS: Full fetch complete (45001 records). [2025-10-08T17:57:35.638202] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-08T17:57:35.904949] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T17:57:36.017890] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-08T17:57:36.018254] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-08T17:57:36.019352] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-08T17:57:36.019957] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-08T17:57:36.020019] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-08T17:57:36.021112] [DEBUG] [LOCAL ] CCS: Trimmed 45001 records to 30228 (keeping 200 days of data) [2025-10-08T17:57:36.210850] [DEBUG] [LOCAL ] CCS: Primary data saved (30228 records). [2025-10-08T17:57:36.210999] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-08T17:57:36.211084] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 37.6s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-08T17:57:36.384383] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:36.427887] [DEBUG] [LOCAL ] CDP: Loaded 42619 existing records from primary storage. [2025-10-08T17:57:36.428226] [INFO ] [MAIN ] CDP: Loaded 42619 existing records. [2025-10-08T17:57:36.600639] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:36.600892] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-08T17:57:36.600940] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-08T17:57:36.601154] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-08T17:57:36.601212] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-08T17:57:36.825256] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-08T17:57:36.952329] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:37.617517] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-08T17:57:37.851479] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T17:57:37.988573] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T17:57:38.383464] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T17:57:38.417535] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-08T17:57:39.217575] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-08T17:57:39.961096] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T17:57:40.017569] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-08T17:57:40.313607] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T17:57:40.805769] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T17:57:40.817493] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-08T17:57:41.617575] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-08T17:57:41.669767] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T17:57:42.417546] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-08T17:57:42.690001] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T17:57:42.692127] [INFO ] [REMOTE ] CCU: Full fetch complete (32451 records). [2025-10-08T17:57:42.692249] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-08T17:57:43.088974] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-08T17:57:43.089058] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-08T17:57:43.089511] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-08T17:57:43.089550] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-08T17:57:43.090340] [DEBUG] [LOCAL ] CCU: Trimmed 32451 records to 22832 (keeping 200 days of data) [2025-10-08T17:57:43.216878] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T17:57:43.217758] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-08T17:57:43.245828] [DEBUG] [LOCAL ] CCU: Primary data saved (22832 records). [2025-10-08T17:57:43.245982] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-08T17:57:43.246084] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCU took 42.6s. Estimated remaining: 4h 27m 50s. Rate: 7.3 symbols/min [2025-10-08T17:57:43.416182] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:43.442136] [DEBUG] [LOCAL ] CDRE: Loaded 24694 existing records from primary storage. [2025-10-08T17:57:43.442427] [INFO ] [MAIN ] CDRE: Loaded 24694 existing records. [2025-10-08T17:57:43.615028] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:43.615302] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-08T17:57:43.615377] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-08T17:57:43.615801] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-08T17:57:43.615872] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-08T17:57:43.963054] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:44.017514] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-08T17:57:44.817512] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-08T17:57:45.314264] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-08T17:57:45.343183] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T17:57:45.617528] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-08T17:57:45.725153] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T17:57:46.417528] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-08T17:57:46.663703] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T17:57:47.217574] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-08T17:57:48.017734] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-08T17:57:48.166256] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T17:57:48.358011] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T17:57:48.817529] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-08T17:57:48.867682] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T17:57:49.617617] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-08T17:57:50.197526] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T17:57:50.417526] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-08T17:57:50.492765] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T17:57:50.494705] [INFO ] [REMOTE ] CDLR: Full fetch complete (13556 records). [2025-10-08T17:57:50.494821] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-08T17:57:50.902695] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-08T17:57:50.902837] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-08T17:57:50.903436] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-08T17:57:50.903481] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-08T17:57:50.904134] [DEBUG] [LOCAL ] CDLR: Trimmed 13556 records to 9863 (keeping 200 days of data) [2025-10-08T17:57:50.968982] [DEBUG] [LOCAL ] CDLR: Primary data saved (9863 records). [2025-10-08T17:57:50.969202] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-08T17:57:50.969316] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 19.3s. Estimated remaining: 4h 27m 39s. Rate: 7.3 symbols/min [2025-10-08T17:57:51.153056] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:57:51.217582] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-08T17:57:51.221225] [DEBUG] [LOCAL ] CE: Loaded 51475 existing records from primary storage. [2025-10-08T17:57:51.221905] [INFO ] [MAIN ] CE: Loaded 51475 existing records. [2025-10-08T17:57:51.425359] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:57:51.425748] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-08T17:57:51.425808] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-08T17:57:51.426207] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-08T17:57:51.426268] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-08T17:57:51.814045] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:57:51.948726] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T17:57:52.017525] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-08T17:57:52.060470] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T17:57:52.817581] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-08T17:57:53.478589] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:57:53.624330] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-08T17:57:53.642224] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T17:57:54.417613] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-08T17:57:55.094625] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T17:57:55.217625] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-08T17:57:55.297613] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T17:57:56.017549] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-08T17:57:56.817626] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-08T17:57:57.190756] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T17:57:57.617540] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-08T17:57:57.714188] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T17:57:58.417523] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-08T17:57:58.560351] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T17:57:59.217551] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-08T17:57:59.376666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T17:57:59.787780] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:58:00.017688] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-08T17:58:00.817949] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-08T17:58:00.982954] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:01.617566] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-08T17:58:01.755276] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T17:58:02.049292] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T17:58:02.417613] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-08T17:58:03.139321] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T17:58:03.217556] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-08T17:58:04.017536] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-08T17:58:04.087495] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T17:58:04.807346] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T17:58:04.818364] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-08T17:58:04.869603] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T17:58:05.617582] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-08T17:58:06.309054] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T17:58:06.417580] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-08T17:58:06.533304] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T17:58:07.217594] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-08T17:58:08.004931] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T17:58:08.017496] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-08T17:58:08.068739] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T17:58:08.817564] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-08T17:58:09.607984] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T17:58:09.617516] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-08T17:58:10.417582] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-08T17:58:10.676632] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T17:58:10.679051] [INFO ] [REMOTE ] CDRE: Full fetch complete (35058 records). [2025-10-08T17:58:10.679156] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-08T17:58:11.064146] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-08T17:58:11.064329] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-08T17:58:11.064975] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-08T17:58:11.065058] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-08T17:58:11.094753] [DEBUG] [LOCAL ] CDRE: Trimmed 35058 records to 24629 (keeping 200 days of data) [2025-10-08T17:58:11.098728] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-08T17:58:11.217676] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-08T17:58:11.265818] [DEBUG] [LOCAL ] CDRE: Primary data saved (24629 records). [2025-10-08T17:58:11.265950] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-08T17:58:11.266038] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDRE took 28.0s. Estimated remaining: 4h 28m 27s. Rate: 7.3 symbols/min [2025-10-08T17:58:11.430496] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:11.439017] [DEBUG] [LOCAL ] CEE: Loaded 5637 existing records from primary storage. [2025-10-08T17:58:11.439247] [INFO ] [MAIN ] CEE: Loaded 5637 existing records. [2025-10-08T17:58:11.611310] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:11.611614] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-08T17:58:11.611719] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-08T17:58:11.611914] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-08T17:58:11.611970] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-08T17:58:11.971841] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:12.017538] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-08T17:58:12.114410] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T17:58:12.705290] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T17:58:12.817556] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-08T17:58:13.021632] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:58:13.617572] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-08T17:58:14.417525] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-08T17:58:14.590186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:14.990011] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T17:58:15.217563] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-08T17:58:15.658584] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T17:58:15.663421] [INFO ] [REMOTE ] CDE: Full fetch complete (77595 records). [2025-10-08T17:58:15.663594] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-08T17:58:15.960668] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T17:58:16.022742] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-08T17:58:16.102311] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-08T17:58:16.102416] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-08T17:58:16.103359] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-08T17:58:16.103485] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-08T17:58:16.105176] [DEBUG] [LOCAL ] CDE: Trimmed 77595 records to 53642 (keeping 200 days of data) [2025-10-08T17:58:16.421136] [DEBUG] [LOCAL ] CDE: Primary data saved (53642 records). [2025-10-08T17:58:16.421299] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-08T17:58:16.421900] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDE took 46.3s. Estimated remaining: 4h 28m 4s. Rate: 7.3 symbols/min [2025-10-08T17:58:16.594388] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:16.623004] [DEBUG] [LOCAL ] CEPU: Loaded 25974 existing records from primary storage. [2025-10-08T17:58:16.623307] [INFO ] [MAIN ] CEPU: Loaded 25974 existing records. [2025-10-08T17:58:16.803170] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:16.803422] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-08T17:58:16.803470] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-08T17:58:16.803713] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-08T17:58:16.803772] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-08T17:58:16.823975] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-08T17:58:17.175498] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:17.617559] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-08T17:58:17.697517] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T17:58:18.353871] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T17:58:18.357372] [INFO ] [REMOTE ] CDP: Full fetch complete (61807 records). [2025-10-08T17:58:18.357476] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-08T17:58:18.422459] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-08T17:58:18.632205] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T17:58:18.770045] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-08T17:58:18.770155] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-08T17:58:18.770905] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-08T17:58:18.770970] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-08T17:58:18.772242] [DEBUG] [LOCAL ] CDP: Trimmed 61807 records to 42533 (keeping 200 days of data) [2025-10-08T17:58:19.032513] [DEBUG] [LOCAL ] CDP: Primary data saved (42533 records). [2025-10-08T17:58:19.032668] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-08T17:58:19.033240] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDP took 42.8s. Estimated remaining: 4h 27m 30s. Rate: 7.3 symbols/min [2025-10-08T17:58:19.205402] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:19.217550] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-08T17:58:19.257669] [DEBUG] [LOCAL ] CF: Loaded 52174 existing records from primary storage. [2025-10-08T17:58:19.258029] [INFO ] [MAIN ] CF: Loaded 52174 existing records. [2025-10-08T17:58:19.435997] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:19.436214] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-08T17:58:19.436260] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-08T17:58:19.436552] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-08T17:58:19.436609] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-08T17:58:19.797890] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:19.872676] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:58:20.017585] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-08T17:58:20.817596] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-08T17:58:20.997605] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:58:21.051447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T17:58:21.617626] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-08T17:58:22.417585] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-08T17:58:22.451551] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T17:58:22.576254] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T17:58:23.217572] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-08T17:58:24.017542] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-08T17:58:24.132871] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T17:58:24.316574] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T17:58:24.817587] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-08T17:58:25.120947] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T17:58:25.428411] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T17:58:25.617548] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-08T17:58:26.417519] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-08T17:58:26.741200] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T17:58:26.795092] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T17:58:27.217559] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-08T17:58:28.017516] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-08T17:58:28.342915] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T17:58:28.817589] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-08T17:58:29.452076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T17:58:29.617562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-08T17:58:30.251067] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T17:58:30.417576] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-08T17:58:31.217585] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-08T17:58:31.323954] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T17:58:32.017557] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-08T17:58:32.064590] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T17:58:32.068824] [INFO ] [REMOTE ] CE: Full fetch complete (74775 records). [2025-10-08T17:58:32.068952] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-08T17:58:32.260616] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T17:58:32.508494] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-08T17:58:32.508637] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-08T17:58:32.509786] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-08T17:58:32.509853] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-08T17:58:32.511393] [DEBUG] [LOCAL ] CE: Trimmed 74775 records to 51448 (keeping 200 days of data) [2025-10-08T17:58:32.817586] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-08T17:58:32.822021] [DEBUG] [LOCAL ] CE: Primary data saved (51448 records). [2025-10-08T17:58:32.822164] [INFO ] [MAIN ] CE: Full history saved. [2025-10-08T17:58:32.822249] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CE took 41.9s. Estimated remaining: 4h 27m 47s. Rate: 7.3 symbols/min [2025-10-08T17:58:32.989458] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:33.037915] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-08T17:58:33.038240] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-08T17:58:33.220523] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:33.221031] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-08T17:58:33.221089] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-08T17:58:33.221410] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-08T17:58:33.221468] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-08T17:58:33.582243] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:33.617567] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-08T17:58:33.717035] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T17:58:33.754193] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T17:58:34.417561] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-08T17:58:35.217606] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-08T17:58:35.355803] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T17:58:35.518823] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T17:58:35.741308] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T17:58:36.017567] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-08T17:58:36.765886] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T17:58:36.817564] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-08T17:58:37.371662] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T17:58:37.617568] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-08T17:58:38.417563] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-08T17:58:38.974471] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T17:58:39.217551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-08T17:58:40.017556] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-08T17:58:40.075013] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T17:58:40.810631] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T17:58:40.821285] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-08T17:58:41.273206] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T17:58:41.275506] [INFO ] [REMOTE ] CEPU: Full fetch complete (39297 records). [2025-10-08T17:58:41.275577] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-08T17:58:41.557202] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T17:58:41.569451] [INFO ] [REMOTE ] CEE: Full fetch complete (10138 records). [2025-10-08T17:58:41.574983] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-08T17:58:41.618014] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-08T17:58:41.808118] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-08T17:58:41.808256] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-08T17:58:41.808882] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-08T17:58:41.809248] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-08T17:58:41.869478] [DEBUG] [LOCAL ] CEPU: Trimmed 39297 records to 25995 (keeping 200 days of data) [2025-10-08T17:58:42.179755] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-08T17:58:42.180418] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-08T17:58:42.181453] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-08T17:58:42.181530] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-08T17:58:42.184288] [DEBUG] [LOCAL ] CEE: Trimmed 10138 records to 5614 (keeping 200 days of data) [2025-10-08T17:58:42.226823] [DEBUG] [LOCAL ] CEE: Primary data saved (5614 records). [2025-10-08T17:58:42.229929] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-08T17:58:42.230062] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEE took 31.0s. Estimated remaining: 4h 27m 44s. Rate: 7.3 symbols/min [2025-10-08T17:58:42.418994] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-08T17:58:42.440159] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:42.445222] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-08T17:58:42.445108] [DEBUG] [LOCAL ] CEPU: Primary data saved (25995 records). [2025-10-08T17:58:42.445385] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-08T17:58:42.445533] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-08T17:58:42.445834] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEPU took 26.0s. Estimated remaining: 4h 26m 59s. Rate: 7.3 symbols/min [2025-10-08T17:58:42.445709] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-08T17:58:42.459051] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-08T17:58:42.481405] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-08T17:58:42.492597] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-08T17:58:42.796026] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:43.012620] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:43.026862] [DEBUG] [LOCAL ] CFR: Loaded 33008 existing records from primary storage. [2025-10-08T17:58:43.027227] [INFO ] [MAIN ] CFR: Loaded 33008 existing records. [2025-10-08T17:58:43.212533] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:43.212819] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-08T17:58:43.212868] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-08T17:58:43.213245] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-08T17:58:43.213302] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-08T17:58:43.227007] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-08T17:58:43.475762] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T17:58:43.497719] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-08T17:58:43.505480] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:58:43.509137] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-08T17:58:43.516021] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:58:43.522246] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-08T17:58:43.538031] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-08T17:58:43.543398] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-08T17:58:43.572772] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-08T17:58:43.591688] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 1.4s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-08T17:58:43.611402] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:43.797919] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T17:58:43.834041] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:58:43.872333] [DEBUG] [LOCAL ] CGAU: Loaded 43023 existing records from primary storage. [2025-10-08T17:58:43.872716] [INFO ] [MAIN ] CGAU: Loaded 43023 existing records. [2025-10-08T17:58:44.022568] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-08T17:58:44.054776] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:58:44.055234] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-08T17:58:44.055319] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-08T17:58:44.055723] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-08T17:58:44.055803] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-08T17:58:44.265227] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T17:58:44.478501] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:58:44.817554] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-08T17:58:45.472060] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T17:58:45.617530] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-08T17:58:46.397565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T17:58:46.417496] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-08T17:58:46.820107] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T17:58:47.217553] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-08T17:58:47.937885] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T17:58:48.017603] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-08T17:58:48.822714] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-08T17:58:48.838871] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T17:58:49.617596] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-08T17:58:49.788958] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T17:58:49.963482] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T17:58:50.417551] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-08T17:58:51.073502] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T17:58:51.217572] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-08T17:58:52.017619] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-08T17:58:52.287457] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T17:58:52.444431] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T17:58:52.817623] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-08T17:58:53.395904] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T17:58:53.617638] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-08T17:58:54.293597] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T17:58:54.417551] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-08T17:58:55.217554] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-08T17:58:55.498757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:58:55.533064] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T17:58:56.017593] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-08T17:58:56.817557] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-08T17:58:57.001697] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:58:57.478936] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T17:58:57.617535] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-08T17:58:58.109779] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T17:58:58.417548] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-08T17:58:59.070309] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T17:58:59.217596] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-08T17:58:59.913567] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T17:59:00.017562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-08T17:59:00.817522] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-08T17:59:01.002456] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T17:59:01.617518] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-08T17:59:01.823380] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T17:59:02.235568] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T17:59:02.417565] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-08T17:59:03.099931] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T17:59:03.217627] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-08T17:59:03.755196] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T17:59:04.017695] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-08T17:59:04.785562] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T17:59:04.817515] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-08T17:59:05.430782] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T17:59:05.617547] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-08T17:59:06.417602] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-08T17:59:06.621828] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T17:59:06.625810] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-08T17:59:06.625934] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-08T17:59:07.025538] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-08T17:59:07.025639] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-08T17:59:07.026519] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-08T17:59:07.026571] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-08T17:59:07.028162] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 53623 (keeping 200 days of data) [2025-10-08T17:59:07.127522] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T17:59:07.134170] [INFO ] [REMOTE ] CFR: Full fetch complete (48330 records). [2025-10-08T17:59:07.134859] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-08T17:59:07.223219] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-08T17:59:07.578754] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-08T17:59:07.579132] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-08T17:59:07.580191] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-08T17:59:07.582417] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-08T17:59:07.640739] [DEBUG] [LOCAL ] CFR: Trimmed 48330 records to 32900 (keeping 200 days of data) [2025-10-08T17:59:07.829637] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T17:59:07.969490] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-08T17:59:07.970165] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-08T17:59:07.970294] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CFG took 35.1s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-08T17:59:08.028599] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-08T17:59:08.161197] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:08.168272] [DEBUG] [LOCAL ] CGV: Loaded 1394 existing records from primary storage. [2025-10-08T17:59:08.208392] [INFO ] [MAIN ] CGV: Loaded 1394 existing records. [2025-10-08T17:59:08.402619] [DEBUG] [LOCAL ] CFR: Primary data saved (32900 records). [2025-10-08T17:59:08.409086] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-08T17:59:08.413187] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFR took 26.0s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-08T17:59:08.432194] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:08.478192] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-08T17:59:08.489965] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-08T17:59:08.511305] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-08T17:59:08.511677] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-08T17:59:08.720276] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:08.963768] [DEBUG] [LOCAL ] CHCT: Loaded 23845 existing records from primary storage. [2025-10-08T17:59:09.005082] [INFO ] [MAIN ] CHCT: Loaded 23845 existing records. [2025-10-08T17:59:09.004984] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:09.016171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-08T17:59:09.167493] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T17:59:09.233460] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:09.234033] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-08T17:59:09.234096] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-08T17:59:09.234357] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-08T17:59:09.234416] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-08T17:59:09.602987] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:09.617490] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-08T17:59:09.654983] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T17:59:09.804751] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T17:59:10.417549] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-08T17:59:10.563530] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T17:59:10.871973] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T17:59:11.217561] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-08T17:59:12.017621] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-08T17:59:12.402070] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T17:59:12.817582] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-08T17:59:12.872854] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T17:59:12.877412] [INFO ] [REMOTE ] CF: Full fetch complete (75299 records). [2025-10-08T17:59:12.877586] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-08T17:59:13.212312] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T17:59:13.323852] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-08T17:59:13.323954] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-08T17:59:13.325189] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-08T17:59:13.325269] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-08T17:59:13.327145] [DEBUG] [LOCAL ] CF: Trimmed 75299 records to 52155 (keeping 200 days of data) [2025-10-08T17:59:13.620711] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-08T17:59:13.662188] [DEBUG] [LOCAL ] CF: Primary data saved (52155 records). [2025-10-08T17:59:13.662352] [INFO ] [MAIN ] CF: Full history saved. [2025-10-08T17:59:13.663253] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CF took 54.6s. Estimated remaining: 4h 26m 18s. Rate: 7.3 symbols/min [2025-10-08T17:59:13.834711] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:13.834912] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-10-08T17:59:13.834950] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-10-08T17:59:13.835060] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-08T17:59:13.835100] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-08T17:59:13.835162] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-08T17:59:13.835196] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-08T17:59:14.211112] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:14.417569] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-08T17:59:14.792799] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T17:59:15.217598] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-08T17:59:15.687435] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T17:59:16.017527] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-08T17:59:16.162396] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T17:59:16.817551] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-08T17:59:17.617561] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-08T17:59:17.750461] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T17:59:18.418179] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-08T17:59:18.418098] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T17:59:18.482943] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T17:59:19.217554] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-08T17:59:20.017586] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-08T17:59:20.083498] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T17:59:20.414690] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T17:59:20.490629] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T17:59:20.817593] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-08T17:59:21.617536] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-08T17:59:22.417562] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-08T17:59:22.530731] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T17:59:22.600206] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T17:59:23.217615] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-08T17:59:23.732109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T17:59:23.736010] [INFO ] [REMOTE ] CGAU: Full fetch complete (61027 records). [2025-10-08T17:59:23.736144] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-08T17:59:24.024833] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-08T17:59:24.147525] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-08T17:59:24.147617] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-08T17:59:24.148339] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-08T17:59:24.148397] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-08T17:59:24.149701] [DEBUG] [LOCAL ] CGAU: Trimmed 61027 records to 43077 (keeping 200 days of data) [2025-10-08T17:59:24.411910] [DEBUG] [LOCAL ] CGAU: Primary data saved (43077 records). [2025-10-08T17:59:24.421717] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-08T17:59:24.421855] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGAU took 40.8s. Estimated remaining: 4h 26m 21s. Rate: 7.3 symbols/min [2025-10-08T17:59:24.494871] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T17:59:24.496415] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T17:59:24.613279] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:24.631538] [DEBUG] [LOCAL ] CHE: Loaded 15233 existing records from primary storage. [2025-10-08T17:59:24.631855] [INFO ] [MAIN ] CHE: Loaded 15233 existing records. [2025-10-08T17:59:24.810717] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:24.811032] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-08T17:59:24.811079] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-08T17:59:24.811307] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-08T17:59:24.811366] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-08T17:59:24.822727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-08T17:59:25.177951] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:25.297915] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T17:59:25.617605] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-08T17:59:26.417566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-08T17:59:27.217586] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-08T17:59:27.421319] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T17:59:27.441811] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T17:59:27.506904] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-08T17:59:28.017581] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-08T17:59:28.817606] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-08T17:59:29.617520] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-08T17:59:29.708299] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T17:59:29.951057] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T17:59:30.417593] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-08T17:59:30.444787] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T17:59:30.868382] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T17:59:31.217566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-08T17:59:31.986471] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T17:59:32.017531] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-08T17:59:32.818322] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-08T17:59:32.824269] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T17:59:33.617565] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-08T17:59:34.179243] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T17:59:34.298977] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T17:59:34.417552] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-08T17:59:35.217548] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-08T17:59:35.391343] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T17:59:35.706926] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T17:59:35.707639] [INFO ] [REMOTE ] CGV: Full fetch complete (2276 records). [2025-10-08T17:59:35.707735] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-08T17:59:36.022702] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-08T17:59:36.064372] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-08T17:59:36.064498] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-08T17:59:36.064609] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-08T17:59:36.064684] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-08T17:59:36.065074] [DEBUG] [LOCAL ] CGV: Trimmed 2276 records to 1395 (keeping 200 days of data) [2025-10-08T17:59:36.074506] [DEBUG] [LOCAL ] CGV: Primary data saved (1395 records). [2025-10-08T17:59:36.074626] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-08T17:59:36.074748] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 28.1s. Estimated remaining: 4h 26m 28s. Rate: 7.3 symbols/min [2025-10-08T17:59:36.252023] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:36.298074] [DEBUG] [LOCAL ] CHGG: Loaded 47825 existing records from primary storage. [2025-10-08T17:59:36.298479] [INFO ] [MAIN ] CHGG: Loaded 47825 existing records. [2025-10-08T17:59:36.480873] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:36.481125] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-08T17:59:36.481174] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-08T17:59:36.481451] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-08T17:59:36.481509] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-08T17:59:36.820730] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-08T17:59:36.851524] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:37.617527] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-08T17:59:37.863063] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T17:59:37.884397] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T17:59:38.415144] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T17:59:38.421277] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-08T17:59:39.217586] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-08T17:59:39.338398] [DEBUG] [REMOTE ] CHCT: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T17:59:39.338783] [WARN ] [REMOTE ] CHCT: No data returned for month 2025-09 [2025-10-08T17:59:39.338872] [FATAL] [REMOTE ] CHCT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T17:59:39.339087] [FATAL] [MAIN ] CHCT: Failed to fetch primary data. [2025-10-08T17:59:39.339168] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T17:59:39.339242] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-08T17:59:39.339307] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-08T17:59:39.339342] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-08T17:59:39.339616] [DEBUG] [LOCAL ] CHCT: Deleted derivative data file. [2025-10-08T17:59:39.339736] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CHCT took 30.9s. Estimated remaining: 4h 25m 58s. Rate: 7.3 symbols/min [2025-10-08T17:59:39.537992] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:39.574750] [DEBUG] [LOCAL ] CHH: Loaded 32270 existing records from primary storage. [2025-10-08T17:59:39.575162] [INFO ] [MAIN ] CHH: Loaded 32270 existing records. [2025-10-08T17:59:39.760764] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:39.760992] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-08T17:59:39.761042] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-08T17:59:39.761954] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-08T17:59:39.762017] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-08T17:59:40.027038] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-08T17:59:40.142474] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:40.817577] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-08T17:59:40.852821] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-08T17:59:41.357375] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T17:59:41.617567] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-08T17:59:42.009316] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T17:59:42.417639] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-08T17:59:43.217539] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-08T17:59:43.240439] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T17:59:43.652964] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T17:59:44.017670] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-08T17:59:44.591587] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T17:59:44.817591] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-08T17:59:45.617551] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-08T17:59:45.737187] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T17:59:45.864085] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T17:59:46.417566] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-08T17:59:46.959251] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T17:59:47.217538] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-08T17:59:47.228901] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T17:59:47.230732] [INFO ] [REMOTE ] CHE: Full fetch complete (20201 records). [2025-10-08T17:59:47.230808] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-08T17:59:47.586897] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-08T17:59:47.586979] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-08T17:59:47.587338] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-08T17:59:47.587376] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-08T17:59:47.587984] [DEBUG] [LOCAL ] CHE: Trimmed 20201 records to 15279 (keeping 200 days of data) [2025-10-08T17:59:47.687512] [DEBUG] [LOCAL ] CHE: Primary data saved (15279 records). [2025-10-08T17:59:47.687682] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-08T17:59:47.687783] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 23.3s. Estimated remaining: 4h 25m 50s. Rate: 7.3 symbols/min [2025-10-08T17:59:47.854684] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:47.874682] [DEBUG] [LOCAL ] CHMI: Loaded 21639 existing records from primary storage. [2025-10-08T17:59:47.874949] [INFO ] [MAIN ] CHMI: Loaded 21639 existing records. [2025-10-08T17:59:48.020802] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-08T17:59:48.057109] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:48.057354] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-08T17:59:48.057421] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-08T17:59:48.058292] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-08T17:59:48.058358] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-08T17:59:48.413874] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:48.592205] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T17:59:48.817571] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-08T17:59:49.617520] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-08T17:59:49.899070] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T17:59:50.417513] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-08T17:59:50.476184] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T17:59:50.680820] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T17:59:51.217590] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-08T17:59:52.017516] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-08T17:59:52.140598] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T17:59:52.817555] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-08T17:59:52.872871] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T17:59:53.617585] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-08T17:59:53.710211] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T17:59:54.417688] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-08T17:59:54.618522] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T17:59:54.978271] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T17:59:55.217583] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-08T17:59:55.686815] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T17:59:56.017628] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-08T17:59:56.797613] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T17:59:56.803499] [INFO ] [REMOTE ] CHD: Full fetch complete (74448 records). [2025-10-08T17:59:56.803742] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-08T17:59:56.822770] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-08T17:59:57.276739] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-08T17:59:57.276892] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-08T17:59:57.277766] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-08T17:59:57.277859] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-08T17:59:57.299828] [DEBUG] [LOCAL ] CHD: Trimmed 74448 records to 52208 (keeping 200 days of data) [2025-10-08T17:59:57.301380] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T17:59:57.630701] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-08T17:59:57.654407] [DEBUG] [LOCAL ] CHD: Primary data saved (52208 records). [2025-10-08T17:59:57.654549] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-08T17:59:57.654626] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 44.0s. Estimated remaining: 4h 25m 50s. Rate: 7.3 symbols/min [2025-10-08T17:59:57.819865] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T17:59:57.826422] [DEBUG] [LOCAL ] CHN: Loaded 4770 existing records from primary storage. [2025-10-08T17:59:57.826743] [INFO ] [MAIN ] CHN: Loaded 4770 existing records. [2025-10-08T17:59:58.005700] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T17:59:58.006021] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-08T17:59:58.006085] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-08T17:59:58.006417] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-08T17:59:58.006476] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-08T17:59:58.371850] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T17:59:58.400244] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T17:59:58.417502] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-08T17:59:58.731962] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T17:59:58.888510] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T17:59:59.217620] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-08T18:00:00.017615] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-08T18:00:00.519968] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:00:00.737332] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T18:00:00.817547] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-08T18:00:01.470361] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:00:01.617637] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-08T18:00:02.217708] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:00:02.417703] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-08T18:00:03.217591] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-08T18:00:03.847312] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:00:04.017544] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-08T18:00:04.817581] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-08T18:00:05.340745] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T18:00:05.343743] [INFO ] [REMOTE ] CHH: Full fetch complete (47070 records). [2025-10-08T18:00:05.343851] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-08T18:00:05.627830] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-08T18:00:05.780345] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-08T18:00:05.780774] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-08T18:00:05.781439] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-08T18:00:05.781577] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-08T18:00:05.783007] [DEBUG] [LOCAL ] CHH: Trimmed 47070 records to 32293 (keeping 200 days of data) [2025-10-08T18:00:05.898908] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:00:05.934675] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-08T18:00:06.050431] [DEBUG] [LOCAL ] CHH: Primary data saved (32293 records). [2025-10-08T18:00:06.050567] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-08T18:00:06.050689] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 26.7s. Estimated remaining: 4h 25m 42s. Rate: 7.3 symbols/min [2025-10-08T18:00:06.072694] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:00:06.417583] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-08T18:00:07.044990] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:00:07.217548] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-08T18:00:08.017556] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-08T18:00:08.676847] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:00:08.712017] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T18:00:08.817556] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-08T18:00:09.525719] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:00:09.617596] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-08T18:00:10.417608] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-08T18:00:10.614898] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T18:00:11.217514] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-08T18:00:11.266084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T18:00:12.017516] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-08T18:00:12.259095] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:00:12.504848] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T18:00:12.817560] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-08T18:00:13.617597] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-08T18:00:14.417558] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-08T18:00:15.119594] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:00:15.120488] [INFO ] [REMOTE ] CHN: Full fetch complete (7405 records). [2025-10-08T18:00:15.120560] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-08T18:00:15.295076] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-08T18:00:15.328344] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-08T18:00:15.521366] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-08T18:00:15.521444] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-08T18:00:15.521628] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-08T18:00:15.521721] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-08T18:00:15.522135] [DEBUG] [LOCAL ] CHN: Trimmed 7405 records to 4753 (keeping 200 days of data) [2025-10-08T18:00:15.550394] [DEBUG] [LOCAL ] CHN: Primary data saved (4753 records). [2025-10-08T18:00:15.550526] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-08T18:00:15.550613] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHN took 17.9s. Estimated remaining: 4h 25m 39s. Rate: 7.3 symbols/min [2025-10-08T18:00:16.363226] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T18:00:16.373821] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-08T18:00:16.991849] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:00:16.998357] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-08T18:00:17.783306] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:00:17.788303] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-08T18:00:18.054661] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T18:00:18.417554] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-08T18:00:19.178977] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:00:19.217544] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-08T18:00:19.742147] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:00:20.017604] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-08T18:00:20.206820] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:00:20.208723] [INFO ] [REMOTE ] CHMI: Full fetch complete (31814 records). [2025-10-08T18:00:20.208802] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-08T18:00:20.619856] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-08T18:00:20.619963] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-08T18:00:20.620490] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-08T18:00:20.620532] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-08T18:00:20.621435] [DEBUG] [LOCAL ] CHMI: Trimmed 31814 records to 21661 (keeping 200 days of data) [2025-10-08T18:00:20.753282] [DEBUG] [LOCAL ] CHMI: Primary data saved (21661 records). [2025-10-08T18:00:20.753417] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-08T18:00:20.753497] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHMI took 33.1s. Estimated remaining: 4h 25m 18s. Rate: 7.3 symbols/min [2025-10-08T18:00:21.590609] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:00:21.601678] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-08T18:00:23.249790] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T18:00:23.253456] [INFO ] [REMOTE ] CHGG: Full fetch complete (70072 records). [2025-10-08T18:00:23.253624] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-08T18:00:23.258567] [FATAL] [VALIDATOR ] CHGG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:00:23.258771] [FATAL] [MAIN ] CHGG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:00:23.258818] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:00:23.258886] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-08T18:00:23.258955] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-08T18:00:23.258992] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-08T18:00:23.259197] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-08T18:00:23.259311] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHGG took 47.2s. Estimated remaining: 4h 24m 44s. Rate: 7.3 symbols/min [2025-10-08T18:00:23.979676] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:23.965613] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.008472] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-08T18:00:24.011780] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-08T18:00:24.053222] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.049503] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-08T18:00:24.060007] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-08T18:00:24.063239] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-08T18:00:24.063526] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-08T18:00:24.125027] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:24.272639] [DEBUG] [LOCAL ] CHT: Loaded 19602 existing records from primary storage. [2025-10-08T18:00:24.304894] [INFO ] [MAIN ] CHT: Loaded 19602 existing records. [2025-10-08T18:00:24.630969] [DEBUG] [LOCAL ] CI: Loaded 49809 existing records from primary storage. [2025-10-08T18:00:24.661982] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-08T18:00:24.667905] [INFO ] [MAIN ] CI: Loaded 49809 existing records. [2025-10-08T18:00:24.691090] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-08T18:00:24.795313] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:24.860986] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-08T18:00:24.956439] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:24.982843] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-08T18:00:24.999503] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-08T18:00:25.044958] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-08T18:00:25.065818] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-08T18:00:25.184721] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:25.230022] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:25.249226] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-08T18:00:25.258757] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-08T18:00:25.275422] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-08T18:00:25.294674] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-08T18:00:25.319544] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-08T18:00:25.325587] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-08T18:00:25.325695] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-08T18:00:25.325884] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-08T18:00:26.111346] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.135844] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-08T18:00:26.381750] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.387167] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-08T18:00:26.391452] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:26.391896] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-08T18:00:27.347428] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:00:27.351810] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-08T18:00:27.390699] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-08T18:00:27.402960] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-08T18:00:27.966859] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:00:27.980792] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-08T18:00:27.993928] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T18:00:27.997985] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-08T18:00:28.121391] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:00:28.132074] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-08T18:00:28.842475] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:00:28.846845] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-08T18:00:29.292741] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:00:29.560791] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:00:29.617543] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-08T18:00:30.017002] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:00:30.055512] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T18:00:30.417540] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-08T18:00:31.217577] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-08T18:00:31.572172] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:00:31.856612] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-08T18:00:32.017629] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-08T18:00:32.817703] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-08T18:00:32.875059] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:00:33.617597] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-08T18:00:33.691044] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T18:00:34.417546] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-08T18:00:34.584037] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:00:35.217530] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-08T18:00:35.418940] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:00:36.017582] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-08T18:00:36.310883] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:00:36.313006] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:00:36.817595] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-08T18:00:37.617510] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-08T18:00:37.891762] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T18:00:38.417529] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-08T18:00:38.679175] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:00:38.852941] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:00:39.217554] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-08T18:00:40.017721] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-08T18:00:40.128593] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T18:00:40.794129] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-08T18:00:40.817504] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-08T18:00:41.617575] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-08T18:00:42.220182] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T18:00:42.344007] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:00:42.417535] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-08T18:00:42.908325] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:00:43.217521] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-08T18:00:44.017529] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-08T18:00:44.236444] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:00:44.639336] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T18:00:44.817701] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-08T18:00:45.077941] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T18:00:45.617526] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-08T18:00:45.714094] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:00:45.715861] [INFO ] [REMOTE ] CHT: Full fetch complete (27485 records). [2025-10-08T18:00:45.715939] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-08T18:00:45.716556] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:00:45.716666] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:00:45.716724] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:00:45.716765] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-08T18:00:45.716836] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-08T18:00:45.716890] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-08T18:00:45.717135] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-08T18:00:45.717230] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 22.5s. Estimated remaining: 4h 25m 38s. Rate: 7.3 symbols/min [2025-10-08T18:00:45.884181] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:00:45.901009] [DEBUG] [LOCAL ] CIA: Loaded 16849 existing records from primary storage. [2025-10-08T18:00:45.901257] [INFO ] [MAIN ] CIA: Loaded 16849 existing records. [2025-10-08T18:00:46.076284] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:00:46.076511] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-08T18:00:46.076558] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-08T18:00:46.077052] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-08T18:00:46.077113] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-08T18:00:46.418370] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-08T18:00:46.444428] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:00:47.217528] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-08T18:00:47.702089] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T18:00:47.863692] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:00:48.017509] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-08T18:00:48.121384] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T18:00:48.817611] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-08T18:00:49.617542] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-08T18:00:49.830770] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:00:50.417618] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-08T18:00:50.792609] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T18:00:51.217568] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-08T18:00:51.483454] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T18:00:52.017675] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-08T18:00:52.068377] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T18:00:52.257447] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T18:00:52.817624] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-08T18:00:53.617547] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-08T18:00:53.726250] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T18:00:53.853040] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:00:54.417589] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-08T18:00:55.217540] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-08T18:00:55.507299] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T18:00:55.848190] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:00:56.017572] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-08T18:00:56.817565] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-08T18:00:57.552002] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T18:00:57.617526] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-08T18:00:57.744217] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T18:00:57.847885] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:00:58.417604] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-08T18:00:59.217581] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-08T18:00:59.414097] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T18:00:59.418150] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-08T18:00:59.418263] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-08T18:00:59.671232] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:00:59.873104] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-08T18:00:59.873320] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-08T18:00:59.874534] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-08T18:00:59.874621] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-08T18:00:59.876860] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 53654 (keeping 200 days of data) [2025-10-08T18:01:00.054296] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-08T18:01:00.219055] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-08T18:01:00.219208] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-08T18:01:00.219338] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHWY took 37.0s. Estimated remaining: 4h 25m 57s. Rate: 7.3 symbols/min [2025-10-08T18:01:00.403062] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:00.436225] [DEBUG] [LOCAL ] CIB: Loaded 30737 existing records from primary storage. [2025-10-08T18:01:00.436578] [INFO ] [MAIN ] CIB: Loaded 30737 existing records. [2025-10-08T18:01:00.619957] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:00.620236] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-08T18:01:00.620292] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-08T18:01:00.621274] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-08T18:01:00.621336] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-08T18:01:00.828393] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-08T18:01:00.991913] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:01.107516] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:01:01.184226] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T18:01:01.187189] [INFO ] [REMOTE ] CHPT: Full fetch complete (71958 records). [2025-10-08T18:01:01.187330] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-08T18:01:01.188134] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:01.188217] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:01.188282] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:01.188353] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-08T18:01:01.188418] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-08T18:01:01.188452] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-08T18:01:01.188490] [DEBUG] [LOCAL ] CHPT: No derivative data file found to delete. [2025-10-08T18:01:01.188566] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 37.9s. Estimated remaining: 4h 25m 17s. Rate: 7.3 symbols/min [2025-10-08T18:01:01.355886] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:01.356115] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-08T18:01:01.356158] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-08T18:01:01.356271] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-08T18:01:01.356311] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-08T18:01:01.356351] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-08T18:01:01.356382] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-08T18:01:01.624712] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-08T18:01:01.649975] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:01:01.664950] [INFO ] [REMOTE ] CI: Full fetch complete (72263 records). [2025-10-08T18:01:01.698942] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-08T18:01:01.775365] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:02.135489] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-08T18:01:02.135570] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-08T18:01:02.136368] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-08T18:01:02.136432] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-08T18:01:02.137859] [DEBUG] [LOCAL ] CI: Trimmed 72263 records to 49812 (keeping 200 days of data) [2025-10-08T18:01:02.429688] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-08T18:01:02.466215] [DEBUG] [LOCAL ] CI: Primary data saved (49812 records). [2025-10-08T18:01:02.466406] [INFO ] [MAIN ] CI: Full history saved. [2025-10-08T18:01:02.466496] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CI took 39.2s. Estimated remaining: 4h 24m 39s. Rate: 7.3 symbols/min [2025-10-08T18:01:02.638596] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:02.686069] [DEBUG] [LOCAL ] CIEN: Loaded 52111 existing records from primary storage. [2025-10-08T18:01:02.686394] [INFO ] [MAIN ] CIEN: Loaded 52111 existing records. [2025-10-08T18:01:02.826229] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:01:02.887849] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:02.888085] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-08T18:01:02.888142] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-08T18:01:02.889547] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-08T18:01:02.889607] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-08T18:01:03.222806] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-08T18:01:03.244965] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:03.626251] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:01:04.017561] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-08T18:01:04.289089] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:01:04.817548] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-08T18:01:05.617552] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-08T18:01:05.752335] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T18:01:05.897108] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:01:06.417606] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-08T18:01:06.789153] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:01:07.010040] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T18:01:07.217598] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-08T18:01:08.017613] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-08T18:01:08.116962] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:01:08.505406] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T18:01:08.817614] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-08T18:01:09.617503] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-08T18:01:09.838626] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T18:01:09.840105] [INFO ] [REMOTE ] CIA: Full fetch complete (23527 records). [2025-10-08T18:01:09.840176] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-08T18:01:10.221340] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-08T18:01:10.221452] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-08T18:01:10.221878] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-08T18:01:10.221940] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-08T18:01:10.222529] [DEBUG] [LOCAL ] CIA: Trimmed 23527 records to 16834 (keeping 200 days of data) [2025-10-08T18:01:10.320141] [DEBUG] [LOCAL ] CIA: Primary data saved (16834 records). [2025-10-08T18:01:10.320298] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-08T18:01:10.320387] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CIA took 24.6s. Estimated remaining: 4h 24m 29s. Rate: 7.3 symbols/min [2025-10-08T18:01:10.422911] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-08T18:01:10.504845] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:10.505023] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-10-08T18:01:10.505058] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-10-08T18:01:10.505170] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-08T18:01:10.505211] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-08T18:01:10.505250] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-08T18:01:10.505281] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-08T18:01:10.858899] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:11.217616] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-08T18:01:11.443623] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:01:11.709565] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T18:01:11.788474] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:01:12.017558] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-08T18:01:12.817606] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-08T18:01:13.450036] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T18:01:13.497600] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:01:13.617595] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-08T18:01:14.417568] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-08T18:01:15.217559] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-08T18:01:15.451105] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:01:15.505236] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T18:01:15.785925] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:01:16.017557] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-08T18:01:16.817617] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-08T18:01:17.512674] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T18:01:17.617516] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-08T18:01:17.764292] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T18:01:18.417622] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-08T18:01:18.894360] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:01:18.929103] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T18:01:19.217604] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-08T18:01:19.648248] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T18:01:20.017613] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-08T18:01:20.817548] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-08T18:01:21.076378] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-08T18:01:21.617533] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-08T18:01:21.699618] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:01:21.992273] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-08T18:01:22.417561] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-08T18:01:22.846035] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T18:01:23.217558] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-08T18:01:23.574229] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:01:24.017552] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-08T18:01:24.817513] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-08T18:01:25.127515] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T18:01:25.285460] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:01:25.617596] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-08T18:01:26.417560] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-08T18:01:26.796410] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T18:01:26.797179] [INFO ] [REMOTE ] CICB: Full fetch complete (1991 records). [2025-10-08T18:01:26.797253] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-08T18:01:26.797627] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:26.797750] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:26.797793] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:26.797837] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-08T18:01:26.797930] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-08T18:01:26.797987] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-08T18:01:26.798032] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-08T18:01:26.798106] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 25.6s. Estimated remaining: 4h 24m 56s. Rate: 7.3 symbols/min [2025-10-08T18:01:26.981229] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:27.026057] [DEBUG] [LOCAL ] CIG: Loaded 43835 existing records from primary storage. [2025-10-08T18:01:27.026389] [INFO ] [MAIN ] CIG: Loaded 43835 existing records. [2025-10-08T18:01:27.221264] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-08T18:01:27.221169] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:27.222444] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-08T18:01:27.222529] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-08T18:01:27.232968] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-08T18:01:27.250782] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-08T18:01:27.311929] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:01:27.637538] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:28.017577] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-08T18:01:28.502993] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T18:01:28.794727] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:01:28.817571] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-08T18:01:29.295383] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T18:01:29.617552] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-08T18:01:30.417599] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-08T18:01:31.217579] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-08T18:01:31.263233] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:01:31.540788] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T18:01:32.017640] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-08T18:01:32.462844] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T18:01:32.817520] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-08T18:01:33.617591] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-08T18:01:33.838913] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:01:34.050338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T18:01:34.417616] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-08T18:01:35.185486] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:01:35.217518] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-08T18:01:35.647300] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T18:01:36.017625] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-08T18:01:36.567946] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T18:01:36.598709] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T18:01:36.817563] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-08T18:01:37.617537] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-08T18:01:38.138478] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T18:01:38.406464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:01:38.417500] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-08T18:01:39.217595] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-08T18:01:40.007813] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:01:40.017505] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-08T18:01:40.047195] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T18:01:40.817609] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-08T18:01:41.579840] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T18:01:41.607997] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T18:01:41.617463] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-08T18:01:42.417570] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-08T18:01:42.998259] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T18:01:43.068350] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T18:01:43.217549] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-08T18:01:44.017587] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-08T18:01:44.251461] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T18:01:44.263989] [INFO ] [REMOTE ] CIB: Full fetch complete (44547 records). [2025-10-08T18:01:44.264224] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-08T18:01:44.821703] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-08T18:01:44.864183] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-08T18:01:44.864325] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-08T18:01:44.865155] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-08T18:01:44.865230] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-08T18:01:44.866768] [DEBUG] [LOCAL ] CIB: Trimmed 44547 records to 30591 (keeping 200 days of data) [2025-10-08T18:01:45.088796] [DEBUG] [LOCAL ] CIB: Primary data saved (30591 records). [2025-10-08T18:01:45.088960] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-08T18:01:45.089051] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 44.9s. Estimated remaining: 4h 25m 31s. Rate: 7.2 symbols/min [2025-10-08T18:01:45.302480] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:45.319944] [DEBUG] [LOCAL ] CII: Loaded 15178 existing records from primary storage. [2025-10-08T18:01:45.320214] [INFO ] [MAIN ] CII: Loaded 15178 existing records. [2025-10-08T18:01:45.523256] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:45.523522] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-08T18:01:45.523570] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-08T18:01:45.524143] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-08T18:01:45.524203] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-08T18:01:45.628745] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-08T18:01:45.956830] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:46.001449] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T18:01:46.185760] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:01:46.186622] [INFO ] [REMOTE ] CIF: Full fetch complete (6595 records). [2025-10-08T18:01:46.186726] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-08T18:01:46.425317] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-08T18:01:46.582093] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-08T18:01:46.582208] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-08T18:01:46.582437] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-08T18:01:46.582509] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-08T18:01:46.583132] [DEBUG] [LOCAL ] CIF: Trimmed 6595 records to 4097 (keeping 200 days of data) [2025-10-08T18:01:46.632517] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:01:46.650239] [DEBUG] [LOCAL ] CIF: Primary data saved (4097 records). [2025-10-08T18:01:46.650574] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-08T18:01:46.650701] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIF took 36.3s. Estimated remaining: 4h 24m 54s. Rate: 7.3 symbols/min [2025-10-08T18:01:46.819417] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:46.859314] [DEBUG] [LOCAL ] CIM: Loaded 37719 existing records from primary storage. [2025-10-08T18:01:46.859701] [INFO ] [MAIN ] CIM: Loaded 37719 existing records. [2025-10-08T18:01:47.057184] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:01:47.057521] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-08T18:01:47.057584] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-08T18:01:47.058793] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-08T18:01:47.058855] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-08T18:01:47.222839] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-08T18:01:47.458267] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:47.596933] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:01:48.017601] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-08T18:01:48.767325] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:01:48.817531] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-08T18:01:49.366269] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:01:49.617545] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-08T18:01:50.427550] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-08T18:01:50.453209] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:01:51.217632] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-08T18:01:51.326577] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:01:51.484026] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:01:51.489507] [INFO ] [REMOTE ] CIEN: Full fetch complete (75175 records). [2025-10-08T18:01:51.489715] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-08T18:01:51.493748] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:01:51.493882] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:01:51.493965] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:01:51.494063] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-08T18:01:51.494188] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-08T18:01:51.494257] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-08T18:01:51.494788] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-10-08T18:01:51.494897] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 49.0s. Estimated remaining: 4h 24m 31s. Rate: 7.3 symbols/min [2025-10-08T18:01:51.696073] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:51.696303] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-08T18:01:51.696348] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-08T18:01:51.696471] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-08T18:01:51.696514] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-08T18:01:51.696558] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-08T18:01:51.696592] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-08T18:01:52.022764] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-08T18:01:52.093321] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:52.412533] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:01:52.817532] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-08T18:01:53.054359] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:01:53.617532] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-08T18:01:54.417549] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-08T18:01:54.443875] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:01:54.450207] [INFO ] [REMOTE ] CIG: Full fetch complete (61351 records). [2025-10-08T18:01:54.450366] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-08T18:01:54.720166] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T18:01:54.889069] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-08T18:01:54.889156] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-08T18:01:54.889879] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-08T18:01:54.889942] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-08T18:01:54.891508] [DEBUG] [LOCAL ] CIG: Trimmed 61351 records to 43848 (keeping 200 days of data) [2025-10-08T18:01:55.071340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:01:55.155528] [DEBUG] [LOCAL ] CIG: Primary data saved (43848 records). [2025-10-08T18:01:55.155693] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-08T18:01:55.157128] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIG took 28.4s. Estimated remaining: 4h 24m 3s. Rate: 7.3 symbols/min [2025-10-08T18:01:55.222757] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-08T18:01:55.330795] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:01:55.330942] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-08T18:01:55.330978] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-08T18:01:55.331088] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-08T18:01:55.331130] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-08T18:01:55.331172] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-08T18:01:55.331205] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-08T18:01:55.672610] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:01:56.017558] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-08T18:01:56.427352] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T18:01:56.817542] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-08T18:01:56.868063] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:01:57.617533] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-08T18:01:57.888521] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T18:01:58.417722] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-08T18:01:58.981948] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:01:59.015928] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:01:59.217580] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-08T18:02:00.017559] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-08T18:02:00.473214] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T18:02:00.817518] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-08T18:02:01.159869] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T18:02:01.599622] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:02:01.617508] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-08T18:02:02.417545] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-08T18:02:02.597850] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:02:03.217601] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-08T18:02:03.717231] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T18:02:03.980779] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:02:04.017517] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-08T18:02:04.817554] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-08T18:02:05.467254] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:02:05.596846] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:02:05.617520] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-08T18:02:06.417516] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-08T18:02:06.660489] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:02:07.217585] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-08T18:02:07.599144] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:02:08.017554] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-08T18:02:08.157250] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T18:02:08.158865] [INFO ] [REMOTE ] CII: Full fetch complete (22838 records). [2025-10-08T18:02:08.158937] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-08T18:02:08.159507] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:02:08.159586] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:08.159676] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:08.159735] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-08T18:02:08.159792] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-08T18:02:08.159826] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-08T18:02:08.160026] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-08T18:02:08.160207] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CII took 23.1s. Estimated remaining: 4h 24m 15s. Rate: 7.3 symbols/min [2025-10-08T18:02:08.327101] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:08.327319] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-08T18:02:08.327374] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-08T18:02:08.327495] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-08T18:02:08.327539] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-08T18:02:08.327579] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-08T18:02:08.327611] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-08T18:02:08.616218] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:02:08.702199] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:08.817579] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-08T18:02:09.025178] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:02:09.025484] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-08T18:02:09.025599] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:02:09.025727] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-08T18:02:09.025812] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:02:09.025897] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-08T18:02:09.026005] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-08T18:02:09.026066] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-08T18:02:09.026141] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-08T18:02:09.026226] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIMP took 0.9s. Estimated remaining: 4h 23m 36s. Rate: 7.3 symbols/min [2025-10-08T18:02:09.270185] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:09.293308] [DEBUG] [LOCAL ] CINT: Loaded 19213 existing records from primary storage. [2025-10-08T18:02:09.293696] [INFO ] [MAIN ] CINT: Loaded 19213 existing records. [2025-10-08T18:02:09.521781] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:09.522090] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-08T18:02:09.522151] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-08T18:02:09.522764] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-08T18:02:09.522829] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-08T18:02:09.622351] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-08T18:02:09.899827] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:10.145621] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T18:02:10.417610] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-08T18:02:11.217523] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-08T18:02:11.379434] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T18:02:12.017559] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-08T18:02:12.564739] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:02:12.811401] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:02:12.819093] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-08T18:02:13.308342] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:02:13.617561] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-08T18:02:14.417563] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-08T18:02:14.978609] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T18:02:15.032036] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:02:15.217559] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-08T18:02:16.017547] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-08T18:02:16.745532] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:02:16.765923] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T18:02:16.817542] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-08T18:02:17.260659] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:02:17.617540] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-08T18:02:17.993762] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T18:02:18.417547] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-08T18:02:18.962093] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:02:19.217555] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-08T18:02:19.683401] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:02:20.017554] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-08T18:02:20.628354] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:02:20.817607] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-08T18:02:21.282811] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T18:02:21.617537] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-08T18:02:22.417608] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-08T18:02:22.503736] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T18:02:23.144729] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:02:23.217607] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-08T18:02:23.768629] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T18:02:24.017610] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-08T18:02:24.711637] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:02:24.712847] [INFO ] [REMOTE ] CIMO: Full fetch complete (5167 records). [2025-10-08T18:02:24.712981] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-08T18:02:24.822704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-08T18:02:24.927282] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:02:24.927527] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:24.927597] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:24.927693] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-08T18:02:24.927763] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-08T18:02:24.927798] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-08T18:02:24.927838] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-08T18:02:24.927954] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMO took 29.8s. Estimated remaining: 4h 23m 60s. Rate: 7.3 symbols/min [2025-10-08T18:02:25.117258] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:25.138711] [DEBUG] [LOCAL ] CIO: Loaded 20458 existing records from primary storage. [2025-10-08T18:02:25.138981] [INFO ] [MAIN ] CIO: Loaded 20458 existing records. [2025-10-08T18:02:25.314260] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:25.314487] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-08T18:02:25.314533] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-08T18:02:25.315163] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-08T18:02:25.315222] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-08T18:02:25.419152] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T18:02:25.622725] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-08T18:02:25.676663] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:26.417581] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-08T18:02:26.697811] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T18:02:26.782141] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:02:27.217565] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-08T18:02:27.725795] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T18:02:27.726844] [INFO ] [REMOTE ] CIMN: Full fetch complete (3930 records). [2025-10-08T18:02:27.726921] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-08T18:02:28.022811] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-08T18:02:28.128226] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-08T18:02:28.128317] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-08T18:02:28.128494] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-08T18:02:28.128582] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-08T18:02:28.129050] [DEBUG] [LOCAL ] CIMN: Trimmed 3930 records to 2733 (keeping 200 days of data) [2025-10-08T18:02:28.146543] [DEBUG] [LOCAL ] CIMN: Primary data saved (2733 records). [2025-10-08T18:02:28.146810] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-08T18:02:28.146929] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIMN took 36.7s. Estimated remaining: 4h 23m 30s. Rate: 7.3 symbols/min [2025-10-08T18:02:28.325743] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:28.355273] [DEBUG] [LOCAL ] CION: Loaded 28464 existing records from primary storage. [2025-10-08T18:02:28.355597] [INFO ] [MAIN ] CION: Loaded 28464 existing records. [2025-10-08T18:02:28.559541] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:28.559830] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-08T18:02:28.559880] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-08T18:02:28.560706] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-08T18:02:28.560770] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-08T18:02:28.822684] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-08T18:02:28.968801] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:29.415430] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T18:02:29.418796] [INFO ] [REMOTE ] CIM: Full fetch complete (54758 records). [2025-10-08T18:02:29.418930] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-08T18:02:29.419625] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:02:29.419738] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:02:29.419784] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:02:29.419824] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-08T18:02:29.419884] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-08T18:02:29.419921] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-10-08T18:02:29.420086] [DEBUG] [LOCAL ] CIM: Deleted derivative data file. [2025-10-08T18:02:29.420961] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIM took 42.8s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-08T18:02:29.595831] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:29.617579] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-08T18:02:29.656445] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-08T18:02:29.656798] [INFO ] [MAIN ] CIVI: Loaded 52615 existing records. [2025-10-08T18:02:29.838051] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:29.838496] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-08T18:02:29.838613] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-08T18:02:29.839005] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-08T18:02:29.839064] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-08T18:02:29.967846] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:02:30.237052] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:30.417571] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-08T18:02:31.024224] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:02:31.103007] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:02:31.217616] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-08T18:02:32.017563] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-08T18:02:32.410532] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:02:32.817561] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-08T18:02:33.262930] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:02:33.617591] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-08T18:02:33.655474] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:02:34.417601] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-08T18:02:34.733619] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:02:35.217551] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-08T18:02:36.017580] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-08T18:02:36.127589] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:02:36.174406] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:02:36.817586] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-08T18:02:37.432091] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T18:02:37.617558] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-08T18:02:37.967775] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:02:38.417599] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-08T18:02:38.609023] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T18:02:39.217561] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-08T18:02:40.017512] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-08T18:02:40.144759] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:02:40.322923] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:02:40.817620] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-08T18:02:41.096755] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T18:02:41.617558] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-08T18:02:42.385768] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:02:42.417537] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-08T18:02:42.602166] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:02:43.217580] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-08T18:02:44.017515] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-08T18:02:44.190624] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:02:44.227876] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T18:02:44.817606] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-08T18:02:45.374541] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:02:45.378233] [INFO ] [REMOTE ] CINT: Full fetch complete (27357 records). [2025-10-08T18:02:45.378343] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-08T18:02:45.627076] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-08T18:02:45.748083] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-08T18:02:45.748172] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-08T18:02:45.748824] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-08T18:02:45.748923] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-08T18:02:45.749865] [DEBUG] [LOCAL ] CINT: Trimmed 27357 records to 19416 (keeping 200 days of data) [2025-10-08T18:02:45.873845] [DEBUG] [LOCAL ] CINT: Primary data saved (19416 records). [2025-10-08T18:02:45.874013] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-08T18:02:45.874113] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 36.8s. Estimated remaining: 4h 23m 19s. Rate: 7.3 symbols/min [2025-10-08T18:02:46.059225] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:02:46.111550] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-08T18:02:46.111933] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-08T18:02:46.307671] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:02:46.307968] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-08T18:02:46.308031] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-08T18:02:46.309027] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-08T18:02:46.309089] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-08T18:02:46.428920] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-08T18:02:46.615216] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:02:46.702707] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:02:46.759757] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:02:47.217546] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-08T18:02:47.562423] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:02:48.017564] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-08T18:02:48.714396] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T18:02:48.817633] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-08T18:02:49.500045] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:02:49.617511] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-08T18:02:50.417569] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-08T18:02:50.609024] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T18:02:50.827230] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T18:02:51.217558] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-08T18:02:52.017507] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-08T18:02:52.129773] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T18:02:52.342534] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T18:02:52.817636] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-08T18:02:53.617565] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-08T18:02:53.811977] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:02:53.947877] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:02:54.417572] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-08T18:02:54.511856] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:02:55.217623] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-08T18:02:56.022698] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-08T18:02:56.044449] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T18:02:56.817599] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-08T18:02:56.976820] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T18:02:57.504341] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:02:57.617601] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-08T18:02:58.417559] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-08T18:02:58.762080] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T18:02:59.217520] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-08T18:02:59.361725] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T18:02:59.510897] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:02:59.881919] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T18:03:00.017571] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-08T18:03:00.817622] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-08T18:03:01.617606] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-08T18:03:02.146528] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T18:03:02.434598] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-08T18:03:02.443686] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:03:02.768086] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:03:03.217621] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-08T18:03:03.565664] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:03:03.567964] [INFO ] [REMOTE ] CIO: Full fetch complete (29171 records). [2025-10-08T18:03:03.568060] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-08T18:03:03.940536] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-08T18:03:03.940620] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-08T18:03:03.941088] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-08T18:03:03.941142] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-08T18:03:03.941974] [DEBUG] [LOCAL ] CIO: Trimmed 29171 records to 20422 (keeping 200 days of data) [2025-10-08T18:03:04.023036] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-08T18:03:04.062037] [DEBUG] [LOCAL ] CIO: Primary data saved (20422 records). [2025-10-08T18:03:04.062173] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-08T18:03:04.062256] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIO took 39.1s. Estimated remaining: 4h 23m 52s. Rate: 7.3 symbols/min [2025-10-08T18:03:04.237441] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:04.280102] [DEBUG] [LOCAL ] CLB: Loaded 33057 existing records from primary storage. [2025-10-08T18:03:04.280466] [INFO ] [MAIN ] CLB: Loaded 33057 existing records. [2025-10-08T18:03:04.459352] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:04.459671] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-08T18:03:04.459745] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-08T18:03:04.460056] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-08T18:03:04.460113] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-08T18:03:04.841883] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:04.842101] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-08T18:03:05.130791] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:03:05.133043] [INFO ] [REMOTE ] CION: Full fetch complete (40429 records). [2025-10-08T18:03:05.133149] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-08T18:03:05.133805] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:03:05.133897] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:03:05.133940] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:03:05.133978] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-08T18:03:05.134034] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-08T18:03:05.134069] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-08T18:03:05.134304] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-10-08T18:03:05.134410] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 37.0s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-08T18:03:05.312021] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:05.357730] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T18:03:05.375209] [DEBUG] [LOCAL ] CLCO: Loaded 12716 existing records from primary storage. [2025-10-08T18:03:05.375805] [INFO ] [MAIN ] CLCO: Loaded 12716 existing records. [2025-10-08T18:03:05.589465] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:05.589732] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-08T18:03:05.589789] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-08T18:03:05.590070] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-08T18:03:05.590153] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-08T18:03:05.628968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-08T18:03:06.027798] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:06.184304] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T18:03:06.189611] [INFO ] [REMOTE ] CIVI: Full fetch complete (75734 records). [2025-10-08T18:03:06.189841] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-08T18:03:06.422792] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-08T18:03:06.592632] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-08T18:03:06.592803] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-08T18:03:06.593878] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-08T18:03:06.593943] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-08T18:03:06.595820] [DEBUG] [LOCAL ] CIVI: Trimmed 75734 records to 52615 (keeping 200 days of data) [2025-10-08T18:03:06.930183] [DEBUG] [LOCAL ] CIVI: Primary data saved (52615 records). [2025-10-08T18:03:06.930345] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-08T18:03:06.931054] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CIVI took 37.5s. Estimated remaining: 4h 22m 39s. Rate: 7.3 symbols/min [2025-10-08T18:03:07.099398] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:07.099611] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-10-08T18:03:07.099685] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-10-08T18:03:07.099798] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-08T18:03:07.099885] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-08T18:03:07.099948] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-08T18:03:07.099982] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-08T18:03:07.222685] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-08T18:03:07.477335] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:07.542297] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:03:07.731852] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:03:08.017548] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-08T18:03:08.301675] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T18:03:08.817548] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-08T18:03:09.320020] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T18:03:09.617551] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-08T18:03:10.417548] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-08T18:03:11.013236] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:03:11.085298] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T18:03:11.217565] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-08T18:03:11.689274] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T18:03:12.017549] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-08T18:03:12.413271] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:03:12.817544] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-08T18:03:13.130701] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:03:13.617546] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-08T18:03:13.863258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T18:03:14.417555] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-08T18:03:14.923148] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T18:03:15.217631] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-08T18:03:16.017557] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-08T18:03:16.260844] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:03:16.629605] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:03:16.817558] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-08T18:03:17.531771] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:03:17.617584] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-08T18:03:17.944138] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:03:18.417805] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-08T18:03:19.084821] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:03:19.217535] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-08T18:03:19.720721] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:03:20.017615] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-08T18:03:20.538890] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:03:20.817589] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-08T18:03:21.183498] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:03:21.617596] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-08T18:03:22.085056] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:03:22.417734] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-08T18:03:22.506258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T18:03:23.217587] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-08T18:03:23.671271] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:03:24.017731] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-08T18:03:24.817541] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-08T18:03:25.029444] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:03:25.377274] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T18:03:25.617538] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-08T18:03:25.999906] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:03:26.417621] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-08T18:03:27.217801] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-08T18:03:27.352849] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:03:27.358195] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-08T18:03:27.358336] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-08T18:03:27.857055] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-08T18:03:27.857398] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-08T18:03:27.859159] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:03:27.860239] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-08T18:03:27.867605] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-08T18:03:27.869999] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 53648 (keeping 200 days of data) [2025-10-08T18:03:28.057106] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-08T18:03:28.067374] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T18:03:28.218436] [DEBUG] [LOCAL ] CL: Primary data saved (53648 records). [2025-10-08T18:03:28.218606] [INFO ] [MAIN ] CL: Full history saved. [2025-10-08T18:03:28.218742] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CL took 42.3s. Estimated remaining: 4h 23m 25s. Rate: 7.3 symbols/min [2025-10-08T18:03:28.397090] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:28.449161] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-08T18:03:28.449553] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-08T18:03:28.628259] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:28.628507] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-08T18:03:28.628600] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-08T18:03:28.629035] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-08T18:03:28.629108] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-08T18:03:28.822710] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-08T18:03:28.997903] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:29.287083] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:03:29.617579] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-08T18:03:30.403021] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:03:30.407818] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T18:03:30.409252] [INFO ] [REMOTE ] CLB: Full fetch complete (46526 records). [2025-10-08T18:03:30.411595] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-08T18:03:30.423212] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-08T18:03:30.823133] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-08T18:03:30.823230] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-08T18:03:30.823821] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-08T18:03:30.823885] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-08T18:03:30.825058] [DEBUG] [LOCAL ] CLB: Trimmed 46526 records to 33007 (keeping 200 days of data) [2025-10-08T18:03:31.040716] [DEBUG] [LOCAL ] CLB: Primary data saved (33007 records). [2025-10-08T18:03:31.040896] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-08T18:03:31.041014] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CLB took 27.0s. Estimated remaining: 4h 22m 54s. Rate: 7.3 symbols/min [2025-10-08T18:03:31.219240] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-08T18:03:31.219144] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:31.246158] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:03:31.260785] [DEBUG] [LOCAL ] CLH: Loaded 27665 existing records from primary storage. [2025-10-08T18:03:31.261096] [INFO ] [MAIN ] CLH: Loaded 27665 existing records. [2025-10-08T18:03:31.441583] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:03:31.441825] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-08T18:03:31.441875] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-08T18:03:31.442160] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-08T18:03:31.442218] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-08T18:03:31.796588] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:32.017608] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-08T18:03:32.191471] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T18:03:32.817573] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-08T18:03:33.280978] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T18:03:33.617617] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-08T18:03:34.417519] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-08T18:03:34.566871] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:03:34.816006] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T18:03:35.217609] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-08T18:03:35.405300] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T18:03:36.017622] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-08T18:03:36.817536] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-08T18:03:37.141722] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T18:03:37.419446] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:03:37.546175] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:03:37.548227] [INFO ] [REMOTE ] CLCO: Full fetch complete (22578 records). [2025-10-08T18:03:37.548297] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-08T18:03:37.622719] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-08T18:03:37.960381] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-08T18:03:37.960477] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-08T18:03:37.961310] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-08T18:03:37.961376] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-08T18:03:37.962402] [DEBUG] [LOCAL ] CLCO: Trimmed 22578 records to 12762 (keeping 200 days of data) [2025-10-08T18:03:38.046131] [DEBUG] [LOCAL ] CLCO: Primary data saved (12762 records). [2025-10-08T18:03:38.046289] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-08T18:03:38.046405] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 32.9s. Estimated remaining: 4h 22m 40s. Rate: 7.3 symbols/min [2025-10-08T18:03:38.263747] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:38.263939] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-08T18:03:38.263979] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-08T18:03:38.264091] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-08T18:03:38.264132] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-08T18:03:38.264175] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-08T18:03:38.264209] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-08T18:03:38.422762] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-08T18:03:38.651204] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:38.812854] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T18:03:39.217592] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-08T18:03:39.458206] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T18:03:40.017538] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-08T18:03:40.234874] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T18:03:40.817552] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-08T18:03:41.617582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-08T18:03:41.917283] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:03:42.111202] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T18:03:42.157973] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:03:42.417624] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-08T18:03:43.217576] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-08T18:03:44.017535] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-08T18:03:44.153373] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:03:44.415085] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:03:44.417434] [INFO ] [REMOTE ] CLDT: Full fetch complete (37225 records). [2025-10-08T18:03:44.417518] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-08T18:03:44.824695] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-08T18:03:44.837298] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T18:03:44.836821] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-08T18:03:44.840921] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-08T18:03:44.841488] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-08T18:03:44.841534] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-08T18:03:44.842368] [DEBUG] [LOCAL ] CLDT: Trimmed 37225 records to 25381 (keeping 200 days of data) [2025-10-08T18:03:45.000082] [DEBUG] [LOCAL ] CLDT: Primary data saved (25381 records). [2025-10-08T18:03:45.000300] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-08T18:03:45.000437] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 38.1s. Estimated remaining: 4h 22m 27s. Rate: 7.3 symbols/min [2025-10-08T18:03:45.277006] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:45.277349] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-08T18:03:45.277413] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-08T18:03:45.277534] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-08T18:03:45.277596] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-08T18:03:45.277706] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-08T18:03:45.277778] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-08T18:03:45.622817] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-08T18:03:45.847560] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:03:46.417529] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-08T18:03:46.754526] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T18:03:46.888809] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:03:47.217582] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-08T18:03:48.017508] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-08T18:03:48.081767] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:03:48.154811] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T18:03:48.817590] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-08T18:03:48.933915] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T18:03:49.617609] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-08T18:03:50.417570] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-08T18:03:50.595785] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T18:03:50.938796] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T18:03:51.217573] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-08T18:03:51.623489] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T18:03:52.017567] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-08T18:03:52.817611] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-08T18:03:53.617585] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-08T18:03:53.821801] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-08T18:03:53.852788] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T18:03:53.933927] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T18:03:54.372925] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:03:54.417531] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-08T18:03:55.069005] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T18:03:55.217616] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-08T18:03:56.017548] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-08T18:03:56.120330] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T18:03:56.817562] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-08T18:03:57.220003] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:03:57.338359] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T18:03:57.617568] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-08T18:03:58.417546] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-08T18:03:58.684824] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T18:03:58.687319] [INFO ] [REMOTE ] CLH: Full fetch complete (41784 records). [2025-10-08T18:03:58.687403] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-08T18:03:59.171379] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-08T18:03:59.171491] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-08T18:03:59.172197] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-08T18:03:59.172274] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-08T18:03:59.173572] [DEBUG] [LOCAL ] CLH: Trimmed 41784 records to 27621 (keeping 200 days of data) [2025-10-08T18:03:59.234355] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-08T18:03:59.357593] [DEBUG] [LOCAL ] CLH: Primary data saved (27621 records). [2025-10-08T18:03:59.357796] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-08T18:03:59.357923] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLH took 28.3s. Estimated remaining: 4h 22m 44s. Rate: 7.3 symbols/min [2025-10-08T18:03:59.531805] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:03:59.532012] [DEBUG] [LOCAL ] CLVT: No existing data file found in primary storage. [2025-10-08T18:03:59.532049] [WARN ] [MAIN ] CLVT: No existing data found, performing full refresh instead. [2025-10-08T18:03:59.532212] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-08T18:03:59.532259] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-08T18:03:59.532299] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-08T18:03:59.532330] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-08T18:03:59.885195] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:00.017586] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-08T18:04:00.563366] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-08T18:04:00.817556] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-08T18:04:01.550313] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-08T18:04:01.617529] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-08T18:04:02.002129] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T18:04:02.417571] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-08T18:04:03.168769] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T18:04:03.217499] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-08T18:04:03.566843] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:04:04.017574] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-08T18:04:04.240030] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-08T18:04:04.622327] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T18:04:04.623847] [INFO ] [REMOTE ] CLPR: Full fetch complete (16787 records). [2025-10-08T18:04:04.623944] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-08T18:04:04.823916] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-08T18:04:05.011901] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-08T18:04:05.012432] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-08T18:04:05.012944] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-08T18:04:05.013009] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-08T18:04:05.013824] [DEBUG] [LOCAL ] CLPR: Trimmed 16787 records to 10563 (keeping 200 days of data) [2025-10-08T18:04:05.079841] [DEBUG] [LOCAL ] CLPR: Primary data saved (10563 records). [2025-10-08T18:04:05.079995] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-08T18:04:05.080073] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLPR took 27.0s. Estimated remaining: 4h 22m 25s. Rate: 7.3 symbols/min [2025-10-08T18:04:05.284132] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:05.287415] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-08T18:04:05.319116] [DEBUG] [LOCAL ] CLW: Loaded 21707 existing records from primary storage. [2025-10-08T18:04:05.319372] [INFO ] [MAIN ] CLW: Loaded 21707 existing records. [2025-10-08T18:04:05.493693] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:05.493933] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-08T18:04:05.493979] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-08T18:04:05.494405] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-08T18:04:05.494465] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-08T18:04:05.633328] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-08T18:04:05.855807] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:06.417612] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-08T18:04:07.192829] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T18:04:07.217505] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-08T18:04:07.339127] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T18:04:07.516220] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T18:04:08.017600] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-08T18:04:08.817602] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-08T18:04:09.489917] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-08T18:04:09.617552] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-08T18:04:10.069011] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T18:04:10.304523] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T18:04:10.417580] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-08T18:04:11.217601] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-08T18:04:11.530972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:04:11.639390] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:04:12.017578] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-08T18:04:12.817547] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-08T18:04:12.956871] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:04:13.617611] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-08T18:04:14.350027] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T18:04:14.417537] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-08T18:04:14.790790] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T18:04:14.794368] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-10-08T18:04:14.794498] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-08T18:04:14.795420] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:04:14.795534] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:04:14.795609] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:04:14.795729] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-08T18:04:14.795805] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-08T18:04:14.795841] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-10-08T18:04:14.796057] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-10-08T18:04:14.796158] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLF took 46.6s. Estimated remaining: 4h 22m 23s. Rate: 7.3 symbols/min [2025-10-08T18:04:14.969941] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:15.023477] [DEBUG] [LOCAL ] CLX: Loaded 51546 existing records from primary storage. [2025-10-08T18:04:15.023844] [INFO ] [MAIN ] CLX: Loaded 51546 existing records. [2025-10-08T18:04:15.219676] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-08T18:04:15.224419] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:15.225671] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-08T18:04:15.225807] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-08T18:04:15.226445] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-08T18:04:15.226741] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-08T18:04:15.363148] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T18:04:15.700365] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:15.701609] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T18:04:16.017574] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-08T18:04:16.817537] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-08T18:04:17.617720] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-08T18:04:17.773925] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:04:17.836625] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-08T18:04:18.417634] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-08T18:04:18.614614] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T18:04:18.660918] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:04:19.217603] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-08T18:04:19.944298] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T18:04:20.017594] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-08T18:04:20.817615] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-08T18:04:21.617577] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-08T18:04:21.736441] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:04:22.007869] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T18:04:22.078468] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-08T18:04:22.417558] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-08T18:04:23.217595] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-08T18:04:23.339770] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:04:23.823498] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:04:23.849029] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T18:04:24.017554] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-08T18:04:24.817723] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-08T18:04:25.617525] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-08T18:04:25.715199] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T18:04:26.417616] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-08T18:04:26.897709] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T18:04:27.202523] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-08T18:04:27.207363] [INFO ] [REMOTE ] CLS: Full fetch complete (77087 records). [2025-10-08T18:04:27.207601] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-08T18:04:27.209629] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:04:27.209891] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:04:27.209962] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:04:27.210042] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-08T18:04:27.210115] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-08T18:04:27.210154] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-08T18:04:27.210194] [DEBUG] [LOCAL ] CLS: No derivative data file found to delete. [2025-10-08T18:04:27.210268] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 42.2s. Estimated remaining: 4h 22m 31s. Rate: 7.3 symbols/min [2025-10-08T18:04:27.223400] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-08T18:04:27.383852] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:27.384061] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-10-08T18:04:27.384117] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-10-08T18:04:27.384235] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-08T18:04:27.384277] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-08T18:04:27.384319] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-10-08T18:04:27.384352] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-08T18:04:27.777450] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:27.809527] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T18:04:28.017564] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-08T18:04:28.375249] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:04:28.817632] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-08T18:04:29.622786] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-08T18:04:29.638479] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:04:29.980421] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:04:30.417580] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-08T18:04:31.217631] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-08T18:04:31.395018] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:04:32.017603] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-08T18:04:32.235754] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:04:32.267356] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:04:32.269665] [INFO ] [REMOTE ] CLW: Full fetch complete (34532 records). [2025-10-08T18:04:32.269816] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-08T18:04:32.721306] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-08T18:04:32.721411] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-08T18:04:32.721980] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-08T18:04:32.722045] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-08T18:04:32.723057] [DEBUG] [LOCAL ] CLW: Trimmed 34532 records to 21669 (keeping 200 days of data) [2025-10-08T18:04:32.822369] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-08T18:04:32.874182] [DEBUG] [LOCAL ] CLW: Primary data saved (21669 records). [2025-10-08T18:04:32.874358] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-08T18:04:32.874460] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 27.8s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-10-08T18:04:33.052385] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:33.101813] [DEBUG] [LOCAL ] CMA: Loaded 49900 existing records from primary storage. [2025-10-08T18:04:33.102184] [INFO ] [MAIN ] CMA: Loaded 49900 existing records. [2025-10-08T18:04:33.281442] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:33.281708] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-08T18:04:33.281766] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-08T18:04:33.282065] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-08T18:04:33.282124] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-08T18:04:33.620630] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-08T18:04:33.700629] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:33.824986] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:04:34.417525] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-08T18:04:34.575396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:04:35.217573] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-08T18:04:35.433902] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T18:04:36.017572] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-08T18:04:36.151907] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:04:36.817534] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-08T18:04:36.939771] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:04:37.338346] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T18:04:37.342312] [INFO ] [REMOTE ] CLVT: Full fetch complete (75223 records). [2025-10-08T18:04:37.342453] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-08T18:04:37.622784] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-08T18:04:37.737220] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-08T18:04:37.737315] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-08T18:04:37.738168] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-08T18:04:37.738243] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-08T18:04:37.739965] [DEBUG] [LOCAL ] CLVT: Trimmed 75223 records to 51982 (keeping 200 days of data) [2025-10-08T18:04:38.054501] [DEBUG] [LOCAL ] CLVT: Primary data saved (51982 records). [2025-10-08T18:04:38.054702] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-08T18:04:38.054812] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLVT took 38.7s. Estimated remaining: 4h 21m 52s. Rate: 7.3 symbols/min [2025-10-08T18:04:38.313504] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:38.346090] [DEBUG] [LOCAL ] CMBT: Loaded 24479 existing records from primary storage. [2025-10-08T18:04:38.346483] [INFO ] [MAIN ] CMBT: Loaded 24479 existing records. [2025-10-08T18:04:38.421538] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-08T18:04:38.638012] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:04:38.732306] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:38.732626] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-08T18:04:38.732733] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-08T18:04:38.733145] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-08T18:04:38.733221] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-08T18:04:39.233340] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-08T18:04:39.248181] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:39.292973] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:04:40.017524] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-08T18:04:40.206293] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:04:40.682839] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T18:04:40.817560] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-08T18:04:41.388357] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:04:41.617588] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-08T18:04:42.417525] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-08T18:04:42.685105] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:04:42.690830] [INFO ] [REMOTE ] CLX: Full fetch complete (73227 records). [2025-10-08T18:04:42.691056] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-08T18:04:43.118634] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-08T18:04:43.118793] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-08T18:04:43.119962] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-08T18:04:43.120033] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-08T18:04:43.121700] [DEBUG] [LOCAL ] CLX: Trimmed 73227 records to 51594 (keeping 200 days of data) [2025-10-08T18:04:43.218224] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-08T18:04:43.415554] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:04:43.543749] [DEBUG] [LOCAL ] CLX: Primary data saved (51594 records). [2025-10-08T18:04:43.543912] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-08T18:04:43.543999] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 28.7s. Estimated remaining: 4h 21m 32s. Rate: 7.3 symbols/min [2025-10-08T18:04:43.711784] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:04:43.757851] [DEBUG] [LOCAL ] CMC: Loaded 45441 existing records from primary storage. [2025-10-08T18:04:43.758221] [INFO ] [MAIN ] CMC: Loaded 45441 existing records. [2025-10-08T18:04:43.947694] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:04:43.948129] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-08T18:04:43.948198] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-08T18:04:43.948482] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-08T18:04:43.948559] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-08T18:04:44.022444] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-08T18:04:44.313067] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:04:44.348269] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T18:04:44.541056] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:04:44.817603] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-08T18:04:45.617698] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-08T18:04:45.863046] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:04:45.859187] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:04:46.417574] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-08T18:04:47.190325] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:04:47.217582] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-08T18:04:47.662427] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T18:04:48.017610] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-08T18:04:48.436181] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T18:04:48.817617] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-08T18:04:49.617580] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-08T18:04:49.697332] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:04:49.736061] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:04:50.417598] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-08T18:04:51.217535] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-08T18:04:51.278607] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:04:51.563339] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:04:52.017543] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-08T18:04:52.227625] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T18:04:52.817608] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-08T18:04:53.500469] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:04:53.617633] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-08T18:04:54.417570] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-08T18:04:54.591591] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:04:54.790563] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:04:55.217569] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-08T18:04:55.814769] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:04:56.017547] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-08T18:04:56.817538] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-08T18:04:57.109570] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:04:57.154284] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:04:57.617571] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-08T18:04:58.417572] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-08T18:04:58.609801] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:04:58.650681] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:04:59.217633] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-08T18:04:59.956674] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:05:00.017529] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-08T18:05:00.817519] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-08T18:05:01.015530] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T18:05:01.617531] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-08T18:05:01.687716] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:05:02.417558] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-08T18:05:03.208879] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T18:05:03.223139] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-08T18:05:03.239671] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T18:05:03.243791] [INFO ] [REMOTE ] CM: Full fetch complete (69563 records). [2025-10-08T18:05:03.243960] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-08T18:05:03.654554] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:05:03.695002] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-08T18:05:03.695083] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-08T18:05:03.695851] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-08T18:05:03.695915] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-08T18:05:03.697893] [DEBUG] [LOCAL ] CM: Trimmed 69563 records to 48747 (keeping 200 days of data) [2025-10-08T18:05:03.993343] [DEBUG] [LOCAL ] CM: Primary data saved (48747 records). [2025-10-08T18:05:03.993476] [INFO ] [MAIN ] CM: Full history saved. [2025-10-08T18:05:03.993551] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 36.8s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-08T18:05:04.022719] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-08T18:05:04.162299] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:04.168121] [DEBUG] [LOCAL ] CMCM: Loaded 4731 existing records from primary storage. [2025-10-08T18:05:04.168295] [INFO ] [MAIN ] CMCM: Loaded 4731 existing records. [2025-10-08T18:05:04.342618] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:04.342880] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-08T18:05:04.342940] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-08T18:05:04.343258] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-08T18:05:04.343316] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-08T18:05:04.698128] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:04.817521] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-08T18:05:04.958231] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:05:05.617543] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-08T18:05:05.683793] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:05:06.381119] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:05:06.417511] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-08T18:05:06.495046] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:05:07.217606] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-08T18:05:07.872752] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T18:05:08.017495] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-08T18:05:08.058788] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:05:08.817713] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-08T18:05:09.486942] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:05:09.617521] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-08T18:05:09.972922] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T18:05:10.417562] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-08T18:05:10.981579] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T18:05:11.001674] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T18:05:11.217566] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-08T18:05:11.704622] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:05:12.017556] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-08T18:05:12.466322] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:05:12.817614] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-08T18:05:13.389132] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T18:05:13.617598] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-08T18:05:14.417622] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-08T18:05:15.044388] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T18:05:15.204462] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:05:15.208119] [INFO ] [REMOTE ] CMBT: Full fetch complete (31356 records). [2025-10-08T18:05:15.208202] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-08T18:05:15.222767] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-08T18:05:15.584088] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-08T18:05:15.584175] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-08T18:05:15.584704] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-08T18:05:15.584774] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-08T18:05:15.586038] [DEBUG] [LOCAL ] CMBT: Trimmed 31356 records to 24761 (keeping 200 days of data) [2025-10-08T18:05:15.733458] [DEBUG] [LOCAL ] CMBT: Primary data saved (24761 records). [2025-10-08T18:05:15.733593] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-08T18:05:15.733816] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMBT took 37.7s. Estimated remaining: 4h 22m 19s. Rate: 7.2 symbols/min [2025-10-08T18:05:15.901600] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:15.901823] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-08T18:05:15.901865] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-08T18:05:15.901983] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-08T18:05:15.902024] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-08T18:05:15.902065] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-08T18:05:15.902096] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-08T18:05:16.022726] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-08T18:05:16.258026] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:16.817567] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-08T18:05:17.036631] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:05:17.066704] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T18:05:17.617626] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-08T18:05:18.364414] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T18:05:18.417499] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-08T18:05:19.087918] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:05:19.091752] [INFO ] [REMOTE ] CMA: Full fetch complete (73112 records). [2025-10-08T18:05:19.091883] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-08T18:05:19.229742] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-08T18:05:19.525304] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-08T18:05:19.525447] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-08T18:05:19.526289] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-08T18:05:19.526351] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-08T18:05:19.527767] [DEBUG] [LOCAL ] CMA: Trimmed 73112 records to 49919 (keeping 200 days of data) [2025-10-08T18:05:19.842885] [DEBUG] [LOCAL ] CMA: Primary data saved (49919 records). [2025-10-08T18:05:19.843023] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-08T18:05:19.843110] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMA took 47.0s. Estimated remaining: 4h 21m 54s. Rate: 7.2 symbols/min [2025-10-08T18:05:19.983163] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:05:20.021050] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-08T18:05:20.040902] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:20.071681] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:05:20.126951] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-08T18:05:20.127296] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-08T18:05:20.252251] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:05:20.288004] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-08T18:05:20.307962] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:05:20.312198] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:20.312290] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-08T18:05:20.312622] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-08T18:05:20.312736] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-08T18:05:20.312562] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:05:20.312899] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-08T18:05:20.312988] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-08T18:05:20.313067] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-08T18:05:20.313164] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-08T18:05:20.313028] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-08T18:05:20.380732] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-08T18:05:20.391764] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMDB took 4.7s. Estimated remaining: 4h 21m 15s. Rate: 7.3 symbols/min [2025-10-08T18:05:20.806457] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:20.840178] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-08T18:05:20.872099] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:20.913977] [DEBUG] [LOCAL ] CMI: Loaded 41708 existing records from primary storage. [2025-10-08T18:05:20.914381] [INFO ] [MAIN ] CMI: Loaded 41708 existing records. [2025-10-08T18:05:21.133043] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:21.133290] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-08T18:05:21.133337] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-08T18:05:21.133716] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-08T18:05:21.133777] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-08T18:05:21.480598] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:21.617516] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-08T18:05:22.417513] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-08T18:05:22.504233] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T18:05:22.507827] [INFO ] [REMOTE ] CMC: Full fetch complete (66885 records). [2025-10-08T18:05:22.507951] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-08T18:05:22.907036] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-08T18:05:22.907185] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-08T18:05:22.908194] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-08T18:05:22.908324] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-08T18:05:22.909771] [DEBUG] [LOCAL ] CMC: Trimmed 66885 records to 45379 (keeping 200 days of data) [2025-10-08T18:05:23.031260] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:05:23.125965] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T18:05:23.152838] [INFO ] [REMOTE ] CMCM: Full fetch complete (6857 records). [2025-10-08T18:05:23.153199] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-08T18:05:23.222624] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-08T18:05:23.563871] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-08T18:05:23.564342] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-08T18:05:23.564558] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-08T18:05:23.565354] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-08T18:05:23.569020] [DEBUG] [LOCAL ] CMCM: Trimmed 6857 records to 4735 (keeping 200 days of data) [2025-10-08T18:05:23.601533] [DEBUG] [LOCAL ] CMCM: Primary data saved (4735 records). [2025-10-08T18:05:23.602421] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-08T18:05:23.602917] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMCM took 19.6s. Estimated remaining: 4h 20m 46s. Rate: 7.3 symbols/min [2025-10-08T18:05:23.814674] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:23.823835] [DEBUG] [LOCAL ] CMC: Primary data saved (45379 records). [2025-10-08T18:05:23.823984] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-08T18:05:23.824076] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMC took 40.3s. Estimated remaining: 4h 20m 6s. Rate: 7.3 symbols/min [2025-10-08T18:05:24.034862] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:24.036092] [DEBUG] [LOCAL ] CMP: Loaded 36085 existing records from primary storage. [2025-10-08T18:05:24.032766] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-08T18:05:24.038342] [INFO ] [MAIN ] CMP: Loaded 36085 existing records. [2025-10-08T18:05:24.262965] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:24.277200] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-08T18:05:24.277303] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-08T18:05:24.278191] [DEBUG] [LOCAL ] CMPO: Loaded 39033 existing records from primary storage. [2025-10-08T18:05:24.278699] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-08T18:05:24.278800] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-08T18:05:24.278639] [INFO ] [MAIN ] CMPO: Loaded 39033 existing records. [2025-10-08T18:05:24.726202] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:05:24.742050] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-08T18:05:24.748739] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-08T18:05:24.774798] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-08T18:05:24.775087] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-08T18:05:25.003023] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:25.019246] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-08T18:05:25.220593] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-08T18:05:25.304085] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:05:25.617583] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-08T18:05:26.279391] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T18:05:26.417621] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-08T18:05:26.555979] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:05:26.964059] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:05:27.217603] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-08T18:05:28.017598] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-08T18:05:28.307270] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:05:28.817514] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-08T18:05:29.002935] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:05:29.264794] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:05:29.617551] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-08T18:05:30.417573] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-08T18:05:30.878585] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:05:30.978639] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T18:05:31.217690] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-08T18:05:32.017620] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-08T18:05:32.153269] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:05:32.603706] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:05:32.817555] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-08T18:05:33.617621] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-08T18:05:34.180581] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:05:34.279583] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-08T18:05:34.417589] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-08T18:05:34.976939] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:05:35.217619] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-08T18:05:36.017589] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-08T18:05:36.543786] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:05:36.709902] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-08T18:05:36.817595] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-08T18:05:37.405193] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:05:37.617586] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-08T18:05:38.256776] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:05:38.417594] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-08T18:05:39.217587] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-08T18:05:39.242177] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T18:05:39.744500] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:05:40.017562] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-08T18:05:40.565994] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T18:05:40.817600] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-08T18:05:41.617591] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-08T18:05:42.417724] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-08T18:05:42.812721] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-08T18:05:43.059045] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T18:05:43.155405] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:05:43.217548] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-08T18:05:43.881298] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:05:44.017578] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-08T18:05:44.633874] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:05:44.817546] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-08T18:05:45.617591] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-08T18:05:46.077956] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T18:05:46.297157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:05:46.417598] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-08T18:05:47.071752] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T18:05:47.217524] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-08T18:05:48.018068] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-08T18:05:48.017987] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:05:48.817603] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-08T18:05:49.280903] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:05:49.555549] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T18:05:49.617565] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-08T18:05:50.002000] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:05:50.417564] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-08T18:05:50.920127] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:05:50.924125] [INFO ] [REMOTE ] CMI: Full fetch complete (60182 records). [2025-10-08T18:05:50.924308] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-08T18:05:51.222741] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-08T18:05:51.368361] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-08T18:05:51.368453] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-08T18:05:51.369196] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-08T18:05:51.369261] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-08T18:05:51.370439] [DEBUG] [LOCAL ] CMI: Trimmed 60182 records to 41656 (keeping 200 days of data) [2025-10-08T18:05:51.638248] [DEBUG] [LOCAL ] CMI: Primary data saved (41656 records). [2025-10-08T18:05:51.638388] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-08T18:05:51.638485] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 31.2s. Estimated remaining: 4h 21m 15s. Rate: 7.2 symbols/min [2025-10-08T18:05:51.725126] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:05:52.017568] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-08T18:05:52.817598] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-08T18:05:53.585432] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T18:05:53.617505] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-08T18:05:53.651484] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:05:54.215974] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:05:54.417547] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-08T18:05:55.217611] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-08T18:05:55.778094] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:05:55.781016] [INFO ] [REMOTE ] CMPO: Full fetch complete (58678 records). [2025-10-08T18:05:55.781119] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-08T18:05:56.191049] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-08T18:05:56.191172] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-08T18:05:56.192037] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-08T18:05:56.208138] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-08T18:05:56.243288] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-08T18:05:56.255504] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:05:56.263142] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-08T18:05:56.263709] [DEBUG] [LOCAL ] CMPO: Trimmed 58678 records to 38977 (keeping 200 days of data) [2025-10-08T18:05:56.499030] [DEBUG] [LOCAL ] CMPO: Primary data saved (38977 records). [2025-10-08T18:05:56.499174] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-08T18:05:56.499254] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMPO took 32.7s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-10-08T18:05:56.817510] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-08T18:05:57.916187] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:05:57.918676] [INFO ] [REMOTE ] CMP: Full fetch complete (52018 records). [2025-10-08T18:05:57.918762] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-08T18:05:58.311836] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-08T18:05:58.311950] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-08T18:05:58.312567] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-08T18:05:58.312607] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-08T18:05:58.313678] [DEBUG] [LOCAL ] CMP: Trimmed 52018 records to 36066 (keeping 200 days of data) [2025-10-08T18:05:58.522050] [DEBUG] [LOCAL ] CMP: Primary data saved (36066 records). [2025-10-08T18:05:58.522213] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-08T18:05:58.523274] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 34.9s. Estimated remaining: 4h 20m 21s. Rate: 7.3 symbols/min [2025-10-08T18:05:58.637936] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T18:05:58.641885] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-08T18:05:58.642000] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-08T18:05:59.026370] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-08T18:05:59.026443] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-08T18:05:59.027274] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-08T18:05:59.027337] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-08T18:05:59.028777] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 53721 (keeping 200 days of data) [2025-10-08T18:05:59.340292] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-08T18:05:59.340424] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-08T18:05:59.340505] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMG took 39.5s. Estimated remaining: 4h 19m 43s. Rate: 7.3 symbols/min [2025-10-08T18:05:59.971935] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:05:59.923039] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.025511] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.051518] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:00.057340] [DEBUG] [LOCAL ] CMSA: Loaded 3514 existing records from primary storage. [2025-10-08T18:06:00.059300] [INFO ] [MAIN ] CMSA: Loaded 3514 existing records. [2025-10-08T18:06:00.108326] [DEBUG] [LOCAL ] CMSC: Loaded 5021 existing records from primary storage. [2025-10-08T18:06:00.151584] [INFO ] [MAIN ] CMSC: Loaded 5021 existing records. [2025-10-08T18:06:00.324866] [DEBUG] [LOCAL ] CMRE: Loaded 35498 existing records from primary storage. [2025-10-08T18:06:00.372772] [INFO ] [MAIN ] CMRE: Loaded 35498 existing records. [2025-10-08T18:06:00.372525] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.430796] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.430913] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-08T18:06:00.518515] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-08T18:06:00.544836] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-08T18:06:00.618813] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.615426] [DEBUG] [LOCAL ] CMS: Loaded 52626 existing records from primary storage. [2025-10-08T18:06:00.674335] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.653679] [INFO ] [MAIN ] CMS: Loaded 52626 existing records. [2025-10-08T18:06:00.727916] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-08T18:06:00.813871] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-08T18:06:00.865836] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:00.892403] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-08T18:06:00.871361] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-08T18:06:00.902794] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-08T18:06:01.016910] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-08T18:06:01.084110] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-08T18:06:01.439106] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:01.462692] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-08T18:06:01.473136] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-08T18:06:01.502763] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-08T18:06:01.523785] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-08T18:06:01.741954] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:01.869174] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-08T18:06:02.147803] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.202764] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-08T18:06:02.316446] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.329100] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-08T18:06:02.440883] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:02.441208] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-08T18:06:02.782116] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T18:06:02.784111] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-08T18:06:02.934551] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:06:02.936389] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-08T18:06:03.142156] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T18:06:03.143694] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-08T18:06:03.421040] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T18:06:03.422751] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-08T18:06:03.656770] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:06:03.719323] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:06:03.774322] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T18:06:04.017491] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-08T18:06:04.107219] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T18:06:04.437762] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:06:04.817606] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-08T18:06:05.582639] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T18:06:05.617494] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-08T18:06:06.102701] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:06:06.417565] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-08T18:06:06.870576] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:06:07.217552] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-08T18:06:07.796265] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T18:06:08.017569] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-08T18:06:08.817583] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-08T18:06:09.574854] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:06:09.617617] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-08T18:06:09.956537] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:06:10.417563] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-08T18:06:11.217555] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-08T18:06:11.339033] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:06:11.809005] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:06:11.828806] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T18:06:12.017561] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-08T18:06:12.646452] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T18:06:12.817526] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-08T18:06:13.580292] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T18:06:13.617521] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-08T18:06:14.417556] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-08T18:06:14.879893] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T18:06:15.217589] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-08T18:06:15.570511] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:06:15.811635] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T18:06:15.812616] [INFO ] [REMOTE ] CMSC: Full fetch complete (7147 records). [2025-10-08T18:06:15.812711] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-08T18:06:16.022717] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-08T18:06:16.177082] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-08T18:06:16.177161] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-08T18:06:16.177428] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-08T18:06:16.177485] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-08T18:06:16.177925] [DEBUG] [LOCAL ] CMSC: Trimmed 7147 records to 5006 (keeping 200 days of data) [2025-10-08T18:06:16.208416] [DEBUG] [LOCAL ] CMSC: Primary data saved (5006 records). [2025-10-08T18:06:16.208530] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-08T18:06:16.208681] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSC took 16.9s. Estimated remaining: 4h 20m 9s. Rate: 7.3 symbols/min [2025-10-08T18:06:16.375133] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:16.385177] [DEBUG] [LOCAL ] CMSD: Loaded 8015 existing records from primary storage. [2025-10-08T18:06:16.385368] [INFO ] [MAIN ] CMSD: Loaded 8015 existing records. [2025-10-08T18:06:16.575083] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:16.575303] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-08T18:06:16.575362] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-08T18:06:16.575594] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-08T18:06:16.575682] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-08T18:06:16.836502] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T18:06:16.823972] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-08T18:06:16.937715] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:17.617588] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-08T18:06:18.168125] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T18:06:18.417548] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-08T18:06:18.557832] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T18:06:18.888737] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T18:06:19.217561] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-08T18:06:19.765464] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T18:06:20.017586] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-08T18:06:20.817540] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-08T18:06:20.887903] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T18:06:21.617572] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-08T18:06:22.169302] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T18:06:22.362050] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:06:22.417552] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-08T18:06:23.217623] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-08T18:06:24.017599] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-08T18:06:24.175802] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:06:24.210379] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T18:06:24.574121] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:06:24.574959] [INFO ] [REMOTE ] CMSA: Full fetch complete (5087 records). [2025-10-08T18:06:24.575029] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-08T18:06:24.822833] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-08T18:06:24.943123] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-08T18:06:24.943261] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-08T18:06:24.943450] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-08T18:06:24.943513] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-08T18:06:24.943930] [DEBUG] [LOCAL ] CMSA: Trimmed 5087 records to 3509 (keeping 200 days of data) [2025-10-08T18:06:24.966398] [DEBUG] [LOCAL ] CMSA: Primary data saved (3509 records). [2025-10-08T18:06:24.966528] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-08T18:06:24.966620] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 25.6s. Estimated remaining: 4h 20m 2s. Rate: 7.3 symbols/min [2025-10-08T18:06:25.134445] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:25.172889] [DEBUG] [LOCAL ] CMTG: Loaded 36360 existing records from primary storage. [2025-10-08T18:06:25.173204] [INFO ] [MAIN ] CMTG: Loaded 36360 existing records. [2025-10-08T18:06:25.349595] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:25.349855] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-08T18:06:25.349902] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-08T18:06:25.350431] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-08T18:06:25.350489] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-08T18:06:25.622789] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-08T18:06:25.708452] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:26.417611] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-08T18:06:26.457285] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:06:27.217576] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-08T18:06:27.544374] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T18:06:27.725282] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:06:28.017547] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-08T18:06:28.389362] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:06:28.817581] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-08T18:06:29.327100] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:06:29.617583] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-08T18:06:30.197055] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T18:06:30.417518] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-08T18:06:30.518611] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:06:31.217609] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-08T18:06:31.934980] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T18:06:32.017508] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-08T18:06:32.659560] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:06:32.817564] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-08T18:06:33.127275] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:06:33.617561] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-08T18:06:34.121098] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:06:34.417569] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-08T18:06:34.589113] [DEBUG] [REMOTE ] CMRE: Error fetching primary data for 2025-07: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-08T18:06:34.589298] [WARN ] [REMOTE ] CMRE: No data returned for month 2025-07 [2025-10-08T18:06:34.589388] [FATAL] [REMOTE ] CMRE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:06:34.589472] [FATAL] [MAIN ] CMRE: Failed to fetch primary data. [2025-10-08T18:06:34.589544] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:06:34.589615] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-08T18:06:34.589719] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-08T18:06:34.589772] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-10-08T18:06:34.590074] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-10-08T18:06:34.590169] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMRE took 35.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-08T18:06:34.819539] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:34.819873] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-08T18:06:34.819937] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-08T18:06:34.820062] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-08T18:06:34.820105] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-08T18:06:34.820146] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-08T18:06:34.820177] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-08T18:06:35.199129] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:35.217493] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-08T18:06:35.321637] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T18:06:35.829163] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T18:06:36.017554] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-08T18:06:36.548832] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:06:36.817536] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-08T18:06:37.617572] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-08T18:06:38.417683] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-08T18:06:38.703077] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T18:06:38.707622] [INFO ] [REMOTE ] CMS: Full fetch complete (75987 records). [2025-10-08T18:06:38.707805] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-08T18:06:39.218415] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-08T18:06:39.237439] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:06:39.267044] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-08T18:06:39.267510] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-08T18:06:39.269142] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-08T18:06:39.269290] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-08T18:06:39.301695] [DEBUG] [LOCAL ] CMS: Trimmed 75987 records to 52610 (keeping 200 days of data) [2025-10-08T18:06:39.306334] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:06:39.773454] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:06:39.797073] [DEBUG] [LOCAL ] CMS: Primary data saved (52610 records). [2025-10-08T18:06:39.797261] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-08T18:06:39.797371] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 40.4s. Estimated remaining: 4h 19m 39s. Rate: 7.3 symbols/min [2025-10-08T18:06:40.030966] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-08T18:06:40.035701] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:40.037324] [DEBUG] [LOCAL ] CNA: No existing data file found in primary storage. [2025-10-08T18:06:40.037391] [WARN ] [MAIN ] CNA: No existing data found, performing full refresh instead. [2025-10-08T18:06:40.037536] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-08T18:06:40.037594] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-08T18:06:40.037706] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-08T18:06:40.037775] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-08T18:06:40.405709] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:40.524057] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T18:06:40.817565] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-08T18:06:41.564445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T18:06:41.617567] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-08T18:06:42.417553] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-08T18:06:42.515381] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T18:06:43.217605] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-08T18:06:43.789285] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:06:43.844133] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:06:44.017529] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-08T18:06:44.817523] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-08T18:06:45.480321] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:06:45.617572] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-08T18:06:45.997292] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:06:46.419039] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:06:46.418062] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-08T18:06:47.217547] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-08T18:06:47.771811] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:06:47.924306] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:06:48.017492] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-08T18:06:48.582919] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:06:48.817506] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-08T18:06:49.617562] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-08T18:06:50.133995] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T18:06:50.134823] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T18:06:50.417557] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-08T18:06:51.217560] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-08T18:06:51.707485] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:06:51.946049] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:06:52.017535] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-08T18:06:52.817554] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-08T18:06:53.144207] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:06:53.617529] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-08T18:06:53.870250] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T18:06:54.136811] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:06:54.138023] [INFO ] [REMOTE ] CMSD: Full fetch complete (12151 records). [2025-10-08T18:06:54.138113] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-08T18:06:54.422678] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-08T18:06:54.585458] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-08T18:06:54.585538] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-08T18:06:54.585865] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-08T18:06:54.585927] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-08T18:06:54.586377] [DEBUG] [LOCAL ] CMSD: Trimmed 12151 records to 8001 (keeping 200 days of data) [2025-10-08T18:06:54.635258] [DEBUG] [LOCAL ] CMSD: Primary data saved (8001 records). [2025-10-08T18:06:54.635406] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-08T18:06:54.635506] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMSD took 38.4s. Estimated remaining: 4h 19m 57s. Rate: 7.3 symbols/min [2025-10-08T18:06:54.801224] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:06:54.857924] [DEBUG] [LOCAL ] CNC: Loaded 53752 existing records from primary storage. [2025-10-08T18:06:54.858266] [INFO ] [MAIN ] CNC: Loaded 53752 existing records. [2025-10-08T18:06:55.037023] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:06:55.037315] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-08T18:06:55.037370] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-08T18:06:55.037771] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-08T18:06:55.037828] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-08T18:06:55.219155] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-08T18:06:55.400693] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:06:55.562845] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:06:56.017539] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-08T18:06:56.234144] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:06:56.811588] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T18:06:56.817495] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-08T18:06:57.617634] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-08T18:06:58.302960] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:06:58.416130] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:06:58.422589] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-08T18:06:59.216275] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:06:59.217760] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-08T18:07:00.017588] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-08T18:07:00.530695] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:07:00.817576] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-08T18:07:01.617553] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-08T18:07:01.946780] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:07:02.423729] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-08T18:07:02.429191] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:07:02.590860] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T18:07:02.593581] [INFO ] [REMOTE ] CMTG: Full fetch complete (53513 records). [2025-10-08T18:07:02.593738] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-08T18:07:02.991261] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-08T18:07:02.991370] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-08T18:07:02.992044] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-08T18:07:02.992108] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-08T18:07:02.993394] [DEBUG] [LOCAL ] CMTG: Trimmed 53513 records to 36233 (keeping 200 days of data) [2025-10-08T18:07:03.094282] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:07:03.215303] [DEBUG] [LOCAL ] CMTG: Primary data saved (36233 records). [2025-10-08T18:07:03.215467] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-08T18:07:03.215575] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 38.2s. Estimated remaining: 4h 19m 50s. Rate: 7.3 symbols/min [2025-10-08T18:07:03.227822] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-08T18:07:03.401111] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:03.413721] [DEBUG] [LOCAL ] CNF: Loaded 10538 existing records from primary storage. [2025-10-08T18:07:03.413976] [INFO ] [MAIN ] CNF: Loaded 10538 existing records. [2025-10-08T18:07:03.609089] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:03.609377] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-08T18:07:03.609443] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-08T18:07:03.609704] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-08T18:07:03.609764] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-08T18:07:03.975070] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:04.017510] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-08T18:07:04.660723] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:07:04.817626] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-08T18:07:05.023861] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:07:05.384956] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:07:05.385899] [INFO ] [REMOTE ] CMU: Full fetch complete (9593 records). [2025-10-08T18:07:05.385980] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-08T18:07:05.622735] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-08T18:07:05.778600] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-08T18:07:05.778713] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-08T18:07:05.779020] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-08T18:07:05.779060] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-08T18:07:05.779561] [DEBUG] [LOCAL ] CMU: Trimmed 9593 records to 6347 (keeping 200 days of data) [2025-10-08T18:07:05.819161] [DEBUG] [LOCAL ] CMU: Primary data saved (6347 records). [2025-10-08T18:07:05.819326] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-08T18:07:05.819416] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 31.2s. Estimated remaining: 4h 19m 19s. Rate: 7.3 symbols/min [2025-10-08T18:07:06.003241] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:06.061033] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-08T18:07:06.061389] [INFO ] [MAIN ] CNH: Loaded 53551 existing records. [2025-10-08T18:07:06.246109] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:06.246406] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-08T18:07:06.246454] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-08T18:07:06.246936] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-08T18:07:06.246994] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-08T18:07:06.322628] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T18:07:06.417842] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-08T18:07:06.623894] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:06.813664] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:07:07.217604] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-08T18:07:08.017551] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-08T18:07:08.587425] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:07:08.817562] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-08T18:07:08.910366] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T18:07:09.617581] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-08T18:07:10.417514] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-08T18:07:10.843541] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-08T18:07:11.052636] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T18:07:11.217543] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-08T18:07:11.270683] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T18:07:12.017559] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-08T18:07:12.817583] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-08T18:07:13.358525] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T18:07:13.471772] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:07:13.617554] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-08T18:07:13.977024] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T18:07:14.363285] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T18:07:14.417595] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-08T18:07:15.217580] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-08T18:07:15.706856] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:07:16.017522] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-08T18:07:16.819487] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-08T18:07:16.832116] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T18:07:16.840568] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:07:17.617572] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-08T18:07:18.246091] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T18:07:18.368117] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T18:07:18.417564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-08T18:07:19.217526] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-08T18:07:19.373116] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T18:07:20.017565] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-08T18:07:20.817533] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-08T18:07:21.012002] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:07:21.582827] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T18:07:21.614821] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:07:21.616216] [INFO ] [REMOTE ] CNF: Full fetch complete (13119 records). [2025-10-08T18:07:21.616295] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-08T18:07:21.622608] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-08T18:07:22.055812] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-08T18:07:22.055912] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-08T18:07:22.056282] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-08T18:07:22.056342] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-08T18:07:22.056872] [DEBUG] [LOCAL ] CNF: Trimmed 13119 records to 10508 (keeping 200 days of data) [2025-10-08T18:07:22.116858] [DEBUG] [LOCAL ] CNF: Primary data saved (10508 records). [2025-10-08T18:07:22.117005] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-08T18:07:22.117093] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 18.9s. Estimated remaining: 4h 19m 42s. Rate: 7.3 symbols/min [2025-10-08T18:07:22.283183] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:22.341452] [DEBUG] [LOCAL ] CNI: Loaded 51675 existing records from primary storage. [2025-10-08T18:07:22.341837] [INFO ] [MAIN ] CNI: Loaded 51675 existing records. [2025-10-08T18:07:22.422712] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-08T18:07:22.521167] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:22.521446] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-08T18:07:22.521576] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-08T18:07:22.521947] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-08T18:07:22.522027] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-08T18:07:22.875147] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:23.117801] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:07:23.120565] [INFO ] [REMOTE ] CNA: Full fetch complete (45682 records). [2025-10-08T18:07:23.120794] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-08T18:07:23.221924] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-08T18:07:23.510678] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-08T18:07:23.510774] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-08T18:07:23.511394] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-08T18:07:23.511436] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-08T18:07:23.512476] [DEBUG] [LOCAL ] CNA: Trimmed 45682 records to 32849 (keeping 200 days of data) [2025-10-08T18:07:23.714039] [DEBUG] [LOCAL ] CNA: Primary data saved (32849 records). [2025-10-08T18:07:23.714178] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-08T18:07:23.714269] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 43.9s. Estimated remaining: 4h 19m 8s. Rate: 7.3 symbols/min [2025-10-08T18:07:23.894943] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:23.946281] [DEBUG] [LOCAL ] CNK: Loaded 52883 existing records from primary storage. [2025-10-08T18:07:23.946672] [INFO ] [MAIN ] CNK: Loaded 52883 existing records. [2025-10-08T18:07:24.023440] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-08T18:07:24.137231] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:24.137468] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-08T18:07:24.137518] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-08T18:07:24.137881] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-08T18:07:24.137942] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-08T18:07:24.515315] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:24.602748] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T18:07:24.817523] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-08T18:07:25.144551] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:07:25.617504] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-08T18:07:25.657666] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:07:26.417582] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-08T18:07:26.669493] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:07:27.202960] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T18:07:27.217497] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-08T18:07:27.985331] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:07:28.017500] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-08T18:07:28.550527] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:07:28.817598] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-08T18:07:29.611453] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:07:29.620616] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-08T18:07:30.332784] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:07:30.417554] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-08T18:07:31.217706] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-08T18:07:32.014757] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-08T18:07:32.021532] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-08T18:07:32.416634] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T18:07:32.588249] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:07:32.817574] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-08T18:07:33.484029] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T18:07:33.617621] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-08T18:07:34.417560] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-08T18:07:34.501448] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:07:35.217554] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-08T18:07:35.786466] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T18:07:36.017524] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-08T18:07:36.097795] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:07:36.817634] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-08T18:07:37.020618] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:07:37.617555] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-08T18:07:37.923147] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T18:07:38.417591] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-08T18:07:39.217797] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-08T18:07:39.694289] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:07:39.742431] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-08T18:07:40.017595] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-08T18:07:40.119295] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T18:07:40.817514] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-08T18:07:40.895729] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:07:40.900028] [INFO ] [REMOTE ] CNH: Full fetch complete (77539 records). [2025-10-08T18:07:40.900195] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-08T18:07:41.295774] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-08T18:07:41.295869] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-08T18:07:41.296710] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-08T18:07:41.296773] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-08T18:07:41.298273] [DEBUG] [LOCAL ] CNH: Trimmed 77539 records to 53551 (keeping 200 days of data) [2025-10-08T18:07:41.617623] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-08T18:07:41.631299] [DEBUG] [LOCAL ] CNH: Primary data saved (53551 records). [2025-10-08T18:07:41.631446] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-08T18:07:41.632479] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNH took 35.8s. Estimated remaining: 4h 19m 37s. Rate: 7.2 symbols/min [2025-10-08T18:07:41.800142] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:41.859239] [DEBUG] [LOCAL ] CNM: Loaded 51054 existing records from primary storage. [2025-10-08T18:07:41.859616] [INFO ] [MAIN ] CNM: Loaded 51054 existing records. [2025-10-08T18:07:42.037943] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:42.038279] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-08T18:07:42.038360] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-08T18:07:42.038963] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-08T18:07:42.039024] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-08T18:07:42.149879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-08T18:07:42.175337] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-08T18:07:42.204295] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-08T18:07:42.592431] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:42.616289] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-08T18:07:42.809346] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-08T18:07:42.809430] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-08T18:07:42.810283] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-08T18:07:42.810348] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-08T18:07:42.811928] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 53755 (keeping 200 days of data) [2025-10-08T18:07:43.158784] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:07:43.190065] [DEBUG] [LOCAL ] CNC: Primary data saved (53755 records). [2025-10-08T18:07:43.190196] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-08T18:07:43.190277] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNC took 48.6s. Estimated remaining: 4h 19m 3s. Rate: 7.3 symbols/min [2025-10-08T18:07:43.221987] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-08T18:07:43.368875] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:43.369153] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-08T18:07:43.369304] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-08T18:07:43.369444] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-08T18:07:43.369510] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-08T18:07:43.369589] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-08T18:07:43.369638] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-08T18:07:43.529769] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-08T18:07:43.772707] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:43.966525] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:07:44.017517] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-08T18:07:44.817557] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-08T18:07:44.998386] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:07:45.617522] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-08T18:07:45.667413] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:07:46.417625] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-08T18:07:46.756363] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T18:07:46.831511] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:07:47.217550] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-08T18:07:48.017518] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-08T18:07:48.297110] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:07:48.817530] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-08T18:07:49.103259] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:07:49.366359] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:07:49.617547] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-08T18:07:50.417552] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-08T18:07:51.088635] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T18:07:51.182215] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-08T18:07:51.185547] [INFO ] [REMOTE ] CNI: Full fetch complete (74202 records). [2025-10-08T18:07:51.185712] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-08T18:07:51.186571] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:07:51.186712] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:07:51.186789] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:07:51.186880] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-08T18:07:51.186977] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-08T18:07:51.187034] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-08T18:07:51.187266] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-10-08T18:07:51.188036] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNI took 29.1s. Estimated remaining: 4h 18m 54s. Rate: 7.3 symbols/min [2025-10-08T18:07:51.222637] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-08T18:07:51.360188] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:07:51.398694] [DEBUG] [LOCAL ] CNNE: Loaded 36320 existing records from primary storage. [2025-10-08T18:07:51.399014] [INFO ] [MAIN ] CNNE: Loaded 36320 existing records. [2025-10-08T18:07:51.571708] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:07:51.571947] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-08T18:07:51.571993] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-08T18:07:51.572318] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-08T18:07:51.572375] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-08T18:07:51.935622] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:07:51.990912] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:07:52.017493] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-08T18:07:52.774227] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T18:07:52.817496] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-08T18:07:53.617526] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-08T18:07:53.743222] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T18:07:53.924091] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:07:54.417513] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-08T18:07:54.813891] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:07:55.217600] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-08T18:07:56.017548] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-08T18:07:56.110828] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:07:56.408292] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:07:56.817588] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-08T18:07:57.019737] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T18:07:57.617581] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-08T18:07:58.212342] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T18:07:58.417577] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-08T18:07:58.476577] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:07:59.217596] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-08T18:07:59.983316] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:08:00.017516] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-08T18:08:00.436761] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:08:00.817550] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-08T18:08:01.617529] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-08T18:08:01.695124] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:08:02.417597] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-08T18:08:02.562302] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:08:02.567209] [INFO ] [REMOTE ] CNK: Full fetch complete (75852 records). [2025-10-08T18:08:02.567383] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-08T18:08:03.102445] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:08:03.102602] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-08T18:08:03.110080] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-08T18:08:03.111761] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-08T18:08:03.111861] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-08T18:08:03.113939] [DEBUG] [LOCAL ] CNK: Trimmed 75852 records to 52888 (keeping 200 days of data) [2025-10-08T18:08:03.219215] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-08T18:08:03.443071] [DEBUG] [LOCAL ] CNK: Primary data saved (52888 records). [2025-10-08T18:08:03.443239] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-08T18:08:03.443326] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNK took 39.7s. Estimated remaining: 4h 19m 1s. Rate: 7.3 symbols/min [2025-10-08T18:08:03.614735] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:03.653257] [DEBUG] [LOCAL ] CNO: Loaded 40903 existing records from primary storage. [2025-10-08T18:08:03.653583] [INFO ] [MAIN ] CNO: Loaded 40903 existing records. [2025-10-08T18:08:03.829391] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:03.829637] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-08T18:08:03.829723] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-08T18:08:03.830000] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-08T18:08:03.830058] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-08T18:08:04.037871] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-08T18:08:04.190661] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:04.219601] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:08:04.536611] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:08:04.817568] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-08T18:08:05.617525] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-08T18:08:05.652918] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T18:08:05.861715] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T18:08:06.417574] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-08T18:08:06.778689] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T18:08:07.217562] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-08T18:08:08.017713] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-08T18:08:08.075615] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:08:08.193424] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:08:08.817576] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-08T18:08:09.162138] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:08:09.617576] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-08T18:08:10.338784] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:08:10.417592] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-08T18:08:10.667700] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:08:10.670711] [INFO ] [REMOTE ] CNMD: Full fetch complete (47219 records). [2025-10-08T18:08:10.670840] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-08T18:08:11.157137] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-08T18:08:11.157244] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-08T18:08:11.158085] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-08T18:08:11.158173] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-08T18:08:11.159342] [DEBUG] [LOCAL ] CNMD: Trimmed 47219 records to 32106 (keeping 200 days of data) [2025-10-08T18:08:11.219267] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-08T18:08:11.380690] [DEBUG] [LOCAL ] CNMD: Primary data saved (32106 records). [2025-10-08T18:08:11.380837] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-08T18:08:11.380918] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 28.2s. Estimated remaining: 4h 18m 51s. Rate: 7.3 symbols/min [2025-10-08T18:08:11.605452] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:11.661195] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-08T18:08:11.661583] [INFO ] [MAIN ] CNP: Loaded 53475 existing records. [2025-10-08T18:08:11.857031] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:11.857278] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-08T18:08:11.857363] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-08T18:08:11.857711] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-08T18:08:11.857769] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-08T18:08:12.032144] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-08T18:08:12.222437] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:12.411081] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T18:08:12.817570] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-08T18:08:13.106690] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T18:08:13.617587] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-08T18:08:13.680048] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:08:14.374129] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T18:08:14.417639] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-08T18:08:15.081848] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T18:08:15.086048] [INFO ] [REMOTE ] CNM: Full fetch complete (73618 records). [2025-10-08T18:08:15.086179] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-08T18:08:15.223854] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-08T18:08:15.483087] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-08T18:08:15.483187] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-08T18:08:15.484061] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-08T18:08:15.484143] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-08T18:08:15.485783] [DEBUG] [LOCAL ] CNM: Trimmed 73618 records to 51046 (keeping 200 days of data) [2025-10-08T18:08:15.799001] [DEBUG] [LOCAL ] CNM: Primary data saved (51046 records). [2025-10-08T18:08:15.799293] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-08T18:08:15.799978] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNM took 34.2s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-08T18:08:15.974686] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:16.027365] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-08T18:08:16.030793] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-08T18:08:16.031247] [INFO ] [MAIN ] CNQ: Loaded 53577 existing records. [2025-10-08T18:08:16.152118] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T18:08:16.247808] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:16.248088] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-08T18:08:16.248136] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-08T18:08:16.248488] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-08T18:08:16.248570] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-08T18:08:16.610245] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:16.687506] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:08:16.817559] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-08T18:08:17.617582] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-08T18:08:17.907853] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:08:18.417595] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-08T18:08:18.564439] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:08:18.991992] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:08:19.217552] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-08T18:08:19.742167] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:08:20.017592] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-08T18:08:20.817538] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-08T18:08:20.903330] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T18:08:21.159279] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:08:21.617596] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-08T18:08:22.199417] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T18:08:22.417610] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-08T18:08:23.076372] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:08:23.217718] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-08T18:08:23.969264] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:08:24.017699] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-08T18:08:24.710316] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:08:24.817604] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-08T18:08:25.210697] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T18:08:25.617566] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-08T18:08:26.050524] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:08:26.417605] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-08T18:08:27.100009] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:08:27.217538] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-08T18:08:27.965742] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T18:08:28.017540] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-08T18:08:28.501634] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:08:28.504817] [INFO ] [REMOTE ] CNNE: Full fetch complete (50239 records). [2025-10-08T18:08:28.504955] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-08T18:08:28.822623] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-08T18:08:28.903496] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-08T18:08:28.903576] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-08T18:08:28.904191] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-08T18:08:28.904254] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-08T18:08:28.905317] [DEBUG] [LOCAL ] CNNE: Trimmed 50239 records to 36255 (keeping 200 days of data) [2025-10-08T18:08:29.124672] [DEBUG] [LOCAL ] CNNE: Primary data saved (36255 records). [2025-10-08T18:08:29.124813] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-08T18:08:29.125424] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 37.9s. Estimated remaining: 4h 18m 39s. Rate: 7.2 symbols/min [2025-10-08T18:08:29.300989] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:29.301149] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-08T18:08:29.301193] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-08T18:08:29.301325] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-08T18:08:29.301383] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-08T18:08:29.301430] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-08T18:08:29.301463] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-08T18:08:29.622730] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-08T18:08:29.678954] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:29.833241] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T18:08:30.196252] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:08:30.417583] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-08T18:08:31.217552] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-08T18:08:31.451795] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:08:31.452156] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-08T18:08:31.452249] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:08:31.452298] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-08T18:08:31.452359] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:08:31.452450] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-08T18:08:31.452516] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-08T18:08:31.452552] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-08T18:08:31.452592] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-08T18:08:31.452661] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNR took 2.3s. Estimated remaining: 4h 18m 8s. Rate: 7.3 symbols/min [2025-10-08T18:08:31.661390] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:08:31.665207] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:31.676277] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-08T18:08:31.676675] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-08T18:08:31.676956] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-08T18:08:31.677011] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-08T18:08:31.677439] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-08T18:08:31.677494] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-08T18:08:32.019086] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-08T18:08:32.046692] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:32.212666] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:08:32.817565] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-08T18:08:33.615207] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:08:33.625916] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-08T18:08:34.417581] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-08T18:08:34.642319] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:08:34.691312] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T18:08:35.217552] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-08T18:08:35.866887] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:08:36.017563] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-08T18:08:36.748163] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T18:08:36.800341] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:08:36.817501] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-08T18:08:37.617580] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-08T18:08:37.844948] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:08:38.417617] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-08T18:08:38.790260] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:08:39.217527] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-08T18:08:39.552302] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:08:40.017600] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-08T18:08:40.714543] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T18:08:40.817545] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-08T18:08:41.617518] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-08T18:08:41.737918] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:08:42.417607] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-08T18:08:42.700714] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:08:43.217515] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-08T18:08:43.492912] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:08:43.512747] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:08:43.518770] [INFO ] [REMOTE ] CNO: Full fetch complete (60619 records). [2025-10-08T18:08:43.518942] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-08T18:08:43.951866] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-08T18:08:43.951964] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-08T18:08:43.952753] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-08T18:08:43.952819] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-08T18:08:43.954240] [DEBUG] [LOCAL ] CNO: Trimmed 60619 records to 40837 (keeping 200 days of data) [2025-10-08T18:08:44.043081] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-08T18:08:44.203393] [DEBUG] [LOCAL ] CNO: Primary data saved (40837 records). [2025-10-08T18:08:44.203525] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-08T18:08:44.203603] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNO took 40.8s. Estimated remaining: 4h 18m 17s. Rate: 7.3 symbols/min [2025-10-08T18:08:44.369366] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:44.415793] [DEBUG] [LOCAL ] CNX: Loaded 51355 existing records from primary storage. [2025-10-08T18:08:44.416136] [INFO ] [MAIN ] CNX: Loaded 51355 existing records. [2025-10-08T18:08:44.601040] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:44.601399] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-08T18:08:44.601472] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-08T18:08:44.601898] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-08T18:08:44.602081] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-08T18:08:44.820409] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-08T18:08:44.915964] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:08:45.000865] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:45.385049] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:08:45.617570] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-08T18:08:46.417511] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-08T18:08:46.636922] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T18:08:47.217511] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-08T18:08:47.533060] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:08:47.673955] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:08:47.678341] [INFO ] [REMOTE ] CNP: Full fetch complete (77368 records). [2025-10-08T18:08:47.678465] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-08T18:08:48.022670] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-08T18:08:48.117214] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-08T18:08:48.117309] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-08T18:08:48.118216] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-08T18:08:48.118282] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-08T18:08:48.119921] [DEBUG] [LOCAL ] CNP: Trimmed 77368 records to 53476 (keeping 200 days of data) [2025-10-08T18:08:48.465969] [DEBUG] [LOCAL ] CNP: Primary data saved (53476 records). [2025-10-08T18:08:48.466125] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-08T18:08:48.466227] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNP took 37.1s. Estimated remaining: 4h 17m 54s. Rate: 7.3 symbols/min [2025-10-08T18:08:48.643844] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:48.644006] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-08T18:08:48.644043] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-08T18:08:48.644152] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-08T18:08:48.644194] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-08T18:08:48.644236] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-08T18:08:48.644268] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-08T18:08:48.835954] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-08T18:08:49.029518] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:49.037698] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:08:49.068767] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:08:49.073983] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-08T18:08:49.074137] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-08T18:08:49.519415] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-08T18:08:49.519509] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-08T18:08:49.520428] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-08T18:08:49.520499] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-08T18:08:49.522323] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 53577 (keeping 200 days of data) [2025-10-08T18:08:49.617680] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-08T18:08:49.855421] [DEBUG] [LOCAL ] CNQ: Primary data saved (53577 records). [2025-10-08T18:08:49.855573] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-08T18:08:49.856352] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNQ took 34.1s. Estimated remaining: 4h 17m 20s. Rate: 7.3 symbols/min [2025-10-08T18:08:50.026236] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:08:50.084188] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-08T18:08:50.084572] [INFO ] [MAIN ] COF: Loaded 53609 existing records. [2025-10-08T18:08:50.268024] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:08:50.268242] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-08T18:08:50.268291] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-08T18:08:50.268523] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-08T18:08:50.268601] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-08T18:08:50.426910] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-08T18:08:50.635474] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:08:50.667031] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:08:51.013454] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:08:51.217507] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-08T18:08:51.285827] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:08:52.017590] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-08T18:08:52.350683] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:08:52.817570] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-08T18:08:53.617518] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-08T18:08:54.078929] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T18:08:54.102414] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:08:54.417605] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-08T18:08:54.937352] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:08:55.217516] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-08T18:08:55.375773] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:08:56.017568] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-08T18:08:56.278904] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:08:56.817597] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-08T18:08:57.603480] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:08:57.617517] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-08T18:08:57.830815] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:08:58.417625] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-08T18:08:58.677110] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:08:59.217569] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-08T18:09:00.017607] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-08T18:09:00.245689] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:09:00.486402] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T18:09:00.488790] [INFO ] [REMOTE ] CNS: Full fetch complete (30359 records). [2025-10-08T18:09:00.488925] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-08T18:09:00.822628] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-08T18:09:00.887784] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-08T18:09:00.887871] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-08T18:09:00.888351] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-08T18:09:00.888392] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-08T18:09:00.889289] [DEBUG] [LOCAL ] CNS: Trimmed 30359 records to 20802 (keeping 200 days of data) [2025-10-08T18:09:01.027910] [DEBUG] [LOCAL ] CNS: Primary data saved (20802 records). [2025-10-08T18:09:01.028038] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-08T18:09:01.028135] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNS took 29.6s. Estimated remaining: 4h 17m 22s. Rate: 7.3 symbols/min [2025-10-08T18:09:01.208240] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:01.275120] [DEBUG] [LOCAL ] COHR: Loaded 53365 existing records from primary storage. [2025-10-08T18:09:01.275577] [INFO ] [MAIN ] COHR: Loaded 53365 existing records. [2025-10-08T18:09:01.466739] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:01.467102] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-08T18:09:01.467166] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-08T18:09:01.467465] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-08T18:09:01.467521] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-08T18:09:01.627299] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-08T18:09:01.896580] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:01.906930] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:09:02.422743] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-08T18:09:02.437410] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:09:03.092070] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T18:09:03.217533] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-08T18:09:04.017531] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-08T18:09:04.105252] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:09:04.817533] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-08T18:09:04.929008] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:09:05.617520] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-08T18:09:05.852820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:09:06.296349] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:09:06.417566] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-08T18:09:07.063596] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:09:07.217605] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-08T18:09:08.017515] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-08T18:09:08.058001] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:09:08.817564] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-08T18:09:09.581831] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-08T18:09:09.617507] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-08T18:09:09.944827] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T18:09:10.185278] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:09:10.417589] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-08T18:09:11.217581] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-08T18:09:11.610714] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T18:09:12.017624] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-08T18:09:12.550969] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:09:12.751589] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-08T18:09:12.817512] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-08T18:09:13.617575] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-08T18:09:13.781249] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:09:14.417566] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-08T18:09:14.497028] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:09:14.857072] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:09:14.860593] [INFO ] [REMOTE ] CNX: Full fetch complete (74377 records). [2025-10-08T18:09:14.860790] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-08T18:09:14.861945] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:09:14.862080] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:09:14.862123] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:09:14.862163] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-08T18:09:14.862249] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-08T18:09:14.862303] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-08T18:09:14.862498] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-08T18:09:14.862608] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CNX took 30.7s. Estimated remaining: 4h 17m 35s. Rate: 7.3 symbols/min [2025-10-08T18:09:15.040931] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:15.041130] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-08T18:09:15.041168] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-08T18:09:15.041282] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-08T18:09:15.041323] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-08T18:09:15.041366] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-08T18:09:15.041397] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-08T18:09:15.227106] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-08T18:09:15.431282] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:15.659985] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:09:16.017542] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-08T18:09:16.817636] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-08T18:09:17.275391] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T18:09:17.617579] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-08T18:09:17.760474] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:09:18.380354] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:09:18.417526] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-08T18:09:19.217603] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-08T18:09:19.586987] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:09:19.716364] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:09:19.719588] [INFO ] [REMOTE ] CODI: Full fetch complete (51521 records). [2025-10-08T18:09:19.719743] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-08T18:09:20.022844] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-08T18:09:20.111308] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-08T18:09:20.111400] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-08T18:09:20.112105] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-08T18:09:20.112167] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-08T18:09:20.113315] [DEBUG] [LOCAL ] CODI: Trimmed 51521 records to 40636 (keeping 200 days of data) [2025-10-08T18:09:20.350444] [DEBUG] [LOCAL ] CODI: Primary data saved (40636 records). [2025-10-08T18:09:20.350590] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-08T18:09:20.350696] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CODI took 31.9s. Estimated remaining: 4h 17m 16s. Rate: 7.3 symbols/min [2025-10-08T18:09:20.526167] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:20.568825] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:09:20.615232] [DEBUG] [LOCAL ] COMP: Loaded 53401 existing records from primary storage. [2025-10-08T18:09:20.615588] [INFO ] [MAIN ] COMP: Loaded 53401 existing records. [2025-10-08T18:09:20.804554] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:20.804948] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-08T18:09:20.805018] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-08T18:09:20.805307] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-08T18:09:20.805365] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-08T18:09:20.826225] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-08T18:09:21.168400] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:21.617525] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-08T18:09:21.987295] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T18:09:22.417570] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-08T18:09:22.960908] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T18:09:23.014251] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:09:23.217580] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-08T18:09:24.017627] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-08T18:09:24.817618] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-08T18:09:24.899959] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T18:09:24.960860] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T18:09:25.617554] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-08T18:09:25.865427] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:09:26.417560] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-08T18:09:27.020559] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-08T18:09:27.217574] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-08T18:09:27.273937] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:09:27.864071] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:09:28.017559] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-08T18:09:28.818082] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-08T18:09:29.357771] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T18:09:29.617542] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-08T18:09:29.746381] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:09:30.415971] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:09:30.426176] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-08T18:09:31.217517] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-08T18:09:31.259367] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:09:32.017525] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-08T18:09:32.159474] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:09:32.817519] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-08T18:09:32.885684] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:09:33.617514] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-08T18:09:33.896102] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T18:09:34.417543] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-08T18:09:34.873719] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:09:35.217513] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-08T18:09:35.351635] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T18:09:35.356761] [INFO ] [REMOTE ] COF: Full fetch complete (77446 records). [2025-10-08T18:09:35.356941] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-08T18:09:35.847315] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-08T18:09:35.847419] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-08T18:09:35.848420] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-08T18:09:35.848568] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-08T18:09:35.850337] [DEBUG] [LOCAL ] COF: Trimmed 77446 records to 53612 (keeping 200 days of data) [2025-10-08T18:09:36.016485] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:09:36.019131] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-08T18:09:36.246243] [DEBUG] [LOCAL ] COF: Primary data saved (53612 records). [2025-10-08T18:09:36.246412] [INFO ] [MAIN ] COF: Full history saved. [2025-10-08T18:09:36.247249] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 46.4s. Estimated remaining: 4h 17m 36s. Rate: 7.2 symbols/min [2025-10-08T18:09:36.416468] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:36.455622] [DEBUG] [LOCAL ] CON: Loaded 38863 existing records from primary storage. [2025-10-08T18:09:36.455969] [INFO ] [MAIN ] CON: Loaded 38863 existing records. [2025-10-08T18:09:36.631334] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:36.631555] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-08T18:09:36.631605] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-08T18:09:36.631879] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-08T18:09:36.631939] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-08T18:09:36.843301] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-08T18:09:37.005055] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:37.303965] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T18:09:37.308070] [INFO ] [REMOTE ] COHR: Full fetch complete (77174 records). [2025-10-08T18:09:37.308188] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-08T18:09:37.618966] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-08T18:09:37.701086] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-08T18:09:37.701268] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-08T18:09:37.702207] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-08T18:09:37.702293] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-08T18:09:37.704097] [DEBUG] [LOCAL ] COHR: Trimmed 77174 records to 53371 (keeping 200 days of data) [2025-10-08T18:09:37.823357] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T18:09:38.062521] [DEBUG] [LOCAL ] COHR: Primary data saved (53371 records). [2025-10-08T18:09:38.062735] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-08T18:09:38.063913] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COHR took 37.0s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-08T18:09:38.244618] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:38.274340] [DEBUG] [LOCAL ] COOK: Loaded 24428 existing records from primary storage. [2025-10-08T18:09:38.274736] [INFO ] [MAIN ] COOK: Loaded 24428 existing records. [2025-10-08T18:09:38.422636] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-08T18:09:38.506558] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:38.507445] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-08T18:09:38.507497] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-08T18:09:38.507788] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-08T18:09:38.507853] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-08T18:09:38.913973] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-08T18:09:38.994505] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:39.217513] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-08T18:09:39.244303] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:09:40.022595] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-08T18:09:40.029107] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:09:40.603915] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:09:40.817555] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-08T18:09:41.184436] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:09:41.617601] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-08T18:09:42.417553] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-08T18:09:42.640200] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:09:43.022212] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:09:43.217520] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-08T18:09:44.017606] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-08T18:09:44.129379] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:09:44.817563] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-08T18:09:45.002053] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:09:45.112637] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T18:09:45.617538] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-08T18:09:46.417510] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-08T18:09:46.523984] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:09:46.650465] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T18:09:47.217596] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-08T18:09:48.009315] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:09:48.013909] [INFO ] [REMOTE ] COLD: Full fetch complete (74456 records). [2025-10-08T18:09:48.014107] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-08T18:09:48.027465] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-08T18:09:48.297690] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:09:48.463131] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-08T18:09:48.463224] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-08T18:09:48.464088] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-08T18:09:48.464163] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-08T18:09:48.465796] [DEBUG] [LOCAL ] COLD: Trimmed 74456 records to 52250 (keeping 200 days of data) [2025-10-08T18:09:48.795134] [DEBUG] [LOCAL ] COLD: Primary data saved (52250 records). [2025-10-08T18:09:48.795299] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-08T18:09:48.795380] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 33.9s. Estimated remaining: 4h 17m 5s. Rate: 7.3 symbols/min [2025-10-08T18:09:48.824195] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-08T18:09:48.986235] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:09:49.043725] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-08T18:09:49.044142] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-08T18:09:49.324280] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:09:49.324552] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-08T18:09:49.324604] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-08T18:09:49.324945] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-08T18:09:49.325004] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-08T18:09:49.619866] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-08T18:09:49.702747] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:09:49.713358] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T18:09:49.809897] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T18:09:50.417611] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-08T18:09:51.124071] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:09:51.217510] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-08T18:09:51.603936] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:09:52.017552] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-08T18:09:52.702518] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:09:52.817552] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-08T18:09:53.060409] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:09:53.617600] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-08T18:09:54.417586] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-08T18:09:54.529860] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:09:54.556428] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T18:09:55.217609] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-08T18:09:55.970724] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T18:09:56.017528] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-08T18:09:56.817534] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-08T18:09:57.366941] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T18:09:57.513396] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:09:57.617565] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-08T18:09:57.898760] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:09:58.417521] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-08T18:09:59.217518] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-08T18:09:59.312467] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:09:59.591430] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T18:10:00.017579] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-08T18:10:00.817710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-08T18:10:01.046974] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-08T18:10:01.050576] [INFO ] [REMOTE ] COMP: Full fetch complete (76806 records). [2025-10-08T18:10:01.050723] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-08T18:10:01.051535] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:01.051631] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:01.051725] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:01.051770] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-08T18:10:01.051860] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-08T18:10:01.051915] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-08T18:10:01.052132] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-08T18:10:01.052226] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 40.7s. Estimated remaining: 4h 17m 11s. Rate: 7.2 symbols/min [2025-10-08T18:10:01.229076] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:01.229292] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-08T18:10:01.229356] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-08T18:10:01.229531] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-08T18:10:01.229574] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-08T18:10:01.229616] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-08T18:10:01.229679] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-08T18:10:01.348453] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:10:01.611849] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:01.617493] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-08T18:10:02.058762] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T18:10:02.417586] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-08T18:10:03.217556] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-08T18:10:03.476110] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T18:10:03.731302] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:10:04.017543] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-08T18:10:04.587228] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:10:04.590199] [INFO ] [REMOTE ] CON: Full fetch complete (56528 records). [2025-10-08T18:10:04.590300] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-08T18:10:04.590999] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:04.591111] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:04.591155] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:04.591218] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-08T18:10:04.591311] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-08T18:10:04.591369] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-08T18:10:04.591545] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-08T18:10:04.592635] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 28.3s. Estimated remaining: 4h 16m 46s. Rate: 7.3 symbols/min [2025-10-08T18:10:04.761504] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:04.813388] [DEBUG] [LOCAL ] COTY: Loaded 53239 existing records from primary storage. [2025-10-08T18:10:04.813787] [INFO ] [MAIN ] COTY: Loaded 53239 existing records. [2025-10-08T18:10:04.824995] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-08T18:10:04.994628] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:04.994962] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-08T18:10:04.995012] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-08T18:10:04.995245] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-08T18:10:04.995302] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-08T18:10:05.117075] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:10:05.153274] [INFO ] [REMOTE ] COOK: Full fetch complete (32539 records). [2025-10-08T18:10:05.165845] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-08T18:10:05.170478] [FATAL] [VALIDATOR ] COOK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:05.187718] [FATAL] [MAIN ] COOK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:05.233014] [WARN ] [MAIN ] COOK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:05.259087] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-08T18:10:05.270073] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-08T18:10:05.289191] [INFO ] [LOCAL ] COOK: Starting deletion of derivative data. [2025-10-08T18:10:05.291982] [DEBUG] [LOCAL ] COOK: Deleted derivative data file. [2025-10-08T18:10:05.302690] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COOK took 27.2s. Estimated remaining: 4h 16m 10s. Rate: 7.3 symbols/min [2025-10-08T18:10:05.454352] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:05.549615] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:05.595026] [DEBUG] [LOCAL ] COUR: Loaded 49046 existing records from primary storage. [2025-10-08T18:10:05.595371] [INFO ] [MAIN ] COUR: Loaded 49046 existing records. [2025-10-08T18:10:05.626432] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-08T18:10:05.777729] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:05.778015] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-08T18:10:05.778085] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-08T18:10:05.778343] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-08T18:10:05.778423] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-08T18:10:06.160223] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:06.417507] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-08T18:10:06.980265] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-08T18:10:07.217562] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-08T18:10:07.601594] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T18:10:08.017582] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-08T18:10:08.455980] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:10:08.549592] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:10:08.817541] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-08T18:10:09.623903] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-08T18:10:09.629892] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:10:10.417540] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-08T18:10:10.479471] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:10:11.217530] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-08T18:10:11.373088] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T18:10:12.017512] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-08T18:10:12.119359] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:10:12.803678] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:10:12.817505] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-08T18:10:13.617514] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-08T18:10:13.841607] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:10:13.984435] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:10:14.417585] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-08T18:10:15.217572] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-08T18:10:15.681714] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T18:10:15.756089] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:10:16.017580] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-08T18:10:16.813970] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:10:16.823822] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-08T18:10:17.617575] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-08T18:10:17.842617] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:10:18.368931] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T18:10:18.417545] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-08T18:10:19.217532] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-08T18:10:19.673255] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:10:20.017608] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-08T18:10:20.386032] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T18:10:20.817522] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-08T18:10:21.106265] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:10:21.617551] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-08T18:10:21.731559] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:10:22.371197] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:10:22.417565] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-08T18:10:23.217523] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-08T18:10:23.283350] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:10:24.017526] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-08T18:10:24.158398] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:10:24.817505] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-08T18:10:25.013355] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:10:25.454787] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:10:25.617614] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-08T18:10:26.417627] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-08T18:10:26.512014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T18:10:27.217563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-08T18:10:27.376723] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T18:10:28.017633] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-08T18:10:28.183612] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:10:28.817504] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-08T18:10:29.294975] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:10:29.617563] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-08T18:10:29.848945] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:10:29.969672] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-08T18:10:29.973215] [INFO ] [REMOTE ] COP: Full fetch complete (77379 records). [2025-10-08T18:10:29.973343] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-08T18:10:29.974205] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:29.974302] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:29.974344] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:29.974383] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-08T18:10:29.974440] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-08T18:10:29.974473] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-08T18:10:29.974673] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-10-08T18:10:29.974770] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 41.2s. Estimated remaining: 4h 17m 1s. Rate: 7.2 symbols/min [2025-10-08T18:10:30.148874] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:30.202284] [DEBUG] [LOCAL ] CP: Loaded 53265 existing records from primary storage. [2025-10-08T18:10:30.202638] [INFO ] [MAIN ] CP: Loaded 53265 existing records. [2025-10-08T18:10:30.384700] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:30.385057] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-08T18:10:30.385136] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-08T18:10:30.386367] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-08T18:10:30.386432] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-08T18:10:30.417734] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-08T18:10:30.789023] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:30.785070] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:10:31.217578] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-08T18:10:32.018441] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-08T18:10:32.021762] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:10:32.817514] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-08T18:10:33.070176] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:10:33.617561] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-08T18:10:33.895702] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:10:34.212949] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:10:34.217762] [INFO ] [REMOTE ] COUR: Full fetch complete (70860 records). [2025-10-08T18:10:34.218069] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-08T18:10:34.423084] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-08T18:10:34.605700] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-08T18:10:34.605794] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-08T18:10:34.606635] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-08T18:10:34.606720] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-08T18:10:34.608213] [DEBUG] [LOCAL ] COUR: Trimmed 70860 records to 49053 (keeping 200 days of data) [2025-10-08T18:10:34.886846] [DEBUG] [LOCAL ] COUR: Primary data saved (49053 records). [2025-10-08T18:10:34.886990] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-08T18:10:34.887071] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COUR took 29.6s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-08T18:10:35.064417] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:35.095064] [DEBUG] [LOCAL ] CPA: Loaded 28274 existing records from primary storage. [2025-10-08T18:10:35.095436] [INFO ] [MAIN ] CPA: Loaded 28274 existing records. [2025-10-08T18:10:35.222695] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-08T18:10:35.276586] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:35.276980] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-08T18:10:35.277129] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-08T18:10:35.277462] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-08T18:10:35.277528] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-08T18:10:35.414733] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:10:35.682545] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:35.862770] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:10:36.017560] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-08T18:10:36.817543] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-08T18:10:36.921373] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:10:36.924822] [INFO ] [REMOTE ] COR: Full fetch complete (68617 records). [2025-10-08T18:10:36.924999] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-08T18:10:37.316913] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-08T18:10:37.317117] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-08T18:10:37.317980] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-08T18:10:37.318085] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-08T18:10:37.320056] [DEBUG] [LOCAL ] COR: Trimmed 68617 records to 46781 (keeping 200 days of data) [2025-10-08T18:10:37.461976] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:10:37.617616] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-08T18:10:37.675125] [DEBUG] [LOCAL ] COR: Primary data saved (46781 records). [2025-10-08T18:10:37.675264] [INFO ] [MAIN ] COR: Full history saved. [2025-10-08T18:10:37.675359] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COR took 36.6s. Estimated remaining: 4h 16m 13s. Rate: 7.3 symbols/min [2025-10-08T18:10:37.854270] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:37.854473] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-08T18:10:37.854518] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-08T18:10:37.854660] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-08T18:10:37.854717] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-08T18:10:37.854765] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-08T18:10:37.854797] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-08T18:10:38.202695] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:38.417513] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-08T18:10:38.494172] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:10:39.092392] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:10:39.206497] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:10:39.217603] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-08T18:10:39.563166] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T18:10:40.017626] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-08T18:10:40.817528] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-08T18:10:41.152066] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T18:10:41.617533] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-08T18:10:41.876106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T18:10:42.417553] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-08T18:10:43.217515] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-08T18:10:43.408708] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T18:10:43.486019] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:10:43.570965] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T18:10:44.017544] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-08T18:10:44.817512] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-08T18:10:45.210387] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T18:10:45.507838] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:10:45.617508] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-08T18:10:45.731509] [DEBUG] [REMOTE ] CP: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T18:10:45.731916] [WARN ] [REMOTE ] CP: No data returned for month 2025-05 [2025-10-08T18:10:45.732008] [FATAL] [REMOTE ] CP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:10:45.732098] [FATAL] [MAIN ] CP: Failed to fetch primary data. [2025-10-08T18:10:45.732170] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:10:45.732217] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-08T18:10:45.732273] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-08T18:10:45.732307] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-08T18:10:45.732667] [DEBUG] [LOCAL ] CP: Deleted derivative data file. [2025-10-08T18:10:45.732780] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CP took 15.8s. Estimated remaining: 4h 16m 3s. Rate: 7.3 symbols/min [2025-10-08T18:10:45.920485] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:45.955637] [DEBUG] [LOCAL ] CPAY: Loaded 30449 existing records from primary storage. [2025-10-08T18:10:45.955985] [INFO ] [MAIN ] CPAY: Loaded 30449 existing records. [2025-10-08T18:10:46.143430] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:46.143679] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-08T18:10:46.143737] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-08T18:10:46.144085] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-08T18:10:46.144142] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-08T18:10:46.420127] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-08T18:10:46.505923] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:47.217553] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-08T18:10:47.671194] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:10:48.017506] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-08T18:10:48.175979] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:10:48.180006] [INFO ] [REMOTE ] COTY: Full fetch complete (76725 records). [2025-10-08T18:10:48.180146] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-08T18:10:48.181079] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:10:48.181172] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:48.181238] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:48.181324] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-08T18:10:48.181405] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-08T18:10:48.181453] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-08T18:10:48.181679] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-08T18:10:48.182429] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. COTY took 43.6s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-08T18:10:48.366399] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:48.367024] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:10:48.367117] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-08T18:10:48.368301] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-08T18:10:48.368467] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-08T18:10:48.368575] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-08T18:10:48.368672] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-08T18:10:48.368730] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-08T18:10:48.723840] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:48.817568] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-08T18:10:49.617550] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-08T18:10:49.641994] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:10:50.417595] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-08T18:10:50.909974] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:10:51.217578] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-08T18:10:51.446174] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T18:10:52.017631] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-08T18:10:52.315227] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:10:52.615886] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:10:52.817588] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-08T18:10:53.617600] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-08T18:10:53.798461] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:10:53.939309] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-08T18:10:54.417560] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-08T18:10:55.217568] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-08T18:10:55.801046] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T18:10:55.823806] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T18:10:56.017529] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-08T18:10:56.817598] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-08T18:10:57.296960] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T18:10:57.297723] [INFO ] [REMOTE ] CPAC: Full fetch complete (1870 records). [2025-10-08T18:10:57.297808] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-08T18:10:57.475777] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:10:57.476028] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:10:57.476138] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:10:57.476313] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-08T18:10:57.476462] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-08T18:10:57.476510] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-08T18:10:57.476674] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-08T18:10:57.476764] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPAC took 19.8s. Estimated remaining: 4h 15m 30s. Rate: 7.3 symbols/min [2025-10-08T18:10:57.620261] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T18:10:57.619154] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-08T18:10:57.702410] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:10:57.723835] [DEBUG] [LOCAL ] CPK: Loaded 13627 existing records from primary storage. [2025-10-08T18:10:57.724087] [INFO ] [MAIN ] CPK: Loaded 13627 existing records. [2025-10-08T18:10:57.947407] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:10:57.947685] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-08T18:10:57.947749] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-08T18:10:57.948012] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-08T18:10:57.948091] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-08T18:10:58.296260] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:10:58.417495] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-08T18:10:58.773463] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:10:59.133096] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T18:10:59.217589] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-08T18:11:00.017572] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-08T18:11:00.505361] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T18:11:00.817590] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-08T18:11:01.151169] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:11:01.345672] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:11:01.617542] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-08T18:11:02.417544] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-08T18:11:02.993575] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T18:11:03.009977] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T18:11:03.217577] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-08T18:11:04.022802] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-08T18:11:04.025695] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:11:04.817590] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-08T18:11:05.011565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:11:05.617540] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-08T18:11:06.065500] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T18:11:06.417518] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-08T18:11:06.653723] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:11:07.217557] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-08T18:11:07.660927] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T18:11:08.017531] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-08T18:11:08.172361] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T18:11:08.817688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-08T18:11:08.938739] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:11:09.617580] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-08T18:11:09.714134] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:11:10.417585] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-08T18:11:10.620314] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T18:11:11.217606] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-08T18:11:11.949220] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:11:11.952199] [INFO ] [REMOTE ] CPF: Full fetch complete (23941 records). [2025-10-08T18:11:11.967808] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-08T18:11:12.004884] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:11:12.028327] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-08T18:11:12.392247] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-08T18:11:12.392334] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-08T18:11:12.392788] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-08T18:11:12.392851] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-08T18:11:12.393604] [DEBUG] [LOCAL ] CPF: Trimmed 23941 records to 15169 (keeping 200 days of data) [2025-10-08T18:11:12.486849] [DEBUG] [LOCAL ] CPF: Primary data saved (15169 records). [2025-10-08T18:11:12.486997] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-08T18:11:12.487073] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPF took 24.3s. Estimated remaining: 4h 15m 46s. Rate: 7.3 symbols/min [2025-10-08T18:11:12.655576] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:12.714209] [DEBUG] [LOCAL ] CPNG: Loaded 53672 existing records from primary storage. [2025-10-08T18:11:12.714622] [INFO ] [MAIN ] CPNG: Loaded 53672 existing records. [2025-10-08T18:11:12.822798] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-08T18:11:12.902563] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:12.902827] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-08T18:11:12.902877] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-08T18:11:12.903195] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-08T18:11:12.903253] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-08T18:11:13.264095] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:13.312962] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T18:11:13.617590] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-08T18:11:14.417614] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-08T18:11:14.470762] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:11:15.217576] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-08T18:11:15.356267] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:11:15.802380] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-08T18:11:16.017551] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-08T18:11:16.188585] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T18:11:16.817599] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-08T18:11:17.617609] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-08T18:11:18.006588] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T18:11:18.092921] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:11:18.206998] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T18:11:18.417587] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-08T18:11:19.217560] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-08T18:11:19.873535] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:11:19.914339] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T18:11:20.017542] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-08T18:11:20.817709] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-08T18:11:21.617579] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-08T18:11:22.132073] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:11:22.295300] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-08T18:11:22.417565] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-08T18:11:22.991367] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:11:23.217566] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-08T18:11:23.504624] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:11:23.779863] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T18:11:24.017562] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-08T18:11:24.817528] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-08T18:11:24.879528] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:11:25.617555] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-08T18:11:25.831508] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T18:11:26.417530] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-08T18:11:26.695060] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:11:27.217549] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-08T18:11:27.494491] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:11:27.496793] [INFO ] [REMOTE ] CPAY: Full fetch complete (44893 records). [2025-10-08T18:11:27.496891] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-08T18:11:27.874628] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-08T18:11:27.874741] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-08T18:11:27.875303] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-08T18:11:27.875343] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-08T18:11:27.876303] [DEBUG] [LOCAL ] CPAY: Trimmed 44893 records to 30443 (keeping 200 days of data) [2025-10-08T18:11:28.027375] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-08T18:11:28.067853] [DEBUG] [LOCAL ] CPAY: Primary data saved (30443 records). [2025-10-08T18:11:28.067969] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-08T18:11:28.068062] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPAY took 42.3s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-08T18:11:28.092205] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T18:11:28.093923] [INFO ] [REMOTE ] CPK: Full fetch complete (18109 records). [2025-10-08T18:11:28.093995] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-08T18:11:28.452968] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-08T18:11:28.453049] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-08T18:11:28.453411] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-08T18:11:28.453450] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-08T18:11:28.454066] [DEBUG] [LOCAL ] CPK: Trimmed 18109 records to 13647 (keeping 200 days of data) [2025-10-08T18:11:28.540816] [DEBUG] [LOCAL ] CPK: Primary data saved (13647 records). [2025-10-08T18:11:28.540997] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-08T18:11:28.541112] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 31.1s. Estimated remaining: 4h 15m 27s. Rate: 7.3 symbols/min [2025-10-08T18:11:28.817557] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-08T18:11:29.944994] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:11:29.947242] [INFO ] [REMOTE ] CPA: Full fetch complete (41385 records). [2025-10-08T18:11:29.947331] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-08T18:11:30.355914] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-08T18:11:30.356095] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-08T18:11:30.356773] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-08T18:11:30.356890] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-08T18:11:30.358021] [DEBUG] [LOCAL ] CPA: Trimmed 41385 records to 28240 (keeping 200 days of data) [2025-10-08T18:11:30.517300] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-08T18:11:30.530833] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-08T18:11:30.591353] [DEBUG] [LOCAL ] CPA: Primary data saved (28240 records). [2025-10-08T18:11:30.591494] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-08T18:11:30.591576] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPA took 55.7s. Estimated remaining: 4h 14m 57s. Rate: 7.3 symbols/min [2025-10-08T18:11:32.634321] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T18:11:32.647245] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-08T18:11:34.986628] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-08T18:11:34.998358] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-08T18:11:37.110942] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:11:37.123214] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-08T18:11:39.324686] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:11:39.337424] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-08T18:11:41.879722] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T18:11:41.892060] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-08T18:11:44.107118] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T18:11:44.118604] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-08T18:11:46.321699] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T18:11:46.325911] [INFO ] [REMOTE ] CPNG: Full fetch complete (77673 records). [2025-10-08T18:11:46.326050] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-08T18:11:46.721895] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-08T18:11:46.722030] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-08T18:11:46.723158] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-08T18:11:46.723230] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-08T18:11:46.724948] [DEBUG] [LOCAL ] CPNG: Trimmed 77673 records to 53670 (keeping 200 days of data) [2025-10-08T18:11:47.043173] [DEBUG] [LOCAL ] CPNG: Primary data saved (53670 records). [2025-10-08T18:11:47.043311] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-08T18:11:47.043915] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 34.6s. Estimated remaining: 4h 15m 18s. Rate: 7.3 symbols/min [2025-10-08T18:11:47.661005] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.682367] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.763166] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.776913] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-08T18:11:47.812145] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:11:47.810957] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-08T18:11:47.812778] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-08T18:11:47.813003] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-08T18:11:47.813077] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-08T18:11:47.813115] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-08T18:11:48.038011] [DEBUG] [LOCAL ] CPS: Loaded 25707 existing records from primary storage. [2025-10-08T18:11:48.081277] [INFO ] [MAIN ] CPS: Loaded 25707 existing records. [2025-10-08T18:11:48.194610] [DEBUG] [LOCAL ] CPT: Loaded 44398 existing records from primary storage. [2025-10-08T18:11:48.264889] [DEBUG] [LOCAL ] CPRI: Loaded 52513 existing records from primary storage. [2025-10-08T18:11:48.275518] [INFO ] [MAIN ] CPT: Loaded 44398 existing records. [2025-10-08T18:11:48.304285] [INFO ] [MAIN ] CPRI: Loaded 52513 existing records. [2025-10-08T18:11:48.606960] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:48.626913] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-08T18:11:48.816330] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.925457] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.953902] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.935168] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.954334] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-08T18:11:48.954232] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-08T18:11:48.957751] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:11:48.958094] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-08T18:11:48.958149] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-08T18:11:48.958272] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-08T18:11:48.958238] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-08T18:11:48.958607] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-08T18:11:48.958521] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-08T18:11:48.958477] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-08T18:11:48.963998] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-08T18:11:49.998765] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.009464] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.033088] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-08T18:11:50.038599] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-08T18:11:50.155055] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:11:50.160634] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-08T18:11:50.168365] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:11:50.173255] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-08T18:11:51.277350] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:11:51.281979] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-08T18:11:51.366923] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:11:51.372883] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-08T18:11:51.468483] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:11:51.476529] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-08T18:11:51.620180] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:11:51.631327] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-08T18:11:52.323349] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:11:52.328091] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-08T18:11:52.410274] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T18:11:52.415885] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-08T18:11:52.942414] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:11:52.951342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-08T18:11:53.407424] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:11:53.418894] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-08T18:11:53.451100] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T18:11:53.456580] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-08T18:11:53.591253] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T18:11:53.596765] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-08T18:11:54.690543] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:11:54.697587] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-08T18:11:54.709952] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:11:54.715068] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-08T18:11:54.877603] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T18:11:54.886667] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-08T18:11:54.942181] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:11:54.952144] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-08T18:11:55.628158] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:11:55.636222] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-08T18:11:55.822811] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:11:55.830219] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-08T18:11:56.237702] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T18:11:56.247104] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-08T18:11:56.549403] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:11:56.562838] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-08T18:11:56.695567] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:11:56.701763] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-08T18:11:57.471521] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:11:57.478809] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-08T18:11:57.914759] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T18:11:57.925148] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-08T18:11:57.962093] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:11:57.968128] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-08T18:11:58.002505] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T18:11:58.014564] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-08T18:11:58.196403] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T18:11:58.201800] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-08T18:11:58.895772] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T18:11:58.899420] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-08T18:11:59.247577] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T18:11:59.257894] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-08T18:11:59.289327] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T18:11:59.650604] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T18:11:59.830155] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:12:00.017595] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-08T18:12:00.732871] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:12:00.817512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-08T18:12:01.617626] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-08T18:12:01.928278] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:12:02.100981] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:12:02.417578] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-08T18:12:02.578969] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:12:02.580455] [INFO ] [REMOTE ] CQP: Full fetch complete (30358 records). [2025-10-08T18:12:02.580547] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-08T18:12:02.953006] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-08T18:12:02.953120] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-08T18:12:02.953605] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-08T18:12:02.953675] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-08T18:12:02.954668] [DEBUG] [LOCAL ] CQP: Trimmed 30358 records to 18929 (keeping 200 days of data) [2025-10-08T18:12:03.071757] [DEBUG] [LOCAL ] CQP: Primary data saved (18929 records). [2025-10-08T18:12:03.071923] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-08T18:12:03.072024] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 16.0s. Estimated remaining: 4h 15m 37s. Rate: 7.2 symbols/min [2025-10-08T18:12:03.223944] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-08T18:12:03.243039] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:03.267709] [DEBUG] [LOCAL ] CR: Loaded 24194 existing records from primary storage. [2025-10-08T18:12:03.267990] [INFO ] [MAIN ] CR: Loaded 24194 existing records. [2025-10-08T18:12:03.448978] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:03.449237] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-08T18:12:03.449330] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-08T18:12:03.450116] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-08T18:12:03.450176] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-08T18:12:03.802969] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:04.017540] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-08T18:12:04.352227] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T18:12:04.376989] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:12:04.817560] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-08T18:12:05.303870] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T18:12:05.617588] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-08T18:12:06.256798] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:12:06.258815] [INFO ] [REMOTE ] CPS: Full fetch complete (36388 records). [2025-10-08T18:12:06.258909] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-08T18:12:06.421924] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-08T18:12:06.649288] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-08T18:12:06.649374] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-08T18:12:06.649973] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-08T18:12:06.650036] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-08T18:12:06.650911] [DEBUG] [LOCAL ] CPS: Trimmed 36388 records to 25526 (keeping 200 days of data) [2025-10-08T18:12:06.803299] [DEBUG] [LOCAL ] CPS: Primary data saved (25526 records). [2025-10-08T18:12:06.803456] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-08T18:12:06.803603] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 19.8s. Estimated remaining: 4h 15m 13s. Rate: 7.2 symbols/min [2025-10-08T18:12:06.984435] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:06.995153] [DEBUG] [LOCAL ] CRBD: Loaded 8964 existing records from primary storage. [2025-10-08T18:12:06.995391] [INFO ] [MAIN ] CRBD: Loaded 8964 existing records. [2025-10-08T18:12:07.182704] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:07.183215] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-08T18:12:07.183362] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-08T18:12:07.183925] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-08T18:12:07.184041] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-08T18:12:07.217695] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-08T18:12:07.332206] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:12:07.607130] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:08.017553] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-08T18:12:08.170156] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T18:12:08.555462] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:12:08.817588] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-08T18:12:09.259785] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:12:09.617573] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-08T18:12:09.980096] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:12:10.417631] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-08T18:12:11.217521] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-08T18:12:11.249520] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:12:11.299474] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T18:12:12.017604] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-08T18:12:12.460294] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:12:12.612846] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T18:12:12.817587] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-08T18:12:13.617595] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-08T18:12:14.417553] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-08T18:12:14.662361] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:12:14.666338] [INFO ] [REMOTE ] CPRI: Full fetch complete (76103 records). [2025-10-08T18:12:14.666447] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-08T18:12:15.071469] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-08T18:12:15.071560] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-08T18:12:15.072407] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-08T18:12:15.072473] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-08T18:12:15.074000] [DEBUG] [LOCAL ] CPRI: Trimmed 76103 records to 52519 (keeping 200 days of data) [2025-10-08T18:12:15.196750] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:12:15.217891] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-08T18:12:15.422286] [DEBUG] [LOCAL ] CPRI: Primary data saved (52519 records). [2025-10-08T18:12:15.422447] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-08T18:12:15.422564] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPRI took 28.4s. Estimated remaining: 4h 15m 6s. Rate: 7.2 symbols/min [2025-10-08T18:12:15.598937] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:15.649847] [DEBUG] [LOCAL ] CRBG: Loaded 52422 existing records from primary storage. [2025-10-08T18:12:15.650173] [INFO ] [MAIN ] CRBG: Loaded 52422 existing records. [2025-10-08T18:12:15.830717] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:15.831048] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-08T18:12:15.831145] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-08T18:12:15.832744] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-08T18:12:15.832808] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-08T18:12:16.031493] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-08T18:12:16.207694] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:16.235065] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T18:12:16.503535] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:12:16.817580] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-08T18:12:16.825022] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T18:12:17.617571] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-08T18:12:17.944909] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T18:12:18.417560] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-08T18:12:19.056473] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:12:19.217520] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-08T18:12:19.400593] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:12:20.017559] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-08T18:12:20.275510] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:12:20.818385] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-08T18:12:20.821992] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T18:12:21.617577] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-08T18:12:22.417609] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-08T18:12:22.547690] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:12:23.220218] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-08T18:12:23.222955] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:12:23.227763] [INFO ] [REMOTE ] CPT: Full fetch complete (63979 records). [2025-10-08T18:12:23.227924] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-08T18:12:23.568623] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:12:23.693105] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-08T18:12:23.693347] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-08T18:12:23.700531] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:12:23.700239] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-08T18:12:23.704017] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-08T18:12:23.705601] [DEBUG] [LOCAL ] CPT: Trimmed 63979 records to 44405 (keeping 200 days of data) [2025-10-08T18:12:23.998688] [DEBUG] [LOCAL ] CPT: Primary data saved (44405 records). [2025-10-08T18:12:23.998839] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-08T18:12:23.998926] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPT took 36.9s. Estimated remaining: 4h 14m 58s. Rate: 7.2 symbols/min [2025-10-08T18:12:24.022741] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-08T18:12:24.178626] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:24.222384] [DEBUG] [LOCAL ] CRC: Loaded 43850 existing records from primary storage. [2025-10-08T18:12:24.222723] [INFO ] [MAIN ] CRC: Loaded 43850 existing records. [2025-10-08T18:12:24.397051] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:24.397298] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-08T18:12:24.397344] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-08T18:12:24.397815] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-08T18:12:24.397873] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-08T18:12:24.744354] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:24.817493] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-08T18:12:25.617596] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-08T18:12:25.853114] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:12:26.324228] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:12:26.370085] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:12:26.417544] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-08T18:12:27.217603] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-08T18:12:27.724278] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:12:28.017548] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-08T18:12:28.810876] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:12:28.821033] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-08T18:12:29.366071] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:12:29.617526] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-08T18:12:29.822413] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:12:30.417585] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-08T18:12:30.459271] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T18:12:31.217554] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-08T18:12:31.949714] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:12:32.017530] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-08T18:12:32.406114] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:12:32.408094] [INFO ] [REMOTE ] CR: Full fetch complete (34686 records). [2025-10-08T18:12:32.408178] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-08T18:12:32.789178] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-08T18:12:32.789268] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-08T18:12:32.789885] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-08T18:12:32.789968] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-08T18:12:32.791249] [DEBUG] [LOCAL ] CR: Trimmed 34686 records to 24113 (keeping 200 days of data) [2025-10-08T18:12:32.851219] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-08T18:12:32.952400] [DEBUG] [LOCAL ] CR: Primary data saved (24113 records). [2025-10-08T18:12:32.952540] [INFO ] [MAIN ] CR: Full history saved. [2025-10-08T18:12:32.952625] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CR took 29.9s. Estimated remaining: 4h 14m 52s. Rate: 7.2 symbols/min [2025-10-08T18:12:33.120212] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:33.120394] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-08T18:12:33.120448] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-08T18:12:33.120558] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-08T18:12:33.120599] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-08T18:12:33.120659] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-08T18:12:33.120716] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-08T18:12:33.490996] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:33.617540] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-08T18:12:33.676248] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:12:33.813590] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:12:33.813946] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-08T18:12:33.814035] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:12:33.814083] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-08T18:12:33.814161] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:12:33.814233] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-08T18:12:33.814297] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-08T18:12:33.814331] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-08T18:12:33.814371] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-08T18:12:33.814418] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRCL took 0.9s. Estimated remaining: 4h 14m 18s. Rate: 7.3 symbols/min [2025-10-08T18:12:33.998005] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:34.048774] [DEBUG] [LOCAL ] CRGY: Loaded 52498 existing records from primary storage. [2025-10-08T18:12:34.049131] [INFO ] [MAIN ] CRGY: Loaded 52498 existing records. [2025-10-08T18:12:34.238102] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:34.238358] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-08T18:12:34.238436] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-08T18:12:34.239044] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-08T18:12:34.239141] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-08T18:12:34.429572] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-08T18:12:34.645558] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:34.676377] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:12:35.217567] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-08T18:12:35.867783] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:12:36.017554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-08T18:12:36.817544] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-08T18:12:36.956507] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:12:37.591970] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T18:12:37.617501] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-08T18:12:37.646816] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:12:38.173327] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T18:12:38.417542] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-08T18:12:39.217557] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-08T18:12:40.026464] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-08T18:12:40.032578] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:12:40.817554] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-08T18:12:41.016489] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:12:41.378481] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T18:12:41.617570] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-08T18:12:42.114227] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:12:42.417576] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-08T18:12:43.217547] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-08T18:12:43.344046] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:12:43.786385] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:12:44.017628] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-08T18:12:44.817611] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-08T18:12:45.039668] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:12:45.605579] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T18:12:45.607154] [INFO ] [REMOTE ] CRBD: Full fetch complete (14028 records). [2025-10-08T18:12:45.607374] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-08T18:12:45.627943] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-08T18:12:45.851876] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:12:46.094290] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-08T18:12:46.094376] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-08T18:12:46.094816] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-08T18:12:46.094880] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-08T18:12:46.095386] [DEBUG] [LOCAL ] CRBD: Trimmed 14028 records to 9039 (keeping 200 days of data) [2025-10-08T18:12:46.150924] [DEBUG] [LOCAL ] CRBD: Primary data saved (9039 records). [2025-10-08T18:12:46.151083] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-08T18:12:46.151176] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBD took 39.3s. Estimated remaining: 4h 14m 24s. Rate: 7.2 symbols/min [2025-10-08T18:12:46.324125] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:46.379965] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-08T18:12:46.380313] [INFO ] [MAIN ] CRH: Loaded 53462 existing records. [2025-10-08T18:12:46.422729] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-08T18:12:46.570742] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:46.571025] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-08T18:12:46.571078] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-08T18:12:46.571628] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-08T18:12:46.571730] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-08T18:12:46.972126] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:47.217512] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-08T18:12:47.417137] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:12:48.017509] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-08T18:12:48.168473] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T18:12:48.172039] [INFO ] [REMOTE ] CRC: Full fetch complete (62540 records). [2025-10-08T18:12:48.172136] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-08T18:12:48.551313] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-08T18:12:48.551395] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-08T18:12:48.552124] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-08T18:12:48.552195] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-08T18:12:48.553409] [DEBUG] [LOCAL ] CRC: Trimmed 62540 records to 43809 (keeping 200 days of data) [2025-10-08T18:12:48.812454] [DEBUG] [LOCAL ] CRC: Primary data saved (43809 records). [2025-10-08T18:12:48.812584] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-08T18:12:48.812683] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 24.8s. Estimated remaining: 4h 13m 56s. Rate: 7.3 symbols/min [2025-10-08T18:12:48.848743] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-08T18:12:48.984280] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:49.016015] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:12:49.066685] [DEBUG] [LOCAL ] CRI: Loaded 49806 existing records from primary storage. [2025-10-08T18:12:49.067006] [INFO ] [MAIN ] CRI: Loaded 49806 existing records. [2025-10-08T18:12:49.247758] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:49.248180] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-08T18:12:49.248232] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-08T18:12:49.248826] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-08T18:12:49.248885] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-08T18:12:49.600353] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:49.617487] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-08T18:12:49.725483] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:12:50.417593] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-08T18:12:50.722716] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:12:50.968677] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:12:51.217571] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-08T18:12:51.732257] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:12:51.736195] [INFO ] [REMOTE ] CRBG: Full fetch complete (75761 records). [2025-10-08T18:12:51.736315] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-08T18:12:52.022746] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-08T18:12:52.133818] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-08T18:12:52.133907] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-08T18:12:52.135060] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-08T18:12:52.135124] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-08T18:12:52.136628] [DEBUG] [LOCAL ] CRBG: Trimmed 75761 records to 52448 (keeping 200 days of data) [2025-10-08T18:12:52.461150] [DEBUG] [LOCAL ] CRBG: Primary data saved (52448 records). [2025-10-08T18:12:52.461324] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-08T18:12:52.461421] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRBG took 37.0s. Estimated remaining: 4h 13m 32s. Rate: 7.3 symbols/min [2025-10-08T18:12:52.630935] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:12:52.684697] [DEBUG] [LOCAL ] CRK: Loaded 52197 existing records from primary storage. [2025-10-08T18:12:52.685227] [INFO ] [MAIN ] CRK: Loaded 52197 existing records. [2025-10-08T18:12:52.827853] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-08T18:12:52.863395] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:12:52.864739] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-08T18:12:52.864916] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-08T18:12:52.900238] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-08T18:12:52.907925] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-08T18:12:53.010190] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T18:12:53.280401] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:12:53.617532] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-08T18:12:53.796320] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T18:12:54.417628] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-08T18:12:54.544590] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T18:12:55.225063] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-08T18:12:55.228186] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T18:12:56.017523] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-08T18:12:56.177829] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:12:56.769382] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:12:56.817563] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-08T18:12:57.355050] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:12:57.617558] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-08T18:12:58.266331] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:12:58.417553] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-08T18:12:59.217547] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-08T18:12:59.616854] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:12:59.978663] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:13:00.017534] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-08T18:13:00.817522] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-08T18:13:00.940497] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:13:01.617525] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-08T18:13:01.826296] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:13:02.417563] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-08T18:13:02.789113] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T18:13:03.217562] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-08T18:13:03.290418] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:13:04.027571] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-08T18:13:04.033609] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T18:13:04.817594] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-08T18:13:04.868582] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:13:05.617509] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-08T18:13:05.798977] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:13:06.417523] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-08T18:13:06.582174] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:13:07.120533] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:13:07.217585] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-08T18:13:08.017621] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-08T18:13:08.268255] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T18:13:08.817556] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-08T18:13:09.234573] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T18:13:09.513122] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:13:09.518202] [INFO ] [REMOTE ] CRGY: Full fetch complete (75952 records). [2025-10-08T18:13:09.518486] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-08T18:13:09.618852] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-08T18:13:09.914978] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-08T18:13:09.915078] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-08T18:13:09.915989] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-08T18:13:09.916058] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-08T18:13:09.917692] [DEBUG] [LOCAL ] CRGY: Trimmed 75952 records to 52481 (keeping 200 days of data) [2025-10-08T18:13:10.252335] [DEBUG] [LOCAL ] CRGY: Primary data saved (52481 records). [2025-10-08T18:13:10.252496] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-08T18:13:10.253137] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRGY took 36.4s. Estimated remaining: 4h 13m 57s. Rate: 7.2 symbols/min [2025-10-08T18:13:10.430542] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-08T18:13:10.434397] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:10.487303] [DEBUG] [LOCAL ] CRL: Loaded 42802 existing records from primary storage. [2025-10-08T18:13:10.487619] [INFO ] [MAIN ] CRL: Loaded 42802 existing records. [2025-10-08T18:13:10.673113] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:10.673554] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-08T18:13:10.673632] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-08T18:13:10.674203] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-08T18:13:10.674266] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-08T18:13:10.813477] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:13:11.121133] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:11.155405] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:13:11.217525] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-08T18:13:12.017611] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-08T18:13:12.385341] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T18:13:12.796802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:13:12.817511] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-08T18:13:13.591916] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:13:13.617585] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-08T18:13:14.417543] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-08T18:13:14.511573] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:13:15.220479] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-08T18:13:15.225329] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:13:16.017522] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-08T18:13:16.361071] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:13:16.822941] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-08T18:13:16.854479] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:13:17.516465] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:13:17.617509] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-08T18:13:18.417568] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-08T18:13:18.588434] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:13:19.217506] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-08T18:13:19.252174] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:13:20.017564] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-08T18:13:20.078512] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:13:20.817559] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-08T18:13:21.230368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T18:13:21.617608] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-08T18:13:21.662688] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:13:22.417635] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-08T18:13:22.635223] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:13:23.217532] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-08T18:13:23.436181] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:13:23.441248] [INFO ] [REMOTE ] CRK: Full fetch complete (75623 records). [2025-10-08T18:13:23.441536] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-08T18:13:23.903145] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-08T18:13:23.903252] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-08T18:13:23.904164] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-08T18:13:23.904234] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-08T18:13:23.905968] [DEBUG] [LOCAL ] CRK: Trimmed 75623 records to 52203 (keeping 200 days of data) [2025-10-08T18:13:24.017707] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-08T18:13:24.101507] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:13:24.133945] [INFO ] [REMOTE ] CRH: Full fetch complete (76917 records). [2025-10-08T18:13:24.135752] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-08T18:13:24.137370] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:13:24.138692] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:13:24.139034] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:13:24.140506] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-08T18:13:24.142014] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-08T18:13:24.142384] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-08T18:13:24.143546] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-08T18:13:24.144233] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 38.0s. Estimated remaining: 4h 14m 8s. Rate: 7.2 symbols/min [2025-10-08T18:13:24.356293] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:24.471699] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-08T18:13:24.472743] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-08T18:13:24.625143] [DEBUG] [LOCAL ] CRK: Primary data saved (52203 records). [2025-10-08T18:13:24.638550] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-08T18:13:24.660577] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 32.2s. Estimated remaining: 4h 13m 33s. Rate: 7.3 symbols/min [2025-10-08T18:13:24.666306] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:24.710452] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-08T18:13:24.722672] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-08T18:13:24.766819] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-08T18:13:24.770772] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-08T18:13:24.943923] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:25.184235] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:13:25.263580] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:25.264324] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-08T18:13:25.278891] [DEBUG] [LOCAL ] CRS: Loaded 43173 existing records from primary storage. [2025-10-08T18:13:25.279158] [INFO ] [MAIN ] CRS: Loaded 43173 existing records. [2025-10-08T18:13:25.469959] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:25.470425] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-08T18:13:25.470522] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-08T18:13:25.471015] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-08T18:13:25.471191] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-08T18:13:25.627484] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-08T18:13:25.737484] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:13:25.892813] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:26.417551] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-08T18:13:27.217551] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-08T18:13:27.548750] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T18:13:27.586716] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T18:13:28.017519] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-08T18:13:28.235926] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:13:28.551827] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:13:28.556913] [INFO ] [REMOTE ] CRI: Full fetch complete (70829 records). [2025-10-08T18:13:28.557202] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-08T18:13:28.822851] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-08T18:13:28.956560] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-08T18:13:28.956703] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-08T18:13:28.957587] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-08T18:13:28.957687] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-08T18:13:28.959396] [DEBUG] [LOCAL ] CRI: Trimmed 70829 records to 49762 (keeping 200 days of data) [2025-10-08T18:13:29.220311] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:13:29.296817] [DEBUG] [LOCAL ] CRI: Primary data saved (49762 records). [2025-10-08T18:13:29.296956] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-08T18:13:29.297050] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRI took 40.5s. Estimated remaining: 4h 13m 12s. Rate: 7.3 symbols/min [2025-10-08T18:13:29.469855] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:29.477695] [DEBUG] [LOCAL ] CRT: Loaded 5025 existing records from primary storage. [2025-10-08T18:13:29.477923] [INFO ] [MAIN ] CRT: Loaded 5025 existing records. [2025-10-08T18:13:29.624957] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-08T18:13:29.667443] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:29.668455] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-08T18:13:29.668509] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-08T18:13:29.668784] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-08T18:13:29.668850] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-08T18:13:30.022701] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:30.417519] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-08T18:13:31.070463] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:13:31.217539] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-08T18:13:31.390533] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-08T18:13:31.478352] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T18:13:31.893925] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T18:13:32.017549] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-08T18:13:32.817601] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-08T18:13:33.617544] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-08T18:13:34.252507] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-08T18:13:34.417559] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-08T18:13:34.647129] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T18:13:34.874803] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:13:35.217563] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-08T18:13:36.017553] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-08T18:13:36.525694] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:13:36.705431] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-08T18:13:36.743891] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T18:13:36.817612] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-08T18:13:37.617582] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-08T18:13:38.417586] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-08T18:13:39.077143] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-08T18:13:39.115330] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:13:39.217554] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-08T18:13:39.757217] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:13:40.017587] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-08T18:13:40.568274] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:13:40.659387] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:13:40.663031] [INFO ] [REMOTE ] CRL: Full fetch complete (63251 records). [2025-10-08T18:13:40.663161] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-08T18:13:40.824184] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-08T18:13:41.067406] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-08T18:13:41.067507] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-08T18:13:41.068309] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-08T18:13:41.068390] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-08T18:13:41.069837] [DEBUG] [LOCAL ] CRL: Trimmed 63251 records to 42811 (keeping 200 days of data) [2025-10-08T18:13:41.334828] [DEBUG] [LOCAL ] CRL: Primary data saved (42811 records). [2025-10-08T18:13:41.334966] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-08T18:13:41.336019] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRL took 31.1s. Estimated remaining: 4h 13m 17s. Rate: 7.3 symbols/min [2025-10-08T18:13:41.504801] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:13:41.567257] [DEBUG] [LOCAL ] CSAN: Loaded 42225 existing records from primary storage. [2025-10-08T18:13:41.567632] [INFO ] [MAIN ] CSAN: Loaded 42225 existing records. [2025-10-08T18:13:41.622887] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-08T18:13:41.761790] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:13:41.762907] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:13:41.763073] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-08T18:13:41.765339] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-08T18:13:41.765594] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-08T18:13:41.765680] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-08T18:13:42.126794] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:13:42.417553] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-08T18:13:43.110438] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:13:43.217544] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-08T18:13:44.003438] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:13:44.017492] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-08T18:13:44.817542] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-08T18:13:45.486488] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:13:45.574209] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T18:13:45.617522] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-08T18:13:46.417530] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-08T18:13:46.674970] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T18:13:46.798397] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T18:13:47.027376] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:13:47.217567] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-08T18:13:48.017634] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-08T18:13:48.628051] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:13:48.817617] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-08T18:13:49.437927] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T18:13:49.617613] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-08T18:13:50.161085] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T18:13:50.417618] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-08T18:13:51.110480] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:13:51.217587] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-08T18:13:52.017558] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-08T18:13:52.692543] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T18:13:52.817956] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-08T18:13:52.817886] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:13:53.341798] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:13:53.617564] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-08T18:13:54.417563] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-08T18:13:55.217733] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-08T18:13:55.220515] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-08T18:13:55.355591] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:13:55.787248] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:13:55.952083] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T18:13:56.017624] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-08T18:13:56.817571] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-08T18:13:57.617541] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-08T18:13:58.408102] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:13:58.417578] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-08T18:13:58.521934] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-08T18:13:58.864329] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T18:13:59.217553] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-08T18:13:59.588319] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-08T18:13:59.589753] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:14:00.017582] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-08T18:14:00.749461] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:14:00.817517] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-08T18:14:01.507292] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:14:01.508250] [INFO ] [REMOTE ] CRT: Full fetch complete (7478 records). [2025-10-08T18:14:01.508323] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-08T18:14:01.509253] [FATAL] [VALIDATOR ] CRT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:14:01.509375] [FATAL] [MAIN ] CRT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:14:01.509418] [WARN ] [MAIN ] CRT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:14:01.509475] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-08T18:14:01.509588] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-08T18:14:01.509664] [INFO ] [LOCAL ] CRT: Starting deletion of derivative data. [2025-10-08T18:14:01.509900] [DEBUG] [LOCAL ] CRT: Deleted derivative data file. [2025-10-08T18:14:01.510005] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRT took 32.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-08T18:14:01.622706] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-08T18:14:01.699795] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:01.743011] [DEBUG] [LOCAL ] CSL: Loaded 31514 existing records from primary storage. [2025-10-08T18:14:01.743406] [INFO ] [MAIN ] CSL: Loaded 31514 existing records. [2025-10-08T18:14:01.985187] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:01.985497] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-08T18:14:01.985554] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-08T18:14:01.986111] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-08T18:14:01.986189] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-08T18:14:02.433408] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-08T18:14:02.441701] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:03.131027] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:14:03.135592] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-08T18:14:03.135782] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-08T18:14:03.143901] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:14:03.152841] [INFO ] [REMOTE ] CRS: Full fetch complete (62631 records). [2025-10-08T18:14:03.194331] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-08T18:14:03.220839] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-08T18:14:04.000585] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-08T18:14:04.004200] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-08T18:14:04.004044] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-08T18:14:04.006117] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-08T18:14:04.006231] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-08T18:14:04.007212] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-08T18:14:04.007299] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-08T18:14:04.007682] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-08T18:14:04.009871] [DEBUG] [LOCAL ] CRS: Trimmed 62631 records to 43154 (keeping 200 days of data) [2025-10-08T18:14:04.011192] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-08T18:14:04.068884] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-08T18:14:04.630538] [DEBUG] [LOCAL ] CRS: Primary data saved (43154 records). [2025-10-08T18:14:04.633877] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-08T18:14:04.634380] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 40.0s. Estimated remaining: 4h 13m 23s. Rate: 7.2 symbols/min [2025-10-08T18:14:04.633797] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:14:04.820604] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-08T18:14:04.890356] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:04.908978] [DEBUG] [LOCAL ] CSR: Loaded 12957 existing records from primary storage. [2025-10-08T18:14:04.910086] [INFO ] [MAIN ] CSR: Loaded 12957 existing records. [2025-10-08T18:14:05.100713] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:05.102312] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-08T18:14:05.102780] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-08T18:14:05.103708] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-08T18:14:05.104071] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-08T18:14:05.272744] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-08T18:14:05.300360] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-08T18:14:05.346195] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRM took 41.2s. Estimated remaining: 4h 12m 49s. Rate: 7.3 symbols/min [2025-10-08T18:14:05.622557] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:05.649035] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-08T18:14:05.670465] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:05.722931] [DEBUG] [LOCAL ] CSTM: Loaded 47537 existing records from primary storage. [2025-10-08T18:14:05.723258] [INFO ] [MAIN ] CSTM: Loaded 47537 existing records. [2025-10-08T18:14:05.902453] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:05.919906] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-08T18:14:05.920050] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-08T18:14:05.920769] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-08T18:14:05.921454] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:14:05.921537] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-08T18:14:06.340111] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:06.370029] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:14:06.417587] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-08T18:14:06.830401] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:14:07.217701] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-08T18:14:08.017606] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-08T18:14:08.063679] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T18:14:08.093905] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:14:08.817615] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-08T18:14:09.169152] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:14:09.617607] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-08T18:14:10.113194] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:14:10.417739] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-08T18:14:10.879192] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:14:11.217689] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-08T18:14:11.449144] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T18:14:11.452216] [INFO ] [REMOTE ] CSAN: Full fetch complete (60427 records). [2025-10-08T18:14:11.452336] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-08T18:14:11.832018] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-08T18:14:11.832098] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-08T18:14:11.832798] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-08T18:14:11.832862] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-08T18:14:11.834155] [DEBUG] [LOCAL ] CSAN: Trimmed 60427 records to 42145 (keeping 200 days of data) [2025-10-08T18:14:12.031492] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-08T18:14:12.079693] [DEBUG] [LOCAL ] CSAN: Primary data saved (42145 records). [2025-10-08T18:14:12.079824] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-08T18:14:12.080626] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 30.7s. Estimated remaining: 4h 12m 35s. Rate: 7.3 symbols/min [2025-10-08T18:14:12.256197] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:12.274485] [DEBUG] [LOCAL ] CSV: Loaded 12795 existing records from primary storage. [2025-10-08T18:14:12.274834] [INFO ] [MAIN ] CSV: Loaded 12795 existing records. [2025-10-08T18:14:12.468118] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:12.468577] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-08T18:14:12.468672] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-08T18:14:12.468906] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-08T18:14:12.468968] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-08T18:14:12.838051] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-08T18:14:13.033003] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T18:14:13.108189] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:13.196806] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:14:13.409893] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:14:13.617607] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-08T18:14:14.220385] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:14:14.417611] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-08T18:14:15.217563] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-08T18:14:16.017601] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-08T18:14:16.072189] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:14:16.823564] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-08T18:14:16.851790] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:14:16.867821] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:14:17.617574] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-08T18:14:18.167365] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T18:14:18.417526] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-08T18:14:18.560568] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:14:19.217574] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-08T18:14:19.964067] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:14:20.017542] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-08T18:14:20.079768] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:14:20.708067] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T18:14:20.817544] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-08T18:14:21.507066] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:14:21.617568] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-08T18:14:22.315559] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:14:22.417565] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-08T18:14:23.217555] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-08T18:14:23.646872] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:14:24.017586] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-08T18:14:24.183582] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T18:14:24.817558] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-08T18:14:25.619395] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-08T18:14:25.626485] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:14:25.653273] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T18:14:26.417528] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-08T18:14:26.428888] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T18:14:27.217594] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-08T18:14:27.621500] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:14:28.017595] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-08T18:14:28.627701] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T18:14:28.657296] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:14:28.817546] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-08T18:14:29.617548] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-08T18:14:29.816467] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T18:14:30.417560] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-08T18:14:30.750082] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T18:14:31.217564] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-08T18:14:32.017547] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-08T18:14:32.222873] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:14:32.718318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:14:32.817595] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-08T18:14:32.912275] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:14:33.617570] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-08T18:14:34.070477] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T18:14:34.073538] [INFO ] [REMOTE ] CSL: Full fetch complete (45333 records). [2025-10-08T18:14:34.073663] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-08T18:14:34.425178] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-08T18:14:34.470562] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-08T18:14:34.470684] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-08T18:14:34.471322] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-08T18:14:34.471368] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-08T18:14:34.474255] [DEBUG] [LOCAL ] CSL: Trimmed 45333 records to 31443 (keeping 200 days of data) [2025-10-08T18:14:34.667275] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T18:14:34.695774] [DEBUG] [LOCAL ] CSL: Primary data saved (31443 records). [2025-10-08T18:14:34.695984] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-08T18:14:34.696105] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSL took 33.2s. Estimated remaining: 4h 13m 16s. Rate: 7.2 symbols/min [2025-10-08T18:14:34.906311] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:34.906582] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-08T18:14:34.906634] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-08T18:14:34.906789] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-08T18:14:34.906831] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-08T18:14:34.906871] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-08T18:14:34.906903] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-08T18:14:35.222829] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-08T18:14:35.292318] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:35.943543] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:14:35.965988] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:14:36.017518] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-08T18:14:36.817554] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-08T18:14:37.158592] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:37.159133] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-08T18:14:37.159256] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:37.159305] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-08T18:14:37.159341] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:37.159412] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-08T18:14:37.159516] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-08T18:14:37.159574] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-08T18:14:37.159636] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-08T18:14:37.159741] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSW took 2.5s. Estimated remaining: 4h 12m 48s. Rate: 7.2 symbols/min [2025-10-08T18:14:37.347802] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:37.380505] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T18:14:37.398009] [DEBUG] [LOCAL ] CTBB: Loaded 7035 existing records from primary storage. [2025-10-08T18:14:37.398360] [INFO ] [MAIN ] CTBB: Loaded 7035 existing records. [2025-10-08T18:14:37.590515] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:37.590807] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-08T18:14:37.590859] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-08T18:14:37.591254] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-08T18:14:37.591546] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-08T18:14:37.623604] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-08T18:14:37.976284] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:38.417615] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-08T18:14:39.154302] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:14:39.158180] [INFO ] [REMOTE ] CSTM: Full fetch complete (69358 records). [2025-10-08T18:14:39.158383] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-08T18:14:39.221896] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-08T18:14:39.339892] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:14:39.583955] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-08T18:14:39.584047] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-08T18:14:39.584916] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-08T18:14:39.584982] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-08T18:14:39.586407] [DEBUG] [LOCAL ] CSTM: Trimmed 69358 records to 47541 (keeping 200 days of data) [2025-10-08T18:14:39.866245] [DEBUG] [LOCAL ] CSTM: Primary data saved (47541 records). [2025-10-08T18:14:39.866355] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-08T18:14:39.866443] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSTM took 34.5s. Estimated remaining: 4h 12m 21s. Rate: 7.3 symbols/min [2025-10-08T18:14:40.036404] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-08T18:14:40.039913] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:40.049095] [DEBUG] [LOCAL ] CTDD: Loaded 5824 existing records from primary storage. [2025-10-08T18:14:40.049303] [INFO ] [MAIN ] CTDD: Loaded 5824 existing records. [2025-10-08T18:14:40.227191] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:40.227455] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-08T18:14:40.227517] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-08T18:14:40.227717] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-08T18:14:40.227773] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-08T18:14:40.409718] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T18:14:40.593497] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:40.817538] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-08T18:14:41.096183] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T18:14:41.097875] [INFO ] [REMOTE ] CSR: Full fetch complete (17756 records). [2025-10-08T18:14:41.097957] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-08T18:14:41.428452] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T18:14:41.563347] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-08T18:14:41.563455] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-08T18:14:41.563994] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-08T18:14:41.564059] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-08T18:14:41.564845] [DEBUG] [LOCAL ] CSR: Trimmed 17756 records to 12972 (keeping 200 days of data) [2025-10-08T18:14:41.628597] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-08T18:14:41.656703] [DEBUG] [LOCAL ] CSR: Primary data saved (12972 records). [2025-10-08T18:14:41.656854] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-08T18:14:41.656993] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSR took 37.0s. Estimated remaining: 4h 11m 51s. Rate: 7.3 symbols/min [2025-10-08T18:14:41.855141] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:41.855348] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-08T18:14:41.855403] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-08T18:14:41.855513] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-08T18:14:41.855554] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-08T18:14:41.855639] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-08T18:14:41.855717] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-08T18:14:42.148593] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T18:14:42.218975] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:42.417495] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-08T18:14:42.731287] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:42.731621] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-08T18:14:42.731731] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:42.731783] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-08T18:14:42.731844] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:42.731916] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-08T18:14:42.731979] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-08T18:14:42.732016] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-08T18:14:42.732056] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-08T18:14:42.732105] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTEST took 1.1s. Estimated remaining: 4h 11m 18s. Rate: 7.3 symbols/min [2025-10-08T18:14:42.901873] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:42.902001] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-08T18:14:42.902038] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-08T18:14:42.902147] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-08T18:14:42.902186] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-08T18:14:42.902227] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-08T18:14:42.902258] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-08T18:14:43.224966] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-08T18:14:43.256717] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:43.847345] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T18:14:44.017566] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-08T18:14:44.817559] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-08T18:14:44.922525] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T18:14:45.265938] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:14:45.617606] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-08T18:14:46.227539] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T18:14:46.417564] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-08T18:14:47.217554] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-08T18:14:47.301077] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T18:14:47.302519] [INFO ] [REMOTE ] CSV: Full fetch complete (19371 records). [2025-10-08T18:14:47.302590] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-08T18:14:47.425397] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:14:47.465701] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-08T18:14:47.466801] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:14:47.494872] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-08T18:14:47.553533] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:14:47.606488] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-08T18:14:47.622843] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-08T18:14:47.658477] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-08T18:14:47.689016] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-08T18:14:47.697355] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-08T18:14:47.697553] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-08T18:14:47.697496] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEV took 5.0s. Estimated remaining: 4h 10m 59s. Rate: 7.3 symbols/min [2025-10-08T18:14:47.698025] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-08T18:14:47.698101] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-08T18:14:47.704348] [DEBUG] [LOCAL ] CSV: Trimmed 19371 records to 12748 (keeping 200 days of data) [2025-10-08T18:14:47.957095] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:47.986434] [DEBUG] [LOCAL ] CSV: Primary data saved (12748 records). [2025-10-08T18:14:47.995477] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-08T18:14:47.995676] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSV took 35.9s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-08T18:14:48.001929] [DEBUG] [LOCAL ] CTO: Loaded 27731 existing records from primary storage. [2025-10-08T18:14:48.025996] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-08T18:14:48.031910] [INFO ] [MAIN ] CTO: Loaded 27731 existing records. [2025-10-08T18:14:48.349341] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:14:48.383566] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:48.383893] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-08T18:14:48.383942] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-08T18:14:48.384189] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-08T18:14:48.384248] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-08T18:14:48.699702] [DEBUG] [LOCAL ] CTOS: Loaded 36691 existing records from primary storage. [2025-10-08T18:14:48.704135] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:14:48.712852] [INFO ] [MAIN ] CTOS: Loaded 36691 existing records. [2025-10-08T18:14:48.827784] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-08T18:14:48.879089] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:48.973005] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:14:48.973270] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-08T18:14:48.973323] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-08T18:14:48.973628] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-08T18:14:48.973711] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-08T18:14:49.342101] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:14:49.617559] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-08T18:14:49.637416] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T18:14:50.417593] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-08T18:14:51.132125] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:14:51.217563] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-08T18:14:52.017562] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-08T18:14:52.042954] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:14:52.350430] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:14:52.700617] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:14:52.817580] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-08T18:14:53.617600] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-08T18:14:54.073207] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:14:54.317375] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:14:54.417566] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-08T18:14:55.153793] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:14:55.217517] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-08T18:14:56.017580] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-08T18:14:56.615760] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:14:56.657522] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:14:56.817551] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-08T18:14:57.442377] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T18:14:57.617579] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-08T18:14:58.225028] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:14:58.417617] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-08T18:14:59.217542] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-08T18:14:59.831021] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T18:14:59.922345] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:15:00.017595] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-08T18:15:00.817591] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-08T18:15:01.543037] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:15:01.617586] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-08T18:15:01.874767] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T18:15:02.417619] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-08T18:15:03.033373] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T18:15:03.094820] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T18:15:03.096020] [INFO ] [REMOTE ] CTDD: Full fetch complete (8322 records). [2025-10-08T18:15:03.096098] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-08T18:15:03.217849] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-08T18:15:03.534121] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-08T18:15:03.534502] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-08T18:15:03.535046] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-08T18:15:03.535124] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-08T18:15:03.535683] [DEBUG] [LOCAL ] CTDD: Trimmed 8322 records to 5820 (keeping 200 days of data) [2025-10-08T18:15:03.573817] [DEBUG] [LOCAL ] CTDD: Primary data saved (5820 records). [2025-10-08T18:15:03.573977] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-08T18:15:03.574079] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTDD took 23.7s. Estimated remaining: 4h 10m 40s. Rate: 7.3 symbols/min [2025-10-08T18:15:03.751847] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:03.807554] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-08T18:15:03.807995] [INFO ] [MAIN ] CTRA: Loaded 53646 existing records. [2025-10-08T18:15:03.989819] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:03.990115] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-08T18:15:03.990162] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-08T18:15:03.990794] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-08T18:15:03.990854] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-08T18:15:04.022736] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-08T18:15:04.405507] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:04.708459] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:15:04.723694] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T18:15:04.817712] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-08T18:15:05.617720] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-08T18:15:06.140090] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:15:06.417574] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-08T18:15:07.217605] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-08T18:15:07.652144] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:15:07.914971] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T18:15:07.917787] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-08T18:15:08.017566] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-08T18:15:08.817584] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-08T18:15:09.617583] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-08T18:15:09.988938] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T18:15:10.089882] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:15:10.409598] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:15:10.417490] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-08T18:15:11.145028] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:15:11.217580] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-08T18:15:12.017636] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-08T18:15:12.309327] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T18:15:12.817589] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-08T18:15:13.518963] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:15:13.520257] [INFO ] [REMOTE ] CTBB: Full fetch complete (10602 records). [2025-10-08T18:15:13.520379] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-08T18:15:13.626140] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-08T18:15:13.757364] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:15:13.952021] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-08T18:15:13.952109] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-08T18:15:13.952406] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-08T18:15:13.952446] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-08T18:15:13.952925] [DEBUG] [LOCAL ] CTBB: Trimmed 10602 records to 7044 (keeping 200 days of data) [2025-10-08T18:15:13.997850] [DEBUG] [LOCAL ] CTBB: Primary data saved (7044 records). [2025-10-08T18:15:13.998004] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-08T18:15:13.998097] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTBB took 36.8s. Estimated remaining: 4h 10m 39s. Rate: 7.3 symbols/min [2025-10-08T18:15:14.171578] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:14.220452] [DEBUG] [LOCAL ] CTRE: Loaded 49274 existing records from primary storage. [2025-10-08T18:15:14.220882] [INFO ] [MAIN ] CTRE: Loaded 49274 existing records. [2025-10-08T18:15:14.406268] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:14.406516] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-08T18:15:14.406566] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-08T18:15:14.406912] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-08T18:15:14.406973] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-08T18:15:14.422771] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-08T18:15:14.781221] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:14.960408] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:15:15.217579] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-08T18:15:16.017688] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-08T18:15:16.306307] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:15:16.379822] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:15:16.817512] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-08T18:15:16.848087] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:15:17.617571] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-08T18:15:18.417602] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-08T18:15:18.747416] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:15:18.750738] [INFO ] [REMOTE ] CTOS: Full fetch complete (53362 records). [2025-10-08T18:15:18.750900] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-08T18:15:18.751814] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:15:18.751939] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:15:18.751985] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:15:18.752034] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-08T18:15:18.752135] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-08T18:15:18.752189] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-08T18:15:18.752474] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-08T18:15:18.752602] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTOS took 30.8s. Estimated remaining: 4h 10m 20s. Rate: 7.3 symbols/min [2025-10-08T18:15:18.948126] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:19.021206] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T18:15:19.048902] [DEBUG] [LOCAL ] CTRI: Loaded 39307 existing records from primary storage. [2025-10-08T18:15:19.049310] [INFO ] [MAIN ] CTRI: Loaded 39307 existing records. [2025-10-08T18:15:19.221113] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-08T18:15:19.257693] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:19.258045] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-08T18:15:19.258105] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-08T18:15:19.258507] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-08T18:15:19.258759] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-08T18:15:19.660285] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:20.017608] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-08T18:15:20.399207] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:15:20.726703] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T18:15:20.817583] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-08T18:15:20.951828] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T18:15:21.617562] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-08T18:15:22.417538] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-08T18:15:22.474203] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:15:23.190718] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:15:23.217519] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-08T18:15:23.259211] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T18:15:24.017577] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-08T18:15:24.817605] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-08T18:15:24.940541] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:15:24.987912] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T18:15:25.617550] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-08T18:15:26.417549] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-08T18:15:26.865696] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T18:15:27.217616] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-08T18:15:27.658825] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T18:15:27.690983] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:15:28.017619] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-08T18:15:28.561876] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T18:15:28.817550] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-08T18:15:29.617509] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-08T18:15:29.885811] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:15:30.102776] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:15:30.105715] [INFO ] [REMOTE ] CTO: Full fetch complete (41740 records). [2025-10-08T18:15:30.105827] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-08T18:15:30.429473] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-08T18:15:30.484039] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-08T18:15:30.484336] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-08T18:15:30.484949] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-08T18:15:30.485013] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-08T18:15:30.486148] [DEBUG] [LOCAL ] CTO: Trimmed 41740 records to 27825 (keeping 200 days of data) [2025-10-08T18:15:30.613814] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T18:15:30.681808] [DEBUG] [LOCAL ] CTO: Primary data saved (27825 records). [2025-10-08T18:15:30.681955] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-08T18:15:30.682044] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTO took 43.0s. Estimated remaining: 4h 10m 24s. Rate: 7.3 symbols/min [2025-10-08T18:15:30.854436] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:30.875115] [DEBUG] [LOCAL ] CTS: Loaded 19410 existing records from primary storage. [2025-10-08T18:15:30.875395] [INFO ] [MAIN ] CTS: Loaded 19410 existing records. [2025-10-08T18:15:31.056544] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:15:31.056819] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-08T18:15:31.056872] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-08T18:15:31.057133] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-08T18:15:31.057193] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-08T18:15:31.221105] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-08T18:15:31.430068] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:32.017510] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-08T18:15:32.433147] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T18:15:32.817568] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-08T18:15:33.012734] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:15:33.299194] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T18:15:33.617574] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-08T18:15:33.954782] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T18:15:34.417529] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-08T18:15:34.547198] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:15:35.217568] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-08T18:15:35.894337] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:15:36.017570] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-08T18:15:36.817565] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-08T18:15:37.080918] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T18:15:37.622735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-08T18:15:37.648595] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:15:37.659554] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:15:38.417593] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-08T18:15:39.069792] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:15:39.217568] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-08T18:15:40.017519] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-08T18:15:40.285409] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T18:15:40.293190] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-08T18:15:40.293381] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-08T18:15:40.699011] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-08T18:15:40.699286] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-08T18:15:40.700243] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-08T18:15:40.700552] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-08T18:15:40.730848] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:15:40.740093] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 53646 (keeping 200 days of data) [2025-10-08T18:15:40.816491] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:15:40.821104] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-08T18:15:41.104456] [DEBUG] [LOCAL ] CTRA: Primary data saved (53646 records). [2025-10-08T18:15:41.104673] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-08T18:15:41.104797] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 37.5s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-08T18:15:41.272761] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:41.272950] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-08T18:15:41.272987] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-08T18:15:41.273099] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-08T18:15:41.273141] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-08T18:15:41.273182] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-08T18:15:41.273215] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-08T18:15:41.620950] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-08T18:15:41.624574] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:42.422764] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-08T18:15:42.445905] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T18:15:43.217574] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-08T18:15:43.553058] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T18:15:43.765793] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:15:44.017546] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-08T18:15:44.615748] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:15:44.817579] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-08T18:15:45.561962] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:15:45.617497] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-08T18:15:46.311408] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:15:46.315599] [INFO ] [REMOTE ] CTRI: Full fetch complete (52513 records). [2025-10-08T18:15:46.315785] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-08T18:15:46.423099] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-08T18:15:46.712815] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-08T18:15:46.712925] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-08T18:15:46.713581] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-08T18:15:46.713631] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-08T18:15:46.714999] [DEBUG] [LOCAL ] CTRI: Trimmed 52513 records to 39419 (keeping 200 days of data) [2025-10-08T18:15:46.988817] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:15:47.006253] [DEBUG] [LOCAL ] CTRI: Primary data saved (39419 records). [2025-10-08T18:15:47.006436] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-08T18:15:47.007412] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRI took 28.3s. Estimated remaining: 4h 10m 7s. Rate: 7.3 symbols/min [2025-10-08T18:15:47.179241] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:15:47.179442] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-08T18:15:47.179479] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-08T18:15:47.179599] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-08T18:15:47.179638] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-08T18:15:47.179728] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-08T18:15:47.179779] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-08T18:15:47.223022] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-08T18:15:47.538370] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:15:48.017542] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-08T18:15:48.066707] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:15:48.123463] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T18:15:48.817551] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-08T18:15:49.617557] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-08T18:15:49.759813] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:15:50.417523] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-08T18:15:50.539772] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:15:50.560338] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T18:15:51.217571] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-08T18:15:51.937539] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:15:52.017533] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-08T18:15:52.406456] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:15:52.817572] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-08T18:15:53.617536] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-08T18:15:53.781098] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T18:15:54.112604] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T18:15:54.241212] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T18:15:54.417570] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-08T18:15:54.753120] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T18:15:55.217573] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-08T18:15:56.017582] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-08T18:15:56.345435] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T18:15:56.817582] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-08T18:15:57.617639] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-08T18:15:57.748972] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T18:15:58.417523] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-08T18:15:58.533223] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:15:58.788151] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:15:59.217577] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-08T18:16:00.010080] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:16:00.015159] [INFO ] [REMOTE ] CTRE: Full fetch complete (71183 records). [2025-10-08T18:16:00.015532] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-08T18:16:00.017591] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-08T18:16:00.438903] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T18:16:00.470683] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:16:00.471065] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-08T18:16:00.472152] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-08T18:16:00.473343] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-08T18:16:00.473416] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-08T18:16:00.475402] [DEBUG] [LOCAL ] CTRE: Trimmed 71183 records to 49289 (keeping 200 days of data) [2025-10-08T18:16:00.769721] [DEBUG] [LOCAL ] CTRE: Primary data saved (49289 records). [2025-10-08T18:16:00.769856] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-08T18:16:00.769961] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRE took 46.8s. Estimated remaining: 4h 10m 16s. Rate: 7.3 symbols/min [2025-10-08T18:16:00.822785] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-08T18:16:00.940117] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:00.992202] [DEBUG] [LOCAL ] CUBE: Loaded 50776 existing records from primary storage. [2025-10-08T18:16:00.992543] [INFO ] [MAIN ] CUBE: Loaded 50776 existing records. [2025-10-08T18:16:01.172148] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:01.172395] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-08T18:16:01.172455] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-08T18:16:01.172915] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-08T18:16:01.172977] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-08T18:16:01.521774] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:01.617501] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-08T18:16:01.746741] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T18:16:01.748605] [INFO ] [REMOTE ] CTS: Full fetch complete (26666 records). [2025-10-08T18:16:01.748732] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-08T18:16:01.749299] [FATAL] [VALIDATOR ] CTS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:16:01.749396] [FATAL] [MAIN ] CTS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:01.749550] [WARN ] [MAIN ] CTS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:01.749630] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-08T18:16:01.749748] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-08T18:16:01.749806] [INFO ] [LOCAL ] CTS: Starting deletion of derivative data. [2025-10-08T18:16:01.750035] [DEBUG] [LOCAL ] CTS: Deleted derivative data file. [2025-10-08T18:16:01.750141] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 31.1s. Estimated remaining: 4h 9m 44s. Rate: 7.3 symbols/min [2025-10-08T18:16:01.977370] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:02.006489] [DEBUG] [LOCAL ] CUBI: Loaded 27078 existing records from primary storage. [2025-10-08T18:16:02.006902] [INFO ] [MAIN ] CUBI: Loaded 27078 existing records. [2025-10-08T18:16:02.241885] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:02.242160] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-08T18:16:02.242220] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-08T18:16:02.242491] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-08T18:16:02.242558] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-08T18:16:02.429325] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-08T18:16:02.657084] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:03.217623] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-08T18:16:03.357076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:16:04.017530] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-08T18:16:04.144871] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T18:16:04.327489] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:16:04.817595] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-08T18:16:05.241200] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T18:16:05.534667] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:16:05.617606] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-08T18:16:06.417630] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-08T18:16:07.217557] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-08T18:16:07.359372] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:16:07.557020] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:16:07.700612] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:16:08.017545] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-08T18:16:08.817622] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-08T18:16:09.599968] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:16:09.617491] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-08T18:16:09.635314] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T18:16:10.417552] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-08T18:16:10.687663] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T18:16:11.107689] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:16:11.217535] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-08T18:16:12.017558] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-08T18:16:12.817535] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-08T18:16:13.097700] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:16:13.581637] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T18:16:13.617502] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-08T18:16:13.635363] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T18:16:14.417551] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-08T18:16:14.696158] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T18:16:15.217628] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-08T18:16:15.402666] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:16:16.017601] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-08T18:16:16.755615] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:16:16.817541] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-08T18:16:17.617617] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-08T18:16:17.902613] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T18:16:17.975580] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:16:18.417586] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-08T18:16:18.603224] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:16:19.217574] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-08T18:16:20.017633] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-08T18:16:20.046805] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:16:20.050862] [INFO ] [REMOTE ] CTVA: Full fetch complete (76607 records). [2025-10-08T18:16:20.051042] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-08T18:16:20.052105] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:16:20.052207] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:20.052254] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:20.052325] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-08T18:16:20.052410] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-08T18:16:20.052468] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-08T18:16:20.052530] [DEBUG] [LOCAL ] CTVA: No derivative data file found to delete. [2025-10-08T18:16:20.052637] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 38.9s. Estimated remaining: 4h 10m 9s. Rate: 7.3 symbols/min [2025-10-08T18:16:20.243749] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:20.296740] [DEBUG] [LOCAL ] CUK: Loaded 50976 existing records from primary storage. [2025-10-08T18:16:20.297134] [INFO ] [MAIN ] CUK: Loaded 50976 existing records. [2025-10-08T18:16:20.515663] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:20.516040] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-08T18:16:20.516101] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-08T18:16:20.516781] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-08T18:16:20.516876] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-08T18:16:20.818678] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-08T18:16:20.892674] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:20.925264] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:16:21.079597] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T18:16:21.248487] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T18:16:21.617559] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-08T18:16:22.417578] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-08T18:16:22.486617] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:16:22.808286] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T18:16:22.809079] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-10-08T18:16:22.809154] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-08T18:16:23.024447] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-08T18:16:23.024736] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:16:23.024798] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:16:23.024842] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-08T18:16:23.024911] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-08T18:16:23.024970] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-08T18:16:23.025015] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-08T18:16:23.025072] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBB took 36.0s. Estimated remaining: 4h 9m 43s. Rate: 7.3 symbols/min [2025-10-08T18:16:23.207159] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:23.214952] [DEBUG] [LOCAL ] CULP: Loaded 2898 existing records from primary storage. [2025-10-08T18:16:23.215190] [INFO ] [MAIN ] CULP: Loaded 2898 existing records. [2025-10-08T18:16:23.226055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-08T18:16:23.401026] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:23.401254] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-08T18:16:23.401302] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-08T18:16:23.401513] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-08T18:16:23.401573] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-08T18:16:23.762744] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:24.017603] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-08T18:16:24.629257] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:16:24.817591] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-08T18:16:25.592298] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T18:16:25.617493] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-08T18:16:25.883437] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:16:26.190426] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:16:26.417609] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-08T18:16:27.217564] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-08T18:16:27.592986] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T18:16:27.859969] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:16:28.017553] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-08T18:16:28.817613] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-08T18:16:29.617576] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-08T18:16:29.898169] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:16:30.098352] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:16:30.417557] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-08T18:16:31.217530] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-08T18:16:31.277465] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:16:31.673249] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:16:31.896922] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:16:32.017602] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-08T18:16:32.498294] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T18:16:32.817613] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-08T18:16:33.617623] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-08T18:16:34.417519] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-08T18:16:34.857538] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-08T18:16:34.877076] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:16:34.880155] [INFO ] [REMOTE ] CUBI: Full fetch complete (39093 records). [2025-10-08T18:16:34.880268] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-08T18:16:35.222811] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-08T18:16:35.295832] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-08T18:16:35.296128] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-08T18:16:35.296824] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-08T18:16:35.296920] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-08T18:16:35.298111] [DEBUG] [LOCAL ] CUBI: Trimmed 39093 records to 26977 (keeping 200 days of data) [2025-10-08T18:16:35.455838] [DEBUG] [LOCAL ] CUBI: Primary data saved (26977 records). [2025-10-08T18:16:35.455989] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-08T18:16:35.456075] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBI took 33.7s. Estimated remaining: 4h 9m 49s. Rate: 7.3 symbols/min [2025-10-08T18:16:35.631127] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:35.664216] [DEBUG] [LOCAL ] CURB: Loaded 32683 existing records from primary storage. [2025-10-08T18:16:35.664519] [INFO ] [MAIN ] CURB: Loaded 32683 existing records. [2025-10-08T18:16:35.845903] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:35.846609] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-08T18:16:35.846723] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-08T18:16:35.847520] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-08T18:16:35.847679] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-08T18:16:36.042366] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:16:36.038607] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-08T18:16:36.311151] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:36.641498] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:16:36.817578] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-08T18:16:37.312107] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T18:16:37.353089] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T18:16:37.617710] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-08T18:16:38.135871] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:16:38.417589] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-08T18:16:39.217613] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-08T18:16:39.621880] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T18:16:39.891165] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:16:40.017580] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-08T18:16:40.817520] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-08T18:16:41.617552] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-08T18:16:41.922357] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T18:16:41.926722] [INFO ] [REMOTE ] CUBE: Full fetch complete (73068 records). [2025-10-08T18:16:41.926851] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-08T18:16:42.259286] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:16:42.358124] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-08T18:16:42.358204] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-08T18:16:42.359010] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-08T18:16:42.359075] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-08T18:16:42.360556] [DEBUG] [LOCAL ] CUBE: Trimmed 73068 records to 50778 (keeping 200 days of data) [2025-10-08T18:16:42.422054] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-08T18:16:42.675275] [DEBUG] [LOCAL ] CUBE: Primary data saved (50778 records). [2025-10-08T18:16:42.675417] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-08T18:16:42.675503] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBE took 41.9s. Estimated remaining: 4h 9m 37s. Rate: 7.3 symbols/min [2025-10-08T18:16:43.217523] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-08T18:16:43.435616] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T18:16:43.757604] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:16:43.845113] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:16:44.017582] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-08T18:16:44.817592] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-08T18:16:45.617529] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-08T18:16:45.962393] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:16:46.072691] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:16:46.083225] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T18:16:46.083978] [INFO ] [REMOTE ] CULP: Full fetch complete (4618 records). [2025-10-08T18:16:46.084048] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-08T18:16:46.419872] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-08T18:16:46.447334] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-08T18:16:46.447425] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-08T18:16:46.447590] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-08T18:16:46.447630] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-08T18:16:46.448137] [DEBUG] [LOCAL ] CULP: Trimmed 4618 records to 2885 (keeping 200 days of data) [2025-10-08T18:16:46.467025] [DEBUG] [LOCAL ] CULP: Primary data saved (2885 records). [2025-10-08T18:16:46.467171] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-08T18:16:46.467264] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CULP took 23.4s. Estimated remaining: 4h 9m 14s. Rate: 7.3 symbols/min [2025-10-08T18:16:47.217587] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-08T18:16:48.399770] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T18:16:48.412711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-08T18:16:48.819944] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:16:48.828230] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-08T18:16:50.139200] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:16:50.161591] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-08T18:16:50.181326] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T18:16:50.417616] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-08T18:16:51.746149] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:16:51.756893] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-08T18:16:51.824286] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:16:52.017563] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-08T18:16:53.204116] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:16:53.211588] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-08T18:16:53.419084] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:16:53.423400] [INFO ] [REMOTE ] CUK: Full fetch complete (74073 records). [2025-10-08T18:16:53.423562] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-08T18:16:53.847519] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-08T18:16:53.847610] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-08T18:16:53.848543] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-08T18:16:53.848612] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-08T18:16:53.850122] [DEBUG] [LOCAL ] CUK: Trimmed 74073 records to 50970 (keeping 200 days of data) [2025-10-08T18:16:54.166171] [DEBUG] [LOCAL ] CUK: Primary data saved (50970 records). [2025-10-08T18:16:54.166318] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-08T18:16:54.166404] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CUK took 34.1s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-08T18:16:54.570217] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T18:16:54.578095] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-08T18:16:55.966871] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:16:55.974958] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-08T18:16:57.287507] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:16:57.290624] [INFO ] [REMOTE ] CURB: Full fetch complete (47293 records). [2025-10-08T18:16:57.290808] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-08T18:16:57.674203] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-08T18:16:57.674412] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-08T18:16:57.675046] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-08T18:16:57.675107] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-08T18:16:57.676162] [DEBUG] [LOCAL ] CURB: Trimmed 47293 records to 32646 (keeping 200 days of data) [2025-10-08T18:16:57.875187] [DEBUG] [LOCAL ] CURB: Primary data saved (32646 records). [2025-10-08T18:16:57.875338] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-08T18:16:57.875424] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURB took 22.4s. Estimated remaining: 4h 8m 41s. Rate: 7.3 symbols/min [2025-10-08T18:16:58.567324] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.591754] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.554784] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.618337] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:16:58.618906] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-08T18:16:58.619377] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-08T18:16:58.619479] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-08T18:16:58.619522] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-08T18:16:58.619563] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-08T18:16:58.619594] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-08T18:16:58.733699] [DEBUG] [LOCAL ] CVEO: Loaded 15232 existing records from primary storage. [2025-10-08T18:16:58.745266] [INFO ] [MAIN ] CVEO: Loaded 15232 existing records. [2025-10-08T18:16:59.154835] [DEBUG] [LOCAL ] CUZ: Loaded 49405 existing records from primary storage. [2025-10-08T18:16:59.155841] [DEBUG] [LOCAL ] CVE: Loaded 53559 existing records from primary storage. [2025-10-08T18:16:59.196082] [INFO ] [MAIN ] CUZ: Loaded 49405 existing records. [2025-10-08T18:16:59.264784] [INFO ] [MAIN ] CVE: Loaded 53559 existing records. [2025-10-08T18:16:59.248601] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.316414] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.389239] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-08T18:16:59.479778] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-08T18:16:59.530533] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:16:59.531109] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-08T18:16:59.530820] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-08T18:16:59.733809] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.776287] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.767443] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:16:59.787888] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-08T18:16:59.788087] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-08T18:16:59.793312] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-08T18:16:59.804220] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-08T18:16:59.814510] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-08T18:16:59.814455] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-08T18:16:59.814723] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-08T18:17:00.602334] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.640326] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-08T18:17:00.840190] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.844506] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:00.844809] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-08T18:17:00.845862] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-08T18:17:01.190013] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:17:01.203325] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-08T18:17:01.871865] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T18:17:01.874615] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-08T18:17:02.257209] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:17:02.267139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-08T18:17:02.396614] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:17:02.402846] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-08T18:17:02.782239] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:17:02.785463] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-08T18:17:02.815482] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:17:02.826906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-08T18:17:03.102635] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T18:17:03.217523] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-08T18:17:03.427022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:17:03.446035] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T18:17:04.017497] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-08T18:17:04.334014] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:17:04.359412] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:17:04.716430] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:17:04.817522] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-08T18:17:05.524691] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T18:17:05.617571] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-08T18:17:06.417567] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-08T18:17:06.741048] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T18:17:07.217520] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-08T18:17:07.544354] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:17:07.841357] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T18:17:08.017556] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-08T18:17:08.817583] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-08T18:17:09.617530] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-08T18:17:09.807952] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T18:17:10.387619] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T18:17:10.417855] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-08T18:17:10.421323] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T18:17:11.217581] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-08T18:17:11.450332] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T18:17:12.017556] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-08T18:17:12.817570] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-08T18:17:13.159288] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T18:17:13.476965] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:17:13.617557] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-08T18:17:14.417503] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-08T18:17:14.576320] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:17:14.714700] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:17:15.217627] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-08T18:17:15.732826] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:17:15.773515] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T18:17:16.017598] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-08T18:17:16.817558] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-08T18:17:17.429258] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:17:17.617546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-08T18:17:18.354041] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:17:18.417494] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-08T18:17:19.110939] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:17:19.217548] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-08T18:17:20.017546] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-08T18:17:20.292504] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:20.542981] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:17:20.545793] [INFO ] [REMOTE ] CURV: Full fetch complete (38860 records). [2025-10-08T18:17:20.545887] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-08T18:17:20.823435] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-08T18:17:20.943188] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-08T18:17:20.943269] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-08T18:17:20.943891] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-08T18:17:20.943955] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-08T18:17:20.944846] [DEBUG] [LOCAL ] CURV: Trimmed 38860 records to 26786 (keeping 200 days of data) [2025-10-08T18:17:21.093804] [DEBUG] [LOCAL ] CURV: Primary data saved (26786 records). [2025-10-08T18:17:21.093946] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-08T18:17:21.094024] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CURV took 23.2s. Estimated remaining: 4h 9m 22s. Rate: 7.3 symbols/min [2025-10-08T18:17:21.261407] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:21.304469] [DEBUG] [LOCAL ] CVI: Loaded 46516 existing records from primary storage. [2025-10-08T18:17:21.304833] [INFO ] [MAIN ] CVI: Loaded 46516 existing records. [2025-10-08T18:17:21.484334] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:21.484588] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-08T18:17:21.484633] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-08T18:17:21.485227] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-08T18:17:21.485285] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-08T18:17:21.625009] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-08T18:17:21.853566] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:21.859708] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:17:21.892610] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:22.417601] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-08T18:17:23.155991] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:17:23.217504] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-08T18:17:24.017551] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-08T18:17:24.034161] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:17:24.035790] [INFO ] [REMOTE ] CVEO: Full fetch complete (20497 records). [2025-10-08T18:17:24.035863] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-08T18:17:24.440866] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-08T18:17:24.491837] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-08T18:17:24.491919] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-08T18:17:24.492338] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-08T18:17:24.492399] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-08T18:17:24.495463] [DEBUG] [LOCAL ] CVEO: Trimmed 20497 records to 15261 (keeping 200 days of data) [2025-10-08T18:17:24.585955] [DEBUG] [LOCAL ] CVEO: Primary data saved (15261 records). [2025-10-08T18:17:24.586105] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-08T18:17:24.586188] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CVEO took 26.7s. Estimated remaining: 4h 8m 58s. Rate: 7.3 symbols/min [2025-10-08T18:17:24.769322] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:24.786764] [DEBUG] [LOCAL ] CVLG: Loaded 15491 existing records from primary storage. [2025-10-08T18:17:24.787036] [INFO ] [MAIN ] CVLG: Loaded 15491 existing records. [2025-10-08T18:17:24.824525] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-08T18:17:24.979279] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:24.979539] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-08T18:17:24.979586] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-08T18:17:24.979814] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-08T18:17:24.979872] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-08T18:17:25.366508] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:25.617508] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-08T18:17:25.752908] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:17:26.417609] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-08T18:17:26.920745] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-08T18:17:27.217562] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-08T18:17:27.714005] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:17:28.017610] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-08T18:17:28.817551] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-08T18:17:29.247133] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:17:29.283570] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:17:29.617529] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-08T18:17:30.012238] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T18:17:30.417566] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-08T18:17:30.907263] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-10-08T18:17:31.124935] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:17:31.217582] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-08T18:17:32.017551] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-08T18:17:32.317725] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T18:17:32.820517] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-08T18:17:32.856149] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:17:32.856927] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:17:33.617542] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-08T18:17:34.310928] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:17:34.316877] [INFO ] [REMOTE ] CVE: Full fetch complete (77171 records). [2025-10-08T18:17:34.317295] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-08T18:17:34.319601] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:17:34.319764] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:17:34.319810] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:17:34.319882] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-08T18:17:34.319954] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-08T18:17:34.319994] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-08T18:17:34.320209] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-08T18:17:34.322182] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 36.4s. Estimated remaining: 4h 8m 54s. Rate: 7.3 symbols/min [2025-10-08T18:17:34.425179] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-08T18:17:34.472317] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T18:17:34.534737] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:34.534950] [DEBUG] [LOCAL ] CVNA: No existing data file found in primary storage. [2025-10-08T18:17:34.535005] [WARN ] [MAIN ] CVNA: No existing data found, performing full refresh instead. [2025-10-08T18:17:34.535120] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-08T18:17:34.535162] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-08T18:17:34.535202] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-08T18:17:34.535234] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-08T18:17:34.888752] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:35.217590] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-08T18:17:36.006198] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:17:36.017561] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-08T18:17:36.078449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T18:17:36.817538] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-08T18:17:37.617589] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-08T18:17:37.865501] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:17:38.417609] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-08T18:17:38.698835] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:17:38.980792] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:17:38.984849] [INFO ] [REMOTE ] CUZ: Full fetch complete (70764 records). [2025-10-08T18:17:38.985042] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-08T18:17:39.224101] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-08T18:17:39.436408] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-08T18:17:39.436304] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:17:39.442003] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-08T18:17:39.443341] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-08T18:17:39.443424] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-08T18:17:39.444988] [DEBUG] [LOCAL ] CUZ: Trimmed 70764 records to 49428 (keeping 200 days of data) [2025-10-08T18:17:39.760724] [DEBUG] [LOCAL ] CUZ: Primary data saved (49428 records). [2025-10-08T18:17:39.760888] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-08T18:17:39.761018] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CUZ took 41.9s. Estimated remaining: 4h 8m 37s. Rate: 7.3 symbols/min [2025-10-08T18:17:39.935222] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:39.990937] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-08T18:17:39.991331] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-08T18:17:40.022779] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-08T18:17:40.194402] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:40.194677] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-08T18:17:40.194737] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-08T18:17:40.195205] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-08T18:17:40.195265] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-08T18:17:40.584348] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:40.817572] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-08T18:17:41.452843] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T18:17:41.521500] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:17:41.617521] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-08T18:17:41.916549] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:17:42.417624] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-08T18:17:43.217611] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-08T18:17:43.776156] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T18:17:43.854840] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:17:44.017586] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-08T18:17:44.817542] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-08T18:17:45.617532] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-08T18:17:45.689035] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T18:17:45.797960] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:17:46.340606] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-08T18:17:46.417578] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-08T18:17:46.880579] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:17:47.067302] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:17:47.217564] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-08T18:17:48.017526] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-08T18:17:48.067753] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T18:17:48.817541] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-08T18:17:49.455240] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T18:17:49.617544] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-08T18:17:50.151582] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-08T18:17:50.229938] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T18:17:50.232177] [INFO ] [REMOTE ] CVLG: Full fetch complete (21121 records). [2025-10-08T18:17:50.232275] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-08T18:17:50.427453] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-08T18:17:50.626105] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-08T18:17:50.626214] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-08T18:17:50.626716] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-08T18:17:50.626778] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-08T18:17:50.627377] [DEBUG] [LOCAL ] CVLG: Trimmed 21121 records to 15513 (keeping 200 days of data) [2025-10-08T18:17:50.722115] [DEBUG] [LOCAL ] CVLG: Primary data saved (15513 records). [2025-10-08T18:17:50.722270] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-08T18:17:50.722359] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 26.1s. Estimated remaining: 4h 8m 38s. Rate: 7.3 symbols/min [2025-10-08T18:17:50.917467] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:50.917693] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-08T18:17:50.917746] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-08T18:17:50.917861] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-08T18:17:50.917904] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-08T18:17:50.917945] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-08T18:17:50.917977] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-08T18:17:51.222606] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-08T18:17:51.325521] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:52.017558] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-08T18:17:52.778969] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-08T18:17:52.825444] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-08T18:17:52.834026] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:17:53.617547] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-08T18:17:54.149608] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-08T18:17:54.417636] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-08T18:17:54.703087] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:17:54.878375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:17:55.217579] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-08T18:17:56.017568] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-08T18:17:56.215157] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:17:56.817597] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-08T18:17:57.268270] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-08T18:17:57.623057] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-08T18:17:57.632314] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:17:57.636278] [INFO ] [REMOTE ] CVI: Full fetch complete (67342 records). [2025-10-08T18:17:57.636831] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-08T18:17:58.094253] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-08T18:17:58.094370] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-08T18:17:58.095449] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-08T18:17:58.095524] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-08T18:17:58.098027] [DEBUG] [LOCAL ] CVI: Trimmed 67342 records to 46541 (keeping 200 days of data) [2025-10-08T18:17:58.418089] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-08T18:17:58.510605] [DEBUG] [LOCAL ] CVI: Primary data saved (46541 records). [2025-10-08T18:17:58.510859] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-08T18:17:58.511014] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVI took 37.4s. Estimated remaining: 4h 8m 28s. Rate: 7.3 symbols/min [2025-10-08T18:17:58.771363] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:17:58.809132] [DEBUG] [LOCAL ] CW: Loaded 22229 existing records from primary storage. [2025-10-08T18:17:58.809511] [INFO ] [MAIN ] CW: Loaded 22229 existing records. [2025-10-08T18:17:58.973362] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T18:17:59.090859] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:17:59.091111] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-08T18:17:59.091173] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-08T18:17:59.091501] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-08T18:17:59.091560] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-08T18:17:59.223008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-08T18:17:59.462358] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:17:59.995745] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-08T18:18:00.017506] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-08T18:18:00.813590] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-08T18:18:00.825066] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-08T18:18:01.612201] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T18:18:01.623323] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-08T18:18:01.895597] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:18:02.267408] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:18:02.417554] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-08T18:18:03.217597] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-08T18:18:03.489413] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:18:03.744595] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:18:04.017568] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-08T18:18:04.817543] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-08T18:18:05.103757] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:18:05.181964] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:18:05.617614] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-08T18:18:06.417635] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-08T18:18:07.218014] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-08T18:18:07.435768] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-08T18:18:07.639531] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T18:18:07.862546] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T18:18:08.017560] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-08T18:18:08.817558] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-08T18:18:09.047935] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:18:09.079986] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T18:18:09.617561] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-08T18:18:10.417571] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-08T18:18:10.723835] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T18:18:10.916379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:18:11.217557] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-08T18:18:12.017538] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-08T18:18:12.058791] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:18:12.817553] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-08T18:18:13.242174] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T18:18:13.247241] [INFO ] [REMOTE ] CVNA: Full fetch complete (76657 records). [2025-10-08T18:18:13.247485] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-08T18:18:13.622828] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-08T18:18:13.674045] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-08T18:18:13.674153] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-08T18:18:13.675224] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-08T18:18:13.675304] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-08T18:18:13.676919] [DEBUG] [LOCAL ] CVNA: Trimmed 76657 records to 52896 (keeping 200 days of data) [2025-10-08T18:18:13.993921] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T18:18:14.042130] [DEBUG] [LOCAL ] CVNA: Primary data saved (52896 records). [2025-10-08T18:18:14.042336] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-08T18:18:14.042527] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 39.7s. Estimated remaining: 4h 8m 43s. Rate: 7.3 symbols/min [2025-10-08T18:18:14.251857] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:14.254754] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T18:18:14.319983] [DEBUG] [LOCAL ] CWAN: Loaded 52446 existing records from primary storage. [2025-10-08T18:18:14.320344] [INFO ] [MAIN ] CWAN: Loaded 52446 existing records. [2025-10-08T18:18:14.418487] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-08T18:18:14.499920] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:14.500145] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-08T18:18:14.500194] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-08T18:18:14.500722] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-08T18:18:14.500781] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-08T18:18:14.901178] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:15.217540] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-08T18:18:15.298899] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T18:18:15.751776] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-08T18:18:16.017549] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-08T18:18:16.533486] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:18:16.537995] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-08T18:18:16.538125] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-08T18:18:16.822682] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-08T18:18:16.954395] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-08T18:18:16.954606] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-08T18:18:16.955676] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-08T18:18:16.955847] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-08T18:18:16.957733] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 53694 (keeping 200 days of data) [2025-10-08T18:18:17.087216] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:18:17.343747] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-08T18:18:17.343900] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-08T18:18:17.344684] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVS took 37.6s. Estimated remaining: 4h 8m 19s. Rate: 7.3 symbols/min [2025-10-08T18:18:17.516951] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:17.576363] [DEBUG] [LOCAL ] CWEN: Loaded 45224 existing records from primary storage. [2025-10-08T18:18:17.576706] [INFO ] [MAIN ] CWEN: Loaded 45224 existing records. [2025-10-08T18:18:17.629441] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-08T18:18:17.754914] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:17.755143] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-08T18:18:17.755189] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-08T18:18:17.755632] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-08T18:18:17.755763] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-08T18:18:18.070426] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:18:18.139543] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:18.417564] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-08T18:18:19.217520] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-08T18:18:19.357059] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:18:20.017590] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-08T18:18:20.075796] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:18:20.139357] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:18:20.817607] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-08T18:18:21.617561] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-08T18:18:22.219043] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:18:22.417502] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-08T18:18:22.515727] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:18:22.517610] [INFO ] [REMOTE ] CW: Full fetch complete (33122 records). [2025-10-08T18:18:22.517714] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-08T18:18:22.943372] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-08T18:18:22.962380] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-08T18:18:22.962479] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-08T18:18:22.963899] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-08T18:18:22.964019] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-08T18:18:22.965208] [DEBUG] [LOCAL ] CW: Trimmed 33122 records to 22225 (keeping 200 days of data) [2025-10-08T18:18:23.107506] [DEBUG] [LOCAL ] CW: Primary data saved (22225 records). [2025-10-08T18:18:23.107639] [INFO ] [MAIN ] CW: Full history saved. [2025-10-08T18:18:23.107771] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 24.6s. Estimated remaining: 4h 8m 2s. Rate: 7.3 symbols/min [2025-10-08T18:18:23.222631] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-08T18:18:23.287933] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:23.343518] [DEBUG] [LOCAL ] CWH: Loaded 51310 existing records from primary storage. [2025-10-08T18:18:23.343854] [INFO ] [MAIN ] CWH: Loaded 51310 existing records. [2025-10-08T18:18:23.517456] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:23.517742] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-08T18:18:23.517795] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-08T18:18:23.518323] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-08T18:18:23.518381] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-08T18:18:23.876382] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:24.017548] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-08T18:18:24.147506] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T18:18:24.817545] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-08T18:18:25.331245] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:18:25.587937] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:18:25.617508] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-08T18:18:26.312343] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:18:26.417539] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-08T18:18:27.048916] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:18:27.217560] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-08T18:18:28.017631] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-08T18:18:28.431386] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T18:18:28.817577] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-08T18:18:29.021445] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:18:29.617536] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-08T18:18:29.949813] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T18:18:30.406321] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:18:30.417490] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-08T18:18:30.963848] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T18:18:31.217557] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-08T18:18:32.027440] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-08T18:18:32.030348] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:18:32.817517] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-08T18:18:32.897356] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:18:33.189768] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:18:33.617567] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-08T18:18:34.417603] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-08T18:18:34.471741] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:18:35.217619] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-08T18:18:36.017522] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-08T18:18:36.707314] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:18:36.817508] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-08T18:18:37.833563] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:18:37.845214] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-08T18:18:38.229716] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:18:38.417513] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-08T18:18:39.693450] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T18:18:39.705955] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-08T18:18:40.107511] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (6.49 seconds). [2025-10-08T18:18:40.125468] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:18:40.136239] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-08T18:18:40.817561] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-08T18:18:41.414538] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:18:41.617507] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-08T18:18:42.054159] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (7.64 seconds). [2025-10-08T18:18:42.417512] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-08T18:18:42.473433] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T18:18:42.538813] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:18:42.902698] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:18:42.906838] [INFO ] [REMOTE ] CWAN: Full fetch complete (75196 records). [2025-10-08T18:18:42.906989] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-08T18:18:43.222706] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-08T18:18:43.315707] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-08T18:18:43.315808] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-08T18:18:43.316732] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-08T18:18:43.316801] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-08T18:18:43.318377] [DEBUG] [LOCAL ] CWAN: Trimmed 75196 records to 52465 (keeping 200 days of data) [2025-10-08T18:18:43.627826] [DEBUG] [LOCAL ] CWAN: Primary data saved (52465 records). [2025-10-08T18:18:43.627984] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-08T18:18:43.628067] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CWAN took 29.6s. Estimated remaining: 4h 8m 33s. Rate: 7.2 symbols/min [2025-10-08T18:18:43.805039] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:43.853480] [DEBUG] [LOCAL ] CWK: Loaded 49503 existing records from primary storage. [2025-10-08T18:18:43.853863] [INFO ] [MAIN ] CWK: Loaded 49503 existing records. [2025-10-08T18:18:44.036721] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-08T18:18:44.042400] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:44.043627] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-08T18:18:44.043796] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-08T18:18:44.044318] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-08T18:18:44.044377] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-08T18:18:44.355240] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:18:44.479424] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:44.678012] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T18:18:44.681578] [INFO ] [REMOTE ] CWEN: Full fetch complete (64645 records). [2025-10-08T18:18:44.681727] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-08T18:18:44.682529] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:18:44.682619] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:18:44.682710] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:18:44.682782] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-08T18:18:44.682847] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-08T18:18:44.682881] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-08T18:18:44.683063] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-08T18:18:44.683156] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 27.3s. Estimated remaining: 4h 8m 2s. Rate: 7.3 symbols/min [2025-10-08T18:18:44.829754] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-08T18:18:44.860497] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:44.860700] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-08T18:18:44.860750] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-08T18:18:44.860858] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-08T18:18:44.860899] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-08T18:18:44.860940] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-08T18:18:44.860972] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-08T18:18:45.208729] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:45.617600] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-08T18:18:46.303713] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-08T18:18:46.308034] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-08T18:18:46.308169] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-08T18:18:46.419351] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-08T18:18:46.652054] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:18:46.750481] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T18:18:46.779159] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-08T18:18:46.779222] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-08T18:18:46.780048] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-08T18:18:46.780112] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-08T18:18:46.781537] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 53760 (keeping 200 days of data) [2025-10-08T18:18:47.131678] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-08T18:18:47.131838] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-08T18:18:47.131919] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CVX took 56.4s. Estimated remaining: 4h 7m 35s. Rate: 7.3 symbols/min [2025-10-08T18:18:47.223013] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-08T18:18:47.307366] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:18:47.356109] [DEBUG] [LOCAL ] CX: Loaded 52822 existing records from primary storage. [2025-10-08T18:18:47.356437] [INFO ] [MAIN ] CX: Loaded 52822 existing records. [2025-10-08T18:18:47.545346] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:18:47.545589] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-08T18:18:47.545635] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-08T18:18:47.546174] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-08T18:18:47.546232] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-08T18:18:47.923614] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:18:48.018060] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-08T18:18:48.498308] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:18:48.586571] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-08T18:18:48.817576] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-08T18:18:49.620104] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-08T18:18:49.622936] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:18:50.417572] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-08T18:18:50.546679] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:18:51.190298] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:18:51.217629] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-08T18:18:51.261631] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T18:18:52.017563] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-08T18:18:52.817554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-08T18:18:52.956695] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T18:18:53.034006] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T18:18:53.617568] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-08T18:18:54.337792] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:18:54.417592] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-08T18:18:54.986915] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:18:55.217535] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-08T18:18:56.017549] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-08T18:18:56.135712] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:18:56.185132] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T18:18:56.817555] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-08T18:18:57.617544] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-08T18:18:57.922970] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T18:18:58.142879] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:18:58.417592] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-08T18:18:59.030402] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:18:59.217554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-08T18:19:00.009035] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:19:00.018879] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-08T18:19:00.817552] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-08T18:19:01.258801] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T18:19:01.262499] [INFO ] [REMOTE ] CWH: Full fetch complete (72698 records). [2025-10-08T18:19:01.262633] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-08T18:19:01.263521] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:19:01.263615] [FATAL] [MAIN ] CWH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:19:01.263701] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:19:01.263780] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-08T18:19:01.263865] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-08T18:19:01.263923] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-08T18:19:01.264187] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-08T18:19:01.264291] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWH took 38.2s. Estimated remaining: 4h 7m 45s. Rate: 7.3 symbols/min [2025-10-08T18:19:01.441012] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:01.449341] [DEBUG] [LOCAL ] CXE: Loaded 6168 existing records from primary storage. [2025-10-08T18:19:01.449716] [INFO ] [MAIN ] CXE: Loaded 6168 existing records. [2025-10-08T18:19:01.627270] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-08T18:19:01.632092] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:01.633319] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-08T18:19:01.633390] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-08T18:19:01.633712] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-08T18:19:01.633878] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-08T18:19:01.717512] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T18:19:02.048754] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:02.417548] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-08T18:19:02.601842] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T18:19:02.992554] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:19:03.221581] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-08T18:19:03.225948] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T18:19:04.017556] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-08T18:19:04.817576] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-08T18:19:04.908623] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:19:04.915408] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:19:05.617556] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-08T18:19:05.668416] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T18:19:06.204382] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:19:06.417559] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-08T18:19:07.217561] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-08T18:19:07.571208] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T18:19:07.573452] [INFO ] [REMOTE ] CWT: Full fetch complete (40447 records). [2025-10-08T18:19:07.573538] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-08T18:19:07.574086] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:19:07.574174] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:19:07.574216] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:19:07.574254] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-08T18:19:07.574312] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-08T18:19:07.574348] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-08T18:19:07.574387] [DEBUG] [LOCAL ] CWT: No derivative data file found to delete. [2025-10-08T18:19:07.574439] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 22.9s. Estimated remaining: 4h 7m 31s. Rate: 7.3 symbols/min [2025-10-08T18:19:07.744174] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:07.744384] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-10-08T18:19:07.744440] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-10-08T18:19:07.744554] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-08T18:19:07.744598] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-08T18:19:07.744693] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-10-08T18:19:07.744741] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-08T18:19:08.020003] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-08T18:19:08.099073] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:08.817563] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-08T18:19:08.952818] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T18:19:09.351081] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:19:09.584318] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T18:19:09.617513] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-08T18:19:10.417632] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-08T18:19:11.060094] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T18:19:11.162583] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:19:11.217579] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-08T18:19:11.896694] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T18:19:12.017556] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-08T18:19:12.817555] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-08T18:19:13.617588] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-08T18:19:14.264185] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-08T18:19:14.330672] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:19:14.385785] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T18:19:14.417541] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-08T18:19:15.217585] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-08T18:19:16.017545] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-08T18:19:16.206767] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:19:16.568320] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T18:19:16.817528] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-08T18:19:16.976432] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:19:17.617552] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-08T18:19:18.376456] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T18:19:18.417545] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-08T18:19:18.585248] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:19:19.217612] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-08T18:19:19.985732] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:19:20.017513] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-08T18:19:20.785638] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:19:20.789560] [INFO ] [REMOTE ] CWK: Full fetch complete (71047 records). [2025-10-08T18:19:20.789747] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-08T18:19:20.825320] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-08T18:19:21.187636] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-08T18:19:21.187755] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-08T18:19:21.188617] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-08T18:19:21.188758] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-08T18:19:21.190280] [DEBUG] [LOCAL ] CWK: Trimmed 71047 records to 49460 (keeping 200 days of data) [2025-10-08T18:19:21.396701] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:19:21.487794] [DEBUG] [LOCAL ] CWK: Primary data saved (49460 records). [2025-10-08T18:19:21.487945] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-08T18:19:21.488031] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWK took 37.9s. Estimated remaining: 4h 7m 40s. Rate: 7.3 symbols/min [2025-10-08T18:19:21.622482] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-08T18:19:21.677222] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:21.721829] [DEBUG] [LOCAL ] CXM: Loaded 47611 existing records from primary storage. [2025-10-08T18:19:21.722189] [INFO ] [MAIN ] CXM: Loaded 47611 existing records. [2025-10-08T18:19:21.898737] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T18:19:21.951211] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:21.951490] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-08T18:19:21.951537] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-08T18:19:21.951998] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-08T18:19:21.952057] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-08T18:19:22.306435] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:22.342325] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:19:22.417567] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-08T18:19:23.217573] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-08T18:19:23.586902] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-08T18:19:23.909028] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:19:24.017574] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-08T18:19:24.817554] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-08T18:19:25.533953] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T18:19:25.567938] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:19:25.617549] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-08T18:19:26.417621] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-08T18:19:27.002313] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:19:27.003423] [INFO ] [REMOTE ] CXE: Full fetch complete (11700 records). [2025-10-08T18:19:27.003499] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-08T18:19:27.222697] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-08T18:19:27.444569] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:19:27.454680] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-08T18:19:27.455877] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-08T18:19:27.456407] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-08T18:19:27.456484] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-08T18:19:27.457206] [DEBUG] [LOCAL ] CXE: Trimmed 11700 records to 6197 (keeping 200 days of data) [2025-10-08T18:19:27.494796] [DEBUG] [LOCAL ] CXE: Primary data saved (6197 records). [2025-10-08T18:19:27.494954] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-08T18:19:27.495045] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CXE took 26.2s. Estimated remaining: 4h 7m 25s. Rate: 7.3 symbols/min [2025-10-08T18:19:27.669506] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:27.705592] [DEBUG] [LOCAL ] CXT: Loaded 30988 existing records from primary storage. [2025-10-08T18:19:27.705953] [INFO ] [MAIN ] CXT: Loaded 30988 existing records. [2025-10-08T18:19:27.889275] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:19:27.895311] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:27.897423] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-08T18:19:27.897483] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-08T18:19:27.897828] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-08T18:19:27.897887] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-08T18:19:28.022713] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-08T18:19:28.260622] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:28.817622] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-08T18:19:29.285928] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T18:19:29.584667] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T18:19:29.617533] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-08T18:19:30.417608] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-08T18:19:31.217569] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-08T18:19:31.457062] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:19:32.017567] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-08T18:19:32.299711] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T18:19:32.347188] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T18:19:32.817555] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-08T18:19:33.254798] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T18:19:33.617552] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-08T18:19:33.728954] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:19:34.417568] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-08T18:19:35.217506] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-08T18:19:35.298117] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:19:35.425875] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:19:35.579675] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:19:36.017689] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-08T18:19:36.817562] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-08T18:19:37.418726] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:19:37.442810] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:19:37.617566] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-08T18:19:38.417561] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-08T18:19:39.022080] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:19:39.217530] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-08T18:19:39.748728] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T18:19:40.017635] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-08T18:19:40.132557] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T18:19:40.137428] [INFO ] [REMOTE ] CX: Full fetch complete (76392 records). [2025-10-08T18:19:40.137773] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-08T18:19:40.539907] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-08T18:19:40.540008] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-08T18:19:40.540919] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-08T18:19:40.540990] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-08T18:19:40.542574] [DEBUG] [LOCAL ] CX: Trimmed 76392 records to 52821 (keeping 200 days of data) [2025-10-08T18:19:40.821538] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-08T18:19:40.864599] [DEBUG] [LOCAL ] CX: Primary data saved (52821 records). [2025-10-08T18:19:40.864799] [INFO ] [MAIN ] CX: Full history saved. [2025-10-08T18:19:40.864927] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CX took 53.7s. Estimated remaining: 4h 7m 33s. Rate: 7.2 symbols/min [2025-10-08T18:19:41.047405] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:41.116360] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:19:41.124725] [DEBUG] [LOCAL ] CXW: Loaded 43951 existing records from primary storage. [2025-10-08T18:19:41.125544] [INFO ] [MAIN ] CXW: Loaded 43951 existing records. [2025-10-08T18:19:41.305941] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:41.306292] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-08T18:19:41.306382] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-08T18:19:41.313279] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T18:19:41.312580] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-08T18:19:41.315546] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-08T18:19:41.627844] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-08T18:19:41.667808] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:42.417549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-08T18:19:43.219360] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-08T18:19:43.229777] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T18:19:43.824994] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T18:19:43.888236] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:19:44.017619] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-08T18:19:44.647420] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:19:44.817551] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-08T18:19:45.388727] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:19:45.389548] [INFO ] [REMOTE ] CXH: Full fetch complete (5401 records). [2025-10-08T18:19:45.389620] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-08T18:19:45.627351] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-08T18:19:45.757016] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-08T18:19:45.757101] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-08T18:19:45.757257] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-08T18:19:45.757314] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-08T18:19:45.757720] [DEBUG] [LOCAL ] CXH: Trimmed 5401 records to 4425 (keeping 200 days of data) [2025-10-08T18:19:45.783285] [DEBUG] [LOCAL ] CXH: Primary data saved (4425 records). [2025-10-08T18:19:45.783449] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-08T18:19:45.783530] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 38.2s. Estimated remaining: 4h 7m 14s. Rate: 7.3 symbols/min [2025-10-08T18:19:45.950514] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:45.985110] [DEBUG] [LOCAL ] CYD: Loaded 26352 existing records from primary storage. [2025-10-08T18:19:45.985480] [INFO ] [MAIN ] CYD: Loaded 26352 existing records. [2025-10-08T18:19:46.162975] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:46.163242] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-08T18:19:46.163303] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-08T18:19:46.163632] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-08T18:19:46.163724] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-08T18:19:46.425366] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-08T18:19:46.513602] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:47.217525] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-08T18:19:47.370406] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:19:48.017521] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-08T18:19:48.133387] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T18:19:48.283771] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T18:19:48.817596] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-08T18:19:49.617537] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-08T18:19:49.741848] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:19:50.169897] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:19:50.199431] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T18:19:50.417637] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-08T18:19:51.217577] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-08T18:19:51.805051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:19:52.017556] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-08T18:19:52.599077] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T18:19:52.817549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-08T18:19:53.574487] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:19:53.579039] [INFO ] [REMOTE ] CXM: Full fetch complete (68662 records). [2025-10-08T18:19:53.579244] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-08T18:19:53.622726] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-08T18:19:54.058326] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-08T18:19:54.058429] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-08T18:19:54.059504] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-08T18:19:54.059599] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-08T18:19:54.061197] [DEBUG] [LOCAL ] CXM: Trimmed 68662 records to 47580 (keeping 200 days of data) [2025-10-08T18:19:54.345554] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T18:19:54.417599] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-08T18:19:54.421317] [DEBUG] [LOCAL ] CXM: Primary data saved (47580 records). [2025-10-08T18:19:54.421405] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-08T18:19:54.421484] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXM took 32.9s. Estimated remaining: 4h 7m 7s. Rate: 7.3 symbols/min [2025-10-08T18:19:54.643788] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:54.693597] [DEBUG] [LOCAL ] CYH: Loaded 47623 existing records from primary storage. [2025-10-08T18:19:54.701223] [INFO ] [MAIN ] CYH: Loaded 47623 existing records. [2025-10-08T18:19:54.702048] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:19:54.748309] [INFO ] [REMOTE ] CXT: Full fetch complete (45534 records). [2025-10-08T18:19:54.780828] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-08T18:19:55.115533] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:19:55.129797] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-08T18:19:55.190129] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-08T18:19:55.206921] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-08T18:19:55.228168] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-08T18:19:55.224678] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-08T18:19:55.478877] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-08T18:19:55.484094] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-08T18:19:55.489879] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-08T18:19:55.489961] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-08T18:19:55.533940] [DEBUG] [LOCAL ] CXT: Trimmed 45534 records to 30997 (keeping 200 days of data) [2025-10-08T18:19:55.832468] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:55.834635] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:19:55.949878] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:19:55.966165] [DEBUG] [LOCAL ] CXT: Primary data saved (30997 records). [2025-10-08T18:19:55.966264] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-08T18:19:55.966339] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXT took 28.5s. Estimated remaining: 4h 6m 38s. Rate: 7.3 symbols/min [2025-10-08T18:19:56.026913] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-08T18:19:56.134097] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:19:56.134272] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-08T18:19:56.134309] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-08T18:19:56.134421] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-08T18:19:56.134461] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-08T18:19:56.134501] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-08T18:19:56.134531] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-08T18:19:56.482700] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:19:56.817583] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-08T18:19:57.219807] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T18:19:57.617609] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-08T18:19:58.417518] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-08T18:19:58.715098] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:19:59.217574] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-08T18:19:59.364417] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T18:20:00.017604] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-08T18:20:00.111442] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:20:00.691843] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:20:00.817561] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-08T18:20:01.617580] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-08T18:20:01.685715] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:20:02.417526] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-08T18:20:02.758217] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T18:20:03.217572] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-08T18:20:03.382823] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T18:20:03.584556] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:20:04.017568] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-08T18:20:04.518285] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:20:04.817567] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-08T18:20:05.617507] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-08T18:20:05.816289] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:20:06.417509] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-08T18:20:06.729221] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:20:06.947553] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:20:07.217616] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-08T18:20:08.017519] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-08T18:20:08.102220] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:20:08.817571] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-08T18:20:09.166285] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T18:20:09.221939] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T18:20:09.617548] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-08T18:20:10.344239] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T18:20:10.417539] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-08T18:20:10.859434] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T18:20:11.217578] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-08T18:20:12.017530] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-08T18:20:12.073079] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:20:12.817618] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-08T18:20:13.029264] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:20:13.059283] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:20:13.617610] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-08T18:20:14.045393] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T18:20:14.417602] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-08T18:20:14.626439] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:20:15.217593] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-08T18:20:16.017558] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-08T18:20:16.160468] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:20:16.695579] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:20:16.817569] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-08T18:20:16.936489] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:20:17.617555] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-08T18:20:18.246448] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:20:18.250045] [INFO ] [REMOTE ] CXW: Full fetch complete (64992 records). [2025-10-08T18:20:18.250192] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-08T18:20:18.422869] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-08T18:20:18.646103] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-08T18:20:18.646221] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-08T18:20:18.647261] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-08T18:20:18.647325] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-08T18:20:18.648772] [DEBUG] [LOCAL ] CXW: Trimmed 64992 records to 43976 (keeping 200 days of data) [2025-10-08T18:20:18.902828] [DEBUG] [LOCAL ] CXW: Primary data saved (43976 records). [2025-10-08T18:20:18.902966] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-08T18:20:18.903065] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CXW took 38.0s. Estimated remaining: 4h 7m 15s. Rate: 7.2 symbols/min [2025-10-08T18:20:19.069586] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:19.084677] [DEBUG] [LOCAL ] DAC: Loaded 12546 existing records from primary storage. [2025-10-08T18:20:19.084932] [INFO ] [MAIN ] DAC: Loaded 12546 existing records. [2025-10-08T18:20:19.221066] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-08T18:20:19.265192] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:19.265430] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-08T18:20:19.265496] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-08T18:20:19.266025] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-08T18:20:19.266217] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-08T18:20:19.548677] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:20:19.561805] [INFO ] [REMOTE ] CYD: Full fetch complete (33992 records). [2025-10-08T18:20:19.572394] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-08T18:20:19.723036] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:20.016916] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-08T18:20:20.017082] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-08T18:20:20.017730] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-08T18:20:20.018074] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-08T18:20:20.017890] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-08T18:20:20.020779] [DEBUG] [LOCAL ] CYD: Trimmed 33992 records to 26383 (keeping 200 days of data) [2025-10-08T18:20:20.186396] [DEBUG] [LOCAL ] CYD: Primary data saved (26383 records). [2025-10-08T18:20:20.186550] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-08T18:20:20.186692] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYD took 34.4s. Estimated remaining: 4h 6m 45s. Rate: 7.3 symbols/min [2025-10-08T18:20:20.359907] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:20.423042] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:20:20.450888] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-08T18:20:20.451222] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-08T18:20:20.626327] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:20.626567] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-08T18:20:20.626616] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-08T18:20:20.627709] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-08T18:20:20.627769] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-08T18:20:20.844169] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-08T18:20:20.995540] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:21.065193] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T18:20:21.471811] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T18:20:21.617575] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-08T18:20:22.417552] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-08T18:20:22.847781] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:20:23.208331] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:20:23.217691] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-08T18:20:23.255271] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:20:24.017588] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-08T18:20:24.817611] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-08T18:20:25.064077] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T18:20:25.444278] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:20:25.449432] [INFO ] [REMOTE ] CYH: Full fetch complete (69807 records). [2025-10-08T18:20:25.449699] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-08T18:20:25.619710] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-08T18:20:25.731417] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T18:20:25.874953] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-08T18:20:25.875041] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-08T18:20:25.876023] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-08T18:20:25.876093] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-08T18:20:25.877478] [DEBUG] [LOCAL ] CYH: Trimmed 69807 records to 47641 (keeping 200 days of data) [2025-10-08T18:20:26.150523] [DEBUG] [LOCAL ] CYH: Primary data saved (47641 records). [2025-10-08T18:20:26.150716] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-08T18:20:26.150846] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. CYH took 31.7s. Estimated remaining: 4h 6m 30s. Rate: 7.3 symbols/min [2025-10-08T18:20:26.321694] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:26.366715] [DEBUG] [LOCAL ] DAN: Loaded 49104 existing records from primary storage. [2025-10-08T18:20:26.367102] [INFO ] [MAIN ] DAN: Loaded 49104 existing records. [2025-10-08T18:20:26.428931] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-08T18:20:26.546213] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:26.546471] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-08T18:20:26.546529] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-08T18:20:26.547881] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-08T18:20:26.547941] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-08T18:20:26.930946] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:27.217579] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-08T18:20:27.821519] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:20:27.844397] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T18:20:28.017594] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-08T18:20:28.336578] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T18:20:28.817625] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-08T18:20:29.259443] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:20:29.617586] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-08T18:20:30.417525] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-08T18:20:30.480476] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T18:20:30.754460] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T18:20:31.217629] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-08T18:20:32.017521] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-08T18:20:32.321384] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:20:32.373932] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:20:32.817552] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-08T18:20:33.511275] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T18:20:33.617506] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-08T18:20:33.973846] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T18:20:34.122950] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T18:20:34.417575] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-08T18:20:35.217581] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-08T18:20:35.872847] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T18:20:36.017688] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-08T18:20:36.589898] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T18:20:36.817577] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-08T18:20:37.617569] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-08T18:20:37.917420] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:20:38.412612] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:20:38.414162] [INFO ] [REMOTE ] DAC: Full fetch complete (19384 records). [2025-10-08T18:20:38.414239] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-08T18:20:38.426399] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-08T18:20:38.810711] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-08T18:20:38.810852] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-08T18:20:38.811257] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-08T18:20:38.811298] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-08T18:20:38.812004] [DEBUG] [LOCAL ] DAC: Trimmed 19384 records to 12578 (keeping 200 days of data) [2025-10-08T18:20:38.896839] [DEBUG] [LOCAL ] DAC: Primary data saved (12578 records). [2025-10-08T18:20:38.896997] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-08T18:20:38.897097] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. DAC took 20.0s. Estimated remaining: 4h 6m 35s. Rate: 7.2 symbols/min [2025-10-08T18:20:39.073595] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:39.093261] [DEBUG] [LOCAL ] DAO: Loaded 20194 existing records from primary storage. [2025-10-08T18:20:39.093630] [INFO ] [MAIN ] DAO: Loaded 20194 existing records. [2025-10-08T18:20:39.222322] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-08T18:20:39.279895] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:39.280305] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-08T18:20:39.280444] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-08T18:20:39.292277] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-08T18:20:39.297622] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-08T18:20:39.384712] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-08T18:20:39.683244] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:40.017524] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-08T18:20:40.306886] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:20:40.817515] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-08T18:20:40.998349] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:20:41.617617] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-08T18:20:41.927895] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:20:42.298326] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T18:20:42.303057] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-10-08T18:20:42.303208] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-08T18:20:42.422733] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-08T18:20:42.727763] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-08T18:20:42.727922] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-08T18:20:42.728908] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-08T18:20:42.728974] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-08T18:20:42.730558] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 53647 (keeping 200 days of data) [2025-10-08T18:20:42.995423] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T18:20:43.107016] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-10-08T18:20:43.107177] [INFO ] [MAIN ] D: Full history saved. [2025-10-08T18:20:43.107258] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 47.1s. Estimated remaining: 4h 6m 14s. Rate: 7.3 symbols/min [2025-10-08T18:20:43.221159] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-08T18:20:43.302100] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:20:43.355988] [DEBUG] [LOCAL ] DAR: Loaded 51864 existing records from primary storage. [2025-10-08T18:20:43.356554] [INFO ] [MAIN ] DAR: Loaded 51864 existing records. [2025-10-08T18:20:43.561179] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:20:43.561620] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-08T18:20:43.561894] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-08T18:20:43.563391] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-08T18:20:43.563456] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-08T18:20:43.871265] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T18:20:43.987544] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:20:44.017698] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-08T18:20:44.817542] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-08T18:20:44.848192] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:20:44.900601] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:20:45.617591] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-08T18:20:46.417564] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-08T18:20:46.659942] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T18:20:46.938179] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:20:47.217554] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-08T18:20:48.017535] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-08T18:20:48.120364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:20:48.726938] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:20:48.817536] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-08T18:20:49.401339] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:20:49.617576] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-08T18:20:50.262101] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:20:50.417585] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-08T18:20:50.804127] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:20:51.217609] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-08T18:20:51.667097] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T18:20:52.017603] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-08T18:20:52.817610] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-08T18:20:53.574096] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:20:53.617494] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-08T18:20:53.632815] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:20:53.736182] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-08T18:20:54.417598] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-08T18:20:55.217536] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-08T18:20:55.456240] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:20:56.017562] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-08T18:20:56.500438] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T18:20:56.716076] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T18:20:56.817504] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-08T18:20:56.911903] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T18:20:57.617588] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-08T18:20:58.390783] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:20:58.417503] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-08T18:20:58.554490] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T18:20:59.217546] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-08T18:21:00.017564] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-08T18:21:00.073138] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:21:00.817513] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-08T18:21:00.990286] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T18:21:01.038178] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T18:21:01.617544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-08T18:21:02.417568] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-08T18:21:02.574625] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:21:03.183995] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T18:21:03.217580] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-08T18:21:03.418418] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T18:21:04.017564] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-08T18:21:04.817608] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-08T18:21:05.297113] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T18:21:05.301219] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-08T18:21:05.301355] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-08T18:21:05.622686] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-08T18:21:05.721018] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:21:05.724621] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-08T18:21:05.725138] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-08T18:21:05.726470] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-08T18:21:05.726680] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-08T18:21:05.727408] [INFO ] [REMOTE ] DAN: Full fetch complete (70889 records). [2025-10-08T18:21:05.727521] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-08T18:21:05.785406] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 53753 (keeping 200 days of data) [2025-10-08T18:21:05.833963] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T18:21:05.839300] [INFO ] [REMOTE ] DAO: Full fetch complete (32453 records). [2025-10-08T18:21:05.922191] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-08T18:21:06.519053] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-08T18:21:06.519535] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-08T18:21:06.521218] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-08T18:21:06.538205] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-08T18:21:06.622220] [DEBUG] [LOCAL ] DAN: Trimmed 70889 records to 49113 (keeping 200 days of data) [2025-10-08T18:21:06.837052] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-08T18:21:06.838082] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-08T18:21:06.839002] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-08T18:21:06.840279] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-08T18:21:06.847402] [DEBUG] [LOCAL ] DAO: Trimmed 32453 records to 20100 (keeping 200 days of data) [2025-10-08T18:21:07.118280] [DEBUG] [LOCAL ] DAO: Primary data saved (20100 records). [2025-10-08T18:21:07.120167] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-08T18:21:07.121070] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAO took 28.2s. Estimated remaining: 4h 6m 54s. Rate: 7.2 symbols/min [2025-10-08T18:21:07.398462] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:07.531838] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:21:07.563276] [DEBUG] [LOCAL ] DAVA: Loaded 41291 existing records from primary storage. [2025-10-08T18:21:07.564318] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-08T18:21:07.565428] [INFO ] [MAIN ] DAVA: Loaded 41291 existing records. [2025-10-08T18:21:07.767175] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-08T18:21:07.804534] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-08T18:21:07.803232] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:07.804863] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-08T18:21:07.808285] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-08T18:21:07.809508] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 47.6s. Estimated remaining: 4h 6m 23s. Rate: 7.2 symbols/min [2025-10-08T18:21:07.813893] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-08T18:21:07.933215] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-08T18:21:08.134176] [DEBUG] [LOCAL ] DAN: Primary data saved (49113 records). [2025-10-08T18:21:08.162132] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-08T18:21:08.168558] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAN took 42.0s. Estimated remaining: 4h 5m 50s. Rate: 7.3 symbols/min [2025-10-08T18:21:08.201333] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:08.237602] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-08T18:21:08.310934] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-08T18:21:08.354585] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-08T18:21:08.419958] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-08T18:21:08.470981] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-08T18:21:08.528438] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-08T18:21:08.559379] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:08.681049] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:08.702285] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-08T18:21:09.051560] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:09.053025] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-08T18:21:09.055208] [DEBUG] [LOCAL ] DB: Loaded 52522 existing records from primary storage. [2025-10-08T18:21:09.055896] [INFO ] [MAIN ] DB: Loaded 52522 existing records. [2025-10-08T18:21:09.261934] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:09.278309] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-08T18:21:09.280895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:21:09.280989] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-08T18:21:09.293189] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-08T18:21:09.293726] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-08T18:21:09.339031] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-08T18:21:09.676784] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:09.677204] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-08T18:21:10.171124] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:21:10.417564] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-08T18:21:10.799583] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T18:21:11.134292] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:21:11.217548] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-08T18:21:11.258927] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:21:11.313128] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T18:21:12.017586] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-08T18:21:12.525282] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:21:12.817584] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-08T18:21:13.367803] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:21:13.617563] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-08T18:21:14.397558] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:21:14.417505] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-08T18:21:15.217512] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-08T18:21:15.443504] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:21:16.017522] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-08T18:21:16.395534] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T18:21:16.452727] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T18:21:16.817614] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-08T18:21:17.356099] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:21:17.617722] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-08T18:21:18.243030] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T18:21:18.417610] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-08T18:21:19.217573] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-08T18:21:19.268121] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T18:21:19.272149] [INFO ] [REMOTE ] DAR: Full fetch complete (74639 records). [2025-10-08T18:21:19.272271] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-08T18:21:19.666272] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-08T18:21:19.666425] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-08T18:21:19.667360] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-08T18:21:19.667516] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-08T18:21:19.669229] [DEBUG] [LOCAL ] DAR: Trimmed 74639 records to 51876 (keeping 200 days of data) [2025-10-08T18:21:19.777365] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T18:21:20.003083] [DEBUG] [LOCAL ] DAR: Primary data saved (51876 records). [2025-10-08T18:21:20.003250] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-08T18:21:20.003341] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAR took 36.9s. Estimated remaining: 4h 5m 53s. Rate: 7.2 symbols/min [2025-10-08T18:21:20.024194] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-08T18:21:20.176318] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:20.176538] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-08T18:21:20.176594] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-08T18:21:20.176731] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-08T18:21:20.176776] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-08T18:21:20.176817] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-08T18:21:20.176849] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-08T18:21:20.536819] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:20.817515] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-08T18:21:20.848405] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:21:21.572368] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:21:21.617500] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-08T18:21:21.792516] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:21:22.417570] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-08T18:21:22.448870] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:21:23.217605] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-08T18:21:24.017708] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-08T18:21:24.569300] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T18:21:24.640027] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:21:24.817518] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-08T18:21:24.973902] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:21:25.617613] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-08T18:21:26.169783] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:21:26.417582] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-08T18:21:27.222617] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-08T18:21:27.234880] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T18:21:27.483051] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T18:21:28.017517] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-08T18:21:28.817527] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-08T18:21:29.091721] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:21:29.539229] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:21:29.617551] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-08T18:21:30.417528] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-08T18:21:30.759502] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T18:21:30.852972] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:21:31.217507] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-08T18:21:31.605182] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:21:32.017596] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-08T18:21:32.798117] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:21:32.802494] [INFO ] [REMOTE ] DAVA: Full fetch complete (56441 records). [2025-10-08T18:21:32.802621] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-08T18:21:32.827617] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-08T18:21:33.029689] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T18:21:33.244221] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-08T18:21:33.244306] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-08T18:21:33.245002] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-08T18:21:33.245065] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-08T18:21:33.246273] [DEBUG] [LOCAL ] DAVA: Trimmed 56441 records to 41417 (keeping 200 days of data) [2025-10-08T18:21:33.489805] [DEBUG] [LOCAL ] DAVA: Primary data saved (41417 records). [2025-10-08T18:21:33.490068] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-08T18:21:33.490177] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAVA took 26.4s. Estimated remaining: 4h 6m 0s. Rate: 7.2 symbols/min [2025-10-08T18:21:33.626825] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-08T18:21:33.658411] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:33.697236] [DEBUG] [LOCAL ] DBI: Loaded 44391 existing records from primary storage. [2025-10-08T18:21:33.697573] [INFO ] [MAIN ] DBI: Loaded 44391 existing records. [2025-10-08T18:21:33.870681] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:33.870931] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-08T18:21:33.870978] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-08T18:21:33.872331] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-08T18:21:33.872405] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-08T18:21:34.242858] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:34.417601] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-08T18:21:35.217597] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-08T18:21:35.533886] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-08T18:21:36.017579] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-08T18:21:36.263103] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-08T18:21:36.395815] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T18:21:36.773854] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:21:36.817499] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-08T18:21:37.617620] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-08T18:21:38.131468] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:21:38.259866] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T18:21:38.417548] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-08T18:21:39.220298] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-08T18:21:39.226548] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:21:39.564610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:21:40.017536] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-08T18:21:40.815881] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:21:40.826180] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-08T18:21:41.078115] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:21:41.617561] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-08T18:21:42.415291] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:21:42.423701] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-08T18:21:43.200543] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:21:43.217633] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-08T18:21:44.017553] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-08T18:21:44.115011] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:21:44.747502] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:21:44.748724] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:21:44.759076] [INFO ] [REMOTE ] DBD: Full fetch complete (30991 records). [2025-10-08T18:21:44.759304] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-08T18:21:44.760479] [INFO ] [REMOTE ] DB: Full fetch complete (74764 records). [2025-10-08T18:21:44.760237] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:21:44.760854] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:21:44.760958] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:21:44.761054] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-08T18:21:44.761153] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-08T18:21:44.761242] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-08T18:21:44.761349] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-08T18:21:44.761478] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DBD took 24.8s. Estimated remaining: 4h 6m 1s. Rate: 7.2 symbols/min [2025-10-08T18:21:44.767430] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-08T18:21:44.819720] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-08T18:21:45.198289] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:45.413473] [DEBUG] [LOCAL ] DBL: Loaded 9263 existing records from primary storage. [2025-10-08T18:21:45.447027] [INFO ] [MAIN ] DBL: Loaded 9263 existing records. [2025-10-08T18:21:45.619040] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-08T18:21:45.770176] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-08T18:21:45.775020] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-08T18:21:45.774954] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:21:45.776322] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-08T18:21:45.776415] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-08T18:21:45.776603] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-08T18:21:45.776684] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-08T18:21:45.777544] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-08T18:21:45.777618] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-08T18:21:45.809321] [DEBUG] [LOCAL ] DB: Trimmed 74764 records to 52514 (keeping 200 days of data) [2025-10-08T18:21:46.287615] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:46.417542] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-08T18:21:46.507108] [DEBUG] [LOCAL ] DB: Primary data saved (52514 records). [2025-10-08T18:21:46.507249] [INFO ] [MAIN ] DB: Full history saved. [2025-10-08T18:21:46.507334] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 38.3s. Estimated remaining: 4h 5m 33s. Rate: 7.2 symbols/min [2025-10-08T18:21:46.682068] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:46.682260] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-08T18:21:46.682501] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-08T18:21:46.682821] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-08T18:21:46.682897] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-08T18:21:46.683001] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-08T18:21:46.683055] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-08T18:21:46.837114] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T18:21:47.087191] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:47.217558] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-08T18:21:47.341493] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:21:47.373537] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T18:21:48.017614] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-08T18:21:48.584191] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:21:48.730350] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T18:21:48.817556] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-08T18:21:49.617613] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-08T18:21:50.417521] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-08T18:21:50.648529] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:21:51.225146] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-08T18:21:51.243372] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T18:21:51.294724] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:21:52.017580] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-08T18:21:52.794988] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:21:52.817535] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-08T18:21:52.942055] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T18:21:53.617605] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-08T18:21:53.699388] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T18:21:54.417543] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-08T18:21:55.043934] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:21:55.063707] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:21:55.066887] [INFO ] [REMOTE ] DAY: Full fetch complete (71089 records). [2025-10-08T18:21:55.067007] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-08T18:21:55.068093] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:21:55.068225] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:21:55.068279] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:21:55.068323] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-08T18:21:55.068392] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-08T18:21:55.068447] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-08T18:21:55.068508] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-08T18:21:55.068621] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DAY took 47.3s. Estimated remaining: 4h 5m 25s. Rate: 7.2 symbols/min [2025-10-08T18:21:55.218619] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-08T18:21:55.244169] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:21:55.245296] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-08T18:21:55.245360] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-08T18:21:55.245473] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-08T18:21:55.245513] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-08T18:21:55.245554] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-08T18:21:55.245586] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-08T18:21:55.591700] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:21:56.017593] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-08T18:21:56.817600] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-08T18:21:57.021148] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T18:21:57.424709] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:21:57.617598] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-08T18:21:58.417515] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-08T18:21:58.518659] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:21:58.585010] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T18:21:59.217557] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-08T18:22:00.017563] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-08T18:22:00.096077] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T18:22:00.545394] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:22:00.817575] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-08T18:22:01.579264] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:22:01.617573] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-08T18:22:02.256697] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T18:22:02.417561] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-08T18:22:02.675689] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:22:03.215084] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:22:03.217824] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-08T18:22:04.017578] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-08T18:22:04.566043] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:22:04.817604] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-08T18:22:05.124935] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T18:22:05.537761] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:22:05.617563] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-08T18:22:06.092976] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:22:06.417577] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-08T18:22:07.217542] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-08T18:22:08.017535] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-08T18:22:08.058766] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:22:08.817576] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-08T18:22:08.860553] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T18:22:08.888203] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T18:22:09.617592] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-08T18:22:10.417560] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-08T18:22:10.478312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:22:10.481145] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:22:10.481375] [INFO ] [REMOTE ] DBL: Full fetch complete (12479 records). [2025-10-08T18:22:10.491556] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-08T18:22:10.492706] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:22:10.492791] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:22:10.492871] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:22:10.492943] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-08T18:22:10.493007] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-08T18:22:10.493042] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-08T18:22:10.493334] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-08T18:22:10.493427] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 25.7s. Estimated remaining: 4h 5m 39s. Rate: 7.2 symbols/min [2025-10-08T18:22:10.662725] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:10.680152] [DEBUG] [LOCAL ] DCO: Loaded 13934 existing records from primary storage. [2025-10-08T18:22:10.680407] [INFO ] [MAIN ] DCO: Loaded 13934 existing records. [2025-10-08T18:22:10.863967] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:10.864250] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-08T18:22:10.864313] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-08T18:22:10.864803] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-08T18:22:10.864875] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-08T18:22:11.224387] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-08T18:22:11.268989] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:11.527131] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T18:22:12.017765] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-08T18:22:12.817595] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-08T18:22:12.818949] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:22:12.824043] [INFO ] [REMOTE ] DBI: Full fetch complete (65509 records). [2025-10-08T18:22:12.824194] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-08T18:22:13.213577] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:22:13.265103] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-08T18:22:13.265194] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-08T18:22:13.266302] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-08T18:22:13.266388] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-08T18:22:13.268247] [DEBUG] [LOCAL ] DBI: Trimmed 65509 records to 44280 (keeping 200 days of data) [2025-10-08T18:22:13.541495] [DEBUG] [LOCAL ] DBI: Primary data saved (44280 records). [2025-10-08T18:22:13.541640] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-08T18:22:13.541770] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 40.1s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-08T18:22:13.622749] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-08T18:22:13.715581] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:13.767848] [DEBUG] [LOCAL ] DD: Loaded 52861 existing records from primary storage. [2025-10-08T18:22:13.768185] [INFO ] [MAIN ] DD: Loaded 52861 existing records. [2025-10-08T18:22:13.946705] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:13.947113] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-08T18:22:13.947268] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-08T18:22:13.947621] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-08T18:22:13.947718] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-08T18:22:14.319120] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:14.341412] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:22:14.400262] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:22:14.417494] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-08T18:22:15.217611] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-08T18:22:16.017504] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-08T18:22:16.211838] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T18:22:16.665796] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:22:16.774154] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T18:22:16.817506] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-08T18:22:17.617556] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-08T18:22:18.302778] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:22:18.417513] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-08T18:22:19.068106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:22:19.217538] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-08T18:22:20.001536] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:22:20.017485] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-08T18:22:20.752170] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T18:22:20.817538] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-08T18:22:21.223835] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:22:21.226910] [INFO ] [REMOTE ] DCI: Full fetch complete (53678 records). [2025-10-08T18:22:21.227025] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-08T18:22:21.626044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-08T18:22:21.648112] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-08T18:22:21.648261] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-08T18:22:21.649178] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-08T18:22:21.649254] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-08T18:22:21.650682] [DEBUG] [LOCAL ] DCI: Trimmed 53678 records to 37056 (keeping 200 days of data) [2025-10-08T18:22:21.891333] [DEBUG] [LOCAL ] DCI: Primary data saved (37056 records). [2025-10-08T18:22:21.891500] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-08T18:22:21.891593] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DCI took 26.8s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-08T18:22:22.060509] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:22:22.116451] [DEBUG] [LOCAL ] DDD: Loaded 50919 existing records from primary storage. [2025-10-08T18:22:22.116836] [INFO ] [MAIN ] DDD: Loaded 50919 existing records. [2025-10-08T18:22:22.298711] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:22:22.299126] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-08T18:22:22.299270] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-08T18:22:22.299611] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-08T18:22:22.299693] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-08T18:22:22.427727] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-08T18:22:22.685754] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:22:22.716258] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:22:23.217498] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-08T18:22:23.461617] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T18:22:23.462519] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:22:24.017556] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-08T18:22:24.811786] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:22:24.823955] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-08T18:22:25.617534] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-08T18:22:25.717916] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T18:22:26.417523] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-08T18:22:26.497119] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T18:22:26.549418] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:22:27.217612] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-08T18:22:28.021720] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-08T18:22:28.024926] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T18:22:28.144284] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:22:28.817616] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-08T18:22:29.617594] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-08T18:22:29.675446] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:22:29.848948] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T18:22:30.417597] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-08T18:22:30.992167] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:22:31.217608] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-08T18:22:31.497962] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T18:22:32.017565] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-08T18:22:32.817581] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-08T18:22:32.974533] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T18:22:33.547264] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:22:33.617715] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-08T18:22:34.281416] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:22:34.417562] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-08T18:22:34.930081] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:22:34.935261] [INFO ] [REMOTE ] DBRG: Full fetch complete (72365 records). [2025-10-08T18:22:34.935442] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-08T18:22:35.226482] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-08T18:22:35.357870] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-08T18:22:35.358005] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-08T18:22:35.358928] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-08T18:22:35.359007] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-08T18:22:35.360872] [DEBUG] [LOCAL ] DBRG: Trimmed 72365 records to 49813 (keeping 200 days of data) [2025-10-08T18:22:35.679288] [DEBUG] [LOCAL ] DBRG: Primary data saved (49813 records). [2025-10-08T18:22:35.679452] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-08T18:22:35.679531] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DBRG took 49.2s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-08T18:22:35.936216] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:22:36.017544] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-08T18:22:36.817681] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-08T18:22:37.141119] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T18:22:37.617603] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-08T18:22:37.879444] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:22:37.930246] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:22:38.417557] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-08T18:22:39.151448] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:22:39.217558] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-08T18:22:39.420301] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:22:40.017620] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-08T18:22:40.817512] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-08T18:22:40.863127] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T18:22:40.864714] [INFO ] [REMOTE ] DCO: Full fetch complete (18921 records). [2025-10-08T18:22:40.864892] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-08T18:22:40.865591] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:22:40.865783] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:22:40.865918] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:22:40.866043] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-08T18:22:40.866214] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-08T18:22:40.866263] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-08T18:22:40.876579] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-10-08T18:22:40.891468] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 30.4s. Estimated remaining: 4h 4m 57s. Rate: 7.2 symbols/min [2025-10-08T18:22:40.896411] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:22:41.617564] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-08T18:22:42.915141] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T18:22:42.927262] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-08T18:22:43.041013] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:22:43.217563] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-08T18:22:44.664491] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:22:44.669368] [INFO ] [REMOTE ] DD: Full fetch complete (76375 records). [2025-10-08T18:22:44.669876] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-08T18:22:45.154568] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-08T18:22:45.154767] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-08T18:22:45.155677] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-08T18:22:45.155795] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-08T18:22:45.173566] [DEBUG] [LOCAL ] DD: Trimmed 76375 records to 52853 (keeping 200 days of data) [2025-10-08T18:22:45.202406] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T18:22:45.306775] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-08T18:22:45.556959] [DEBUG] [LOCAL ] DD: Primary data saved (52853 records). [2025-10-08T18:22:45.557177] [INFO ] [MAIN ] DD: Full history saved. [2025-10-08T18:22:45.557330] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 32.0s. Estimated remaining: 4h 4m 38s. Rate: 7.2 symbols/min [2025-10-08T18:22:47.261850] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:22:47.274294] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-08T18:22:49.701147] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-08T18:22:49.713979] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-08T18:22:51.672869] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:22:51.685727] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-08T18:23:06.490978] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (14.81 seconds). [2025-10-08T18:23:06.494954] [INFO ] [REMOTE ] DDD: Full fetch complete (73336 records). [2025-10-08T18:23:06.495136] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-08T18:23:06.496561] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:23:06.496758] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:23:06.496825] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:23:06.496890] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-08T18:23:06.497083] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-08T18:23:06.497156] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-10-08T18:23:06.497454] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-10-08T18:23:06.498583] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 44.6s. Estimated remaining: 4h 5m 7s. Rate: 7.2 symbols/min [2025-10-08T18:23:07.145213] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.220971] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.273782] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.316830] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:07.317705] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-08T18:23:07.317798] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-08T18:23:07.317923] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-08T18:23:07.317964] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-08T18:23:07.318005] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-08T18:23:07.318037] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-08T18:23:07.424916] [DEBUG] [LOCAL ] DDS: Loaded 12873 existing records from primary storage. [2025-10-08T18:23:07.441896] [INFO ] [MAIN ] DDS: Loaded 12873 existing records. [2025-10-08T18:23:07.497700] [DEBUG] [LOCAL ] DDL: Loaded 36762 existing records from primary storage. [2025-10-08T18:23:07.529587] [INFO ] [MAIN ] DDL: Loaded 36762 existing records. [2025-10-08T18:23:07.916663] [DEBUG] [LOCAL ] DE: Loaded 47575 existing records from primary storage. [2025-10-08T18:23:08.012457] [INFO ] [MAIN ] DE: Loaded 47575 existing records. [2025-10-08T18:23:08.077353] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.137194] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.174071] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-08T18:23:08.248945] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.307381] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-08T18:23:08.335455] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.326406] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:08.347608] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-08T18:23:08.347175] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-08T18:23:08.347035] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-08T18:23:08.383211] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-08T18:23:08.395618] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-08T18:23:08.580381] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:08.657303] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-08T18:23:08.661708] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-08T18:23:08.715085] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-08T18:23:08.729694] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-08T18:23:09.431283] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.480025] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.480579] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-08T18:23:09.486177] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-08T18:23:09.584083] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:23:09.608576] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-08T18:23:09.655818] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:09.656289] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-08T18:23:10.077793] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:23:10.079593] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-08T18:23:10.681775] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:23:10.682966] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-08T18:23:10.922991] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:23:10.927705] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-08T18:23:11.152454] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T18:23:11.154884] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-08T18:23:11.158071] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:23:11.173126] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-08T18:23:11.282961] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:23:11.297755] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-08T18:23:11.549362] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T18:23:11.553236] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-08T18:23:11.595221] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:23:11.597101] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-08T18:23:12.033474] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:23:12.035226] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-08T18:23:12.184885] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T18:23:12.188005] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-08T18:23:12.364689] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:23:12.365948] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-08T18:23:12.559372] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:23:12.566531] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-08T18:23:12.673726] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:23:12.683722] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-08T18:23:12.710390] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T18:23:12.712202] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-08T18:23:12.862344] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:23:12.866322] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-08T18:23:13.156475] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T18:23:13.157805] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-08T18:23:13.624630] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T18:23:13.629468] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T18:23:13.630405] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-08T18:23:13.640448] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-08T18:23:13.986294] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T18:23:13.990478] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-08T18:23:14.048925] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T18:23:14.049690] [INFO ] [REMOTE ] DDT: Full fetch complete (2849 records). [2025-10-08T18:23:14.049770] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-08T18:23:14.449470] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-08T18:23:14.449625] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-08T18:23:14.449838] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-08T18:23:14.450050] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-08T18:23:14.450766] [DEBUG] [LOCAL ] DDT: Trimmed 2849 records to 2086 (keeping 200 days of data) [2025-10-08T18:23:14.465076] [DEBUG] [LOCAL ] DDT: Primary data saved (2086 records). [2025-10-08T18:23:14.465228] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-08T18:23:14.465329] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 8.0s. Estimated remaining: 4h 4m 58s. Rate: 7.2 symbols/min [2025-10-08T18:23:14.646389] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:14.686569] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:23:14.696796] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-08T18:23:14.738427] [DEBUG] [LOCAL ] DEA: Loaded 40570 existing records from primary storage. [2025-10-08T18:23:14.738935] [INFO ] [MAIN ] DEA: Loaded 40570 existing records. [2025-10-08T18:23:14.943903] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:14.946199] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:23:14.946512] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-08T18:23:14.951224] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-08T18:23:14.951311] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-08T18:23:14.952798] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-08T18:23:14.952894] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-08T18:23:15.354229] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:15.355940] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-08T18:23:15.359620] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:23:15.374902] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-08T18:23:15.901076] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T18:23:15.905757] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-08T18:23:16.296246] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:23:16.307165] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-08T18:23:16.663624] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T18:23:16.674416] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-08T18:23:16.749856] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:23:16.761254] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-08T18:23:16.779249] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T18:23:16.782515] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-08T18:23:17.397902] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T18:23:17.402099] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-08T18:23:17.894918] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T18:23:17.904520] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-08T18:23:18.251827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T18:23:18.262084] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-08T18:23:18.271127] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T18:23:18.274794] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-08T18:23:18.393254] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T18:23:18.405900] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-08T18:23:19.031404] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T18:23:19.038560] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-08T18:23:19.057314] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T18:23:19.058673] [INFO ] [REMOTE ] DDS: Full fetch complete (18837 records). [2025-10-08T18:23:19.058759] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-08T18:23:19.497869] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-08T18:23:19.497982] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-08T18:23:19.498560] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-08T18:23:19.498666] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-08T18:23:19.499546] [DEBUG] [LOCAL ] DDS: Trimmed 18837 records to 12832 (keeping 200 days of data) [2025-10-08T18:23:19.588449] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:23:19.600442] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-08T18:23:19.623310] [DEBUG] [LOCAL ] DDS: Primary data saved (12832 records). [2025-10-08T18:23:19.623424] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-08T18:23:19.623520] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 13.1s. Estimated remaining: 4h 4m 40s. Rate: 7.2 symbols/min [2025-10-08T18:23:19.807539] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:19.841195] [DEBUG] [LOCAL ] DEC: Loaded 30438 existing records from primary storage. [2025-10-08T18:23:19.841522] [INFO ] [MAIN ] DEC: Loaded 30438 existing records. [2025-10-08T18:23:20.024768] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:20.025391] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-08T18:23:20.025474] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-08T18:23:20.025909] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-08T18:23:20.026019] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-08T18:23:20.388540] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T18:23:20.466094] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:20.467365] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-08T18:23:20.468624] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T18:23:20.467707] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-08T18:23:20.817629] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-08T18:23:20.949677] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T18:23:21.310989] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T18:23:21.617569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-08T18:23:21.929007] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:23:22.224537] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:23:22.417605] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-08T18:23:23.205771] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:23:23.217484] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-08T18:23:23.747069] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:23:24.017558] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-08T18:23:24.494310] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:23:24.817604] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-08T18:23:25.617600] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-08T18:23:25.887714] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:23:26.352104] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:23:26.417564] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-08T18:23:26.624254] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:23:27.217552] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-08T18:23:28.017547] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-08T18:23:28.117717] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:23:28.619305] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:23:28.623118] [INFO ] [REMOTE ] DDL: Full fetch complete (53186 records). [2025-10-08T18:23:28.623322] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-08T18:23:28.825154] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-08T18:23:29.039786] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-08T18:23:29.039883] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-08T18:23:29.040555] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-08T18:23:29.040599] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-08T18:23:29.041865] [DEBUG] [LOCAL ] DDL: Trimmed 53186 records to 36794 (keeping 200 days of data) [2025-10-08T18:23:29.258706] [DEBUG] [LOCAL ] DDL: Primary data saved (36794 records). [2025-10-08T18:23:29.258885] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-08T18:23:29.258978] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDL took 22.8s. Estimated remaining: 4h 4m 36s. Rate: 7.2 symbols/min [2025-10-08T18:23:29.446434] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:29.511249] [DEBUG] [LOCAL ] DECK: Loaded 53299 existing records from primary storage. [2025-10-08T18:23:29.511813] [INFO ] [MAIN ] DECK: Loaded 53299 existing records. [2025-10-08T18:23:29.621804] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-08T18:23:29.829618] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:29.829998] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-08T18:23:29.830228] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-08T18:23:29.830861] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-08T18:23:29.830940] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-08T18:23:29.977207] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:23:30.127023] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:23:30.434308] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-08T18:23:30.497556] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:31.217544] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-08T18:23:31.659574] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T18:23:31.814471] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:23:32.017592] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-08T18:23:32.817532] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-08T18:23:33.149201] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:23:33.470439] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T18:23:33.617565] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-08T18:23:34.223808] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:23:34.228613] [INFO ] [REMOTE ] DE: Full fetch complete (69493 records). [2025-10-08T18:23:34.228861] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-08T18:23:34.426318] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-08T18:23:34.689805] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-08T18:23:34.689905] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-08T18:23:34.690725] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-08T18:23:34.690793] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-08T18:23:34.692248] [DEBUG] [LOCAL ] DE: Trimmed 69493 records to 47554 (keeping 200 days of data) [2025-10-08T18:23:35.005406] [DEBUG] [LOCAL ] DE: Primary data saved (47554 records). [2025-10-08T18:23:35.005541] [INFO ] [MAIN ] DE: Full history saved. [2025-10-08T18:23:35.005628] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 28.5s. Estimated remaining: 4h 4m 20s. Rate: 7.2 symbols/min [2025-10-08T18:23:35.169135] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T18:23:35.221924] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-08T18:23:35.224957] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:35.226163] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-08T18:23:35.226236] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-08T18:23:35.226378] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-08T18:23:35.226431] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-08T18:23:35.226488] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-08T18:23:35.226533] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-08T18:23:35.582540] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:36.017533] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-08T18:23:36.129273] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:23:36.556802] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:23:36.817588] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-08T18:23:37.089361] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T18:23:37.617547] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-08T18:23:38.082853] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T18:23:38.417565] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-08T18:23:39.217569] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-08T18:23:39.388271] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T18:23:39.724221] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:23:40.017573] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-08T18:23:40.476878] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:23:40.482344] [INFO ] [REMOTE ] DEA: Full fetch complete (62242 records). [2025-10-08T18:23:40.482543] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-08T18:23:40.822738] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-08T18:23:40.899299] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-08T18:23:40.899408] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-08T18:23:40.900250] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-08T18:23:40.900332] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-08T18:23:40.901932] [DEBUG] [LOCAL ] DEA: Trimmed 62242 records to 40555 (keeping 200 days of data) [2025-10-08T18:23:41.150024] [DEBUG] [LOCAL ] DEA: Primary data saved (40555 records). [2025-10-08T18:23:41.150170] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-08T18:23:41.150261] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 26.7s. Estimated remaining: 4h 4m 6s. Rate: 7.2 symbols/min [2025-10-08T18:23:41.324756] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:41.383795] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-08T18:23:41.384159] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-08T18:23:41.575628] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:23:41.575986] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-08T18:23:41.576405] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-08T18:23:41.577058] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-08T18:23:41.577196] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-08T18:23:41.623091] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-08T18:23:41.781551] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T18:23:42.012293] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:42.312783] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T18:23:42.417629] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-08T18:23:43.217691] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-08T18:23:43.637990] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T18:23:44.017623] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-08T18:23:44.374928] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:23:44.663521] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-08T18:23:44.817572] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-08T18:23:45.617603] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-08T18:23:45.897454] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:23:46.396639] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T18:23:46.417508] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-08T18:23:47.217613] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-08T18:23:47.801442] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-08T18:23:47.850911] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:23:48.017548] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-08T18:23:48.607925] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:23:48.817552] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-08T18:23:49.617549] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-08T18:23:50.026328] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:23:50.030229] [INFO ] [REMOTE ] DEC: Full fetch complete (43823 records). [2025-10-08T18:23:50.030359] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-08T18:23:50.417096] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-08T18:23:50.417208] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-08T18:23:50.417901] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-08T18:23:50.418115] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-08T18:23:50.418011] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-08T18:23:50.421711] [DEBUG] [LOCAL ] DEC: Trimmed 43823 records to 30453 (keeping 200 days of data) [2025-10-08T18:23:50.575136] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-08T18:23:50.681591] [DEBUG] [LOCAL ] DEC: Primary data saved (30453 records). [2025-10-08T18:23:50.681833] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-08T18:23:50.681975] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEC took 31.1s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-08T18:23:50.889126] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:23:50.889494] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-08T18:23:50.889701] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-08T18:23:50.890036] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-08T18:23:50.890163] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-08T18:23:50.890497] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-08T18:23:50.890564] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-08T18:23:51.224737] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-08T18:23:51.246469] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T18:23:51.341932] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:23:52.017573] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-08T18:23:52.635950] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-08T18:23:52.817602] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-08T18:23:53.617526] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-08T18:23:53.695841] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T18:23:53.738617] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:23:54.417579] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-08T18:23:54.674598] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T18:23:55.113120] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:23:55.217558] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-08T18:23:56.017562] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-08T18:23:56.309615] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:23:56.817607] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-08T18:23:57.585392] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T18:23:57.617537] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-08T18:23:58.263879] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-08T18:23:58.417577] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-08T18:23:58.565078] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:23:59.217579] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-08T18:23:59.775678] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T18:23:59.954864] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:24:00.017568] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-08T18:24:00.817528] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-08T18:24:01.161143] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T18:24:01.617576] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-08T18:24:02.400756] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:24:02.417505] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-08T18:24:02.558268] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-08T18:24:03.217603] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-08T18:24:03.303722] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T18:24:03.941464] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:24:04.017506] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-08T18:24:04.817520] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-08T18:24:04.915921] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:24:05.617562] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-08T18:24:05.685108] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:24:06.417559] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-08T18:24:07.082230] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-08T18:24:07.152774] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:24:07.156913] [INFO ] [REMOTE ] DECK: Full fetch complete (76780 records). [2025-10-08T18:24:07.157023] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-08T18:24:07.222794] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-08T18:24:07.557921] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-08T18:24:07.558003] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-08T18:24:07.558884] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-08T18:24:07.558950] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-08T18:24:07.560392] [DEBUG] [LOCAL ] DECK: Trimmed 76780 records to 53291 (keeping 200 days of data) [2025-10-08T18:24:07.707727] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:24:07.924049] [DEBUG] [LOCAL ] DECK: Primary data saved (53291 records). [2025-10-08T18:24:07.924222] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-08T18:24:07.924335] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 38.7s. Estimated remaining: 4h 4m 19s. Rate: 7.2 symbols/min [2025-10-08T18:24:08.023724] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-08T18:24:08.101252] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:08.133560] [DEBUG] [LOCAL ] DFH: Loaded 32149 existing records from primary storage. [2025-10-08T18:24:08.133885] [INFO ] [MAIN ] DFH: Loaded 32149 existing records. [2025-10-08T18:24:08.310131] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:08.310334] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-08T18:24:08.310380] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-08T18:24:08.310723] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-08T18:24:08.310783] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-08T18:24:08.667370] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:08.693623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:24:08.817567] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-08T18:24:09.617623] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-08T18:24:10.422725] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-08T18:24:10.438328] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:24:10.542620] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-08T18:24:11.217541] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-08T18:24:11.555992] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-08T18:24:11.628311] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:24:12.017616] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-08T18:24:12.817701] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-08T18:24:13.133810] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:24:13.137731] [INFO ] [REMOTE ] DEI: Full fetch complete (69400 records). [2025-10-08T18:24:13.137884] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-08T18:24:13.138970] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:24:13.139155] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:24:13.139217] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:24:13.139308] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-08T18:24:13.139423] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-08T18:24:13.139484] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-08T18:24:13.139547] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-10-08T18:24:13.139664] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DEI took 38.1s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-08T18:24:13.327355] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:13.353039] [DEBUG] [LOCAL ] DFIN: Loaded 22891 existing records from primary storage. [2025-10-08T18:24:13.353330] [INFO ] [MAIN ] DFIN: Loaded 22891 existing records. [2025-10-08T18:24:13.533434] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:13.533825] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-08T18:24:13.533935] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-08T18:24:13.534519] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-08T18:24:13.534629] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-08T18:24:13.643331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-08T18:24:13.702813] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-08T18:24:13.949837] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:13.968788] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:24:14.417570] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-08T18:24:15.217613] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-08T18:24:15.444360] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T18:24:15.474402] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T18:24:16.017585] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-08T18:24:16.817577] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-08T18:24:17.183010] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T18:24:17.616837] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-08T18:24:17.621308] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-08T18:24:17.623335] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-08T18:24:17.623621] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-08T18:24:18.041053] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-08T18:24:18.041146] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-08T18:24:18.042106] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-08T18:24:18.042174] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-08T18:24:18.043821] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 53736 (keeping 200 days of data) [2025-10-08T18:24:18.402322] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-08T18:24:18.402487] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-08T18:24:18.402578] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 37.3s. Estimated remaining: 4h 3m 44s. Rate: 7.2 symbols/min [2025-10-08T18:24:18.424173] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-08T18:24:18.606155] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T18:24:18.626102] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:18.654054] [DEBUG] [LOCAL ] DFP: Loaded 11307 existing records from primary storage. [2025-10-08T18:24:18.654358] [INFO ] [MAIN ] DFP: Loaded 11307 existing records. [2025-10-08T18:24:18.844022] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:18.844311] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-08T18:24:18.844360] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-08T18:24:18.844612] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-08T18:24:18.844712] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-08T18:24:19.210680] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:24:19.220515] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-08T18:24:19.241205] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:19.664382] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T18:24:20.017591] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-08T18:24:20.686176] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:24:20.689639] [INFO ] [REMOTE ] DEO: Full fetch complete (71157 records). [2025-10-08T18:24:20.689834] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-08T18:24:20.690536] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:24:20.690678] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:24:20.690755] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:24:20.690851] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-08T18:24:20.690934] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-08T18:24:20.690970] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-08T18:24:20.691009] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-08T18:24:20.691070] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 30.0s. Estimated remaining: 4h 3m 19s. Rate: 7.2 symbols/min [2025-10-08T18:24:20.823851] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-08T18:24:20.904213] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:20.904414] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-08T18:24:20.904462] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-08T18:24:20.904588] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-08T18:24:20.904629] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-08T18:24:20.904731] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-08T18:24:20.904773] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-08T18:24:21.186147] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:24:21.290389] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:21.617631] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-08T18:24:22.262834] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:24:22.285748] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:24:22.417634] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-08T18:24:23.171824] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:24:23.217591] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-08T18:24:24.017573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-08T18:24:24.817606] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-08T18:24:25.155838] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T18:24:25.411514] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T18:24:25.617537] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-08T18:24:25.691494] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T18:24:26.417550] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-08T18:24:26.700958] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T18:24:27.217575] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-08T18:24:27.247151] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T18:24:28.017535] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-08T18:24:28.456515] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:24:28.707567] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T18:24:28.817570] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-08T18:24:29.345390] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T18:24:29.617546] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-08T18:24:30.417595] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-08T18:24:30.833905] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T18:24:30.973638] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T18:24:31.217625] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-08T18:24:32.017570] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-08T18:24:32.244976] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:24:32.817555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-08T18:24:33.617568] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-08T18:24:34.010370] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T18:24:34.191284] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:24:34.217207] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:24:34.417560] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-08T18:24:35.217659] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-08T18:24:35.296616] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T18:24:36.017557] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-08T18:24:36.323932] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T18:24:36.518173] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T18:24:36.817555] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-08T18:24:37.617588] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-08T18:24:37.940726] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:24:38.417573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-08T18:24:39.217579] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-08T18:24:39.517474] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:24:39.623553] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:24:39.626048] [INFO ] [REMOTE ] DFH: Full fetch complete (48308 records). [2025-10-08T18:24:39.626153] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-08T18:24:39.944219] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:24:39.956140] [INFO ] [REMOTE ] DFP: Full fetch complete (15982 records). [2025-10-08T18:24:39.966465] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-08T18:24:40.023214] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-08T18:24:40.099084] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-08T18:24:40.105438] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-08T18:24:40.112257] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-08T18:24:40.135605] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-08T18:24:40.184993] [DEBUG] [LOCAL ] DFH: Trimmed 48308 records to 32083 (keeping 200 days of data) [2025-10-08T18:24:40.513316] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-08T18:24:40.513421] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-08T18:24:40.514154] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-08T18:24:40.514513] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-08T18:24:40.517170] [DEBUG] [LOCAL ] DFP: Trimmed 15982 records to 11313 (keeping 200 days of data) [2025-10-08T18:24:40.662104] [DEBUG] [LOCAL ] DFP: Primary data saved (11313 records). [2025-10-08T18:24:40.663989] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-08T18:24:40.664154] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 22.3s. Estimated remaining: 4h 3m 44s. Rate: 7.2 symbols/min [2025-10-08T18:24:40.821933] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-08T18:24:40.851013] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:40.859779] [DEBUG] [LOCAL ] DFH: Primary data saved (32083 records). [2025-10-08T18:24:40.860308] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-08T18:24:40.860403] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 32.9s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-08T18:24:41.046011] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:41.046318] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-08T18:24:41.046376] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-08T18:24:41.046492] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-08T18:24:41.046536] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-08T18:24:41.046578] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-08T18:24:41.046610] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-08T18:24:41.165703] [DEBUG] [LOCAL ] DGX: Loaded 44803 existing records from primary storage. [2025-10-08T18:24:41.205224] [INFO ] [MAIN ] DGX: Loaded 44803 existing records. [2025-10-08T18:24:41.537384] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:24:41.608220] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:41.634801] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-08T18:24:41.639317] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:41.640573] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-08T18:24:41.640623] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-08T18:24:41.640987] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-08T18:24:41.641043] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-08T18:24:42.002257] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:42.417525] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-08T18:24:42.567190] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T18:24:42.825183] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T18:24:43.217573] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-08T18:24:43.671568] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T18:24:44.017524] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-08T18:24:44.033628] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:24:44.817574] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-08T18:24:45.617573] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-08T18:24:45.942143] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T18:24:46.143301] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:24:46.381097] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T18:24:46.417538] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-08T18:24:47.217577] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-08T18:24:48.017514] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-08T18:24:48.137128] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:24:48.265513] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:24:48.268929] [INFO ] [REMOTE ] DFIN: Full fetch complete (33512 records). [2025-10-08T18:24:48.269040] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-08T18:24:48.643415] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-08T18:24:48.643494] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-08T18:24:48.644025] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-08T18:24:48.644087] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-08T18:24:48.644924] [DEBUG] [LOCAL ] DFIN: Trimmed 33512 records to 22871 (keeping 200 days of data) [2025-10-08T18:24:48.779337] [DEBUG] [LOCAL ] DFIN: Primary data saved (22871 records). [2025-10-08T18:24:48.779501] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-08T18:24:48.779606] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DFIN took 35.6s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-08T18:24:48.822442] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-08T18:24:48.933222] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:24:48.968749] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:24:49.032547] [DEBUG] [LOCAL ] DHI: Loaded 53341 existing records from primary storage. [2025-10-08T18:24:49.033016] [INFO ] [MAIN ] DHI: Loaded 53341 existing records. [2025-10-08T18:24:49.208886] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:24:49.209130] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-08T18:24:49.209177] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-08T18:24:49.209449] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-08T18:24:49.209507] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-08T18:24:49.565984] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:24:49.617509] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-08T18:24:50.417586] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-08T18:24:50.974685] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-08T18:24:51.222701] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-08T18:24:51.242765] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:24:51.839260] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:24:52.017570] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-08T18:24:52.817585] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-08T18:24:53.147697] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:24:53.427162] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:24:53.476867] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:24:53.617543] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-08T18:24:54.417623] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-08T18:24:55.217564] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-08T18:24:55.418065] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T18:24:55.828973] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T18:24:56.017590] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-08T18:24:56.817753] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-08T18:24:57.309632] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T18:24:57.617562] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-08T18:24:57.855431] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:24:57.899931] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:24:58.417619] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-08T18:24:59.203328] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:24:59.217482] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-08T18:24:59.533018] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T18:25:00.017632] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-08T18:25:00.817568] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-08T18:25:01.561177] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T18:25:01.617557] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-08T18:25:02.027177] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T18:25:02.285335] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-08T18:25:02.417586] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-08T18:25:03.217585] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-08T18:25:03.248468] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:25:03.254871] [INFO ] [REMOTE ] DG: Full fetch complete (76818 records). [2025-10-08T18:25:03.255004] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-08T18:25:03.259090] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:25:03.259197] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:25:03.259241] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:25:03.259282] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-08T18:25:03.259354] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-08T18:25:03.259409] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-08T18:25:03.259451] [DEBUG] [LOCAL ] DG: No derivative data file found to delete. [2025-10-08T18:25:03.259513] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 42.6s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-08T18:25:03.435864] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:03.489732] [DEBUG] [LOCAL ] DHR: Loaded 53382 existing records from primary storage. [2025-10-08T18:25:03.490066] [INFO ] [MAIN ] DHR: Loaded 53382 existing records. [2025-10-08T18:25:03.669737] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:03.670184] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-08T18:25:03.670300] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-08T18:25:03.670826] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-08T18:25:03.670884] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-08T18:25:04.028102] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-08T18:25:04.032964] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:04.058344] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:25:04.817524] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-08T18:25:04.859865] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:25:05.063216] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T18:25:05.617555] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-08T18:25:06.417583] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-08T18:25:06.592444] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T18:25:07.217710] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-08T18:25:07.508910] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T18:25:08.017505] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-08T18:25:08.052116] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:25:08.293561] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T18:25:08.817616] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-08T18:25:09.617522] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-08T18:25:09.832013] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:25:10.005803] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:25:10.417563] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-08T18:25:11.205442] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T18:25:11.217491] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-08T18:25:12.017529] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-08T18:25:12.376015] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T18:25:12.734110] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:25:12.817521] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-08T18:25:12.852386] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T18:25:13.617551] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-08T18:25:14.406986] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:25:14.417487] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-08T18:25:15.043473] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:25:15.046969] [INFO ] [REMOTE ] DGX: Full fetch complete (65136 records). [2025-10-08T18:25:15.047067] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-08T18:25:15.226602] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-08T18:25:15.444731] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-08T18:25:15.444818] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-08T18:25:15.445597] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-08T18:25:15.445693] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-08T18:25:15.446945] [DEBUG] [LOCAL ] DGX: Trimmed 65136 records to 44756 (keeping 200 days of data) [2025-10-08T18:25:15.725413] [DEBUG] [LOCAL ] DGX: Primary data saved (44756 records). [2025-10-08T18:25:15.725543] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-08T18:25:15.725668] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DGX took 35.1s. Estimated remaining: 4h 3m 16s. Rate: 7.2 symbols/min [2025-10-08T18:25:15.895200] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:15.939423] [DEBUG] [LOCAL ] DHT: Loaded 47896 existing records from primary storage. [2025-10-08T18:25:15.939803] [INFO ] [MAIN ] DHT: Loaded 47896 existing records. [2025-10-08T18:25:16.020090] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-08T18:25:16.131224] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:16.131513] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-08T18:25:16.131583] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-08T18:25:16.132005] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-08T18:25:16.132062] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-08T18:25:16.248029] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T18:25:16.513010] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:16.545356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:25:16.817548] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-08T18:25:17.617531] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-08T18:25:17.754502] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:25:18.417534] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-08T18:25:18.762153] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T18:25:18.791800] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:25:18.794220] [INFO ] [REMOTE ] DHF: Full fetch complete (29975 records). [2025-10-08T18:25:18.794342] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-08T18:25:18.795228] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:25:18.795344] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:25:18.795407] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:25:18.795452] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-08T18:25:18.795537] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-08T18:25:18.795595] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-08T18:25:18.795672] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-10-08T18:25:18.795773] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHF took 37.9s. Estimated remaining: 4h 2m 53s. Rate: 7.2 symbols/min [2025-10-08T18:25:18.975938] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:18.990775] [DEBUG] [LOCAL ] DHX: Loaded 12971 existing records from primary storage. [2025-10-08T18:25:18.991033] [INFO ] [MAIN ] DHX: Loaded 12971 existing records. [2025-10-08T18:25:19.167479] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:19.167752] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-08T18:25:19.167805] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-08T18:25:19.168006] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-08T18:25:19.168063] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-08T18:25:19.229948] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-08T18:25:19.535733] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:20.017527] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-08T18:25:20.456346] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T18:25:20.811748] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:25:20.817483] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-08T18:25:21.058898] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:25:21.594535] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:25:21.617490] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-08T18:25:22.417559] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-08T18:25:22.713866] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:25:23.217577] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-08T18:25:24.017544] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-08T18:25:24.099097] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T18:25:24.817556] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-08T18:25:25.572572] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:25:25.617512] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-08T18:25:25.741286] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-08T18:25:26.330793] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:25:26.417568] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-08T18:25:27.103817] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:25:27.217509] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-08T18:25:28.017523] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-08T18:25:28.480743] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:25:28.795359] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:25:28.817495] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-08T18:25:29.617618] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-08T18:25:29.844301] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T18:25:30.144204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T18:25:30.285770] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:25:30.417539] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-08T18:25:31.217615] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-08T18:25:31.882593] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:25:32.017563] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-08T18:25:32.817565] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-08T18:25:32.921746] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:25:32.925730] [INFO ] [REMOTE ] DHI: Full fetch complete (77206 records). [2025-10-08T18:25:32.925907] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-08T18:25:33.352298] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-08T18:25:33.352548] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-08T18:25:33.353560] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-08T18:25:33.353689] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-08T18:25:33.355555] [DEBUG] [LOCAL ] DHI: Trimmed 77206 records to 53342 (keeping 200 days of data) [2025-10-08T18:25:33.492865] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:25:33.617684] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-08T18:25:33.736790] [DEBUG] [LOCAL ] DHI: Primary data saved (53342 records). [2025-10-08T18:25:33.736953] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-08T18:25:33.738075] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHI took 45.0s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-08T18:25:33.934203] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:33.945933] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:25:33.963140] [DEBUG] [LOCAL ] DIAX: Loaded 13133 existing records from primary storage. [2025-10-08T18:25:33.963402] [INFO ] [MAIN ] DIAX: Loaded 13133 existing records. [2025-10-08T18:25:34.161356] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:34.161667] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-08T18:25:34.161729] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-08T18:25:34.161985] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-08T18:25:34.162045] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-08T18:25:34.425437] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-08T18:25:34.603785] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:35.052525] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T18:25:35.217540] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-08T18:25:35.893289] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:25:36.017577] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-08T18:25:36.817540] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-08T18:25:36.891176] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:25:37.617619] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-08T18:25:37.764947] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:25:38.030231] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T18:25:38.417560] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-08T18:25:39.111584] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:25:39.115767] [INFO ] [REMOTE ] DHR: Full fetch complete (77277 records). [2025-10-08T18:25:39.115882] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-08T18:25:39.222728] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-08T18:25:39.410114] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T18:25:39.448206] [INFO ] [REMOTE ] DHT: Full fetch complete (69934 records). [2025-10-08T18:25:39.458618] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-08T18:25:39.668580] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-08T18:25:39.690009] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-08T18:25:39.701208] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-08T18:25:39.701346] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-08T18:25:39.759248] [DEBUG] [LOCAL ] DHR: Trimmed 77277 records to 53383 (keeping 200 days of data) [2025-10-08T18:25:40.020149] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-08T18:25:40.115807] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-08T18:25:40.117864] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-08T18:25:40.120398] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-08T18:25:40.121209] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-08T18:25:40.132130] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:25:40.141411] [DEBUG] [LOCAL ] DHT: Trimmed 69934 records to 47880 (keeping 200 days of data) [2025-10-08T18:25:40.687516] [DEBUG] [LOCAL ] DHT: Primary data saved (47880 records). [2025-10-08T18:25:40.698117] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-08T18:25:40.699920] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHT took 25.0s. Estimated remaining: 4h 2m 51s. Rate: 7.2 symbols/min [2025-10-08T18:25:40.758799] [DEBUG] [LOCAL ] DHR: Primary data saved (53383 records). [2025-10-08T18:25:40.790500] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-08T18:25:40.821600] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:25:40.821731] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-08T18:25:40.822044] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 37.6s. Estimated remaining: 4h 2m 20s. Rate: 7.2 symbols/min [2025-10-08T18:25:41.038127] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:41.041461] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-10-08T18:25:41.041879] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-10-08T18:25:41.057836] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-08T18:25:41.063069] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-08T18:25:41.068318] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-08T18:25:41.082957] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-08T18:25:41.189619] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:41.527429] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:41.529168] [DEBUG] [LOCAL ] DINO: Loaded 52913 existing records from primary storage. [2025-10-08T18:25:41.529534] [INFO ] [MAIN ] DINO: Loaded 52913 existing records. [2025-10-08T18:25:41.622101] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-08T18:25:41.725764] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:25:41.726050] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-08T18:25:41.726156] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-08T18:25:41.726505] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-08T18:25:41.726562] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-08T18:25:41.844800] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:25:42.111339] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:25:42.388258] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T18:25:42.417553] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-08T18:25:43.217546] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-08T18:25:44.017552] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-08T18:25:44.335103] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:25:44.570300] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T18:25:44.765134] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:25:44.817495] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-08T18:25:45.617599] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-08T18:25:46.417566] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-08T18:25:46.729489] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:25:46.748306] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:25:47.217551] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-08T18:25:47.607173] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:25:48.017584] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-08T18:25:48.822679] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-08T18:25:48.842110] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:25:49.092166] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T18:25:49.617561] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-08T18:25:49.845395] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T18:25:50.160898] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:25:50.417612] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-08T18:25:51.217567] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-08T18:25:52.017521] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-08T18:25:52.235976] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:25:52.728464] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:25:52.745071] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:25:52.817543] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-08T18:25:53.494116] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:25:53.617587] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-08T18:25:54.417534] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-08T18:25:54.481998] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:25:55.217568] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-08T18:25:56.017540] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-08T18:25:56.177308] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:25:56.262133] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:25:56.817514] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-08T18:25:56.850323] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T18:25:57.617561] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-08T18:25:58.297165] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T18:25:58.347333] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T18:25:58.417560] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-08T18:25:59.210385] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T18:25:59.211794] [INFO ] [REMOTE ] DHX: Full fetch complete (20690 records). [2025-10-08T18:25:59.211865] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-08T18:25:59.222956] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-08T18:25:59.588483] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-08T18:25:59.588606] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-08T18:25:59.589207] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-08T18:25:59.589267] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-08T18:25:59.589957] [DEBUG] [LOCAL ] DHX: Trimmed 20690 records to 12939 (keeping 200 days of data) [2025-10-08T18:25:59.662220] [DEBUG] [LOCAL ] DHX: Primary data saved (12939 records). [2025-10-08T18:25:59.662369] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-08T18:25:59.662455] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHX took 40.9s. Estimated remaining: 4h 2m 41s. Rate: 7.2 symbols/min [2025-10-08T18:25:59.842507] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:25:59.898298] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-08T18:25:59.898839] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-08T18:26:00.022629] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-08T18:26:00.104170] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:00.104396] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-08T18:26:00.104462] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-08T18:26:00.104788] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-08T18:26:00.104850] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-08T18:26:00.469929] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:00.817552] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-08T18:26:01.284684] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:26:01.305959] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:26:01.307612] [INFO ] [REMOTE ] DIAX: Full fetch complete (17795 records). [2025-10-08T18:26:01.307710] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-08T18:26:01.622752] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-08T18:26:01.698399] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-08T18:26:01.698553] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-08T18:26:01.699074] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-08T18:26:01.699138] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-08T18:26:01.699910] [DEBUG] [LOCAL ] DIAX: Trimmed 17795 records to 13144 (keeping 200 days of data) [2025-10-08T18:26:01.798062] [DEBUG] [LOCAL ] DIAX: Primary data saved (13144 records). [2025-10-08T18:26:01.798221] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-08T18:26:01.798315] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 28.1s. Estimated remaining: 4h 2m 15s. Rate: 7.2 symbols/min [2025-10-08T18:26:02.001503] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:02.001739] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-08T18:26:02.001789] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-08T18:26:02.001910] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-08T18:26:02.002016] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-08T18:26:02.002101] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-08T18:26:02.002158] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-08T18:26:02.385722] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:02.417504] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-08T18:26:02.862804] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T18:26:03.217527] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-08T18:26:03.353423] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:26:03.426363] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-08T18:26:04.017551] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-08T18:26:04.429189] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T18:26:04.817581] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-08T18:26:05.182619] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-08T18:26:05.617569] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-08T18:26:06.036879] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T18:26:06.417533] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-08T18:26:06.480176] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-08T18:26:07.217549] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-08T18:26:08.034062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-08T18:26:08.040687] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:26:08.817545] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-08T18:26:09.524051] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T18:26:09.562852] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-08T18:26:09.617524] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-08T18:26:09.642599] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:26:10.026244] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T18:26:10.417553] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-08T18:26:11.217628] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-08T18:26:11.840447] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:26:12.017596] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-08T18:26:12.633400] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T18:26:12.817579] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-08T18:26:13.292454] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T18:26:13.341766] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T18:26:13.617576] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-08T18:26:13.969222] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:26:14.417624] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-08T18:26:15.217563] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-08T18:26:15.578478] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T18:26:16.017581] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-08T18:26:16.130347] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T18:26:16.817562] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-08T18:26:17.176371] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T18:26:17.617577] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-08T18:26:17.952854] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T18:26:18.417681] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-08T18:26:18.638532] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:26:18.642592] [INFO ] [REMOTE ] DINO: Full fetch complete (76633 records). [2025-10-08T18:26:18.642776] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-08T18:26:19.033690] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-08T18:26:19.033789] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-08T18:26:19.034838] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-08T18:26:19.034905] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-08T18:26:19.036480] [DEBUG] [LOCAL ] DINO: Trimmed 76633 records to 52894 (keeping 200 days of data) [2025-10-08T18:26:19.226190] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-08T18:26:19.385907] [DEBUG] [LOCAL ] DINO: Primary data saved (52894 records). [2025-10-08T18:26:19.386145] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-08T18:26:19.386250] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DINO took 38.5s. Estimated remaining: 4h 2m 33s. Rate: 7.2 symbols/min [2025-10-08T18:26:19.565754] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:19.612608] [DEBUG] [LOCAL ] DK: Loaded 49328 existing records from primary storage. [2025-10-08T18:26:19.612962] [INFO ] [MAIN ] DK: Loaded 49328 existing records. [2025-10-08T18:26:19.796490] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:19.796845] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-08T18:26:19.796896] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-08T18:26:19.797145] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-08T18:26:19.797204] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-08T18:26:19.931837] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:26:19.963862] [INFO ] [REMOTE ] DIN: Full fetch complete (55245 records). [2025-10-08T18:26:19.989669] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-08T18:26:20.023105] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-08T18:26:20.373975] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:20.528005] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T18:26:20.626961] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-08T18:26:20.627060] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-08T18:26:20.627857] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-08T18:26:20.627924] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-08T18:26:20.629288] [DEBUG] [LOCAL ] DIN: Trimmed 55245 records to 37280 (keeping 200 days of data) [2025-10-08T18:26:20.829584] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-08T18:26:20.864438] [DEBUG] [LOCAL ] DIN: Primary data saved (37280 records). [2025-10-08T18:26:20.864592] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-08T18:26:20.864737] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIN took 40.2s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-08T18:26:21.058863] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:21.080270] [DEBUG] [LOCAL ] DKL: Loaded 18057 existing records from primary storage. [2025-10-08T18:26:21.080555] [INFO ] [MAIN ] DKL: Loaded 18057 existing records. [2025-10-08T18:26:21.275347] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:21.275626] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-08T18:26:21.275719] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-08T18:26:21.276378] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-08T18:26:21.276440] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-08T18:26:21.350004] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:26:21.373300] [INFO ] [REMOTE ] DIVY: Full fetch complete (1708 records). [2025-10-08T18:26:21.397122] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-08T18:26:21.624357] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-08T18:26:21.838441] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T18:26:21.898408] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:21.898586] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:26:21.898815] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:26:21.899134] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-08T18:26:21.899227] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-08T18:26:21.899280] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-08T18:26:21.899451] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-08T18:26:21.899548] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIVY took 20.1s. Estimated remaining: 4h 1m 37s. Rate: 7.2 symbols/min [2025-10-08T18:26:22.073548] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:22.107396] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-08T18:26:22.173821] [DEBUG] [LOCAL ] DKS: Loaded 49700 existing records from primary storage. [2025-10-08T18:26:22.174194] [INFO ] [MAIN ] DKS: Loaded 49700 existing records. [2025-10-08T18:26:22.351238] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:22.351483] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-08T18:26:22.351529] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-08T18:26:22.351965] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-08T18:26:22.352021] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-08T18:26:22.425004] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-08T18:26:22.715211] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:23.051012] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:26:23.217577] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-08T18:26:23.620520] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:26:24.017573] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-08T18:26:24.817617] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-08T18:26:25.298287] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T18:26:25.617530] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-08T18:26:25.644665] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T18:26:26.417579] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-08T18:26:26.853998] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:26:27.217575] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-08T18:26:27.914018] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T18:26:28.019702] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-08T18:26:28.025936] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-08T18:26:28.762304] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T18:26:28.817615] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-08T18:26:29.617541] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-08T18:26:29.689836] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:26:30.422722] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-08T18:26:30.444684] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:26:31.217510] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-08T18:26:31.590017] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:26:32.017530] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-08T18:26:32.066528] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-08T18:26:32.817578] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-08T18:26:32.984260] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:26:33.617564] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-08T18:26:33.750217] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T18:26:33.896478] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T18:26:34.417554] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-08T18:26:35.217505] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-08T18:26:35.336985] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:26:35.967868] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T18:26:36.017547] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-08T18:26:36.780937] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:26:36.817512] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-08T18:26:37.316407] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:26:37.617575] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-08T18:26:38.417549] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-08T18:26:38.723147] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T18:26:39.217579] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-08T18:26:39.976147] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T18:26:40.015701] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-08T18:26:40.025869] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-08T18:26:40.582378] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T18:26:40.817532] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-08T18:26:41.155956] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:26:41.617569] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-08T18:26:42.271486] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T18:26:42.417524] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-08T18:26:43.226321] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-08T18:26:43.232073] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:26:43.467069] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:26:44.017562] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-08T18:26:44.817557] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-08T18:26:44.962243] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:26:45.617597] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-08T18:26:46.241139] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:26:46.417503] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-08T18:26:46.451159] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-08T18:26:47.217526] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-08T18:26:47.410885] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T18:26:47.655399] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:26:47.761534] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T18:26:48.017569] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-08T18:26:48.817607] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-08T18:26:49.617586] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-08T18:26:49.814430] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T18:26:49.819555] [INFO ] [REMOTE ] DKS: Full fetch complete (71638 records). [2025-10-08T18:26:49.819869] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-08T18:26:50.217064] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-08T18:26:50.217188] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-08T18:26:50.218131] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-08T18:26:50.218201] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-08T18:26:50.222678] [DEBUG] [LOCAL ] DKS: Trimmed 71638 records to 49707 (keeping 200 days of data) [2025-10-08T18:26:50.423216] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-08T18:26:50.555509] [DEBUG] [LOCAL ] DKS: Primary data saved (49707 records). [2025-10-08T18:26:50.555708] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-08T18:26:50.556824] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKS took 28.7s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-08T18:26:50.725930] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:50.765218] [DEBUG] [LOCAL ] DLB: Loaded 32090 existing records from primary storage. [2025-10-08T18:26:50.765532] [INFO ] [MAIN ] DLB: Loaded 32090 existing records. [2025-10-08T18:26:50.962813] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-08T18:26:50.961243] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:50.967038] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-08T18:26:50.967379] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-08T18:26:50.967285] [INFO ] [REMOTE ] DIS: Full fetch complete (77555 records). [2025-10-08T18:26:50.967715] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-08T18:26:50.967922] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-08T18:26:50.968001] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-08T18:26:51.011421] [FATAL] [VALIDATOR ] DIS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:26:51.067710] [FATAL] [MAIN ] DIS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:26:51.072176] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:26:51.072388] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-08T18:26:51.072918] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-08T18:26:51.072988] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-08T18:26:51.083887] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-08T18:26:51.094330] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DIS took 51.4s. Estimated remaining: 4h 1m 55s. Rate: 7.2 symbols/min [2025-10-08T18:26:51.511181] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:51.517740] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:26:51.554920] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:51.557962] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-08T18:26:51.593157] [DEBUG] [LOCAL ] DLNG: Loaded 6093 existing records from primary storage. [2025-10-08T18:26:51.593439] [INFO ] [MAIN ] DLNG: Loaded 6093 existing records. [2025-10-08T18:26:51.639157] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T18:26:51.784261] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:51.784510] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-08T18:26:51.784557] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-08T18:26:51.784765] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-08T18:26:51.784825] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-08T18:26:52.030332] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-08T18:26:52.149740] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:52.817517] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-08T18:26:52.879380] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:26:52.976539] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:26:53.617530] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-08T18:26:53.652794] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T18:26:54.388484] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T18:26:54.389865] [INFO ] [REMOTE ] DKL: Full fetch complete (28087 records). [2025-10-08T18:26:54.389958] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-08T18:26:54.422805] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-08T18:26:54.772007] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-08T18:26:54.772089] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-08T18:26:54.772573] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-08T18:26:54.772612] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-08T18:26:54.773325] [DEBUG] [LOCAL ] DKL: Trimmed 28087 records to 17900 (keeping 200 days of data) [2025-10-08T18:26:54.884182] [DEBUG] [LOCAL ] DKL: Primary data saved (17900 records). [2025-10-08T18:26:54.884341] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-08T18:26:54.884454] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKL took 34.0s. Estimated remaining: 4h 1m 35s. Rate: 7.2 symbols/min [2025-10-08T18:26:55.053352] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:55.108501] [DEBUG] [LOCAL ] DLR: Loaded 50862 existing records from primary storage. [2025-10-08T18:26:55.108901] [INFO ] [MAIN ] DLR: Loaded 50862 existing records. [2025-10-08T18:26:55.217528] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-08T18:26:55.306439] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:55.306853] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-08T18:26:55.306917] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-08T18:26:55.307144] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-08T18:26:55.307191] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-08T18:26:55.569732] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T18:26:55.690394] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:26:56.017630] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-08T18:26:56.734720] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:26:56.817529] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-08T18:26:57.617605] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-08T18:26:57.840223] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:26:58.218819] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:26:58.417689] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-08T18:26:58.867918] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T18:26:58.873382] [INFO ] [REMOTE ] DK: Full fetch complete (70849 records). [2025-10-08T18:26:58.873577] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-08T18:26:59.013976] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T18:26:59.222691] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-08T18:26:59.301554] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-08T18:26:59.301685] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-08T18:26:59.302567] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-08T18:26:59.302619] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-08T18:26:59.304307] [DEBUG] [LOCAL ] DK: Trimmed 70849 records to 49326 (keeping 200 days of data) [2025-10-08T18:26:59.609790] [DEBUG] [LOCAL ] DK: Primary data saved (49326 records). [2025-10-08T18:26:59.609950] [INFO ] [MAIN ] DK: Full history saved. [2025-10-08T18:26:59.610037] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DK took 40.2s. Estimated remaining: 4h 1m 16s. Rate: 7.2 symbols/min [2025-10-08T18:26:59.782013] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:26:59.812980] [DEBUG] [LOCAL ] DLX: Loaded 28517 existing records from primary storage. [2025-10-08T18:26:59.813278] [INFO ] [MAIN ] DLX: Loaded 28517 existing records. [2025-10-08T18:26:59.987963] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:26:59.988248] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-08T18:26:59.988311] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-08T18:26:59.988551] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-08T18:26:59.988616] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-08T18:27:00.022776] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-08T18:27:00.350318] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:00.630388] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T18:27:00.817571] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-08T18:27:01.617574] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-08T18:27:01.973955] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T18:27:02.058765] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:27:02.067158] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:27:02.417585] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-08T18:27:03.217623] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-08T18:27:03.873963] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:27:04.017573] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-08T18:27:04.271110] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:27:04.817554] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-08T18:27:05.556749] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:27:05.618084] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-08T18:27:05.618011] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:27:05.726192] [DEBUG] [REMOTE ] DLNG: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-08T18:27:05.726489] [WARN ] [REMOTE ] DLNG: No data returned for month 2025-04 [2025-10-08T18:27:05.726582] [FATAL] [REMOTE ] DLNG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:27:05.726716] [FATAL] [MAIN ] DLNG: Failed to fetch primary data. [2025-10-08T18:27:05.726785] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:27:05.726860] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-08T18:27:05.726925] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-08T18:27:05.726959] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-08T18:27:05.727126] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-10-08T18:27:05.727212] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLNG took 14.6s. Estimated remaining: 4h 1m 2s. Rate: 7.2 symbols/min [2025-10-08T18:27:05.902508] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:05.926317] [DEBUG] [LOCAL ] DLY: Loaded 20249 existing records from primary storage. [2025-10-08T18:27:05.926692] [INFO ] [MAIN ] DLY: Loaded 20249 existing records. [2025-10-08T18:27:06.116498] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:06.116778] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-08T18:27:06.116840] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-08T18:27:06.117077] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-08T18:27:06.117136] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-08T18:27:06.422737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-08T18:27:06.480317] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:07.217498] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-08T18:27:07.710048] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:27:08.017557] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-08T18:27:08.246964] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:27:08.817570] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-08T18:27:09.617554] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-08T18:27:09.863347] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T18:27:09.984057] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T18:27:10.417569] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-08T18:27:10.838434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T18:27:11.217622] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-08T18:27:11.699275] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:27:12.017580] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-08T18:27:12.732500] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:27:12.817549] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-08T18:27:13.483164] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:27:13.617625] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-08T18:27:14.417600] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-08T18:27:14.649013] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:27:14.969383] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T18:27:15.217527] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-08T18:27:15.953725] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:27:16.017600] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-08T18:27:16.354771] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:27:16.817620] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-08T18:27:17.617513] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-08T18:27:17.734227] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:27:18.116128] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:27:18.417587] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-08T18:27:18.647905] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T18:27:19.217602] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-08T18:27:19.774424] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:27:19.778779] [INFO ] [REMOTE ] DLB: Full fetch complete (47073 records). [2025-10-08T18:27:19.778887] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-08T18:27:20.022775] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-08T18:27:20.183506] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-08T18:27:20.183596] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-08T18:27:20.184270] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-08T18:27:20.184332] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-08T18:27:20.185393] [DEBUG] [LOCAL ] DLB: Trimmed 47073 records to 32096 (keeping 200 days of data) [2025-10-08T18:27:20.388812] [DEBUG] [LOCAL ] DLB: Primary data saved (32096 records). [2025-10-08T18:27:20.388964] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-08T18:27:20.389059] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 29.8s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-08T18:27:20.517716] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:27:20.584256] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:20.591862] [DEBUG] [LOCAL ] DMA: Loaded 4585 existing records from primary storage. [2025-10-08T18:27:20.592037] [INFO ] [MAIN ] DMA: Loaded 4585 existing records. [2025-10-08T18:27:20.771809] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:20.772075] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-08T18:27:20.772143] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-08T18:27:20.772446] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-08T18:27:20.772504] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-08T18:27:20.829625] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-08T18:27:21.135437] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:21.617508] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-08T18:27:21.851908] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:27:22.025184] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:27:22.417553] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-08T18:27:22.504865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:27:23.217593] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-08T18:27:23.406350] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:27:23.754798] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T18:27:24.017579] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-08T18:27:24.817535] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-08T18:27:25.411603] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T18:27:25.414344] [INFO ] [REMOTE ] DLX: Full fetch complete (41318 records). [2025-10-08T18:27:25.414549] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-08T18:27:25.622771] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-08T18:27:25.820552] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-08T18:27:25.820666] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-08T18:27:25.821431] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-08T18:27:25.821493] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-08T18:27:25.822451] [DEBUG] [LOCAL ] DLX: Trimmed 41318 records to 28454 (keeping 200 days of data) [2025-10-08T18:27:25.990778] [DEBUG] [LOCAL ] DLX: Primary data saved (28454 records). [2025-10-08T18:27:25.990900] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-08T18:27:25.990981] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLX took 26.4s. Estimated remaining: 4h 0m 55s. Rate: 7.2 symbols/min [2025-10-08T18:27:26.163855] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:26.177052] [DEBUG] [LOCAL ] DMB: Loaded 10289 existing records from primary storage. [2025-10-08T18:27:26.177278] [INFO ] [MAIN ] DMB: Loaded 10289 existing records. [2025-10-08T18:27:26.365860] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T18:27:26.365469] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:26.368337] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-08T18:27:26.368405] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-08T18:27:26.378157] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-08T18:27:26.394805] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-08T18:27:26.414603] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T18:27:26.421843] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-08T18:27:26.789797] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:26.923007] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T18:27:27.217580] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-08T18:27:27.917147] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:27:28.017544] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-08T18:27:28.817538] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-08T18:27:28.999958] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T18:27:29.379291] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T18:27:29.617552] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-08T18:27:30.417554] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-08T18:27:31.217583] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-08T18:27:31.319285] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T18:27:32.017576] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-08T18:27:32.465107] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T18:27:32.490801] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:27:32.817539] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-08T18:27:32.880883] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T18:27:33.617550] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-08T18:27:34.307581] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:27:34.417579] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-08T18:27:34.596124] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T18:27:34.600704] [INFO ] [REMOTE ] DLR: Full fetch complete (74027 records). [2025-10-08T18:27:34.600873] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-08T18:27:34.942895] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:27:35.022163] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-08T18:27:35.022262] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-08T18:27:35.023128] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-08T18:27:35.023193] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-08T18:27:35.024830] [DEBUG] [LOCAL ] DLR: Trimmed 74027 records to 50850 (keeping 200 days of data) [2025-10-08T18:27:35.220405] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-08T18:27:35.372057] [DEBUG] [LOCAL ] DLR: Primary data saved (50850 records). [2025-10-08T18:27:35.372282] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-08T18:27:35.372426] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DLR took 40.5s. Estimated remaining: 4h 0m 50s. Rate: 7.2 symbols/min [2025-10-08T18:27:35.567387] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:35.580185] [DEBUG] [LOCAL ] DMO: Loaded 9932 existing records from primary storage. [2025-10-08T18:27:35.580442] [INFO ] [MAIN ] DMO: Loaded 9932 existing records. [2025-10-08T18:27:35.755739] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T18:27:35.761137] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:35.763519] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-08T18:27:35.763580] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-08T18:27:35.763842] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-08T18:27:35.763901] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-08T18:27:36.022716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-08T18:27:36.199328] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:36.807791] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T18:27:36.817495] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-08T18:27:37.617517] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-08T18:27:37.777369] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:27:38.378205] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:27:38.417557] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-08T18:27:39.083715] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:27:39.217538] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-08T18:27:39.921078] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T18:27:40.017493] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-08T18:27:40.536361] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T18:27:40.817632] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-08T18:27:41.338321] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T18:27:41.617559] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-08T18:27:42.151110] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T18:27:42.417556] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-08T18:27:43.028845] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:27:43.217554] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-08T18:27:44.017505] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-08T18:27:44.403098] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:27:44.482178] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T18:27:44.817560] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-08T18:27:45.624059] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-08T18:27:45.628502] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T18:27:46.417600] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-08T18:27:46.486939] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:27:47.217558] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-08T18:27:47.267576] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T18:27:47.694739] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:27:48.017562] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-08T18:27:48.817543] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-08T18:27:49.092941] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:27:49.617560] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-08T18:27:49.813879] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T18:27:50.025700] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T18:27:50.417617] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-08T18:27:50.861518] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T18:27:50.862433] [INFO ] [REMOTE ] DMA: Full fetch complete (6656 records). [2025-10-08T18:27:50.862503] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-08T18:27:51.223164] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-08T18:27:51.232025] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-08T18:27:51.232130] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-08T18:27:51.232391] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-08T18:27:51.232453] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-08T18:27:51.232993] [DEBUG] [LOCAL ] DMA: Trimmed 6656 records to 4615 (keeping 200 days of data) [2025-10-08T18:27:51.261820] [DEBUG] [LOCAL ] DMA: Primary data saved (4615 records). [2025-10-08T18:27:51.261973] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-08T18:27:51.262064] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 30.9s. Estimated remaining: 4h 1m 3s. Rate: 7.2 symbols/min [2025-10-08T18:27:51.439539] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:51.487528] [DEBUG] [LOCAL ] DNA: Loaded 48427 existing records from primary storage. [2025-10-08T18:27:51.487894] [INFO ] [MAIN ] DNA: Loaded 48427 existing records. [2025-10-08T18:27:51.689301] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:51.689604] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-08T18:27:51.689707] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-08T18:27:51.690046] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-08T18:27:51.690124] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-08T18:27:52.022743] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-08T18:27:52.161132] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:52.208040] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:27:52.212200] [INFO ] [REMOTE ] DLY: Full fetch complete (28358 records). [2025-10-08T18:27:52.212461] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-08T18:27:52.602603] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-08T18:27:52.602776] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-08T18:27:52.603300] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-08T18:27:52.603342] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-08T18:27:52.604148] [DEBUG] [LOCAL ] DLY: Trimmed 28358 records to 20261 (keeping 200 days of data) [2025-10-08T18:27:52.733692] [DEBUG] [LOCAL ] DLY: Primary data saved (20261 records). [2025-10-08T18:27:52.733908] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-08T18:27:52.734053] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 47.0s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-08T18:27:52.822890] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-08T18:27:52.860418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T18:27:52.921022] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:52.968404] [DEBUG] [LOCAL ] DNOW: Loaded 43697 existing records from primary storage. [2025-10-08T18:27:52.968793] [INFO ] [MAIN ] DNOW: Loaded 43697 existing records. [2025-10-08T18:27:53.143255] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:53.143468] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-08T18:27:53.143550] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-08T18:27:53.143798] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-08T18:27:53.143855] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-08T18:27:53.492175] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:53.494909] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T18:27:53.496153] [INFO ] [REMOTE ] DMB: Full fetch complete (14881 records). [2025-10-08T18:27:53.496223] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-08T18:27:53.632789] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-08T18:27:53.854899] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-08T18:27:53.854976] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-08T18:27:53.855280] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-08T18:27:53.855317] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-08T18:27:53.855820] [DEBUG] [LOCAL ] DMB: Trimmed 14881 records to 10262 (keeping 200 days of data) [2025-10-08T18:27:53.915478] [DEBUG] [LOCAL ] DMB: Primary data saved (10262 records). [2025-10-08T18:27:53.915592] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-08T18:27:53.915694] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 27.9s. Estimated remaining: 4h 0m 8s. Rate: 7.2 symbols/min [2025-10-08T18:27:54.080911] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:27:54.111738] [DEBUG] [LOCAL ] DNP: Loaded 33279 existing records from primary storage. [2025-10-08T18:27:54.112036] [INFO ] [MAIN ] DNP: Loaded 33279 existing records. [2025-10-08T18:27:54.286152] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:27:54.286352] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-08T18:27:54.286398] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-08T18:27:54.286639] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-08T18:27:54.286729] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-08T18:27:54.422843] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-08T18:27:54.644711] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:27:55.217634] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-08T18:27:55.261118] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T18:27:55.339984] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:27:56.017584] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-08T18:27:56.817540] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-08T18:27:57.021609] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:27:57.180496] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T18:27:57.617559] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-08T18:27:58.417507] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-08T18:27:58.475977] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T18:27:59.067724] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T18:27:59.085483] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T18:27:59.217568] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-08T18:28:00.017572] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-08T18:28:00.774677] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T18:28:00.817500] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-08T18:28:00.900862] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:28:01.617612] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-08T18:28:02.106569] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:28:02.417575] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-08T18:28:03.217578] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-08T18:28:03.503314] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T18:28:03.776259] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T18:28:03.872991] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T18:28:04.017528] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-08T18:28:04.817554] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-08T18:28:05.203811] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:28:05.617579] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-08T18:28:05.711616] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:28:06.417587] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-08T18:28:07.217584] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-08T18:28:07.358990] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T18:28:07.393173] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:28:07.723550] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T18:28:08.017563] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-08T18:28:08.817698] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-08T18:28:09.186240] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:28:09.617604] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-08T18:28:10.275772] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:28:10.417611] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-08T18:28:11.118035] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T18:28:11.119286] [INFO ] [REMOTE ] DMO: Full fetch complete (14427 records). [2025-10-08T18:28:11.119356] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-08T18:28:11.119772] [FATAL] [VALIDATOR ] DMO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:28:11.119854] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:28:11.119915] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:28:11.119980] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-08T18:28:11.120045] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-08T18:28:11.120079] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-10-08T18:28:11.120318] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-10-08T18:28:11.120409] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 35.7s. Estimated remaining: 4h 0m 24s. Rate: 7.2 symbols/min [2025-10-08T18:28:11.221289] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-08T18:28:11.325689] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:11.328677] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T18:28:11.387697] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-08T18:28:11.388050] [INFO ] [MAIN ] DOC: Loaded 53552 existing records. [2025-10-08T18:28:11.563979] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:11.564184] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-08T18:28:11.564230] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-08T18:28:11.564460] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-08T18:28:11.564517] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-08T18:28:11.917219] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:12.017551] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-08T18:28:12.817534] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-08T18:28:12.878818] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:28:13.506123] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:28:13.617497] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-08T18:28:14.301517] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:28:14.417574] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-08T18:28:15.217549] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-08T18:28:15.428863] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:28:16.017522] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-08T18:28:16.159457] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:28:16.828157] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-08T18:28:16.831140] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:28:17.617545] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-08T18:28:17.669502] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:28:17.923280] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T18:28:18.417515] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-08T18:28:18.879677] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T18:28:19.217569] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-08T18:28:19.734863] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:28:20.017547] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-08T18:28:20.798942] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:28:20.817507] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-08T18:28:21.617524] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-08T18:28:21.684339] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:28:22.417539] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-08T18:28:22.468288] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:28:23.217573] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-08T18:28:23.386447] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:28:23.415745] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:28:24.017588] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-08T18:28:24.496165] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:28:24.499513] [INFO ] [REMOTE ] DNOW: Full fetch complete (62917 records). [2025-10-08T18:28:24.499610] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-08T18:28:24.822736] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-08T18:28:24.894425] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-08T18:28:24.894508] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-08T18:28:24.895352] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-08T18:28:24.895418] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-08T18:28:24.896699] [DEBUG] [LOCAL ] DNOW: Trimmed 62917 records to 43622 (keeping 200 days of data) [2025-10-08T18:28:25.155179] [DEBUG] [LOCAL ] DNOW: Primary data saved (43622 records). [2025-10-08T18:28:25.155280] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-08T18:28:25.155364] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNOW took 32.4s. Estimated remaining: 4h 0m 31s. Rate: 7.2 symbols/min [2025-10-08T18:28:25.617593] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-08T18:28:25.772356] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T18:28:26.402418] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:28:26.417487] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-08T18:28:26.813064] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:28:27.217560] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-08T18:28:28.017561] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-08T18:28:28.175539] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T18:28:28.817544] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-08T18:28:29.072674] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:28:29.089922] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T18:28:29.093707] [INFO ] [REMOTE ] DNP: Full fetch complete (49023 records). [2025-10-08T18:28:29.093837] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-08T18:28:29.480862] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-08T18:28:29.480956] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-08T18:28:29.481675] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-08T18:28:29.481749] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-08T18:28:29.482960] [DEBUG] [LOCAL ] DNP: Trimmed 49023 records to 33275 (keeping 200 days of data) [2025-10-08T18:28:29.644592] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-08T18:28:29.696300] [DEBUG] [LOCAL ] DNP: Primary data saved (33275 records). [2025-10-08T18:28:29.696457] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-08T18:28:29.696594] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNP took 35.8s. Estimated remaining: 4h 0m 12s. Rate: 7.2 symbols/min [2025-10-08T18:28:30.404114] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:28:30.417487] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-08T18:28:31.150715] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:28:31.217554] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-08T18:28:32.249429] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:28:32.261254] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-08T18:28:33.182070] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:28:33.195093] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-08T18:28:34.330251] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T18:28:34.342965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-08T18:28:34.790433] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:28:34.794918] [INFO ] [REMOTE ] DNA: Full fetch complete (71027 records). [2025-10-08T18:28:34.795091] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-08T18:28:35.204841] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-08T18:28:35.204970] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-08T18:28:35.206297] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-08T18:28:35.206379] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-08T18:28:35.208474] [DEBUG] [LOCAL ] DNA: Trimmed 71027 records to 48491 (keeping 200 days of data) [2025-10-08T18:28:35.520856] [DEBUG] [LOCAL ] DNA: Primary data saved (48491 records). [2025-10-08T18:28:35.521071] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-08T18:28:35.522502] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNA took 44.3s. Estimated remaining: 3h 59m 57s. Rate: 7.2 symbols/min [2025-10-08T18:28:35.892625] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T18:28:35.896684] [INFO ] [REMOTE ] DOC: Full fetch complete (77387 records). [2025-10-08T18:28:35.896814] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-08T18:28:36.280554] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-08T18:28:36.280635] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-08T18:28:36.281486] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-08T18:28:36.281533] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-08T18:28:36.282949] [DEBUG] [LOCAL ] DOC: Trimmed 77387 records to 53548 (keeping 200 days of data) [2025-10-08T18:28:36.611861] [DEBUG] [LOCAL ] DOC: Primary data saved (53548 records). [2025-10-08T18:28:36.612012] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-08T18:28:36.612114] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 25.5s. Estimated remaining: 3h 59m 29s. Rate: 7.2 symbols/min [2025-10-08T18:28:37.231199] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.286234] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.303190] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.307478] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-08T18:28:37.307609] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-08T18:28:37.307127] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:28:37.307822] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-10-08T18:28:37.308115] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-10-08T18:28:37.308063] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-08T18:28:37.308734] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-08T18:28:37.308796] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-08T18:28:37.308840] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-10-08T18:28:37.308872] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-08T18:28:37.308267] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-08T18:28:37.340526] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-08T18:28:37.346740] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-08T18:28:37.644259] [DEBUG] [LOCAL ] DOLE: Loaded 38734 existing records from primary storage. [2025-10-08T18:28:37.726125] [INFO ] [MAIN ] DOLE: Loaded 38734 existing records. [2025-10-08T18:28:37.993929] [DEBUG] [LOCAL ] DOCN: Loaded 50780 existing records from primary storage. [2025-10-08T18:28:38.069591] [INFO ] [MAIN ] DOCN: Loaded 50780 existing records. [2025-10-08T18:28:38.231569] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:38.331434] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-08T18:28:38.376777] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:38.396695] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-08T18:28:38.452626] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:38.463179] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-08T18:28:38.468357] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-08T18:28:38.492912] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-08T18:28:38.503239] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-08T18:28:38.539216] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:28:38.555725] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-08T18:28:38.555827] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-08T18:28:38.588861] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-08T18:28:38.600388] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-08T18:28:39.187210] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:39.207904] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-08T18:28:39.295986] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:28:39.296334] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-08T18:28:40.026625] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:28:40.036969] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-08T18:28:40.076417] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T18:28:40.085041] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-08T18:28:40.761538] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:28:40.768785] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-08T18:28:41.241776] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:28:41.250909] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-08T18:28:41.426637] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:28:41.434433] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-08T18:28:41.591035] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T18:28:41.617496] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-08T18:28:41.895934] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:28:42.417515] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-08T18:28:42.697627] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:28:42.765493] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:28:43.112397] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T18:28:43.217576] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-08T18:28:43.741030] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:28:44.017612] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-08T18:28:44.559013] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:28:44.817576] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-08T18:28:45.088120] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T18:28:45.617555] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-08T18:28:46.177251] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:28:46.417559] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-08T18:28:47.217565] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-08T18:28:47.416259] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:28:47.590977] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T18:28:48.017596] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-08T18:28:48.450403] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:28:48.817521] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-08T18:28:49.601100] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:28:49.617578] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-08T18:28:49.941914] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:28:50.417610] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-08T18:28:51.217541] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-08T18:28:51.403401] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:28:51.910528] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:28:52.017577] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-08T18:28:52.329595] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:28:52.817699] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-08T18:28:53.617612] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-08T18:28:53.703898] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:28:53.762876] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T18:28:54.417614] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-08T18:28:55.217609] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-08T18:28:55.629302] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T18:28:55.689710] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:28:56.017546] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-08T18:28:56.559169] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T18:28:56.817555] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-08T18:28:57.617523] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-08T18:28:57.971091] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-08T18:28:58.143079] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:28:58.417546] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-08T18:28:59.069345] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:28:59.217557] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-08T18:28:59.820760] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:29:00.017594] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-08T18:29:00.693037] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T18:29:00.817590] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-08T18:29:01.560796] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:29:01.564976] [INFO ] [REMOTE ] DOLE: Full fetch complete (54289 records). [2025-10-08T18:29:01.565139] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-08T18:29:01.622724] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-08T18:29:02.008060] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-08T18:29:02.008141] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-08T18:29:02.008916] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-08T18:29:02.008982] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-08T18:29:02.012311] [DEBUG] [LOCAL ] DOLE: Trimmed 54289 records to 38840 (keeping 200 days of data) [2025-10-08T18:29:02.256099] [DEBUG] [LOCAL ] DOLE: Primary data saved (38840 records). [2025-10-08T18:29:02.256249] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-08T18:29:02.256352] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 25.6s. Estimated remaining: 4h 0m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:02.422093] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-08T18:29:02.426679] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:02.483767] [DEBUG] [LOCAL ] DOV: Loaded 45506 existing records from primary storage. [2025-10-08T18:29:02.484149] [INFO ] [MAIN ] DOV: Loaded 45506 existing records. [2025-10-08T18:29:02.666534] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:02.666875] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-08T18:29:02.666954] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-08T18:29:02.667351] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-08T18:29:02.667431] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-08T18:29:02.986461] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-08T18:29:03.084192] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:03.217523] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-08T18:29:03.374564] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:29:04.017516] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-08T18:29:04.210986] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T18:29:04.817579] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-08T18:29:05.010072] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:29:05.012895] [INFO ] [REMOTE ] DOUG: Full fetch complete (50819 records). [2025-10-08T18:29:05.013027] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-08T18:29:05.361013] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-08T18:29:05.446985] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-08T18:29:05.447063] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-08T18:29:05.447721] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-08T18:29:05.447782] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-08T18:29:05.448832] [DEBUG] [LOCAL ] DOUG: Trimmed 50819 records to 34415 (keeping 200 days of data) [2025-10-08T18:29:05.622501] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-08T18:29:05.647667] [DEBUG] [LOCAL ] DOUG: Primary data saved (34415 records). [2025-10-08T18:29:05.647822] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-08T18:29:05.647902] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOUG took 29.0s. Estimated remaining: 3h 59m 46s. Rate: 7.2 symbols/min [2025-10-08T18:29:05.846804] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:05.895571] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-08T18:29:05.895977] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-08T18:29:06.078479] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:06.078854] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-08T18:29:06.078927] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-08T18:29:06.079220] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-08T18:29:06.079301] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-08T18:29:06.427969] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-08T18:29:06.436886] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:29:06.475118] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:07.217524] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-08T18:29:07.780929] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T18:29:08.025590] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-08T18:29:08.046107] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T18:29:08.817534] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-08T18:29:08.847815] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T18:29:09.617521] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-08T18:29:09.774603] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T18:29:10.417551] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-08T18:29:10.844249] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-08T18:29:10.848290] [INFO ] [REMOTE ] DOCN: Full fetch complete (72045 records). [2025-10-08T18:29:10.848429] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-08T18:29:11.233930] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-08T18:29:11.284045] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-08T18:29:11.284244] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-08T18:29:11.285130] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-08T18:29:11.285208] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-08T18:29:11.295953] [DEBUG] [LOCAL ] DOCN: Trimmed 72045 records to 50781 (keeping 200 days of data) [2025-10-08T18:29:11.313711] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T18:29:11.629047] [DEBUG] [LOCAL ] DOCN: Primary data saved (50781 records). [2025-10-08T18:29:11.629229] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-08T18:29:11.629370] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 35.0s. Estimated remaining: 3h 59m 32s. Rate: 7.2 symbols/min [2025-10-08T18:29:11.804173] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:11.838737] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T18:29:11.854857] [DEBUG] [LOCAL ] DPG: Loaded 13428 existing records from primary storage. [2025-10-08T18:29:11.855099] [INFO ] [MAIN ] DPG: Loaded 13428 existing records. [2025-10-08T18:29:12.026172] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-08T18:29:12.031352] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:12.032415] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-08T18:29:12.032480] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-08T18:29:12.032759] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-08T18:29:12.032831] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-08T18:29:12.391675] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:12.817581] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-08T18:29:13.465375] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-08T18:29:13.552931] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:29:13.556993] [INFO ] [REMOTE ] DOCS: Full fetch complete (74140 records). [2025-10-08T18:29:13.557119] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-08T18:29:13.625028] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-08T18:29:13.971609] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-08T18:29:13.971721] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-08T18:29:13.972588] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-08T18:29:13.972630] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-08T18:29:13.974053] [DEBUG] [LOCAL ] DOCS: Trimmed 74140 records to 50973 (keeping 200 days of data) [2025-10-08T18:29:14.282258] [DEBUG] [LOCAL ] DOCS: Primary data saved (50973 records). [2025-10-08T18:29:14.282434] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-08T18:29:14.282539] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 37.7s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:14.421006] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-08T18:29:14.481530] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:14.484424] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:29:14.535042] [DEBUG] [LOCAL ] DQ: Loaded 43484 existing records from primary storage. [2025-10-08T18:29:14.535355] [INFO ] [MAIN ] DQ: Loaded 43484 existing records. [2025-10-08T18:29:14.709872] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:14.710163] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-08T18:29:14.710229] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-08T18:29:14.710847] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-08T18:29:14.710907] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-08T18:29:15.065107] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:15.217555] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-08T18:29:15.260203] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:29:15.395096] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:29:16.017620] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-08T18:29:16.625045] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:29:16.661493] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:29:16.817577] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-08T18:29:17.617518] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-08T18:29:17.696344] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:29:18.417621] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-08T18:29:19.140789] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:29:19.217624] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-08T18:29:20.017589] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-08T18:29:20.248595] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-08T18:29:20.332416] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T18:29:20.817565] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-08T18:29:21.617590] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-08T18:29:21.676436] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T18:29:22.306258] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T18:29:22.417570] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-08T18:29:22.945323] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:29:23.069462] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:29:23.217555] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-08T18:29:23.834747] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T18:29:24.017548] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-08T18:29:24.817553] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-08T18:29:25.617533] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-08T18:29:25.872414] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:29:26.004692] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T18:29:26.417549] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-08T18:29:27.217561] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-08T18:29:27.361499] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T18:29:27.382838] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T18:29:28.017566] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-08T18:29:28.817633] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-08T18:29:29.418603] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T18:29:29.617537] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-08T18:29:29.727411] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:29:30.153910] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:29:30.417584] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-08T18:29:31.102128] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T18:29:31.217496] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-08T18:29:31.551251] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T18:29:32.017561] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-08T18:29:32.742354] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:29:32.817540] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-08T18:29:33.580989] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:29:33.617502] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-08T18:29:34.046422] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:29:34.417579] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-08T18:29:35.028412] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:29:35.217579] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-08T18:29:35.949342] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T18:29:36.017546] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-08T18:29:36.817562] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-08T18:29:36.879937] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-08T18:29:37.110904] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:29:37.508829] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T18:29:37.510268] [INFO ] [REMOTE ] DPG: Full fetch complete (18930 records). [2025-10-08T18:29:37.510341] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-08T18:29:37.622738] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-08T18:29:37.883609] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-08T18:29:37.883718] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-08T18:29:37.884143] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-08T18:29:37.884182] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-08T18:29:37.884730] [DEBUG] [LOCAL ] DPG: Trimmed 18930 records to 13460 (keeping 200 days of data) [2025-10-08T18:29:37.965806] [DEBUG] [LOCAL ] DPG: Primary data saved (13460 records). [2025-10-08T18:29:37.965943] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-08T18:29:37.966034] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 26.3s. Estimated remaining: 3h 59m 41s. Rate: 7.2 symbols/min [2025-10-08T18:29:38.133063] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:38.169812] [DEBUG] [LOCAL ] DRD: Loaded 37150 existing records from primary storage. [2025-10-08T18:29:38.170099] [INFO ] [MAIN ] DRD: Loaded 37150 existing records. [2025-10-08T18:29:38.343952] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:38.344172] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-08T18:29:38.344218] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-08T18:29:38.344441] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-08T18:29:38.344493] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-08T18:29:38.422677] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-08T18:29:38.710876] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:39.217558] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-08T18:29:39.314140] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:29:39.317928] [INFO ] [REMOTE ] DOV: Full fetch complete (65265 records). [2025-10-08T18:29:39.318039] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-08T18:29:39.705168] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-08T18:29:39.705252] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-08T18:29:39.706047] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-08T18:29:39.706120] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-08T18:29:39.707505] [DEBUG] [LOCAL ] DOV: Trimmed 65265 records to 45490 (keeping 200 days of data) [2025-10-08T18:29:40.008761] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T18:29:40.017987] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-08T18:29:40.025900] [DEBUG] [LOCAL ] DOV: Primary data saved (45490 records). [2025-10-08T18:29:40.025978] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-08T18:29:40.026989] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DOV took 37.8s. Estimated remaining: 3h 59m 16s. Rate: 7.2 symbols/min [2025-10-08T18:29:40.222506] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:40.240192] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T18:29:40.291734] [DEBUG] [LOCAL ] DRH: Loaded 50480 existing records from primary storage. [2025-10-08T18:29:40.292125] [INFO ] [MAIN ] DRH: Loaded 50480 existing records. [2025-10-08T18:29:40.481745] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:40.482029] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-08T18:29:40.482098] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-08T18:29:40.482392] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-08T18:29:40.482467] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-08T18:29:40.827367] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-08T18:29:40.860251] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:41.617506] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-08T18:29:41.931556] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T18:29:41.966928] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T18:29:42.417594] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-08T18:29:43.217566] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-08T18:29:43.867297] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-08T18:29:43.955760] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:29:44.017505] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-08T18:29:44.683191] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:29:44.817516] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-08T18:29:45.436233] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T18:29:45.617556] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-08T18:29:46.417574] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-08T18:29:46.687747] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:29:46.924975] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T18:29:47.217569] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-08T18:29:47.755267] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T18:29:47.759318] [INFO ] [REMOTE ] DQ: Full fetch complete (63214 records). [2025-10-08T18:29:47.759460] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-08T18:29:48.027687] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-08T18:29:48.161318] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-08T18:29:48.161409] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-08T18:29:48.162197] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-08T18:29:48.162260] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-08T18:29:48.163690] [DEBUG] [LOCAL ] DQ: Trimmed 63214 records to 43500 (keeping 200 days of data) [2025-10-08T18:29:48.419214] [DEBUG] [LOCAL ] DQ: Primary data saved (43500 records). [2025-10-08T18:29:48.419345] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-08T18:29:48.419452] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DQ took 34.1s. Estimated remaining: 3h 59m 8s. Rate: 7.2 symbols/min [2025-10-08T18:29:48.590936] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:48.609145] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T18:29:48.656537] [DEBUG] [LOCAL ] DRI: Loaded 47703 existing records from primary storage. [2025-10-08T18:29:48.656898] [INFO ] [MAIN ] DRI: Loaded 47703 existing records. [2025-10-08T18:29:48.826529] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-08T18:29:48.863771] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:48.864051] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-08T18:29:48.864108] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-08T18:29:48.865217] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-08T18:29:48.865287] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-08T18:29:49.246865] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:49.617574] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-08T18:29:49.917197] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-08T18:29:49.921461] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-08T18:29:49.921609] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-08T18:29:50.325542] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-08T18:29:50.325785] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-08T18:29:50.326937] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-08T18:29:50.327013] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-08T18:29:50.328605] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 53733 (keeping 200 days of data) [2025-10-08T18:29:50.418481] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-08T18:29:50.576711] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:29:50.695040] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-08T18:29:50.695187] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-08T18:29:50.695282] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 45.0s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-08T18:29:50.877260] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:29:50.899819] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T18:29:50.918454] [DEBUG] [LOCAL ] DRLL: Loaded 9285 existing records from primary storage. [2025-10-08T18:29:50.918862] [INFO ] [MAIN ] DRLL: Loaded 9285 existing records. [2025-10-08T18:29:51.100542] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:29:51.100812] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-08T18:29:51.100860] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-08T18:29:51.101305] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-08T18:29:51.101364] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-08T18:29:51.222717] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-08T18:29:51.457687] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:29:52.017552] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-08T18:29:52.338006] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T18:29:52.796808] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:29:52.817527] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-08T18:29:52.848334] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T18:29:53.617599] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-08T18:29:54.417517] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-08T18:29:54.536441] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T18:29:55.011236] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:29:55.059397] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T18:29:55.217567] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-08T18:29:56.017584] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-08T18:29:56.771162] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:29:56.817579] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-08T18:29:57.512864] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T18:29:57.617555] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-08T18:29:57.956736] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T18:29:58.417589] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-08T18:29:58.990350] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:29:59.217524] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-08T18:29:59.526052] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:29:59.803884] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:30:00.017559] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-08T18:30:00.817532] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-08T18:30:01.602102] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:30:01.617506] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-08T18:30:01.916917] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-08T18:30:02.417571] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-08T18:30:03.217522] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-08T18:30:03.558179] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T18:30:03.604071] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:30:04.017609] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-08T18:30:04.706879] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:30:04.817571] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-08T18:30:05.471901] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:30:05.617538] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-08T18:30:05.886254] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:30:06.417613] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-08T18:30:07.003370] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:30:07.021581] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T18:30:07.217551] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-08T18:30:08.017583] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-08T18:30:08.817605] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-08T18:30:09.581527] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:30:09.617523] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-08T18:30:10.417525] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-08T18:30:10.632732] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:30:11.019913] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T18:30:11.182493] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (3.96 seconds). [2025-10-08T18:30:11.219525] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-08T18:30:11.226106] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T18:30:11.221985] [INFO ] [REMOTE ] DRD: Full fetch complete (50427 records). [2025-10-08T18:30:11.238448] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-08T18:30:11.831892] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-08T18:30:11.831996] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-08T18:30:11.832878] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-08T18:30:11.832954] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-08T18:30:11.834479] [DEBUG] [LOCAL ] DRD: Trimmed 50427 records to 37231 (keeping 200 days of data) [2025-10-08T18:30:12.022586] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-08T18:30:12.074568] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:30:12.108949] [DEBUG] [LOCAL ] DRD: Primary data saved (37231 records). [2025-10-08T18:30:12.109135] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-08T18:30:12.109230] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRD took 34.1s. Estimated remaining: 3h 59m 10s. Rate: 7.2 symbols/min [2025-10-08T18:30:12.279664] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:12.310398] [DEBUG] [LOCAL ] DSL: Loaded 28564 existing records from primary storage. [2025-10-08T18:30:12.310775] [INFO ] [MAIN ] DSL: Loaded 28564 existing records. [2025-10-08T18:30:12.494428] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:12.494736] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-08T18:30:12.494791] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-08T18:30:12.495691] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-08T18:30:12.495751] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-08T18:30:12.824266] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-08T18:30:12.854979] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:13.617504] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-08T18:30:13.795587] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:30:14.417515] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-08T18:30:14.499324] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:30:14.503701] [INFO ] [REMOTE ] DRH: Full fetch complete (71908 records). [2025-10-08T18:30:14.503847] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-08T18:30:14.895495] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-08T18:30:14.895794] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-08T18:30:14.896873] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-08T18:30:14.897008] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-08T18:30:14.898710] [DEBUG] [LOCAL ] DRH: Trimmed 71908 records to 50450 (keeping 200 days of data) [2025-10-08T18:30:15.008865] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:30:15.217605] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-08T18:30:15.233392] [DEBUG] [LOCAL ] DRH: Primary data saved (50450 records). [2025-10-08T18:30:15.233543] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-08T18:30:15.233632] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 35.2s. Estimated remaining: 3h 58m 48s. Rate: 7.2 symbols/min [2025-10-08T18:30:15.399146] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:15.413675] [DEBUG] [LOCAL ] DSM: Loaded 14610 existing records from primary storage. [2025-10-08T18:30:15.413923] [INFO ] [MAIN ] DSM: Loaded 14610 existing records. [2025-10-08T18:30:15.625067] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:15.625622] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-08T18:30:15.625711] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-08T18:30:15.626342] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-08T18:30:15.626402] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-08T18:30:15.990861] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:16.021297] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-08T18:30:16.028378] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:30:16.050533] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T18:30:16.817509] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-08T18:30:17.163713] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T18:30:17.501728] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T18:30:17.503150] [INFO ] [REMOTE ] DRLL: Full fetch complete (15051 records). [2025-10-08T18:30:17.503225] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-08T18:30:17.625073] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-08T18:30:17.893095] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-08T18:30:17.893191] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-08T18:30:17.893572] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-08T18:30:17.893612] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-08T18:30:17.894135] [DEBUG] [LOCAL ] DRLL: Trimmed 15051 records to 9289 (keeping 200 days of data) [2025-10-08T18:30:17.951462] [DEBUG] [LOCAL ] DRLL: Primary data saved (9289 records). [2025-10-08T18:30:17.951606] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-08T18:30:17.951715] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRLL took 27.3s. Estimated remaining: 3h 58m 25s. Rate: 7.2 symbols/min [2025-10-08T18:30:18.142042] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:18.145660] [DEBUG] [LOCAL ] DSMC: Loaded 1845 existing records from primary storage. [2025-10-08T18:30:18.145837] [INFO ] [MAIN ] DSMC: Loaded 1845 existing records. [2025-10-08T18:30:18.321416] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:18.321844] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-08T18:30:18.321948] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-08T18:30:18.322353] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-08T18:30:18.322428] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-08T18:30:18.424666] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-08T18:30:18.453693] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:30:18.694582] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:19.217555] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-08T18:30:19.723356] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-08T18:30:20.017550] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-08T18:30:20.243717] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:30:20.800340] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:30:20.817519] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-08T18:30:21.617533] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-08T18:30:21.978314] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T18:30:22.417571] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-08T18:30:22.847274] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:30:23.217562] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-08T18:30:23.645889] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T18:30:23.995908] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:30:24.017507] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-08T18:30:24.817572] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-08T18:30:25.617573] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-08T18:30:25.690135] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:30:25.750970] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T18:30:26.126399] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T18:30:26.417552] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-08T18:30:27.217561] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-08T18:30:27.620952] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T18:30:27.777234] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T18:30:28.017564] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-08T18:30:28.817502] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-08T18:30:28.998045] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:30:29.617546] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-08T18:30:30.249954] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:30:30.374846] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:30:30.417550] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-08T18:30:31.217536] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-08T18:30:31.251194] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T18:30:32.017592] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-08T18:30:32.652444] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T18:30:32.658325] [INFO ] [REMOTE ] DRI: Full fetch complete (69491 records). [2025-10-08T18:30:32.658601] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-08T18:30:32.825199] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-08T18:30:33.093394] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-08T18:30:33.093525] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-08T18:30:33.094445] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-08T18:30:33.094513] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-08T18:30:33.096105] [DEBUG] [LOCAL ] DRI: Trimmed 69491 records to 47675 (keeping 200 days of data) [2025-10-08T18:30:33.203296] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T18:30:33.339010] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T18:30:33.427474] [DEBUG] [LOCAL ] DRI: Primary data saved (47675 records). [2025-10-08T18:30:33.427625] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-08T18:30:33.427749] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 45.0s. Estimated remaining: 3h 58m 35s. Rate: 7.2 symbols/min [2025-10-08T18:30:33.594397] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:33.616461] [DEBUG] [LOCAL ] DSU: Loaded 22802 existing records from primary storage. [2025-10-08T18:30:33.616879] [INFO ] [MAIN ] DSU: Loaded 22802 existing records. [2025-10-08T18:30:33.627756] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-08T18:30:33.807089] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:33.807369] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-08T18:30:33.807426] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-08T18:30:33.808315] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-08T18:30:33.808378] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-08T18:30:34.155997] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:34.163946] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T18:30:34.417611] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-08T18:30:35.217564] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-08T18:30:35.587946] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T18:30:36.017593] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-08T18:30:36.274258] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:30:36.817549] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-08T18:30:36.865052] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T18:30:37.086067] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T18:30:37.617601] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-08T18:30:38.417521] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-08T18:30:38.787439] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-08T18:30:38.794400] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T18:30:39.217589] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-08T18:30:39.725011] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T18:30:40.017585] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-08T18:30:40.817563] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-08T18:30:41.081445] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:30:41.617580] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-08T18:30:41.823440] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T18:30:41.959927] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-08T18:30:42.417613] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-08T18:30:43.217574] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-08T18:30:43.315588] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:30:43.735463] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:30:44.017533] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-08T18:30:44.817683] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-08T18:30:45.158803] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:30:45.162282] [INFO ] [REMOTE ] DSL: Full fetch complete (41565 records). [2025-10-08T18:30:45.162370] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-08T18:30:45.533222] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-08T18:30:45.533298] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-08T18:30:45.533897] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-08T18:30:45.533959] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-08T18:30:45.534815] [DEBUG] [LOCAL ] DSL: Trimmed 41565 records to 28586 (keeping 200 days of data) [2025-10-08T18:30:45.623166] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-08T18:30:45.641103] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T18:30:45.727291] [DEBUG] [LOCAL ] DSL: Primary data saved (28586 records). [2025-10-08T18:30:45.727429] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-08T18:30:45.727511] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSL took 33.6s. Estimated remaining: 3h 58m 37s. Rate: 7.2 symbols/min [2025-10-08T18:30:45.896151] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:45.896313] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-08T18:30:45.896349] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-08T18:30:45.896464] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-08T18:30:45.896506] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-08T18:30:45.896591] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-08T18:30:45.896670] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-08T18:30:46.199715] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:30:46.216449] [INFO ] [REMOTE ] DSMC: Full fetch complete (2848 records). [2025-10-08T18:30:46.230382] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-08T18:30:46.281976] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:46.424487] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-08T18:30:46.610790] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-08T18:30:46.610868] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-08T18:30:46.610979] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-08T18:30:46.611021] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-08T18:30:46.611415] [DEBUG] [LOCAL ] DSMC: Trimmed 2848 records to 1842 (keeping 200 days of data) [2025-10-08T18:30:46.622901] [DEBUG] [LOCAL ] DSMC: Primary data saved (1842 records). [2025-10-08T18:30:46.622960] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-08T18:30:46.623026] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSMC took 28.7s. Estimated remaining: 3h 58m 9s. Rate: 7.2 symbols/min [2025-10-08T18:30:46.787782] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:46.787963] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-08T18:30:46.788000] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-08T18:30:46.788111] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-08T18:30:46.788151] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-08T18:30:46.788190] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-08T18:30:46.788222] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-08T18:30:47.140759] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:47.217519] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-08T18:30:48.022681] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-08T18:30:48.032616] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:30:48.817573] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-08T18:30:48.939075] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T18:30:48.983803] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T18:30:49.617570] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-08T18:30:49.920733] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T18:30:50.417614] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-08T18:30:50.750573] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T18:30:51.217552] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-08T18:30:52.017522] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-08T18:30:52.124850] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T18:30:52.190782] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T18:30:52.687899] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:30:52.817605] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-08T18:30:53.617560] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-08T18:30:53.810275] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:30:54.340243] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T18:30:54.341548] [INFO ] [REMOTE ] DSM: Full fetch complete (24097 records). [2025-10-08T18:30:54.341635] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-08T18:30:54.342218] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:30:54.342321] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:30:54.342364] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:30:54.342427] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-08T18:30:54.342491] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-08T18:30:54.342526] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-10-08T18:30:54.343041] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-10-08T18:30:54.343148] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSM took 39.1s. Estimated remaining: 3h 57m 60s. Rate: 7.2 symbols/min [2025-10-08T18:30:54.422622] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-08T18:30:54.516844] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:30:54.525056] [DEBUG] [LOCAL ] DTB: Loaded 4948 existing records from primary storage. [2025-10-08T18:30:54.525291] [INFO ] [MAIN ] DTB: Loaded 4948 existing records. [2025-10-08T18:30:54.703577] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:30:54.703839] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-08T18:30:54.703886] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-08T18:30:54.704478] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-08T18:30:54.704539] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-08T18:30:55.073098] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:30:55.217573] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-08T18:30:56.017538] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-08T18:30:56.074621] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:30:56.133266] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T18:30:56.586488] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T18:30:56.817600] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-08T18:30:57.617704] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-08T18:30:58.081002] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T18:30:58.417512] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-08T18:30:58.783349] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:30:59.204699] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:30:59.217612] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-08T18:30:59.782247] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:31:00.017554] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-08T18:31:00.817582] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-08T18:31:01.330266] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:31:01.617569] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-08T18:31:02.417522] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-08T18:31:02.662052] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:31:02.692350] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T18:31:03.217556] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-08T18:31:03.259192] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T18:31:04.017621] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-08T18:31:04.086382] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T18:31:04.818163] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-08T18:31:04.885020] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:31:05.373336] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T18:31:05.617554] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-08T18:31:06.417626] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-08T18:31:06.854691] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T18:31:07.217535] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-08T18:31:07.395059] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:31:08.017548] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-08T18:31:08.197130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:31:08.817579] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-08T18:31:09.617632] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-08T18:31:10.159409] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T18:31:10.303186] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T18:31:10.327614] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T18:31:10.417548] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-08T18:31:11.000394] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:31:11.217582] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-08T18:31:11.967225] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:31:12.017568] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-08T18:31:12.817557] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-08T18:31:13.617586] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-08T18:31:13.827420] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T18:31:13.922482] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:31:14.224713] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T18:31:14.417545] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-08T18:31:15.050106] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T18:31:15.217585] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-08T18:31:16.017554] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-08T18:31:16.333920] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:31:16.335957] [INFO ] [REMOTE ] DSX: Full fetch complete (36027 records). [2025-10-08T18:31:16.336057] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-08T18:31:16.336814] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:31:16.336949] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:31:16.337009] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:31:16.337096] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-08T18:31:16.337185] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-08T18:31:16.337235] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-08T18:31:16.337288] [DEBUG] [LOCAL ] DSX: No derivative data file found to delete. [2025-10-08T18:31:16.337363] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSX took 30.6s. Estimated remaining: 3h 58m 27s. Rate: 7.2 symbols/min [2025-10-08T18:31:16.541526] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:16.547525] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-10-08T18:31:16.547609] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-10-08T18:31:16.547824] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-08T18:31:16.547924] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-08T18:31:16.548051] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-08T18:31:16.548170] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-08T18:31:16.554729] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T18:31:16.822802] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-08T18:31:16.920390] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:17.415003] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T18:31:17.416415] [INFO ] [REMOTE ] DTB: Full fetch complete (6900 records). [2025-10-08T18:31:17.416515] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-08T18:31:17.624636] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-08T18:31:17.780033] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-08T18:31:17.780125] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-08T18:31:17.780368] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-08T18:31:17.780469] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-08T18:31:17.780954] [DEBUG] [LOCAL ] DTB: Trimmed 6900 records to 5032 (keeping 200 days of data) [2025-10-08T18:31:17.815048] [DEBUG] [LOCAL ] DTB: Primary data saved (5032 records). [2025-10-08T18:31:17.815176] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-08T18:31:17.815285] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DTB took 23.5s. Estimated remaining: 3h 58m 1s. Rate: 7.2 symbols/min [2025-10-08T18:31:17.987496] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:17.987730] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-08T18:31:17.987783] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-08T18:31:17.987900] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-08T18:31:17.987941] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-08T18:31:17.987981] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-08T18:31:17.988013] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-08T18:31:18.336140] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:18.417522] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-08T18:31:19.089834] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:31:19.217548] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-08T18:31:19.472819] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:31:20.017560] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-08T18:31:20.806093] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:31:20.817484] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-08T18:31:21.625962] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-08T18:31:21.657409] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:31:22.182146] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:31:22.417562] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-08T18:31:22.890164] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:31:22.892314] [INFO ] [REMOTE ] DSU: Full fetch complete (32916 records). [2025-10-08T18:31:22.892395] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-08T18:31:23.226808] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-08T18:31:23.276690] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-08T18:31:23.276781] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-08T18:31:23.277300] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-08T18:31:23.277341] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-08T18:31:23.278261] [DEBUG] [LOCAL ] DSU: Trimmed 32916 records to 22858 (keeping 200 days of data) [2025-10-08T18:31:23.424755] [DEBUG] [LOCAL ] DSU: Primary data saved (22858 records). [2025-10-08T18:31:23.424897] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-08T18:31:23.424983] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DSU took 50.0s. Estimated remaining: 3h 57m 45s. Rate: 7.2 symbols/min [2025-10-08T18:31:23.602433] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:23.602635] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-08T18:31:23.602717] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-08T18:31:23.602836] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-08T18:31:23.602883] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-08T18:31:23.602927] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-08T18:31:23.602960] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-08T18:31:24.023488] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:24.023619] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-08T18:31:24.067620] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:31:24.471111] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T18:31:24.495162] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:31:24.817569] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-08T18:31:25.617553] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-08T18:31:25.707433] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:31:26.417670] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-08T18:31:27.220100] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-08T18:31:27.222965] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:31:27.228533] [INFO ] [REMOTE ] DT: Full fetch complete (76671 records). [2025-10-08T18:31:27.228731] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-08T18:31:27.644250] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-08T18:31:27.644345] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-08T18:31:27.645338] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-08T18:31:27.645408] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-08T18:31:27.647005] [DEBUG] [LOCAL ] DT: Trimmed 76671 records to 52944 (keeping 200 days of data) [2025-10-08T18:31:27.712531] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T18:31:27.909264] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:31:28.017836] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-08T18:31:28.028374] [DEBUG] [LOCAL ] DT: Primary data saved (52944 records). [2025-10-08T18:31:28.028556] [INFO ] [MAIN ] DT: Full history saved. [2025-10-08T18:31:28.028721] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 41.4s. Estimated remaining: 3h 57m 27s. Rate: 7.2 symbols/min [2025-10-08T18:31:28.197564] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:28.197789] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-08T18:31:28.197844] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-08T18:31:28.197955] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-08T18:31:28.198000] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-08T18:31:28.198043] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-08T18:31:28.198074] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-08T18:31:28.510791] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T18:31:28.550049] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:28.817621] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-08T18:31:29.374218] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:31:29.617567] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-08T18:31:30.056134] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:31:30.417568] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-08T18:31:31.012203] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:31:31.217577] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-08T18:31:31.787103] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T18:31:32.017544] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-08T18:31:32.619540] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:31:32.817560] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-08T18:31:33.318125] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:31:33.617605] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-08T18:31:33.985930] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:31:33.986268] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-08T18:31:33.986359] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:31:33.986409] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-08T18:31:33.986470] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:31:33.986544] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-08T18:31:33.986629] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-08T18:31:33.986707] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-08T18:31:33.986811] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-08T18:31:33.986885] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTK took 6.0s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-08T18:31:34.170916] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:34.218327] [DEBUG] [LOCAL ] DTM: Loaded 44092 existing records from primary storage. [2025-10-08T18:31:34.218789] [INFO ] [MAIN ] DTM: Loaded 44092 existing records. [2025-10-08T18:31:34.401572] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:31:34.401875] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-08T18:31:34.401937] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-08T18:31:34.402275] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-08T18:31:34.402333] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-08T18:31:34.423624] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-08T18:31:34.769109] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:35.217549] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-08T18:31:35.545329] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:31:36.017542] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-08T18:31:36.404340] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T18:31:36.454865] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T18:31:36.817594] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-08T18:31:37.617576] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-08T18:31:37.993175] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:31:38.419936] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-08T18:31:38.422843] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:31:39.074457] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:31:39.217546] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-08T18:31:39.857706] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:31:40.017583] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-08T18:31:40.817570] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-08T18:31:41.617548] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-08T18:31:41.666394] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T18:31:41.696205] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T18:31:42.161820] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T18:31:42.417557] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-08T18:31:43.217561] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-08T18:31:43.941153] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:31:44.017569] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-08T18:31:44.084628] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T18:31:44.817596] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-08T18:31:45.218727] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:31:45.219514] [INFO ] [REMOTE ] DTF: Full fetch complete (1969 records). [2025-10-08T18:31:45.219587] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-08T18:31:45.424364] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-08T18:31:45.424635] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:31:45.424849] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:31:45.424937] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-08T18:31:45.425079] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-08T18:31:45.425200] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-08T18:31:45.425309] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-08T18:31:45.425423] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTF took 27.6s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-08T18:31:45.621714] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-08T18:31:45.603264] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:45.643094] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:31:45.659024] [DEBUG] [LOCAL ] DTW: Loaded 4907 existing records from primary storage. [2025-10-08T18:31:45.659269] [INFO ] [MAIN ] DTW: Loaded 4907 existing records. [2025-10-08T18:31:45.838716] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:31:45.838967] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-08T18:31:45.839013] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-08T18:31:45.839318] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-08T18:31:45.839378] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-08T18:31:46.173066] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T18:31:46.218222] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:46.417585] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-08T18:31:47.217582] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-08T18:31:47.816808] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T18:31:47.877967] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T18:31:48.017592] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-08T18:31:48.483494] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T18:31:48.817575] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-08T18:31:49.545881] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:31:49.547472] [INFO ] [REMOTE ] DTG: Full fetch complete (8970 records). [2025-10-08T18:31:49.547560] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-08T18:31:49.622738] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-08T18:31:50.035134] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-08T18:31:50.035262] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-08T18:31:50.035573] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-08T18:31:50.035663] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-08T18:31:50.036193] [DEBUG] [LOCAL ] DTG: Trimmed 8970 records to 5856 (keeping 200 days of data) [2025-10-08T18:31:50.075885] [DEBUG] [LOCAL ] DTG: Primary data saved (5856 records). [2025-10-08T18:31:50.076032] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-08T18:31:50.076159] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTG took 26.7s. Estimated remaining: 3h 56m 55s. Rate: 7.2 symbols/min [2025-10-08T18:31:50.213766] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T18:31:50.296143] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:31:50.296357] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-08T18:31:50.296419] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-08T18:31:50.296551] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-08T18:31:50.296609] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-08T18:31:50.296683] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-08T18:31:50.296737] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-08T18:31:50.422721] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-08T18:31:50.703589] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:31:51.217600] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-08T18:31:52.017516] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-08T18:31:52.056713] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:31:52.817534] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-08T18:31:52.943024] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:31:53.617570] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-08T18:31:53.703839] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:31:54.417570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-08T18:31:54.527729] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:31:55.217536] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-08T18:31:55.332231] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:31:55.820686] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:31:55.886527] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:31:56.017613] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-08T18:31:56.510301] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T18:31:56.817586] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-08T18:31:57.617614] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-08T18:31:58.417597] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-08T18:31:58.464602] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T18:31:59.080592] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T18:31:59.117997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T18:31:59.217570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-08T18:32:00.017590] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-08T18:32:00.484394] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:32:00.817569] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-08T18:32:01.050294] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:32:01.617594] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-08T18:32:02.409438] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:32:02.418751] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-08T18:32:03.217538] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-08T18:32:03.587181] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:32:04.017541] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-08T18:32:04.052068] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:32:04.517154] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T18:32:04.544851] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:32:04.549872] [INFO ] [REMOTE ] DTE: Full fetch complete (68794 records). [2025-10-08T18:32:04.550021] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-08T18:32:04.822705] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-08T18:32:04.981682] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-08T18:32:04.981807] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-08T18:32:04.982710] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-08T18:32:04.982775] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-08T18:32:04.984349] [DEBUG] [LOCAL ] DTE: Trimmed 68794 records to 47531 (keeping 200 days of data) [2025-10-08T18:32:05.308713] [DEBUG] [LOCAL ] DTE: Primary data saved (47531 records). [2025-10-08T18:32:05.308880] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-08T18:32:05.308968] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTE took 49.0s. Estimated remaining: 3h 57m 4s. Rate: 7.2 symbols/min [2025-10-08T18:32:05.512407] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:05.523992] [DEBUG] [LOCAL ] DUKB: Loaded 6365 existing records from primary storage. [2025-10-08T18:32:05.524271] [INFO ] [MAIN ] DUKB: Loaded 6365 existing records. [2025-10-08T18:32:05.625808] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-08T18:32:05.709914] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:05.710122] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-08T18:32:05.710206] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-08T18:32:05.710426] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-08T18:32:05.710483] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-08T18:32:06.098902] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:06.417622] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-08T18:32:06.573325] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:32:06.874044] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:32:07.217582] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-08T18:32:07.247934] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:32:08.017566] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-08T18:32:08.817531] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-08T18:32:08.977717] [DEBUG] [REMOTE ] DTW: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T18:32:08.978042] [WARN ] [REMOTE ] DTW: No data returned for month 2025-09 [2025-10-08T18:32:08.978134] [FATAL] [REMOTE ] DTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:32:08.978220] [FATAL] [MAIN ] DTW: Failed to fetch primary data. [2025-10-08T18:32:08.978282] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:32:08.978412] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-08T18:32:08.978622] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-08T18:32:08.978761] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-08T18:32:08.979032] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-08T18:32:08.979136] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTW took 23.6s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-08T18:32:09.157771] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:09.189135] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T18:32:09.254168] [DEBUG] [LOCAL ] DV: Loaded 51295 existing records from primary storage. [2025-10-08T18:32:09.254531] [INFO ] [MAIN ] DV: Loaded 51295 existing records. [2025-10-08T18:32:09.438846] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:09.439344] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-08T18:32:09.439556] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-08T18:32:09.440302] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-08T18:32:09.440364] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-08T18:32:09.625149] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-08T18:32:09.646606] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:32:09.883050] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:10.417611] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-08T18:32:11.086619] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T18:32:11.217568] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-08T18:32:11.673257] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T18:32:12.017591] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-08T18:32:12.782396] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:32:12.798106] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:32:12.817504] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-08T18:32:13.617554] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-08T18:32:14.325244] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:32:14.328792] [INFO ] [REMOTE ] DTM: Full fetch complete (64829 records). [2025-10-08T18:32:14.328920] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-08T18:32:14.426223] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-08T18:32:14.714697] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-08T18:32:14.714804] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-08T18:32:14.715662] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-08T18:32:14.715728] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-08T18:32:14.717134] [DEBUG] [LOCAL ] DTM: Trimmed 64829 records to 44082 (keeping 200 days of data) [2025-10-08T18:32:15.004137] [DEBUG] [LOCAL ] DTM: Primary data saved (44082 records). [2025-10-08T18:32:15.004303] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-08T18:32:15.004408] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTM took 41.0s. Estimated remaining: 3h 56m 30s. Rate: 7.2 symbols/min [2025-10-08T18:32:15.175859] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:15.216614] [DEBUG] [LOCAL ] DVA: Loaded 41009 existing records from primary storage. [2025-10-08T18:32:15.216990] [INFO ] [MAIN ] DVA: Loaded 41009 existing records. [2025-10-08T18:32:15.249256] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-08T18:32:15.418276] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:32:15.438451] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:15.438802] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-08T18:32:15.448782] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-08T18:32:15.449852] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-08T18:32:15.449914] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-08T18:32:15.828173] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:15.961970] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T18:32:16.017564] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-08T18:32:16.239014] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T18:32:16.438010] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:32:16.817564] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-08T18:32:17.617550] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-08T18:32:18.417520] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-08T18:32:18.702540] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:32:18.918805] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:32:19.158196] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:32:19.217533] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-08T18:32:20.017567] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-08T18:32:20.676131] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T18:32:20.817609] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-08T18:32:21.422060] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:32:21.617605] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-08T18:32:21.858489] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:32:21.862718] [INFO ] [REMOTE ] DUK: Full fetch complete (77394 records). [2025-10-08T18:32:21.862853] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-08T18:32:22.252585] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-08T18:32:22.252704] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-08T18:32:22.253587] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-08T18:32:22.253632] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-08T18:32:22.255203] [DEBUG] [LOCAL ] DUK: Trimmed 77394 records to 53445 (keeping 200 days of data) [2025-10-08T18:32:22.440364] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-08T18:32:22.599725] [DEBUG] [LOCAL ] DUK: Primary data saved (53445 records). [2025-10-08T18:32:22.599880] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-08T18:32:22.599962] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 32.5s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-08T18:32:22.772400] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:22.772630] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-08T18:32:22.772837] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-08T18:32:22.772957] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-08T18:32:22.772999] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-08T18:32:22.773040] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-08T18:32:22.773072] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-08T18:32:23.067527] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T18:32:23.181335] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:23.183396] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:32:23.217504] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-08T18:32:24.017567] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-08T18:32:24.817585] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-08T18:32:25.411311] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T18:32:25.622696] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-08T18:32:25.643009] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-08T18:32:25.734311] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:32:26.417596] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-08T18:32:27.217621] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-08T18:32:27.286249] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T18:32:28.017538] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-08T18:32:28.817625] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-08T18:32:28.953016] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-08T18:32:29.050747] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:32:29.176377] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:32:29.617547] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-08T18:32:29.801288] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T18:32:30.417586] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-08T18:32:30.780273] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:32:31.013477] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T18:32:31.217603] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-08T18:32:31.945874] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T18:32:31.946882] [INFO ] [REMOTE ] DUKB: Full fetch complete (9369 records). [2025-10-08T18:32:31.946962] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-08T18:32:31.947382] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:32:31.947473] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:32:31.947524] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:32:31.947616] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-08T18:32:31.947836] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-08T18:32:31.947926] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-08T18:32:31.948164] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-08T18:32:31.948276] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUKB took 26.6s. Estimated remaining: 3h 56m 14s. Rate: 7.2 symbols/min [2025-10-08T18:32:32.025779] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-08T18:32:32.140598] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:32.199483] [DEBUG] [LOCAL ] DX: Loaded 52486 existing records from primary storage. [2025-10-08T18:32:32.199895] [INFO ] [MAIN ] DX: Loaded 52486 existing records. [2025-10-08T18:32:32.380150] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:32.380361] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-08T18:32:32.380433] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-08T18:32:32.381906] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-08T18:32:32.381968] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-08T18:32:32.737976] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:32.817514] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-08T18:32:33.509367] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:32:33.617500] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-08T18:32:34.384846] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T18:32:34.417502] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-08T18:32:35.015914] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T18:32:35.217582] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-08T18:32:36.017539] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-08T18:32:36.141913] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T18:32:36.817618] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-08T18:32:37.231076] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-08T18:32:37.599129] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:32:37.617496] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-08T18:32:38.227247] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:32:38.417532] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-08T18:32:39.167867] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T18:32:39.217499] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-08T18:32:39.661612] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:32:40.017574] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-08T18:32:40.817624] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-08T18:32:41.617988] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-08T18:32:41.619405] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-08T18:32:42.417726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-08T18:32:42.899678] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-08T18:32:43.019424] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T18:32:43.227334] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-08T18:32:43.232990] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T18:32:44.017555] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-08T18:32:44.263760] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:32:44.817590] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-08T18:32:45.081264] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:32:45.085519] [INFO ] [REMOTE ] DV: Full fetch complete (73587 records). [2025-10-08T18:32:45.085715] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-08T18:32:45.486909] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-08T18:32:45.487003] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-08T18:32:45.487923] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-08T18:32:45.487992] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-08T18:32:45.489797] [DEBUG] [LOCAL ] DV: Trimmed 73587 records to 51300 (keeping 200 days of data) [2025-10-08T18:32:45.617817] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-08T18:32:45.840936] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:32:45.857210] [DEBUG] [LOCAL ] DV: Primary data saved (51300 records). [2025-10-08T18:32:45.857326] [INFO ] [MAIN ] DV: Full history saved. [2025-10-08T18:32:45.857402] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DV took 36.9s. Estimated remaining: 3h 56m 20s. Rate: 7.2 symbols/min [2025-10-08T18:32:46.045931] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:46.046410] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-08T18:32:46.046466] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-08T18:32:46.046624] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-08T18:32:46.046699] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-08T18:32:46.046757] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-08T18:32:46.046791] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-08T18:32:46.433131] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-08T18:32:46.439054] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:47.217531] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-08T18:32:47.273798] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T18:32:47.296852] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-08T18:32:48.017578] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-08T18:32:48.298284] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T18:32:48.794396] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T18:32:48.817497] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-08T18:32:49.617498] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-08T18:32:49.798684] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:32:49.891407] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T18:32:50.417554] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-08T18:32:51.217574] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-08T18:32:51.387923] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:32:52.017615] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-08T18:32:52.560491] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T18:32:52.817603] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-08T18:32:52.865451] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:32:53.617588] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-08T18:32:53.769557] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T18:32:54.417617] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-08T18:32:54.725299] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T18:32:55.217530] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-08T18:32:55.272579] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:32:55.847151] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:32:56.017554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-08T18:32:56.817513] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-08T18:32:56.948544] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:32:57.384319] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:32:57.387665] [INFO ] [REMOTE ] DVA: Full fetch complete (59771 records). [2025-10-08T18:32:57.387804] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-08T18:32:57.623108] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-08T18:32:57.800369] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-08T18:32:57.800470] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-08T18:32:57.801258] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-08T18:32:57.801325] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-08T18:32:57.802630] [DEBUG] [LOCAL ] DVA: Trimmed 59771 records to 41008 (keeping 200 days of data) [2025-10-08T18:32:58.052150] [DEBUG] [LOCAL ] DVA: Primary data saved (41008 records). [2025-10-08T18:32:58.052288] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-08T18:32:58.052372] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVA took 43.0s. Estimated remaining: 3h 56m 21s. Rate: 7.2 symbols/min [2025-10-08T18:32:58.225212] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:32:58.261032] [DEBUG] [LOCAL ] DXYZ: Loaded 37024 existing records from primary storage. [2025-10-08T18:32:58.261330] [INFO ] [MAIN ] DXYZ: Loaded 37024 existing records. [2025-10-08T18:32:58.418759] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-08T18:32:58.445122] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:32:58.447823] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-08T18:32:58.447987] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-08T18:32:58.449635] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-08T18:32:58.449861] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-08T18:32:58.760821] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:32:58.848576] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:32:59.217574] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-08T18:32:59.792031] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T18:33:00.017515] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-08T18:33:00.320961] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:33:00.817563] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-08T18:33:00.940870] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:33:01.617580] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-08T18:33:02.149379] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-08T18:33:02.417576] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-08T18:33:02.786884] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:33:03.217517] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-08T18:33:04.017611] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-08T18:33:04.225103] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T18:33:04.257884] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-10-08T18:33:04.260450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-08T18:33:04.260634] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-08T18:33:04.272748] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:33:04.272898] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:33:04.272970] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:33:04.273044] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-08T18:33:04.273112] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-08T18:33:04.273148] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-08T18:33:04.273187] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-08T18:33:04.273264] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 41.7s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-08T18:33:04.471468] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:04.506628] [DEBUG] [LOCAL ] DY: Loaded 28615 existing records from primary storage. [2025-10-08T18:33:04.507043] [INFO ] [MAIN ] DY: Loaded 28615 existing records. [2025-10-08T18:33:04.724771] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:04.724985] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-08T18:33:04.725033] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-08T18:33:04.725927] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-08T18:33:04.725987] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-08T18:33:04.822878] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-08T18:33:05.125406] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:33:05.130508] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:05.557633] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:33:05.561231] [INFO ] [REMOTE ] DX: Full fetch complete (75177 records). [2025-10-08T18:33:05.561378] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-08T18:33:05.565044] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:33:05.565148] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:33:05.565190] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:33:05.565228] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-08T18:33:05.565298] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-08T18:33:05.565352] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-08T18:33:05.565604] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-08T18:33:05.565728] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 33.6s. Estimated remaining: 3h 55m 42s. Rate: 7.2 symbols/min [2025-10-08T18:33:05.628569] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-08T18:33:05.739058] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:05.776812] [DEBUG] [LOCAL ] E: Loaded 33210 existing records from primary storage. [2025-10-08T18:33:05.777173] [INFO ] [MAIN ] E: Loaded 33210 existing records. [2025-10-08T18:33:05.978543] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:05.978793] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-08T18:33:05.978842] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-08T18:33:05.979686] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-08T18:33:05.979747] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-08T18:33:06.422781] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-08T18:33:06.469325] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:07.063217] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:33:07.154289] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T18:33:07.217617] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-08T18:33:08.017521] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-08T18:33:08.130135] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:33:08.212948] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T18:33:08.817558] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-08T18:33:09.617592] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-08T18:33:09.967952] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T18:33:10.417583] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-08T18:33:10.761473] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T18:33:10.827221] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T18:33:11.217617] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-08T18:33:12.020685] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-08T18:33:12.023728] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T18:33:12.814505] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T18:33:12.822136] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-08T18:33:13.362631] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T18:33:13.617570] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-08T18:33:14.224319] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:33:14.417588] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-08T18:33:15.054629] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T18:33:15.217556] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-08T18:33:16.017549] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-08T18:33:16.201713] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:33:16.265865] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:33:16.817580] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-08T18:33:16.960106] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T18:33:17.617622] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-08T18:33:18.417604] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-08T18:33:18.592730] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:33:19.049794] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:33:19.217528] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-08T18:33:19.672371] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T18:33:20.017559] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-08T18:33:20.817586] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-08T18:33:21.015032] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:33:21.617553] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-08T18:33:21.664990] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:33:21.991313] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T18:33:22.417579] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-08T18:33:23.155266] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T18:33:23.159306] [INFO ] [REMOTE ] DXC: Full fetch complete (69655 records). [2025-10-08T18:33:23.159469] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-08T18:33:23.229348] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-08T18:33:23.582847] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-08T18:33:23.582936] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-08T18:33:23.583840] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-08T18:33:23.583907] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-08T18:33:23.585337] [DEBUG] [LOCAL ] DXC: Trimmed 69655 records to 49857 (keeping 200 days of data) [2025-10-08T18:33:23.906212] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T18:33:23.933543] [DEBUG] [LOCAL ] DXC: Primary data saved (49857 records). [2025-10-08T18:33:23.933722] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-08T18:33:23.933839] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 38.1s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-08T18:33:24.026112] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-08T18:33:24.109931] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:24.152347] [DEBUG] [LOCAL ] EAF: Loaded 42243 existing records from primary storage. [2025-10-08T18:33:24.152695] [INFO ] [MAIN ] EAF: Loaded 42243 existing records. [2025-10-08T18:33:24.336218] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:24.336457] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-08T18:33:24.336505] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-08T18:33:24.337748] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-08T18:33:24.337808] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-08T18:33:24.700898] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:24.817569] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-08T18:33:25.133154] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T18:33:25.617568] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-08T18:33:25.656629] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:33:25.752689] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T18:33:26.417589] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-08T18:33:26.988585] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:33:27.217574] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-08T18:33:27.826727] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T18:33:28.017551] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-08T18:33:28.531636] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:33:28.817561] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-08T18:33:29.415373] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T18:33:29.617597] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-08T18:33:30.417567] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-08T18:33:30.826514] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T18:33:30.965068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T18:33:31.217523] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-08T18:33:31.512572] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:33:31.514919] [INFO ] [REMOTE ] DY: Full fetch complete (43898 records). [2025-10-08T18:33:31.515006] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-08T18:33:31.900184] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-08T18:33:31.900264] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-08T18:33:31.900886] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-08T18:33:31.900961] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-08T18:33:31.903576] [DEBUG] [LOCAL ] DY: Trimmed 43898 records to 28554 (keeping 200 days of data) [2025-10-08T18:33:32.018225] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-08T18:33:32.085938] [DEBUG] [LOCAL ] DY: Primary data saved (28554 records). [2025-10-08T18:33:32.086080] [INFO ] [MAIN ] DY: Full history saved. [2025-10-08T18:33:32.086164] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DY took 27.8s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-08T18:33:32.259468] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:32.265399] [DEBUG] [LOCAL ] EAI: Loaded 3998 existing records from primary storage. [2025-10-08T18:33:32.265597] [INFO ] [MAIN ] EAI: Loaded 3998 existing records. [2025-10-08T18:33:32.453396] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:32.453632] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-08T18:33:32.453716] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-08T18:33:32.454058] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-08T18:33:32.454117] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-08T18:33:32.830478] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-08T18:33:32.836469] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:32.890742] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:33:33.598824] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T18:33:33.617529] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-08T18:33:34.121275] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T18:33:34.417603] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-08T18:33:34.939265] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:33:35.217570] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-08T18:33:36.016304] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:33:36.024179] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-08T18:33:36.817829] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-08T18:33:36.818084] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:33:36.969705] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:33:37.617582] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-08T18:33:37.847929] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T18:33:38.417706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-08T18:33:39.217718] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-08T18:33:39.428877] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T18:33:39.805851] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T18:33:40.017555] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-08T18:33:40.479459] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T18:33:40.483019] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57575 records). [2025-10-08T18:33:40.483163] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-08T18:33:40.596544] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T18:33:40.827751] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-08T18:33:40.882793] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-08T18:33:40.882877] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-08T18:33:40.883562] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-08T18:33:40.883601] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-08T18:33:40.884788] [DEBUG] [LOCAL ] DXYZ: Trimmed 57575 records to 37113 (keeping 200 days of data) [2025-10-08T18:33:41.103811] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37113 records). [2025-10-08T18:33:41.103958] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-08T18:33:41.104053] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DXYZ took 43.1s. Estimated remaining: 3h 55m 43s. Rate: 7.2 symbols/min [2025-10-08T18:33:41.270194] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:41.298935] [DEBUG] [LOCAL ] EARN: Loaded 29238 existing records from primary storage. [2025-10-08T18:33:41.299212] [INFO ] [MAIN ] EARN: Loaded 29238 existing records. [2025-10-08T18:33:41.481060] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:41.481307] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-08T18:33:41.481368] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-08T18:33:41.482223] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-08T18:33:41.482283] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-08T18:33:41.625088] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-08T18:33:41.858463] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:42.309616] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T18:33:42.417575] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-08T18:33:42.640607] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T18:33:43.217618] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-08T18:33:43.660181] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:33:43.662761] [INFO ] [REMOTE ] E: Full fetch complete (48025 records). [2025-10-08T18:33:43.662872] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-08T18:33:44.021684] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-08T18:33:44.037479] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-08T18:33:44.037583] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-08T18:33:44.039236] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-08T18:33:44.039396] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-08T18:33:44.040626] [DEBUG] [LOCAL ] E: Trimmed 48025 records to 33186 (keeping 200 days of data) [2025-10-08T18:33:44.248092] [DEBUG] [LOCAL ] E: Primary data saved (33186 records). [2025-10-08T18:33:44.248271] [INFO ] [MAIN ] E: Full history saved. [2025-10-08T18:33:44.248372] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. E took 38.7s. Estimated remaining: 3h 55m 22s. Rate: 7.2 symbols/min [2025-10-08T18:33:44.424380] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:44.449018] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T18:33:44.500601] [DEBUG] [LOCAL ] EAT: Loaded 49804 existing records from primary storage. [2025-10-08T18:33:44.500939] [INFO ] [MAIN ] EAT: Loaded 49804 existing records. [2025-10-08T18:33:44.678153] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:33:44.678399] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-08T18:33:44.678476] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-08T18:33:44.680047] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-08T18:33:44.680111] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-08T18:33:44.822717] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-08T18:33:45.048391] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:45.620584] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-08T18:33:45.625527] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:33:45.747134] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T18:33:46.417597] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-08T18:33:46.862427] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T18:33:47.217606] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-08T18:33:47.664173] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T18:33:48.017534] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-08T18:33:48.503398] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:33:48.817503] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-08T18:33:49.075388] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T18:33:49.259435] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T18:33:49.617559] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-08T18:33:50.417615] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-08T18:33:51.124300] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:33:51.124662] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T18:33:51.217587] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-08T18:33:52.017562] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-08T18:33:52.552567] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T18:33:52.590524] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:33:52.817576] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-08T18:33:53.617618] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-08T18:33:54.121254] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:33:54.417609] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-08T18:33:54.848825] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T18:33:54.851627] [INFO ] [REMOTE ] EAF: Full fetch complete (63179 records). [2025-10-08T18:33:54.851854] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-08T18:33:55.226269] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-08T18:33:55.243152] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-08T18:33:55.243215] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-08T18:33:55.244168] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-08T18:33:55.244331] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-08T18:33:55.245761] [DEBUG] [LOCAL ] EAF: Trimmed 63179 records to 42154 (keeping 200 days of data) [2025-10-08T18:33:55.486446] [DEBUG] [LOCAL ] EAF: Primary data saved (42154 records). [2025-10-08T18:33:55.486580] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-08T18:33:55.486695] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 31.6s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-08T18:33:55.652906] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:33:55.653099] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-08T18:33:55.653155] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-08T18:33:55.653269] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-08T18:33:55.653310] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-08T18:33:55.653351] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-08T18:33:55.653383] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-08T18:33:56.012207] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:33:56.017490] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-08T18:33:56.086052] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:33:56.725578] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T18:33:56.817509] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-08T18:33:57.489954] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:33:57.617530] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-08T18:33:58.004382] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T18:33:58.417556] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-08T18:33:58.823985] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T18:33:59.086384] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:33:59.217617] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-08T18:34:00.017557] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-08T18:34:00.817562] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-08T18:34:01.333717] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-08T18:34:01.392199] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:34:01.617574] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-08T18:34:02.399742] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T18:34:02.417525] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-08T18:34:03.115966] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T18:34:03.217528] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-08T18:34:03.930746] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:34:04.017519] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-08T18:34:04.756243] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T18:34:04.820346] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-08T18:34:04.822691] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T18:34:05.617553] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-08T18:34:06.417580] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-08T18:34:06.933850] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:34:06.934792] [INFO ] [REMOTE ] EAI: Full fetch complete (6124 records). [2025-10-08T18:34:06.934867] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-08T18:34:07.069854] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:34:07.102698] [INFO ] [REMOTE ] EARN: Full fetch complete (45718 records). [2025-10-08T18:34:07.108699] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-08T18:34:07.225740] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-08T18:34:07.527351] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-08T18:34:07.573626] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-08T18:34:07.617857] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-08T18:34:07.632127] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-08T18:34:07.687670] [DEBUG] [LOCAL ] EAI: Trimmed 6124 records to 4002 (keeping 200 days of data) [2025-10-08T18:34:07.698719] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-08T18:34:07.815411] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-08T18:34:07.816042] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-08T18:34:07.817235] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-08T18:34:07.817927] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-08T18:34:07.818544] [DEBUG] [LOCAL ] EAI: Primary data saved (4002 records). [2025-10-08T18:34:07.818859] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-08T18:34:07.818965] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EAI took 35.7s. Estimated remaining: 3h 55m 22s. Rate: 7.2 symbols/min [2025-10-08T18:34:07.819953] [DEBUG] [LOCAL ] EARN: Trimmed 45718 records to 29114 (keeping 200 days of data) [2025-10-08T18:34:07.987415] [DEBUG] [LOCAL ] EARN: Primary data saved (29114 records). [2025-10-08T18:34:07.987561] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-08T18:34:07.987670] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 26.9s. Estimated remaining: 3h 54m 54s. Rate: 7.2 symbols/min [2025-10-08T18:34:08.017580] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-08T18:34:08.899830] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:34:08.910371] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-08T18:34:09.182997] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:34:09.617603] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-08T18:34:10.386623] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:34:10.417538] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-08T18:34:11.127566] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:34:11.217560] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-08T18:34:12.673988] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T18:34:12.682598] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-08T18:34:12.915906] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-08T18:34:12.926871] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-08T18:34:14.001394] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:34:14.008526] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-08T18:34:14.696476] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:34:14.706520] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-08T18:34:15.228198] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:34:15.230862] [INFO ] [REMOTE ] EB: Full fetch complete (55631 records). [2025-10-08T18:34:15.230980] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-08T18:34:15.231756] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:34:15.231839] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:34:15.231898] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:34:15.231969] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-08T18:34:15.232032] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-08T18:34:15.232067] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-08T18:34:15.232130] [DEBUG] [LOCAL ] EB: No derivative data file found to delete. [2025-10-08T18:34:15.232214] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EB took 19.7s. Estimated remaining: 3h 54m 43s. Rate: 7.2 symbols/min [2025-10-08T18:34:16.322906] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T18:34:16.333723] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-08T18:34:18.153859] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T18:34:18.164483] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-08T18:34:19.925699] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:34:19.938087] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-08T18:34:21.638054] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:34:21.642789] [INFO ] [REMOTE ] EAT: Full fetch complete (72088 records). [2025-10-08T18:34:21.643023] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-08T18:34:22.089244] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-08T18:34:22.089366] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-08T18:34:22.090611] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-08T18:34:22.090715] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-08T18:34:22.092776] [DEBUG] [LOCAL ] EAT: Trimmed 72088 records to 49839 (keeping 200 days of data) [2025-10-08T18:34:22.445374] [DEBUG] [LOCAL ] EAT: Primary data saved (49839 records). [2025-10-08T18:34:22.445696] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-08T18:34:22.445830] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EAT took 38.2s. Estimated remaining: 3h 54m 32s. Rate: 7.2 symbols/min [2025-10-08T18:34:23.263071] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.285178] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.284251] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.286399] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:23.335250] [DEBUG] [LOCAL ] EBF: Loaded 19079 existing records from primary storage. [2025-10-08T18:34:23.335812] [INFO ] [MAIN ] EBF: Loaded 19079 existing records. [2025-10-08T18:34:23.464967] [DEBUG] [LOCAL ] EBR: Loaded 43045 existing records from primary storage. [2025-10-08T18:34:23.464243] [DEBUG] [LOCAL ] EBS: Loaded 46746 existing records from primary storage. [2025-10-08T18:34:23.497102] [INFO ] [MAIN ] EBR: Loaded 43045 existing records. [2025-10-08T18:34:23.509779] [INFO ] [MAIN ] EBS: Loaded 46746 existing records. [2025-10-08T18:34:23.521551] [DEBUG] [LOCAL ] EC: Loaded 49091 existing records from primary storage. [2025-10-08T18:34:23.634337] [INFO ] [MAIN ] EC: Loaded 49091 existing records. [2025-10-08T18:34:24.056250] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.063676] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.064083] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.067222] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-08T18:34:24.067100] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.067598] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.067856] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.073868] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-08T18:34:24.073717] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-08T18:34:24.079374] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-08T18:34:24.079291] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-08T18:34:24.089676] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-08T18:34:24.125601] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-08T18:34:24.125636] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-08T18:34:24.145602] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-08T18:34:24.456230] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:24.500254] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-08T18:34:24.561194] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-08T18:34:24.786788] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-08T18:34:24.827266] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-08T18:34:25.454003] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.457367] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-08T18:34:25.449660] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.471038] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-08T18:34:25.457111] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.491632] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-08T18:34:25.664919] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:25.665286] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-08T18:34:26.937330] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:34:26.941058] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-08T18:34:27.236083] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T18:34:27.247548] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-08T18:34:27.658229] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-08T18:34:27.675149] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-08T18:34:27.795100] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-08T18:34:27.805521] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-08T18:34:27.836764] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T18:34:27.841083] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-08T18:34:28.702385] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T18:34:28.706977] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-08T18:34:28.813401] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:34:28.823283] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-08T18:34:29.004549] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:34:29.015281] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-08T18:34:29.456602] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T18:34:29.467964] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-08T18:34:29.499214] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T18:34:29.505457] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-08T18:34:30.020482] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:34:30.029479] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-08T18:34:30.332478] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:34:30.342892] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-08T18:34:30.362833] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T18:34:30.417570] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-08T18:34:31.277010] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T18:34:31.286728] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-08T18:34:31.526625] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T18:34:31.549450] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:34:31.717262] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:34:32.017538] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-08T18:34:32.715885] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T18:34:32.817559] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-08T18:34:33.605607] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:34:33.617492] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-08T18:34:34.065124] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T18:34:34.417577] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-08T18:34:35.217545] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-08T18:34:35.320823] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:34:35.876453] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:34:36.017530] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-08T18:34:36.790104] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:34:36.817523] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-08T18:34:37.617584] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-08T18:34:37.739827] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:34:38.417505] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-08T18:34:38.525546] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T18:34:38.625701] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T18:34:39.217611] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-08T18:34:39.968175] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T18:34:40.017575] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-08T18:34:40.817526] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-08T18:34:40.998610] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:34:41.085487] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:34:41.617590] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-08T18:34:42.226038] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:34:42.417518] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-08T18:34:43.122631] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:34:43.217530] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-08T18:34:43.736714] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:34:44.017561] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-08T18:34:44.187116] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T18:34:44.817575] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-08T18:34:45.564780] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:34:45.617532] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-08T18:34:46.020946] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:34:46.417606] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-08T18:34:47.217593] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-08T18:34:47.342038] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:34:47.770105] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:34:48.013319] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T18:34:48.015728] [INFO ] [REMOTE ] EBF: Full fetch complete (27568 records). [2025-10-08T18:34:48.015811] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-08T18:34:48.022686] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-08T18:34:48.394567] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-08T18:34:48.394818] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-08T18:34:48.395322] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-08T18:34:48.395365] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-08T18:34:48.396091] [DEBUG] [LOCAL ] EBF: Trimmed 27568 records to 19015 (keeping 200 days of data) [2025-10-08T18:34:48.511769] [DEBUG] [LOCAL ] EBF: Primary data saved (19015 records). [2025-10-08T18:34:48.511933] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-08T18:34:48.512023] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 26.1s. Estimated remaining: 3h 55m 7s. Rate: 7.2 symbols/min [2025-10-08T18:34:48.678161] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:48.709003] [DEBUG] [LOCAL ] ECAT: Loaded 29448 existing records from primary storage. [2025-10-08T18:34:48.709287] [INFO ] [MAIN ] ECAT: Loaded 29448 existing records. [2025-10-08T18:34:48.822719] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-08T18:34:48.886768] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:48.887209] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-08T18:34:48.887258] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-08T18:34:48.888349] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-08T18:34:48.888424] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-08T18:34:49.251329] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:49.507425] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T18:34:49.511062] [INFO ] [REMOTE ] EBR: Full fetch complete (62489 records). [2025-10-08T18:34:49.511220] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-08T18:34:49.622703] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-08T18:34:49.929243] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-08T18:34:49.929367] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-08T18:34:49.930571] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-08T18:34:49.930676] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-08T18:34:49.932517] [DEBUG] [LOCAL ] EBR: Trimmed 62489 records to 43127 (keeping 200 days of data) [2025-10-08T18:34:50.200431] [DEBUG] [LOCAL ] EBR: Primary data saved (43127 records). [2025-10-08T18:34:50.200563] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-08T18:34:50.200671] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EBR took 27.8s. Estimated remaining: 3h 54m 43s. Rate: 7.2 symbols/min [2025-10-08T18:34:50.372901] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:50.412722] [DEBUG] [LOCAL ] ECC: Loaded 43086 existing records from primary storage. [2025-10-08T18:34:50.413050] [INFO ] [MAIN ] ECC: Loaded 43086 existing records. [2025-10-08T18:34:50.424290] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-08T18:34:50.599045] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:34:50.599348] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-08T18:34:50.599581] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-08T18:34:50.601180] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-08T18:34:50.601257] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-08T18:34:50.907096] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T18:34:51.065970] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:51.217708] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-08T18:34:51.342733] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:34:52.017541] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-08T18:34:52.626010] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:34:52.629546] [INFO ] [REMOTE ] EC: Full fetch complete (71820 records). [2025-10-08T18:34:52.629682] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-08T18:34:52.822714] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-08T18:34:53.014714] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-08T18:34:53.014817] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-08T18:34:53.015707] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-08T18:34:53.015774] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-08T18:34:53.017305] [DEBUG] [LOCAL ] EC: Trimmed 71820 records to 49065 (keeping 200 days of data) [2025-10-08T18:34:53.315295] [DEBUG] [LOCAL ] EC: Primary data saved (49065 records). [2025-10-08T18:34:53.315477] [INFO ] [MAIN ] EC: Full history saved. [2025-10-08T18:34:53.316879] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EC took 30.9s. Estimated remaining: 3h 54m 21s. Rate: 7.2 symbols/min [2025-10-08T18:34:53.489535] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:34:53.489737] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-08T18:34:53.489851] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-08T18:34:53.489938] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-08T18:34:53.489975] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-08T18:34:53.490015] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-08T18:34:53.490046] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-08T18:34:53.903462] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:34:53.903838] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-08T18:34:53.928718] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T18:34:54.417554] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-08T18:34:54.483139] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T18:34:54.553407] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:34:55.193504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (4.77 seconds). [2025-10-08T18:34:55.217514] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-08T18:34:55.644347] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T18:34:56.017558] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-08T18:34:56.520423] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T18:34:56.537681] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T18:34:56.817578] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-08T18:34:57.112739] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-08T18:34:57.617550] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-08T18:34:58.417566] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-08T18:34:58.744772] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T18:34:59.129592] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:34:59.217566] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-08T18:35:00.017564] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-08T18:35:00.363341] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:35:00.817566] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-08T18:35:01.617606] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-08T18:35:01.966475] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T18:35:01.978040] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:35:02.036330] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T18:35:02.042270] [INFO ] [REMOTE ] EBS: Full fetch complete (67384 records). [2025-10-08T18:35:02.042508] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-08T18:35:02.433017] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-08T18:35:02.456135] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-08T18:35:02.456223] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-08T18:35:02.457088] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-08T18:35:02.457236] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-08T18:35:02.458993] [DEBUG] [LOCAL ] EBS: Trimmed 67384 records to 46781 (keeping 200 days of data) [2025-10-08T18:35:02.734240] [DEBUG] [LOCAL ] EBS: Primary data saved (46781 records). [2025-10-08T18:35:02.734401] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-08T18:35:02.735559] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBS took 40.3s. Estimated remaining: 3h 54m 16s. Rate: 7.2 symbols/min [2025-10-08T18:35:02.913921] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:02.915151] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-08T18:35:02.915220] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-08T18:35:02.915478] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-08T18:35:02.915544] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-08T18:35:02.915602] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-08T18:35:02.915679] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-08T18:35:03.221462] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-08T18:35:03.308484] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:03.826093] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:35:04.017544] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-08T18:35:04.167513] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:35:04.508981] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T18:35:04.817551] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-08T18:35:05.487727] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:35:05.617550] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-08T18:35:06.417628] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-08T18:35:06.867595] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:35:07.089196] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T18:35:07.217526] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-08T18:35:07.679754] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:35:08.017557] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-08T18:35:08.817555] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-08T18:35:09.335414] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T18:35:09.354585] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T18:35:09.617527] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-08T18:35:10.062687] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T18:35:10.417602] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-08T18:35:11.217551] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-08T18:35:11.543179] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T18:35:11.883981] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T18:35:12.017533] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-08T18:35:12.356147] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T18:35:12.817625] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-08T18:35:13.168211] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T18:35:13.617566] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-08T18:35:14.078077] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:35:14.079087] [INFO ] [REMOTE ] ECCC: Full fetch complete (1303 records). [2025-10-08T18:35:14.079171] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-08T18:35:14.277595] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-08T18:35:14.277828] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:14.277901] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:14.277974] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-08T18:35:14.278038] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-08T18:35:14.278075] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-08T18:35:14.278132] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-08T18:35:14.278214] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCC took 21.0s. Estimated remaining: 3h 54m 15s. Rate: 7.2 symbols/min [2025-10-08T18:35:14.431107] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-08T18:35:14.465064] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:14.465263] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-08T18:35:14.465308] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-08T18:35:14.465423] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-08T18:35:14.465487] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-08T18:35:14.465553] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-08T18:35:14.465602] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-08T18:35:14.822801] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:15.217554] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-08T18:35:16.017577] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-08T18:35:16.410362] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:35:16.458729] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T18:35:16.685870] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:35:16.817582] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-08T18:35:17.617554] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-08T18:35:18.205671] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:35:18.417555] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-08T18:35:19.087823] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:35:19.217534] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-08T18:35:19.980484] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:35:20.014168] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T18:35:20.022210] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-08T18:35:20.383860] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T18:35:20.817608] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-08T18:35:21.617571] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-08T18:35:22.417595] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-08T18:35:22.468987] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:35:22.552452] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:35:22.932014] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T18:35:23.217600] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-08T18:35:23.676751] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:35:24.017579] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-08T18:35:24.817564] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-08T18:35:25.155779] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T18:35:25.178808] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T18:35:25.181716] [INFO ] [REMOTE ] ECAT: Full fetch complete (42950 records). [2025-10-08T18:35:25.181829] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-08T18:35:25.581469] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-08T18:35:25.581579] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-08T18:35:25.582363] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-08T18:35:25.582429] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-08T18:35:25.585305] [DEBUG] [LOCAL ] ECAT: Trimmed 42950 records to 29416 (keeping 200 days of data) [2025-10-08T18:35:25.642637] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-08T18:35:25.790499] [DEBUG] [LOCAL ] ECAT: Primary data saved (29416 records). [2025-10-08T18:35:25.790691] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-08T18:35:25.790829] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECAT took 37.3s. Estimated remaining: 3h 54m 15s. Rate: 7.2 symbols/min [2025-10-08T18:35:25.965944] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:25.966145] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-08T18:35:25.966183] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-08T18:35:25.966303] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-08T18:35:25.966344] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-08T18:35:25.966385] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-08T18:35:25.966459] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-08T18:35:26.341167] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:26.417500] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-08T18:35:27.048765] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T18:35:27.217520] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-08T18:35:27.475431] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:35:27.698428] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T18:35:28.017567] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-08T18:35:28.280274] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-08T18:35:28.817576] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-08T18:35:29.617636] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-08T18:35:30.022329] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:35:30.023125] [INFO ] [REMOTE ] ECCU: Full fetch complete (4510 records). [2025-10-08T18:35:30.023231] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-08T18:35:30.417670] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-08T18:35:30.417518] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-08T18:35:30.418755] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-08T18:35:30.419040] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-08T18:35:30.419155] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-08T18:35:30.419969] [DEBUG] [LOCAL ] ECCU: Trimmed 4510 records to 2260 (keeping 200 days of data) [2025-10-08T18:35:30.435750] [DEBUG] [LOCAL ] ECCU: Primary data saved (2260 records). [2025-10-08T18:35:30.435847] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-08T18:35:30.435919] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCU took 27.7s. Estimated remaining: 3h 53m 57s. Rate: 7.2 symbols/min [2025-10-08T18:35:30.648566] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:35:30.667333] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:30.724627] [DEBUG] [LOCAL ] ECG: Loaded 33518 existing records from primary storage. [2025-10-08T18:35:30.724976] [INFO ] [MAIN ] ECG: Loaded 33518 existing records. [2025-10-08T18:35:30.829396] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T18:35:30.907797] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:30.908067] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-08T18:35:30.908129] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-08T18:35:30.909244] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-08T18:35:30.909309] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-08T18:35:31.227735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-08T18:35:31.271301] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:31.676703] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:35:32.017550] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-08T18:35:32.817583] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-08T18:35:33.318146] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T18:35:33.321593] [INFO ] [REMOTE ] ECC: Full fetch complete (60964 records). [2025-10-08T18:35:33.321799] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-08T18:35:33.622774] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-08T18:35:33.735457] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-08T18:35:33.735578] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-08T18:35:33.736536] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-08T18:35:33.736604] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-08T18:35:33.738305] [DEBUG] [LOCAL ] ECC: Trimmed 60964 records to 43089 (keeping 200 days of data) [2025-10-08T18:35:33.998377] [DEBUG] [LOCAL ] ECC: Primary data saved (43089 records). [2025-10-08T18:35:33.998555] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-08T18:35:33.998683] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECC took 43.8s. Estimated remaining: 3h 53m 37s. Rate: 7.2 symbols/min [2025-10-08T18:35:34.032707] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:35:34.188881] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:35:34.216582] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:34.260628] [DEBUG] [LOCAL ] ECL: Loaded 46705 existing records from primary storage. [2025-10-08T18:35:34.260966] [INFO ] [MAIN ] ECL: Loaded 46705 existing records. [2025-10-08T18:35:34.425257] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-08T18:35:34.439131] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:34.439420] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-08T18:35:34.439467] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-08T18:35:34.440806] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-08T18:35:34.440867] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-08T18:35:34.793128] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:34.839943] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:35:35.217573] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-08T18:35:36.017609] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-08T18:35:36.817600] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-08T18:35:37.107136] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:35:37.188699] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:35:37.262601] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T18:35:37.617557] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-08T18:35:38.417588] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-08T18:35:39.213634] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T18:35:39.222815] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-08T18:35:39.566423] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:35:39.848238] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:35:40.017593] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-08T18:35:40.817555] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-08T18:35:41.158659] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T18:35:41.532620] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T18:35:41.617508] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-08T18:35:42.417577] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-08T18:35:42.867666] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T18:35:43.115254] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:35:43.217631] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-08T18:35:44.017608] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-08T18:35:44.817590] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-08T18:35:44.940500] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:35:45.178993] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T18:35:45.323196] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T18:35:45.617568] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-08T18:35:45.965748] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:35:46.417700] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-08T18:35:46.834985] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T18:35:47.217585] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-08T18:35:48.017605] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-08T18:35:48.519698] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T18:35:48.817553] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-08T18:35:49.233946] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T18:35:49.617555] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-08T18:35:49.906148] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:35:49.947317] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T18:35:50.417565] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-08T18:35:50.773266] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:35:51.217593] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-08T18:35:52.017554] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-08T18:35:52.377768] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T18:35:52.378567] [INFO ] [REMOTE ] ECCW: Full fetch complete (1421 records). [2025-10-08T18:35:52.378690] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-08T18:35:52.590809] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-08T18:35:52.591016] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:52.591064] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:52.591131] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-08T18:35:52.591197] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-08T18:35:52.591232] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-08T18:35:52.591272] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-08T18:35:52.591346] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCW took 38.3s. Estimated remaining: 3h 53m 54s. Rate: 7.2 symbols/min [2025-10-08T18:35:52.789682] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:35:52.810614] [DEBUG] [LOCAL ] ECO: Loaded 18390 existing records from primary storage. [2025-10-08T18:35:52.810966] [INFO ] [MAIN ] ECO: Loaded 18390 existing records. [2025-10-08T18:35:52.822721] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-08T18:35:53.017520] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:35:53.017940] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-08T18:35:53.018038] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-08T18:35:53.018895] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-08T18:35:53.018959] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-08T18:35:53.223258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T18:35:53.429092] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T18:35:53.434233] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:35:53.617674] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-08T18:35:54.417557] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-08T18:35:55.036381] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:35:55.217545] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-08T18:35:56.017517] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-08T18:35:56.223341] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:35:56.319468] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-08T18:35:56.322276] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T18:35:56.817580] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-08T18:35:57.617574] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-08T18:35:58.417521] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-08T18:35:58.522703] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:35:59.018380] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:35:59.217580] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-08T18:35:59.721603] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T18:35:59.722346] [INFO ] [REMOTE ] ECCX: Full fetch complete (1457 records). [2025-10-08T18:35:59.722433] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-08T18:35:59.935681] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-08T18:35:59.929596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:35:59.935940] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:35:59.942805] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:35:59.943221] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-08T18:35:59.943296] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-08T18:35:59.943338] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-08T18:35:59.943380] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-08T18:35:59.943457] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 34.2s. Estimated remaining: 3h 53m 43s. Rate: 7.2 symbols/min [2025-10-08T18:36:00.022630] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-08T18:36:00.124974] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:00.168735] [DEBUG] [LOCAL ] ECVT: Loaded 43236 existing records from primary storage. [2025-10-08T18:36:00.169226] [INFO ] [MAIN ] ECVT: Loaded 43236 existing records. [2025-10-08T18:36:00.349935] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:00.350255] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-08T18:36:00.350319] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-08T18:36:00.351344] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-08T18:36:00.351407] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-08T18:36:00.719232] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:00.817548] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-08T18:36:01.617557] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-08T18:36:02.417614] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-08T18:36:02.611593] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-08T18:36:02.847601] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T18:36:03.109369] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-08T18:36:03.217561] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-08T18:36:04.017524] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-08T18:36:04.138202] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:36:04.607291] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:36:04.817674] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-08T18:36:04.819734] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:36:05.617555] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-08T18:36:06.417521] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-08T18:36:06.455109] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:36:06.964522] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:36:07.217585] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-08T18:36:07.765306] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T18:36:07.768138] [INFO ] [REMOTE ] ECG: Full fetch complete (50940 records). [2025-10-08T18:36:07.768268] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-08T18:36:08.024334] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-08T18:36:08.177345] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-08T18:36:08.177448] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-08T18:36:08.178197] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-08T18:36:08.178263] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-08T18:36:08.179469] [DEBUG] [LOCAL ] ECG: Trimmed 50940 records to 33381 (keeping 200 days of data) [2025-10-08T18:36:08.387443] [DEBUG] [LOCAL ] ECG: Primary data saved (33381 records). [2025-10-08T18:36:08.387617] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-08T18:36:08.387746] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 38.0s. Estimated remaining: 3h 53m 35s. Rate: 7.2 symbols/min [2025-10-08T18:36:08.595510] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:08.655500] [DEBUG] [LOCAL ] ED: Loaded 52726 existing records from primary storage. [2025-10-08T18:36:08.655918] [INFO ] [MAIN ] ED: Loaded 52726 existing records. [2025-10-08T18:36:08.825205] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-08T18:36:08.876463] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:08.902986] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-08T18:36:08.903792] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-08T18:36:08.905865] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T18:36:08.915328] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-08T18:36:08.916979] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-08T18:36:09.309615] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:09.571106] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:36:09.617529] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-08T18:36:09.815247] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T18:36:10.417554] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-08T18:36:11.088667] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:36:11.092712] [INFO ] [REMOTE ] ECL: Full fetch complete (68023 records). [2025-10-08T18:36:11.092833] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-08T18:36:11.222631] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-08T18:36:11.497383] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:36:11.589178] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-08T18:36:11.589297] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-08T18:36:11.590618] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-08T18:36:11.590730] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-08T18:36:11.592628] [DEBUG] [LOCAL ] ECL: Trimmed 68023 records to 46683 (keeping 200 days of data) [2025-10-08T18:36:11.899025] [DEBUG] [LOCAL ] ECL: Primary data saved (46683 records). [2025-10-08T18:36:11.899169] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-08T18:36:11.899277] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 37.9s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-08T18:36:12.022767] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-08T18:36:12.077060] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:12.102741] [DEBUG] [LOCAL ] EDD: Loaded 27101 existing records from primary storage. [2025-10-08T18:36:12.103003] [INFO ] [MAIN ] EDD: Loaded 27101 existing records. [2025-10-08T18:36:12.287588] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:12.287842] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-08T18:36:12.287900] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-08T18:36:12.288797] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-08T18:36:12.288857] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-08T18:36:12.645232] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:12.817566] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-08T18:36:12.908123] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:36:13.617612] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-08T18:36:13.857032] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T18:36:14.422250] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-08T18:36:14.428703] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:36:14.602112] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:36:15.217595] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-08T18:36:15.938888] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T18:36:16.017531] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-08T18:36:16.702586] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:36:16.745604] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T18:36:16.817554] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-08T18:36:17.617597] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-08T18:36:17.798850] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:36:18.417605] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-08T18:36:18.650375] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:36:19.218635] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-08T18:36:19.220772] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:36:20.017562] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-08T18:36:20.817527] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-08T18:36:21.026895] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T18:36:21.159864] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T18:36:21.617562] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-08T18:36:21.844559] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T18:36:22.417574] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-08T18:36:23.100579] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:36:23.217569] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-08T18:36:23.496569] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T18:36:23.498355] [INFO ] [REMOTE ] ECO: Full fetch complete (28675 records). [2025-10-08T18:36:23.498440] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-08T18:36:23.879181] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-08T18:36:23.879266] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-08T18:36:23.879783] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-08T18:36:23.879845] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-08T18:36:23.880610] [DEBUG] [LOCAL ] ECO: Trimmed 28675 records to 18349 (keeping 200 days of data) [2025-10-08T18:36:23.992604] [DEBUG] [LOCAL ] ECO: Primary data saved (18349 records). [2025-10-08T18:36:23.992797] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-08T18:36:23.992894] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 31.4s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-10-08T18:36:24.022884] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-08T18:36:24.168013] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:24.182191] [DEBUG] [LOCAL ] EDF: Loaded 13197 existing records from primary storage. [2025-10-08T18:36:24.182463] [INFO ] [MAIN ] EDF: Loaded 13197 existing records. [2025-10-08T18:36:24.361358] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:24.361875] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-08T18:36:24.361939] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-08T18:36:24.362337] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-08T18:36:24.362394] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-08T18:36:24.745918] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:24.758669] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:36:24.817519] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-08T18:36:25.617532] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-08T18:36:25.659355] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T18:36:26.417514] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-08T18:36:26.588554] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T18:36:26.910760] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T18:36:27.217557] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-08T18:36:27.362684] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:36:28.017613] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-08T18:36:28.393445] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T18:36:28.817545] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-08T18:36:29.617582] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-08T18:36:29.834613] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T18:36:29.950212] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:36:30.348806] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T18:36:30.417542] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-08T18:36:31.217520] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-08T18:36:31.371270] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T18:36:32.017627] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-08T18:36:32.740143] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:36:32.808212] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T18:36:32.817499] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-08T18:36:33.617567] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-08T18:36:33.984395] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:36:34.417592] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-08T18:36:34.749267] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T18:36:34.752760] [INFO ] [REMOTE ] ECVT: Full fetch complete (60187 records). [2025-10-08T18:36:34.752857] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-08T18:36:35.134042] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-08T18:36:35.134178] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-08T18:36:35.135055] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-08T18:36:35.135119] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-08T18:36:35.136589] [DEBUG] [LOCAL ] ECVT: Trimmed 60187 records to 43281 (keeping 200 days of data) [2025-10-08T18:36:35.226049] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-08T18:36:35.393372] [DEBUG] [LOCAL ] ECVT: Primary data saved (43281 records). [2025-10-08T18:36:35.393500] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-08T18:36:35.393598] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 35.4s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-08T18:36:35.482767] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T18:36:35.573893] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:35.591815] [DEBUG] [LOCAL ] EDN: Loaded 18236 existing records from primary storage. [2025-10-08T18:36:35.592051] [INFO ] [MAIN ] EDN: Loaded 18236 existing records. [2025-10-08T18:36:35.766486] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:35.766732] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-08T18:36:35.766785] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-08T18:36:35.767364] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-08T18:36:35.767423] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-08T18:36:36.022782] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-08T18:36:36.118710] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:36.817508] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-08T18:36:37.363666] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T18:36:37.395231] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:36:37.617516] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-08T18:36:37.928440] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T18:36:38.417599] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-08T18:36:39.099955] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:36:39.131946] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T18:36:39.217519] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-08T18:36:40.017571] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-08T18:36:40.702394] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:36:40.717916] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T18:36:40.817551] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-08T18:36:41.617525] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-08T18:36:41.961928] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T18:36:42.417562] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-08T18:36:42.714159] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:36:43.137563] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T18:36:43.217538] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-08T18:36:44.017544] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-08T18:36:44.817583] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-08T18:36:45.081412] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:36:45.264397] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T18:36:45.297109] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:36:45.617558] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-08T18:36:46.417523] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-08T18:36:46.475115] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T18:36:47.217544] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-08T18:36:48.017522] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-08T18:36:48.041894] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:36:48.043458] [INFO ] [REMOTE ] EDF: Full fetch complete (20621 records). [2025-10-08T18:36:48.043543] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-08T18:36:48.365674] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T18:36:48.459751] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-08T18:36:48.459835] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-08T18:36:48.460279] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-08T18:36:48.460320] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-08T18:36:48.460910] [DEBUG] [LOCAL ] EDF: Trimmed 20621 records to 13210 (keeping 200 days of data) [2025-10-08T18:36:48.536091] [DEBUG] [LOCAL ] EDF: Primary data saved (13210 records). [2025-10-08T18:36:48.536236] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-08T18:36:48.536323] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDF took 24.5s. Estimated remaining: 3h 53m 18s. Rate: 7.2 symbols/min [2025-10-08T18:36:48.703051] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:48.746678] [DEBUG] [LOCAL ] EDU: Loaded 44805 existing records from primary storage. [2025-10-08T18:36:48.747005] [INFO ] [MAIN ] EDU: Loaded 44805 existing records. [2025-10-08T18:36:48.821105] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-08T18:36:48.933553] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:48.933926] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-08T18:36:48.934005] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-08T18:36:48.940335] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-08T18:36:48.945254] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-08T18:36:48.978031] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T18:36:49.311203] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:49.617571] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-08T18:36:50.340529] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:36:50.344971] [INFO ] [REMOTE ] ED: Full fetch complete (76301 records). [2025-10-08T18:36:50.345118] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-08T18:36:50.425005] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-08T18:36:50.751812] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-08T18:36:50.751991] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-08T18:36:50.752959] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-08T18:36:50.753022] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-08T18:36:50.754586] [DEBUG] [LOCAL ] ED: Trimmed 76301 records to 52710 (keeping 200 days of data) [2025-10-08T18:36:50.862048] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T18:36:51.107028] [DEBUG] [LOCAL ] ED: Primary data saved (52710 records). [2025-10-08T18:36:51.107173] [INFO ] [MAIN ] ED: Full history saved. [2025-10-08T18:36:51.108171] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. ED took 42.7s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-10-08T18:36:51.222777] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-08T18:36:51.280000] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:51.317742] [DEBUG] [LOCAL ] EE: Loaded 32733 existing records from primary storage. [2025-10-08T18:36:51.318067] [INFO ] [MAIN ] EE: Loaded 32733 existing records. [2025-10-08T18:36:51.494041] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:36:51.494310] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-08T18:36:51.494360] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-08T18:36:51.495373] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-08T18:36:51.495438] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-08T18:36:51.864385] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:52.017620] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-08T18:36:52.437395] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T18:36:52.555868] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T18:36:52.559920] [INFO ] [REMOTE ] EDD: Full fetch complete (38597 records). [2025-10-08T18:36:52.560152] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-08T18:36:52.822851] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-08T18:36:53.085358] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-08T18:36:53.085560] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-08T18:36:53.086520] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-08T18:36:53.086689] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-08T18:36:53.101966] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:36:53.107272] [DEBUG] [LOCAL ] EDD: Trimmed 38597 records to 26944 (keeping 200 days of data) [2025-10-08T18:36:53.279057] [DEBUG] [LOCAL ] EDD: Primary data saved (26944 records). [2025-10-08T18:36:53.279219] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-08T18:36:53.279310] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EDD took 41.4s. Estimated remaining: 3h 52m 33s. Rate: 7.2 symbols/min [2025-10-08T18:36:53.450469] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:36:53.450715] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-08T18:36:53.450777] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-08T18:36:53.450890] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-08T18:36:53.450933] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-08T18:36:53.450973] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-08T18:36:53.451003] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-08T18:36:53.622779] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-08T18:36:53.878172] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:36:54.405419] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:36:54.417495] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-08T18:36:55.217521] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-08T18:36:55.306139] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T18:36:55.791475] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T18:36:56.017524] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-08T18:36:56.339450] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T18:36:56.757974] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T18:36:56.817571] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-08T18:36:57.617513] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-08T18:36:57.695502] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:36:58.417551] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-08T18:36:59.217552] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-08T18:36:59.433842] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T18:36:59.499630] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:36:59.863696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:37:00.017548] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-08T18:37:00.817547] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-08T18:37:01.209976] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T18:37:01.617559] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-08T18:37:01.956070] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:37:02.417559] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-08T18:37:02.942891] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:37:03.217551] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-08T18:37:03.608886] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T18:37:04.017576] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-08T18:37:04.764813] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T18:37:04.817638] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-08T18:37:05.617552] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-08T18:37:05.810974] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T18:37:05.813159] [INFO ] [REMOTE ] EDN: Full fetch complete (29592 records). [2025-10-08T18:37:05.813302] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-08T18:37:05.936507] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T18:37:06.248816] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-08T18:37:06.248902] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-08T18:37:06.249443] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-08T18:37:06.249486] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-08T18:37:06.250205] [DEBUG] [LOCAL ] EDN: Trimmed 29592 records to 18262 (keeping 200 days of data) [2025-10-08T18:37:06.359875] [DEBUG] [LOCAL ] EDN: Primary data saved (18262 records). [2025-10-08T18:37:06.360051] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-08T18:37:06.360146] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 31.0s. Estimated remaining: 3h 52m 36s. Rate: 7.2 symbols/min [2025-10-08T18:37:06.426702] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-08T18:37:06.541977] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:06.559040] [DEBUG] [LOCAL ] EEX: Loaded 10938 existing records from primary storage. [2025-10-08T18:37:06.559544] [INFO ] [MAIN ] EEX: Loaded 10938 existing records. [2025-10-08T18:37:06.744856] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:06.745139] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-08T18:37:06.745187] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-08T18:37:06.745944] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-08T18:37:06.746019] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-08T18:37:07.173438] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:07.196626] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:37:07.217494] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-08T18:37:07.801025] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T18:37:08.017565] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-08T18:37:08.587241] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T18:37:08.817561] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-08T18:37:09.451101] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T18:37:09.617580] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-08T18:37:09.801197] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T18:37:10.417534] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-08T18:37:10.882192] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:37:10.934596] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:37:11.217551] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-08T18:37:11.866492] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T18:37:12.017563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-08T18:37:12.443802] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T18:37:12.817563] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-08T18:37:13.295941] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T18:37:13.617612] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-08T18:37:14.417613] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-08T18:37:15.042104] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T18:37:15.217518] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-08T18:37:15.299066] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T18:37:16.017557] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-08T18:37:16.685580] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:37:16.817552] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-08T18:37:17.084853] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T18:37:17.617574] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-08T18:37:17.998299] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:37:18.360473] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T18:37:18.417506] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-08T18:37:18.805440] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T18:37:19.217566] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-08T18:37:20.017566] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-08T18:37:20.509533] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T18:37:20.817618] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-08T18:37:21.356144] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T18:37:21.357063] [INFO ] [REMOTE ] EEA: Full fetch complete (3862 records). [2025-10-08T18:37:21.357139] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-08T18:37:21.565386] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:37:21.565887] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:37:21.566100] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:37:21.566210] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-08T18:37:21.566461] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-08T18:37:21.566609] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-08T18:37:21.566898] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-08T18:37:21.567042] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EEA took 28.3s. Estimated remaining: 3h 52m 44s. Rate: 7.2 symbols/min [2025-10-08T18:37:21.627553] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-08T18:37:21.793694] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:37:21.797455] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:21.857235] [DEBUG] [LOCAL ] EFC: Loaded 46373 existing records from primary storage. [2025-10-08T18:37:21.857633] [INFO ] [MAIN ] EFC: Loaded 46373 existing records. [2025-10-08T18:37:22.048918] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:22.049224] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-08T18:37:22.049283] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-08T18:37:22.050779] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-08T18:37:22.050841] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-08T18:37:22.410208] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:22.417497] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-08T18:37:22.825292] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:37:22.828071] [INFO ] [REMOTE ] EE: Full fetch complete (43693 records). [2025-10-08T18:37:22.828199] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-08T18:37:23.200113] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-08T18:37:23.200231] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-08T18:37:23.201040] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-08T18:37:23.201134] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-08T18:37:23.202829] [DEBUG] [LOCAL ] EE: Trimmed 43693 records to 32798 (keeping 200 days of data) [2025-10-08T18:37:23.262153] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-08T18:37:23.410131] [DEBUG] [LOCAL ] EE: Primary data saved (32798 records). [2025-10-08T18:37:23.410286] [INFO ] [MAIN ] EE: Full history saved. [2025-10-08T18:37:23.410373] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EE took 32.3s. Estimated remaining: 3h 52m 20s. Rate: 7.2 symbols/min [2025-10-08T18:37:23.590577] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:23.607797] [DEBUG] [LOCAL ] EFR: Loaded 14868 existing records from primary storage. [2025-10-08T18:37:23.608054] [INFO ] [MAIN ] EFR: Loaded 14868 existing records. [2025-10-08T18:37:23.794147] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:23.794376] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-08T18:37:23.794448] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-08T18:37:23.795037] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-08T18:37:23.795097] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-08T18:37:24.024728] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-08T18:37:24.183886] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:24.188458] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:37:24.448540] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-08T18:37:24.817584] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-08T18:37:25.587181] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:37:25.590769] [INFO ] [REMOTE ] EDU: Full fetch complete (66515 records). [2025-10-08T18:37:25.590916] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-08T18:37:25.626526] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-08T18:37:25.998801] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:37:26.017171] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-08T18:37:26.017306] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-08T18:37:26.023137] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-08T18:37:26.023302] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-08T18:37:26.024662] [DEBUG] [LOCAL ] EDU: Trimmed 66515 records to 44849 (keeping 200 days of data) [2025-10-08T18:37:26.297762] [DEBUG] [LOCAL ] EDU: Primary data saved (44849 records). [2025-10-08T18:37:26.297916] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-08T18:37:26.298005] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EDU took 37.8s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-10-08T18:37:26.422783] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-08T18:37:26.482527] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:26.498920] [DEBUG] [LOCAL ] EFT: Loaded 13169 existing records from primary storage. [2025-10-08T18:37:26.499228] [INFO ] [MAIN ] EFT: Loaded 13169 existing records. [2025-10-08T18:37:26.681991] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:26.682264] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-08T18:37:26.682315] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-08T18:37:26.682897] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-08T18:37:26.682961] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-08T18:37:27.029867] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:27.217527] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-08T18:37:27.320463] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:37:27.534500] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:37:28.017524] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-08T18:37:28.025635] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T18:37:28.817607] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-08T18:37:28.990492] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:37:29.617562] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-08T18:37:29.866173] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T18:37:30.253239] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T18:37:30.417557] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-08T18:37:31.174439] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T18:37:31.217560] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-08T18:37:32.017559] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-08T18:37:32.762555] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T18:37:32.817525] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-08T18:37:32.947187] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T18:37:33.389780] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:37:33.617551] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-08T18:37:34.291889] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:37:34.417588] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-08T18:37:35.217575] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-08T18:37:35.342279] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T18:37:35.946568] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T18:37:36.017511] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-08T18:37:36.816299] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:37:36.819312] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-08T18:37:37.617539] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-08T18:37:38.417574] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-08T18:37:38.506908] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:37:38.834876] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T18:37:39.064562] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T18:37:39.217553] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-08T18:37:40.017568] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-08T18:37:40.817538] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-08T18:37:40.887480] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T18:37:40.977894] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T18:37:41.617587] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-08T18:37:41.778600] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:37:42.042884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T18:37:42.417568] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-08T18:37:43.217521] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-08T18:37:43.411262] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:37:44.017555] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-08T18:37:44.819879] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-08T18:37:44.819519] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:37:44.846179] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T18:37:45.617596] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-08T18:37:45.648553] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:37:46.184504] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:37:46.417561] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-08T18:37:47.217554] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-08T18:37:48.022736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-08T18:37:48.038292] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T18:37:48.168798] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T18:37:48.817520] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-08T18:37:48.904449] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T18:37:49.617554] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-08T18:37:50.417528] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-08T18:37:50.449177] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T18:37:50.450864] [INFO ] [REMOTE ] EFT: Full fetch complete (17969 records). [2025-10-08T18:37:50.450933] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-08T18:37:50.838459] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-08T18:37:50.853490] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-08T18:37:50.869580] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-08T18:37:50.869756] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-08T18:37:50.874254] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:37:50.884682] [DEBUG] [LOCAL ] EFT: Trimmed 17969 records to 13144 (keeping 200 days of data) [2025-10-08T18:37:50.973525] [DEBUG] [LOCAL ] EFT: Primary data saved (13144 records). [2025-10-08T18:37:50.973725] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-08T18:37:50.973863] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFT took 24.7s. Estimated remaining: 3h 52m 29s. Rate: 7.2 symbols/min [2025-10-08T18:37:51.148012] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:51.191074] [DEBUG] [LOCAL ] EFX: Loaded 44568 existing records from primary storage. [2025-10-08T18:37:51.191460] [INFO ] [MAIN ] EFX: Loaded 44568 existing records. [2025-10-08T18:37:51.222717] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-08T18:37:51.304684] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:37:51.387475] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:51.387755] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-08T18:37:51.387807] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-08T18:37:51.389183] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-08T18:37:51.389244] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-08T18:37:51.752239] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:52.017584] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-08T18:37:52.330531] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:37:52.539601] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T18:37:52.540883] [INFO ] [REMOTE ] EEX: Full fetch complete (19052 records). [2025-10-08T18:37:52.540972] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-08T18:37:52.822791] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-08T18:37:52.985261] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-08T18:37:52.985353] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-08T18:37:52.985850] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-08T18:37:52.985913] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-08T18:37:52.986629] [DEBUG] [LOCAL ] EEX: Trimmed 19052 records to 10841 (keeping 200 days of data) [2025-10-08T18:37:53.055419] [DEBUG] [LOCAL ] EEX: Primary data saved (10841 records). [2025-10-08T18:37:53.055565] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-08T18:37:53.055679] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EEX took 46.7s. Estimated remaining: 3h 52m 6s. Rate: 7.2 symbols/min [2025-10-08T18:37:53.225072] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:37:53.253174] [DEBUG] [LOCAL ] EFXT: Loaded 29278 existing records from primary storage. [2025-10-08T18:37:53.253494] [INFO ] [MAIN ] EFXT: Loaded 29278 existing records. [2025-10-08T18:37:53.468583] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:37:53.468894] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-08T18:37:53.468966] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-08T18:37:53.469848] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-08T18:37:53.469923] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-08T18:37:53.622626] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-08T18:37:53.923753] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:37:54.417527] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-08T18:37:54.640826] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T18:37:54.732796] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:37:55.217553] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-08T18:37:55.894486] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T18:37:55.921567] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T18:37:56.017554] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-08T18:37:56.817564] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-08T18:37:57.628294] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-08T18:37:57.629948] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:37:58.184493] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:37:58.417543] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-08T18:37:59.217576] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-08T18:37:59.279435] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T18:37:59.799053] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:38:00.017505] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-08T18:38:00.123054] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T18:38:00.124868] [INFO ] [REMOTE ] EFR: Full fetch complete (19144 records). [2025-10-08T18:38:00.124954] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-08T18:38:00.517306] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-08T18:38:00.517410] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-08T18:38:00.518027] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-08T18:38:00.518096] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-08T18:38:00.518994] [DEBUG] [LOCAL ] EFR: Trimmed 19144 records to 14966 (keeping 200 days of data) [2025-10-08T18:38:00.613480] [DEBUG] [LOCAL ] EFR: Primary data saved (14966 records). [2025-10-08T18:38:00.613622] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-08T18:38:00.613748] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFR took 37.2s. Estimated remaining: 3h 51m 56s. Rate: 7.2 symbols/min [2025-10-08T18:38:00.777696] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:00.805346] [DEBUG] [LOCAL ] EG: Loaded 27855 existing records from primary storage. [2025-10-08T18:38:00.805621] [INFO ] [MAIN ] EG: Loaded 27855 existing records. [2025-10-08T18:38:00.826432] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-08T18:38:00.982439] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:00.982710] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-08T18:38:00.982793] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-08T18:38:00.983618] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-08T18:38:00.983733] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-08T18:38:01.335159] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:01.617539] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-08T18:38:01.881063] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T18:38:01.885020] [INFO ] [REMOTE ] EFC: Full fetch complete (66268 records). [2025-10-08T18:38:01.885205] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-08T18:38:01.886092] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:38:01.886207] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:38:01.886417] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:38:01.886500] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-08T18:38:01.886592] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-08T18:38:01.886680] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-08T18:38:01.887059] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-10-08T18:38:01.887187] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 40.3s. Estimated remaining: 3h 51m 31s. Rate: 7.2 symbols/min [2025-10-08T18:38:02.070227] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:02.124989] [DEBUG] [LOCAL ] EGO: Loaded 51673 existing records from primary storage. [2025-10-08T18:38:02.125339] [INFO ] [MAIN ] EGO: Loaded 51673 existing records. [2025-10-08T18:38:02.313946] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:02.314286] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-08T18:38:02.314388] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-08T18:38:02.314827] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-08T18:38:02.314888] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-08T18:38:02.422848] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-08T18:38:02.707107] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:02.725362] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:38:02.971099] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:38:03.217538] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-08T18:38:04.022684] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-08T18:38:04.033239] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:38:04.183858] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T18:38:04.817561] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-08T18:38:05.555319] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:38:05.617612] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-08T18:38:06.260826] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:38:06.417597] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-08T18:38:07.217513] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-08T18:38:07.408168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T18:38:07.899371] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:38:08.017536] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-08T18:38:08.817568] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-08T18:38:09.170887] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:38:09.439403] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:09.617574] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-08T18:38:10.017687] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T18:38:10.417546] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-08T18:38:11.115888] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:38:11.217544] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-08T18:38:11.433858] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:38:12.017557] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-08T18:38:12.121345] [DEBUG] [REMOTE ] EGO: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T18:38:12.121682] [WARN ] [REMOTE ] EGO: No data returned for month 2025-01 [2025-10-08T18:38:12.121793] [FATAL] [REMOTE ] EGO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:38:12.121876] [FATAL] [MAIN ] EGO: Failed to fetch primary data. [2025-10-08T18:38:12.121940] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:38:12.122023] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-08T18:38:12.122133] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-08T18:38:12.122191] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-10-08T18:38:12.122380] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-10-08T18:38:12.122482] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EGO took 10.2s. Estimated remaining: 3h 51m 27s. Rate: 7.2 symbols/min [2025-10-08T18:38:12.303739] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:12.338173] [DEBUG] [LOCAL ] EGP: Loaded 30699 existing records from primary storage. [2025-10-08T18:38:12.338490] [INFO ] [MAIN ] EGP: Loaded 30699 existing records. [2025-10-08T18:38:12.520157] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:12.520414] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-08T18:38:12.520464] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-08T18:38:12.520716] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-08T18:38:12.520773] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-08T18:38:12.823373] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-08T18:38:12.886634] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:12.911947] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T18:38:13.617560] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-08T18:38:14.417508] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-08T18:38:14.591157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T18:38:14.774407] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:38:15.217569] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-08T18:38:16.017604] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-08T18:38:16.056017] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:38:16.172834] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:38:16.817556] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-08T18:38:17.303441] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T18:38:17.617521] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-08T18:38:17.895232] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:38:18.417566] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-08T18:38:18.616575] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:38:19.217565] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-08T18:38:19.530812] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:38:20.017561] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-08T18:38:20.388812] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:38:20.817627] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-08T18:38:21.441469] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:21.617586] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-08T18:38:21.779329] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:38:21.782144] [INFO ] [REMOTE ] EFXT: Full fetch complete (44039 records). [2025-10-08T18:38:21.782237] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-08T18:38:22.156746] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-08T18:38:22.156862] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-08T18:38:22.157960] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-08T18:38:22.158021] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-08T18:38:22.159024] [DEBUG] [LOCAL ] EFXT: Trimmed 44039 records to 29343 (keeping 200 days of data) [2025-10-08T18:38:22.339963] [DEBUG] [LOCAL ] EFXT: Primary data saved (29343 records). [2025-10-08T18:38:22.340134] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-08T18:38:22.340253] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFXT took 29.3s. Estimated remaining: 3h 51m 23s. Rate: 7.2 symbols/min [2025-10-08T18:38:22.422904] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-08T18:38:22.517223] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:22.555580] [DEBUG] [LOCAL ] EGY: Loaded 41850 existing records from primary storage. [2025-10-08T18:38:22.555911] [INFO ] [MAIN ] EGY: Loaded 41850 existing records. [2025-10-08T18:38:22.730870] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:22.731151] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-08T18:38:22.731205] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-08T18:38:22.731437] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-08T18:38:22.731494] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-08T18:38:23.101395] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:23.180619] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:38:23.217535] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-08T18:38:24.017537] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-08T18:38:24.130349] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T18:38:24.360834] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:38:24.817559] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-08T18:38:25.482905] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:38:25.617575] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-08T18:38:26.042186] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T18:38:26.417519] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-08T18:38:26.820347] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:38:27.217592] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-08T18:38:27.874073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T18:38:28.017557] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-08T18:38:28.081265] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T18:38:28.817578] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-08T18:38:29.470203] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:38:29.617580] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-08T18:38:30.220466] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:38:30.417561] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-08T18:38:31.125042] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:38:31.217519] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-08T18:38:32.005589] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T18:38:32.017494] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-08T18:38:32.633505] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:38:32.817572] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-08T18:38:33.379932] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T18:38:33.617577] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-08T18:38:34.417521] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-08T18:38:34.596894] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:38:34.673694] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T18:38:35.217565] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-08T18:38:36.017954] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:38:36.018151] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-08T18:38:36.548052] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T18:38:36.817579] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-08T18:38:37.375598] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T18:38:37.379429] [INFO ] [REMOTE ] EG: Full fetch complete (43290 records). [2025-10-08T18:38:37.379623] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-08T18:38:37.627889] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-08T18:38:37.966486] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-08T18:38:37.966665] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-08T18:38:37.968082] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-08T18:38:37.968182] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-08T18:38:37.969874] [DEBUG] [LOCAL ] EG: Trimmed 43290 records to 27804 (keeping 200 days of data) [2025-10-08T18:38:38.249971] [DEBUG] [LOCAL ] EG: Primary data saved (27804 records). [2025-10-08T18:38:38.250186] [INFO ] [MAIN ] EG: Full history saved. [2025-10-08T18:38:38.250367] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EG took 37.6s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-08T18:38:38.418699] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-08T18:38:38.446297] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:38.446961] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-08T18:38:38.447033] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-08T18:38:38.449460] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-08T18:38:38.449583] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-08T18:38:38.449903] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-08T18:38:38.450079] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-08T18:38:38.817343] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:38:38.903938] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:38.911586] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:38:38.914883] [INFO ] [REMOTE ] EGP: Full fetch complete (45415 records). [2025-10-08T18:38:38.914975] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-08T18:38:39.227695] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-08T18:38:39.354682] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-08T18:38:39.354783] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-08T18:38:39.355483] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-08T18:38:39.355526] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-08T18:38:39.356605] [DEBUG] [LOCAL ] EGP: Trimmed 45415 records to 30646 (keeping 200 days of data) [2025-10-08T18:38:39.555680] [DEBUG] [LOCAL ] EGP: Primary data saved (30646 records). [2025-10-08T18:38:39.555842] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-08T18:38:39.555935] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EGP took 27.4s. Estimated remaining: 3h 51m 7s. Rate: 7.2 symbols/min [2025-10-08T18:38:39.723459] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:39.767162] [DEBUG] [LOCAL ] EHC: Loaded 41268 existing records from primary storage. [2025-10-08T18:38:39.767586] [INFO ] [MAIN ] EHC: Loaded 41268 existing records. [2025-10-08T18:38:39.955333] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:39.955599] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-08T18:38:39.955695] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-08T18:38:39.956077] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-08T18:38:39.956135] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-08T18:38:40.019184] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-08T18:38:40.182031] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:38:40.227198] [INFO ] [REMOTE ] EFX: Full fetch complete (64474 records). [2025-10-08T18:38:40.253689] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-08T18:38:40.489870] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:40.811515] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-08T18:38:40.811677] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-08T18:38:40.812689] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-08T18:38:40.812788] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-08T18:38:40.814622] [DEBUG] [LOCAL ] EFX: Trimmed 64474 records to 44556 (keeping 200 days of data) [2025-10-08T18:38:40.817609] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-08T18:38:40.959864] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:38:41.160805] [DEBUG] [LOCAL ] EFX: Primary data saved (44556 records). [2025-10-08T18:38:41.161034] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-08T18:38:41.161140] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EFX took 50.2s. Estimated remaining: 3h 50m 43s. Rate: 7.2 symbols/min [2025-10-08T18:38:41.340338] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:41.340689] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-10-08T18:38:41.340762] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-10-08T18:38:41.350588] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-08T18:38:41.357333] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-08T18:38:41.358173] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-10-08T18:38:41.358272] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-08T18:38:41.359267] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T18:38:41.626904] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-08T18:38:41.717100] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:42.417555] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-08T18:38:42.577537] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:38:42.636806] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:38:43.196778] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:38:43.217493] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-08T18:38:44.017525] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-08T18:38:44.039137] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T18:38:44.817528] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-08T18:38:45.142205] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:38:45.613719] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T18:38:45.617485] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-08T18:38:46.417577] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-08T18:38:46.453016] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T18:38:47.217573] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-08T18:38:47.607233] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T18:38:48.017598] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-08T18:38:48.757087] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:38:48.784970] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T18:38:48.817496] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-08T18:38:49.617551] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-08T18:38:50.258103] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T18:38:50.331889] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:38:50.417547] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-08T18:38:51.217581] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-08T18:38:52.017555] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-08T18:38:52.095288] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:38:52.368790] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:38:52.817531] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-08T18:38:52.977873] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:38:53.617549] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-08T18:38:53.882154] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T18:38:54.417581] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-08T18:38:55.189934] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:38:55.217515] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-08T18:38:55.498906] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T18:38:56.017576] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-08T18:38:56.635666] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T18:38:56.639386] [INFO ] [REMOTE ] EGY: Full fetch complete (61145 records). [2025-10-08T18:38:56.639509] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-08T18:38:56.821999] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-08T18:38:57.095499] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-08T18:38:57.095615] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-08T18:38:57.096433] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-08T18:38:57.096488] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-08T18:38:57.097847] [DEBUG] [LOCAL ] EGY: Trimmed 61145 records to 41770 (keeping 200 days of data) [2025-10-08T18:38:57.320048] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:38:57.370719] [DEBUG] [LOCAL ] EGY: Primary data saved (41770 records). [2025-10-08T18:38:57.370862] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-08T18:38:57.370950] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 35.0s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-08T18:38:57.549203] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:38:57.573370] [DEBUG] [LOCAL ] EIC: Loaded 23128 existing records from primary storage. [2025-10-08T18:38:57.573671] [INFO ] [MAIN ] EIC: Loaded 23128 existing records. [2025-10-08T18:38:57.627244] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-08T18:38:57.754958] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:38:57.755250] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-08T18:38:57.755306] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-08T18:38:57.755594] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-08T18:38:57.755682] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-08T18:38:58.120766] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:38:58.306352] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:38:58.417508] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-08T18:38:58.465513] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T18:38:59.038680] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T18:38:59.217578] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-08T18:39:00.017558] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-08T18:39:00.817516] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-08T18:39:00.927484] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T18:39:00.993208] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T18:39:01.617595] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-08T18:39:02.358830] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:39:02.417487] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-08T18:39:03.134171] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:39:03.217508] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-08T18:39:03.561076] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:39:04.017505] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-08T18:39:04.201577] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T18:39:04.817571] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-08T18:39:05.101499] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:39:05.617579] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-08T18:39:06.152272] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:39:06.415395] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T18:39:06.421081] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-08T18:39:07.217572] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-08T18:39:07.798344] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:39:07.928213] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T18:39:08.017534] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-08T18:39:08.734333] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T18:39:08.736186] [INFO ] [REMOTE ] EHI: Full fetch complete (16306 records). [2025-10-08T18:39:08.736268] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-08T18:39:08.822766] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-08T18:39:09.201288] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-08T18:39:09.201384] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-08T18:39:09.201860] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-08T18:39:09.201944] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-08T18:39:09.202583] [DEBUG] [LOCAL ] EHI: Trimmed 16306 records to 10705 (keeping 200 days of data) [2025-10-08T18:39:09.273338] [DEBUG] [LOCAL ] EHI: Primary data saved (10705 records). [2025-10-08T18:39:09.273488] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-08T18:39:09.273563] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHI took 28.1s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-08T18:39:09.474307] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:09.474486] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-08T18:39:09.474522] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-08T18:39:09.474638] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-08T18:39:09.474726] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-08T18:39:09.474809] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-08T18:39:09.474870] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-08T18:39:09.631528] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-08T18:39:09.832821] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:10.417570] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-08T18:39:10.565688] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T18:39:10.768278] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:39:10.770518] [INFO ] [REMOTE ] EHAB: Full fetch complete (40958 records). [2025-10-08T18:39:10.770607] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-08T18:39:11.142099] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-08T18:39:11.142216] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-08T18:39:11.142848] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-08T18:39:11.142915] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-08T18:39:11.143877] [DEBUG] [LOCAL ] EHAB: Trimmed 40958 records to 29327 (keeping 200 days of data) [2025-10-08T18:39:11.231490] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-08T18:39:11.332333] [DEBUG] [LOCAL ] EHAB: Primary data saved (29327 records). [2025-10-08T18:39:11.332499] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-08T18:39:11.332589] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHAB took 33.1s. Estimated remaining: 3h 50m 30s. Rate: 7.2 symbols/min [2025-10-08T18:39:11.550004] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:11.550173] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-08T18:39:11.550223] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-08T18:39:11.550357] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-08T18:39:11.550399] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-08T18:39:11.550441] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-08T18:39:11.550478] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-08T18:39:11.672280] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T18:39:11.746491] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:39:11.948559] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:12.017549] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-08T18:39:12.817568] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-08T18:39:13.581011] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:39:13.617511] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-08T18:39:13.658619] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T18:39:14.056167] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T18:39:14.417591] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-08T18:39:14.845903] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T18:39:15.217542] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-08T18:39:15.656637] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T18:39:16.017550] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-08T18:39:16.454160] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T18:39:16.817554] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-08T18:39:17.617559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-08T18:39:18.040863] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T18:39:18.042583] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T18:39:18.417554] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-08T18:39:19.217513] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-08T18:39:19.508190] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:39:19.696492] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:39:20.017570] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-08T18:39:20.264803] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-08T18:39:20.817546] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-08T18:39:21.617552] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-08T18:39:22.028282] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:39:22.054581] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:39:22.417572] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-08T18:39:23.217542] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-08T18:39:23.472976] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T18:39:23.578617] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T18:39:24.017569] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-08T18:39:24.356732] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:39:24.817555] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-08T18:39:25.149161] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:39:25.617601] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-08T18:39:25.967772] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T18:39:26.417544] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-08T18:39:26.856018] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T18:39:27.217559] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-08T18:39:27.692679] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T18:39:28.017580] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-08T18:39:28.817533] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-08T18:39:29.067481] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T18:39:29.148627] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T18:39:29.617591] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-08T18:39:30.080732] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T18:39:30.417628] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-08T18:39:30.893051] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T18:39:31.217561] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-08T18:39:32.017572] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-08T18:39:32.313505] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T18:39:32.429778] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T18:39:32.817597] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-08T18:39:33.175767] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T18:39:33.176432] [INFO ] [REMOTE ] EICA: Full fetch complete (1305 records). [2025-10-08T18:39:33.176500] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-08T18:39:33.353380] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-08T18:39:33.353623] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:33.353704] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:33.353752] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-08T18:39:33.353808] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-08T18:39:33.353841] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-08T18:39:33.353879] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-08T18:39:33.353935] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EICA took 24.1s. Estimated remaining: 3h 50m 54s. Rate: 7.2 symbols/min [2025-10-08T18:39:33.520138] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:33.520335] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-08T18:39:33.520393] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-08T18:39:33.520504] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-08T18:39:33.520545] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-08T18:39:33.520588] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-08T18:39:33.520619] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-08T18:39:33.618475] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-08T18:39:33.869408] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:34.417528] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-08T18:39:34.568070] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:39:34.570164] [INFO ] [REMOTE ] EIC: Full fetch complete (34556 records). [2025-10-08T18:39:34.570248] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-08T18:39:35.024538] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-08T18:39:35.024625] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-08T18:39:35.025244] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-08T18:39:35.025297] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-08T18:39:35.026136] [DEBUG] [LOCAL ] EIC: Trimmed 34556 records to 23043 (keeping 200 days of data) [2025-10-08T18:39:35.171560] [DEBUG] [LOCAL ] EIC: Primary data saved (23043 records). [2025-10-08T18:39:35.171822] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-08T18:39:35.171933] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 37.8s. Estimated remaining: 3h 50m 30s. Rate: 7.2 symbols/min [2025-10-08T18:39:35.224228] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-08T18:39:35.383982] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:35.406184] [DEBUG] [LOCAL ] EIG: Loaded 20324 existing records from primary storage. [2025-10-08T18:39:35.406447] [INFO ] [MAIN ] EIG: Loaded 20324 existing records. [2025-10-08T18:39:35.586424] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:39:35.586714] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-08T18:39:35.586770] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-08T18:39:35.587112] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-08T18:39:35.587170] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-08T18:39:35.717912] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T18:39:35.751450] [INFO ] [REMOTE ] EICB: Full fetch complete (2708 records). [2025-10-08T18:39:35.752530] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-08T18:39:35.949941] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:39:36.030284] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-08T18:39:36.009331] [INFO ] [REMOTE ] EHC: Full fetch complete (58799 records). [2025-10-08T18:39:36.054150] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-08T18:39:36.146173] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T18:39:36.187437] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:36.214598] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:36.214828] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:36.224166] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-08T18:39:36.256542] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-08T18:39:36.261903] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-08T18:39:36.280814] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-08T18:39:36.283273] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 25.0s. Estimated remaining: 3h 50m 5s. Rate: 7.2 symbols/min [2025-10-08T18:39:36.648980] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:39:36.752441] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-08T18:39:36.754188] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-08T18:39:36.758285] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:39:36.758116] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-08T18:39:36.760359] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-08T18:39:36.761789] [DEBUG] [LOCAL ] EHC: Trimmed 58799 records to 41177 (keeping 200 days of data) [2025-10-08T18:39:36.836806] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-08T18:39:36.903822] [DEBUG] [LOCAL ] EIX: Loaded 53343 existing records from primary storage. [2025-10-08T18:39:36.905067] [INFO ] [MAIN ] EIX: Loaded 53343 existing records. [2025-10-08T18:39:37.111416] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:39:37.113396] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-08T18:39:37.113966] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-08T18:39:37.114571] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-08T18:39:37.114691] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-08T18:39:37.595850] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:39:37.618053] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-08T18:39:37.642902] [DEBUG] [LOCAL ] EHC: Primary data saved (41177 records). [2025-10-08T18:39:37.643030] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-08T18:39:37.643121] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EHC took 58.1s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-08T18:39:37.884582] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:39:38.417534] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-08T18:39:38.875079] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T18:39:39.217516] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-08T18:39:39.252495] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:39:39.986492] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T18:39:40.017557] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-08T18:39:40.819829] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-08T18:39:40.823593] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:39:41.617535] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-08T18:39:42.188255] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:39:42.417546] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-08T18:39:42.521703] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T18:39:43.018671] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T18:39:43.217549] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-08T18:39:43.743992] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:39:44.017554] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-08T18:39:44.693800] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:39:44.817554] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-08T18:39:45.617522] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-08T18:39:45.681487] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T18:39:46.273931] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:39:46.417566] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-08T18:39:47.217578] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-08T18:39:47.255850] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T18:39:48.017638] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-08T18:39:48.817546] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-08T18:39:49.196994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T18:39:49.197839] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:39:49.404510] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T18:39:49.617561] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-08T18:39:50.417581] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-08T18:39:50.584034] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T18:39:51.141705] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:39:51.217513] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-08T18:39:52.005170] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T18:39:52.017482] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-08T18:39:52.567445] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T18:39:52.568545] [INFO ] [REMOTE ] EICC: Full fetch complete (8369 records). [2025-10-08T18:39:52.568622] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-08T18:39:52.569123] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T18:39:52.569206] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:39:52.569248] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:39:52.569285] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-08T18:39:52.569343] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-08T18:39:52.569381] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-08T18:39:52.569435] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-08T18:39:52.569523] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 19.2s. Estimated remaining: 3h 49m 47s. Rate: 7.2 symbols/min [2025-10-08T18:39:52.817609] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-08T18:39:53.617578] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-08T18:39:54.504925] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:39:54.509842] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-08T18:39:54.765694] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:39:55.217582] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-08T18:39:55.399097] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:39:56.017552] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-08T18:39:57.060707] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T18:39:57.072359] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-08T18:39:57.197282] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T18:39:57.617559] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-08T18:39:58.520728] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:39:58.522410] [INFO ] [REMOTE ] EIG: Full fetch complete (27100 records). [2025-10-08T18:39:58.522489] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-08T18:39:58.912287] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-08T18:39:58.912416] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-08T18:39:58.913168] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-08T18:39:58.913282] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-08T18:39:58.914497] [DEBUG] [LOCAL ] EIG: Trimmed 27100 records to 20264 (keeping 200 days of data) [2025-10-08T18:39:59.034162] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T18:39:59.048442] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-08T18:39:59.082902] [DEBUG] [LOCAL ] EIG: Primary data saved (20264 records). [2025-10-08T18:39:59.083031] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-08T18:39:59.083114] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 23.9s. Estimated remaining: 3h 49m 35s. Rate: 7.2 symbols/min [2025-10-08T18:40:01.466757] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-08T18:40:01.477788] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-08T18:40:03.535932] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T18:40:03.548446] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-08T18:40:05.557226] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T18:40:05.568931] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-08T18:40:07.235821] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T18:40:07.248768] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-08T18:40:09.098379] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T18:40:09.102690] [INFO ] [REMOTE ] EIX: Full fetch complete (77106 records). [2025-10-08T18:40:09.102874] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-08T18:40:09.497130] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-08T18:40:09.497235] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-08T18:40:09.498207] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-08T18:40:09.498290] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-08T18:40:09.499996] [DEBUG] [LOCAL ] EIX: Trimmed 77106 records to 53347 (keeping 200 days of data) [2025-10-08T18:40:09.855383] [DEBUG] [LOCAL ] EIX: Primary data saved (53347 records). [2025-10-08T18:40:09.855555] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-08T18:40:09.855684] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 33.6s. Estimated remaining: 3h 49m 32s. Rate: 7.2 symbols/min [2025-10-08T18:40:10.507535] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.668876] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.667438] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.673042] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-08T18:40:10.672687] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:10.673755] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-08T18:40:10.674093] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-08T18:40:10.674206] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-08T18:40:10.674305] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-08T18:40:10.674367] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-08T18:40:11.071228] [DEBUG] [LOCAL ] ELAN: Loaded 53273 existing records from primary storage. [2025-10-08T18:40:11.130410] [DEBUG] [LOCAL ] ELF: Loaded 52072 existing records from primary storage. [2025-10-08T18:40:11.129681] [INFO ] [MAIN ] ELAN: Loaded 53273 existing records. [2025-10-08T18:40:11.129420] [DEBUG] [LOCAL ] EL: Loaded 53369 existing records from primary storage. [2025-10-08T18:40:11.164526] [INFO ] [MAIN ] ELF: Loaded 52072 existing records. [2025-10-08T18:40:11.164421] [INFO ] [MAIN ] EL: Loaded 53369 existing records. [2025-10-08T18:40:11.332218] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:11.376179] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-08T18:40:11.786098] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.790485] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.760834] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:11.790869] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791094] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791346] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-08T18:40:11.791259] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-08T18:40:11.791476] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-08T18:40:11.791622] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-08T18:40:11.791957] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-08T18:40:11.792027] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-08T18:40:11.792054] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-08T18:40:11.792239] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-08T18:40:11.792157] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-08T18:40:11.888443] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-08T18:40:12.806415] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.826554] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.843166] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-08T18:40:12.842756] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-08T18:40:12.864544] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T18:40:12.867282] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-08T18:40:12.949432] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:12.949799] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-08T18:40:13.554589] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T18:40:13.556144] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-08T18:40:14.084606] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:40:14.086044] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-08T18:40:14.463535] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:40:14.474914] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-08T18:40:14.648136] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T18:40:14.649981] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-08T18:40:14.713053] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T18:40:14.723431] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-08T18:40:14.986845] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T18:40:14.997828] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-08T18:40:15.093101] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:40:15.095041] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-08T18:40:16.125008] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:40:16.127751] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-08T18:40:16.161575] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:40:16.174277] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-08T18:40:16.579791] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T18:40:16.595448] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-08T18:40:16.595688] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:40:16.598477] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-08T18:40:16.871631] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:40:16.882203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-08T18:40:17.246602] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T18:40:17.248360] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-08T18:40:17.452674] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:40:17.464017] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-08T18:40:17.747470] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T18:40:17.749113] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-08T18:40:18.321225] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:40:18.417532] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-08T18:40:18.592707] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T18:40:18.689761] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T18:40:18.923400] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T18:40:18.924227] [INFO ] [REMOTE ] ELC: Full fetch complete (5066 records). [2025-10-08T18:40:18.924316] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-08T18:40:19.234197] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-08T18:40:19.332415] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-08T18:40:19.332784] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-08T18:40:19.334870] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:40:19.335605] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-08T18:40:19.346153] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-08T18:40:19.347339] [DEBUG] [LOCAL ] ELC: Trimmed 5066 records to 3504 (keeping 200 days of data) [2025-10-08T18:40:19.368975] [DEBUG] [LOCAL ] ELC: Primary data saved (3504 records). [2025-10-08T18:40:19.369070] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-08T18:40:19.369147] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 9.5s. Estimated remaining: 3h 49m 26s. Rate: 7.2 symbols/min [2025-10-08T18:40:19.583023] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:19.623687] [DEBUG] [LOCAL ] ELME: Loaded 39289 existing records from primary storage. [2025-10-08T18:40:19.624008] [INFO ] [MAIN ] ELME: Loaded 39289 existing records. [2025-10-08T18:40:19.810287] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:19.810520] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-08T18:40:19.810565] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-08T18:40:19.810842] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-08T18:40:19.810900] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-08T18:40:20.027482] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-08T18:40:20.183095] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:20.817548] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-08T18:40:21.357389] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-08T18:40:21.617594] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-08T18:40:22.381341] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-08T18:40:22.417535] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-08T18:40:22.747470] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:40:23.217527] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-08T18:40:23.445796] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T18:40:24.017564] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-08T18:40:24.612157] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T18:40:24.736151] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-08T18:40:24.817568] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-08T18:40:25.617813] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-08T18:40:25.620122] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:40:25.897399] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:40:26.417566] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-08T18:40:27.217539] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-08T18:40:27.846977] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-08T18:40:27.904926] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:40:28.017559] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-08T18:40:28.817570] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-08T18:40:29.266079] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T18:40:29.499386] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:40:29.617542] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-08T18:40:30.175964] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T18:40:30.417559] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-08T18:40:31.066360] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:40:31.217555] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-08T18:40:32.017536] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-08T18:40:32.336108] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:40:32.522854] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:40:32.817549] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-08T18:40:33.617507] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-08T18:40:33.771543] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:40:34.417574] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-08T18:40:34.866516] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T18:40:35.196691] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:40:35.217507] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-08T18:40:35.508896] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:40:36.017622] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-08T18:40:36.817547] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-08T18:40:36.860600] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:40:37.617533] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-08T18:40:38.112160] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T18:40:38.417611] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-08T18:40:38.683743] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T18:40:38.747690] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:40:39.217632] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-08T18:40:40.017562] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-08T18:40:40.170265] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T18:40:40.817520] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-08T18:40:40.867676] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:40:41.617600] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-08T18:40:41.988254] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T18:40:42.381759] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:40:42.417531] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-08T18:40:43.184434] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T18:40:43.217517] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-08T18:40:44.017570] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-08T18:40:44.192035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:40:44.456540] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T18:40:44.461054] [INFO ] [REMOTE ] ELAN: Full fetch complete (76874 records). [2025-10-08T18:40:44.461246] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-08T18:40:44.823225] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-08T18:40:44.867722] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-08T18:40:44.867873] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-08T18:40:44.868871] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-08T18:40:44.868937] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-08T18:40:44.870568] [DEBUG] [LOCAL ] ELAN: Trimmed 76874 records to 53293 (keeping 200 days of data) [2025-10-08T18:40:45.200950] [DEBUG] [LOCAL ] ELAN: Primary data saved (53293 records). [2025-10-08T18:40:45.201103] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-08T18:40:45.201205] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELAN took 35.3s. Estimated remaining: 3h 49m 58s. Rate: 7.2 symbols/min [2025-10-08T18:40:45.383844] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:45.410225] [DEBUG] [LOCAL ] ELP: Loaded 25608 existing records from primary storage. [2025-10-08T18:40:45.410537] [INFO ] [MAIN ] ELP: Loaded 25608 existing records. [2025-10-08T18:40:45.608167] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:45.608775] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-08T18:40:45.608842] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-08T18:40:45.609220] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-08T18:40:45.609279] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-08T18:40:45.641464] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-08T18:40:45.941378] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T18:40:45.990921] [INFO ] [REMOTE ] ELF: Full fetch complete (75278 records). [2025-10-08T18:40:46.001925] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-08T18:40:46.023502] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:46.421535] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-08T18:40:46.426053] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-08T18:40:46.428080] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-08T18:40:46.429192] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-08T18:40:46.429394] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-08T18:40:46.431030] [DEBUG] [LOCAL ] ELF: Trimmed 75278 records to 52053 (keeping 200 days of data) [2025-10-08T18:40:46.757280] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:40:46.766055] [INFO ] [REMOTE ] EL: Full fetch complete (77275 records). [2025-10-08T18:40:46.766922] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-08T18:40:47.061623] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T18:40:47.117880] [INFO ] [REMOTE ] ELME: Full fetch complete (56104 records). [2025-10-08T18:40:47.152740] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-08T18:40:47.175155] [DEBUG] [LOCAL ] ELF: Primary data saved (52053 records). [2025-10-08T18:40:47.181361] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-08T18:40:47.181747] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELF took 37.3s. Estimated remaining: 3h 49m 35s. Rate: 7.2 symbols/min [2025-10-08T18:40:47.510684] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-08T18:40:47.528631] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-08T18:40:47.540900] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-08T18:40:47.588906] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-08T18:40:47.667170] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:47.701004] [DEBUG] [LOCAL ] EL: Trimmed 77275 records to 53372 (keeping 200 days of data) [2025-10-08T18:40:47.700575] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-08T18:40:47.755227] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-08T18:40:47.854058] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-08T18:40:47.864554] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-08T18:40:47.895673] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-08T18:40:47.925830] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-08T18:40:48.128319] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-08T18:40:48.134326] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-08T18:40:48.155240] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-08T18:40:48.155728] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-08T18:40:48.232283] [DEBUG] [LOCAL ] ELME: Trimmed 56104 records to 39293 (keeping 200 days of data) [2025-10-08T18:40:48.392975] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T18:40:48.489399] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-08T18:40:48.622989] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:48.628425] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-08T18:40:48.909962] [DEBUG] [LOCAL ] ELME: Primary data saved (39293 records). [2025-10-08T18:40:48.911372] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-08T18:40:48.912456] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELME took 29.5s. Estimated remaining: 3h 49m 12s. Rate: 7.2 symbols/min [2025-10-08T18:40:49.167441] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:49.172625] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T18:40:49.176246] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-08T18:40:49.204053] [DEBUG] [LOCAL ] EL: Primary data saved (53372 records). [2025-10-08T18:40:49.217692] [INFO ] [MAIN ] EL: Full history saved. [2025-10-08T18:40:49.217871] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. EL took 39.3s. Estimated remaining: 3h 48m 45s. Rate: 7.2 symbols/min [2025-10-08T18:40:49.389932] [DEBUG] [LOCAL ] ELS: Loaded 49737 existing records from primary storage. [2025-10-08T18:40:49.423148] [INFO ] [MAIN ] ELS: Loaded 49737 existing records. [2025-10-08T18:40:49.441032] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:40:49.621534] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:49.622727] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-08T18:40:49.622975] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-08T18:40:49.626452] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:40:49.627908] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-08T18:40:49.628020] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-08T18:40:49.628470] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-08T18:40:49.749564] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:40:49.871420] [DEBUG] [LOCAL ] ELV: Loaded 50629 existing records from primary storage. [2025-10-08T18:40:49.914130] [INFO ] [MAIN ] ELV: Loaded 50629 existing records. [2025-10-08T18:40:50.071538] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T18:40:50.219252] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:50.306111] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:40:50.306518] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-08T18:40:50.306586] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-08T18:40:50.306960] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-08T18:40:50.307021] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-08T18:40:50.422785] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-08T18:40:50.689958] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:40:50.810691] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T18:40:51.217538] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-08T18:40:52.017565] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-08T18:40:52.384720] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-08T18:40:52.817515] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-08T18:40:53.135170] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T18:40:53.169835] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:40:53.617557] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-08T18:40:53.946250] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T18:40:54.417547] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-08T18:40:55.199343] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T18:40:55.217498] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-08T18:40:55.556592] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T18:40:56.017552] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-08T18:40:56.817561] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-08T18:40:56.818844] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T18:40:57.174911] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:40:57.617553] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-08T18:40:58.417596] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-08T18:40:59.217513] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-08T18:40:59.305322] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:40:59.754801] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:41:00.017535] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-08T18:41:00.817545] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-08T18:41:01.296342] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:41:01.321379] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T18:41:01.617565] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-08T18:41:02.326184] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T18:41:02.417544] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-08T18:41:02.791629] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:41:03.217563] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-08T18:41:03.827981] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T18:41:04.017523] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-08T18:41:04.489748] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T18:41:04.817610] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-08T18:41:05.381815] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:41:05.617576] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-08T18:41:06.287603] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:41:06.417556] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-08T18:41:06.690866] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T18:41:06.803156] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T18:41:06.803868] [INFO ] [REMOTE ] ELPC: Full fetch complete (1424 records). [2025-10-08T18:41:06.803938] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-08T18:41:07.033669] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-08T18:41:07.033891] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:41:07.033960] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:41:07.034022] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-08T18:41:07.034120] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-08T18:41:07.034175] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-08T18:41:07.034274] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-08T18:41:07.034370] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 19.9s. Estimated remaining: 3h 48m 58s. Rate: 7.2 symbols/min [2025-10-08T18:41:07.222738] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-08T18:41:07.251322] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:07.252231] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-08T18:41:07.252291] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-08T18:41:07.252401] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-08T18:41:07.252444] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-08T18:41:07.252486] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-08T18:41:07.252519] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-08T18:41:07.707601] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:08.017564] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-08T18:41:08.473325] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:41:08.817562] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-08T18:41:09.617528] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-08T18:41:09.691669] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:41:09.932175] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:41:09.932471] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-08T18:41:09.932561] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:41:09.932667] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-08T18:41:09.932746] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:41:09.932832] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-08T18:41:09.932913] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-08T18:41:09.932963] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-08T18:41:09.933019] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-08T18:41:09.933089] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. EMA took 2.9s. Estimated remaining: 3h 48m 38s. Rate: 7.2 symbols/min [2025-10-08T18:41:10.103089] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:10.116998] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:41:10.139244] [DEBUG] [LOCAL ] EMD: Loaded 21092 existing records from primary storage. [2025-10-08T18:41:10.139530] [INFO ] [MAIN ] EMD: Loaded 21092 existing records. [2025-10-08T18:41:10.318558] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:10.318830] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-08T18:41:10.318900] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-08T18:41:10.319295] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-08T18:41:10.319355] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-08T18:41:10.419956] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-08T18:41:10.678864] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:11.217618] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-08T18:41:11.505026] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T18:41:11.507381] [INFO ] [REMOTE ] ELP: Full fetch complete (36922 records). [2025-10-08T18:41:11.507488] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-08T18:41:11.943819] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-08T18:41:11.943918] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-08T18:41:11.944585] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-08T18:41:11.944677] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-08T18:41:11.945886] [DEBUG] [LOCAL ] ELP: Trimmed 36922 records to 25619 (keeping 200 days of data) [2025-10-08T18:41:12.039299] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-08T18:41:12.117508] [DEBUG] [LOCAL ] ELP: Primary data saved (25619 records). [2025-10-08T18:41:12.117693] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-08T18:41:12.117805] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 26.9s. Estimated remaining: 3h 48m 15s. Rate: 7.2 symbols/min [2025-10-08T18:41:12.312502] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:12.343637] [DEBUG] [LOCAL ] EME: Loaded 31195 existing records from primary storage. [2025-10-08T18:41:12.343949] [INFO ] [MAIN ] EME: Loaded 31195 existing records. [2025-10-08T18:41:12.518551] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:12.518810] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-08T18:41:12.518858] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-08T18:41:12.519143] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-08T18:41:12.519204] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-08T18:41:12.829239] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-08T18:41:12.870941] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:13.358175] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-08T18:41:13.622728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-08T18:41:13.652305] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:41:14.159941] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T18:41:14.417608] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-08T18:41:15.217520] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-08T18:41:15.398218] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:41:16.017544] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-08T18:41:16.206427] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T18:41:16.265960] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T18:41:16.817575] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-08T18:41:17.219356] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:41:17.617513] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-08T18:41:17.864426] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T18:41:18.417552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-08T18:41:19.217602] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-08T18:41:19.343321] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:41:19.394110] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T18:41:20.017581] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-08T18:41:20.691796] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:41:20.817687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-08T18:41:21.621935] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-08T18:41:21.628002] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:41:22.417585] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-08T18:41:22.663774] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:41:23.158999] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T18:41:23.217558] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-08T18:41:24.017568] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-08T18:41:24.334321] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T18:41:24.489489] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:41:24.817582] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-08T18:41:25.285416] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:41:25.617560] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-08T18:41:26.219708] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:41:26.417632] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-08T18:41:27.217615] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-08T18:41:27.417790] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T18:41:27.507108] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T18:41:28.017528] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-08T18:41:28.817528] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-08T18:41:28.934065] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:41:29.455924] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:41:29.460843] [INFO ] [REMOTE ] ELS: Full fetch complete (70945 records). [2025-10-08T18:41:29.460981] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-08T18:41:29.598168] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:41:29.622611] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-08T18:41:29.995913] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-08T18:41:29.996020] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-08T18:41:29.996961] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-08T18:41:29.997027] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-08T18:41:29.998567] [DEBUG] [LOCAL ] ELS: Trimmed 70945 records to 49760 (keeping 200 days of data) [2025-10-08T18:41:30.327186] [DEBUG] [LOCAL ] ELS: Primary data saved (49760 records). [2025-10-08T18:41:30.327313] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-08T18:41:30.327398] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELS took 41.4s. Estimated remaining: 3h 48m 29s. Rate: 7.2 symbols/min [2025-10-08T18:41:30.419016] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-08T18:41:30.505196] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:30.505454] [DEBUG] [LOCAL ] EMF: No existing data file found in primary storage. [2025-10-08T18:41:30.505509] [WARN ] [MAIN ] EMF: No existing data found, performing full refresh instead. [2025-10-08T18:41:30.505620] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-08T18:41:30.505693] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-08T18:41:30.505751] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-10-08T18:41:30.505789] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-08T18:41:30.861861] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:41:30.887225] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:31.217687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-08T18:41:32.017565] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-08T18:41:32.189661] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:41:32.718835] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T18:41:32.817537] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-08T18:41:33.314895] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T18:41:33.617552] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-08T18:41:34.394885] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:41:34.417505] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-08T18:41:34.985737] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:41:35.217554] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-08T18:41:35.628604] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:41:36.017569] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-08T18:41:36.472985] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T18:41:36.817585] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-08T18:41:37.260727] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:41:37.590044] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T18:41:37.617551] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-08T18:41:38.012581] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:41:38.417558] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-08T18:41:39.217556] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-08T18:41:39.915046] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T18:41:40.019164] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-08T18:41:40.022548] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:41:40.026687] [INFO ] [REMOTE ] ELV: Full fetch complete (73109 records). [2025-10-08T18:41:40.026804] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-08T18:41:40.446431] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-08T18:41:40.446514] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-08T18:41:40.447486] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-08T18:41:40.447553] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-08T18:41:40.449061] [DEBUG] [LOCAL ] ELV: Trimmed 73109 records to 50611 (keeping 200 days of data) [2025-10-08T18:41:40.676240] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T18:41:40.779830] [DEBUG] [LOCAL ] ELV: Primary data saved (50611 records). [2025-10-08T18:41:40.779995] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-08T18:41:40.780095] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 51.6s. Estimated remaining: 3h 48m 26s. Rate: 7.2 symbols/min [2025-10-08T18:41:40.822732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-08T18:41:40.952057] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:40.999610] [DEBUG] [LOCAL ] EMN: Loaded 50612 existing records from primary storage. [2025-10-08T18:41:40.999958] [INFO ] [MAIN ] EMN: Loaded 50612 existing records. [2025-10-08T18:41:41.173565] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:41.173803] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-08T18:41:41.173849] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-08T18:41:41.174035] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-08T18:41:41.174073] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-08T18:41:41.526023] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:41.617592] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-08T18:41:42.288695] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:41:42.417562] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-08T18:41:42.458209] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T18:41:42.460323] [INFO ] [REMOTE ] EMD: Full fetch complete (32297 records). [2025-10-08T18:41:42.460408] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-08T18:41:42.857105] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-08T18:41:42.857202] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-08T18:41:42.857884] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-08T18:41:42.857951] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-08T18:41:42.858916] [DEBUG] [LOCAL ] EMD: Trimmed 32297 records to 21094 (keeping 200 days of data) [2025-10-08T18:41:43.002772] [DEBUG] [LOCAL ] EMD: Primary data saved (21094 records). [2025-10-08T18:41:43.002933] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-08T18:41:43.003073] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 33.1s. Estimated remaining: 3h 48m 4s. Rate: 7.2 symbols/min [2025-10-08T18:41:43.128150] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T18:41:43.202719] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:43.218458] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-08T18:41:43.219058] [DEBUG] [LOCAL ] EMO: Loaded 12812 existing records from primary storage. [2025-10-08T18:41:43.220522] [INFO ] [MAIN ] EMO: Loaded 12812 existing records. [2025-10-08T18:41:43.403905] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:43.404136] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-08T18:41:43.404186] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-08T18:41:43.404380] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-08T18:41:43.404438] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-08T18:41:43.758429] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:44.017508] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-08T18:41:44.817515] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-08T18:41:44.914986] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T18:41:45.019470] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T18:41:45.617550] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-08T18:41:46.424574] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-08T18:41:46.430797] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T18:41:46.447998] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T18:41:47.217536] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-08T18:41:47.835934] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:41:47.838591] [INFO ] [REMOTE ] EME: Full fetch complete (46853 records). [2025-10-08T18:41:47.838762] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-08T18:41:48.027704] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-08T18:41:48.239604] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-08T18:41:48.239741] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-08T18:41:48.240478] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-08T18:41:48.240537] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-08T18:41:48.241766] [DEBUG] [LOCAL ] EME: Trimmed 46853 records to 31165 (keeping 200 days of data) [2025-10-08T18:41:48.443912] [DEBUG] [LOCAL ] EME: Primary data saved (31165 records). [2025-10-08T18:41:48.444058] [INFO ] [MAIN ] EME: Full history saved. [2025-10-08T18:41:48.444147] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EME took 36.3s. Estimated remaining: 3h 47m 49s. Rate: 7.2 symbols/min [2025-10-08T18:41:48.623255] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:48.629411] [DEBUG] [LOCAL ] EMP: Loaded 3076 existing records from primary storage. [2025-10-08T18:41:48.629598] [INFO ] [MAIN ] EMP: Loaded 3076 existing records. [2025-10-08T18:41:48.826699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-08T18:41:48.880955] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:48.890824] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:41:48.893421] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T18:41:48.893530] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-08T18:41:48.905624] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-08T18:41:48.906290] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-08T18:41:48.906383] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-08T18:41:49.250847] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-08T18:41:49.343213] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:49.617530] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-08T18:41:50.417558] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-08T18:41:51.145514] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T18:41:51.217514] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-08T18:41:51.245775] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:41:51.906293] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T18:41:52.017544] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-08T18:41:52.345244] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T18:41:52.817552] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-08T18:41:53.599464] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T18:41:53.617507] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-08T18:41:54.417614] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-08T18:41:54.433195] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T18:41:55.217614] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-08T18:41:55.801519] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T18:41:56.017526] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-08T18:41:56.278968] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T18:41:56.483891] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T18:41:56.817543] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-08T18:41:57.617528] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-08T18:41:58.099396] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T18:41:58.100300] [INFO ] [REMOTE ] EMF: Full fetch complete (6898 records). [2025-10-08T18:41:58.100369] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-08T18:41:58.420254] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-08T18:41:58.493940] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-08T18:41:58.494143] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-08T18:41:58.494466] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-08T18:41:58.494548] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-08T18:41:58.495374] [DEBUG] [LOCAL ] EMF: Trimmed 6898 records to 3289 (keeping 200 days of data) [2025-10-08T18:41:58.517546] [DEBUG] [LOCAL ] EMF: Primary data saved (3289 records). [2025-10-08T18:41:58.517788] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-08T18:41:58.517924] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMF took 28.2s. Estimated remaining: 3h 47m 44s. Rate: 7.2 symbols/min [2025-10-08T18:41:58.709057] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T18:41:58.735887] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:41:58.817533] [DEBUG] [LOCAL ] EMR: Loaded 53240 existing records from primary storage. [2025-10-08T18:41:58.817981] [INFO ] [MAIN ] EMR: Loaded 53240 existing records. [2025-10-08T18:41:58.997816] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:41:58.998129] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-08T18:41:58.998214] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-08T18:41:58.998553] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-08T18:41:58.998611] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-08T18:41:59.222756] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-08T18:41:59.379277] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:41:59.396912] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T18:42:00.017604] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-08T18:42:00.817559] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-08T18:42:01.294714] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T18:42:01.339743] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T18:42:01.552036] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T18:42:01.617561] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-08T18:42:02.082542] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T18:42:02.417605] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-08T18:42:03.217578] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-08T18:42:03.876731] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:42:04.017605] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-08T18:42:04.121577] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T18:42:04.817575] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-08T18:42:05.617580] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-08T18:42:05.888272] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T18:42:06.057992] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T18:42:06.302337] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T18:42:06.417591] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-08T18:42:07.217586] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-08T18:42:08.017533] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-08T18:42:08.108921] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T18:42:08.495335] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T18:42:08.817531] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-08T18:42:08.946748] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T18:42:09.277472] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T18:42:09.617556] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-08T18:42:10.417584] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-08T18:42:10.910715] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T18:42:11.217626] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-08T18:42:11.885345] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T18:42:12.017578] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-08T18:42:12.810997] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:42:12.817485] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-08T18:42:13.168047] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T18:42:13.617533] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-08T18:42:13.801707] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:42:14.417587] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-08T18:42:14.523184] [DEBUG] [REMOTE ] EMP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-08T18:42:14.523564] [WARN ] [REMOTE ] EMP: No data returned for month 2025-07 [2025-10-08T18:42:14.523705] [FATAL] [REMOTE ] EMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:42:14.523818] [FATAL] [MAIN ] EMP: Failed to fetch primary data. [2025-10-08T18:42:14.523897] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:42:14.523987] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-08T18:42:14.524072] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-08T18:42:14.524170] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-08T18:42:14.524509] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-08T18:42:14.524624] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMP took 26.1s. Estimated remaining: 3h 47m 53s. Rate: 7.2 symbols/min [2025-10-08T18:42:14.716428] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:14.766823] [DEBUG] [LOCAL ] ENB: Loaded 53509 existing records from primary storage. [2025-10-08T18:42:14.767162] [INFO ] [MAIN ] ENB: Loaded 53509 existing records. [2025-10-08T18:42:14.948893] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:14.949691] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-08T18:42:14.949761] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-08T18:42:14.950442] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-08T18:42:14.950500] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-08T18:42:15.222195] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-08T18:42:15.287427] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T18:42:15.336269] [INFO ] [REMOTE ] EMN: Full fetch complete (72116 records). [2025-10-08T18:42:15.352671] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-08T18:42:15.361487] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:15.755072] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-08T18:42:15.755156] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-08T18:42:15.756050] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-08T18:42:15.756115] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-08T18:42:15.757523] [DEBUG] [LOCAL ] EMN: Trimmed 72116 records to 50628 (keeping 200 days of data) [2025-10-08T18:42:16.039230] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-08T18:42:16.079699] [DEBUG] [LOCAL ] EMN: Primary data saved (50628 records). [2025-10-08T18:42:16.079825] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-08T18:42:16.079923] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMN took 35.3s. Estimated remaining: 3h 47m 29s. Rate: 7.2 symbols/min [2025-10-08T18:42:16.250933] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:16.257507] [DEBUG] [LOCAL ] ENFY: Loaded 3219 existing records from primary storage. [2025-10-08T18:42:16.257706] [INFO ] [MAIN ] ENFY: Loaded 3219 existing records. [2025-10-08T18:42:16.432576] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:16.432804] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-08T18:42:16.432853] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-08T18:42:16.433016] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-08T18:42:16.433073] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-08T18:42:16.536113] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T18:42:16.544327] [INFO ] [REMOTE ] EMO: Full fetch complete (17467 records). [2025-10-08T18:42:16.559802] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-08T18:42:16.822465] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-08T18:42:17.095841] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:17.206578] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-08T18:42:17.206710] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-08T18:42:17.207102] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-08T18:42:17.207143] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-08T18:42:17.208563] [DEBUG] [LOCAL ] EMO: Trimmed 17467 records to 12883 (keeping 200 days of data) [2025-10-08T18:42:17.289826] [DEBUG] [LOCAL ] EMO: Primary data saved (12883 records). [2025-10-08T18:42:17.289975] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-08T18:42:17.290094] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMO took 34.3s. Estimated remaining: 3h 47m 5s. Rate: 7.2 symbols/min [2025-10-08T18:42:17.460320] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:17.503300] [DEBUG] [LOCAL ] ENIC: Loaded 36328 existing records from primary storage. [2025-10-08T18:42:17.503613] [INFO ] [MAIN ] ENIC: Loaded 36328 existing records. [2025-10-08T18:42:17.621084] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-08T18:42:17.690027] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:17.690988] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-08T18:42:17.691190] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-08T18:42:17.691532] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-08T18:42:17.691595] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-08T18:42:18.068425] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:18.106247] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T18:42:18.417557] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-08T18:42:18.436971] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:42:18.769873] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T18:42:19.217609] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-08T18:42:20.007586] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T18:42:20.012682] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T18:42:20.022922] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-08T18:42:20.817586] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-08T18:42:21.617563] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-08T18:42:21.836387] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T18:42:22.004505] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-08T18:42:22.166434] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:42:22.417619] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-08T18:42:22.794600] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-08T18:42:23.217602] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-08T18:42:23.560945] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T18:42:24.017704] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-08T18:42:24.516115] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T18:42:24.817565] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-08T18:42:25.617621] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-08T18:42:26.417539] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-08T18:42:26.602618] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T18:42:27.217705] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-08T18:42:27.404437] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T18:42:27.541986] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T18:42:27.569131] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T18:42:28.017582] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-08T18:42:28.817579] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-08T18:42:29.617572] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-08T18:42:29.681191] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T18:42:30.417575] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-08T18:42:30.553986] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-08T18:42:30.585486] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T18:42:31.217550] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-08T18:42:32.017519] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-08T18:42:32.149351] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:42:32.493963] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T18:42:32.710517] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:42:32.817499] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-08T18:42:33.617578] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-08T18:42:34.376387] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T18:42:34.417500] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-08T18:42:35.107861] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T18:42:35.217554] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-08T18:42:36.017583] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-08T18:42:36.316093] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T18:42:36.445763] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T18:42:36.817549] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-08T18:42:37.048136] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T18:42:37.378038] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T18:42:37.379087] [INFO ] [REMOTE ] ENFY: Full fetch complete (5543 records). [2025-10-08T18:42:37.379200] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-08T18:42:37.622691] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-08T18:42:37.800218] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-08T18:42:37.800323] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-08T18:42:37.800525] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-08T18:42:37.800579] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-08T18:42:37.801254] [DEBUG] [LOCAL ] ENFY: Trimmed 5543 records to 3235 (keeping 200 days of data) [2025-10-08T18:42:37.824135] [DEBUG] [LOCAL ] ENFY: Primary data saved (3235 records). [2025-10-08T18:42:37.824277] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-08T18:42:37.824406] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENFY took 21.7s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-10-08T18:42:38.016863] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:38.017134] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-08T18:42:38.017186] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-08T18:42:38.017333] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-08T18:42:38.017405] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-08T18:42:38.017463] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-08T18:42:38.017498] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-08T18:42:38.417928] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-08T18:42:38.417855] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:38.854201] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:42:39.217576] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-08T18:42:39.985793] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T18:42:40.017535] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-08T18:42:40.291391] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T18:42:40.817556] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-08T18:42:41.233632] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T18:42:41.617548] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-08T18:42:42.417614] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-08T18:42:42.838933] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T18:42:42.840757] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T18:42:43.185008] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:42:43.190692] [INFO ] [REMOTE ] EMR: Full fetch complete (77080 records). [2025-10-08T18:42:43.190852] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-08T18:42:43.222677] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-08T18:42:43.619539] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-08T18:42:43.619638] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-08T18:42:43.620670] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-08T18:42:43.620735] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-08T18:42:43.624000] [DEBUG] [LOCAL ] EMR: Trimmed 77080 records to 53224 (keeping 200 days of data) [2025-10-08T18:42:43.964860] [DEBUG] [LOCAL ] EMR: Primary data saved (53224 records). [2025-10-08T18:42:43.965023] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-08T18:42:43.965671] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. EMR took 45.4s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-08T18:42:44.025402] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-08T18:42:44.151072] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:44.199479] [DEBUG] [LOCAL ] ENOV: Loaded 44787 existing records from primary storage. [2025-10-08T18:42:44.199821] [INFO ] [MAIN ] ENOV: Loaded 44787 existing records. [2025-10-08T18:42:44.396982] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:44.397391] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-08T18:42:44.397505] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-08T18:42:44.397843] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-08T18:42:44.397957] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-08T18:42:44.551291] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:42:44.805893] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:44.817495] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-08T18:42:45.617545] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-08T18:42:45.958469] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T18:42:46.414138] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:42:46.423037] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-08T18:42:46.751294] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:42:46.950060] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T18:42:47.217554] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-08T18:42:47.605296] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T18:42:48.017555] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-08T18:42:48.817549] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-08T18:42:49.469219] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:42:49.617551] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-08T18:42:50.241399] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T18:42:50.417610] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-08T18:42:51.018628] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:42:51.217538] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-08T18:42:51.494995] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:42:51.714269] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:42:52.017556] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-08T18:42:52.817615] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-08T18:42:53.132432] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:42:53.135170] [INFO ] [REMOTE ] ENIC: Full fetch complete (51382 records). [2025-10-08T18:42:53.135343] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-08T18:42:53.562494] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-08T18:42:53.562634] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-08T18:42:53.563440] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-08T18:42:53.563506] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-08T18:42:53.564755] [DEBUG] [LOCAL ] ENIC: Trimmed 51382 records to 36357 (keeping 200 days of data) [2025-10-08T18:42:53.618911] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-08T18:42:53.788027] [DEBUG] [LOCAL ] ENIC: Primary data saved (36357 records). [2025-10-08T18:42:53.788191] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-08T18:42:53.788307] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 36.5s. Estimated remaining: 3h 47m 6s. Rate: 7.2 symbols/min [2025-10-08T18:42:53.956537] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:42:53.997192] [DEBUG] [LOCAL ] ENR: Loaded 43186 existing records from primary storage. [2025-10-08T18:42:53.997499] [INFO ] [MAIN ] ENR: Loaded 43186 existing records. [2025-10-08T18:42:54.106453] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T18:42:54.189772] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:42:54.190069] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-08T18:42:54.190124] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-08T18:42:54.190322] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-08T18:42:54.190379] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-08T18:42:54.420549] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-08T18:42:54.601592] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T18:42:54.607033] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:42:54.819736] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T18:42:55.217576] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-08T18:42:55.647738] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T18:42:56.017561] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-08T18:42:56.817579] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-08T18:42:57.181668] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:42:57.617527] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-08T18:42:57.896116] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:42:58.417594] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-08T18:42:59.217510] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-08T18:42:59.372624] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T18:43:00.017607] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-08T18:43:00.207986] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T18:43:00.212039] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-08T18:43:00.212183] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-08T18:43:00.608258] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-08T18:43:00.608373] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-08T18:43:00.609401] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-08T18:43:00.609466] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-08T18:43:00.611037] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53511 (keeping 200 days of data) [2025-10-08T18:43:00.828691] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-08T18:43:00.954122] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-08T18:43:00.954268] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-08T18:43:00.954352] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENB took 46.4s. Estimated remaining: 3h 46m 55s. Rate: 7.2 symbols/min [2025-10-08T18:43:01.144283] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:01.174458] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:43:01.210114] [DEBUG] [LOCAL ] ENS: Loaded 29309 existing records from primary storage. [2025-10-08T18:43:01.210415] [INFO ] [MAIN ] ENS: Loaded 29309 existing records. [2025-10-08T18:43:01.394135] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:01.394757] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:43:01.395469] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-08T18:43:01.395635] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-08T18:43:01.398479] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-08T18:43:01.398688] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-08T18:43:01.518669] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T18:43:01.624724] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-08T18:43:01.789244] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:02.417591] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-08T18:43:02.950878] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T18:43:02.962904] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T18:43:02.963985] [INFO ] [REMOTE ] ENO: Full fetch complete (3089 records). [2025-10-08T18:43:02.964117] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-08T18:43:03.222813] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-08T18:43:03.325404] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-08T18:43:03.325492] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-08T18:43:03.325668] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-08T18:43:03.325731] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-08T18:43:03.326112] [DEBUG] [LOCAL ] ENO: Trimmed 3089 records to 1889 (keeping 200 days of data) [2025-10-08T18:43:03.338374] [DEBUG] [LOCAL ] ENO: Primary data saved (1889 records). [2025-10-08T18:43:03.338433] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-08T18:43:03.338507] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENO took 25.5s. Estimated remaining: 3h 46m 33s. Rate: 7.2 symbols/min [2025-10-08T18:43:03.519737] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:03.548149] [DEBUG] [LOCAL ] ENVA: Loaded 25309 existing records from primary storage. [2025-10-08T18:43:03.548517] [INFO ] [MAIN ] ENVA: Loaded 25309 existing records. [2025-10-08T18:43:03.741496] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:03.741870] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-08T18:43:03.741954] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-08T18:43:03.742225] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-08T18:43:03.742307] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-08T18:43:04.024085] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-08T18:43:04.148303] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:04.822287] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-08T18:43:04.828099] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T18:43:05.488228] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:43:05.617572] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-08T18:43:05.883122] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T18:43:06.417598] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-08T18:43:07.217582] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-08T18:43:07.406555] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T18:43:07.463295] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:43:07.981017] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T18:43:08.017600] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-08T18:43:08.817632] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-08T18:43:09.349476] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T18:43:09.617618] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-08T18:43:10.417565] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-08T18:43:10.467725] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:43:10.527204] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T18:43:11.217594] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-08T18:43:11.556155] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T18:43:12.017549] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-08T18:43:12.180952] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:43:12.817590] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-08T18:43:13.617573] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-08T18:43:13.656354] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:43:13.718917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T18:43:14.417606] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-08T18:43:14.722852] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:43:15.217624] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-08T18:43:15.767901] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T18:43:15.772919] [INFO ] [REMOTE ] ENOV: Full fetch complete (63413 records). [2025-10-08T18:43:15.773114] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-08T18:43:16.023159] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-08T18:43:16.353990] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-08T18:43:16.354117] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-08T18:43:16.355630] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-08T18:43:16.355756] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-08T18:43:16.357449] [DEBUG] [LOCAL ] ENOV: Trimmed 63413 records to 44833 (keeping 200 days of data) [2025-10-08T18:43:16.673209] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T18:43:16.766481] [DEBUG] [LOCAL ] ENOV: Primary data saved (44833 records). [2025-10-08T18:43:16.766683] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-08T18:43:16.766829] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENOV took 32.8s. Estimated remaining: 3h 46m 36s. Rate: 7.2 symbols/min [2025-10-08T18:43:16.823127] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-08T18:43:16.965277] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:16.988353] [DEBUG] [LOCAL ] EOD: Loaded 14699 existing records from primary storage. [2025-10-08T18:43:16.988743] [INFO ] [MAIN ] EOD: Loaded 14699 existing records. [2025-10-08T18:43:17.171493] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:17.171862] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-08T18:43:17.171935] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-08T18:43:17.172183] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-08T18:43:17.172263] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-08T18:43:17.555119] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:43:17.554209] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:17.617493] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-08T18:43:18.411725] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:43:18.422354] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-08T18:43:19.126338] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:43:19.217581] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-08T18:43:19.402433] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:43:20.017588] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-08T18:43:20.079018] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:43:20.817558] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-08T18:43:21.161596] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:43:21.617574] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-08T18:43:21.916910] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T18:43:22.417556] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-08T18:43:22.841321] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T18:43:23.217513] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-08T18:43:23.554873] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T18:43:23.773686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:43:24.017569] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-08T18:43:24.785316] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T18:43:24.817519] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-08T18:43:25.454180] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T18:43:25.617598] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-08T18:43:26.417583] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-08T18:43:26.815547] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:43:26.818097] [INFO ] [REMOTE ] ENVA: Full fetch complete (36751 records). [2025-10-08T18:43:26.818178] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-08T18:43:27.208883] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-08T18:43:27.209279] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-08T18:43:27.209913] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-08T18:43:27.209976] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-08T18:43:27.212454] [DEBUG] [LOCAL ] ENVA: Trimmed 36751 records to 25329 (keeping 200 days of data) [2025-10-08T18:43:27.217602] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-08T18:43:27.372628] [DEBUG] [LOCAL ] ENVA: Primary data saved (25329 records). [2025-10-08T18:43:27.372787] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-08T18:43:27.372907] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENVA took 24.0s. Estimated remaining: 3h 46m 33s. Rate: 7.2 symbols/min [2025-10-08T18:43:27.546848] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:27.578972] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:43:27.625440] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-08T18:43:27.625825] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-08T18:43:27.801157] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:27.801567] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-08T18:43:27.801619] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-08T18:43:27.801910] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-08T18:43:27.801968] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-08T18:43:28.022764] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-08T18:43:28.159936] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:28.817576] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-08T18:43:28.961907] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:43:29.007054] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T18:43:29.617602] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-08T18:43:29.922943] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:43:30.417562] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-08T18:43:31.217572] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-08T18:43:31.513439] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T18:43:31.577500] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:43:32.017550] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-08T18:43:32.817517] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-08T18:43:32.875428] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:43:33.445971] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:43:33.617562] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-08T18:43:34.417574] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-08T18:43:34.550746] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T18:43:34.729289] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:43:35.217561] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-08T18:43:36.014156] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T18:43:36.023470] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-08T18:43:36.510434] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T18:43:36.513138] [INFO ] [REMOTE ] ENS: Full fetch complete (42103 records). [2025-10-08T18:43:36.513238] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-08T18:43:36.822735] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-08T18:43:36.923664] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-08T18:43:36.923758] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-08T18:43:36.924394] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-08T18:43:36.924434] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-08T18:43:36.925402] [DEBUG] [LOCAL ] ENS: Trimmed 42103 records to 29250 (keeping 200 days of data) [2025-10-08T18:43:37.119195] [DEBUG] [LOCAL ] ENS: Primary data saved (29250 records). [2025-10-08T18:43:37.119355] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-08T18:43:37.119441] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENS took 36.2s. Estimated remaining: 3h 46m 27s. Rate: 7.2 symbols/min [2025-10-08T18:43:37.318794] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:37.331673] [DEBUG] [LOCAL ] EOI: Loaded 10811 existing records from primary storage. [2025-10-08T18:43:37.331953] [INFO ] [MAIN ] EOI: Loaded 10811 existing records. [2025-10-08T18:43:37.531827] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:37.532111] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-08T18:43:37.532175] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-08T18:43:37.532450] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-08T18:43:37.532553] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-08T18:43:37.630797] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-08T18:43:37.923871] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T18:43:37.928940] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:38.268396] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:43:38.417558] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-08T18:43:38.509946] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T18:43:39.217528] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-08T18:43:39.604129] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:43:40.017510] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-08T18:43:40.167452] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T18:43:40.817561] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-08T18:43:41.617593] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-08T18:43:41.787569] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T18:43:42.004699] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T18:43:42.417564] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-08T18:43:43.100262] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T18:43:43.217528] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-08T18:43:43.304022] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T18:43:44.017554] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-08T18:43:44.409778] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:43:44.413029] [INFO ] [REMOTE ] ENR: Full fetch complete (58982 records). [2025-10-08T18:43:44.413124] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-08T18:43:44.619943] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T18:43:44.815306] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-08T18:43:44.815396] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-08T18:43:44.816177] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-08T18:43:44.816243] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-08T18:43:44.817545] [DEBUG] [LOCAL ] ENR: Trimmed 58982 records to 43238 (keeping 200 days of data) [2025-10-08T18:43:44.817747] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-08T18:43:45.089048] [DEBUG] [LOCAL ] ENR: Primary data saved (43238 records). [2025-10-08T18:43:45.089225] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-08T18:43:45.089341] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENR took 51.3s. Estimated remaining: 3h 46m 18s. Rate: 7.2 symbols/min [2025-10-08T18:43:45.265270] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:45.282499] [DEBUG] [LOCAL ] EOS: Loaded 15413 existing records from primary storage. [2025-10-08T18:43:45.282885] [INFO ] [MAIN ] EOS: Loaded 15413 existing records. [2025-10-08T18:43:45.461668] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:45.461930] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-08T18:43:45.461977] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-08T18:43:45.462182] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-08T18:43:45.462240] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-08T18:43:45.632246] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-08T18:43:45.817324] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:46.418331] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-08T18:43:46.421068] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T18:43:46.764538] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:43:47.217600] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-08T18:43:47.632568] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T18:43:48.017570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-08T18:43:48.212899] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T18:43:48.214833] [INFO ] [REMOTE ] EOD: Full fetch complete (20663 records). [2025-10-08T18:43:48.214904] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-08T18:43:48.588799] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-08T18:43:48.588902] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-08T18:43:48.589394] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-08T18:43:48.589440] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-08T18:43:48.590050] [DEBUG] [LOCAL ] EOD: Trimmed 20663 records to 14808 (keeping 200 days of data) [2025-10-08T18:43:48.680043] [DEBUG] [LOCAL ] EOD: Primary data saved (14808 records). [2025-10-08T18:43:48.680206] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-08T18:43:48.680297] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 31.9s. Estimated remaining: 3h 45m 59s. Rate: 7.2 symbols/min [2025-10-08T18:43:48.822719] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-08T18:43:48.857543] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:43:48.868328] [DEBUG] [LOCAL ] EOT: Loaded 6766 existing records from primary storage. [2025-10-08T18:43:48.868627] [INFO ] [MAIN ] EOT: Loaded 6766 existing records. [2025-10-08T18:43:49.061285] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T18:43:49.066864] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:43:49.071670] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-08T18:43:49.071749] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-08T18:43:49.071929] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-08T18:43:49.071989] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-08T18:43:49.434072] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:43:49.617516] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-08T18:43:49.771728] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:43:50.417544] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-08T18:43:50.473439] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:43:51.217516] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-08T18:43:51.514936] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:43:51.756911] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T18:43:52.017566] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-08T18:43:52.817544] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-08T18:43:52.843685] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T18:43:53.556243] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T18:43:53.617537] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-08T18:43:54.132138] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T18:43:54.417558] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-08T18:43:54.949325] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T18:43:55.217558] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-08T18:43:55.951870] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T18:43:56.017545] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-08T18:43:56.712482] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T18:43:56.817570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-08T18:43:57.617519] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-08T18:43:57.906376] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T18:43:58.417598] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-08T18:43:59.045382] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T18:43:59.217538] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-08T18:43:59.346376] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T18:43:59.880065] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T18:44:00.017522] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-08T18:44:00.817547] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:44:00.817627] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-08T18:44:01.617557] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-08T18:44:02.417609] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-08T18:44:02.629625] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T18:44:02.724602] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:44:03.088676] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T18:44:03.217527] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-08T18:44:04.017514] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-08T18:44:04.158912] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T18:44:04.817548] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-08T18:44:04.979531] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:44:04.981039] [INFO ] [REMOTE ] EOI: Full fetch complete (16264 records). [2025-10-08T18:44:04.981112] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-08T18:44:05.348582] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-08T18:44:05.348689] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-08T18:44:05.349067] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-08T18:44:05.349128] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-08T18:44:05.349629] [DEBUG] [LOCAL ] EOI: Trimmed 16264 records to 10829 (keeping 200 days of data) [2025-10-08T18:44:05.418220] [DEBUG] [LOCAL ] EOI: Primary data saved (10829 records). [2025-10-08T18:44:05.418363] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-08T18:44:05.418505] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 28.3s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-08T18:44:05.592040] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:05.617508] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-08T18:44:05.640264] [DEBUG] [LOCAL ] EPAC: Loaded 26790 existing records from primary storage. [2025-10-08T18:44:05.640521] [INFO ] [MAIN ] EPAC: Loaded 26790 existing records. [2025-10-08T18:44:05.750628] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T18:44:05.832092] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:05.832256] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-08T18:44:05.832301] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-08T18:44:05.832519] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-08T18:44:05.832576] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-08T18:44:06.189726] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:06.417562] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-08T18:44:07.217522] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-08T18:44:07.582372] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T18:44:07.603736] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T18:44:07.754838] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T18:44:08.017522] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-08T18:44:08.817608] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-08T18:44:09.148769] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T18:44:09.613838] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T18:44:09.617489] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-08T18:44:10.336483] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T18:44:10.417561] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-08T18:44:11.217595] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-08T18:44:11.784092] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:44:11.890682] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T18:44:12.017618] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-08T18:44:12.719189] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T18:44:12.817619] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-08T18:44:13.592548] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T18:44:13.617499] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-08T18:44:14.241215] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T18:44:14.242342] [INFO ] [REMOTE ] EOT: Full fetch complete (10648 records). [2025-10-08T18:44:14.242435] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-08T18:44:14.432792] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-08T18:44:14.725714] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-08T18:44:14.725848] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-08T18:44:14.726221] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-08T18:44:14.726302] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-08T18:44:14.727141] [DEBUG] [LOCAL ] EOT: Trimmed 10648 records to 6743 (keeping 200 days of data) [2025-10-08T18:44:14.781698] [DEBUG] [LOCAL ] EOT: Primary data saved (6743 records). [2025-10-08T18:44:14.781860] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-08T18:44:14.781946] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOT took 26.1s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-08T18:44:14.950100] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:14.991135] [DEBUG] [LOCAL ] EPAM: Loaded 39563 existing records from primary storage. [2025-10-08T18:44:14.991454] [INFO ] [MAIN ] EPAM: Loaded 39563 existing records. [2025-10-08T18:44:15.169294] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:15.169535] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-08T18:44:15.169582] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-08T18:44:15.169837] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-08T18:44:15.169895] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-08T18:44:15.225730] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-08T18:44:15.619843] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:15.633828] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:44:16.017565] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-08T18:44:16.501542] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:44:16.503362] [INFO ] [REMOTE ] EOS: Full fetch complete (23421 records). [2025-10-08T18:44:16.503436] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-08T18:44:16.827529] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-08T18:44:16.863594] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-08T18:44:16.863696] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-08T18:44:16.864170] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-08T18:44:16.864210] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-08T18:44:16.864855] [DEBUG] [LOCAL ] EOS: Trimmed 23421 records to 15423 (keeping 200 days of data) [2025-10-08T18:44:16.960396] [DEBUG] [LOCAL ] EOS: Primary data saved (15423 records). [2025-10-08T18:44:16.960550] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-08T18:44:16.960634] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOS took 31.9s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-08T18:44:17.126498] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:17.164505] [DEBUG] [LOCAL ] EPC: Loaded 39861 existing records from primary storage. [2025-10-08T18:44:17.164840] [INFO ] [MAIN ] EPC: Loaded 39861 existing records. [2025-10-08T18:44:17.356389] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:17.356928] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-08T18:44:17.357101] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-08T18:44:17.357855] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-08T18:44:17.358154] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-08T18:44:17.618517] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-08T18:44:17.659281] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:44:17.745677] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:18.417597] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-08T18:44:19.026157] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-08T18:44:19.080879] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T18:44:19.217568] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-08T18:44:20.017601] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-08T18:44:20.300086] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:44:20.637426] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T18:44:20.817583] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-08T18:44:21.617587] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-08T18:44:21.896751] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T18:44:22.223366] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T18:44:22.417533] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-08T18:44:23.081244] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:44:23.217564] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-08T18:44:24.017620] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-08T18:44:24.295937] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T18:44:24.529088] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-08T18:44:24.533308] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-08T18:44:24.533473] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-08T18:44:24.822618] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-08T18:44:24.949995] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-08T18:44:24.950127] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-08T18:44:24.951206] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-08T18:44:24.951280] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-08T18:44:24.953006] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53344 (keeping 200 days of data) [2025-10-08T18:44:25.448906] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:44:25.490502] [DEBUG] [LOCAL ] EOG: Primary data saved (53344 records). [2025-10-08T18:44:25.490728] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-08T18:44:25.490854] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOG took 58.1s. Estimated remaining: 3h 45m 34s. Rate: 7.2 symbols/min [2025-10-08T18:44:25.623005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-08T18:44:25.761843] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:25.762095] [DEBUG] [LOCAL ] EPD: No existing data file found in primary storage. [2025-10-08T18:44:25.762142] [WARN ] [MAIN ] EPD: No existing data found, performing full refresh instead. [2025-10-08T18:44:25.762283] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-08T18:44:25.762334] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-08T18:44:25.762385] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-10-08T18:44:25.762481] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-08T18:44:26.223519] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:26.370381] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T18:44:26.417510] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-08T18:44:26.739182] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:44:27.217557] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-08T18:44:28.017613] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-08T18:44:28.127198] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:44:28.535190] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:44:28.817535] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-08T18:44:29.130171] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:44:29.617571] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-08T18:44:30.393381] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T18:44:30.417505] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-08T18:44:30.857111] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T18:44:31.217591] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-08T18:44:31.867000] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T18:44:32.017838] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-08T18:44:32.742031] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T18:44:32.817576] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-08T18:44:33.617513] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-08T18:44:33.890148] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T18:44:34.042357] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T18:44:34.417576] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-08T18:44:35.011957] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:44:35.217546] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-08T18:44:35.282734] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T18:44:36.017552] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-08T18:44:36.817558] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-08T18:44:36.885475] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T18:44:37.247063] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T18:44:37.617556] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-08T18:44:38.099447] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T18:44:38.417922] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-08T18:44:38.966937] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T18:44:39.217558] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-08T18:44:40.017544] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-08T18:44:40.416345] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T18:44:40.419662] [INFO ] [REMOTE ] EPAM: Full fetch complete (55957 records). [2025-10-08T18:44:40.419779] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-08T18:44:40.749919] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-08T18:44:40.817504] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-08T18:44:40.853803] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-08T18:44:40.853888] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-08T18:44:40.854812] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-08T18:44:40.854994] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-08T18:44:40.856345] [DEBUG] [LOCAL ] EPAM: Trimmed 55957 records to 39420 (keeping 200 days of data) [2025-10-08T18:44:41.102324] [DEBUG] [LOCAL ] EPAM: Primary data saved (39420 records). [2025-10-08T18:44:41.102469] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-08T18:44:41.102552] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAM took 26.3s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-08T18:44:41.280586] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:41.280937] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-08T18:44:41.281006] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-08T18:44:41.281321] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-08T18:44:41.281441] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-08T18:44:41.281525] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-08T18:44:41.281569] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-08T18:44:41.563860] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T18:44:41.620381] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-08T18:44:41.697457] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:42.417547] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-08T18:44:42.539187] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:44:42.675506] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T18:44:42.677689] [INFO ] [REMOTE ] EPAC: Full fetch complete (38853 records). [2025-10-08T18:44:42.677763] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-08T18:44:43.051638] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-08T18:44:43.051757] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-08T18:44:43.052342] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-08T18:44:43.052381] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-08T18:44:43.053313] [DEBUG] [LOCAL ] EPAC: Trimmed 38853 records to 26691 (keeping 200 days of data) [2025-10-08T18:44:43.217810] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-08T18:44:43.221462] [DEBUG] [LOCAL ] EPAC: Primary data saved (26691 records). [2025-10-08T18:44:43.221603] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-08T18:44:43.221752] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPAC took 37.8s. Estimated remaining: 3h 45m 19s. Rate: 7.2 symbols/min [2025-10-08T18:44:43.395322] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:43.395509] [DEBUG] [LOCAL ] EPRT: No existing data file found in primary storage. [2025-10-08T18:44:43.395545] [WARN ] [MAIN ] EPRT: No existing data found, performing full refresh instead. [2025-10-08T18:44:43.395690] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-08T18:44:43.395745] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-08T18:44:43.395787] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-08T18:44:43.395818] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-08T18:44:43.773599] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:43.842174] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T18:44:44.017700] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-08T18:44:44.818228] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-08T18:44:44.823965] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T18:44:45.526230] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T18:44:45.617501] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-08T18:44:46.215740] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:44:46.417588] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-08T18:44:46.991560] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T18:44:47.217562] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-08T18:44:48.009868] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T18:44:48.018212] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-08T18:44:48.250694] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T18:44:48.817569] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-08T18:44:49.361364] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:44:49.617561] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-08T18:44:50.417536] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-08T18:44:50.521435] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T18:44:51.217555] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-08T18:44:51.568207] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:44:51.677409] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:44:52.017608] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-08T18:44:52.511420] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:44:52.817602] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-08T18:44:53.160538] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:44:53.617575] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-08T18:44:54.430256] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-08T18:44:54.457494] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T18:44:55.217554] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-08T18:44:55.300939] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T18:44:55.856287] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T18:44:56.017559] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-08T18:44:56.263481] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T18:44:56.267554] [INFO ] [REMOTE ] EPC: Full fetch complete (57064 records). [2025-10-08T18:44:56.267687] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-08T18:44:56.665187] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-08T18:44:56.665272] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-08T18:44:56.666043] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-08T18:44:56.666105] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-08T18:44:56.669575] [DEBUG] [LOCAL ] EPC: Trimmed 57064 records to 39795 (keeping 200 days of data) [2025-10-08T18:44:56.849906] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-08T18:44:56.921738] [DEBUG] [LOCAL ] EPC: Primary data saved (39795 records). [2025-10-08T18:44:56.921866] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-08T18:44:56.921945] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPC took 40.0s. Estimated remaining: 3h 45m 22s. Rate: 7.2 symbols/min [2025-10-08T18:44:57.094198] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:44:57.107545] [DEBUG] [LOCAL ] EQBK: Loaded 10957 existing records from primary storage. [2025-10-08T18:44:57.107797] [INFO ] [MAIN ] EQBK: Loaded 10957 existing records. [2025-10-08T18:44:57.286361] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:44:57.286569] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-08T18:44:57.286615] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-08T18:44:57.286902] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-08T18:44:57.286960] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-08T18:44:57.624355] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-08T18:44:57.679433] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:44:57.706266] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T18:44:58.425916] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-08T18:44:58.444140] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T18:44:59.217543] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-08T18:44:59.627045] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:45:00.017600] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-08T18:45:00.061264] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T18:45:00.509169] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T18:45:00.817598] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-08T18:45:01.617593] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-08T18:45:02.120497] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T18:45:02.417539] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-08T18:45:02.654423] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T18:45:02.709457] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T18:45:03.217558] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-08T18:45:04.017525] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-08T18:45:04.376042] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T18:45:04.817837] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-08T18:45:04.818263] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T18:45:04.858169] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T18:45:05.617581] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-08T18:45:06.417692] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-08T18:45:06.504335] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:45:06.508697] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-08T18:45:06.508877] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-08T18:45:06.925029] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-08T18:45:06.925150] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-08T18:45:06.926101] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-08T18:45:06.926168] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-08T18:45:06.927787] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53611 (keeping 200 days of data) [2025-10-08T18:45:07.219730] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-08T18:45:07.272985] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-08T18:45:07.273160] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-08T18:45:07.273242] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 41.8s. Estimated remaining: 3h 45m 18s. Rate: 7.2 symbols/min [2025-10-08T18:45:07.451316] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:07.451605] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-08T18:45:07.451754] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-08T18:45:07.451896] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-08T18:45:07.451999] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-08T18:45:07.452168] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-08T18:45:07.452223] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-08T18:45:07.624066] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T18:45:07.887005] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:07.918393] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:45:08.008016] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T18:45:08.017550] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-08T18:45:08.643071] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T18:45:08.817700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-08T18:45:09.617525] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-08T18:45:09.780903] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:45:10.417543] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-08T18:45:11.219011] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-08T18:45:11.218917] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:45:11.407301] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T18:45:12.017558] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-08T18:45:12.817568] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-08T18:45:13.283719] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-08T18:45:13.617516] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-08T18:45:13.696883] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:45:13.855289] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T18:45:13.859105] [INFO ] [REMOTE ] EPRT: Full fetch complete (68950 records). [2025-10-08T18:45:13.859238] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-08T18:45:14.242056] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-08T18:45:14.242177] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-08T18:45:14.243078] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-08T18:45:14.243143] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-08T18:45:14.244594] [DEBUG] [LOCAL ] EPRT: Trimmed 68950 records to 48408 (keeping 200 days of data) [2025-10-08T18:45:14.424695] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-08T18:45:14.553376] [DEBUG] [LOCAL ] EPRT: Primary data saved (48408 records). [2025-10-08T18:45:14.553522] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-08T18:45:14.553600] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPRT took 31.3s. Estimated remaining: 3h 45m 7s. Rate: 7.2 symbols/min [2025-10-08T18:45:14.730113] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:14.786323] [DEBUG] [LOCAL ] EQNR: Loaded 53034 existing records from primary storage. [2025-10-08T18:45:14.786718] [INFO ] [MAIN ] EQNR: Loaded 53034 existing records. [2025-10-08T18:45:14.987165] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:14.987399] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-08T18:45:14.987446] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-08T18:45:14.987922] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-08T18:45:14.987981] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-08T18:45:15.223819] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-08T18:45:15.388317] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:15.400554] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T18:45:15.463690] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T18:45:16.017605] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-08T18:45:16.817524] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-08T18:45:17.008777] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T18:45:17.617880] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-08T18:45:17.682811] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T18:45:17.713467] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T18:45:18.417598] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-08T18:45:18.902333] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:45:18.906117] [INFO ] [REMOTE ] EPR: Full fetch complete (63055 records). [2025-10-08T18:45:18.906259] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-08T18:45:19.210496] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T18:45:19.218970] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-08T18:45:19.324056] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-08T18:45:19.324166] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-08T18:45:19.324981] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-08T18:45:19.325046] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-08T18:45:19.328379] [DEBUG] [LOCAL ] EPR: Trimmed 63055 records to 43947 (keeping 200 days of data) [2025-10-08T18:45:19.613168] [DEBUG] [LOCAL ] EPR: Primary data saved (43947 records). [2025-10-08T18:45:19.613349] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-08T18:45:19.613471] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 38.5s. Estimated remaining: 3h 44m 52s. Rate: 7.2 symbols/min [2025-10-08T18:45:19.819532] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:19.872463] [DEBUG] [LOCAL ] EQR: Loaded 51602 existing records from primary storage. [2025-10-08T18:45:19.872918] [INFO ] [MAIN ] EQR: Loaded 51602 existing records. [2025-10-08T18:45:20.022733] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-08T18:45:20.068330] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:20.068627] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-08T18:45:20.068722] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-08T18:45:20.068980] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-08T18:45:20.069057] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-08T18:45:20.449634] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:20.790173] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:45:20.817529] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-08T18:45:21.617529] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-08T18:45:21.730223] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:45:22.417587] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-08T18:45:22.588053] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T18:45:23.135421] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T18:45:23.185054] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T18:45:23.186788] [INFO ] [REMOTE ] EQBK: Full fetch complete (15535 records). [2025-10-08T18:45:23.186868] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-08T18:45:23.222730] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-08T18:45:23.573764] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-08T18:45:23.574045] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-08T18:45:23.574489] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-08T18:45:23.574533] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-08T18:45:23.575098] [DEBUG] [LOCAL ] EQBK: Trimmed 15535 records to 10961 (keeping 200 days of data) [2025-10-08T18:45:23.643915] [DEBUG] [LOCAL ] EQBK: Primary data saved (10961 records). [2025-10-08T18:45:23.644070] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-08T18:45:23.644157] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQBK took 26.7s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-08T18:45:24.017631] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-08T18:45:24.817588] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-08T18:45:25.227475] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:45:25.617615] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-08T18:45:25.754437] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T18:45:26.427885] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-08T18:45:26.435474] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:45:27.217520] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-08T18:45:27.335262] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:45:27.717453] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:45:28.017576] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-08T18:45:28.701123] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:45:28.817622] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-08T18:45:29.617576] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-08T18:45:29.796239] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T18:45:30.358383] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T18:45:30.417552] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-08T18:45:31.217566] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-08T18:45:31.283473] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T18:45:32.017556] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-08T18:45:32.413742] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:45:32.817626] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-08T18:45:32.992893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T18:45:33.617616] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-08T18:45:33.676722] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:45:34.417531] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-08T18:45:34.817402] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T18:45:35.217586] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-08T18:45:35.444739] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T18:45:36.017606] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-08T18:45:36.200440] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:45:36.657353] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:45:36.817549] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-08T18:45:37.484415] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:45:37.488481] [INFO ] [REMOTE ] EQH: Full fetch complete (76394 records). [2025-10-08T18:45:37.488634] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-08T18:45:37.622609] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-08T18:45:37.893907] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-08T18:45:37.893989] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-08T18:45:37.894938] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-08T18:45:37.895006] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-08T18:45:37.896483] [DEBUG] [LOCAL ] EQH: Trimmed 76394 records to 52650 (keeping 200 days of data) [2025-10-08T18:45:38.220253] [DEBUG] [LOCAL ] EQH: Primary data saved (52650 records). [2025-10-08T18:45:38.220405] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-08T18:45:38.220490] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 30.9s. Estimated remaining: 3h 44m 39s. Rate: 7.2 symbols/min [2025-10-08T18:45:38.814529] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T18:45:38.826530] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-08T18:45:39.342782] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T18:45:39.354066] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-08T18:45:40.435259] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:45:40.446761] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-08T18:45:40.829974] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:45:40.841071] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-08T18:45:42.316382] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T18:45:42.328724] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-08T18:45:42.363108] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:45:42.417543] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-08T18:45:43.950845] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:45:43.962361] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-08T18:45:44.255269] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T18:45:44.259343] [INFO ] [REMOTE ] EQNR: Full fetch complete (76823 records). [2025-10-08T18:45:44.259454] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-08T18:45:44.649364] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-08T18:45:44.649457] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-08T18:45:44.650363] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-08T18:45:44.650432] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-08T18:45:44.652030] [DEBUG] [LOCAL ] EQNR: Trimmed 76823 records to 53032 (keeping 200 days of data) [2025-10-08T18:45:44.979316] [DEBUG] [LOCAL ] EQNR: Primary data saved (53032 records). [2025-10-08T18:45:44.979460] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-08T18:45:44.979546] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 30.4s. Estimated remaining: 3h 44m 28s. Rate: 7.2 symbols/min [2025-10-08T18:45:45.416306] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:45:45.420296] [INFO ] [REMOTE ] EQR: Full fetch complete (74104 records). [2025-10-08T18:45:45.420433] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-08T18:45:45.806326] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-08T18:45:45.806408] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-08T18:45:45.807293] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-08T18:45:45.807355] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-08T18:45:45.808871] [DEBUG] [LOCAL ] EQR: Trimmed 74104 records to 51608 (keeping 200 days of data) [2025-10-08T18:45:46.134326] [DEBUG] [LOCAL ] EQR: Primary data saved (51608 records). [2025-10-08T18:45:46.134502] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-08T18:45:46.134636] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 26.5s. Estimated remaining: 3h 44m 4s. Rate: 7.2 symbols/min [2025-10-08T18:45:46.784513] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.879998] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.878743] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.885932] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-08T18:45:46.907503] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-08T18:45:46.908056] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-08T18:45:46.907315] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:45:46.908174] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-08T18:45:46.909114] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-08T18:45:46.909164] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-08T18:45:46.974394] [DEBUG] [LOCAL ] EQV: Loaded 2705 existing records from primary storage. [2025-10-08T18:45:47.001345] [INFO ] [MAIN ] EQV: Loaded 2705 existing records. [2025-10-08T18:45:47.426490] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-08T18:45:47.469392] [DEBUG] [LOCAL ] ERJ: Loaded 50561 existing records from primary storage. [2025-10-08T18:45:47.498025] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-08T18:45:47.484469] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:47.514424] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-08T18:45:47.530160] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-08T18:45:47.519769] [INFO ] [MAIN ] ERJ: Loaded 50561 existing records. [2025-10-08T18:45:47.624323] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:47.631726] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-08T18:45:47.641201] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-08T18:45:47.702167] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-08T18:45:48.100720] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:48.166785] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-08T18:45:48.176002] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-08T18:45:48.170471] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:45:48.186780] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-08T18:45:48.200554] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-08T18:45:48.211348] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-08T18:45:48.262817] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-08T18:45:48.372667] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-08T18:45:48.326958] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T18:45:48.408968] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-08T18:45:48.383130] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-08T18:45:48.903321] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:48.926460] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T18:45:48.984876] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-08T18:45:48.932099] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-08T18:45:49.239302] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:49.251541] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-08T18:45:49.332440] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:45:49.332846] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-08T18:45:49.389022] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T18:45:49.390008] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-08T18:45:49.674935] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T18:45:49.676991] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-08T18:45:49.694967] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-08T18:45:50.252369] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T18:45:50.417535] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-08T18:45:50.677243] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-08T18:45:50.773074] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T18:45:51.080227] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T18:45:51.217600] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-08T18:45:51.792176] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T18:45:52.017708] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-08T18:45:52.817579] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-08T18:45:53.298242] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T18:45:53.378305] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:45:53.617546] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-08T18:45:54.417581] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-08T18:45:55.217544] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-08T18:45:55.338985] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T18:45:55.608739] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T18:45:56.017560] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-08T18:45:56.248807] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T18:45:56.817576] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-08T18:45:57.166857] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T18:45:57.617611] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-08T18:45:57.855835] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:45:58.417564] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-08T18:45:59.217543] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-08T18:45:59.270637] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:45:59.721071] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T18:46:00.017524] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-08T18:46:00.222726] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T18:46:00.403888] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T18:46:00.817587] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-08T18:46:01.617569] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-08T18:46:01.957622] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T18:46:02.417600] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-08T18:46:02.714690] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T18:46:03.217559] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-08T18:46:03.601711] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:46:03.952519] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T18:46:04.017505] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-08T18:46:04.817748] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-08T18:46:05.460800] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T18:46:05.617539] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-08T18:46:06.417558] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-08T18:46:06.773888] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:46:06.980526] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T18:46:07.217609] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-08T18:46:07.473629] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:46:08.017572] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-08T18:46:08.606770] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T18:46:08.817533] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-08T18:46:08.915485] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:46:09.233348] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T18:46:09.234096] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-08T18:46:09.234163] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-08T18:46:09.422145] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-08T18:46:09.422351] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:46:09.422420] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:46:09.422493] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-08T18:46:09.422576] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-08T18:46:09.422630] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-08T18:46:09.422732] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-08T18:46:09.422826] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 23.3s. Estimated remaining: 3h 44m 27s. Rate: 7.2 symbols/min [2025-10-08T18:46:09.607054] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:09.617571] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-08T18:46:09.653765] [DEBUG] [LOCAL ] ERO: Loaded 41407 existing records from primary storage. [2025-10-08T18:46:09.654174] [INFO ] [MAIN ] ERO: Loaded 41407 existing records. [2025-10-08T18:46:09.897501] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:09.897839] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-08T18:46:09.897902] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-08T18:46:09.898151] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-08T18:46:09.898220] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-08T18:46:10.429130] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-08T18:46:10.437495] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:11.217571] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-08T18:46:11.519278] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T18:46:11.613204] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-08T18:46:11.963951] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:46:12.017534] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-08T18:46:12.817566] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-08T18:46:13.617561] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-08T18:46:14.016518] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:46:14.184443] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T18:46:14.220732] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T18:46:14.417555] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-08T18:46:15.217527] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-08T18:46:16.017584] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-08T18:46:16.444578] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:46:16.652410] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T18:46:16.817554] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-08T18:46:17.485150] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:46:17.617570] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-08T18:46:17.981800] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T18:46:18.098899] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:46:18.103018] [INFO ] [REMOTE ] ERJ: Full fetch complete (72438 records). [2025-10-08T18:46:18.103189] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-08T18:46:18.422790] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-08T18:46:18.533496] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-08T18:46:18.533599] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-08T18:46:18.534467] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-08T18:46:18.534532] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-08T18:46:18.536082] [DEBUG] [LOCAL ] ERJ: Trimmed 72438 records to 50464 (keeping 200 days of data) [2025-10-08T18:46:18.839818] [DEBUG] [LOCAL ] ERJ: Primary data saved (50464 records). [2025-10-08T18:46:18.839964] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-08T18:46:18.840048] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERJ took 32.7s. Estimated remaining: 3h 44m 21s. Rate: 7.2 symbols/min [2025-10-08T18:46:19.011422] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:19.060963] [DEBUG] [LOCAL ] ES: Loaded 52614 existing records from primary storage. [2025-10-08T18:46:19.061296] [INFO ] [MAIN ] ES: Loaded 52614 existing records. [2025-10-08T18:46:19.232920] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-08T18:46:19.238165] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:19.239768] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-08T18:46:19.239840] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-08T18:46:19.240101] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-08T18:46:19.240160] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-08T18:46:19.598209] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:20.017626] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-08T18:46:20.480177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:46:20.818913] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-08T18:46:20.821213] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:46:21.251640] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T18:46:21.252427] [INFO ] [REMOTE ] EQV: Full fetch complete (5764 records). [2025-10-08T18:46:21.252500] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-08T18:46:21.627473] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-08T18:46:21.647950] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:46:21.673256] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-08T18:46:21.685351] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-08T18:46:21.686494] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-08T18:46:21.686556] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-08T18:46:21.687091] [DEBUG] [LOCAL ] EQV: Trimmed 5764 records to 2709 (keeping 200 days of data) [2025-10-08T18:46:21.703287] [DEBUG] [LOCAL ] EQV: Primary data saved (2709 records). [2025-10-08T18:46:21.703406] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-08T18:46:21.703495] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQV took 35.5s. Estimated remaining: 3h 44m 1s. Rate: 7.2 symbols/min [2025-10-08T18:46:21.877370] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:21.906447] [DEBUG] [LOCAL ] ESAB: Loaded 26108 existing records from primary storage. [2025-10-08T18:46:21.906773] [INFO ] [MAIN ] ESAB: Loaded 26108 existing records. [2025-10-08T18:46:22.109489] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:22.109786] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-08T18:46:22.109861] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-08T18:46:22.110139] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-08T18:46:22.110200] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-08T18:46:22.426559] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-08T18:46:22.466926] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:23.217536] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-08T18:46:23.547721] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T18:46:23.551841] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-08T18:46:23.551973] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-08T18:46:23.945257] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-08T18:46:23.945345] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-08T18:46:23.946297] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-08T18:46:23.946383] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-08T18:46:23.948002] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 53682 (keeping 200 days of data) [2025-10-08T18:46:24.018066] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-08T18:46:24.248227] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T18:46:24.346071] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-10-08T18:46:24.346242] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-08T18:46:24.346333] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. EQT took 38.2s. Estimated remaining: 3h 43m 41s. Rate: 7.2 symbols/min [2025-10-08T18:46:24.528528] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:24.556675] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T18:46:24.579409] [DEBUG] [LOCAL ] ESE: Loaded 16585 existing records from primary storage. [2025-10-08T18:46:24.579703] [INFO ] [MAIN ] ESE: Loaded 16585 existing records. [2025-10-08T18:46:24.765036] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:24.765333] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-08T18:46:24.765520] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-08T18:46:24.765865] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-08T18:46:24.765940] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-08T18:46:24.822756] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-08T18:46:24.912011] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T18:46:25.141602] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:25.617540] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-08T18:46:26.417582] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-08T18:46:26.469227] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:46:26.545988] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:46:27.217545] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-08T18:46:27.996725] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T18:46:28.017490] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-08T18:46:28.100220] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:46:28.624363] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T18:46:28.817566] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-08T18:46:29.617540] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-08T18:46:29.768265] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T18:46:30.417556] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-08T18:46:31.021133] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T18:46:31.217544] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-08T18:46:31.554446] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:46:32.017546] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-08T18:46:32.817576] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-08T18:46:33.074942] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T18:46:33.451453] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T18:46:33.541291] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T18:46:33.617562] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-08T18:46:34.417515] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-08T18:46:34.544341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T18:46:35.217547] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-08T18:46:36.017529] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T18:46:36.017614] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-08T18:46:36.817598] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-08T18:46:36.997910] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:46:37.028174] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T18:46:37.617596] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-08T18:46:37.867135] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T18:46:38.417530] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-08T18:46:38.686814] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T18:46:39.217547] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-08T18:46:39.375814] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T18:46:40.017577] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-08T18:46:40.817514] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-08T18:46:41.027610] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T18:46:41.239485] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T18:46:41.615395] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:46:41.618990] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-08T18:46:42.417520] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-08T18:46:42.712001] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T18:46:43.217558] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-08T18:46:44.027213] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-08T18:46:44.046953] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:46:44.108306] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:46:44.817530] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-08T18:46:45.075884] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T18:46:45.617610] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-08T18:46:46.417537] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-08T18:46:46.591701] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T18:46:46.970933] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T18:46:47.217573] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-08T18:46:47.421795] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T18:46:48.017572] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-08T18:46:48.817580] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-08T18:46:48.991114] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T18:46:49.177907] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:46:49.617607] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-08T18:46:50.088633] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T18:46:50.417569] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-08T18:46:51.217569] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-08T18:46:51.242273] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T18:46:51.363584] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:46:52.017617] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-08T18:46:52.784190] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T18:46:52.793068] [INFO ] [REMOTE ] ERO: Full fetch complete (59733 records). [2025-10-08T18:46:52.793260] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-08T18:46:52.824178] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-08T18:46:53.192487] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-08T18:46:53.192577] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-08T18:46:53.193451] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-08T18:46:53.193520] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-08T18:46:53.195006] [DEBUG] [LOCAL ] ERO: Trimmed 59733 records to 41514 (keeping 200 days of data) [2025-10-08T18:46:53.444063] [DEBUG] [LOCAL ] ERO: Primary data saved (41514 records). [2025-10-08T18:46:53.444196] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-08T18:46:53.444280] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERO took 44.0s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-08T18:46:53.618876] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-08T18:46:53.611014] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T18:46:53.641836] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:53.648307] [INFO ] [REMOTE ] ES: Full fetch complete (76241 records). [2025-10-08T18:46:53.648423] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-08T18:46:53.771316] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:46:53.826636] [INFO ] [REMOTE ] ESE: Full fetch complete (22408 records). [2025-10-08T18:46:53.857885] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-08T18:46:54.185625] [DEBUG] [LOCAL ] ESI: Loaded 50698 existing records from primary storage. [2025-10-08T18:46:54.235204] [INFO ] [MAIN ] ESI: Loaded 50698 existing records. [2025-10-08T18:46:54.453324] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-08T18:46:54.534307] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-08T18:46:54.577356] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-08T18:46:54.649473] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-08T18:46:54.776320] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:54.804334] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-08T18:46:54.804193] [DEBUG] [LOCAL ] ES: Trimmed 76241 records to 52628 (keeping 200 days of data) [2025-10-08T18:46:54.805213] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-08T18:46:54.805475] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-08T18:46:54.805546] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-08T18:46:54.806092] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-08T18:46:54.806570] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-08T18:46:54.807042] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-08T18:46:54.806998] [DEBUG] [LOCAL ] ESE: Trimmed 22408 records to 16540 (keeping 200 days of data) [2025-10-08T18:46:54.807150] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-08T18:46:55.071267] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T18:46:55.102631] [INFO ] [REMOTE ] ESAB: Full fetch complete (35888 records). [2025-10-08T18:46:55.116261] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-08T18:46:55.485709] [DEBUG] [LOCAL ] ESE: Primary data saved (16540 records). [2025-10-08T18:46:55.496888] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-08T18:46:55.502763] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ESE took 31.2s. Estimated remaining: 3h 43m 54s. Rate: 7.2 symbols/min [2025-10-08T18:46:55.688088] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:55.718824] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-08T18:46:56.004814] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:56.096016] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-08T18:46:56.096598] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-08T18:46:56.097702] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-08T18:46:56.098151] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-08T18:46:56.103030] [DEBUG] [LOCAL ] ESAB: Trimmed 35888 records to 26086 (keeping 200 days of data) [2025-10-08T18:46:56.331432] [DEBUG] [LOCAL ] ESNT: Loaded 38318 existing records from primary storage. [2025-10-08T18:46:56.332755] [INFO ] [MAIN ] ESNT: Loaded 38318 existing records. [2025-10-08T18:46:56.547608] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:56.550874] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-08T18:46:56.551680] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-08T18:46:56.553529] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-08T18:46:56.554396] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-08T18:46:57.081467] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:57.083504] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-08T18:46:57.142289] [DEBUG] [LOCAL ] ES: Primary data saved (52628 records). [2025-10-08T18:46:57.143233] [INFO ] [MAIN ] ES: Full history saved. [2025-10-08T18:46:57.143366] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ES took 38.3s. Estimated remaining: 3h 43m 32s. Rate: 7.2 symbols/min [2025-10-08T18:46:57.333438] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:57.337338] [DEBUG] [LOCAL ] ESAB: Primary data saved (26086 records). [2025-10-08T18:46:57.337524] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-08T18:46:57.337704] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESAB took 35.6s. Estimated remaining: 3h 43m 7s. Rate: 7.2 symbols/min [2025-10-08T18:46:57.562584] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:46:57.565779] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T18:46:57.577385] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-08T18:46:57.594103] [DEBUG] [LOCAL ] ESRT: Loaded 46351 existing records from primary storage. [2025-10-08T18:46:57.594525] [INFO ] [MAIN ] ESRT: Loaded 46351 existing records. [2025-10-08T18:46:57.806123] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:57.807114] [DEBUG] [LOCAL ] ESS: Loaded 29871 existing records from primary storage. [2025-10-08T18:46:57.807384] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-08T18:46:57.807526] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-08T18:46:57.807698] [INFO ] [MAIN ] ESS: Loaded 29871 existing records. [2025-10-08T18:46:57.839725] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-08T18:46:57.880562] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-08T18:46:58.149838] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:46:58.166180] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-08T18:46:58.220938] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-08T18:46:58.283104] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-08T18:46:58.294630] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-08T18:46:58.499930] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:58.505496] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-08T18:46:58.752731] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:46:58.753065] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-08T18:46:58.866919] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:46:58.896207] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-08T18:46:58.897891] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:46:59.217543] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-08T18:46:59.779971] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T18:47:00.017559] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-08T18:47:00.135725] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:47:00.267157] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T18:47:00.749947] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T18:47:00.817537] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-08T18:47:01.083813] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T18:47:01.617588] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-08T18:47:02.074668] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:47:02.417601] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-08T18:47:03.218751] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-08T18:47:03.228670] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:47:04.017889] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-08T18:47:04.116609] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T18:47:04.576177] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T18:47:04.817610] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-08T18:47:05.467922] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T18:47:05.617549] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-08T18:47:06.334799] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T18:47:06.417552] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-08T18:47:07.222760] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-08T18:47:07.237814] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T18:47:07.436830] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T18:47:08.017572] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-08T18:47:08.600996] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:47:08.817584] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-08T18:47:09.406012] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:47:09.617527] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-08T18:47:10.244800] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T18:47:10.417584] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-08T18:47:10.823582] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T18:47:11.217585] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-08T18:47:12.017528] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-08T18:47:12.183443] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:47:12.254557] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:47:12.817552] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-08T18:47:13.461514] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:47:13.617556] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-08T18:47:14.417513] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-08T18:47:14.547005] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T18:47:14.797695] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:47:15.217572] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-08T18:47:16.017523] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-08T18:47:16.042563] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:47:16.485929] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:47:16.817569] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-08T18:47:17.617690] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-08T18:47:17.663713] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T18:47:17.755608] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T18:47:18.417547] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-08T18:47:18.859964] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T18:47:19.217551] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-08T18:47:19.761694] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T18:47:20.017615] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-08T18:47:20.552365] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T18:47:20.817554] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-08T18:47:21.149044] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T18:47:21.617563] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-08T18:47:22.417532] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-08T18:47:22.459934] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T18:47:22.538351] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:47:23.217557] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-08T18:47:23.663904] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T18:47:24.017548] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-08T18:47:24.395498] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T18:47:24.397867] [INFO ] [REMOTE ] ESS: Full fetch complete (43321 records). [2025-10-08T18:47:24.397969] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-08T18:47:24.776492] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-08T18:47:24.776577] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-08T18:47:24.777233] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-08T18:47:24.777298] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-08T18:47:24.778172] [DEBUG] [LOCAL ] ESS: Trimmed 43321 records to 29778 (keeping 200 days of data) [2025-10-08T18:47:24.833882] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-08T18:47:24.972365] [DEBUG] [LOCAL ] ESS: Primary data saved (29778 records). [2025-10-08T18:47:24.972527] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-08T18:47:24.972663] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESS took 27.6s. Estimated remaining: 3h 43m 38s. Rate: 7.2 symbols/min [2025-10-08T18:47:25.141864] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:25.187601] [DEBUG] [LOCAL ] ESTC: Loaded 50060 existing records from primary storage. [2025-10-08T18:47:25.188008] [INFO ] [MAIN ] ESTC: Loaded 50060 existing records. [2025-10-08T18:47:25.378633] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:25.379036] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-08T18:47:25.379136] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-08T18:47:25.380627] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-08T18:47:25.380744] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-08T18:47:25.628614] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T18:47:25.628709] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-08T18:47:25.836137] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:26.417562] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-08T18:47:26.435999] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:47:26.440295] [INFO ] [REMOTE ] ESI: Full fetch complete (72857 records). [2025-10-08T18:47:26.440502] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-08T18:47:26.912018] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-08T18:47:26.912164] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-08T18:47:26.913344] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-08T18:47:26.913579] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-08T18:47:26.915856] [DEBUG] [LOCAL ] ESI: Trimmed 72857 records to 50673 (keeping 200 days of data) [2025-10-08T18:47:27.071404] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:47:27.236914] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-08T18:47:27.276798] [DEBUG] [LOCAL ] ESI: Primary data saved (50673 records). [2025-10-08T18:47:27.276958] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-08T18:47:27.277047] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESI took 33.8s. Estimated remaining: 3h 43m 17s. Rate: 7.2 symbols/min [2025-10-08T18:47:27.443899] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:27.496441] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-08T18:47:27.496801] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-08T18:47:27.677377] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:27.677673] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-08T18:47:27.677741] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-08T18:47:27.679121] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-08T18:47:27.679181] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-08T18:47:28.030370] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-08T18:47:28.037503] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:28.118786] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:47:28.737355] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:47:28.741680] [INFO ] [REMOTE ] ESRT: Full fetch complete (66511 records). [2025-10-08T18:47:28.741810] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-08T18:47:28.822827] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-08T18:47:29.129310] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-08T18:47:29.129547] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-08T18:47:29.130455] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-08T18:47:29.130589] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-08T18:47:29.132736] [DEBUG] [LOCAL ] ESRT: Trimmed 66511 records to 46356 (keeping 200 days of data) [2025-10-08T18:47:29.250715] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T18:47:29.447011] [DEBUG] [LOCAL ] ESRT: Primary data saved (46356 records). [2025-10-08T18:47:29.447178] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-08T18:47:29.447321] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESRT took 32.3s. Estimated remaining: 3h 42m 56s. Rate: 7.2 symbols/min [2025-10-08T18:47:29.614605] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:29.617575] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-08T18:47:29.629518] [DEBUG] [LOCAL ] ETB: Loaded 12221 existing records from primary storage. [2025-10-08T18:47:29.629811] [INFO ] [MAIN ] ETB: Loaded 12221 existing records. [2025-10-08T18:47:29.803496] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:29.803789] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-08T18:47:29.803838] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-08T18:47:29.804297] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-08T18:47:29.804356] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-08T18:47:30.154288] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:30.417566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-08T18:47:30.706665] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T18:47:30.817806] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:47:31.167348] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:47:31.217495] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-08T18:47:31.780430] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T18:47:32.017566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-08T18:47:32.817535] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-08T18:47:33.018228] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T18:47:33.617548] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-08T18:47:34.184248] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:47:34.187986] [INFO ] [REMOTE ] ESNT: Full fetch complete (57138 records). [2025-10-08T18:47:34.188142] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-08T18:47:34.351072] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:47:34.426517] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-08T18:47:34.696795] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-08T18:47:34.696891] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-08T18:47:34.697851] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-08T18:47:34.697919] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-08T18:47:34.699313] [DEBUG] [LOCAL ] ESNT: Trimmed 57138 records to 38246 (keeping 200 days of data) [2025-10-08T18:47:34.978801] [DEBUG] [LOCAL ] ESNT: Primary data saved (38246 records). [2025-10-08T18:47:34.979004] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-08T18:47:34.979135] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESNT took 39.4s. Estimated remaining: 3h 42m 42s. Rate: 7.2 symbols/min [2025-10-08T18:47:35.205693] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:35.221705] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-08T18:47:35.235322] [DEBUG] [LOCAL ] ETD: Loaded 27351 existing records from primary storage. [2025-10-08T18:47:35.235672] [INFO ] [MAIN ] ETD: Loaded 27351 existing records. [2025-10-08T18:47:35.477543] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:35.477908] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-08T18:47:35.477972] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-08T18:47:35.478869] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-08T18:47:35.478929] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-08T18:47:35.587171] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T18:47:35.838102] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:36.017532] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-08T18:47:36.817502] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-08T18:47:36.859084] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:47:37.617533] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-08T18:47:37.668885] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T18:47:37.858992] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T18:47:38.417541] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-08T18:47:38.669978] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:47:39.217570] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-08T18:47:40.012558] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T18:47:40.017488] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-08T18:47:40.512487] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T18:47:40.537524] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T18:47:40.817572] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-08T18:47:41.617507] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-08T18:47:41.994106] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:47:42.275037] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T18:47:42.417519] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-08T18:47:43.217563] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-08T18:47:43.517913] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:47:44.017578] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-08T18:47:44.538212] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T18:47:44.817599] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-08T18:47:45.244947] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:47:45.617566] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-08T18:47:46.234684] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T18:47:46.265253] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T18:47:46.417606] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-08T18:47:47.217521] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-08T18:47:47.319660] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:47:47.321324] [INFO ] [REMOTE ] ETB: Full fetch complete (18329 records). [2025-10-08T18:47:47.321395] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-08T18:47:47.685661] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-08T18:47:47.685768] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-08T18:47:47.686194] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-08T18:47:47.686235] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-08T18:47:47.686902] [DEBUG] [LOCAL ] ETB: Trimmed 18329 records to 12203 (keeping 200 days of data) [2025-10-08T18:47:47.763237] [DEBUG] [LOCAL ] ETB: Primary data saved (12203 records). [2025-10-08T18:47:47.763392] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-08T18:47:47.763493] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 18.3s. Estimated remaining: 3h 42m 43s. Rate: 7.2 symbols/min [2025-10-08T18:47:47.949734] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:47:47.967248] [DEBUG] [LOCAL ] ETG: Loaded 16574 existing records from primary storage. [2025-10-08T18:47:47.967511] [INFO ] [MAIN ] ETG: Loaded 16574 existing records. [2025-10-08T18:47:48.028220] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-08T18:47:48.148301] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:47:48.148569] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-08T18:47:48.148624] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-08T18:47:48.149198] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-08T18:47:48.149257] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-08T18:47:48.497599] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:47:48.817695] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-08T18:47:49.343006] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T18:47:49.372832] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T18:47:49.617557] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-08T18:47:50.232066] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T18:47:50.417514] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-08T18:47:51.217624] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-08T18:47:51.705946] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T18:47:52.017735] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-08T18:47:52.218048] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:47:52.269297] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T18:47:52.817579] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-08T18:47:53.617539] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-08T18:47:53.645016] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T18:47:54.152025] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T18:47:54.417634] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-08T18:47:55.217567] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-08T18:47:55.276640] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T18:47:55.329813] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T18:47:56.017563] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-08T18:47:56.817532] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-08T18:47:56.995407] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T18:47:57.364553] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-08T18:47:57.617547] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-08T18:47:58.080636] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:47:58.417527] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-08T18:47:59.217598] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-08T18:47:59.802970] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T18:47:59.961808] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T18:48:00.017515] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-08T18:48:00.324816] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T18:48:00.817608] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-08T18:48:01.617554] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-08T18:48:02.359677] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-08T18:48:02.409393] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:48:02.419734] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-08T18:48:03.102601] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T18:48:03.217586] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-08T18:48:04.017552] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-08T18:48:04.327174] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T18:48:04.711962] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T18:48:04.716470] [INFO ] [REMOTE ] ESTC: Full fetch complete (72106 records). [2025-10-08T18:48:04.716620] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-08T18:48:04.827275] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-08T18:48:05.151620] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-08T18:48:05.152849] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-08T18:48:05.153785] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-08T18:48:05.153868] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-08T18:48:05.152785] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T18:48:05.161813] [DEBUG] [LOCAL ] ESTC: Trimmed 72106 records to 50106 (keeping 200 days of data) [2025-10-08T18:48:05.466546] [DEBUG] [LOCAL ] ESTC: Primary data saved (50106 records). [2025-10-08T18:48:05.466724] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-08T18:48:05.466833] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ESTC took 40.5s. Estimated remaining: 3h 42m 54s. Rate: 7.2 symbols/min [2025-10-08T18:48:05.618238] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-08T18:48:05.643943] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:05.662031] [DEBUG] [LOCAL ] ETJ: Loaded 17010 existing records from primary storage. [2025-10-08T18:48:05.662329] [INFO ] [MAIN ] ETJ: Loaded 17010 existing records. [2025-10-08T18:48:05.850549] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:05.851110] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-08T18:48:05.851216] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-08T18:48:05.852066] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-08T18:48:05.852132] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-08T18:48:06.023060] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T18:48:06.225190] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:06.417560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-08T18:48:06.689778] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T18:48:07.070344] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T18:48:07.217557] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-08T18:48:08.017549] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-08T18:48:08.241947] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:48:08.817566] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-08T18:48:09.617571] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-08T18:48:09.836480] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:48:10.066706] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-08T18:48:10.071092] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-08T18:48:10.071258] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-08T18:48:10.420239] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-08T18:48:10.464286] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-08T18:48:10.464389] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-08T18:48:10.465623] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-08T18:48:10.465721] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-08T18:48:10.467403] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 53789 (keeping 200 days of data) [2025-10-08T18:48:10.601503] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:48:10.605359] [INFO ] [REMOTE ] ETD: Full fetch complete (38459 records). [2025-10-08T18:48:10.606183] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-08T18:48:11.104595] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-08T18:48:11.132035] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-08T18:48:11.132870] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-08T18:48:11.134525] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-08T18:48:11.140091] [DEBUG] [LOCAL ] ETD: Trimmed 38459 records to 27379 (keeping 200 days of data) [2025-10-08T18:48:11.235091] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-08T18:48:11.254624] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T18:48:11.358255] [DEBUG] [LOCAL ] ETD: Primary data saved (27379 records). [2025-10-08T18:48:11.360344] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-08T18:48:11.360480] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETD took 36.4s. Estimated remaining: 3h 42m 40s. Rate: 7.2 symbols/min [2025-10-08T18:48:11.649046] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:11.653154] [DEBUG] [LOCAL ] ETN: No existing data file found in primary storage. [2025-10-08T18:48:11.653235] [WARN ] [MAIN ] ETN: No existing data found, performing full refresh instead. [2025-10-08T18:48:11.653721] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-08T18:48:11.653819] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-08T18:48:11.654711] [DEBUG] [LOCAL ] ETN: No primary data file found to delete. [2025-10-08T18:48:11.655329] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-08T18:48:11.823257] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-08T18:48:11.833696] [INFO ] [MAIN ] ET: Full history saved. [2025-10-08T18:48:11.833821] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ET took 44.6s. Estimated remaining: 3h 42m 16s. Rate: 7.2 symbols/min [2025-10-08T18:48:12.044138] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-08T18:48:12.219224] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:12.327830] [DEBUG] [LOCAL ] ETO: Loaded 6736 existing records from primary storage. [2025-10-08T18:48:12.327345] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:12.335535] [INFO ] [MAIN ] ETO: Loaded 6736 existing records. [2025-10-08T18:48:12.361453] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T18:48:12.545517] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:12.545822] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-08T18:48:12.545884] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-08T18:48:12.546201] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-08T18:48:12.546262] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-08T18:48:12.822891] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-08T18:48:13.104529] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:13.120694] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T18:48:13.617572] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-08T18:48:13.893859] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T18:48:14.398447] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T18:48:14.417561] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-08T18:48:14.944600] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-08T18:48:15.217581] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-08T18:48:16.017553] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-08T18:48:16.284002] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T18:48:16.710865] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T18:48:16.817564] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-08T18:48:17.488544] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:48:17.617599] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-08T18:48:18.417546] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-08T18:48:18.535799] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T18:48:19.068410] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T18:48:19.217537] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-08T18:48:20.017585] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-08T18:48:20.180017] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:48:20.817585] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-08T18:48:21.271344] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T18:48:21.565456] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T18:48:21.617538] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-08T18:48:22.417618] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-08T18:48:23.217567] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-08T18:48:23.341866] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T18:48:23.631241] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T18:48:23.667728] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T18:48:24.017561] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-08T18:48:24.817555] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-08T18:48:24.912498] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T18:48:24.914160] [INFO ] [REMOTE ] ETG: Full fetch complete (24847 records). [2025-10-08T18:48:24.914232] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-08T18:48:25.272785] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-08T18:48:25.272867] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-08T18:48:25.273344] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-08T18:48:25.273382] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-08T18:48:25.274037] [DEBUG] [LOCAL ] ETG: Trimmed 24847 records to 16576 (keeping 200 days of data) [2025-10-08T18:48:25.374157] [DEBUG] [LOCAL ] ETG: Primary data saved (16576 records). [2025-10-08T18:48:25.374309] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-08T18:48:25.374395] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETG took 37.6s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-08T18:48:25.540363] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:48:25.560370] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:25.614601] [DEBUG] [LOCAL ] ETR: Loaded 53233 existing records from primary storage. [2025-10-08T18:48:25.614964] [INFO ] [MAIN ] ETR: Loaded 53233 existing records. [2025-10-08T18:48:25.625841] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-08T18:48:25.792050] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:25.792246] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-08T18:48:25.792294] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-08T18:48:25.792557] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-08T18:48:25.792615] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-08T18:48:26.132318] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:26.417551] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-08T18:48:27.217589] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-08T18:48:27.509285] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T18:48:27.759411] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T18:48:28.017532] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-08T18:48:28.346886] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T18:48:28.646760] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T18:48:28.817547] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-08T18:48:29.617557] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-08T18:48:30.375802] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:48:30.417556] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-08T18:48:31.217530] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-08T18:48:31.422751] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:48:31.753829] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:48:31.978536] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T18:48:32.017546] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-08T18:48:32.817518] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-08T18:48:33.056854] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T18:48:33.059055] [INFO ] [REMOTE ] ETJ: Full fetch complete (25682 records). [2025-10-08T18:48:33.059225] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-08T18:48:33.451346] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-08T18:48:33.451426] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-08T18:48:33.451911] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-08T18:48:33.451972] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-08T18:48:33.452572] [DEBUG] [LOCAL ] ETJ: Trimmed 25682 records to 17038 (keeping 200 days of data) [2025-10-08T18:48:33.549378] [DEBUG] [LOCAL ] ETJ: Primary data saved (17038 records). [2025-10-08T18:48:33.549519] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-08T18:48:33.549604] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETJ took 28.1s. Estimated remaining: 3h 42m 9s. Rate: 7.2 symbols/min [2025-10-08T18:48:33.623731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-08T18:48:33.720305] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:33.742021] [DEBUG] [LOCAL ] ETV: Loaded 21890 existing records from primary storage. [2025-10-08T18:48:33.742273] [INFO ] [MAIN ] ETV: Loaded 21890 existing records. [2025-10-08T18:48:33.921321] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:33.921558] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-08T18:48:33.921604] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-08T18:48:33.921874] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-08T18:48:33.921931] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-08T18:48:34.272801] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:34.417548] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-08T18:48:34.485463] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T18:48:34.702583] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T18:48:35.217569] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-08T18:48:36.017607] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-08T18:48:36.586692] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T18:48:36.671130] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T18:48:36.817529] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-08T18:48:37.064085] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T18:48:37.590001] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T18:48:37.617506] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-08T18:48:38.149761] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:48:38.417604] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-08T18:48:39.217551] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-08T18:48:40.001078] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T18:48:40.017491] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-08T18:48:40.477260] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T18:48:40.817534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-08T18:48:41.013272] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T18:48:41.617608] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-08T18:48:42.417575] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-08T18:48:42.593423] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:48:42.857884] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T18:48:43.217565] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-08T18:48:43.442377] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T18:48:44.017607] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-08T18:48:44.660618] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T18:48:44.661932] [INFO ] [REMOTE ] ETO: Full fetch complete (9564 records). [2025-10-08T18:48:44.662005] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-08T18:48:44.837962] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-08T18:48:45.038125] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-08T18:48:45.038239] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-08T18:48:45.038559] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-08T18:48:45.038664] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-08T18:48:45.039368] [DEBUG] [LOCAL ] ETO: Trimmed 9564 records to 6764 (keeping 200 days of data) [2025-10-08T18:48:45.106853] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T18:48:45.122356] [DEBUG] [LOCAL ] ETO: Primary data saved (6764 records). [2025-10-08T18:48:45.122513] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-08T18:48:45.122607] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 33.3s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-08T18:48:45.290423] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:45.316889] [DEBUG] [LOCAL ] ETW: Loaded 25336 existing records from primary storage. [2025-10-08T18:48:45.317172] [INFO ] [MAIN ] ETW: Loaded 25336 existing records. [2025-10-08T18:48:45.492495] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:45.492763] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-08T18:48:45.492816] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-08T18:48:45.493047] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-08T18:48:45.493105] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-08T18:48:45.622716] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-08T18:48:45.859794] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:45.873987] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:48:46.417567] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-08T18:48:47.217594] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-08T18:48:47.517559] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T18:48:47.787409] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T18:48:48.017591] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-08T18:48:48.817528] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-08T18:48:48.864423] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T18:48:49.617520] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-08T18:48:50.056226] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T18:48:50.093384] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T18:48:50.417560] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-08T18:48:51.132030] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T18:48:51.217522] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-08T18:48:51.519396] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:48:52.017554] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-08T18:48:52.817534] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-08T18:48:53.243723] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T18:48:53.297744] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T18:48:53.617699] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-08T18:48:54.345841] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T18:48:54.417504] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-08T18:48:55.217581] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-08T18:48:55.786263] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-08T18:48:55.790933] [INFO ] [REMOTE ] ETN: Full fetch complete (76535 records). [2025-10-08T18:48:55.791104] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-08T18:48:55.933074] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T18:48:55.962808] [INFO ] [REMOTE ] ETR: Full fetch complete (77098 records). [2025-10-08T18:48:56.006439] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-08T18:48:56.027725] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-08T18:48:56.332885] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:48:56.610332] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-08T18:48:56.622194] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-08T18:48:56.643221] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-08T18:48:56.646311] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-08T18:48:56.703301] [DEBUG] [LOCAL ] ETN: Trimmed 76535 records to 52702 (keeping 200 days of data) [2025-10-08T18:48:56.749708] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-08T18:48:56.749829] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-08T18:48:56.750878] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-08T18:48:56.828330] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-08T18:48:56.837233] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-08T18:48:56.870817] [DEBUG] [LOCAL ] ETR: Trimmed 77098 records to 53231 (keeping 200 days of data) [2025-10-08T18:48:57.036819] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T18:48:57.483514] [DEBUG] [LOCAL ] ETN: Primary data saved (52702 records). [2025-10-08T18:48:57.484630] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-08T18:48:57.485084] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 46.1s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-08T18:48:57.535580] [DEBUG] [LOCAL ] ETR: Primary data saved (53231 records). [2025-10-08T18:48:57.558186] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-08T18:48:57.558330] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETR took 32.2s. Estimated remaining: 3h 41m 42s. Rate: 7.2 symbols/min [2025-10-08T18:48:57.630313] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-08T18:48:57.794556] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:57.856479] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:48:57.864469] [DEBUG] [LOCAL ] ETX: Loaded 5181 existing records from primary storage. [2025-10-08T18:48:57.864747] [INFO ] [MAIN ] ETX: Loaded 5181 existing records. [2025-10-08T18:48:57.995493] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T18:48:58.038518] [DEBUG] [LOCAL ] ETY: Loaded 23014 existing records from primary storage. [2025-10-08T18:48:58.058334] [INFO ] [MAIN ] ETY: Loaded 23014 existing records. [2025-10-08T18:48:58.126146] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:58.196427] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-08T18:48:58.213097] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-08T18:48:58.237287] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-08T18:48:58.253085] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-08T18:48:58.424353] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-08T18:48:58.445488] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:48:58.446537] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-08T18:48:58.446600] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-08T18:48:58.457925] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-08T18:48:58.468323] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-08T18:48:58.992505] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:59.097745] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:48:59.116970] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:48:59.217504] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-08T18:48:59.550740] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:49:00.017557] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-08T18:49:00.327927] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T18:49:00.817629] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-08T18:49:00.928118] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T18:49:01.617550] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-08T18:49:01.845329] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T18:49:02.417601] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-08T18:49:02.784230] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:49:03.217556] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-08T18:49:03.245075] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T18:49:04.017529] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-08T18:49:04.362144] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T18:49:04.655111] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:49:04.817684] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-08T18:49:05.617575] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-08T18:49:05.977477] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T18:49:06.151637] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T18:49:06.417548] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-08T18:49:07.217597] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-08T18:49:07.562516] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:49:07.565234] [INFO ] [REMOTE ] ETV: Full fetch complete (32287 records). [2025-10-08T18:49:07.565309] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-08T18:49:07.947394] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-08T18:49:07.947524] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-08T18:49:07.948116] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-08T18:49:07.948178] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-08T18:49:07.948959] [DEBUG] [LOCAL ] ETV: Trimmed 32287 records to 22112 (keeping 200 days of data) [2025-10-08T18:49:08.037088] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-08T18:49:08.090385] [DEBUG] [LOCAL ] ETV: Primary data saved (22112 records). [2025-10-08T18:49:08.090514] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-08T18:49:08.090611] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETV took 34.5s. Estimated remaining: 3h 41m 38s. Rate: 7.2 symbols/min [2025-10-08T18:49:08.269211] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:08.290056] [DEBUG] [LOCAL ] EVC: Loaded 18322 existing records from primary storage. [2025-10-08T18:49:08.290305] [INFO ] [MAIN ] EVC: Loaded 18322 existing records. [2025-10-08T18:49:08.410265] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:49:08.455827] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T18:49:08.539166] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:08.539483] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-08T18:49:08.539541] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-08T18:49:08.539919] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-08T18:49:08.539978] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-08T18:49:08.822711] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-08T18:49:08.890618] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:09.617550] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-08T18:49:10.117454] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T18:49:10.155070] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T18:49:10.417576] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-08T18:49:11.217551] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-08T18:49:11.894951] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T18:49:12.017561] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-08T18:49:12.523769] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T18:49:12.761288] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T18:49:12.817518] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-08T18:49:13.617562] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-08T18:49:13.872425] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T18:49:14.219091] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T18:49:14.417548] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-08T18:49:15.000413] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:49:15.217536] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-08T18:49:16.017509] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-08T18:49:16.096120] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T18:49:16.767634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:49:16.817506] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-08T18:49:17.255804] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T18:49:17.617547] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-08T18:49:18.417549] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-08T18:49:18.784716] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:49:19.217503] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-08T18:49:19.602448] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:49:20.017513] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-08T18:49:20.308428] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T18:49:20.707268] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T18:49:20.817540] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-08T18:49:21.617542] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-08T18:49:21.873285] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T18:49:22.417558] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-08T18:49:22.875979] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:49:22.919437] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T18:49:23.217547] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-08T18:49:23.831785] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T18:49:24.017571] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-08T18:49:24.817512] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-08T18:49:24.906352] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T18:49:25.459706] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T18:49:25.460773] [INFO ] [REMOTE ] ETX: Full fetch complete (7011 records). [2025-10-08T18:49:25.460846] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-08T18:49:25.618791] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-08T18:49:25.842180] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-08T18:49:25.842264] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-08T18:49:25.842465] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-08T18:49:25.842505] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-08T18:49:25.842984] [DEBUG] [LOCAL ] ETX: Trimmed 7011 records to 5220 (keeping 200 days of data) [2025-10-08T18:49:25.877971] [DEBUG] [LOCAL ] ETX: Primary data saved (5220 records). [2025-10-08T18:49:25.878081] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-08T18:49:25.878163] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETX took 28.4s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-08T18:49:26.055875] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:26.085761] [DEBUG] [LOCAL ] EVEX: Loaded 31180 existing records from primary storage. [2025-10-08T18:49:26.086052] [INFO ] [MAIN ] EVEX: Loaded 31180 existing records. [2025-10-08T18:49:26.271615] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:26.271875] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-08T18:49:26.271923] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-08T18:49:26.272918] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-08T18:49:26.272981] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-08T18:49:26.422699] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-08T18:49:26.655123] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:26.791667] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:49:26.794470] [INFO ] [REMOTE ] ETW: Full fetch complete (36666 records). [2025-10-08T18:49:26.794590] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-08T18:49:27.176326] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-08T18:49:27.176433] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-08T18:49:27.177084] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-08T18:49:27.177149] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-08T18:49:27.178234] [DEBUG] [LOCAL ] ETW: Trimmed 36666 records to 25426 (keeping 200 days of data) [2025-10-08T18:49:27.231556] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-08T18:49:27.341015] [DEBUG] [LOCAL ] ETW: Primary data saved (25426 records). [2025-10-08T18:49:27.341176] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-08T18:49:27.341268] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 42.2s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-08T18:49:27.519776] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:27.532549] [DEBUG] [LOCAL ] EVF: Loaded 9610 existing records from primary storage. [2025-10-08T18:49:27.532849] [INFO ] [MAIN ] EVF: Loaded 9610 existing records. [2025-10-08T18:49:27.719741] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:27.729021] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-08T18:49:27.729104] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-08T18:49:27.730815] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-08T18:49:27.730729] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:49:27.731086] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-08T18:49:28.022735] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-08T18:49:28.114457] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:28.352212] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T18:49:28.817551] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-08T18:49:29.283048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T18:49:29.617519] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-08T18:49:29.701178] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T18:49:30.417623] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-08T18:49:30.517168] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T18:49:30.520030] [INFO ] [REMOTE ] ETY: Full fetch complete (34349 records). [2025-10-08T18:49:30.520154] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-08T18:49:30.904532] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-08T18:49:30.904623] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-08T18:49:30.905307] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-08T18:49:30.905369] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-08T18:49:30.906137] [DEBUG] [LOCAL ] ETY: Trimmed 34349 records to 23084 (keeping 200 days of data) [2025-10-08T18:49:31.047449] [DEBUG] [LOCAL ] ETY: Primary data saved (23084 records). [2025-10-08T18:49:31.047584] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-08T18:49:31.047712] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 33.5s. Estimated remaining: 3h 41m 8s. Rate: 7.2 symbols/min [2025-10-08T18:49:31.221159] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:31.218280] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-08T18:49:31.237018] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T18:49:31.248321] [DEBUG] [LOCAL ] EVG: Loaded 5964 existing records from primary storage. [2025-10-08T18:49:31.248742] [INFO ] [MAIN ] EVG: Loaded 5964 existing records. [2025-10-08T18:49:31.420980] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:31.421203] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-08T18:49:31.421250] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-08T18:49:31.421549] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-08T18:49:31.421608] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-08T18:49:31.773835] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:32.017505] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-08T18:49:32.030081] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:49:32.657799] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T18:49:32.817627] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-08T18:49:33.527865] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T18:49:33.617567] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-08T18:49:34.369997] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T18:49:34.417589] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-08T18:49:35.068539] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:49:35.217530] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-08T18:49:35.942768] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:49:36.017521] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-08T18:49:36.736576] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T18:49:36.817555] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-08T18:49:37.413609] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:49:37.617575] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-08T18:49:38.277809] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T18:49:38.417540] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-08T18:49:39.122910] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T18:49:39.217498] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-08T18:49:39.881026] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T18:49:39.882458] [INFO ] [REMOTE ] EVC: Full fetch complete (29462 records). [2025-10-08T18:49:39.882530] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-08T18:49:40.022705] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-08T18:49:40.256293] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-08T18:49:40.256370] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-08T18:49:40.256903] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-08T18:49:40.256965] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-08T18:49:40.257638] [DEBUG] [LOCAL ] EVC: Trimmed 29462 records to 18236 (keeping 200 days of data) [2025-10-08T18:49:40.367497] [DEBUG] [LOCAL ] EVC: Primary data saved (18236 records). [2025-10-08T18:49:40.367664] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-08T18:49:40.367783] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 32.3s. Estimated remaining: 3h 41m 2s. Rate: 7.2 symbols/min [2025-10-08T18:49:40.541736] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:40.587268] [DEBUG] [LOCAL ] EVH: Loaded 49492 existing records from primary storage. [2025-10-08T18:49:40.587629] [INFO ] [MAIN ] EVH: Loaded 49492 existing records. [2025-10-08T18:49:40.671155] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T18:49:40.780596] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:40.780834] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-08T18:49:40.780880] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-08T18:49:40.782154] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-08T18:49:40.782214] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-08T18:49:40.822676] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-08T18:49:41.140694] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:41.600820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:49:41.617488] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-08T18:49:42.286315] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T18:49:42.417527] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-08T18:49:43.217546] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-08T18:49:43.806073] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T18:49:44.017505] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-08T18:49:44.348553] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T18:49:44.552250] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:49:44.817603] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-08T18:49:45.278389] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T18:49:45.617559] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-08T18:49:46.417570] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-08T18:49:47.223522] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-08T18:49:47.241523] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:49:47.282397] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:49:47.284781] [INFO ] [REMOTE ] EVF: Full fetch complete (12617 records). [2025-10-08T18:49:47.284866] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-08T18:49:47.643055] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-08T18:49:47.643133] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-08T18:49:47.643483] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-08T18:49:47.643519] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-08T18:49:47.644025] [DEBUG] [LOCAL ] EVF: Trimmed 12617 records to 9735 (keeping 200 days of data) [2025-10-08T18:49:47.702193] [DEBUG] [LOCAL ] EVF: Primary data saved (9735 records). [2025-10-08T18:49:47.702316] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-08T18:49:47.702397] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVF took 20.4s. Estimated remaining: 3h 40m 51s. Rate: 7.2 symbols/min [2025-10-08T18:49:47.877542] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:49:47.882631] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T18:49:47.894312] [DEBUG] [LOCAL ] EVN: Loaded 11046 existing records from primary storage. [2025-10-08T18:49:47.894498] [INFO ] [MAIN ] EVN: Loaded 11046 existing records. [2025-10-08T18:49:48.022703] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-08T18:49:48.075192] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:49:48.075353] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-08T18:49:48.075398] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-08T18:49:48.075918] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-08T18:49:48.075977] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-08T18:49:48.423003] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:49:48.709942] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:49:48.817515] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-08T18:49:49.617602] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-08T18:49:50.296767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T18:49:50.417542] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-08T18:49:50.590639] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:49:51.217592] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-08T18:49:51.745608] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T18:49:52.017536] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-08T18:49:52.193024] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T18:49:52.817517] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-08T18:49:53.387610] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T18:49:53.617565] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-08T18:49:53.890026] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T18:49:54.114242] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T18:49:54.417636] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-08T18:49:55.217525] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-08T18:49:55.299599] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:49:55.912038] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T18:49:56.017563] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-08T18:49:56.817709] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-08T18:49:57.263259] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T18:49:57.617574] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-08T18:49:57.804884] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T18:49:58.417614] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-08T18:49:59.149432] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T18:49:59.217571] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-08T18:49:59.316421] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T18:49:59.579555] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T18:50:00.017558] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-08T18:50:00.817609] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-08T18:50:01.309198] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T18:50:01.617616] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-08T18:50:01.981547] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:50:02.417578] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-08T18:50:02.763894] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T18:50:03.217550] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-08T18:50:03.947278] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T18:50:04.017554] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-08T18:50:04.082953] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T18:50:04.762725] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T18:50:04.817565] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-08T18:50:05.617551] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-08T18:50:06.201403] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T18:50:06.202919] [INFO ] [REMOTE ] EVG: Full fetch complete (8247 records). [2025-10-08T18:50:06.203038] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-08T18:50:06.418408] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-08T18:50:06.653888] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-08T18:50:06.660204] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-08T18:50:06.672243] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-08T18:50:06.673149] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-08T18:50:06.674281] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T18:50:06.686916] [DEBUG] [LOCAL ] EVG: Trimmed 8247 records to 5983 (keeping 200 days of data) [2025-10-08T18:50:06.731050] [DEBUG] [LOCAL ] EVG: Primary data saved (5983 records). [2025-10-08T18:50:06.731264] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-08T18:50:06.731390] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVG took 35.7s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-08T18:50:06.938947] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:06.989811] [DEBUG] [LOCAL ] EVR: Loaded 34643 existing records from primary storage. [2025-10-08T18:50:06.990294] [INFO ] [MAIN ] EVR: Loaded 34643 existing records. [2025-10-08T18:50:07.199815] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:07.200275] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-08T18:50:07.200349] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-08T18:50:07.201747] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-08T18:50:07.201808] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-08T18:50:07.223607] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-08T18:50:07.565192] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T18:50:07.601427] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:07.880735] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T18:50:08.017534] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-08T18:50:08.817595] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-08T18:50:09.297816] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T18:50:09.617547] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-08T18:50:10.348722] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T18:50:10.417502] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-08T18:50:10.709272] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:50:11.217554] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-08T18:50:11.856987] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T18:50:12.017538] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-08T18:50:12.595115] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:50:12.817520] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-08T18:50:13.048009] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T18:50:13.617607] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-08T18:50:14.116289] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:50:14.417550] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-08T18:50:15.217623] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-08T18:50:15.377801] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:50:15.985730] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T18:50:16.017501] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-08T18:50:16.626359] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T18:50:16.817559] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-08T18:50:17.617548] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-08T18:50:18.017142] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T18:50:18.219211] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T18:50:18.222899] [INFO ] [REMOTE ] EVEX: Full fetch complete (42685 records). [2025-10-08T18:50:18.222999] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-08T18:50:18.426375] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-08T18:50:18.662481] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-08T18:50:18.662561] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-08T18:50:18.663195] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-08T18:50:18.663256] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-08T18:50:18.664183] [DEBUG] [LOCAL ] EVEX: Trimmed 42685 records to 31368 (keeping 200 days of data) [2025-10-08T18:50:18.842265] [DEBUG] [LOCAL ] EVEX: Primary data saved (31368 records). [2025-10-08T18:50:18.842397] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-08T18:50:18.842496] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVEX took 53.0s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-08T18:50:19.019782] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:19.037737] [DEBUG] [LOCAL ] EVT: Loaded 16888 existing records from primary storage. [2025-10-08T18:50:19.037984] [INFO ] [MAIN ] EVT: Loaded 16888 existing records. [2025-10-08T18:50:19.173676] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:50:19.243359] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-08T18:50:19.209917] [INFO ] [REMOTE ] EVH: Full fetch complete (71770 records). [2025-10-08T18:50:19.248796] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-08T18:50:19.250974] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:19.251311] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-08T18:50:19.251414] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-08T18:50:19.267900] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-08T18:50:19.290957] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-08T18:50:19.591889] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:50:20.006342] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-08T18:50:20.024313] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-08T18:50:20.039773] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-08T18:50:20.045417] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:20.039882] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-08T18:50:20.024227] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-08T18:50:20.047477] [DEBUG] [LOCAL ] EVH: Trimmed 71770 records to 49565 (keeping 200 days of data) [2025-10-08T18:50:20.337686] [DEBUG] [LOCAL ] EVH: Primary data saved (49565 records). [2025-10-08T18:50:20.337914] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-08T18:50:20.338048] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVH took 40.0s. Estimated remaining: 3h 40m 41s. Rate: 7.2 symbols/min [2025-10-08T18:50:20.514712] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:20.545104] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:50:20.576477] [DEBUG] [LOCAL ] EVTC: Loaded 26406 existing records from primary storage. [2025-10-08T18:50:20.576803] [INFO ] [MAIN ] EVTC: Loaded 26406 existing records. [2025-10-08T18:50:20.754185] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:20.754391] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-08T18:50:20.754438] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-08T18:50:20.755357] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-08T18:50:20.755454] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-08T18:50:20.818275] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-08T18:50:21.056105] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T18:50:21.137983] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:21.617567] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-08T18:50:22.130358] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:50:22.417518] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-08T18:50:22.796930] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:50:23.179748] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:50:23.217544] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-08T18:50:24.017557] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-08T18:50:24.225444] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T18:50:24.817569] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-08T18:50:25.206448] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T18:50:25.617549] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-08T18:50:26.257782] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T18:50:26.417514] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-08T18:50:26.554546] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T18:50:27.217530] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-08T18:50:27.719329] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:50:28.017701] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-08T18:50:28.223319] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:50:28.817604] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-08T18:50:28.873260] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T18:50:28.874853] [INFO ] [REMOTE ] EVN: Full fetch complete (17733 records). [2025-10-08T18:50:28.874927] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-08T18:50:29.240292] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-08T18:50:29.240372] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-08T18:50:29.240758] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-08T18:50:29.240818] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-08T18:50:29.241319] [DEBUG] [LOCAL ] EVN: Trimmed 17733 records to 11115 (keeping 200 days of data) [2025-10-08T18:50:29.306565] [DEBUG] [LOCAL ] EVN: Primary data saved (11115 records). [2025-10-08T18:50:29.306723] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-08T18:50:29.306819] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVN took 41.6s. Estimated remaining: 3h 40m 34s. Rate: 7.2 symbols/min [2025-10-08T18:50:29.472949] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:29.510294] [DEBUG] [LOCAL ] EVTL: Loaded 38975 existing records from primary storage. [2025-10-08T18:50:29.510586] [INFO ] [MAIN ] EVTL: Loaded 38975 existing records. [2025-10-08T18:50:29.622786] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-08T18:50:29.689586] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:29.689823] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-08T18:50:29.689892] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-08T18:50:29.690954] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-08T18:50:29.691016] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-08T18:50:30.098399] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:30.114930] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:50:30.417552] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-08T18:50:30.767783] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T18:50:31.217548] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-08T18:50:31.284252] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T18:50:32.017561] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-08T18:50:32.240113] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T18:50:32.817574] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-08T18:50:33.345478] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T18:50:33.617513] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-08T18:50:33.855015] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T18:50:34.417575] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-08T18:50:34.764138] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T18:50:35.217540] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-08T18:50:35.343011] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T18:50:36.017504] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-08T18:50:36.326969] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T18:50:36.330412] [INFO ] [REMOTE ] EVR: Full fetch complete (50638 records). [2025-10-08T18:50:36.330577] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-08T18:50:36.724184] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-08T18:50:36.724273] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-08T18:50:36.724968] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-08T18:50:36.725029] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-08T18:50:36.726057] [DEBUG] [LOCAL ] EVR: Trimmed 50638 records to 34583 (keeping 200 days of data) [2025-10-08T18:50:36.817591] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-08T18:50:36.946404] [DEBUG] [LOCAL ] EVR: Primary data saved (34583 records). [2025-10-08T18:50:36.946564] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-08T18:50:36.946690] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVR took 30.2s. Estimated remaining: 3h 40m 24s. Rate: 7.2 symbols/min [2025-10-08T18:50:37.149701] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:37.173888] [DEBUG] [LOCAL ] EVTR: Loaded 24189 existing records from primary storage. [2025-10-08T18:50:37.174152] [INFO ] [MAIN ] EVTR: Loaded 24189 existing records. [2025-10-08T18:50:37.358276] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:37.358584] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-08T18:50:37.358638] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-08T18:50:37.358915] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-08T18:50:37.358973] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-08T18:50:37.636249] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-08T18:50:37.667524] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T18:50:37.756086] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:37.858512] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T18:50:38.417575] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-08T18:50:39.058581] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T18:50:39.135429] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:50:39.217582] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-08T18:50:40.017516] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-08T18:50:40.160420] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T18:50:40.817579] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-08T18:50:40.988831] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T18:50:41.617583] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-08T18:50:42.005332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T18:50:42.417638] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-08T18:50:43.191835] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T18:50:43.217505] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-08T18:50:43.370052] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T18:50:43.371815] [INFO ] [REMOTE ] EVT: Full fetch complete (25237 records). [2025-10-08T18:50:43.371911] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-08T18:50:43.744691] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-08T18:50:43.744786] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-08T18:50:43.745341] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-08T18:50:43.745410] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-08T18:50:43.746206] [DEBUG] [LOCAL ] EVT: Trimmed 25237 records to 16893 (keeping 200 days of data) [2025-10-08T18:50:43.852707] [DEBUG] [LOCAL ] EVT: Primary data saved (16893 records). [2025-10-08T18:50:43.852879] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-08T18:50:43.852968] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 25.0s. Estimated remaining: 3h 40m 13s. Rate: 7.2 symbols/min [2025-10-08T18:50:44.020976] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:44.021048] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-08T18:50:44.074119] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-08T18:50:44.074463] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-08T18:50:44.265803] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:44.266144] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-08T18:50:44.271477] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-08T18:50:44.279790] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T18:50:44.281560] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-08T18:50:44.285032] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-08T18:50:44.638488] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:44.817552] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-08T18:50:44.979848] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T18:50:45.617598] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-08T18:50:46.360492] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:50:46.417549] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-08T18:50:46.613563] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T18:50:47.217517] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-08T18:50:47.775737] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:50:47.933320] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T18:50:48.017578] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-08T18:50:48.817552] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-08T18:50:49.182686] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T18:50:49.617590] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-08T18:50:50.431134] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-08T18:50:50.463985] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T18:50:50.603639] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:50:51.217599] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-08T18:50:51.557924] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T18:50:52.017558] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-08T18:50:52.817527] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-08T18:50:53.008129] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T18:50:53.060960] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:50:53.617605] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-08T18:50:54.027153] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:50:54.029737] [INFO ] [REMOTE ] EVTC: Full fetch complete (38134 records). [2025-10-08T18:50:54.029820] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-08T18:50:54.404123] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-08T18:50:54.404271] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-08T18:50:54.404910] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-08T18:50:54.404973] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-08T18:50:54.406040] [DEBUG] [LOCAL ] EVTC: Trimmed 38134 records to 26384 (keeping 200 days of data) [2025-10-08T18:50:54.459106] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-08T18:50:54.571867] [DEBUG] [LOCAL ] EVTC: Primary data saved (26384 records). [2025-10-08T18:50:54.572744] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-08T18:50:54.572868] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 34.2s. Estimated remaining: 3h 40m 9s. Rate: 7.2 symbols/min [2025-10-08T18:50:54.707438] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T18:50:54.768447] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:50:54.803264] [DEBUG] [LOCAL ] EXG: Loaded 34226 existing records from primary storage. [2025-10-08T18:50:54.803598] [INFO ] [MAIN ] EXG: Loaded 34226 existing records. [2025-10-08T18:50:54.980503] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:50:54.980801] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-08T18:50:54.980871] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-08T18:50:54.982071] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-08T18:50:54.982136] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-08T18:50:55.230553] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-08T18:50:55.349268] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:50:56.026009] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-08T18:50:56.033158] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:50:56.549786] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T18:50:56.817578] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-08T18:50:57.347313] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:50:57.617601] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-08T18:50:58.210608] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:50:58.417596] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-08T18:50:58.796039] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:50:59.217519] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-08T18:50:59.509240] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T18:51:00.017587] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-08T18:51:00.817554] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-08T18:51:01.276100] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T18:51:01.326554] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T18:51:01.617593] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-08T18:51:02.417547] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-08T18:51:02.523227] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T18:51:02.834792] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T18:51:03.217628] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-08T18:51:04.017600] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-08T18:51:04.439271] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T18:51:04.662552] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:51:04.817526] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-08T18:51:05.133091] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T18:51:05.617561] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-08T18:51:06.325823] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T18:51:06.417523] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-08T18:51:07.115048] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T18:51:07.217606] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-08T18:51:07.800920] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T18:51:08.017568] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-08T18:51:08.583006] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:51:08.817621] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-08T18:51:09.617593] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-08T18:51:09.930877] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T18:51:10.266279] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T18:51:10.417575] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-08T18:51:11.142459] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T18:51:11.217526] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-08T18:51:12.017568] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-08T18:51:12.239322] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T18:51:12.617411] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:51:12.817631] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-08T18:51:12.980275] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:51:12.982927] [INFO ] [REMOTE ] EVTR: Full fetch complete (32859 records). [2025-10-08T18:51:12.983003] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-08T18:51:13.373614] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-08T18:51:13.373750] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-08T18:51:13.374374] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-08T18:51:13.374417] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-08T18:51:13.375217] [DEBUG] [LOCAL ] EVTR: Trimmed 32859 records to 24255 (keeping 200 days of data) [2025-10-08T18:51:13.523619] [DEBUG] [LOCAL ] EVTR: Primary data saved (24255 records). [2025-10-08T18:51:13.523792] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-08T18:51:13.523885] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTR took 36.6s. Estimated remaining: 3h 40m 22s. Rate: 7.2 symbols/min [2025-10-08T18:51:13.627155] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-08T18:51:13.705154] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:13.757237] [DEBUG] [LOCAL ] EXK: Loaded 53139 existing records from primary storage. [2025-10-08T18:51:13.757618] [INFO ] [MAIN ] EXK: Loaded 53139 existing records. [2025-10-08T18:51:13.950880] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:13.951106] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-08T18:51:13.951154] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-08T18:51:13.952423] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-08T18:51:13.952488] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-08T18:51:14.333595] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:14.422693] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-08T18:51:14.428731] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T18:51:14.433311] [INFO ] [REMOTE ] EW: Full fetch complete (77353 records). [2025-10-08T18:51:14.433453] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-08T18:51:14.846089] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-08T18:51:14.846310] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-08T18:51:14.847357] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-08T18:51:14.847480] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-08T18:51:14.866507] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T18:51:14.874180] [DEBUG] [LOCAL ] EW: Trimmed 77353 records to 53402 (keeping 200 days of data) [2025-10-08T18:51:15.209842] [DEBUG] [LOCAL ] EW: Primary data saved (53402 records). [2025-10-08T18:51:15.210027] [INFO ] [MAIN ] EW: Full history saved. [2025-10-08T18:51:15.210133] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EW took 31.4s. Estimated remaining: 3h 40m 0s. Rate: 7.2 symbols/min [2025-10-08T18:51:15.222779] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-08T18:51:15.393594] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:15.421589] [DEBUG] [LOCAL ] EXP: Loaded 29608 existing records from primary storage. [2025-10-08T18:51:15.421930] [INFO ] [MAIN ] EXP: Loaded 29608 existing records. [2025-10-08T18:51:15.603532] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:15.603852] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-08T18:51:15.603906] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-08T18:51:15.604997] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-08T18:51:15.605082] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-08T18:51:15.962789] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:16.017516] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-08T18:51:16.428769] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T18:51:16.817567] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-08T18:51:16.936606] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:51:17.068133] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T18:51:17.617502] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-08T18:51:17.744719] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T18:51:18.417575] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-08T18:51:19.217534] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-08T18:51:19.289693] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T18:51:19.721679] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:51:20.017547] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-08T18:51:20.809778] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T18:51:20.819972] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-08T18:51:21.363891] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T18:51:21.617506] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-08T18:51:21.937666] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:51:21.941814] [INFO ] [REMOTE ] EXG: Full fetch complete (49854 records). [2025-10-08T18:51:21.942008] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-08T18:51:22.328951] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-08T18:51:22.329039] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-08T18:51:22.329760] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-08T18:51:22.329825] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-08T18:51:22.330900] [DEBUG] [LOCAL ] EXG: Trimmed 49854 records to 34256 (keeping 200 days of data) [2025-10-08T18:51:22.424766] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-08T18:51:22.569343] [DEBUG] [LOCAL ] EXG: Primary data saved (34256 records). [2025-10-08T18:51:22.569502] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-08T18:51:22.569592] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 28.0s. Estimated remaining: 3h 39m 50s. Rate: 7.2 symbols/min [2025-10-08T18:51:23.217565] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-08T18:51:23.553767] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T18:51:23.560261] [INFO ] [REMOTE ] EVTL: Full fetch complete (53270 records). [2025-10-08T18:51:23.560458] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-08T18:51:23.932686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T18:51:24.023594] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-08T18:51:24.069849] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-08T18:51:24.069939] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-08T18:51:24.070839] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-08T18:51:24.070906] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-08T18:51:24.072173] [DEBUG] [LOCAL ] EVTL: Trimmed 53270 records to 39239 (keeping 200 days of data) [2025-10-08T18:51:24.299285] [DEBUG] [LOCAL ] EVTL: Primary data saved (39239 records). [2025-10-08T18:51:24.299672] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-08T18:51:24.299780] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EVTL took 55.0s. Estimated remaining: 3h 39m 28s. Rate: 7.2 symbols/min [2025-10-08T18:51:24.614231] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T18:51:24.817617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-08T18:51:25.200429] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:51:25.617567] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-08T18:51:26.646082] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T18:51:26.657548] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-08T18:51:26.726329] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T18:51:27.217741] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-08T18:51:28.537994] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T18:51:28.545292] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-08T18:51:28.630075] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T18:51:28.817620] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-08T18:51:29.947602] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T18:51:29.958741] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-08T18:51:30.699045] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T18:51:30.710617] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-08T18:51:31.307010] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:51:31.313860] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-08T18:51:32.205393] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T18:51:32.216810] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-08T18:51:32.753686] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T18:51:32.817502] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-08T18:51:33.872830] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:51:33.884626] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-08T18:51:34.042339] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:51:34.044700] [INFO ] [REMOTE ] EXP: Full fetch complete (42860 records). [2025-10-08T18:51:34.044819] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-08T18:51:34.447294] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-08T18:51:34.447383] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-08T18:51:34.448033] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-08T18:51:34.448098] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-08T18:51:34.452072] [DEBUG] [LOCAL ] EXP: Trimmed 42860 records to 29620 (keeping 200 days of data) [2025-10-08T18:51:34.646857] [DEBUG] [LOCAL ] EXP: Primary data saved (29620 records). [2025-10-08T18:51:34.647018] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-08T18:51:34.647102] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 19.4s. Estimated remaining: 3h 39m 24s. Rate: 7.2 symbols/min [2025-10-08T18:51:35.811932] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T18:51:35.824198] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-08T18:51:37.585095] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:51:37.599512] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-08T18:51:39.588319] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T18:51:39.593532] [INFO ] [REMOTE ] EXK: Full fetch complete (76569 records). [2025-10-08T18:51:39.593713] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-08T18:51:40.002896] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-08T18:51:40.003000] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-08T18:51:40.003945] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-08T18:51:40.004012] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-08T18:51:40.005549] [DEBUG] [LOCAL ] EXK: Trimmed 76569 records to 53142 (keeping 200 days of data) [2025-10-08T18:51:40.321570] [DEBUG] [LOCAL ] EXK: Primary data saved (53142 records). [2025-10-08T18:51:40.321778] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-08T18:51:40.321946] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 26.8s. Estimated remaining: 3h 39m 10s. Rate: 7.2 symbols/min [2025-10-08T18:51:41.061389] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.081333] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.111928] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.087573] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:51:41.239959] [DEBUG] [LOCAL ] EXPD: Loaded 47815 existing records from primary storage. [2025-10-08T18:51:41.239231] [DEBUG] [LOCAL ] EXR: Loaded 45261 existing records from primary storage. [2025-10-08T18:51:41.241215] [INFO ] [MAIN ] EXPD: Loaded 47815 existing records. [2025-10-08T18:51:41.240618] [DEBUG] [LOCAL ] FAF: Loaded 41605 existing records from primary storage. [2025-10-08T18:51:41.241561] [INFO ] [MAIN ] EXR: Loaded 45261 existing records. [2025-10-08T18:51:41.238400] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-08T18:51:41.252748] [INFO ] [MAIN ] FAF: Loaded 41605 existing records. [2025-10-08T18:51:41.268196] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-08T18:51:41.834609] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:41.893021] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:41.933585] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-08T18:51:41.941734] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-08T18:51:41.976684] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-08T18:51:42.013728] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-08T18:51:42.013617] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:42.013900] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-08T18:51:42.029434] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-08T18:51:42.029368] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-08T18:51:42.040515] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-08T18:51:42.040442] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-08T18:51:42.076954] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-08T18:51:42.089622] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-08T18:51:42.055966] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:51:42.103948] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-08T18:51:42.135987] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-08T18:51:42.176792] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-08T18:51:42.267731] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-08T18:51:42.308325] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-08T18:51:43.427312] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.441337] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.475807] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-08T18:51:43.475400] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-08T18:51:43.511437] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.538924] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-08T18:51:43.595209] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:51:43.595521] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-08T18:51:44.881457] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T18:51:44.889208] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-08T18:51:44.970930] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T18:51:44.979839] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-08T18:51:45.201971] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T18:51:45.211299] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-08T18:51:46.059735] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T18:51:46.067730] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-08T18:51:46.126946] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-08T18:51:46.138260] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-08T18:51:46.501308] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:51:46.510816] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-08T18:51:46.940182] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T18:51:46.949600] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-08T18:51:47.322719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T18:51:47.330064] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-08T18:51:47.679200] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T18:51:47.687949] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-08T18:51:48.212146] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T18:51:48.221431] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-08T18:51:48.414792] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-08T18:51:48.428304] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-08T18:51:48.800086] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T18:51:48.809347] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-08T18:51:48.911552] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T18:51:48.921811] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-08T18:51:49.589591] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:51:49.617505] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-08T18:51:50.107046] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:51:50.417518] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-08T18:51:50.560529] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-08T18:51:50.721552] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T18:51:51.217559] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-08T18:51:51.329406] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:51:51.827847] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T18:51:52.017557] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-08T18:51:52.485084] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T18:51:52.817599] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-08T18:51:53.437146] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:51:53.617567] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-08T18:51:54.417572] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-08T18:51:54.631213] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T18:51:54.822909] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:51:55.217574] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-08T18:51:55.660042] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T18:51:56.017559] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-08T18:51:56.817571] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-08T18:51:56.888779] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:51:57.617571] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-08T18:51:58.192262] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T18:51:58.417510] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-08T18:51:58.577032] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-08T18:51:58.819779] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T18:51:59.217613] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-08T18:51:59.803117] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T18:52:00.017625] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-08T18:52:00.736705] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T18:52:00.817620] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-08T18:52:01.016038] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T18:52:01.019288] [INFO ] [REMOTE ] FAF: Full fetch complete (57748 records). [2025-10-08T18:52:01.019452] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-08T18:52:01.442067] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-08T18:52:01.442163] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-08T18:52:01.442954] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-08T18:52:01.443020] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-08T18:52:01.444359] [DEBUG] [LOCAL ] FAF: Trimmed 57748 records to 41546 (keeping 200 days of data) [2025-10-08T18:52:01.629010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-08T18:52:01.719287] [DEBUG] [LOCAL ] FAF: Primary data saved (41546 records). [2025-10-08T18:52:01.719475] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-08T18:52:01.719626] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FAF took 21.4s. Estimated remaining: 3h 39m 27s. Rate: 7.2 symbols/min [2025-10-08T18:52:01.896234] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:01.942208] [DEBUG] [LOCAL ] FBIN: Loaded 50405 existing records from primary storage. [2025-10-08T18:52:01.942558] [INFO ] [MAIN ] FBIN: Loaded 50405 existing records. [2025-10-08T18:52:02.151527] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:02.151892] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-08T18:52:02.151964] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-08T18:52:02.153451] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-08T18:52:02.153533] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-08T18:52:02.419284] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-08T18:52:02.591120] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:02.619077] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:52:03.217551] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-08T18:52:04.017524] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-08T18:52:04.140296] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-08T18:52:04.193346] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T18:52:04.817525] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-08T18:52:04.925726] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T18:52:05.173584] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T18:52:05.617600] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-08T18:52:06.417598] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-08T18:52:07.217535] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-08T18:52:07.368527] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T18:52:07.715884] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T18:52:08.017585] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-08T18:52:08.083881] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-08T18:52:08.426874] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:52:08.431207] [INFO ] [REMOTE ] EXR: Full fetch complete (65951 records). [2025-10-08T18:52:08.431389] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-08T18:52:08.830770] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-08T18:52:08.886697] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-08T18:52:08.886793] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-08T18:52:08.887861] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-08T18:52:08.887925] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-08T18:52:08.889212] [DEBUG] [LOCAL ] EXR: Trimmed 65951 records to 45251 (keeping 200 days of data) [2025-10-08T18:52:09.168216] [DEBUG] [LOCAL ] EXR: Primary data saved (45251 records). [2025-10-08T18:52:09.168351] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-08T18:52:09.168437] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 28.8s. Estimated remaining: 3h 39m 17s. Rate: 7.2 symbols/min [2025-10-08T18:52:09.338966] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:09.364976] [DEBUG] [LOCAL ] FBK: Loaded 26609 existing records from primary storage. [2025-10-08T18:52:09.365266] [INFO ] [MAIN ] FBK: Loaded 26609 existing records. [2025-10-08T18:52:09.543468] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:09.543801] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-08T18:52:09.543916] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-08T18:52:09.544959] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-08T18:52:09.545023] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-08T18:52:09.635308] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-08T18:52:09.854914] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T18:52:09.943677] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:10.362852] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T18:52:10.366412] [INFO ] [REMOTE ] EXPD: Full fetch complete (69280 records). [2025-10-08T18:52:10.366561] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-08T18:52:10.429377] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-08T18:52:10.761339] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-08T18:52:10.761429] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-08T18:52:10.762386] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-08T18:52:10.762449] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-08T18:52:10.763802] [DEBUG] [LOCAL ] EXPD: Trimmed 69280 records to 47841 (keeping 200 days of data) [2025-10-08T18:52:11.058639] [DEBUG] [LOCAL ] EXPD: Primary data saved (47841 records). [2025-10-08T18:52:11.058807] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-08T18:52:11.058914] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. EXPD took 30.7s. Estimated remaining: 3h 38m 56s. Rate: 7.2 symbols/min [2025-10-08T18:52:11.219109] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-08T18:52:11.237307] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:11.248209] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:52:11.290963] [DEBUG] [LOCAL ] FBP: Loaded 45850 existing records from primary storage. [2025-10-08T18:52:11.291307] [INFO ] [MAIN ] FBP: Loaded 45850 existing records. [2025-10-08T18:52:11.475007] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:11.475202] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-08T18:52:11.475264] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-08T18:52:11.476615] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-08T18:52:11.476699] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-08T18:52:11.846429] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:11.888361] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-08T18:52:12.017540] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-08T18:52:12.824082] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-08T18:52:12.850481] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:52:12.874486] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T18:52:13.617543] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-08T18:52:14.417521] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-08T18:52:14.625523] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T18:52:15.207573] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T18:52:15.220392] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-08T18:52:16.017545] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-08T18:52:16.052890] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:52:16.677517] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T18:52:16.817584] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-08T18:52:17.141621] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T18:52:17.617576] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-08T18:52:18.417592] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-08T18:52:19.189780] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:52:19.217808] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-08T18:52:19.234549] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T18:52:19.265590] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T18:52:20.017551] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-08T18:52:20.817557] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-08T18:52:20.956580] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T18:52:21.005791] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T18:52:21.617551] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-08T18:52:22.338435] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:52:22.417507] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-08T18:52:22.485609] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T18:52:23.217593] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-08T18:52:23.711033] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T18:52:24.017551] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-08T18:52:24.367731] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T18:52:24.817594] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-08T18:52:25.617548] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-08T18:52:25.673068] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:52:26.151744] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T18:52:26.417587] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-08T18:52:27.217611] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-08T18:52:27.676543] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T18:52:27.975428] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:52:28.017504] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-08T18:52:28.826263] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-08T18:52:28.831958] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T18:52:29.273593] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T18:52:29.590226] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T18:52:29.617526] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-08T18:52:30.417615] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-08T18:52:31.126933] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:52:31.217558] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-08T18:52:31.571926] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T18:52:32.017555] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-08T18:52:32.817557] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-08T18:52:32.888003] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T18:52:33.617593] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-08T18:52:33.692820] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:52:34.417570] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-08T18:52:34.914459] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T18:52:35.224729] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-08T18:52:35.229321] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-08T18:52:35.234119] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-08T18:52:35.234246] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-08T18:52:35.670283] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-08T18:52:35.670377] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-08T18:52:35.671343] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-08T18:52:35.671416] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-08T18:52:35.672981] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 53820 (keeping 200 days of data) [2025-10-08T18:52:35.799283] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T18:52:35.804736] [INFO ] [REMOTE ] FBIN: Full fetch complete (72745 records). [2025-10-08T18:52:35.805696] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-08T18:52:36.019973] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-08T18:52:36.365789] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-08T18:52:36.366572] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-08T18:52:36.367809] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-08T18:52:36.367903] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-08T18:52:36.382862] [DEBUG] [LOCAL ] FBIN: Trimmed 72745 records to 50379 (keeping 200 days of data) [2025-10-08T18:52:36.598408] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-08T18:52:36.600139] [INFO ] [MAIN ] F: Full history saved. [2025-10-08T18:52:36.600889] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 56.3s. Estimated remaining: 3h 39m 21s. Rate: 7.1 symbols/min [2025-10-08T18:52:36.800031] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:52:36.841074] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:36.856904] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-08T18:52:37.003058] [DEBUG] [LOCAL ] FBRT: Loaded 35007 existing records from primary storage. [2025-10-08T18:52:37.005027] [INFO ] [MAIN ] FBRT: Loaded 35007 existing records. [2025-10-08T18:52:37.213449] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:37.221546] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-08T18:52:37.221928] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-08T18:52:37.226017] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-08T18:52:37.226462] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:52:37.226582] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-08T18:52:37.268948] [INFO ] [REMOTE ] FBK: Full fetch complete (34193 records). [2025-10-08T18:52:37.302622] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-08T18:52:37.975925] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:37.988362] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-08T18:52:38.119024] [DEBUG] [LOCAL ] FBIN: Primary data saved (50379 records). [2025-10-08T18:52:38.149144] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-08T18:52:38.162842] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBIN took 36.4s. Estimated remaining: 3h 38m 59s. Rate: 7.2 symbols/min [2025-10-08T18:52:38.188297] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-08T18:52:38.222350] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-08T18:52:38.232618] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-08T18:52:38.238248] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-08T18:52:38.287559] [DEBUG] [LOCAL ] FBK: Trimmed 34193 records to 26718 (keeping 200 days of data) [2025-10-08T18:52:38.357202] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:38.457212] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T18:52:38.466287] [INFO ] [REMOTE ] FBP: Full fetch complete (66424 records). [2025-10-08T18:52:38.467261] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-08T18:52:38.480598] [DEBUG] [LOCAL ] FC: Loaded 15301 existing records from primary storage. [2025-10-08T18:52:38.508342] [INFO ] [MAIN ] FC: Loaded 15301 existing records. [2025-10-08T18:52:38.887506] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:38.910045] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-08T18:52:38.915515] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-08T18:52:38.951630] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-08T18:52:38.964926] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-08T18:52:39.218328] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-08T18:52:39.218849] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-08T18:52:39.244202] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-08T18:52:39.267139] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-08T18:52:39.362063] [DEBUG] [LOCAL ] FBP: Trimmed 66424 records to 45763 (keeping 200 days of data) [2025-10-08T18:52:39.583440] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:39.600308] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-08T18:52:39.633539] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T18:52:39.645209] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-08T18:52:39.681052] [DEBUG] [LOCAL ] FBK: Primary data saved (26718 records). [2025-10-08T18:52:39.683437] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-08T18:52:39.683599] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBK took 30.5s. Estimated remaining: 3h 38m 38s. Rate: 7.2 symbols/min [2025-10-08T18:52:39.945492] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:40.020789] [DEBUG] [LOCAL ] FBP: Primary data saved (45763 records). [2025-10-08T18:52:40.031899] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-08T18:52:40.032053] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBP took 29.0s. Estimated remaining: 3h 38m 14s. Rate: 7.2 symbols/min [2025-10-08T18:52:40.032575] [DEBUG] [LOCAL ] FCF: Loaded 39294 existing records from primary storage. [2025-10-08T18:52:40.075612] [INFO ] [MAIN ] FCF: Loaded 39294 existing records. [2025-10-08T18:52:40.349857] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:52:40.385040] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:40.385286] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-08T18:52:40.385330] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-08T18:52:40.386391] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-08T18:52:40.386457] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-08T18:52:40.522926] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T18:52:40.546468] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-08T18:52:40.702892] [DEBUG] [LOCAL ] FCN: Loaded 26013 existing records from primary storage. [2025-10-08T18:52:40.709222] [INFO ] [MAIN ] FCN: Loaded 26013 existing records. [2025-10-08T18:52:40.840915] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:40.861812] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-08T18:52:40.981458] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:52:40.981769] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-08T18:52:40.981913] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-08T18:52:40.982779] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-08T18:52:40.982843] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-08T18:52:41.113498] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T18:52:41.357910] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:52:41.425863] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T18:52:41.617526] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-08T18:52:42.004346] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T18:52:42.407894] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T18:52:42.417489] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-08T18:52:43.217567] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-08T18:52:43.509951] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T18:52:44.017564] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-08T18:52:44.121899] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T18:52:44.817554] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-08T18:52:45.306504] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:52:45.617530] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-08T18:52:45.712185] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T18:52:46.417578] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-08T18:52:46.606203] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T18:52:47.217597] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-08T18:52:47.786317] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T18:52:48.017631] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-08T18:52:48.353007] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T18:52:48.817551] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-08T18:52:49.581782] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:52:49.617508] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-08T18:52:50.178463] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T18:52:50.417601] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-08T18:52:50.955493] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T18:52:51.217528] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-08T18:52:51.547695] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:52:52.017631] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-08T18:52:52.321455] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:52:52.817610] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-08T18:52:53.112837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:52:53.617560] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-08T18:52:53.918259] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T18:52:54.417558] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-08T18:52:55.153759] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T18:52:55.217489] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-08T18:52:55.555407] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T18:52:56.017604] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-08T18:52:56.673211] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T18:52:56.817519] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-08T18:52:56.936912] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T18:52:57.617562] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-08T18:52:58.086888] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T18:52:58.270211] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T18:52:58.417610] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-08T18:52:59.217558] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-08T18:52:59.715937] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T18:53:00.017639] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-08T18:53:00.689620] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T18:53:00.817552] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-08T18:53:01.299917] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T18:53:01.304740] [INFO ] [REMOTE ] FBRT: Full fetch complete (49285 records). [2025-10-08T18:53:01.304925] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-08T18:53:01.622853] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-08T18:53:01.713404] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-08T18:53:01.713498] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-08T18:53:01.714216] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-08T18:53:01.714278] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-08T18:53:01.715350] [DEBUG] [LOCAL ] FBRT: Trimmed 49285 records to 35080 (keeping 200 days of data) [2025-10-08T18:53:01.933253] [DEBUG] [LOCAL ] FBRT: Primary data saved (35080 records). [2025-10-08T18:53:01.933397] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-08T18:53:01.933483] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 25.3s. Estimated remaining: 3h 38m 32s. Rate: 7.2 symbols/min [2025-10-08T18:53:02.113841] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:02.153050] [DEBUG] [LOCAL ] FCPT: Loaded 37319 existing records from primary storage. [2025-10-08T18:53:02.153374] [INFO ] [MAIN ] FCPT: Loaded 37319 existing records. [2025-10-08T18:53:02.341576] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:02.342154] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-08T18:53:02.342442] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-08T18:53:02.342792] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-08T18:53:02.350973] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-08T18:53:02.377340] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T18:53:02.419219] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-08T18:53:02.445806] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T18:53:02.756717] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:03.217600] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-08T18:53:03.326200] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T18:53:04.017620] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-08T18:53:04.153390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T18:53:04.817561] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-08T18:53:05.100488] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:53:05.617549] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-08T18:53:05.680274] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T18:53:06.417522] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-08T18:53:06.502626] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T18:53:07.097853] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T18:53:07.217580] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-08T18:53:08.017583] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-08T18:53:08.235077] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T18:53:08.817527] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-08T18:53:09.418748] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:53:09.617599] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-08T18:53:09.800668] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:53:09.802241] [INFO ] [REMOTE ] FC: Full fetch complete (21785 records). [2025-10-08T18:53:09.802314] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-08T18:53:10.175324] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-08T18:53:10.175403] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-08T18:53:10.175936] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-08T18:53:10.176000] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-08T18:53:10.176574] [DEBUG] [LOCAL ] FC: Trimmed 21785 records to 15157 (keeping 200 days of data) [2025-10-08T18:53:10.262004] [DEBUG] [LOCAL ] FC: Primary data saved (15157 records). [2025-10-08T18:53:10.262138] [INFO ] [MAIN ] FC: Full history saved. [2025-10-08T18:53:10.262222] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 32.1s. Estimated remaining: 3h 38m 23s. Rate: 7.2 symbols/min [2025-10-08T18:53:10.428160] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-08T18:53:10.430867] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:10.431691] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-08T18:53:10.431743] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-08T18:53:10.431849] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-08T18:53:10.431894] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-08T18:53:10.431936] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-08T18:53:10.431967] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-08T18:53:10.795692] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:11.058425] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T18:53:11.217607] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-08T18:53:11.835067] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T18:53:11.837342] [INFO ] [REMOTE ] FCN: Full fetch complete (35755 records). [2025-10-08T18:53:11.837444] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-08T18:53:12.026718] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-08T18:53:12.248560] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-08T18:53:12.248674] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-08T18:53:12.249310] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-08T18:53:12.249403] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-08T18:53:12.250298] [DEBUG] [LOCAL ] FCN: Trimmed 35755 records to 26003 (keeping 200 days of data) [2025-10-08T18:53:12.410337] [DEBUG] [LOCAL ] FCN: Primary data saved (26003 records). [2025-10-08T18:53:12.410484] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-08T18:53:12.413149] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCN took 32.4s. Estimated remaining: 3h 38m 3s. Rate: 7.2 symbols/min [2025-10-08T18:53:12.413260] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-08T18:53:12.592747] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:12.609230] [DEBUG] [LOCAL ] FCT: Loaded 14747 existing records from primary storage. [2025-10-08T18:53:12.609714] [INFO ] [MAIN ] FCT: Loaded 14747 existing records. [2025-10-08T18:53:12.733593] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:53:12.823594] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-08T18:53:12.832120] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:12.832394] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-08T18:53:12.832447] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-08T18:53:12.832718] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-08T18:53:12.832778] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-08T18:53:13.235621] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:13.270628] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T18:53:13.617576] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-08T18:53:14.417613] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-08T18:53:14.705850] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T18:53:15.003731] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T18:53:15.217563] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-08T18:53:15.632888] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:53:16.017567] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-08T18:53:16.817522] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-08T18:53:16.999791] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T18:53:17.617516] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-08T18:53:17.725364] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T18:53:18.417546] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-08T18:53:18.548716] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:53:19.217625] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-08T18:53:19.514401] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T18:53:19.816397] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T18:53:20.017594] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-08T18:53:20.817587] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-08T18:53:20.918788] [DEBUG] [REMOTE ] FCRX: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T18:53:20.919055] [WARN ] [REMOTE ] FCRX: No data returned for month 2025-05 [2025-10-08T18:53:20.919143] [FATAL] [REMOTE ] FCRX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:53:20.919246] [FATAL] [MAIN ] FCRX: Failed to fetch primary data. [2025-10-08T18:53:20.919312] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:53:20.919382] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-08T18:53:20.919443] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-08T18:53:20.919482] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-08T18:53:20.919560] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-08T18:53:20.919624] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCRX took 10.7s. Estimated remaining: 3h 37m 55s. Rate: 7.2 symbols/min [2025-10-08T18:53:21.084720] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:21.134254] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-08T18:53:21.134583] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-08T18:53:21.331979] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:21.332495] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-08T18:53:21.332549] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-08T18:53:21.332894] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-08T18:53:21.332954] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-08T18:53:21.618922] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-08T18:53:21.710457] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:21.733725] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T18:53:22.417518] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-08T18:53:22.501939] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T18:53:23.217630] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-08T18:53:23.979682] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:53:24.017497] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-08T18:53:24.337372] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T18:53:24.340745] [INFO ] [REMOTE ] FCF: Full fetch complete (58138 records). [2025-10-08T18:53:24.340863] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-08T18:53:24.735519] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-08T18:53:24.735603] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-08T18:53:24.736358] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-08T18:53:24.736420] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-08T18:53:24.737679] [DEBUG] [LOCAL ] FCF: Trimmed 58138 records to 39188 (keeping 200 days of data) [2025-10-08T18:53:24.825404] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-08T18:53:24.976784] [DEBUG] [LOCAL ] FCF: Primary data saved (39188 records). [2025-10-08T18:53:24.976928] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-08T18:53:24.977011] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCF took 45.3s. Estimated remaining: 3h 37m 38s. Rate: 7.2 symbols/min [2025-10-08T18:53:25.150611] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:25.183363] [DEBUG] [LOCAL ] FDP: Loaded 30089 existing records from primary storage. [2025-10-08T18:53:25.183636] [INFO ] [MAIN ] FDP: Loaded 30089 existing records. [2025-10-08T18:53:25.366463] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:25.366935] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-08T18:53:25.367017] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-08T18:53:25.367358] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-08T18:53:25.367603] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-08T18:53:25.556179] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:53:25.619824] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-08T18:53:25.755881] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:26.417513] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-08T18:53:26.566942] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:53:26.840512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T18:53:27.217566] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-08T18:53:27.438801] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:53:28.017584] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-08T18:53:28.094997] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T18:53:28.817630] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-08T18:53:29.402171] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T18:53:29.617553] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-08T18:53:29.841369] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T18:53:30.417591] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-08T18:53:31.217517] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-08T18:53:31.595129] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T18:53:31.728360] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T18:53:31.806473] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T18:53:32.017612] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-08T18:53:32.817558] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-08T18:53:33.617553] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-08T18:53:33.903103] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T18:53:33.985709] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T18:53:34.064101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T18:53:34.417622] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-08T18:53:35.217567] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-08T18:53:35.772755] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T18:53:36.017531] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-08T18:53:36.262280] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:53:36.817590] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-08T18:53:37.091685] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T18:53:37.617560] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-08T18:53:38.417618] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-08T18:53:38.877464] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T18:53:38.989737] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T18:53:39.217562] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-08T18:53:39.554621] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T18:53:39.557962] [INFO ] [REMOTE ] FCPT: Full fetch complete (53849 records). [2025-10-08T18:53:39.558104] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-08T18:53:39.944723] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-08T18:53:39.944814] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-08T18:53:39.945594] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-08T18:53:39.945678] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-08T18:53:39.946851] [DEBUG] [LOCAL ] FCPT: Trimmed 53849 records to 37317 (keeping 200 days of data) [2025-10-08T18:53:40.036455] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-08T18:53:40.203732] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T18:53:40.214563] [DEBUG] [LOCAL ] FCPT: Primary data saved (37317 records). [2025-10-08T18:53:40.214711] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-08T18:53:40.214800] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 38.3s. Estimated remaining: 3h 37m 43s. Rate: 7.2 symbols/min [2025-10-08T18:53:40.382587] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:40.409940] [DEBUG] [LOCAL ] FDS: Loaded 26938 existing records from primary storage. [2025-10-08T18:53:40.410221] [INFO ] [MAIN ] FDS: Loaded 26938 existing records. [2025-10-08T18:53:40.585025] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:40.585243] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-08T18:53:40.585289] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-08T18:53:40.585558] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-08T18:53:40.585616] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-08T18:53:40.822594] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-08T18:53:40.953966] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:40.998334] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T18:53:41.617563] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-08T18:53:42.417592] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-08T18:53:42.669096] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T18:53:42.780503] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T18:53:43.179361] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:53:43.217502] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-08T18:53:44.017609] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-08T18:53:44.493847] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T18:53:44.817637] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-08T18:53:44.979540] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T18:53:45.617537] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-08T18:53:46.283994] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T18:53:46.417562] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-08T18:53:46.477869] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T18:53:47.217529] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-08T18:53:47.382092] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T18:53:48.017631] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-08T18:53:48.325055] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:53:48.817556] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-08T18:53:49.617521] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-08T18:53:49.787478] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T18:53:49.968993] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T18:53:50.417565] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-08T18:53:50.742705] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:53:51.208782] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T18:53:51.217494] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-08T18:53:52.017563] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-08T18:53:52.442515] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T18:53:52.817612] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-08T18:53:53.617623] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-08T18:53:54.417513] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-08T18:53:54.721036] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T18:53:54.723394] [INFO ] [REMOTE ] FDP: Full fetch complete (42888 records). [2025-10-08T18:53:54.723502] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-08T18:53:55.107450] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-08T18:53:55.107570] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-08T18:53:55.108359] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-08T18:53:55.108503] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-08T18:53:55.109770] [DEBUG] [LOCAL ] FDP: Trimmed 42888 records to 30061 (keeping 200 days of data) [2025-10-08T18:53:55.238070] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-08T18:53:55.252048] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-08T18:53:55.375579] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T18:53:55.390753] [DEBUG] [LOCAL ] FDP: Primary data saved (30061 records). [2025-10-08T18:53:55.390927] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-08T18:53:55.391033] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FDP took 30.4s. Estimated remaining: 3h 37m 47s. Rate: 7.1 symbols/min [2025-10-08T18:53:55.559899] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:55.613357] [DEBUG] [LOCAL ] FDX: Loaded 51485 existing records from primary storage. [2025-10-08T18:53:55.613737] [INFO ] [MAIN ] FDX: Loaded 51485 existing records. [2025-10-08T18:53:55.741738] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (3.72 seconds). [2025-10-08T18:53:55.782792] [INFO ] [REMOTE ] FCT: Full fetch complete (21171 records). [2025-10-08T18:53:55.806704] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-08T18:53:55.806540] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:55.807087] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-08T18:53:55.807197] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-08T18:53:55.839510] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-08T18:53:55.888892] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-08T18:53:56.024004] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-08T18:53:56.542107] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-08T18:53:56.542695] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-08T18:53:56.560031] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-08T18:53:56.566534] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:56.566689] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-08T18:53:56.567555] [DEBUG] [LOCAL ] FCT: Trimmed 21171 records to 14779 (keeping 200 days of data) [2025-10-08T18:53:56.661395] [DEBUG] [LOCAL ] FCT: Primary data saved (14779 records). [2025-10-08T18:53:56.661560] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-08T18:53:56.661718] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FCT took 44.2s. Estimated remaining: 3h 37m 25s. Rate: 7.2 symbols/min [2025-10-08T18:53:56.825523] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-08T18:53:56.829259] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:53:56.882071] [DEBUG] [LOCAL ] FE: Loaded 53431 existing records from primary storage. [2025-10-08T18:53:56.882419] [INFO ] [MAIN ] FE: Loaded 53431 existing records. [2025-10-08T18:53:57.065211] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:53:57.065436] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-08T18:53:57.065483] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-08T18:53:57.065743] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-08T18:53:57.065803] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-08T18:53:57.442585] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:53:57.458806] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T18:53:57.496606] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-08T18:53:57.617498] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-08T18:53:58.417531] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-08T18:53:58.622681] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T18:53:59.217557] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-08T18:53:59.731149] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-08T18:54:00.017544] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-08T18:54:00.051102] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:54:00.817577] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-08T18:54:00.860440] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T18:54:00.936294] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T18:54:01.617592] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-08T18:54:02.417559] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-08T18:54:02.563877] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T18:54:03.217555] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-08T18:54:03.769328] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-08T18:54:03.774901] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-08T18:54:03.775048] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-08T18:54:04.022281] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-08T18:54:04.189946] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-08T18:54:04.190301] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-08T18:54:04.191420] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-08T18:54:04.201572] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-08T18:54:04.221411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T18:54:04.221560] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 53700 (keeping 200 days of data) [2025-10-08T18:54:04.570408] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T18:54:04.596886] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-10-08T18:54:04.597059] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-08T18:54:04.597164] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FCX took 43.7s. Estimated remaining: 3h 37m 16s. Rate: 7.2 symbols/min [2025-10-08T18:54:04.766614] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:04.766819] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-08T18:54:04.766861] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-08T18:54:04.766976] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-08T18:54:04.767017] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-08T18:54:04.767058] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-08T18:54:04.767088] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-08T18:54:04.830126] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-08T18:54:05.140527] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:05.617544] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-08T18:54:05.704885] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T18:54:06.420266] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-08T18:54:06.423300] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T18:54:07.154441] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T18:54:07.217554] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-08T18:54:08.017561] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-08T18:54:08.260930] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T18:54:08.377228] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T18:54:08.653923] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:54:08.657003] [INFO ] [REMOTE ] FDS: Full fetch complete (38028 records). [2025-10-08T18:54:08.657125] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-08T18:54:08.825197] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-08T18:54:09.069966] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-08T18:54:09.070073] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-08T18:54:09.070735] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-08T18:54:09.070800] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-08T18:54:09.071875] [DEBUG] [LOCAL ] FDS: Trimmed 38028 records to 26941 (keeping 200 days of data) [2025-10-08T18:54:09.256594] [DEBUG] [LOCAL ] FDS: Primary data saved (26941 records). [2025-10-08T18:54:09.256775] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-08T18:54:09.256868] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FDS took 29.0s. Estimated remaining: 3h 37m 1s. Rate: 7.2 symbols/min [2025-10-08T18:54:09.436936] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:09.484232] [DEBUG] [LOCAL ] FERG: Loaded 48782 existing records from primary storage. [2025-10-08T18:54:09.484564] [INFO ] [MAIN ] FERG: Loaded 48782 existing records. [2025-10-08T18:54:09.623341] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-08T18:54:09.665514] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:09.665990] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-08T18:54:09.666047] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-08T18:54:09.666273] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-08T18:54:09.666330] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-08T18:54:10.071250] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:10.132055] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T18:54:10.417528] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-08T18:54:10.488181] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T18:54:10.788534] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T18:54:11.217556] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-08T18:54:12.017559] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-08T18:54:12.440722] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T18:54:12.817530] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-08T18:54:12.909901] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T18:54:13.146770] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-08T18:54:13.617553] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-08T18:54:14.417548] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-08T18:54:15.217525] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-08T18:54:15.393112] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T18:54:15.863532] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:54:16.017519] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-08T18:54:16.817575] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-08T18:54:16.936922] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T18:54:17.348901] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T18:54:17.617508] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-08T18:54:17.693710] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:54:18.417571] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-08T18:54:19.217517] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-08T18:54:19.501091] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T18:54:20.017590] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-08T18:54:20.217316] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T18:54:20.294470] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-08T18:54:20.817531] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-08T18:54:20.992958] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T18:54:21.617587] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-08T18:54:22.382732] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T18:54:22.417584] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-08T18:54:23.217518] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-08T18:54:23.372791] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:54:24.017568] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-08T18:54:24.049695] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T18:54:24.295899] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T18:54:24.817587] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-08T18:54:24.898253] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T18:54:25.177406] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T18:54:25.617540] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-08T18:54:25.998457] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-08T18:54:26.417593] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-08T18:54:27.217562] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-08T18:54:28.017506] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-08T18:54:28.452346] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T18:54:28.817531] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-08T18:54:28.883596] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T18:54:28.888071] [INFO ] [REMOTE ] FE: Full fetch complete (77281 records). [2025-10-08T18:54:28.888216] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-08T18:54:29.276681] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:54:29.297334] [INFO ] [REMOTE ] FENG: Full fetch complete (2258 records). [2025-10-08T18:54:29.297433] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-08T18:54:29.343734] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-08T18:54:29.364735] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-08T18:54:29.365873] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-08T18:54:29.371389] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-08T18:54:29.430887] [DEBUG] [LOCAL ] FE: Trimmed 77281 records to 53433 (keeping 200 days of data) [2025-10-08T18:54:29.486336] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T18:54:29.539245] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T18:54:29.548255] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T18:54:29.574565] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-08T18:54:29.575406] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-08T18:54:29.575720] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-08T18:54:29.576101] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-08T18:54:29.576213] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FENG took 25.0s. Estimated remaining: 3h 37m 15s. Rate: 7.1 symbols/min [2025-10-08T18:54:29.620121] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-08T18:54:29.768983] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:29.789272] [DEBUG] [LOCAL ] FET: Loaded 12791 existing records from primary storage. [2025-10-08T18:54:29.791148] [INFO ] [MAIN ] FET: Loaded 12791 existing records. [2025-10-08T18:54:29.996276] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:29.997448] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-08T18:54:29.997918] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-08T18:54:29.999245] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-08T18:54:30.000282] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-08T18:54:30.324931] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-08T18:54:30.426749] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-08T18:54:30.545228] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:30.649140] [DEBUG] [LOCAL ] FE: Primary data saved (53433 records). [2025-10-08T18:54:30.649302] [INFO ] [MAIN ] FE: Full history saved. [2025-10-08T18:54:30.649446] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FE took 34.0s. Estimated remaining: 3h 36m 53s. Rate: 7.2 symbols/min [2025-10-08T18:54:30.835596] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:30.858396] [DEBUG] [LOCAL ] FF: Loaded 24565 existing records from primary storage. [2025-10-08T18:54:30.858736] [INFO ] [MAIN ] FF: Loaded 24565 existing records. [2025-10-08T18:54:31.035734] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:31.035942] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-08T18:54:31.035988] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-08T18:54:31.036293] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-08T18:54:31.036349] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-08T18:54:31.224091] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-08T18:54:31.390494] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:31.655130] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T18:54:32.017547] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-08T18:54:32.088102] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T18:54:32.150945] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T18:54:32.817601] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-08T18:54:33.385083] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T18:54:33.617491] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-08T18:54:34.006741] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-08T18:54:34.010489] [INFO ] [REMOTE ] FDX: Full fetch complete (74397 records). [2025-10-08T18:54:34.010594] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-08T18:54:34.414319] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T18:54:34.417435] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-08T18:54:34.416813] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-08T18:54:34.418432] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-08T18:54:34.419826] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-08T18:54:34.420021] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-08T18:54:34.421839] [DEBUG] [LOCAL ] FDX: Trimmed 74397 records to 51462 (keeping 200 days of data) [2025-10-08T18:54:34.752294] [DEBUG] [LOCAL ] FDX: Primary data saved (51462 records). [2025-10-08T18:54:34.752433] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-08T18:54:34.753389] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FDX took 39.4s. Estimated remaining: 3h 36m 36s. Rate: 7.2 symbols/min [2025-10-08T18:54:34.927825] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:34.936766] [DEBUG] [LOCAL ] FFA: Loaded 5982 existing records from primary storage. [2025-10-08T18:54:34.937008] [INFO ] [MAIN ] FFA: Loaded 5982 existing records. [2025-10-08T18:54:35.121490] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:35.121903] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-08T18:54:35.122150] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-08T18:54:35.130371] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-08T18:54:35.131011] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-08T18:54:35.131323] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T18:54:35.222697] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-08T18:54:35.489515] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:36.017620] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-08T18:54:36.162716] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T18:54:36.619457] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T18:54:36.817740] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-08T18:54:37.499608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T18:54:37.617559] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-08T18:54:38.417552] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-08T18:54:38.457949] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T18:54:39.217517] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-08T18:54:39.353320] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T18:54:39.674447] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T18:54:40.017533] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-08T18:54:40.817563] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-08T18:54:40.888547] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T18:54:41.602896] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T18:54:41.617503] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-08T18:54:42.417556] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-08T18:54:42.510452] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T18:54:43.217512] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-08T18:54:43.251130] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T18:54:44.017520] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-08T18:54:44.134821] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T18:54:44.817573] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-08T18:54:45.617507] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-08T18:54:45.885530] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T18:54:46.289828] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T18:54:46.352448] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T18:54:46.417507] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-08T18:54:47.217588] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-08T18:54:47.669168] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:54:47.962328] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T18:54:48.017510] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-08T18:54:48.817571] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-08T18:54:49.550450] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:54:49.617518] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-08T18:54:49.801322] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T18:54:50.417549] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-08T18:54:50.992696] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T18:54:51.217512] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-08T18:54:51.317458] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T18:54:51.964532] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T18:54:51.966051] [INFO ] [REMOTE ] FET: Full fetch complete (18288 records). [2025-10-08T18:54:51.966125] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-08T18:54:52.027036] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-08T18:54:52.337659] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-08T18:54:52.337756] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-08T18:54:52.338174] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-08T18:54:52.338214] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-08T18:54:52.338875] [DEBUG] [LOCAL ] FET: Trimmed 18288 records to 12811 (keeping 200 days of data) [2025-10-08T18:54:52.414393] [DEBUG] [LOCAL ] FET: Primary data saved (12811 records). [2025-10-08T18:54:52.414542] [INFO ] [MAIN ] FET: Full history saved. [2025-10-08T18:54:52.414662] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FET took 22.8s. Estimated remaining: 3h 36m 45s. Rate: 7.2 symbols/min [2025-10-08T18:54:52.587303] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:54:52.605947] [DEBUG] [LOCAL ] FFC: Loaded 16682 existing records from primary storage. [2025-10-08T18:54:52.606204] [INFO ] [MAIN ] FFC: Loaded 16682 existing records. [2025-10-08T18:54:52.781662] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:54:52.781941] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-08T18:54:52.782001] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-08T18:54:52.782216] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-08T18:54:52.782311] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-08T18:54:52.823555] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-08T18:54:53.146700] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:54:53.179212] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T18:54:53.617628] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-08T18:54:54.417520] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-08T18:54:54.437780] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T18:54:54.533204] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T18:54:55.217560] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-08T18:54:55.307248] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T18:54:56.017573] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-08T18:54:56.817552] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-08T18:54:56.943334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T18:54:56.946524] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T18:54:57.292345] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:54:57.617585] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-08T18:54:58.417548] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-08T18:54:59.217517] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-08T18:54:59.354411] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T18:54:59.358591] [INFO ] [REMOTE ] FERG: Full fetch complete (70870 records). [2025-10-08T18:54:59.358750] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-08T18:54:59.552116] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T18:54:59.779982] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-08T18:54:59.780179] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-08T18:54:59.781101] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-08T18:54:59.781164] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-08T18:54:59.782567] [DEBUG] [LOCAL ] FERG: Trimmed 70870 records to 48754 (keeping 200 days of data) [2025-10-08T18:55:00.021339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-08T18:55:00.031334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T18:55:00.118494] [DEBUG] [LOCAL ] FERG: Primary data saved (48754 records). [2025-10-08T18:55:00.118702] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-08T18:55:00.118830] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FERG took 50.9s. Estimated remaining: 3h 36m 36s. Rate: 7.2 symbols/min [2025-10-08T18:55:00.287827] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:00.319979] [DEBUG] [LOCAL ] FFWM: Loaded 35834 existing records from primary storage. [2025-10-08T18:55:00.320266] [INFO ] [MAIN ] FFWM: Loaded 35834 existing records. [2025-10-08T18:55:00.495267] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:00.495499] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-08T18:55:00.495546] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-08T18:55:00.495810] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-08T18:55:00.495869] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-08T18:55:00.603819] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:55:00.824993] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-08T18:55:00.856073] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:01.407044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T18:55:01.617553] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-08T18:55:02.417559] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-08T18:55:02.987142] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T18:55:03.204510] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T18:55:03.217501] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-08T18:55:04.017550] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-08T18:55:04.343603] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T18:55:04.585818] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T18:55:04.817569] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-08T18:55:05.617563] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-08T18:55:05.853222] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T18:55:06.417603] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-08T18:55:06.790293] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T18:55:06.792142] [INFO ] [REMOTE ] FF: Full fetch complete (36593 records). [2025-10-08T18:55:06.792215] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-08T18:55:07.163157] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-08T18:55:07.163237] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-08T18:55:07.163972] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-08T18:55:07.164051] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-08T18:55:07.165177] [DEBUG] [LOCAL ] FF: Trimmed 36593 records to 24514 (keeping 200 days of data) [2025-10-08T18:55:07.223594] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-08T18:55:07.311954] [DEBUG] [LOCAL ] FF: Primary data saved (24514 records). [2025-10-08T18:55:07.312096] [INFO ] [MAIN ] FF: Full history saved. [2025-10-08T18:55:07.312183] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FF took 36.7s. Estimated remaining: 3h 36m 25s. Rate: 7.2 symbols/min [2025-10-08T18:55:07.484970] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:07.508855] [DEBUG] [LOCAL ] FG: Loaded 22959 existing records from primary storage. [2025-10-08T18:55:07.509138] [INFO ] [MAIN ] FG: Loaded 22959 existing records. [2025-10-08T18:55:07.696498] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:07.696713] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-08T18:55:07.696768] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-08T18:55:07.696993] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-08T18:55:07.697050] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-08T18:55:07.906630] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T18:55:08.018854] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-08T18:55:08.018747] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T18:55:08.110111] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:08.817542] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-08T18:55:09.439923] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T18:55:09.515391] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:55:09.617539] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-08T18:55:10.232720] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T18:55:10.417536] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-08T18:55:11.217557] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-08T18:55:11.454830] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T18:55:12.017543] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-08T18:55:12.292949] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T18:55:12.817536] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-08T18:55:13.483317] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T18:55:13.617529] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-08T18:55:13.876895] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T18:55:14.417590] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-08T18:55:14.646240] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:55:15.217626] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-08T18:55:15.459428] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T18:55:16.017549] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-08T18:55:16.596535] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T18:55:16.753306] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:55:16.817545] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-08T18:55:17.617615] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-08T18:55:17.780429] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T18:55:17.781998] [INFO ] [REMOTE ] FFC: Full fetch complete (24650 records). [2025-10-08T18:55:17.782072] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-08T18:55:18.149133] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-08T18:55:18.149216] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-08T18:55:18.149891] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-08T18:55:18.149955] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-08T18:55:18.150621] [DEBUG] [LOCAL ] FFC: Trimmed 24650 records to 16723 (keeping 200 days of data) [2025-10-08T18:55:18.230221] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T18:55:18.232791] [INFO ] [REMOTE ] FFA: Full fetch complete (8709 records). [2025-10-08T18:55:18.232892] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-08T18:55:18.434321] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-08T18:55:18.628441] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-08T18:55:18.628818] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-08T18:55:18.629404] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-08T18:55:18.629741] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-08T18:55:18.631069] [DEBUG] [LOCAL ] FFA: Trimmed 8709 records to 6060 (keeping 200 days of data) [2025-10-08T18:55:18.676539] [DEBUG] [LOCAL ] FFC: Primary data saved (16723 records). [2025-10-08T18:55:18.677205] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-08T18:55:18.677345] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FFC took 26.3s. Estimated remaining: 3h 36m 22s. Rate: 7.1 symbols/min [2025-10-08T18:55:18.788594] [DEBUG] [LOCAL ] FFA: Primary data saved (6060 records). [2025-10-08T18:55:18.794621] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-08T18:55:18.810328] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFA took 44.1s. Estimated remaining: 3h 35m 58s. Rate: 7.2 symbols/min [2025-10-08T18:55:18.992183] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:19.073263] [DEBUG] [LOCAL ] FGN: Loaded 3819 existing records from primary storage. [2025-10-08T18:55:19.090793] [INFO ] [MAIN ] FGN: Loaded 3819 existing records. [2025-10-08T18:55:19.092300] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:19.136554] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-08T18:55:19.158158] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-08T18:55:19.170022] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-08T18:55:19.175215] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-08T18:55:19.198440] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-08T18:55:19.198546] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-08T18:55:19.229449] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-08T18:55:19.389635] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:19.392411] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-08T18:55:19.392484] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-08T18:55:19.392901] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-08T18:55:19.403530] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-08T18:55:19.974059] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:20.026095] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-08T18:55:20.070326] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:20.090182] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:55:20.190391] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T18:55:20.290300] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:55:20.290870] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-08T18:55:20.291002] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:20.291091] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-08T18:55:20.291169] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:20.291265] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-08T18:55:20.291388] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-08T18:55:20.291463] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-08T18:55:20.291523] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-08T18:55:20.291612] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FGSN took 1.5s. Estimated remaining: 3h 35m 37s. Rate: 7.2 symbols/min [2025-10-08T18:55:20.462869] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:20.501381] [DEBUG] [LOCAL ] FHI: Loaded 39965 existing records from primary storage. [2025-10-08T18:55:20.501711] [INFO ] [MAIN ] FHI: Loaded 39965 existing records. [2025-10-08T18:55:20.681805] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:20.682076] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-08T18:55:20.682129] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-08T18:55:20.682402] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-08T18:55:20.682459] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-08T18:55:20.822770] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-08T18:55:21.040270] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:21.492900] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T18:55:21.617590] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-08T18:55:22.417548] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-08T18:55:22.710507] [DEBUG] [REMOTE ] FHI: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-08T18:55:22.710869] [WARN ] [REMOTE ] FHI: No data returned for month 2024-12 [2025-10-08T18:55:22.710959] [FATAL] [REMOTE ] FHI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:22.711010] [FATAL] [MAIN ] FHI: Failed to fetch primary data. [2025-10-08T18:55:22.711044] [WARN ] [MAIN ] FHI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:22.711080] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-08T18:55:22.711135] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-08T18:55:22.711169] [INFO ] [LOCAL ] FHI: Starting deletion of derivative data. [2025-10-08T18:55:22.711446] [DEBUG] [LOCAL ] FHI: Deleted derivative data file. [2025-10-08T18:55:22.711544] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FHI took 2.4s. Estimated remaining: 3h 35m 17s. Rate: 7.2 symbols/min [2025-10-08T18:55:22.877582] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T18:55:22.904808] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:22.959595] [DEBUG] [LOCAL ] FHN: Loaded 53368 existing records from primary storage. [2025-10-08T18:55:22.959974] [INFO ] [MAIN ] FHN: Loaded 53368 existing records. [2025-10-08T18:55:23.143310] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:23.143511] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-08T18:55:23.143559] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-08T18:55:23.143851] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-08T18:55:23.143911] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-08T18:55:23.222705] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-08T18:55:23.506346] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:23.848715] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T18:55:24.017588] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-08T18:55:24.594462] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T18:55:24.817590] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-08T18:55:25.617567] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-08T18:55:26.292009] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T18:55:26.417570] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-08T18:55:26.941933] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:55:26.954719] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T18:55:27.217592] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-08T18:55:28.017552] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-08T18:55:28.309542] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T18:55:28.467639] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T18:55:28.817554] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-08T18:55:29.617534] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-08T18:55:30.002139] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T18:55:30.174771] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T18:55:30.417597] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-08T18:55:31.198714] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T18:55:31.217531] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-08T18:55:32.017560] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-08T18:55:32.330598] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T18:55:32.574686] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T18:55:32.817580] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-08T18:55:33.499160] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T18:55:33.617605] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-08T18:55:34.417570] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-08T18:55:35.062871] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T18:55:35.217544] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-08T18:55:35.427969] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T18:55:35.768894] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T18:55:36.017545] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-08T18:55:36.817587] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-08T18:55:37.098979] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T18:55:37.348822] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T18:55:37.617554] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-08T18:55:38.400172] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T18:55:38.402479] [INFO ] [REMOTE ] FG: Full fetch complete (28066 records). [2025-10-08T18:55:38.402568] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-08T18:55:38.425117] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-08T18:55:38.791117] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-08T18:55:38.791213] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-08T18:55:38.791739] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-08T18:55:38.791802] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-08T18:55:38.792509] [DEBUG] [LOCAL ] FG: Trimmed 28066 records to 22742 (keeping 200 days of data) [2025-10-08T18:55:38.946726] [DEBUG] [LOCAL ] FG: Primary data saved (22742 records). [2025-10-08T18:55:38.946864] [INFO ] [MAIN ] FG: Full history saved. [2025-10-08T18:55:38.946950] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FG took 31.6s. Estimated remaining: 3h 35m 24s. Rate: 7.2 symbols/min [2025-10-08T18:55:39.112447] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:39.164989] [DEBUG] [LOCAL ] FI: Loaded 53526 existing records from primary storage. [2025-10-08T18:55:39.165350] [INFO ] [MAIN ] FI: Loaded 53526 existing records. [2025-10-08T18:55:39.227769] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-08T18:55:39.351508] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:39.352094] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-08T18:55:39.352156] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-08T18:55:39.352567] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-08T18:55:39.352626] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-08T18:55:39.713435] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:39.802333] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T18:55:40.017537] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-08T18:55:40.185784] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T18:55:40.591802] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T18:55:40.592592] [INFO ] [REMOTE ] FGN: Full fetch complete (5686 records). [2025-10-08T18:55:40.592686] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-08T18:55:40.823738] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-08T18:55:40.952766] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-08T18:55:40.952849] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-08T18:55:40.953009] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-08T18:55:40.953047] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-08T18:55:40.953412] [DEBUG] [LOCAL ] FGN: Trimmed 5686 records to 3793 (keeping 200 days of data) [2025-10-08T18:55:40.977501] [DEBUG] [LOCAL ] FGN: Primary data saved (3793 records). [2025-10-08T18:55:40.977659] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-08T18:55:40.977770] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FGN took 22.3s. Estimated remaining: 3h 35m 4s. Rate: 7.2 symbols/min [2025-10-08T18:55:41.163548] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:41.187139] [DEBUG] [LOCAL ] FICO: Loaded 21194 existing records from primary storage. [2025-10-08T18:55:41.187442] [INFO ] [MAIN ] FICO: Loaded 21194 existing records. [2025-10-08T18:55:41.373858] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:41.374112] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-08T18:55:41.374160] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-08T18:55:41.374417] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-08T18:55:41.374475] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-08T18:55:41.623086] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-08T18:55:41.755760] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:41.920084] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T18:55:42.417597] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-08T18:55:43.217532] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-08T18:55:43.433324] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T18:55:43.674888] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T18:55:43.677786] [INFO ] [REMOTE ] FFWM: Full fetch complete (51873 records). [2025-10-08T18:55:43.677875] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-08T18:55:44.026976] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-08T18:55:44.064577] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T18:55:44.086692] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-08T18:55:44.086790] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-08T18:55:44.087526] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-08T18:55:44.087568] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-08T18:55:44.088823] [DEBUG] [LOCAL ] FFWM: Trimmed 51873 records to 35821 (keeping 200 days of data) [2025-10-08T18:55:44.290324] [DEBUG] [LOCAL ] FFWM: Primary data saved (35821 records). [2025-10-08T18:55:44.290504] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-08T18:55:44.290595] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FFWM took 44.2s. Estimated remaining: 3h 34m 46s. Rate: 7.2 symbols/min [2025-10-08T18:55:44.462068] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:44.462270] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-08T18:55:44.462307] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-08T18:55:44.462454] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-08T18:55:44.462494] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-08T18:55:44.462535] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-08T18:55:44.462566] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-08T18:55:44.817162] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:44.817519] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-08T18:55:45.083311] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-08T18:55:45.617622] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-08T18:55:45.860264] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-08T18:55:45.906835] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T18:55:46.417579] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-08T18:55:46.739136] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T18:55:47.217597] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-08T18:55:47.457466] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-08T18:55:48.017544] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-08T18:55:48.817577] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-08T18:55:49.138182] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T18:55:49.617549] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-08T18:55:50.294496] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T18:55:50.417732] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-08T18:55:50.697342] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T18:55:51.217559] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-08T18:55:51.625168] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T18:55:52.017561] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-08T18:55:52.394008] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T18:55:52.618527] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-08T18:55:52.817557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-08T18:55:53.617558] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-08T18:55:53.816572] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:55:53.816949] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-08T18:55:53.817038] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:55:53.817117] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-08T18:55:53.817154] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:55:53.817219] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-08T18:55:53.817283] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-08T18:55:53.817337] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-08T18:55:53.817399] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-08T18:55:53.817469] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FIG took 9.5s. Estimated remaining: 3h 34m 40s. Rate: 7.2 symbols/min [2025-10-08T18:55:53.990781] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:55:54.040173] [DEBUG] [LOCAL ] FIGS: Loaded 48805 existing records from primary storage. [2025-10-08T18:55:54.040557] [INFO ] [MAIN ] FIGS: Loaded 48805 existing records. [2025-10-08T18:55:54.225903] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:55:54.226177] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-08T18:55:54.226239] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-08T18:55:54.226499] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-08T18:55:54.226557] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-08T18:55:54.422701] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-08T18:55:54.593139] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:55:54.622995] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:55:55.217631] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-08T18:55:56.017557] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-08T18:55:56.363179] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T18:55:56.694486] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:55:56.817562] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-08T18:55:57.562201] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:55:57.617540] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-08T18:55:58.417531] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-08T18:55:58.825849] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T18:55:58.907132] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T18:55:59.145410] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:55:59.217603] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-08T18:56:00.017591] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-08T18:56:00.817562] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-08T18:56:01.455345] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-08T18:56:01.617566] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-08T18:56:01.676168] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T18:56:01.820726] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T18:56:02.417562] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-08T18:56:02.913484] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T18:56:03.217564] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-08T18:56:03.851287] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T18:56:04.017566] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-08T18:56:04.817592] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-08T18:56:05.296732] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T18:56:05.560013] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T18:56:05.617522] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-08T18:56:05.917920] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:56:06.417567] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-08T18:56:07.217525] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-08T18:56:07.338592] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T18:56:08.017552] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-08T18:56:08.356628] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T18:56:08.393379] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T18:56:08.817557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-08T18:56:09.432369] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T18:56:09.617544] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-08T18:56:10.417516] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-08T18:56:10.955124] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T18:56:11.217557] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-08T18:56:11.534991] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T18:56:11.833832] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T18:56:12.017630] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-08T18:56:12.527621] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T18:56:12.779949] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T18:56:12.783932] [INFO ] [REMOTE ] FI: Full fetch complete (77215 records). [2025-10-08T18:56:12.784067] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-08T18:56:12.822689] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-08T18:56:13.199693] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-08T18:56:13.199813] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-08T18:56:13.200997] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-08T18:56:13.201075] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-08T18:56:13.202706] [DEBUG] [LOCAL ] FI: Trimmed 77215 records to 53534 (keeping 200 days of data) [2025-10-08T18:56:13.534162] [DEBUG] [LOCAL ] FI: Primary data saved (53534 records). [2025-10-08T18:56:13.534308] [INFO ] [MAIN ] FI: Full history saved. [2025-10-08T18:56:13.534394] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FI took 34.6s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-08T18:56:13.623565] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-08T18:56:13.705576] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:13.742664] [DEBUG] [LOCAL ] FIHL: Loaded 39681 existing records from primary storage. [2025-10-08T18:56:13.742971] [INFO ] [MAIN ] FIHL: Loaded 39681 existing records. [2025-10-08T18:56:13.916976] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:13.917204] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-08T18:56:13.917268] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-08T18:56:13.917512] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-08T18:56:13.917571] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-08T18:56:14.279282] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:14.417539] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-08T18:56:14.550595] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T18:56:15.217618] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-08T18:56:15.385920] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T18:56:15.391380] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-08T18:56:15.391557] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-08T18:56:15.744889] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T18:56:15.834815] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-08T18:56:15.834901] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-08T18:56:15.835890] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-08T18:56:15.835953] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-08T18:56:15.837455] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53373 (keeping 200 days of data) [2025-10-08T18:56:16.018849] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-08T18:56:16.168105] [DEBUG] [LOCAL ] FHN: Primary data saved (53373 records). [2025-10-08T18:56:16.168240] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-08T18:56:16.168335] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FHN took 53.5s. Estimated remaining: 3h 34m 33s. Rate: 7.2 symbols/min [2025-10-08T18:56:16.340877] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:16.352104] [DEBUG] [LOCAL ] FINS: Loaded 8266 existing records from primary storage. [2025-10-08T18:56:16.352343] [INFO ] [MAIN ] FINS: Loaded 8266 existing records. [2025-10-08T18:56:16.534073] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:16.534322] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-08T18:56:16.534384] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-08T18:56:16.534545] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-08T18:56:16.534601] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-08T18:56:16.839299] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-08T18:56:16.894062] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:16.966347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T18:56:17.060676] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T18:56:17.617543] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-08T18:56:17.782146] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:56:18.417581] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-08T18:56:18.614071] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T18:56:19.217686] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-08T18:56:19.753575] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T18:56:20.017578] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-08T18:56:20.438232] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T18:56:20.817608] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-08T18:56:20.993545] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T18:56:20.996421] [INFO ] [REMOTE ] FICO: Full fetch complete (29345 records). [2025-10-08T18:56:20.996613] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-08T18:56:21.361823] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-08T18:56:21.361909] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-08T18:56:21.362458] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-08T18:56:21.362524] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-08T18:56:21.363340] [DEBUG] [LOCAL ] FICO: Trimmed 29345 records to 21409 (keeping 200 days of data) [2025-10-08T18:56:21.497546] [DEBUG] [LOCAL ] FICO: Primary data saved (21409 records). [2025-10-08T18:56:21.497700] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-08T18:56:21.497796] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FICO took 40.5s. Estimated remaining: 3h 34m 19s. Rate: 7.2 symbols/min [2025-10-08T18:56:21.622696] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-08T18:56:21.676761] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:21.719356] [DEBUG] [LOCAL ] FINV: Loaded 45208 existing records from primary storage. [2025-10-08T18:56:21.719751] [INFO ] [MAIN ] FINV: Loaded 45208 existing records. [2025-10-08T18:56:21.897998] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:21.898247] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-08T18:56:21.898295] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-08T18:56:21.898517] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-08T18:56:21.898573] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-08T18:56:22.261509] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:22.292312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T18:56:22.417544] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-08T18:56:22.440397] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T18:56:23.217554] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-08T18:56:23.839424] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T18:56:24.017567] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-08T18:56:24.486504] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T18:56:24.518339] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:56:24.817707] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-08T18:56:25.617549] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-08T18:56:26.358390] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T18:56:26.387178] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T18:56:26.417517] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-08T18:56:27.217575] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-08T18:56:28.017566] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-08T18:56:28.155445] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T18:56:28.588803] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T18:56:28.817586] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-08T18:56:29.280439] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T18:56:29.617585] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-08T18:56:30.134246] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T18:56:30.417576] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-08T18:56:31.125064] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T18:56:31.217504] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-08T18:56:31.786813] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T18:56:31.791306] [INFO ] [REMOTE ] FIGS: Full fetch complete (70870 records). [2025-10-08T18:56:31.791521] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-08T18:56:32.025336] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-08T18:56:32.221794] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-08T18:56:32.221873] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-08T18:56:32.222739] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-08T18:56:32.222801] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-08T18:56:32.224141] [DEBUG] [LOCAL ] FIGS: Trimmed 70870 records to 48743 (keeping 200 days of data) [2025-10-08T18:56:32.449555] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T18:56:32.539032] [DEBUG] [LOCAL ] FIGS: Primary data saved (48743 records). [2025-10-08T18:56:32.539220] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-08T18:56:32.539338] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 38.7s. Estimated remaining: 3h 34m 16s. Rate: 7.2 symbols/min [2025-10-08T18:56:32.711449] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:32.718744] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:56:32.770227] [DEBUG] [LOCAL ] FIS: Loaded 53356 existing records from primary storage. [2025-10-08T18:56:32.770595] [INFO ] [MAIN ] FIS: Loaded 53356 existing records. [2025-10-08T18:56:32.822687] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-08T18:56:32.949285] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:32.949537] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-08T18:56:32.949611] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-08T18:56:32.949989] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-08T18:56:32.950070] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-08T18:56:33.303093] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:33.617507] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-08T18:56:34.410552] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T18:56:34.419131] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-08T18:56:34.691919] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T18:56:35.118343] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T18:56:35.217523] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-08T18:56:36.017561] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-08T18:56:36.451525] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:56:36.481536] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T18:56:36.817560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-08T18:56:37.582565] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T18:56:37.617517] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-08T18:56:38.417627] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-08T18:56:39.080578] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T18:56:39.217170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:56:39.224560] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-08T18:56:39.965750] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T18:56:40.017584] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-08T18:56:40.817613] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-08T18:56:41.440175] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T18:56:41.441264] [INFO ] [REMOTE ] FINS: Full fetch complete (11948 records). [2025-10-08T18:56:41.441355] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-08T18:56:41.621137] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-08T18:56:41.847718] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-08T18:56:41.847905] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-08T18:56:41.848250] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-08T18:56:41.848328] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-08T18:56:41.849027] [DEBUG] [LOCAL ] FINS: Trimmed 11948 records to 8304 (keeping 200 days of data) [2025-10-08T18:56:41.923502] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T18:56:41.945115] [DEBUG] [LOCAL ] FINS: Primary data saved (8304 records). [2025-10-08T18:56:41.945251] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-08T18:56:41.945333] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINS took 25.8s. Estimated remaining: 3h 34m 9s. Rate: 7.2 symbols/min [2025-10-08T18:56:42.128181] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:56:42.159414] [DEBUG] [LOCAL ] FIX: Loaded 29405 existing records from primary storage. [2025-10-08T18:56:42.159862] [INFO ] [MAIN ] FIX: Loaded 29405 existing records. [2025-10-08T18:56:42.338943] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:56:42.339191] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-08T18:56:42.339252] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-08T18:56:42.339502] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-08T18:56:42.339559] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-08T18:56:42.422690] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-08T18:56:42.694532] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:56:43.217519] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-08T18:56:43.326687] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T18:56:43.979517] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T18:56:44.017518] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-08T18:56:44.494462] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T18:56:44.817545] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-08T18:56:45.487555] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T18:56:45.490815] [INFO ] [REMOTE ] FIHL: Full fetch complete (56062 records). [2025-10-08T18:56:45.490924] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-08T18:56:45.631112] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-08T18:56:45.881008] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-08T18:56:45.881134] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-08T18:56:45.881910] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-08T18:56:45.881973] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-08T18:56:45.883152] [DEBUG] [LOCAL ] FIHL: Trimmed 56062 records to 39645 (keeping 200 days of data) [2025-10-08T18:56:46.128063] [DEBUG] [LOCAL ] FIHL: Primary data saved (39645 records). [2025-10-08T18:56:46.128199] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-08T18:56:46.128317] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 32.6s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-08T18:56:46.417511] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-08T18:56:46.619111] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T18:56:46.814272] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T18:56:47.217565] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-08T18:56:47.500387] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T18:56:48.017555] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-08T18:56:48.817574] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-08T18:56:49.192956] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:56:49.226693] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T18:56:49.617605] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-08T18:56:49.833953] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T18:56:50.417536] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-08T18:56:51.127411] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T18:56:51.217511] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-08T18:56:52.017527] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-08T18:56:52.181907] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:56:52.817518] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-08T18:56:52.945606] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T18:56:53.290102] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T18:56:53.617557] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-08T18:56:54.417557] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-08T18:56:54.603742] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T18:56:54.847713] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T18:56:55.217554] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-08T18:56:56.017524] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-08T18:56:56.326127] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T18:56:56.797566] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T18:56:56.817496] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-08T18:56:57.267894] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T18:56:57.617549] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-08T18:56:58.254202] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T18:56:58.257846] [INFO ] [REMOTE ] FINV: Full fetch complete (63780 records). [2025-10-08T18:56:58.257946] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-08T18:56:58.430386] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-08T18:56:58.671942] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-08T18:56:58.672091] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-08T18:56:58.673061] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-08T18:56:58.673250] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-08T18:56:58.674639] [DEBUG] [LOCAL ] FINV: Trimmed 63780 records to 45214 (keeping 200 days of data) [2025-10-08T18:56:58.894695] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T18:56:58.963551] [DEBUG] [LOCAL ] FINV: Primary data saved (45214 records). [2025-10-08T18:56:58.963746] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-08T18:56:58.963844] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINV took 37.5s. Estimated remaining: 3h 33m 53s. Rate: 7.2 symbols/min [2025-10-08T18:56:59.217553] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-08T18:57:00.237324] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T18:57:00.250506] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-08T18:57:00.428377] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:57:00.817557] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-08T18:57:01.968695] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T18:57:01.975906] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-08T18:57:02.248562] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T18:57:02.417544] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-08T18:57:03.377151] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T18:57:03.383244] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-08T18:57:03.977980] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T18:57:03.981965] [INFO ] [REMOTE ] FIS: Full fetch complete (77179 records). [2025-10-08T18:57:03.982078] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-08T18:57:04.372234] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-08T18:57:04.372317] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-08T18:57:04.373232] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-08T18:57:04.373296] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-08T18:57:04.374720] [DEBUG] [LOCAL ] FIS: Trimmed 77179 records to 53350 (keeping 200 days of data) [2025-10-08T18:57:04.586635] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T18:57:04.633149] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-08T18:57:04.735841] [DEBUG] [LOCAL ] FIS: Primary data saved (53350 records). [2025-10-08T18:57:04.736004] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-08T18:57:04.736111] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIS took 32.2s. Estimated remaining: 3h 33m 40s. Rate: 7.2 symbols/min [2025-10-08T18:57:05.857482] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T18:57:05.859902] [INFO ] [REMOTE ] FIX: Full fetch complete (45343 records). [2025-10-08T18:57:05.859990] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-08T18:57:06.244940] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-08T18:57:06.245032] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-08T18:57:06.245715] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-08T18:57:06.245778] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-08T18:57:06.246830] [DEBUG] [LOCAL ] FIX: Trimmed 45343 records to 29294 (keeping 200 days of data) [2025-10-08T18:57:06.427973] [DEBUG] [LOCAL ] FIX: Primary data saved (29294 records). [2025-10-08T18:57:06.428116] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-08T18:57:06.428203] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIX took 24.5s. Estimated remaining: 3h 33m 20s. Rate: 7.2 symbols/min [2025-10-08T18:57:06.949290] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.066694] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.173983] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.176835] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:07.177051] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-08T18:57:07.177278] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-08T18:57:07.177895] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-08T18:57:07.177963] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-08T18:57:07.178057] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-08T18:57:07.178130] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-08T18:57:07.223016] [DEBUG] [LOCAL ] FLC: Loaded 5372 existing records from primary storage. [2025-10-08T18:57:07.254228] [INFO ] [MAIN ] FLC: Loaded 5372 existing records. [2025-10-08T18:57:07.548121] [DEBUG] [LOCAL ] FLG: Loaded 53331 existing records from primary storage. [2025-10-08T18:57:07.584492] [DEBUG] [LOCAL ] FLNG: Loaded 33596 existing records from primary storage. [2025-10-08T18:57:07.639052] [INFO ] [MAIN ] FLG: Loaded 53331 existing records. [2025-10-08T18:57:07.633792] [INFO ] [MAIN ] FLNG: Loaded 33596 existing records. [2025-10-08T18:57:07.900472] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.014669] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.032121] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-08T18:57:08.080152] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-08T18:57:08.085487] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-08T18:57:08.281164] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:08.307905] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.367167] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:08.367556] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-08T18:57:08.367807] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.384764] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-08T18:57:08.397488] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-08T18:57:08.402806] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-08T18:57:08.413435] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-08T18:57:08.408258] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-08T18:57:08.418774] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-08T18:57:08.429206] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-08T18:57:08.771246] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:57:08.813602] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-08T18:57:08.840265] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:57:08.858134] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-08T18:57:08.929002] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:57:09.008727] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-08T18:57:09.072925] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-08T18:57:09.128253] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-08T18:57:09.131336] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.194313] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-08T18:57:09.225435] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-08T18:57:09.270379] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 2.8s. Estimated remaining: 3h 33m 1s. Rate: 7.2 symbols/min [2025-10-08T18:57:09.536879] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.574900] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:09.588986] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-08T18:57:09.588767] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-08T18:57:09.690863] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:09.743396] [DEBUG] [LOCAL ] FLO: Loaded 51949 existing records from primary storage. [2025-10-08T18:57:09.743782] [INFO ] [MAIN ] FLO: Loaded 51949 existing records. [2025-10-08T18:57:09.928553] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:09.928848] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-08T18:57:09.928897] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-08T18:57:09.929245] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-08T18:57:09.929307] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-08T18:57:10.037177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:57:10.050150] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-08T18:57:10.292320] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:10.292714] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-08T18:57:10.723918] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T18:57:10.725842] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-08T18:57:11.164055] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T18:57:11.166084] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-08T18:57:11.188844] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T18:57:11.221261] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-08T18:57:11.226881] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T18:57:11.664530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T18:57:11.925894] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:57:12.017514] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-08T18:57:12.452603] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T18:57:12.817594] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-08T18:57:13.446968] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T18:57:13.477831] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T18:57:13.617529] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-08T18:57:14.417597] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-08T18:57:15.017143] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T18:57:15.074939] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T18:57:15.217547] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-08T18:57:16.017573] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-08T18:57:16.817515] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-08T18:57:16.874567] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T18:57:17.458798] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T18:57:17.591735] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T18:57:17.617522] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-08T18:57:18.417581] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-08T18:57:18.884933] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T18:57:19.217548] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-08T18:57:19.925708] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T18:57:20.017496] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-08T18:57:20.705635] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:57:20.817511] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-08T18:57:21.617589] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-08T18:57:21.886504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:57:21.920898] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T18:57:22.233965] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T18:57:22.417590] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-08T18:57:23.217530] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-08T18:57:23.834712] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T18:57:24.017565] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-08T18:57:24.719078] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T18:57:24.817512] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-08T18:57:25.531153] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T18:57:25.617493] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-08T18:57:26.417566] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-08T18:57:26.598544] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T18:57:26.818288] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:57:26.910615] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T18:57:27.217603] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-08T18:57:28.017632] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-08T18:57:28.598662] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T18:57:28.817565] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-08T18:57:28.861861] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:57:29.617561] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-08T18:57:30.242702] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T18:57:30.243539] [INFO ] [REMOTE ] FLC: Full fetch complete (7808 records). [2025-10-08T18:57:30.243611] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-08T18:57:30.419160] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-08T18:57:30.507270] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T18:57:30.753305] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-08T18:57:30.753452] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-08T18:57:30.753968] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-08T18:57:30.754052] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-08T18:57:30.755015] [DEBUG] [LOCAL ] FLC: Trimmed 7808 records to 5366 (keeping 200 days of data) [2025-10-08T18:57:30.801250] [DEBUG] [LOCAL ] FLC: Primary data saved (5366 records). [2025-10-08T18:57:30.801425] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-08T18:57:30.801557] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 24.4s. Estimated remaining: 3h 33m 17s. Rate: 7.2 symbols/min [2025-10-08T18:57:31.039443] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:31.039676] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-08T18:57:31.039811] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-08T18:57:31.039942] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-08T18:57:31.040006] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-08T18:57:31.040082] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-08T18:57:31.040139] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-08T18:57:31.222892] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-08T18:57:31.591083] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:31.976895] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T18:57:32.017569] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-08T18:57:32.229360] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T18:57:32.229725] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-08T18:57:32.229829] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T18:57:32.229907] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-08T18:57:32.229974] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T18:57:32.230045] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-08T18:57:32.230123] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-08T18:57:32.230180] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-08T18:57:32.230225] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-08T18:57:32.230276] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLOC took 1.4s. Estimated remaining: 3h 32m 56s. Rate: 7.2 symbols/min [2025-10-08T18:57:32.410729] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:32.408370] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T18:57:32.413992] [INFO ] [REMOTE ] FLNG: Full fetch complete (50284 records). [2025-10-08T18:57:32.414175] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-08T18:57:32.751516] [DEBUG] [LOCAL ] FLR: Loaded 53161 existing records from primary storage. [2025-10-08T18:57:32.772618] [INFO ] [MAIN ] FLR: Loaded 53161 existing records. [2025-10-08T18:57:32.821867] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-08T18:57:32.962461] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-08T18:57:32.962613] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-08T18:57:32.963750] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-08T18:57:32.964166] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-08T18:57:33.024719] [DEBUG] [LOCAL ] FLNG: Trimmed 50284 records to 33564 (keeping 200 days of data) [2025-10-08T18:57:33.047992] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:33.048502] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-08T18:57:33.048561] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-08T18:57:33.048919] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-08T18:57:33.048979] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-08T18:57:33.623928] [DEBUG] [LOCAL ] FLNG: Primary data saved (33564 records). [2025-10-08T18:57:33.629763] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-08T18:57:33.629928] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLNG took 27.2s. Estimated remaining: 3h 32m 35s. Rate: 7.2 symbols/min [2025-10-08T18:57:33.629622] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-08T18:57:33.662806] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:33.853801] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:33.898405] [DEBUG] [LOCAL ] FLS: Loaded 50242 existing records from primary storage. [2025-10-08T18:57:33.898845] [INFO ] [MAIN ] FLS: Loaded 50242 existing records. [2025-10-08T18:57:34.074555] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:34.074818] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-08T18:57:34.074873] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-08T18:57:34.075157] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-08T18:57:34.075218] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-08T18:57:34.426157] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:34.426222] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-08T18:57:34.473906] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T18:57:35.110955] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:57:35.217530] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-08T18:57:36.017560] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-08T18:57:36.054051] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T18:57:36.487961] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T18:57:36.817623] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-08T18:57:37.556215] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T18:57:37.617510] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-08T18:57:38.137624] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T18:57:38.417566] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-08T18:57:39.217571] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-08T18:57:39.382232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:57:40.018229] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-08T18:57:40.024594] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T18:57:40.540357] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:57:40.817588] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-08T18:57:41.617607] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-08T18:57:41.719106] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T18:57:42.283175] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T18:57:42.417562] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-08T18:57:43.116409] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:57:43.217508] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-08T18:57:44.017627] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-08T18:57:44.110049] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T18:57:44.719352] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:57:44.723382] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-10-08T18:57:44.723504] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-08T18:57:44.822553] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-08T18:57:45.113584] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-08T18:57:45.113727] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-08T18:57:45.114625] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-08T18:57:45.114702] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-08T18:57:45.116142] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 53325 (keeping 200 days of data) [2025-10-08T18:57:45.449103] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T18:57:45.480229] [DEBUG] [LOCAL ] FLG: Primary data saved (53325 records). [2025-10-08T18:57:45.480368] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-08T18:57:45.480455] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLG took 39.0s. Estimated remaining: 3h 32m 33s. Rate: 7.2 symbols/min [2025-10-08T18:57:45.623253] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-08T18:57:45.648253] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:45.695449] [DEBUG] [LOCAL ] FLUT: Loaded 50783 existing records from primary storage. [2025-10-08T18:57:45.695809] [INFO ] [MAIN ] FLUT: Loaded 50783 existing records. [2025-10-08T18:57:45.869778] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:45.870008] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-08T18:57:45.870054] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-08T18:57:45.870262] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-08T18:57:45.870318] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-08T18:57:46.219979] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:46.417495] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-08T18:57:46.741977] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T18:57:46.818733] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T18:57:47.217615] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-08T18:57:48.017519] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-08T18:57:48.120816] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T18:57:48.817515] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-08T18:57:48.898094] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T18:57:48.901971] [INFO ] [REMOTE ] FLO: Full fetch complete (75053 records). [2025-10-08T18:57:48.902078] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-08T18:57:49.290453] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-08T18:57:49.290708] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-08T18:57:49.291710] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-08T18:57:49.291776] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-08T18:57:49.293208] [DEBUG] [LOCAL ] FLO: Trimmed 75053 records to 51950 (keeping 200 days of data) [2025-10-08T18:57:49.620463] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-08T18:57:49.626500] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T18:57:49.655735] [DEBUG] [LOCAL ] FLO: Primary data saved (51950 records). [2025-10-08T18:57:49.655855] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-08T18:57:49.655944] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 40.3s. Estimated remaining: 3h 32m 17s. Rate: 7.2 symbols/min [2025-10-08T18:57:49.825196] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:57:49.846561] [DEBUG] [LOCAL ] FLXR: Loaded 20685 existing records from primary storage. [2025-10-08T18:57:49.846947] [INFO ] [MAIN ] FLXR: Loaded 20685 existing records. [2025-10-08T18:57:50.028980] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:57:50.029246] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-08T18:57:50.029293] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-08T18:57:50.029590] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-08T18:57:50.029680] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-08T18:57:50.392530] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:57:50.423637] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-08T18:57:50.433876] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T18:57:51.104207] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T18:57:51.186522] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:57:51.217579] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-08T18:57:52.017709] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-08T18:57:52.817511] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-08T18:57:52.999440] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T18:57:53.558237] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T18:57:53.617578] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-08T18:57:54.093262] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T18:57:54.417683] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-08T18:57:54.419541] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T18:57:55.217565] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-08T18:57:55.980934] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T18:57:56.017500] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-08T18:57:56.669471] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:57:56.817540] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-08T18:57:57.617519] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-08T18:57:57.732151] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:57:58.027548] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T18:57:58.417547] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-08T18:57:59.217525] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-08T18:57:59.427520] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T18:57:59.750484] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T18:58:00.017564] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-08T18:58:00.817511] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-08T18:58:01.012871] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T18:58:01.212837] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T18:58:01.617582] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-08T18:58:02.312498] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T18:58:02.417534] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-08T18:58:03.217518] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-08T18:58:03.374025] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T18:58:04.017548] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-08T18:58:04.105967] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T18:58:04.555063] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T18:58:04.588086] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:58:04.817525] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-08T18:58:05.617560] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-08T18:58:06.346795] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T18:58:06.417516] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-08T18:58:07.217564] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-08T18:58:07.316968] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T18:58:07.321764] [INFO ] [REMOTE ] FLR: Full fetch complete (76476 records). [2025-10-08T18:58:07.321891] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-08T18:58:07.709470] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-08T18:58:07.709558] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-08T18:58:07.710505] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-08T18:58:07.710572] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-08T18:58:07.712113] [DEBUG] [LOCAL ] FLR: Trimmed 76476 records to 53168 (keeping 200 days of data) [2025-10-08T18:58:07.950259] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T18:58:08.026862] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-08T18:58:08.077825] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T18:58:08.092530] [DEBUG] [LOCAL ] FLR: Primary data saved (53168 records). [2025-10-08T18:58:08.092787] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-08T18:58:08.093162] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 35.9s. Estimated remaining: 3h 32m 27s. Rate: 7.2 symbols/min [2025-10-08T18:58:08.263854] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:08.312515] [DEBUG] [LOCAL ] FMC: Loaded 51806 existing records from primary storage. [2025-10-08T18:58:08.312891] [INFO ] [MAIN ] FMC: Loaded 51806 existing records. [2025-10-08T18:58:08.490020] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:08.490198] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-08T18:58:08.490249] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-08T18:58:08.490552] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-08T18:58:08.490613] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-08T18:58:08.820089] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-08T18:58:08.846782] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:09.617551] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-08T18:58:09.716145] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T18:58:09.721553] [INFO ] [REMOTE ] FLS: Full fetch complete (71814 records). [2025-10-08T18:58:09.721726] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-08T18:58:09.996309] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T18:58:10.134158] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-08T18:58:10.134261] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-08T18:58:10.135256] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-08T18:58:10.135325] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-08T18:58:10.137138] [DEBUG] [LOCAL ] FLS: Trimmed 71814 records to 50253 (keeping 200 days of data) [2025-10-08T18:58:10.422345] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-08T18:58:10.455482] [DEBUG] [LOCAL ] FLS: Primary data saved (50253 records). [2025-10-08T18:58:10.455668] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-08T18:58:10.455792] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLS took 36.8s. Estimated remaining: 3h 32m 8s. Rate: 7.2 symbols/min [2025-10-08T18:58:10.622899] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:10.631338] [DEBUG] [LOCAL ] FMN: Loaded 5266 existing records from primary storage. [2025-10-08T18:58:10.631535] [INFO ] [MAIN ] FMN: Loaded 5266 existing records. [2025-10-08T18:58:10.808870] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:10.809125] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-08T18:58:10.809173] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-08T18:58:10.809391] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-08T18:58:10.809448] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-08T18:58:11.179931] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:11.217554] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-08T18:58:11.249496] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:58:11.451600] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T18:58:12.017569] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-08T18:58:12.819210] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-08T18:58:12.821031] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T18:58:12.904837] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T18:58:13.617565] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-08T18:58:14.298272] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T18:58:14.417572] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-08T18:58:14.626997] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T18:58:15.198983] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T18:58:15.217499] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-08T18:58:16.017564] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-08T18:58:16.165737] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T18:58:16.817570] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-08T18:58:17.594169] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T18:58:17.617505] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-08T18:58:17.636346] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T18:58:17.638885] [INFO ] [REMOTE ] FLXR: Full fetch complete (26195 records). [2025-10-08T18:58:17.638988] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-08T18:58:18.040312] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-08T18:58:18.040408] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-08T18:58:18.040999] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-08T18:58:18.041064] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-08T18:58:18.041827] [DEBUG] [LOCAL ] FLXR: Trimmed 26195 records to 20757 (keeping 200 days of data) [2025-10-08T18:58:18.172991] [DEBUG] [LOCAL ] FLXR: Primary data saved (20757 records). [2025-10-08T18:58:18.173126] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-08T18:58:18.173207] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLXR took 28.5s. Estimated remaining: 3h 31m 58s. Rate: 7.2 symbols/min [2025-10-08T18:58:18.367237] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T18:58:18.371078] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:18.402268] [DEBUG] [LOCAL ] FMS: Loaded 29997 existing records from primary storage. [2025-10-08T18:58:18.402570] [INFO ] [MAIN ] FMS: Loaded 29997 existing records. [2025-10-08T18:58:18.422730] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-08T18:58:18.598925] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:18.599343] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-08T18:58:18.599390] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-08T18:58:18.599615] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-08T18:58:18.599701] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-08T18:58:18.951403] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:19.217563] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-08T18:58:20.017549] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-08T18:58:20.149624] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T18:58:20.153528] [INFO ] [REMOTE ] FLUT: Full fetch complete (73029 records). [2025-10-08T18:58:20.153677] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-08T18:58:20.446183] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T18:58:20.570779] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-08T18:58:20.570865] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-08T18:58:20.571814] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-08T18:58:20.571885] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-08T18:58:20.573408] [DEBUG] [LOCAL ] FLUT: Trimmed 73029 records to 50781 (keeping 200 days of data) [2025-10-08T18:58:20.842596] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-08T18:58:20.881602] [DEBUG] [LOCAL ] FLUT: Primary data saved (50781 records). [2025-10-08T18:58:20.881745] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-08T18:58:20.881845] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLUT took 35.4s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-08T18:58:21.047572] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:21.089095] [DEBUG] [LOCAL ] FMX: Loaded 40660 existing records from primary storage. [2025-10-08T18:58:21.089482] [INFO ] [MAIN ] FMX: Loaded 40660 existing records. [2025-10-08T18:58:21.268840] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:21.269068] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-08T18:58:21.269116] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-08T18:58:21.269354] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-08T18:58:21.269412] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-08T18:58:21.618868] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-08T18:58:21.630534] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:21.632879] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T18:58:21.879362] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T18:58:22.417510] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-08T18:58:22.795524] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T18:58:23.217614] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-08T18:58:23.815563] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T18:58:23.855670] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T18:58:24.017572] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-08T18:58:24.783926] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T18:58:24.817619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-08T18:58:25.552489] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T18:58:25.617563] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-08T18:58:26.417587] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-08T18:58:26.999025] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T18:58:27.217522] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-08T18:58:27.531325] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T18:58:27.726111] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-08T18:58:28.017572] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-08T18:58:28.817563] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-08T18:58:29.315291] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T18:58:29.416628] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T18:58:29.617603] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-08T18:58:30.417513] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-08T18:58:30.891512] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T18:58:31.217569] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-08T18:58:31.856037] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T18:58:32.017561] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-08T18:58:32.697981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T18:58:32.817571] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-08T18:58:33.397924] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T18:58:33.580402] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T18:58:33.617572] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-08T18:58:34.417561] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-08T18:58:34.922742] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T18:58:35.217561] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-08T18:58:35.714436] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T18:58:36.017601] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-08T18:58:36.817592] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-08T18:58:36.898672] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T18:58:37.617611] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-08T18:58:38.000956] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T18:58:38.186545] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:58:38.417553] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-08T18:58:38.793534] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T18:58:38.917892] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T18:58:39.217586] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-08T18:58:40.017563] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-08T18:58:40.319940] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T18:58:40.817592] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-08T18:58:41.301228] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T18:58:41.311361] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T18:58:41.617573] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-08T18:58:42.077414] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T18:58:42.078530] [INFO ] [REMOTE ] FMN: Full fetch complete (9962 records). [2025-10-08T18:58:42.078616] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-08T18:58:42.421327] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-08T18:58:42.454566] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-08T18:58:42.455943] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-08T18:58:42.456263] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-08T18:58:42.456306] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-08T18:58:42.457088] [DEBUG] [LOCAL ] FMN: Trimmed 9962 records to 5285 (keeping 200 days of data) [2025-10-08T18:58:42.491072] [DEBUG] [LOCAL ] FMN: Primary data saved (5285 records). [2025-10-08T18:58:42.491195] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-08T18:58:42.491548] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 32.0s. Estimated remaining: 3h 31m 55s. Rate: 7.2 symbols/min [2025-10-08T18:58:42.665408] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:42.669527] [DEBUG] [LOCAL ] FMY: Loaded 1385 existing records from primary storage. [2025-10-08T18:58:42.669709] [INFO ] [MAIN ] FMY: Loaded 1385 existing records. [2025-10-08T18:58:42.891046] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:42.891321] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-08T18:58:42.891370] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-08T18:58:42.891550] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-08T18:58:42.891609] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-08T18:58:43.222844] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-08T18:58:43.262178] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:43.736980] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T18:58:44.017548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-08T18:58:44.640730] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T18:58:44.817543] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-08T18:58:45.126020] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T18:58:45.617566] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-08T18:58:46.127444] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:58:46.417575] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-08T18:58:46.931873] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T18:58:47.217628] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-08T18:58:47.487364] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-08T18:58:47.897966] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T18:58:48.017547] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-08T18:58:48.817577] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-08T18:58:49.592128] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T18:58:49.617539] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-08T18:58:49.968420] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T18:58:49.970896] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T18:58:49.975087] [INFO ] [REMOTE ] FMS: Full fetch complete (42445 records). [2025-10-08T18:58:49.975193] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-08T18:58:50.403236] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-08T18:58:50.403339] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-08T18:58:50.404079] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-08T18:58:50.404176] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-08T18:58:50.405380] [DEBUG] [LOCAL ] FMS: Trimmed 42445 records to 29995 (keeping 200 days of data) [2025-10-08T18:58:50.461814] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-08T18:58:50.593817] [DEBUG] [LOCAL ] FMS: Primary data saved (29995 records). [2025-10-08T18:58:50.593985] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-08T18:58:50.594093] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMS took 32.4s. Estimated remaining: 3h 31m 46s. Rate: 7.2 symbols/min [2025-10-08T18:58:50.762666] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:50.799340] [DEBUG] [LOCAL ] FN: Loaded 38245 existing records from primary storage. [2025-10-08T18:58:50.799677] [INFO ] [MAIN ] FN: Loaded 38245 existing records. [2025-10-08T18:58:50.987121] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:50.987468] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-08T18:58:50.987558] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-08T18:58:50.987891] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-08T18:58:50.987951] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-08T18:58:51.227401] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-08T18:58:51.356202] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:51.711779] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T18:58:51.957569] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T18:58:52.017504] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-08T18:58:52.817563] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-08T18:58:53.282706] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T18:58:53.285684] [INFO ] [REMOTE ] FMX: Full fetch complete (57622 records). [2025-10-08T18:58:53.285773] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-08T18:58:53.632448] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-08T18:58:53.689873] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-08T18:58:53.689984] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-08T18:58:53.691214] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-08T18:58:53.691280] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-08T18:58:53.692679] [DEBUG] [LOCAL ] FMX: Trimmed 57622 records to 40585 (keeping 200 days of data) [2025-10-08T18:58:53.944723] [DEBUG] [LOCAL ] FMX: Primary data saved (40585 records). [2025-10-08T18:58:53.944858] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-08T18:58:53.944953] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMX took 33.1s. Estimated remaining: 3h 31m 29s. Rate: 7.2 symbols/min [2025-10-08T18:58:54.145406] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:54.165824] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T18:58:54.221545] [DEBUG] [LOCAL ] FNB: Loaded 52527 existing records from primary storage. [2025-10-08T18:58:54.221940] [INFO ] [MAIN ] FNB: Loaded 52527 existing records. [2025-10-08T18:58:54.415075] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:54.415315] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-08T18:58:54.415361] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-08T18:58:54.415593] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-08T18:58:54.415685] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-08T18:58:54.426719] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-08T18:58:54.792209] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:58:55.217520] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-08T18:58:55.476446] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T18:58:55.566919] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T18:58:55.950915] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T18:58:56.017578] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-08T18:58:56.817558] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-08T18:58:57.334956] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T18:58:57.617549] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-08T18:58:58.417518] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-08T18:58:58.636089] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T18:58:58.640952] [INFO ] [REMOTE ] FMC: Full fetch complete (75140 records). [2025-10-08T18:58:58.641094] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-08T18:58:58.913565] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T18:58:59.107166] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-08T18:58:59.107275] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-08T18:58:59.108216] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-08T18:58:59.108302] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-08T18:58:59.110295] [DEBUG] [LOCAL ] FMC: Trimmed 75140 records to 51801 (keeping 200 days of data) [2025-10-08T18:58:59.134551] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T18:58:59.229409] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-08T18:58:59.466705] [DEBUG] [LOCAL ] FMC: Primary data saved (51801 records). [2025-10-08T18:58:59.466882] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-08T18:58:59.466976] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMC took 51.4s. Estimated remaining: 3h 31m 15s. Rate: 7.2 symbols/min [2025-10-08T18:58:59.619570] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-08T18:58:59.645089] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:58:59.693971] [DEBUG] [LOCAL ] FND: Loaded 52089 existing records from primary storage. [2025-10-08T18:58:59.694337] [INFO ] [MAIN ] FND: Loaded 52089 existing records. [2025-10-08T18:58:59.875985] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:58:59.876167] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-08T18:58:59.876215] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-08T18:58:59.876466] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-08T18:58:59.876523] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-08T18:59:00.022689] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-08T18:59:00.228576] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:00.491584] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T18:59:00.817558] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-08T18:59:01.617554] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-08T18:59:02.417472] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-08T18:59:02.460025] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T18:59:02.954929] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T18:59:03.217599] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-08T18:59:04.025960] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-08T18:59:04.032513] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T18:59:04.375054] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T18:59:04.540273] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T18:59:04.817614] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-08T18:59:05.617580] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-08T18:59:06.065403] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T18:59:06.417629] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-08T18:59:06.570429] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T18:59:06.795127] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-08T18:59:07.217610] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-08T18:59:08.017623] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-08T18:59:08.416263] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T18:59:08.417500] [INFO ] [REMOTE ] FMY: Full fetch complete (1961 records). [2025-10-08T18:59:08.418868] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T18:59:08.419068] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-08T18:59:08.790108] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-08T18:59:08.790201] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-08T18:59:08.790295] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-08T18:59:08.790333] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-08T18:59:08.790709] [DEBUG] [LOCAL ] FMY: Trimmed 1961 records to 1384 (keeping 200 days of data) [2025-10-08T18:59:08.799948] [DEBUG] [LOCAL ] FMY: Primary data saved (1384 records). [2025-10-08T18:59:08.800024] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-08T18:59:08.800113] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 26.3s. Estimated remaining: 3h 31m 9s. Rate: 7.2 symbols/min [2025-10-08T18:59:08.822746] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-08T18:59:08.976253] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:09.023287] [DEBUG] [LOCAL ] FNF: Loaded 48940 existing records from primary storage. [2025-10-08T18:59:09.023610] [INFO ] [MAIN ] FNF: Loaded 48940 existing records. [2025-10-08T18:59:09.199971] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:09.200280] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-08T18:59:09.200345] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-08T18:59:09.200634] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-08T18:59:09.200882] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-08T18:59:09.561546] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:09.617556] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-08T18:59:10.296280] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T18:59:10.417584] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-08T18:59:10.816474] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T18:59:11.217634] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-08T18:59:12.022896] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-08T18:59:12.028017] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T18:59:12.777788] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T18:59:12.817511] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-08T18:59:13.617593] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-08T18:59:13.895636] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T18:59:14.401359] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T18:59:14.417483] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-08T18:59:15.156947] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T18:59:15.217514] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-08T18:59:16.022639] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-08T18:59:16.043250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T18:59:16.801399] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T18:59:16.817502] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-08T18:59:17.623356] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-08T18:59:17.634814] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T18:59:17.809382] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T18:59:18.417535] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-08T18:59:19.002953] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T18:59:19.217537] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-08T18:59:19.839094] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T18:59:20.017565] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-08T18:59:20.817546] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-08T18:59:20.924441] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T18:59:21.231227] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T18:59:21.233885] [INFO ] [REMOTE ] FN: Full fetch complete (56068 records). [2025-10-08T18:59:21.234016] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-08T18:59:21.623784] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-08T18:59:21.624755] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-08T18:59:21.625817] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-08T18:59:21.626771] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-08T18:59:21.626976] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-08T18:59:21.628439] [DEBUG] [LOCAL ] FN: Trimmed 56068 records to 38138 (keeping 200 days of data) [2025-10-08T18:59:21.874601] [DEBUG] [LOCAL ] FN: Primary data saved (38138 records). [2025-10-08T18:59:21.874791] [INFO ] [MAIN ] FN: Full history saved. [2025-10-08T18:59:21.874881] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 31.3s. Estimated remaining: 3h 31m 9s. Rate: 7.2 symbols/min [2025-10-08T18:59:22.049977] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:22.092491] [DEBUG] [LOCAL ] FNV: Loaded 46152 existing records from primary storage. [2025-10-08T18:59:22.092899] [INFO ] [MAIN ] FNV: Loaded 46152 existing records. [2025-10-08T18:59:22.277205] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:22.277614] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-08T18:59:22.277723] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-08T18:59:22.278426] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-08T18:59:22.278670] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-08T18:59:22.427785] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-08T18:59:22.434960] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T18:59:22.697164] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:23.217527] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-08T18:59:23.368125] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T18:59:24.017564] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-08T18:59:24.109336] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T18:59:24.754196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T18:59:24.817527] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-08T18:59:25.596011] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T18:59:25.617502] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-08T18:59:26.390596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T18:59:26.417538] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-08T18:59:27.070918] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T18:59:27.217578] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-08T18:59:27.728636] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T18:59:28.017552] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-08T18:59:28.543898] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T18:59:28.817616] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-08T18:59:29.307583] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T18:59:29.617535] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-08T18:59:30.185479] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T18:59:30.417549] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-08T18:59:31.000461] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T18:59:31.217567] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-08T18:59:32.017628] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-08T18:59:32.181137] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T18:59:32.817553] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-08T18:59:33.100883] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T18:59:33.617576] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-08T18:59:33.716169] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T18:59:34.417525] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-08T18:59:34.522930] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T18:59:35.007664] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T18:59:35.217561] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-08T18:59:36.017514] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-08T18:59:36.137394] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T18:59:36.817560] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-08T18:59:36.846472] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T18:59:37.391337] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T18:59:37.617562] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-08T18:59:38.417578] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-08T18:59:38.507173] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T18:59:39.217508] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-08T18:59:39.246132] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T18:59:40.018975] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-08T18:59:40.022112] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T18:59:40.722406] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T18:59:40.726318] [INFO ] [REMOTE ] FND: Full fetch complete (74725 records). [2025-10-08T18:59:40.726444] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-08T18:59:40.825281] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-08T18:59:41.130089] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-08T18:59:41.130215] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-08T18:59:41.131176] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-08T18:59:41.131246] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-08T18:59:41.132855] [DEBUG] [LOCAL ] FND: Trimmed 74725 records to 52108 (keeping 200 days of data) [2025-10-08T18:59:41.452035] [DEBUG] [LOCAL ] FND: Primary data saved (52108 records). [2025-10-08T18:59:41.452192] [INFO ] [MAIN ] FND: Full history saved. [2025-10-08T18:59:41.452280] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FND took 42.0s. Estimated remaining: 3h 31m 20s. Rate: 7.2 symbols/min [2025-10-08T18:59:41.627675] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:41.624290] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-08T18:59:41.647053] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T18:59:41.651520] [INFO ] [REMOTE ] FNB: Full fetch complete (75888 records). [2025-10-08T18:59:41.656691] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-08T18:59:41.657195] [DEBUG] [LOCAL ] FOA: Loaded 13075 existing records from primary storage. [2025-10-08T18:59:41.657532] [INFO ] [MAIN ] FOA: Loaded 13075 existing records. [2025-10-08T18:59:42.015493] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:42.015870] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-08T18:59:42.015962] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-08T18:59:42.016294] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-08T18:59:42.016353] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-08T18:59:42.640155] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-08T18:59:42.639994] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:42.640842] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-08T18:59:42.640923] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-08T18:59:42.642976] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-08T18:59:42.643222] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-08T18:59:42.671400] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T18:59:42.671547] [DEBUG] [LOCAL ] FNB: Trimmed 75888 records to 52530 (keeping 200 days of data) [2025-10-08T18:59:43.006434] [DEBUG] [LOCAL ] FNB: Primary data saved (52530 records). [2025-10-08T18:59:43.006669] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-08T18:59:43.006855] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FNB took 49.1s. Estimated remaining: 3h 30m 60s. Rate: 7.2 symbols/min [2025-10-08T18:59:43.129996] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T18:59:43.167266] [INFO ] [REMOTE ] FNF: Full fetch complete (69698 records). [2025-10-08T18:59:43.180960] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-08T18:59:43.233355] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-08T18:59:43.224440] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:43.367631] [DEBUG] [LOCAL ] FOF: Loaded 8500 existing records from primary storage. [2025-10-08T18:59:43.398224] [INFO ] [MAIN ] FOF: Loaded 8500 existing records. [2025-10-08T18:59:43.684507] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T18:59:43.837155] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:43.840960] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-08T18:59:43.841138] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-08T18:59:43.841252] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-08T18:59:43.841341] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-08T18:59:43.842365] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-08T18:59:43.842451] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-08T18:59:43.842532] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-08T18:59:43.842705] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-08T18:59:43.947781] [DEBUG] [LOCAL ] FNF: Trimmed 69698 records to 48933 (keeping 200 days of data) [2025-10-08T18:59:44.057725] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-08T18:59:44.331861] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:44.549686] [DEBUG] [LOCAL ] FNF: Primary data saved (48933 records). [2025-10-08T18:59:44.549865] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-08T18:59:44.549968] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 35.7s. Estimated remaining: 3h 30m 39s. Rate: 7.2 symbols/min [2025-10-08T18:59:44.764811] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T18:59:44.777147] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:44.798558] [DEBUG] [LOCAL ] FOR: Loaded 19691 existing records from primary storage. [2025-10-08T18:59:44.798863] [INFO ] [MAIN ] FOR: Loaded 19691 existing records. [2025-10-08T18:59:44.828954] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-08T18:59:44.984304] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:44.984698] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-08T18:59:44.984927] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-08T18:59:44.998073] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-08T18:59:44.998792] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:59:44.998935] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-08T18:59:45.363803] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:45.617566] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-08T18:59:45.638403] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T18:59:46.417583] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-08T18:59:47.128911] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T18:59:47.175557] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T18:59:47.217492] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-08T18:59:48.017571] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-08T18:59:48.157865] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T18:59:48.817595] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-08T18:59:49.600215] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T18:59:49.604595] [INFO ] [REMOTE ] FNV: Full fetch complete (66524 records). [2025-10-08T18:59:49.604787] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-08T18:59:49.627220] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-08T18:59:49.921494] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T18:59:50.017532] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-08T18:59:50.017661] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-08T18:59:50.018502] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-08T18:59:50.018562] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-08T18:59:50.019833] [DEBUG] [LOCAL ] FNV: Trimmed 66524 records to 46166 (keeping 200 days of data) [2025-10-08T18:59:50.311783] [DEBUG] [LOCAL ] FNV: Primary data saved (46166 records). [2025-10-08T18:59:50.311939] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-08T18:59:50.312052] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FNV took 28.4s. Estimated remaining: 3h 30m 26s. Rate: 7.2 symbols/min [2025-10-08T18:59:50.422733] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-08T18:59:50.489218] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T18:59:50.497042] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T18:59:50.541412] [DEBUG] [LOCAL ] FOUR: Loaded 49599 existing records from primary storage. [2025-10-08T18:59:50.541783] [INFO ] [MAIN ] FOUR: Loaded 49599 existing records. [2025-10-08T18:59:50.720822] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T18:59:50.721073] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-08T18:59:50.721123] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-08T18:59:50.721375] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-08T18:59:50.721431] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-08T18:59:51.077056] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T18:59:51.217501] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-08T18:59:51.548830] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T18:59:52.017596] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-08T18:59:52.817565] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-08T18:59:52.968739] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T18:59:53.181998] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T18:59:53.573083] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T18:59:53.617557] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-08T18:59:54.310621] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T18:59:54.417519] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-08T18:59:55.166754] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T18:59:55.217516] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-08T18:59:56.018975] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-08T18:59:56.021016] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T18:59:56.817531] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-08T18:59:57.317913] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T18:59:57.541471] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T18:59:57.617511] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-08T18:59:58.417503] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-08T18:59:58.435985] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T18:59:59.132564] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T18:59:59.217577] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-08T18:59:59.997968] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:00:00.017512] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-08T19:00:00.817599] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-08T19:00:01.216960] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:00:01.347898] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T19:00:01.617592] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-08T19:00:02.417615] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-08T19:00:02.528081] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T19:00:03.217634] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-08T19:00:03.259767] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:00:04.017558] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-08T19:00:04.304723] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:00:04.722021] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:00:04.817567] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-08T19:00:05.617559] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-08T19:00:05.629475] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T19:00:06.417532] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-08T19:00:07.136046] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:00:07.217499] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-08T19:00:07.298777] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:00:08.017566] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-08T19:00:08.817522] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-08T19:00:08.924434] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:00:09.017936] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T19:00:09.593512] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T19:00:09.595295] [INFO ] [REMOTE ] FOR: Full fetch complete (29818 records). [2025-10-08T19:00:09.595400] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-08T19:00:09.625452] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-08T19:00:09.982492] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-08T19:00:09.982579] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-08T19:00:09.983137] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-08T19:00:09.983200] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-08T19:00:09.984068] [DEBUG] [LOCAL ] FOR: Trimmed 29818 records to 19696 (keeping 200 days of data) [2025-10-08T19:00:10.104010] [DEBUG] [LOCAL ] FOR: Primary data saved (19696 records). [2025-10-08T19:00:10.104168] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-08T19:00:10.104261] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOR took 25.6s. Estimated remaining: 3h 30m 38s. Rate: 7.2 symbols/min [2025-10-08T19:00:10.270340] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:10.293573] [DEBUG] [LOCAL ] FPF: Loaded 18492 existing records from primary storage. [2025-10-08T19:00:10.293877] [INFO ] [MAIN ] FPF: Loaded 18492 existing records. [2025-10-08T19:00:10.422682] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-08T19:00:10.478243] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:10.479129] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-08T19:00:10.479180] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-08T19:00:10.479491] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-08T19:00:10.479549] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-08T19:00:10.860130] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:10.863473] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:00:11.217614] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-08T19:00:12.017524] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-08T19:00:12.250627] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:00:12.252406] [INFO ] [REMOTE ] FOA: Full fetch complete (22178 records). [2025-10-08T19:00:12.252523] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-08T19:00:12.553291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-08T19:00:12.551554] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T19:00:12.687762] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-08T19:00:12.687850] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-08T19:00:12.688353] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-08T19:00:12.688392] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-08T19:00:12.689116] [DEBUG] [LOCAL ] FOA: Trimmed 22178 records to 13062 (keeping 200 days of data) [2025-10-08T19:00:12.765299] [DEBUG] [LOCAL ] FOA: Primary data saved (13062 records). [2025-10-08T19:00:12.765434] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-08T19:00:12.765518] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 31.3s. Estimated remaining: 3h 30m 20s. Rate: 7.2 symbols/min [2025-10-08T19:00:12.826076] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-08T19:00:12.938788] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:12.957695] [DEBUG] [LOCAL ] FPH: Loaded 19275 existing records from primary storage. [2025-10-08T19:00:12.957955] [INFO ] [MAIN ] FPH: Loaded 19275 existing records. [2025-10-08T19:00:13.132424] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:13.132686] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-08T19:00:13.132759] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-08T19:00:13.132963] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-08T19:00:13.133024] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-08T19:00:13.478075] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:13.617540] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-08T19:00:14.417587] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-08T19:00:14.546124] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:00:14.693867] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:00:14.988181] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:00:15.217603] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-08T19:00:16.017733] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-08T19:00:16.537703] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:00:16.817566] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-08T19:00:17.474136] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:00:17.478410] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:00:17.479149] [INFO ] [REMOTE ] FOF: Full fetch complete (11897 records). [2025-10-08T19:00:17.494589] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-08T19:00:17.622749] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-08T19:00:17.906331] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-08T19:00:17.906408] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-08T19:00:17.906718] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-08T19:00:17.906780] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-08T19:00:17.907219] [DEBUG] [LOCAL ] FOF: Trimmed 11897 records to 8522 (keeping 200 days of data) [2025-10-08T19:00:17.963231] [DEBUG] [LOCAL ] FOF: Primary data saved (8522 records). [2025-10-08T19:00:17.963375] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-08T19:00:17.963461] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOF took 35.0s. Estimated remaining: 3h 30m 6s. Rate: 7.2 symbols/min [2025-10-08T19:00:18.140305] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:18.175914] [DEBUG] [LOCAL ] FPI: Loaded 31067 existing records from primary storage. [2025-10-08T19:00:18.176222] [INFO ] [MAIN ] FPI: Loaded 31067 existing records. [2025-10-08T19:00:18.370367] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:18.370622] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-08T19:00:18.370714] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-08T19:00:18.370947] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-08T19:00:18.371024] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-08T19:00:18.423611] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-08T19:00:18.717548] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T19:00:18.787100] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:19.217630] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-08T19:00:20.017517] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-08T19:00:20.176914] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T19:00:20.346491] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:00:20.616679] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:00:20.817577] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-08T19:00:21.526527] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:00:21.617550] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-08T19:00:22.417637] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-08T19:00:22.978558] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:00:23.217598] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-08T19:00:23.790576] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:00:24.017592] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-08T19:00:24.113116] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T19:00:24.817553] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-08T19:00:25.075343] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:00:25.574572] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:00:25.617567] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-08T19:00:26.229963] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:00:26.417582] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-08T19:00:27.217586] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-08T19:00:28.017559] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-08T19:00:28.201733] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T19:00:28.363118] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T19:00:28.817607] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-08T19:00:29.146845] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:00:29.617537] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-08T19:00:29.777077] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:00:30.417546] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-08T19:00:30.660257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:00:31.217557] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-08T19:00:31.829155] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:00:32.017550] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-08T19:00:32.216827] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:00:32.817557] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-08T19:00:32.982110] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:00:33.580476] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T19:00:33.617550] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-08T19:00:34.368765] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:00:34.417513] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-08T19:00:35.217565] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-08T19:00:36.017598] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-08T19:00:36.102146] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T19:00:36.104256] [INFO ] [REMOTE ] FPH: Full fetch complete (31244 records). [2025-10-08T19:00:36.104463] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-08T19:00:36.397095] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T19:00:36.434711] [INFO ] [REMOTE ] FOUR: Full fetch complete (72038 records). [2025-10-08T19:00:36.450567] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-08T19:00:36.628936] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-08T19:00:36.634492] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-08T19:00:36.635324] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-08T19:00:36.640532] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-08T19:00:36.705615] [DEBUG] [LOCAL ] FPH: Trimmed 31244 records to 19300 (keeping 200 days of data) [2025-10-08T19:00:36.854968] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-08T19:00:37.059916] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-08T19:00:37.061131] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-08T19:00:37.065022] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-08T19:00:37.065603] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-08T19:00:37.074694] [DEBUG] [LOCAL ] FOUR: Trimmed 72038 records to 49586 (keeping 200 days of data) [2025-10-08T19:00:37.162153] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T19:00:37.213204] [DEBUG] [LOCAL ] FPH: Primary data saved (19300 records). [2025-10-08T19:00:37.213933] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-08T19:00:37.214303] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPH took 24.4s. Estimated remaining: 3h 30m 17s. Rate: 7.2 symbols/min [2025-10-08T19:00:37.395023] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:37.532489] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-08T19:00:37.533990] [INFO ] [MAIN ] FR: Loaded 46429 existing records. [2025-10-08T19:00:37.635191] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-08T19:00:37.723352] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:37.725454] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-08T19:00:37.726278] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-08T19:00:37.726879] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-08T19:00:37.726945] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-08T19:00:38.191947] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:38.209544] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:00:38.227407] [DEBUG] [LOCAL ] FOUR: Primary data saved (49586 records). [2025-10-08T19:00:38.227551] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-08T19:00:38.227635] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOUR took 47.9s. Estimated remaining: 3h 29m 55s. Rate: 7.2 symbols/min [2025-10-08T19:00:38.394215] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:38.410162] [DEBUG] [LOCAL ] FRA: Loaded 14607 existing records from primary storage. [2025-10-08T19:00:38.410402] [INFO ] [MAIN ] FRA: Loaded 14607 existing records. [2025-10-08T19:00:38.423447] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-08T19:00:38.588915] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:38.589144] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-08T19:00:38.589192] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-08T19:00:38.589374] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-08T19:00:38.589431] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-08T19:00:38.967775] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:39.115332] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:00:39.217520] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-08T19:00:40.017520] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-08T19:00:40.049401] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:00:40.301299] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T19:00:40.817553] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-08T19:00:40.898765] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T19:00:41.617545] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-08T19:00:42.333459] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:00:42.417550] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-08T19:00:42.609068] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T19:00:43.217554] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-08T19:00:43.939538] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:00:44.017572] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-08T19:00:44.288303] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T19:00:44.817627] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-08T19:00:44.870316] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:00:45.617548] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-08T19:00:46.417580] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-08T19:00:46.436060] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:00:46.565302] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:00:47.217509] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-08T19:00:47.236934] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:00:48.017605] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-08T19:00:48.817526] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-08T19:00:48.942826] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:00:49.263574] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:00:49.617538] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-08T19:00:49.694728] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T19:00:50.417529] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-08T19:00:50.552247] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:00:51.180275] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:00:51.217509] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-08T19:00:52.017554] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-08T19:00:52.327255] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:00:52.329552] [INFO ] [REMOTE ] FPF: Full fetch complete (26739 records). [2025-10-08T19:00:52.329710] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-08T19:00:52.728281] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-08T19:00:52.728493] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-08T19:00:52.729235] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-08T19:00:52.729318] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-08T19:00:52.730462] [DEBUG] [LOCAL ] FPF: Trimmed 26739 records to 18595 (keeping 200 days of data) [2025-10-08T19:00:52.796239] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:00:52.838514] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-08T19:00:52.876588] [DEBUG] [LOCAL ] FPF: Primary data saved (18595 records). [2025-10-08T19:00:52.876805] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-08T19:00:52.876908] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FPF took 42.8s. Estimated remaining: 3h 29m 58s. Rate: 7.2 symbols/min [2025-10-08T19:00:53.043497] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:53.062566] [DEBUG] [LOCAL ] FRGE: Loaded 16981 existing records from primary storage. [2025-10-08T19:00:53.062880] [INFO ] [MAIN ] FRGE: Loaded 16981 existing records. [2025-10-08T19:00:53.238956] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:53.239208] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-08T19:00:53.239268] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-08T19:00:53.239574] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-08T19:00:53.239633] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-08T19:00:53.622769] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-08T19:00:53.681038] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:54.003886] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:00:54.007033] [INFO ] [REMOTE ] FPI: Full fetch complete (44145 records). [2025-10-08T19:00:54.007176] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-08T19:00:54.384226] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-08T19:00:54.384310] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-08T19:00:54.384973] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-08T19:00:54.385035] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-08T19:00:54.386001] [DEBUG] [LOCAL ] FPI: Trimmed 44145 records to 31074 (keeping 200 days of data) [2025-10-08T19:00:54.441555] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-08T19:00:54.588278] [DEBUG] [LOCAL ] FPI: Primary data saved (31074 records). [2025-10-08T19:00:54.588484] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-08T19:00:54.588677] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPI took 36.6s. Estimated remaining: 3h 29m 38s. Rate: 7.2 symbols/min [2025-10-08T19:00:54.757977] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:00:54.807569] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-08T19:00:54.807982] [INFO ] [MAIN ] FRO: Loaded 51679 existing records. [2025-10-08T19:00:54.988986] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:00:54.989194] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-08T19:00:54.989241] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-08T19:00:54.989462] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-08T19:00:54.989520] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-08T19:00:55.227528] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-08T19:00:55.352370] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:00:55.381469] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:00:55.969477] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:00:56.024459] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-08T19:00:56.027342] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:00:56.817589] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-08T19:00:57.617546] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-08T19:00:57.658594] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:00:57.920447] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T19:00:58.417544] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-08T19:00:58.927267] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:00:59.217593] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-08T19:01:00.017566] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-08T19:01:00.234532] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T19:01:00.638872] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T19:01:00.817511] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-08T19:01:00.974433] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T19:01:01.617548] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-08T19:01:02.317060] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:01:02.371084] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:01:02.417513] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-08T19:01:03.217516] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-08T19:01:03.245503] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T19:01:04.017578] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-08T19:01:04.339359] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:01:04.817587] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-08T19:01:05.617540] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-08T19:01:05.879783] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T19:01:05.994565] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:01:06.417614] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-08T19:01:06.621351] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:01:07.217564] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-08T19:01:08.017576] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-08T19:01:08.328082] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:01:08.501227] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:01:08.504725] [INFO ] [REMOTE ] FR: Full fetch complete (66709 records). [2025-10-08T19:01:08.504842] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-08T19:01:08.817814] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-08T19:01:08.901240] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-08T19:01:08.901346] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-08T19:01:08.902459] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-08T19:01:08.902545] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-08T19:01:08.913353] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:01:08.919086] [DEBUG] [LOCAL ] FR: Trimmed 66709 records to 46358 (keeping 200 days of data) [2025-10-08T19:01:09.205633] [DEBUG] [LOCAL ] FR: Primary data saved (46358 records). [2025-10-08T19:01:09.205804] [INFO ] [MAIN ] FR: Full history saved. [2025-10-08T19:01:09.205908] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FR took 32.0s. Estimated remaining: 3h 29m 40s. Rate: 7.2 symbols/min [2025-10-08T19:01:09.372814] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:09.411760] [DEBUG] [LOCAL ] FRT: Loaded 41989 existing records from primary storage. [2025-10-08T19:01:09.412084] [INFO ] [MAIN ] FRT: Loaded 41989 existing records. [2025-10-08T19:01:09.585304] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:09.585547] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-08T19:01:09.585617] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-08T19:01:09.585937] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-08T19:01:09.586016] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-08T19:01:09.627724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-08T19:01:09.959050] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:10.417517] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-08T19:01:10.528213] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:01:10.530164] [INFO ] [REMOTE ] FRA: Full fetch complete (23931 records). [2025-10-08T19:01:10.530245] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-08T19:01:10.959929] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-08T19:01:10.970295] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-08T19:01:10.976074] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-08T19:01:10.976165] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-08T19:01:10.990435] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T19:01:10.990775] [DEBUG] [LOCAL ] FRA: Trimmed 23931 records to 14561 (keeping 200 days of data) [2025-10-08T19:01:11.094869] [DEBUG] [LOCAL ] FRA: Primary data saved (14561 records). [2025-10-08T19:01:11.095049] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-08T19:01:11.095159] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRA took 32.9s. Estimated remaining: 3h 29m 21s. Rate: 7.2 symbols/min [2025-10-08T19:01:11.222721] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-08T19:01:11.276513] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:11.312811] [DEBUG] [LOCAL ] FSCO: Loaded 37940 existing records from primary storage. [2025-10-08T19:01:11.313115] [INFO ] [MAIN ] FSCO: Loaded 37940 existing records. [2025-10-08T19:01:11.492890] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:11.493187] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-08T19:01:11.493260] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-08T19:01:11.494286] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-08T19:01:11.494347] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-08T19:01:11.856247] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:11.869860] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:01:12.017519] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-08T19:01:12.661491] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:01:12.817556] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-08T19:01:13.503295] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:01:13.617541] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-08T19:01:14.102599] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:01:14.417554] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-08T19:01:15.121123] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:01:15.217531] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-08T19:01:16.017520] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-08T19:01:16.559896] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T19:01:16.679606] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:01:16.817543] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-08T19:01:17.231090] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T19:01:17.617706] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-08T19:01:18.181621] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:01:18.417568] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-08T19:01:18.681984] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:01:19.217617] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-08T19:01:19.377933] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T19:01:19.906091] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T19:01:20.017558] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-08T19:01:20.817547] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-08T19:01:20.855992] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T19:01:21.617548] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-08T19:01:22.408702] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T19:01:22.417512] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-08T19:01:22.452295] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:01:23.217552] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-08T19:01:23.916073] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:01:24.017563] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-08T19:01:24.817515] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-08T19:01:24.973100] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:01:25.148632] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:01:25.617544] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-08T19:01:25.901148] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T19:01:26.417563] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-08T19:01:26.519343] [DEBUG] [REMOTE ] FRGE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T19:01:26.519716] [WARN ] [REMOTE ] FRGE: No data returned for month 2025-09 [2025-10-08T19:01:26.519834] [FATAL] [REMOTE ] FRGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:01:26.519958] [FATAL] [MAIN ] FRGE: Failed to fetch primary data. [2025-10-08T19:01:26.520048] [WARN ] [MAIN ] FRGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:01:26.520144] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-08T19:01:26.520229] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-10-08T19:01:26.520267] [INFO ] [LOCAL ] FRGE: Starting deletion of derivative data. [2025-10-08T19:01:26.520517] [DEBUG] [LOCAL ] FRGE: Deleted derivative data file. [2025-10-08T19:01:26.520607] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 33.6s. Estimated remaining: 3h 29m 25s. Rate: 7.2 symbols/min [2025-10-08T19:01:26.695720] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:26.742866] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-08T19:01:26.743191] [INFO ] [MAIN ] FSK: Loaded 49404 existing records. [2025-10-08T19:01:26.918261] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:26.918508] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-08T19:01:26.918567] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-08T19:01:26.920007] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-08T19:01:26.920071] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-08T19:01:27.222781] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-08T19:01:27.283058] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:27.602872] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T19:01:28.017523] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-08T19:01:28.817572] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-08T19:01:28.886756] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:01:29.617600] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-08T19:01:29.718423] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T19:01:29.962566] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:01:30.417617] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-08T19:01:31.164549] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:01:31.217535] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-08T19:01:31.626779] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:01:32.017608] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-08T19:01:32.360720] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:01:32.817542] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-08T19:01:33.535695] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:01:33.617573] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-08T19:01:34.417534] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-08T19:01:34.739826] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:01:35.202902] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:01:35.217506] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-08T19:01:35.782300] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:01:36.017626] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-08T19:01:36.817580] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-08T19:01:36.991172] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:01:37.040230] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T19:01:37.617549] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-08T19:01:38.056710] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:01:38.417545] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-08T19:01:38.853983] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:01:39.217618] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-08T19:01:39.784620] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:01:40.017569] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-08T19:01:40.764515] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:01:40.817577] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-08T19:01:41.268613] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:01:41.617576] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-08T19:01:42.194776] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:01:42.199601] [INFO ] [REMOTE ] FSCO: Full fetch complete (54724 records). [2025-10-08T19:01:42.199889] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-08T19:01:42.422713] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-08T19:01:42.623361] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-08T19:01:42.623451] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-08T19:01:42.624229] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-08T19:01:42.624294] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-08T19:01:42.625469] [DEBUG] [LOCAL ] FSCO: Trimmed 54724 records to 38029 (keeping 200 days of data) [2025-10-08T19:01:42.853532] [DEBUG] [LOCAL ] FSCO: Primary data saved (38029 records). [2025-10-08T19:01:42.853734] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-08T19:01:42.853835] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FSCO took 31.8s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-08T19:01:43.024812] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:43.074304] [DEBUG] [LOCAL ] FSLY: Loaded 51244 existing records from primary storage. [2025-10-08T19:01:43.074629] [INFO ] [MAIN ] FSLY: Loaded 51244 existing records. [2025-10-08T19:01:43.227273] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-08T19:01:43.256828] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:43.257488] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-08T19:01:43.257541] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-08T19:01:43.259040] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-08T19:01:43.259100] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-08T19:01:43.390793] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T19:01:43.428770] [INFO ] [REMOTE ] FRO: Full fetch complete (75191 records). [2025-10-08T19:01:43.435224] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-08T19:01:43.870597] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:44.017298] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:01:44.017903] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-08T19:01:44.080835] [INFO ] [REMOTE ] FRT: Full fetch complete (60393 records). [2025-10-08T19:01:44.111308] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-08T19:01:44.135255] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-08T19:01:44.135415] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-08T19:01:44.137202] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-08T19:01:44.137424] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-08T19:01:44.242901] [DEBUG] [LOCAL ] FRO: Trimmed 75191 records to 51674 (keeping 200 days of data) [2025-10-08T19:01:44.652607] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-08T19:01:44.653006] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-08T19:01:44.654221] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-08T19:01:44.656032] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-08T19:01:44.660466] [DEBUG] [LOCAL ] FRT: Trimmed 60393 records to 41872 (keeping 200 days of data) [2025-10-08T19:01:44.792629] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:01:44.819398] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-08T19:01:45.089288] [DEBUG] [LOCAL ] FRT: Primary data saved (41872 records). [2025-10-08T19:01:45.090512] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-08T19:01:45.090673] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 35.9s. Estimated remaining: 3h 29m 11s. Rate: 7.2 symbols/min [2025-10-08T19:01:45.283784] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:45.380360] [DEBUG] [LOCAL ] FRO: Primary data saved (51674 records). [2025-10-08T19:01:45.380537] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-08T19:01:45.380632] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FRO took 50.8s. Estimated remaining: 3h 28m 49s. Rate: 7.2 symbols/min [2025-10-08T19:01:45.547149] [DEBUG] [LOCAL ] FSM: Loaded 53294 existing records from primary storage. [2025-10-08T19:01:45.585762] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:01:45.586137] [INFO ] [MAIN ] FSM: Loaded 53294 existing records. [2025-10-08T19:01:45.793237] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:45.804162] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-08T19:01:45.804955] [DEBUG] [LOCAL ] FSS: Loaded 33992 existing records from primary storage. [2025-10-08T19:01:45.805259] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-08T19:01:45.805429] [INFO ] [MAIN ] FSS: Loaded 33992 existing records. [2025-10-08T19:01:45.810793] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-08T19:01:45.812721] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-08T19:01:46.213459] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:01:46.279794] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-08T19:01:46.307501] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-08T19:01:46.332243] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T19:01:46.356727] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-08T19:01:46.363016] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-08T19:01:46.405531] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-08T19:01:46.505158] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:46.546671] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-08T19:01:46.878770] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-08T19:01:46.884158] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:01:47.217553] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-08T19:01:48.022681] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-08T19:01:48.050909] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:01:48.313531] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:01:48.404173] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:01:48.817550] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-08T19:01:49.617596] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-08T19:01:49.749584] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:01:50.251581] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:01:50.417561] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-08T19:01:50.837344] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:01:51.217560] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-08T19:01:52.017547] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-08T19:01:52.167562] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T19:01:52.547788] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T19:01:52.817594] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-08T19:01:53.372393] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:01:53.617560] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-08T19:01:54.402416] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:01:54.417511] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-08T19:01:55.197242] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:01:55.217499] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-08T19:01:56.017562] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-08T19:01:56.242348] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:01:56.754913] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T19:01:56.817493] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-08T19:01:57.494901] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:01:57.617580] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-08T19:01:58.193120] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:01:58.417571] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-08T19:01:59.217526] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-08T19:01:59.419344] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T19:01:59.876342] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:02:00.017570] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-08T19:02:00.822249] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-08T19:02:00.828881] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:02:01.385836] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:02:01.617563] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-08T19:02:02.417594] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-08T19:02:02.589490] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:02:03.226939] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-08T19:02:03.229901] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:02:04.017616] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-08T19:02:04.220147] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T19:02:04.225511] [INFO ] [REMOTE ] FSK: Full fetch complete (71662 records). [2025-10-08T19:02:04.225632] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-08T19:02:04.666673] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-08T19:02:04.666766] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-08T19:02:04.667619] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-08T19:02:04.667690] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-08T19:02:04.669069] [DEBUG] [LOCAL ] FSK: Trimmed 71662 records to 49404 (keeping 200 days of data) [2025-10-08T19:02:04.860637] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-08T19:02:04.996442] [DEBUG] [LOCAL ] FSK: Primary data saved (49404 records). [2025-10-08T19:02:04.996686] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-08T19:02:04.996854] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 38.5s. Estimated remaining: 3h 28m 60s. Rate: 7.2 symbols/min [2025-10-08T19:02:05.174109] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T19:02:05.218734] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:05.228081] [DEBUG] [LOCAL ] FT: Loaded 6560 existing records from primary storage. [2025-10-08T19:02:05.228336] [INFO ] [MAIN ] FT: Loaded 6560 existing records. [2025-10-08T19:02:05.411772] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:05.412140] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-08T19:02:05.412288] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-08T19:02:05.412885] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-08T19:02:05.412947] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-08T19:02:05.630285] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-08T19:02:05.815776] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T19:02:05.819318] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:05.894959] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:02:06.417540] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-08T19:02:07.075186] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T19:02:07.217555] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-08T19:02:07.500096] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T19:02:08.017602] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-08T19:02:08.428594] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:02:08.644819] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T19:02:08.817587] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-08T19:02:09.617629] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-08T19:02:10.417628] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-08T19:02:10.700616] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T19:02:11.017371] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:02:11.230478] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-08T19:02:11.241274] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:02:11.918609] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T19:02:12.017597] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-08T19:02:12.809588] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T19:02:12.817498] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-08T19:02:13.483395] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:02:13.617594] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-08T19:02:14.417566] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-08T19:02:15.102941] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:02:15.217611] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-08T19:02:15.763686] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T19:02:16.017618] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-08T19:02:16.605571] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:02:16.612213] [INFO ] [REMOTE ] FSLY: Full fetch complete (74873 records). [2025-10-08T19:02:16.612478] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-08T19:02:16.827500] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-08T19:02:17.064294] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-08T19:02:17.064542] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-08T19:02:17.066062] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-08T19:02:17.066183] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-08T19:02:17.085783] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:02:17.092126] [DEBUG] [LOCAL ] FSLY: Trimmed 74873 records to 51235 (keeping 200 days of data) [2025-10-08T19:02:17.445883] [DEBUG] [LOCAL ] FSLY: Primary data saved (51235 records). [2025-10-08T19:02:17.446134] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-08T19:02:17.446258] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 34.6s. Estimated remaining: 3h 28m 58s. Rate: 7.2 symbols/min [2025-10-08T19:02:17.622815] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-08T19:02:17.656196] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:17.672598] [DEBUG] [LOCAL ] FTHY: Loaded 12266 existing records from primary storage. [2025-10-08T19:02:17.673116] [INFO ] [MAIN ] FTHY: Loaded 12266 existing records. [2025-10-08T19:02:17.880107] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:17.880413] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-08T19:02:17.880467] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-08T19:02:17.881148] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-08T19:02:17.881214] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-08T19:02:18.341491] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:18.417612] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-08T19:02:18.657065] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:02:18.661411] [INFO ] [REMOTE ] FSS: Full fetch complete (48453 records). [2025-10-08T19:02:18.661576] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-08T19:02:18.945816] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-08T19:02:19.018633] [INFO ] [REMOTE ] FSM: Full fetch complete (76829 records). [2025-10-08T19:02:19.046162] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-08T19:02:19.157362] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-08T19:02:19.189323] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-08T19:02:19.223125] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-08T19:02:19.229475] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-08T19:02:19.235573] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-08T19:02:19.271711] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:02:19.321359] [DEBUG] [LOCAL ] FSS: Trimmed 48453 records to 33877 (keeping 200 days of data) [2025-10-08T19:02:19.773721] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-08T19:02:19.779329] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-08T19:02:19.786095] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-08T19:02:19.786283] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-08T19:02:19.861365] [DEBUG] [LOCAL ] FSM: Trimmed 76829 records to 53296 (keeping 200 days of data) [2025-10-08T19:02:19.931411] [DEBUG] [LOCAL ] FSS: Primary data saved (33877 records). [2025-10-08T19:02:19.943467] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-08T19:02:19.943779] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSS took 34.6s. Estimated remaining: 3h 28m 40s. Rate: 7.2 symbols/min [2025-10-08T19:02:19.981400] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T19:02:20.029535] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-08T19:02:20.208835] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:20.379422] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-08T19:02:20.386628] [INFO ] [MAIN ] FTI: Loaded 53292 existing records. [2025-10-08T19:02:20.612202] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:20.616089] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-08T19:02:20.616215] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-08T19:02:20.674266] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-08T19:02:20.675158] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-08T19:02:20.819580] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-08T19:02:20.859035] [DEBUG] [LOCAL ] FSM: Primary data saved (53296 records). [2025-10-08T19:02:20.865611] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-08T19:02:20.892800] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 35.8s. Estimated remaining: 3h 28m 19s. Rate: 7.2 symbols/min [2025-10-08T19:02:21.081705] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T19:02:21.173893] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:21.617545] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-08T19:02:21.624777] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T19:02:22.417596] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-08T19:02:23.143190] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T19:02:23.217621] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-08T19:02:23.383486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:02:23.851407] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T19:02:24.017569] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-08T19:02:24.817597] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-08T19:02:25.431940] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:02:25.452262] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T19:02:25.617549] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-08T19:02:26.211983] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:02:26.213416] [INFO ] [REMOTE ] FT: Full fetch complete (9186 records). [2025-10-08T19:02:26.213523] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-08T19:02:26.426686] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-08T19:02:26.611961] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-08T19:02:26.612075] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-08T19:02:26.612349] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-08T19:02:26.612390] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-08T19:02:26.613142] [DEBUG] [LOCAL ] FT: Trimmed 9186 records to 6607 (keeping 200 days of data) [2025-10-08T19:02:26.655854] [DEBUG] [LOCAL ] FT: Primary data saved (6607 records). [2025-10-08T19:02:26.655995] [INFO ] [MAIN ] FT: Full history saved. [2025-10-08T19:02:26.656083] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FT took 21.7s. Estimated remaining: 3h 28m 6s. Rate: 7.2 symbols/min [2025-10-08T19:02:26.888247] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T19:02:27.217588] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-08T19:02:28.017530] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-08T19:02:28.177099] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:02:28.817624] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-08T19:02:29.464586] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T19:02:29.511996] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:02:29.617613] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-08T19:02:30.417595] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-08T19:02:30.933228] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:02:31.217608] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-08T19:02:31.586968] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T19:02:32.017600] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-08T19:02:32.046702] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:02:32.817559] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-08T19:02:33.533760] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T19:02:33.617575] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-08T19:02:33.682855] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:02:34.191399] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:02:34.417613] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-08T19:02:35.217579] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-08T19:02:35.926000] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T19:02:35.928026] [INFO ] [REMOTE ] FTHY: Full fetch complete (17544 records). [2025-10-08T19:02:35.928135] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-08T19:02:36.362529] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-08T19:02:36.362697] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-08T19:02:36.363496] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-08T19:02:36.363598] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-08T19:02:36.364903] [DEBUG] [LOCAL ] FTHY: Trimmed 17544 records to 12273 (keeping 200 days of data) [2025-10-08T19:02:36.434486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T19:02:36.468582] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-08T19:02:36.495564] [DEBUG] [LOCAL ] FTHY: Primary data saved (12273 records). [2025-10-08T19:02:36.495734] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-08T19:02:36.495832] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 19.0s. Estimated remaining: 3h 28m 0s. Rate: 7.2 symbols/min [2025-10-08T19:02:38.283031] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T19:02:38.294957] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-08T19:02:40.109568] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:02:40.121458] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-08T19:02:41.660951] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:02:41.673871] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-08T19:02:43.454485] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:02:43.466447] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-08T19:02:45.170477] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-08T19:02:45.175384] [INFO ] [REMOTE ] FTI: Full fetch complete (77125 records). [2025-10-08T19:02:45.175540] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-08T19:02:45.672027] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-08T19:02:45.672118] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-08T19:02:45.673083] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-08T19:02:45.673151] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-08T19:02:45.674687] [DEBUG] [LOCAL ] FTI: Trimmed 77125 records to 53294 (keeping 200 days of data) [2025-10-08T19:02:46.008294] [DEBUG] [LOCAL ] FTI: Primary data saved (53294 records). [2025-10-08T19:02:46.008777] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-08T19:02:46.008916] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 26.1s. Estimated remaining: 3h 27m 54s. Rate: 7.2 symbols/min [2025-10-08T19:02:46.630614] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.704277] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.757812] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.761041] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:46.766600] [DEBUG] [LOCAL ] FTWO: Loaded 1866 existing records from primary storage. [2025-10-08T19:02:46.766962] [INFO ] [MAIN ] FTWO: Loaded 1866 existing records. [2025-10-08T19:02:46.972375] [DEBUG] [LOCAL ] FTK: Loaded 32577 existing records from primary storage. [2025-10-08T19:02:47.011389] [INFO ] [MAIN ] FTK: Loaded 32577 existing records. [2025-10-08T19:02:47.010615] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.057821] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.107470] [DEBUG] [LOCAL ] FTS: Loaded 42398 existing records from primary storage. [2025-10-08T19:02:47.096248] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-08T19:02:47.123731] [INFO ] [MAIN ] FTS: Loaded 42398 existing records. [2025-10-08T19:02:47.175723] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-08T19:02:47.182841] [DEBUG] [LOCAL ] FTV: Loaded 52985 existing records from primary storage. [2025-10-08T19:02:47.176044] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-08T19:02:47.228259] [INFO ] [MAIN ] FTV: Loaded 52985 existing records. [2025-10-08T19:02:47.409467] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.499481] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.508078] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-08T19:02:47.571345] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-08T19:02:47.622921] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-08T19:02:47.728924] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.839301] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.838986] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:47.885249] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-08T19:02:47.919844] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-08T19:02:47.885096] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-08T19:02:47.981735] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-08T19:02:47.981885] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-08T19:02:47.966842] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-08T19:02:48.057185] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-08T19:02:48.793579] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:48.849837] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-08T19:02:49.037742] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.048682] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-08T19:02:49.149730] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.189477] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:49.190028] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-08T19:02:49.189756] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-08T19:02:49.557196] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T19:02:49.559690] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-08T19:02:50.102739] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:02:50.107901] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-08T19:02:50.146963] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:02:50.148685] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-08T19:02:50.614798] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:02:50.625545] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-08T19:02:50.705815] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:02:50.707281] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-08T19:02:50.739708] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T19:02:50.748685] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-08T19:02:50.815892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:02:50.821571] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-08T19:02:51.073452] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T19:02:51.074669] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-08T19:02:51.467384] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T19:02:51.468532] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-08T19:02:51.815230] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T19:02:51.816323] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-08T19:02:52.093178] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:02:52.098319] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-08T19:02:52.374077] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:02:52.375528] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-08T19:02:52.410818] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T19:02:52.504927] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T19:02:52.817554] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-08T19:02:53.086168] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:02:53.166081] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:02:53.617693] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-08T19:02:53.936523] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:02:54.417771] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-08T19:02:55.217611] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-08T19:02:55.512270] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:02:55.735048] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T19:02:55.788631] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:02:56.017605] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-08T19:02:56.455954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T19:02:56.817578] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-08T19:02:57.617583] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-08T19:02:57.877892] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:02:58.117339] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:02:58.118215] [INFO ] [REMOTE ] FTWO: Full fetch complete (3324 records). [2025-10-08T19:02:58.118284] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-08T19:02:58.422672] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-08T19:02:58.477743] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-08T19:02:58.477827] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-08T19:02:58.477952] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-08T19:02:58.477988] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-08T19:02:58.478355] [DEBUG] [LOCAL ] FTWO: Trimmed 3324 records to 1882 (keeping 200 days of data) [2025-10-08T19:02:58.490489] [DEBUG] [LOCAL ] FTWO: Primary data saved (1882 records). [2025-10-08T19:02:58.490592] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-08T19:02:58.490763] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 12.5s. Estimated remaining: 3h 27m 52s. Rate: 7.2 symbols/min [2025-10-08T19:02:58.661993] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:02:58.713033] [DEBUG] [LOCAL ] FUBO: Loaded 53701 existing records from primary storage. [2025-10-08T19:02:58.713403] [INFO ] [MAIN ] FUBO: Loaded 53701 existing records. [2025-10-08T19:02:58.899831] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:02:58.900050] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-08T19:02:58.900096] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-08T19:02:58.901375] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-08T19:02:58.901436] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-08T19:02:59.222773] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-08T19:02:59.280594] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:02:59.757276] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:03:00.017616] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-08T19:03:00.654467] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:03:00.817585] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-08T19:03:01.617582] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-08T19:03:01.777177] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T19:03:02.417689] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-08T19:03:02.606007] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:03:02.647320] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:03:03.217619] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-08T19:03:04.017598] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-08T19:03:04.380963] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T19:03:04.817544] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-08T19:03:05.007317] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-08T19:03:05.617615] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-08T19:03:05.862562] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:03:06.423321] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-08T19:03:06.444740] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:03:07.217577] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-08T19:03:07.637220] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:03:07.731246] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-08T19:03:08.017600] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-08T19:03:08.328130] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:03:08.817614] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-08T19:03:09.423099] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:03:09.617615] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-08T19:03:10.365623] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:03:10.417535] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-08T19:03:11.217706] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-08T19:03:11.511849] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:03:11.790155] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:03:12.017619] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-08T19:03:12.211891] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T19:03:12.215983] [INFO ] [REMOTE ] FTK: Full fetch complete (43747 records). [2025-10-08T19:03:12.216150] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-08T19:03:12.629421] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-08T19:03:12.629810] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-08T19:03:12.630532] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-08T19:03:12.630597] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-08T19:03:12.632835] [DEBUG] [LOCAL ] FTK: Trimmed 43747 records to 32569 (keeping 200 days of data) [2025-10-08T19:03:12.819504] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-08T19:03:12.831709] [DEBUG] [LOCAL ] FTK: Primary data saved (32569 records). [2025-10-08T19:03:12.831878] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-08T19:03:12.832014] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTK took 26.8s. Estimated remaining: 3h 27m 54s. Rate: 7.2 symbols/min [2025-10-08T19:03:13.008840] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:13.042330] [DEBUG] [LOCAL ] FUL: Loaded 32878 existing records from primary storage. [2025-10-08T19:03:13.042737] [INFO ] [MAIN ] FUL: Loaded 32878 existing records. [2025-10-08T19:03:13.225029] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:13.225254] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-08T19:03:13.225301] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-08T19:03:13.226175] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-08T19:03:13.226237] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-08T19:03:13.597279] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:13.617515] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-08T19:03:13.768988] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:03:14.364829] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:03:14.420684] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-08T19:03:14.425235] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:03:15.217561] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-08T19:03:16.017538] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-08T19:03:16.075115] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:03:16.696382] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:03:16.817558] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-08T19:03:17.617556] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-08T19:03:17.878368] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:03:18.063823] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-08T19:03:18.417611] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-08T19:03:19.217572] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-08T19:03:19.416405] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:03:19.875268] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T19:03:19.879289] [INFO ] [REMOTE ] FTS: Full fetch complete (60234 records). [2025-10-08T19:03:19.879434] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-08T19:03:20.022691] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-08T19:03:20.292295] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-08T19:03:20.292404] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-08T19:03:20.293240] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-08T19:03:20.293315] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-08T19:03:20.294883] [DEBUG] [LOCAL ] FTS: Trimmed 60234 records to 42429 (keeping 200 days of data) [2025-10-08T19:03:20.551938] [DEBUG] [LOCAL ] FTS: Primary data saved (42429 records). [2025-10-08T19:03:20.552086] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-08T19:03:20.552176] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTS took 34.5s. Estimated remaining: 3h 27m 45s. Rate: 7.2 symbols/min [2025-10-08T19:03:20.718685] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:20.768860] [DEBUG] [LOCAL ] FUN: Loaded 51731 existing records from primary storage. [2025-10-08T19:03:20.769272] [INFO ] [MAIN ] FUN: Loaded 51731 existing records. [2025-10-08T19:03:20.831185] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-08T19:03:20.948700] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:20.949001] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-08T19:03:20.949053] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-08T19:03:20.950352] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-08T19:03:20.950411] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-08T19:03:21.311206] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:21.342515] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T19:03:21.596705] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:03:21.617492] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-08T19:03:22.417515] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-08T19:03:22.658353] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:03:22.713438] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:03:23.217558] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-08T19:03:24.017568] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-08T19:03:24.615619] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-08T19:03:24.817537] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-08T19:03:24.932527] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:03:25.522312] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:03:25.617573] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-08T19:03:25.711140] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:03:26.417536] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-08T19:03:27.217624] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-08T19:03:27.354161] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T19:03:28.017562] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-08T19:03:28.347575] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:03:28.817785] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-08T19:03:28.842196] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:03:28.846163] [INFO ] [REMOTE ] FTV: Full fetch complete (76402 records). [2025-10-08T19:03:28.846265] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-08T19:03:29.256937] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-08T19:03:29.257055] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-08T19:03:29.258014] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-08T19:03:29.258096] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-08T19:03:29.260001] [DEBUG] [LOCAL ] FTV: Trimmed 76402 records to 52988 (keeping 200 days of data) [2025-10-08T19:03:29.389001] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:03:29.617682] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-08T19:03:29.621919] [DEBUG] [LOCAL ] FTV: Primary data saved (52988 records). [2025-10-08T19:03:29.621995] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-08T19:03:29.622070] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 43.6s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-08T19:03:29.792451] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:29.814599] [DEBUG] [LOCAL ] FVR: Loaded 21680 existing records from primary storage. [2025-10-08T19:03:29.814875] [INFO ] [MAIN ] FVR: Loaded 21680 existing records. [2025-10-08T19:03:29.993828] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:29.994064] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-08T19:03:29.994136] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-08T19:03:29.994892] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-08T19:03:29.994954] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-08T19:03:30.291992] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:03:30.382419] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:30.417488] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-08T19:03:31.085155] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:03:31.217524] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-08T19:03:31.486673] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:03:32.017574] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-08T19:03:32.817560] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-08T19:03:32.891250] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:03:33.369295] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:03:33.581676] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:03:33.617599] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-08T19:03:34.417571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-08T19:03:34.709806] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T19:03:35.217734] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-08T19:03:36.017567] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-08T19:03:36.537568] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:03:36.672577] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-08T19:03:36.817571] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-08T19:03:36.939698] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:03:37.617564] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-08T19:03:38.417545] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-08T19:03:39.130888] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-08T19:03:39.182717] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:03:39.217546] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-08T19:03:39.436904] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:03:40.017561] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-08T19:03:40.817559] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-08T19:03:41.315032] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:03:41.317796] [INFO ] [REMOTE ] FUL: Full fetch complete (47855 records). [2025-10-08T19:03:41.317920] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-08T19:03:41.620447] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-08T19:03:41.668598] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-08T19:03:41.721384] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-08T19:03:41.733078] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-08T19:03:41.849539] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-08T19:03:41.882226] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-08T19:03:41.898932] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-08T19:03:41.904164] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-08T19:03:42.057400] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:03:42.046779] [DEBUG] [LOCAL ] FUL: Trimmed 47855 records to 32850 (keeping 200 days of data) [2025-10-08T19:03:42.289988] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-08T19:03:42.290350] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-08T19:03:42.292170] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-08T19:03:42.292509] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-08T19:03:42.302370] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 53705 (keeping 200 days of data) [2025-10-08T19:03:42.420288] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-08T19:03:42.610996] [DEBUG] [LOCAL ] FUL: Primary data saved (32850 records). [2025-10-08T19:03:42.612952] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-08T19:03:42.615864] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUL took 29.8s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-08T19:03:42.804896] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:42.906413] [DEBUG] [LOCAL ] FVRR: Loaded 40180 existing records from primary storage. [2025-10-08T19:03:42.908082] [INFO ] [MAIN ] FVRR: Loaded 40180 existing records. [2025-10-08T19:03:42.976272] [DEBUG] [LOCAL ] FUBO: Primary data saved (53705 records). [2025-10-08T19:03:42.998001] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-08T19:03:43.016141] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 44.5s. Estimated remaining: 3h 27m 15s. Rate: 7.2 symbols/min [2025-10-08T19:03:43.209797] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:43.225582] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-08T19:03:43.225792] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-08T19:03:43.246605] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-08T19:03:43.277771] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-08T19:03:43.281355] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:43.366494] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-08T19:03:43.366890] [INFO ] [MAIN ] FXED: Loaded 1252 existing records. [2025-10-08T19:03:43.741952] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:43.804564] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-08T19:03:43.858686] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-08T19:03:43.890168] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:03:43.888066] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:43.896948] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-08T19:03:43.899290] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-08T19:03:43.912148] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-08T19:03:43.915989] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-08T19:03:44.022752] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-08T19:03:44.299273] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:44.817581] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-08T19:03:45.030169] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:03:45.209851] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:03:45.617629] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-08T19:03:45.981271] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:03:46.417539] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-08T19:03:47.013802] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T19:03:47.217539] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-08T19:03:47.628995] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:03:48.017604] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-08T19:03:48.684244] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T19:03:48.817579] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-08T19:03:49.033477] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T19:03:49.617574] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-08T19:03:50.417513] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-08T19:03:50.530273] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:03:50.859845] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T19:03:51.121558] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:03:51.217552] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-08T19:03:52.017625] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-08T19:03:52.346387] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:03:52.696335] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:03:52.817559] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-08T19:03:53.617632] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-08T19:03:54.033231] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T19:03:54.417599] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-08T19:03:55.217593] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-08T19:03:55.403948] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T19:03:55.409102] [INFO ] [REMOTE ] FUN: Full fetch complete (72981 records). [2025-10-08T19:03:55.409287] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-08T19:03:55.877514] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-08T19:03:55.877745] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-08T19:03:55.878940] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-08T19:03:55.879430] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-08T19:03:55.882230] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:03:55.893181] [DEBUG] [LOCAL ] FUN: Trimmed 72981 records to 51776 (keeping 200 days of data) [2025-10-08T19:03:55.910488] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T19:03:56.018263] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-08T19:03:56.223690] [DEBUG] [LOCAL ] FUN: Primary data saved (51776 records). [2025-10-08T19:03:56.223837] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-08T19:03:56.223920] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUN took 35.7s. Estimated remaining: 3h 27m 15s. Rate: 7.2 symbols/min [2025-10-08T19:03:56.391018] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:56.437127] [DEBUG] [LOCAL ] G: Loaded 49989 existing records from primary storage. [2025-10-08T19:03:56.437444] [INFO ] [MAIN ] G: Loaded 49989 existing records. [2025-10-08T19:03:56.616167] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:03:56.616747] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-08T19:03:56.616849] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-08T19:03:56.618839] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-08T19:03:56.618901] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-08T19:03:56.822741] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-08T19:03:56.991881] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:03:57.013694] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:03:57.214539] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T19:03:57.617634] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-08T19:03:57.913750] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:03:58.417576] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-08T19:03:59.170267] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:03:59.171984] [INFO ] [REMOTE ] FVR: Full fetch complete (29780 records). [2025-10-08T19:03:59.172062] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-08T19:03:59.227620] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-08T19:03:59.593362] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-08T19:03:59.593444] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-08T19:03:59.593982] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-08T19:03:59.594043] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-08T19:03:59.594885] [DEBUG] [LOCAL ] FVR: Trimmed 29780 records to 21569 (keeping 200 days of data) [2025-10-08T19:03:59.691563] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:03:59.741456] [DEBUG] [LOCAL ] FVR: Primary data saved (21569 records). [2025-10-08T19:03:59.741622] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-08T19:03:59.741770] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FVR took 30.1s. Estimated remaining: 3h 26m 58s. Rate: 7.2 symbols/min [2025-10-08T19:03:59.917680] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:03:59.945044] [DEBUG] [LOCAL ] GAB: Loaded 27802 existing records from primary storage. [2025-10-08T19:03:59.945379] [INFO ] [MAIN ] GAB: Loaded 27802 existing records. [2025-10-08T19:04:00.022757] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-08T19:04:00.125590] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:00.125822] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-08T19:04:00.125869] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-08T19:04:00.126774] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-08T19:04:00.126835] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-08T19:04:00.482023] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:00.817558] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-08T19:04:01.466017] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:04:01.617613] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-08T19:04:02.417545] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-08T19:04:02.457807] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:04:02.886582] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:04:03.217575] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-08T19:04:03.843921] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:04:03.908765] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:04:04.017586] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-08T19:04:04.287250] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T19:04:04.817591] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-08T19:04:05.617577] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-08T19:04:05.943927] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:04:06.068517] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T19:04:06.417583] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-08T19:04:06.843014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:04:07.217563] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-08T19:04:08.017586] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-08T19:04:08.784015] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:04:08.817503] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-08T19:04:09.617560] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-08T19:04:09.656710] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:04:10.089618] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T19:04:10.209750] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:04:10.210494] [INFO ] [REMOTE ] FXED: Full fetch complete (1803 records). [2025-10-08T19:04:10.210565] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-08T19:04:10.423155] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-08T19:04:10.604358] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-08T19:04:10.604443] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-08T19:04:10.604561] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-08T19:04:10.604621] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-08T19:04:10.605033] [DEBUG] [LOCAL ] FXED: Trimmed 1803 records to 1252 (keeping 200 days of data) [2025-10-08T19:04:10.614737] [DEBUG] [LOCAL ] FXED: Primary data saved (1252 records). [2025-10-08T19:04:10.614874] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-08T19:04:10.614961] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FXED took 27.6s. Estimated remaining: 3h 26m 54s. Rate: 7.2 symbols/min [2025-10-08T19:04:10.858000] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:10.864013] [DEBUG] [LOCAL ] GAM: Loaded 4015 existing records from primary storage. [2025-10-08T19:04:10.864303] [INFO ] [MAIN ] GAM: Loaded 4015 existing records. [2025-10-08T19:04:11.112205] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:11.112517] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-08T19:04:11.112580] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-08T19:04:11.112954] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-08T19:04:11.113027] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-08T19:04:11.222787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-08T19:04:11.694487] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:12.022263] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-08T19:04:12.028970] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:04:12.063739] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T19:04:12.817752] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-08T19:04:13.492272] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:04:13.497189] [INFO ] [REMOTE ] FVRR: Full fetch complete (59178 records). [2025-10-08T19:04:13.497318] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-08T19:04:13.622758] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-08T19:04:14.015861] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-08T19:04:14.015964] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-08T19:04:14.016937] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-08T19:04:14.017022] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-08T19:04:14.018539] [DEBUG] [LOCAL ] FVRR: Trimmed 59178 records to 40243 (keeping 200 days of data) [2025-10-08T19:04:14.318937] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:04:14.343047] [DEBUG] [LOCAL ] FVRR: Primary data saved (40243 records). [2025-10-08T19:04:14.343204] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-08T19:04:14.343294] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FVRR took 31.7s. Estimated remaining: 3h 26m 38s. Rate: 7.2 symbols/min [2025-10-08T19:04:14.422901] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-08T19:04:14.492859] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T19:04:14.560360] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:14.614314] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-08T19:04:14.614720] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-08T19:04:14.787318] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:14.787555] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-08T19:04:14.787604] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-08T19:04:14.789088] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-08T19:04:14.789151] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-08T19:04:15.133467] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:15.217497] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-08T19:04:15.882577] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:04:16.017571] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-08T19:04:16.822743] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-08T19:04:16.844982] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:04:17.467329] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T19:04:17.617558] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-08T19:04:17.832817] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T19:04:18.235403] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T19:04:18.417584] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-08T19:04:19.217530] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-08T19:04:19.552701] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T19:04:19.844471] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T19:04:20.017546] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-08T19:04:20.817575] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-08T19:04:21.293230] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:04:21.617560] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-08T19:04:22.340515] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:04:22.354467] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:04:22.417582] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-08T19:04:23.217691] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-08T19:04:23.641211] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:04:24.017594] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-08T19:04:24.621881] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:04:24.658035] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:04:24.817532] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-08T19:04:25.617577] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-08T19:04:26.384357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:04:26.417507] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-08T19:04:26.722100] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:04:26.987946] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:04:27.217560] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-08T19:04:28.017561] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-08T19:04:28.500177] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:04:28.832802] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-08T19:04:28.857354] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:04:29.512638] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T19:04:29.617572] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-08T19:04:30.417559] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-08T19:04:30.856974] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T19:04:31.217563] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-08T19:04:31.860440] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:04:32.017551] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-08T19:04:32.817553] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-08T19:04:33.087343] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T19:04:33.617570] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-08T19:04:33.962152] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T19:04:33.979738] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:04:33.981783] [INFO ] [REMOTE ] GAB: Full fetch complete (39463 records). [2025-10-08T19:04:33.981883] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-08T19:04:34.374236] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-08T19:04:34.374329] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-08T19:04:34.375042] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-08T19:04:34.375107] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-08T19:04:34.376007] [DEBUG] [LOCAL ] GAB: Trimmed 39463 records to 27641 (keeping 200 days of data) [2025-10-08T19:04:34.425493] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-08T19:04:34.539448] [DEBUG] [LOCAL ] GAB: Primary data saved (27641 records). [2025-10-08T19:04:34.539584] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-08T19:04:34.539689] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAB took 34.8s. Estimated remaining: 3h 26m 49s. Rate: 7.2 symbols/min [2025-10-08T19:04:34.735298] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:34.756549] [DEBUG] [LOCAL ] GATX: Loaded 18153 existing records from primary storage. [2025-10-08T19:04:34.756858] [INFO ] [MAIN ] GATX: Loaded 18153 existing records. [2025-10-08T19:04:34.968178] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:34.968464] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-08T19:04:34.968537] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-08T19:04:34.969336] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-08T19:04:34.969405] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-08T19:04:35.217507] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-08T19:04:35.372445] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:35.400273] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:04:35.677826] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T19:04:36.017534] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-08T19:04:36.415618] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:04:36.817573] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-08T19:04:37.024937] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T19:04:37.319306] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T19:04:37.617534] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-08T19:04:38.198306] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T19:04:38.199371] [INFO ] [REMOTE ] GAM: Full fetch complete (6654 records). [2025-10-08T19:04:38.199469] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-08T19:04:38.422739] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-08T19:04:38.628048] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-08T19:04:38.628133] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-08T19:04:38.628331] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-08T19:04:38.628369] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-08T19:04:38.628821] [DEBUG] [LOCAL ] GAM: Trimmed 6654 records to 4028 (keeping 200 days of data) [2025-10-08T19:04:38.652076] [DEBUG] [LOCAL ] GAM: Primary data saved (4028 records). [2025-10-08T19:04:38.652163] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-08T19:04:38.652255] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 28.0s. Estimated remaining: 3h 26m 34s. Rate: 7.2 symbols/min [2025-10-08T19:04:38.830416] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:38.845150] [DEBUG] [LOCAL ] GBAB: Loaded 13001 existing records from primary storage. [2025-10-08T19:04:38.845405] [INFO ] [MAIN ] GBAB: Loaded 13001 existing records. [2025-10-08T19:04:39.017009] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:39.017299] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-08T19:04:39.017351] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-08T19:04:39.017843] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-08T19:04:39.017902] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-08T19:04:39.221777] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-08T19:04:39.370478] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:39.380228] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T19:04:40.017565] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-08T19:04:40.822814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-08T19:04:40.833107] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:04:41.182701] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T19:04:41.617561] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-08T19:04:42.100941] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:04:42.104884] [INFO ] [REMOTE ] G: Full fetch complete (71753 records). [2025-10-08T19:04:42.105010] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-08T19:04:42.417852] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-08T19:04:42.431563] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:04:42.519575] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-08T19:04:42.519691] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-08T19:04:42.520728] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-08T19:04:42.520808] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-08T19:04:42.522962] [DEBUG] [LOCAL ] G: Trimmed 71753 records to 49981 (keeping 200 days of data) [2025-10-08T19:04:42.833068] [DEBUG] [LOCAL ] G: Primary data saved (49981 records). [2025-10-08T19:04:42.833209] [INFO ] [MAIN ] G: Full history saved. [2025-10-08T19:04:42.833295] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 46.6s. Estimated remaining: 3h 26m 18s. Rate: 7.2 symbols/min [2025-10-08T19:04:43.000735] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:43.043585] [DEBUG] [LOCAL ] GBCI: Loaded 40500 existing records from primary storage. [2025-10-08T19:04:43.043990] [INFO ] [MAIN ] GBCI: Loaded 40500 existing records. [2025-10-08T19:04:43.217568] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:04:43.217680] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-08T19:04:43.218002] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-08T19:04:43.218078] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-08T19:04:43.220254] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-08T19:04:43.220317] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-08T19:04:43.570060] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:44.017529] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-08T19:04:44.179925] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:04:44.359236] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T19:04:44.679715] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T19:04:44.817632] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-08T19:04:45.617572] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-08T19:04:45.632984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T19:04:46.417598] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-08T19:04:47.217573] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-08T19:04:47.607472] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T19:04:47.635232] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T19:04:48.017892] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-08T19:04:48.347882] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:04:48.817589] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-08T19:04:49.036313] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:04:49.308510] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:04:49.617569] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-08T19:04:50.370330] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T19:04:50.417524] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-08T19:04:50.937550] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T19:04:51.217553] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-08T19:04:52.017556] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-08T19:04:52.817580] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-08T19:04:53.158045] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:04:53.386244] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T19:04:53.599240] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T19:04:53.617493] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-08T19:04:54.417547] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-08T19:04:54.993456] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:04:55.217608] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-08T19:04:55.945759] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T19:04:56.017509] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-08T19:04:56.216676] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:04:56.817524] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-08T19:04:57.617585] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-08T19:04:57.651895] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:04:57.656140] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-08T19:04:57.656286] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-08T19:04:57.850273] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T19:04:58.066345] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-08T19:04:58.066437] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-08T19:04:58.067387] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-08T19:04:58.067452] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-08T19:04:58.069936] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 53652 (keeping 200 days of data) [2025-10-08T19:04:58.406018] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:04:58.417722] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-08T19:04:58.428496] [DEBUG] [LOCAL ] GAP: Primary data saved (53652 records). [2025-10-08T19:04:58.428698] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-08T19:04:58.428825] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 44.1s. Estimated remaining: 3h 26m 22s. Rate: 7.2 symbols/min [2025-10-08T19:04:58.611501] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:04:58.611737] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-08T19:04:58.611786] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-08T19:04:58.611917] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-08T19:04:58.611970] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-08T19:04:58.612037] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-08T19:04:58.612072] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-08T19:04:58.983744] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:04:59.217590] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-08T19:04:59.242162] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:05:00.017526] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-08T19:05:00.028163] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:05:00.817561] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-08T19:05:01.345928] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:05:01.617550] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-08T19:05:02.310504] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:05:02.417617] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-08T19:05:02.845371] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T19:05:02.847032] [INFO ] [REMOTE ] GATX: Full fetch complete (25061 records). [2025-10-08T19:05:02.847130] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-08T19:05:03.228069] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-08T19:05:03.413759] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-08T19:05:03.413889] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-08T19:05:03.414768] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-08T19:05:03.414834] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-08T19:05:03.415940] [DEBUG] [LOCAL ] GATX: Trimmed 25061 records to 18143 (keeping 200 days of data) [2025-10-08T19:05:03.555138] [DEBUG] [LOCAL ] GATX: Primary data saved (18143 records). [2025-10-08T19:05:03.555311] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-08T19:05:03.555421] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 29.0s. Estimated remaining: 3h 26m 8s. Rate: 7.2 symbols/min [2025-10-08T19:05:03.727933] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:03.766583] [DEBUG] [LOCAL ] GBTG: Loaded 40073 existing records from primary storage. [2025-10-08T19:05:03.766915] [INFO ] [MAIN ] GBTG: Loaded 40073 existing records. [2025-10-08T19:05:03.942543] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:03.942832] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-08T19:05:03.942894] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-08T19:05:03.943827] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-08T19:05:03.943888] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-08T19:05:04.027458] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-08T19:05:04.047117] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T19:05:04.354275] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:04.817566] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-08T19:05:05.295783] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T19:05:05.617583] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-08T19:05:05.806371] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:05:06.093051] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-08T19:05:06.094395] [INFO ] [REMOTE ] GBAB: Full fetch complete (19542 records). [2025-10-08T19:05:06.094469] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-08T19:05:06.422811] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-08T19:05:06.465981] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-08T19:05:06.466071] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-08T19:05:06.466536] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-08T19:05:06.466578] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-08T19:05:06.467198] [DEBUG] [LOCAL ] GBAB: Trimmed 19542 records to 13043 (keeping 200 days of data) [2025-10-08T19:05:06.554192] [DEBUG] [LOCAL ] GBAB: Primary data saved (13043 records). [2025-10-08T19:05:06.554362] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-08T19:05:06.554453] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 27.9s. Estimated remaining: 3h 25m 51s. Rate: 7.2 symbols/min [2025-10-08T19:05:06.734375] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:06.768260] [DEBUG] [LOCAL ] GBX: Loaded 29133 existing records from primary storage. [2025-10-08T19:05:06.768637] [INFO ] [MAIN ] GBX: Loaded 29133 existing records. [2025-10-08T19:05:06.948158] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:06.948388] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-08T19:05:06.948460] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-08T19:05:06.949454] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-08T19:05:06.949515] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-08T19:05:07.228707] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-08T19:05:07.234757] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:05:07.325054] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:07.350430] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:05:08.017615] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-08T19:05:08.310152] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-08T19:05:08.337119] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:05:08.817566] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-08T19:05:09.156185] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-08T19:05:09.617602] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-08T19:05:09.930117] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-08T19:05:10.417558] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-08T19:05:10.881680] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:05:11.217609] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-08T19:05:11.492544] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T19:05:12.017545] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-08T19:05:12.367604] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T19:05:12.817677] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-08T19:05:13.617558] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-08T19:05:14.124971] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:05:14.227398] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T19:05:14.417540] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-08T19:05:15.217621] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-08T19:05:15.395026] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T19:05:16.017561] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-08T19:05:16.805372] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T19:05:16.817483] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-08T19:05:17.589880] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:05:17.617507] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-08T19:05:18.089111] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T19:05:18.417548] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-08T19:05:19.118326] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T19:05:19.217563] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-08T19:05:19.356504] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T19:05:19.486367] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-08T19:05:20.017574] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-08T19:05:20.407062] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T19:05:20.408030] [INFO ] [REMOTE ] GBLI: Full fetch complete (1310 records). [2025-10-08T19:05:20.408119] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-08T19:05:20.600360] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-08T19:05:20.600593] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:05:20.600686] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:05:20.600757] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-08T19:05:20.600837] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-08T19:05:20.600892] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-08T19:05:20.600936] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-08T19:05:20.601010] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBLI took 22.2s. Estimated remaining: 3h 25m 52s. Rate: 7.2 symbols/min [2025-10-08T19:05:20.769491] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:20.812955] [DEBUG] [LOCAL ] GCI: Loaded 44112 existing records from primary storage. [2025-10-08T19:05:20.813377] [INFO ] [MAIN ] GCI: Loaded 44112 existing records. [2025-10-08T19:05:20.824167] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-08T19:05:20.996213] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:20.996435] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-08T19:05:20.996482] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-08T19:05:20.997909] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-08T19:05:20.997973] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-08T19:05:21.362809] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:21.617554] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-08T19:05:22.417542] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-08T19:05:22.653527] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:05:22.738917] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:05:23.217560] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-08T19:05:23.551406] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:05:24.017549] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-08T19:05:24.407166] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T19:05:24.817579] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-08T19:05:25.223552] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T19:05:25.617568] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-08T19:05:26.166920] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:05:26.417537] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-08T19:05:26.837545] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:05:27.217606] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-08T19:05:27.730999] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T19:05:28.017572] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-08T19:05:28.751264] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:05:28.817576] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-08T19:05:29.558638] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:05:29.562699] [INFO ] [REMOTE ] GBCI: Full fetch complete (58587 records). [2025-10-08T19:05:29.562841] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-08T19:05:29.629738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-08T19:05:29.964126] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-08T19:05:29.964236] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-08T19:05:29.965211] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-08T19:05:29.965363] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-08T19:05:30.000935] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:05:29.999783] [DEBUG] [LOCAL ] GBCI: Trimmed 58587 records to 40512 (keeping 200 days of data) [2025-10-08T19:05:30.258956] [DEBUG] [LOCAL ] GBCI: Primary data saved (40512 records). [2025-10-08T19:05:30.259087] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-08T19:05:30.259164] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBCI took 47.4s. Estimated remaining: 3h 25m 46s. Rate: 7.2 symbols/min [2025-10-08T19:05:30.426711] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-08T19:05:30.430002] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:30.453915] [DEBUG] [LOCAL ] GCO: Loaded 24194 existing records from primary storage. [2025-10-08T19:05:30.454183] [INFO ] [MAIN ] GCO: Loaded 24194 existing records. [2025-10-08T19:05:30.628747] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:30.628983] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-08T19:05:30.629047] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-08T19:05:30.629844] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-08T19:05:30.629904] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-08T19:05:30.985143] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:31.217548] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-08T19:05:31.344001] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:05:31.412056] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T19:05:32.017555] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-08T19:05:32.447869] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T19:05:32.817549] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-08T19:05:33.047987] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:05:33.617609] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-08T19:05:34.040008] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:05:34.417511] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-08T19:05:34.743728] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:05:35.217602] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-08T19:05:36.017540] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-08T19:05:36.156491] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:05:36.250111] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:05:36.689373] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T19:05:36.817621] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-08T19:05:37.617555] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-08T19:05:38.195856] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T19:05:38.417555] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-08T19:05:39.061524] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T19:05:39.217523] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-08T19:05:39.474760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:05:39.477874] [INFO ] [REMOTE ] GBTG: Full fetch complete (56533 records). [2025-10-08T19:05:39.477956] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-08T19:05:39.857582] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-08T19:05:39.857687] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-08T19:05:39.858465] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-08T19:05:39.858529] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-08T19:05:39.859672] [DEBUG] [LOCAL ] GBTG: Trimmed 56533 records to 40036 (keeping 200 days of data) [2025-10-08T19:05:40.025449] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-08T19:05:40.087551] [DEBUG] [LOCAL ] GBTG: Primary data saved (40036 records). [2025-10-08T19:05:40.087692] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-08T19:05:40.087814] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBTG took 36.5s. Estimated remaining: 3h 25m 40s. Rate: 7.2 symbols/min [2025-10-08T19:05:40.263488] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:40.284722] [DEBUG] [LOCAL ] GCTS: Loaded 20339 existing records from primary storage. [2025-10-08T19:05:40.284975] [INFO ] [MAIN ] GCTS: Loaded 20339 existing records. [2025-10-08T19:05:40.460566] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T19:05:40.509259] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:40.509713] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-08T19:05:40.510312] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-08T19:05:40.510948] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-08T19:05:40.511015] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-08T19:05:40.822779] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-08T19:05:40.862145] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:40.945681] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:05:41.617573] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-08T19:05:41.881898] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:05:42.417528] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-08T19:05:42.514498] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:05:43.217571] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-08T19:05:43.740937] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:05:44.017573] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-08T19:05:44.403484] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:05:44.405796] [INFO ] [REMOTE ] GBX: Full fetch complete (42716 records). [2025-10-08T19:05:44.405874] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-08T19:05:44.803766] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-08T19:05:44.803866] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-08T19:05:44.804539] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-08T19:05:44.804580] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-08T19:05:44.805461] [DEBUG] [LOCAL ] GBX: Trimmed 42716 records to 29122 (keeping 200 days of data) [2025-10-08T19:05:44.861144] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-08T19:05:44.984335] [DEBUG] [LOCAL ] GBX: Primary data saved (29122 records). [2025-10-08T19:05:44.984502] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-08T19:05:44.984603] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBX took 38.4s. Estimated remaining: 3h 25m 26s. Rate: 7.2 symbols/min [2025-10-08T19:05:45.154151] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:45.162720] [DEBUG] [LOCAL ] GCV: Loaded 7535 existing records from primary storage. [2025-10-08T19:05:45.162948] [INFO ] [MAIN ] GCV: Loaded 7535 existing records. [2025-10-08T19:05:45.341068] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:45.341283] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-08T19:05:45.341330] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-08T19:05:45.341873] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-08T19:05:45.341933] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-08T19:05:45.623201] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-08T19:05:45.706341] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:05:45.733820] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:05:46.209588] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:05:46.321511] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:05:46.417564] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-08T19:05:47.217610] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-08T19:05:48.023069] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-08T19:05:48.035284] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:05:48.094284] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T19:05:48.449345] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T19:05:48.817638] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-08T19:05:49.282898] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T19:05:49.617583] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-08T19:05:50.417577] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-08T19:05:50.636400] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T19:05:51.217589] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-08T19:05:51.834738] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:05:52.017599] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-08T19:05:52.097428] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:05:52.798529] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:05:52.817504] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-08T19:05:53.617516] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-08T19:05:53.907977] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:05:54.121694] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T19:05:54.417551] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-08T19:05:54.930756] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T19:05:55.217567] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-08T19:05:56.017620] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-08T19:05:56.731873] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:05:56.817579] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-08T19:05:57.127307] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T19:05:57.617586] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-08T19:05:58.158245] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:05:58.161701] [INFO ] [REMOTE ] GCI: Full fetch complete (63239 records). [2025-10-08T19:05:58.161802] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-08T19:05:58.294016] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T19:05:58.422726] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-08T19:05:58.603597] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-08T19:05:58.603780] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-08T19:05:58.604783] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-08T19:05:58.604854] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-08T19:05:58.606337] [DEBUG] [LOCAL ] GCI: Trimmed 63239 records to 44080 (keeping 200 days of data) [2025-10-08T19:05:58.854594] [DEBUG] [LOCAL ] GCI: Primary data saved (44080 records). [2025-10-08T19:05:58.854774] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-08T19:05:58.854871] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 38.3s. Estimated remaining: 3h 25m 26s. Rate: 7.2 symbols/min [2025-10-08T19:05:59.024900] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:05:59.068382] [DEBUG] [LOCAL ] GD: Loaded 46964 existing records from primary storage. [2025-10-08T19:05:59.068788] [INFO ] [MAIN ] GD: Loaded 46964 existing records. [2025-10-08T19:05:59.176946] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:05:59.223891] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-08T19:05:59.268769] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:05:59.268994] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-08T19:05:59.269042] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-08T19:05:59.270893] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-08T19:05:59.270977] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-08T19:05:59.629477] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:00.017628] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-08T19:06:00.429985] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:06:00.619010] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:06:00.817548] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-08T19:06:01.617521] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-08T19:06:01.635569] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T19:06:01.637889] [INFO ] [REMOTE ] GCO: Full fetch complete (35302 records). [2025-10-08T19:06:01.638017] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-08T19:06:02.103850] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-08T19:06:02.103971] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-08T19:06:02.104746] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-08T19:06:02.104811] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-08T19:06:02.105682] [DEBUG] [LOCAL ] GCO: Trimmed 35302 records to 24065 (keeping 200 days of data) [2025-10-08T19:06:02.253000] [DEBUG] [LOCAL ] GCO: Primary data saved (24065 records). [2025-10-08T19:06:02.253141] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-08T19:06:02.253224] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCO took 32.0s. Estimated remaining: 3h 25m 10s. Rate: 7.2 symbols/min [2025-10-08T19:06:02.420843] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:02.418097] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-08T19:06:02.468365] [DEBUG] [LOCAL ] GDDY: Loaded 49795 existing records from primary storage. [2025-10-08T19:06:02.468780] [INFO ] [MAIN ] GDDY: Loaded 49795 existing records. [2025-10-08T19:06:02.631764] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:06:02.666077] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:02.666728] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-08T19:06:02.666815] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-08T19:06:02.668176] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-08T19:06:02.668234] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-08T19:06:03.022122] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:03.183420] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:06:03.217551] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-08T19:06:03.811454] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:06:04.017556] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-08T19:06:04.817601] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-08T19:06:04.911468] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T19:06:05.617549] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-08T19:06:06.417520] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-08T19:06:06.688886] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T19:06:07.017810] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:06:07.217561] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-08T19:06:07.262162] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:06:08.017509] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-08T19:06:08.395314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:06:08.817587] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-08T19:06:09.617532] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-08T19:06:09.974765] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T19:06:10.270435] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:06:10.372360] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:06:10.373682] [INFO ] [REMOTE ] GCV: Full fetch complete (9616 records). [2025-10-08T19:06:10.373757] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-08T19:06:10.427736] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-08T19:06:10.743041] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-08T19:06:10.743125] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-08T19:06:10.743362] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-08T19:06:10.743401] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-08T19:06:10.743863] [DEBUG] [LOCAL ] GCV: Trimmed 9616 records to 7565 (keeping 200 days of data) [2025-10-08T19:06:10.787435] [DEBUG] [LOCAL ] GCV: Primary data saved (7565 records). [2025-10-08T19:06:10.787558] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-08T19:06:10.787639] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCV took 25.8s. Estimated remaining: 3h 25m 2s. Rate: 7.2 symbols/min [2025-10-08T19:06:10.959512] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:10.964619] [DEBUG] [LOCAL ] GDIV: Loaded 3613 existing records from primary storage. [2025-10-08T19:06:10.964809] [INFO ] [MAIN ] GDIV: Loaded 3613 existing records. [2025-10-08T19:06:11.149393] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:11.149759] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-08T19:06:11.149819] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-08T19:06:11.150138] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-08T19:06:11.150197] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-08T19:06:11.224507] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-08T19:06:11.502942] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:12.017577] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-08T19:06:12.203919] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:06:12.513603] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:06:12.817559] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-08T19:06:13.617521] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-08T19:06:13.788329] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:06:13.955054] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-08T19:06:14.206374] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T19:06:14.417552] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-08T19:06:15.217574] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-08T19:06:16.017601] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-08T19:06:16.121014] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:06:16.817548] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-08T19:06:16.977403] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:06:17.031191] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:06:17.138101] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-08T19:06:17.617570] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-08T19:06:18.417563] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-08T19:06:19.151211] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:06:19.217591] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-08T19:06:19.493823] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:06:20.017638] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-08T19:06:20.817590] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-08T19:06:20.882289] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:06:20.923906] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T19:06:21.267626] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T19:06:21.617536] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-08T19:06:22.191887] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T19:06:22.417545] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-08T19:06:23.217563] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-08T19:06:23.557859] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:06:23.560114] [INFO ] [REMOTE ] GCTS: Full fetch complete (27044 records). [2025-10-08T19:06:23.560190] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-08T19:06:23.967573] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-08T19:06:23.967936] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-08T19:06:23.968719] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-08T19:06:23.968785] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-08T19:06:23.969758] [DEBUG] [LOCAL ] GCTS: Trimmed 27044 records to 20353 (keeping 200 days of data) [2025-10-08T19:06:24.024064] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-08T19:06:24.087062] [DEBUG] [LOCAL ] GCTS: Primary data saved (20353 records). [2025-10-08T19:06:24.087194] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-08T19:06:24.087278] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 44.0s. Estimated remaining: 3h 25m 1s. Rate: 7.2 symbols/min [2025-10-08T19:06:24.255452] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:24.260277] [DEBUG] [LOCAL ] GDL: Loaded 2551 existing records from primary storage. [2025-10-08T19:06:24.260451] [INFO ] [MAIN ] GDL: Loaded 2551 existing records. [2025-10-08T19:06:24.445988] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:24.446288] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-08T19:06:24.446407] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-08T19:06:24.446883] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-08T19:06:24.446945] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-08T19:06:24.667170] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:06:24.830409] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-08T19:06:24.836790] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:24.896762] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:06:25.617603] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-08T19:06:26.057614] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T19:06:26.330334] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:06:26.417488] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-08T19:06:27.217606] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-08T19:06:27.906093] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T19:06:27.939139] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:06:28.017507] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-08T19:06:28.817551] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-08T19:06:29.617554] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-08T19:06:29.735432] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T19:06:30.214145] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T19:06:30.231594] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T19:06:30.417544] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-08T19:06:31.217575] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-08T19:06:31.697914] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T19:06:31.876084] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:06:32.017581] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-08T19:06:32.378283] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:06:32.817618] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-08T19:06:33.100685] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-08T19:06:33.617524] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-08T19:06:34.417561] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-08T19:06:35.225205] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-08T19:06:35.242041] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:06:35.741113] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T19:06:35.744466] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:06:36.017594] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-08T19:06:36.817563] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-08T19:06:37.617616] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-08T19:06:37.622414] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:06:38.059712] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:06:38.212509] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:06:38.218116] [INFO ] [REMOTE ] GDDY: Full fetch complete (71761 records). [2025-10-08T19:06:38.218465] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-08T19:06:38.425915] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-08T19:06:38.655041] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-08T19:06:38.655170] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-08T19:06:38.656464] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-08T19:06:38.656548] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-08T19:06:38.658666] [DEBUG] [LOCAL ] GDDY: Trimmed 71761 records to 49785 (keeping 200 days of data) [2025-10-08T19:06:38.986705] [DEBUG] [LOCAL ] GDDY: Primary data saved (49785 records). [2025-10-08T19:06:38.986890] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-08T19:06:38.987057] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDDY took 36.7s. Estimated remaining: 3h 25m 3s. Rate: 7.1 symbols/min [2025-10-08T19:06:39.155249] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:39.162875] [DEBUG] [LOCAL ] GDO: Loaded 5920 existing records from primary storage. [2025-10-08T19:06:39.163092] [INFO ] [MAIN ] GDO: Loaded 5920 existing records. [2025-10-08T19:06:39.224460] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-08T19:06:39.341032] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:39.341252] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-08T19:06:39.341299] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-08T19:06:39.341580] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-08T19:06:39.341639] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-08T19:06:39.697586] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:39.737791] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T19:06:40.017557] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-08T19:06:40.146731] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:06:40.151101] [INFO ] [REMOTE ] GD: Full fetch complete (69994 records). [2025-10-08T19:06:40.151252] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-08T19:06:40.479571] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:06:40.547580] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-08T19:06:40.547754] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-08T19:06:40.548807] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-08T19:06:40.548875] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-08T19:06:40.550418] [DEBUG] [LOCAL ] GD: Trimmed 69994 records to 46879 (keeping 200 days of data) [2025-10-08T19:06:40.824921] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-08T19:06:40.850747] [DEBUG] [LOCAL ] GD: Primary data saved (46879 records). [2025-10-08T19:06:40.850908] [INFO ] [MAIN ] GD: Full history saved. [2025-10-08T19:06:40.851015] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GD took 42.0s. Estimated remaining: 3h 24m 44s. Rate: 7.2 symbols/min [2025-10-08T19:06:41.019602] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:41.057765] [DEBUG] [LOCAL ] GDOT: Loaded 37959 existing records from primary storage. [2025-10-08T19:06:41.058114] [INFO ] [MAIN ] GDOT: Loaded 37959 existing records. [2025-10-08T19:06:41.244684] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:41.244903] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-08T19:06:41.244974] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-08T19:06:41.246249] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-08T19:06:41.246314] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-08T19:06:41.357514] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-08T19:06:41.621094] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-08T19:06:41.624929] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:42.417565] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-08T19:06:42.466088] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:06:42.880866] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T19:06:43.217559] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-08T19:06:43.758126] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T19:06:44.017573] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-08T19:06:44.486148] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T19:06:44.817571] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-08T19:06:45.372545] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T19:06:45.617525] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-08T19:06:46.093820] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T19:06:46.094556] [INFO ] [REMOTE ] GDL: Full fetch complete (3605 records). [2025-10-08T19:06:46.094680] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-08T19:06:46.422748] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-08T19:06:46.453193] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-08T19:06:46.453263] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-08T19:06:46.453384] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-08T19:06:46.453422] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-08T19:06:46.453818] [DEBUG] [LOCAL ] GDL: Trimmed 3605 records to 2553 (keeping 200 days of data) [2025-10-08T19:06:46.469424] [DEBUG] [LOCAL ] GDL: Primary data saved (2553 records). [2025-10-08T19:06:46.469487] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-08T19:06:46.469567] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDL took 22.4s. Estimated remaining: 3h 24m 32s. Rate: 7.2 symbols/min [2025-10-08T19:06:46.637822] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:46.656435] [DEBUG] [LOCAL ] GDV: Loaded 19508 existing records from primary storage. [2025-10-08T19:06:46.656759] [INFO ] [MAIN ] GDV: Loaded 19508 existing records. [2025-10-08T19:06:46.842955] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:46.843154] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-08T19:06:46.843202] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-08T19:06:46.843844] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-08T19:06:46.843911] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-08T19:06:47.219149] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-08T19:06:47.219088] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:47.225470] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:06:47.723267] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:06:47.724151] [INFO ] [REMOTE ] GDIV: Full fetch complete (5469 records). [2025-10-08T19:06:47.724220] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-08T19:06:48.022678] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-08T19:06:48.077714] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-08T19:06:48.077809] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-08T19:06:48.078024] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-08T19:06:48.078071] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-08T19:06:48.078494] [DEBUG] [LOCAL ] GDIV: Trimmed 5469 records to 3609 (keeping 200 days of data) [2025-10-08T19:06:48.103821] [DEBUG] [LOCAL ] GDIV: Primary data saved (3609 records). [2025-10-08T19:06:48.103984] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-08T19:06:48.104076] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDIV took 37.3s. Estimated remaining: 3h 24m 12s. Rate: 7.2 symbols/min [2025-10-08T19:06:48.271710] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:06:48.329989] [DEBUG] [LOCAL ] GE: Loaded 53712 existing records from primary storage. [2025-10-08T19:06:48.330395] [INFO ] [MAIN ] GE: Loaded 53712 existing records. [2025-10-08T19:06:48.510547] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:06:48.510822] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-08T19:06:48.510870] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-08T19:06:48.512723] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-08T19:06:48.512788] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-08T19:06:48.827004] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-08T19:06:48.868863] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:06:49.381564] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:06:49.556717] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T19:06:49.617594] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-08T19:06:50.417608] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-08T19:06:50.841358] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:06:51.217531] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-08T19:06:51.265248] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:06:51.814080] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:06:52.017544] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-08T19:06:52.817576] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-08T19:06:52.946555] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:06:53.617558] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-08T19:06:54.081131] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:06:54.353634] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:06:54.417606] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-08T19:06:55.021240] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T19:06:55.217623] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-08T19:06:56.017549] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-08T19:06:56.514934] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:06:56.817580] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-08T19:06:57.147301] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T19:06:57.617578] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-08T19:06:57.906184] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T19:06:58.031695] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T19:06:58.417631] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-08T19:06:59.055992] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T19:06:59.217622] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-08T19:07:00.017559] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-08T19:07:00.628638] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:07:00.817522] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-08T19:07:01.265992] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T19:07:01.267700] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T19:07:01.617548] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-08T19:07:02.417561] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-08T19:07:03.217507] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-08T19:07:03.430723] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T19:07:03.711747] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T19:07:03.715577] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T19:07:04.017622] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-08T19:07:04.817861] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-08T19:07:05.305204] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:07:05.617553] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-08T19:07:06.407687] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:07:06.417697] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-08T19:07:06.815234] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T19:07:07.023409] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:07:07.217573] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-08T19:07:08.017554] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-08T19:07:08.583517] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:07:08.817520] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-08T19:07:09.551248] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:07:09.552322] [INFO ] [REMOTE ] GDO: Full fetch complete (8761 records). [2025-10-08T19:07:09.552416] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-08T19:07:09.626228] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-08T19:07:09.940195] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-08T19:07:09.940344] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-08T19:07:09.940791] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-08T19:07:09.940900] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-08T19:07:09.941499] [DEBUG] [LOCAL ] GDO: Trimmed 8761 records to 5927 (keeping 200 days of data) [2025-10-08T19:07:10.007129] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:07:10.027464] [DEBUG] [LOCAL ] GDO: Primary data saved (5927 records). [2025-10-08T19:07:10.027660] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-08T19:07:10.027780] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 31.0s. Estimated remaining: 3h 24m 26s. Rate: 7.2 symbols/min [2025-10-08T19:07:10.193532] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:10.214810] [DEBUG] [LOCAL ] GEF: Loaded 20741 existing records from primary storage. [2025-10-08T19:07:10.215079] [INFO ] [MAIN ] GEF: Loaded 20741 existing records. [2025-10-08T19:07:10.404243] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:10.414623] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-08T19:07:10.415158] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-08T19:07:10.415501] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T19:07:10.417045] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-08T19:07:10.420720] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-08T19:07:10.419623] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-08T19:07:10.785530] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:11.217569] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-08T19:07:12.017526] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-08T19:07:12.101988] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T19:07:12.789255] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T19:07:12.817502] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-08T19:07:13.058156] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T19:07:13.617592] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-08T19:07:14.358240] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T19:07:14.417503] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-08T19:07:15.102726] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-08T19:07:15.217599] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-08T19:07:15.541592] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:07:15.976849] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:07:16.017508] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-08T19:07:16.817588] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-08T19:07:17.073627] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:07:17.617623] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-08T19:07:18.386907] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:07:18.417522] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-08T19:07:18.546789] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:07:19.217523] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-08T19:07:19.598755] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:07:19.953483] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T19:07:19.955255] [INFO ] [REMOTE ] GDV: Full fetch complete (28483 records). [2025-10-08T19:07:19.955328] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-08T19:07:20.022973] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-08T19:07:20.338183] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-08T19:07:20.338279] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-08T19:07:20.339041] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-08T19:07:20.339110] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-08T19:07:20.340062] [DEBUG] [LOCAL ] GDV: Trimmed 28483 records to 19517 (keeping 200 days of data) [2025-10-08T19:07:20.466014] [DEBUG] [LOCAL ] GDV: Primary data saved (19517 records). [2025-10-08T19:07:20.466195] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-08T19:07:20.466352] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDV took 34.0s. Estimated remaining: 3h 24m 21s. Rate: 7.1 symbols/min [2025-10-08T19:07:20.645189] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:20.681778] [DEBUG] [LOCAL ] GEL: Loaded 32496 existing records from primary storage. [2025-10-08T19:07:20.682151] [INFO ] [MAIN ] GEL: Loaded 32496 existing records. [2025-10-08T19:07:20.831956] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-08T19:07:20.876348] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:20.876873] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-08T19:07:20.876946] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-08T19:07:20.877207] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-08T19:07:20.877267] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-08T19:07:21.250758] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:21.617530] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-08T19:07:21.957114] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T19:07:22.372999] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T19:07:22.417632] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-08T19:07:23.206274] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T19:07:23.217485] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-08T19:07:23.342634] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T19:07:24.017558] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-08T19:07:24.415823] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:07:24.420094] [INFO ] [REMOTE ] GDOT: Full fetch complete (53159 records). [2025-10-08T19:07:24.420305] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-08T19:07:24.817944] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-08T19:07:24.837763] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-08T19:07:24.837928] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-08T19:07:24.838766] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-08T19:07:24.838971] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-08T19:07:24.840571] [DEBUG] [LOCAL ] GDOT: Trimmed 53159 records to 37785 (keeping 200 days of data) [2025-10-08T19:07:24.952585] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:07:25.095531] [DEBUG] [LOCAL ] GDOT: Primary data saved (37785 records). [2025-10-08T19:07:25.095725] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-08T19:07:25.095840] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GDOT took 44.2s. Estimated remaining: 3h 24m 6s. Rate: 7.2 symbols/min [2025-10-08T19:07:25.262871] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:25.312737] [DEBUG] [LOCAL ] GENI: Loaded 52945 existing records from primary storage. [2025-10-08T19:07:25.313086] [INFO ] [MAIN ] GENI: Loaded 52945 existing records. [2025-10-08T19:07:25.488418] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:25.488955] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-08T19:07:25.489005] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-08T19:07:25.489210] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-08T19:07:25.489267] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-08T19:07:25.628880] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-08T19:07:25.848190] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:26.417612] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-08T19:07:26.877293] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T19:07:27.125854] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-08T19:07:27.217503] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-08T19:07:27.243760] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:07:28.017529] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-08T19:07:28.522917] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:07:28.817585] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-08T19:07:29.617621] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-08T19:07:30.096672] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-08T19:07:30.417589] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-08T19:07:30.499013] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:07:30.534048] [DEBUG] [REMOTE ] GEL: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-08T19:07:30.534369] [WARN ] [REMOTE ] GEL: No data returned for month 2025-02 [2025-10-08T19:07:30.534462] [FATAL] [REMOTE ] GEL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:07:30.534544] [FATAL] [MAIN ] GEL: Failed to fetch primary data. [2025-10-08T19:07:30.534606] [WARN ] [MAIN ] GEL: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:07:30.534736] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-08T19:07:30.534827] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-08T19:07:30.534883] [INFO ] [LOCAL ] GEL: Starting deletion of derivative data. [2025-10-08T19:07:30.535118] [DEBUG] [LOCAL ] GEL: Deleted derivative data file. [2025-10-08T19:07:30.535205] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GEL took 10.1s. Estimated remaining: 3h 23m 53s. Rate: 7.2 symbols/min [2025-10-08T19:07:30.711683] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:30.777147] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T19:07:30.817425] [DEBUG] [LOCAL ] GEO: Loaded 51896 existing records from primary storage. [2025-10-08T19:07:30.817784] [INFO ] [MAIN ] GEO: Loaded 51896 existing records. [2025-10-08T19:07:30.992291] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:30.992527] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-08T19:07:30.992575] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-08T19:07:30.993959] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-08T19:07:30.994019] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-08T19:07:31.227034] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-08T19:07:31.345491] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:32.017710] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-08T19:07:32.817587] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-08T19:07:32.881350] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:07:33.313851] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:07:33.319452] [INFO ] [REMOTE ] GE: Full fetch complete (77771 records). [2025-10-08T19:07:33.319734] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-08T19:07:33.622769] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-08T19:07:33.753782] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-08T19:07:33.753917] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-08T19:07:33.755252] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-08T19:07:33.755322] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-08T19:07:33.757867] [DEBUG] [LOCAL ] GE: Trimmed 77771 records to 53706 (keeping 200 days of data) [2025-10-08T19:07:34.148734] [DEBUG] [LOCAL ] GE: Primary data saved (53706 records). [2025-10-08T19:07:34.149400] [INFO ] [MAIN ] GE: Full history saved. [2025-10-08T19:07:34.149664] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GE took 46.0s. Estimated remaining: 3h 23m 37s. Rate: 7.2 symbols/min [2025-10-08T19:07:34.348348] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:34.420417] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-08T19:07:34.418658] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T19:07:34.422714] [DEBUG] [LOCAL ] GES: Loaded 38833 existing records from primary storage. [2025-10-08T19:07:34.433499] [INFO ] [MAIN ] GES: Loaded 38833 existing records. [2025-10-08T19:07:34.554709] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T19:07:34.608485] [INFO ] [REMOTE ] GEF: Full fetch complete (29402 records). [2025-10-08T19:07:34.629491] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-08T19:07:34.629288] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:34.630299] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-08T19:07:34.630526] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-08T19:07:34.636906] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-08T19:07:34.696492] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-08T19:07:35.221128] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-08T19:07:35.417328] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-08T19:07:35.421199] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-08T19:07:35.421125] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:35.422270] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-08T19:07:35.422339] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-08T19:07:35.423430] [DEBUG] [LOCAL ] GEF: Trimmed 29402 records to 20665 (keeping 200 days of data) [2025-10-08T19:07:35.549359] [DEBUG] [LOCAL ] GEF: Primary data saved (20665 records). [2025-10-08T19:07:35.549518] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-08T19:07:35.549602] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEF took 25.5s. Estimated remaining: 3h 23m 18s. Rate: 7.2 symbols/min [2025-10-08T19:07:35.718788] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:07:35.754433] [DEBUG] [LOCAL ] GETY: Loaded 35311 existing records from primary storage. [2025-10-08T19:07:35.754859] [INFO ] [MAIN ] GETY: Loaded 35311 existing records. [2025-10-08T19:07:35.935124] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:07:35.935347] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-08T19:07:35.935394] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-08T19:07:35.936411] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-08T19:07:35.936473] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-08T19:07:36.032408] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-08T19:07:36.323719] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:07:36.468963] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T19:07:36.605103] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:07:36.817591] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-08T19:07:37.395103] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:07:37.617560] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-08T19:07:38.259194] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:07:38.417560] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-08T19:07:39.116877] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T19:07:39.217499] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-08T19:07:40.017506] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-08T19:07:40.208296] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:07:40.406520] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T19:07:40.817555] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-08T19:07:41.617565] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-08T19:07:41.943259] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T19:07:42.300997] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:07:42.417552] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-08T19:07:43.217600] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-08T19:07:43.373734] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:07:43.929598] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:07:44.017530] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-08T19:07:44.819977] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-08T19:07:44.825802] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:07:45.544379] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:07:45.617510] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-08T19:07:46.417606] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-08T19:07:46.539221] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:07:47.217518] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-08T19:07:47.411431] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:07:48.023532] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-08T19:07:48.045467] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:07:48.738059] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:07:48.817536] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-08T19:07:49.489822] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:07:49.617619] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-08T19:07:50.299804] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:07:50.417507] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-08T19:07:50.876396] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:07:51.217574] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-08T19:07:52.017679] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-08T19:07:52.312117] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T19:07:52.817576] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-08T19:07:52.957520] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:07:53.100988] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T19:07:53.617594] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-08T19:07:54.264136] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:07:54.417700] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-08T19:07:54.754866] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:07:55.217575] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-08T19:07:56.017567] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-08T19:07:56.262907] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:07:56.295022] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:07:56.817622] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-08T19:07:57.436545] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T19:07:57.617609] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-08T19:07:58.417511] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-08T19:07:58.474605] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:07:59.222726] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-08T19:07:59.236364] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:08:00.017607] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-08T19:08:00.246129] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T19:08:00.817546] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-08T19:08:01.106023] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:08:01.146688] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T19:08:01.617573] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-08T19:08:02.362181] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T19:08:02.417579] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-08T19:08:03.217564] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-08T19:08:03.520861] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T19:08:03.525347] [INFO ] [REMOTE ] GENI: Full fetch complete (75601 records). [2025-10-08T19:08:03.525531] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-08T19:08:03.833222] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:08:03.836466] [INFO ] [REMOTE ] GETY: Full fetch complete (55520 records). [2025-10-08T19:08:03.847161] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-08T19:08:04.018536] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-08T19:08:04.066789] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-08T19:08:04.114560] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-08T19:08:04.131266] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-08T19:08:04.133679] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-08T19:08:04.252993] [DEBUG] [LOCAL ] GENI: Trimmed 75601 records to 52944 (keeping 200 days of data) [2025-10-08T19:08:04.445501] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-08T19:08:04.447335] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-08T19:08:04.448146] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-08T19:08:04.448227] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-08T19:08:04.455026] [DEBUG] [LOCAL ] GETY: Trimmed 55520 records to 35367 (keeping 200 days of data) [2025-10-08T19:08:04.898234] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:08:04.922159] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-08T19:08:04.948375] [DEBUG] [LOCAL ] GENI: Primary data saved (52944 records). [2025-10-08T19:08:04.949713] [DEBUG] [LOCAL ] GETY: Primary data saved (35367 records). [2025-10-08T19:08:04.949909] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-08T19:08:04.949992] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-08T19:08:04.950113] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GETY took 29.4s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-08T19:08:04.961711] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GENI took 39.9s. Estimated remaining: 3h 23m 21s. Rate: 7.2 symbols/min [2025-10-08T19:08:05.262319] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:05.359785] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:05.358078] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:08:05.365136] [INFO ] [REMOTE ] GES: Full fetch complete (59014 records). [2025-10-08T19:08:05.365263] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-08T19:08:05.444214] [DEBUG] [LOCAL ] GF: Loaded 2801 existing records from primary storage. [2025-10-08T19:08:05.467439] [INFO ] [MAIN ] GF: Loaded 2801 existing records. [2025-10-08T19:08:05.846113] [DEBUG] [LOCAL ] GEV: Loaded 53018 existing records from primary storage. [2025-10-08T19:08:05.900367] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:05.903714] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-08T19:08:05.903924] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-08T19:08:05.904039] [INFO ] [MAIN ] GEV: Loaded 53018 existing records. [2025-10-08T19:08:05.925024] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-08T19:08:05.965210] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-08T19:08:06.221376] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-08T19:08:06.297442] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-08T19:08:06.297273] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:06.309053] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-08T19:08:06.314418] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-08T19:08:06.327988] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-08T19:08:06.338551] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-08T19:08:06.365984] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-08T19:08:06.381251] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-08T19:08:06.462144] [DEBUG] [LOCAL ] GES: Trimmed 59014 records to 38643 (keeping 200 days of data) [2025-10-08T19:08:06.777000] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:06.788617] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-08T19:08:07.084331] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:07.100620] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-08T19:08:07.105311] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-08T19:08:07.218413] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-08T19:08:07.245166] [DEBUG] [LOCAL ] GES: Primary data saved (38643 records). [2025-10-08T19:08:07.245288] [INFO ] [MAIN ] GES: Full history saved. [2025-10-08T19:08:07.245367] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GES took 33.1s. Estimated remaining: 3h 23m 3s. Rate: 7.2 symbols/min [2025-10-08T19:08:07.482094] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:08:08.017567] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-08T19:08:08.574714] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T19:08:08.817552] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-08T19:08:08.917223] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T19:08:09.175760] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:08:09.377417] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T19:08:09.617590] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-08T19:08:10.327677] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:08:10.417522] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-08T19:08:11.217547] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-08T19:08:11.923981] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:08:12.017707] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-08T19:08:12.624376] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-08T19:08:12.639514] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T19:08:12.817590] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-08T19:08:13.311675] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T19:08:13.617628] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-08T19:08:14.417589] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-08T19:08:14.812175] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T19:08:15.217555] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-08T19:08:15.709589] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T19:08:15.737803] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-08T19:08:16.017563] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-08T19:08:16.817693] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-08T19:08:17.617517] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-08T19:08:17.735745] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T19:08:17.898858] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-08T19:08:18.417559] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-08T19:08:18.807036] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:08:18.866708] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T19:08:18.867517] [INFO ] [REMOTE ] GF: Full fetch complete (5057 records). [2025-10-08T19:08:18.867586] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-08T19:08:19.219163] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-08T19:08:19.243117] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-08T19:08:19.243208] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-08T19:08:19.243371] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-08T19:08:19.243411] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-08T19:08:19.243831] [DEBUG] [LOCAL ] GF: Trimmed 5057 records to 2781 (keeping 200 days of data) [2025-10-08T19:08:19.261448] [DEBUG] [LOCAL ] GF: Primary data saved (2781 records). [2025-10-08T19:08:19.261703] [INFO ] [MAIN ] GF: Full history saved. [2025-10-08T19:08:19.261800] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GF took 14.3s. Estimated remaining: 3h 23m 0s. Rate: 7.2 symbols/min [2025-10-08T19:08:20.017584] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-08T19:08:21.160598] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:08:21.164943] [INFO ] [REMOTE ] GEO: Full fetch complete (75445 records). [2025-10-08T19:08:21.165065] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-08T19:08:21.632077] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-08T19:08:21.632169] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-08T19:08:21.633133] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-08T19:08:21.633199] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-08T19:08:21.634599] [DEBUG] [LOCAL ] GEO: Trimmed 75445 records to 51887 (keeping 200 days of data) [2025-10-08T19:08:21.945315] [DEBUG] [LOCAL ] GEO: Primary data saved (51887 records). [2025-10-08T19:08:21.945464] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-08T19:08:21.945550] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GEO took 51.4s. Estimated remaining: 3h 22m 43s. Rate: 7.2 symbols/min [2025-10-08T19:08:22.173577] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:08:22.185870] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-08T19:08:24.309105] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T19:08:24.322234] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-08T19:08:26.341997] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-08T19:08:26.354182] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-08T19:08:28.773274] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-08T19:08:28.785492] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-08T19:08:31.272193] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-08T19:08:31.283784] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-08T19:08:33.487968] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-08T19:08:33.499465] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-08T19:08:35.719730] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-08T19:08:35.723723] [INFO ] [REMOTE ] GEV: Full fetch complete (76904 records). [2025-10-08T19:08:35.723849] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-08T19:08:36.119422] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-08T19:08:36.119590] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-08T19:08:36.120541] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-08T19:08:36.120604] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-08T19:08:36.122061] [DEBUG] [LOCAL ] GEV: Trimmed 76904 records to 53015 (keeping 200 days of data) [2025-10-08T19:08:36.454032] [DEBUG] [LOCAL ] GEV: Primary data saved (53015 records). [2025-10-08T19:08:36.454180] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-08T19:08:36.455734] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 31.5s. Estimated remaining: 3h 22m 44s. Rate: 7.2 symbols/min [2025-10-08T19:08:37.045587] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.186862] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.148535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.191193] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:37.210002] [DEBUG] [LOCAL ] GFR: Loaded 8002 existing records from primary storage. [2025-10-08T19:08:37.210551] [INFO ] [MAIN ] GFR: Loaded 8002 existing records. [2025-10-08T19:08:37.316091] [DEBUG] [LOCAL ] GFF: Loaded 30268 existing records from primary storage. [2025-10-08T19:08:37.342867] [INFO ] [MAIN ] GFF: Loaded 30268 existing records. [2025-10-08T19:08:37.439872] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-08T19:08:37.481215] [INFO ] [MAIN ] GFL: Loaded 47875 existing records. [2025-10-08T19:08:37.577064] [DEBUG] [LOCAL ] GFI: Loaded 53101 existing records from primary storage. [2025-10-08T19:08:37.670715] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:37.735712] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-08T19:08:37.680829] [INFO ] [MAIN ] GFI: Loaded 53101 existing records. [2025-10-08T19:08:37.741158] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-08T19:08:37.798801] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:37.856039] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-08T19:08:37.847775] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-08T19:08:37.869860] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-08T19:08:37.870041] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-08T19:08:37.905888] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-08T19:08:37.963755] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-08T19:08:38.283080] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:38.286867] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:38.318097] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-08T19:08:38.318279] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-08T19:08:38.380888] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-08T19:08:38.381412] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-08T19:08:38.394050] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-08T19:08:38.420663] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-08T19:08:38.420829] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-08T19:08:38.446020] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-08T19:08:39.254587] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.323129] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-08T19:08:39.306380] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.344774] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-08T19:08:39.591047] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.617353] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-08T19:08:39.644459] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:39.644881] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-08T19:08:40.243167] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T19:08:40.247164] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-08T19:08:40.671019] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:08:40.676926] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-08T19:08:40.848591] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:08:40.857419] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-08T19:08:41.046540] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:08:41.049351] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-08T19:08:41.300312] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:08:41.310421] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-08T19:08:41.595866] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:08:41.598253] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-08T19:08:41.684690] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:08:41.690852] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-08T19:08:42.091433] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:08:42.101318] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-08T19:08:42.111139] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T19:08:42.114099] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-08T19:08:42.839371] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T19:08:42.851006] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-08T19:08:42.946071] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:08:42.953847] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-08T19:08:43.000625] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T19:08:43.006072] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-08T19:08:43.309520] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:08:43.318682] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-08T19:08:43.514026] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-08T19:08:43.517378] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-08T19:08:43.913861] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T19:08:43.916110] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-08T19:08:44.058223] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:08:44.065712] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-08T19:08:44.289018] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-08T19:08:44.291342] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-08T19:08:44.647178] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T19:08:44.685074] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-08T19:08:44.688239] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:08:44.699458] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-08T19:08:44.955388] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:08:44.957399] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-08T19:08:45.279405] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:08:45.287456] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-08T19:08:45.467740] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T19:08:45.617590] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-08T19:08:46.137111] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:08:46.138265] [INFO ] [REMOTE ] GFR: Full fetch complete (12405 records). [2025-10-08T19:08:46.138337] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-08T19:08:46.521995] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-08T19:08:46.538156] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-08T19:08:46.551937] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:08:46.549898] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-08T19:08:46.562416] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-08T19:08:46.564331] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-08T19:08:46.565668] [DEBUG] [LOCAL ] GFR: Trimmed 12405 records to 7915 (keeping 200 days of data) [2025-10-08T19:08:46.646987] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T19:08:46.680744] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T19:08:46.696577] [DEBUG] [LOCAL ] GFR: Primary data saved (7915 records). [2025-10-08T19:08:46.696723] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-08T19:08:46.696901] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 10.2s. Estimated remaining: 3h 22m 39s. Rate: 7.2 symbols/min [2025-10-08T19:08:46.862365] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:08:46.915156] [DEBUG] [LOCAL ] GGB: Loaded 51168 existing records from primary storage. [2025-10-08T19:08:46.915512] [INFO ] [MAIN ] GGB: Loaded 51168 existing records. [2025-10-08T19:08:47.088822] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:08:47.089044] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-08T19:08:47.089090] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-08T19:08:47.089398] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-08T19:08:47.089454] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-08T19:08:47.225429] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-08T19:08:47.441327] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:08:48.017529] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-08T19:08:48.312883] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:08:48.560115] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T19:08:48.817609] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-08T19:08:49.617584] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-08T19:08:49.828543] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T19:08:50.417588] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-08T19:08:50.702785] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T19:08:51.118417] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T19:08:51.217531] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-08T19:08:51.555704] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:08:52.017561] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-08T19:08:52.526608] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:08:52.817557] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-08T19:08:53.119769] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:08:53.617620] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-08T19:08:54.345187] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:08:54.417590] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-08T19:08:55.217528] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-08T19:08:55.280665] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:08:56.017526] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-08T19:08:56.053688] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:08:56.265983] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:08:56.817621] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-08T19:08:57.617608] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-08T19:08:57.992342] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T19:08:58.417572] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-08T19:08:58.498418] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:08:59.163435] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:08:59.217501] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-08T19:08:59.537048] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T19:08:59.542322] [INFO ] [REMOTE ] GFF: Full fetch complete (44159 records). [2025-10-08T19:08:59.542401] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-08T19:08:59.910684] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-08T19:08:59.910801] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-08T19:08:59.911430] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-08T19:08:59.911492] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-08T19:08:59.912390] [DEBUG] [LOCAL ] GFF: Trimmed 44159 records to 30233 (keeping 200 days of data) [2025-10-08T19:09:00.017632] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-08T19:09:00.103592] [DEBUG] [LOCAL ] GFF: Primary data saved (30233 records). [2025-10-08T19:09:00.103758] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-08T19:09:00.103849] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 23.6s. Estimated remaining: 3h 22m 38s. Rate: 7.2 symbols/min [2025-10-08T19:09:00.270193] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:00.306814] [DEBUG] [LOCAL ] GGG: Loaded 40843 existing records from primary storage. [2025-10-08T19:09:00.307133] [INFO ] [MAIN ] GGG: Loaded 40843 existing records. [2025-10-08T19:09:00.482241] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:00.482444] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-08T19:09:00.482490] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-08T19:09:00.482731] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-08T19:09:00.482788] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-08T19:09:00.831471] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:00.825784] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-08T19:09:01.204799] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:09:01.617607] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-08T19:09:02.220944] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T19:09:02.417495] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-08T19:09:02.604942] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-08T19:09:02.609421] [INFO ] [REMOTE ] GFL: Full fetch complete (69245 records). [2025-10-08T19:09:02.609574] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-08T19:09:03.010917] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-08T19:09:03.011034] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-08T19:09:03.012042] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-08T19:09:03.012126] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-08T19:09:03.036068] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:09:03.034821] [DEBUG] [LOCAL ] GFL: Trimmed 69245 records to 47875 (keeping 200 days of data) [2025-10-08T19:09:03.250590] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-08T19:09:03.391050] [DEBUG] [LOCAL ] GFL: Primary data saved (47875 records). [2025-10-08T19:09:03.391230] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-08T19:09:03.391345] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 26.9s. Estimated remaining: 3h 22m 22s. Rate: 7.2 symbols/min [2025-10-08T19:09:03.609044] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:03.626134] [DEBUG] [LOCAL ] GGT: Loaded 14149 existing records from primary storage. [2025-10-08T19:09:03.626463] [INFO ] [MAIN ] GGT: Loaded 14149 existing records. [2025-10-08T19:09:03.835267] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:03.835481] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-08T19:09:03.835533] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-08T19:09:03.835776] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-08T19:09:03.835835] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-08T19:09:04.023437] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-08T19:09:04.197763] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:04.414002] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T19:09:04.564310] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:09:04.817523] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-08T19:09:05.617561] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-08T19:09:05.755543] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:09:06.009418] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:09:06.417536] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-08T19:09:07.177118] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:09:07.217512] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-08T19:09:07.953341] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:09:08.017505] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-08T19:09:08.292806] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:09:08.801539] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T19:09:08.817534] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-08T19:09:09.552854] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:09:09.617542] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-08T19:09:10.417630] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-08T19:09:11.217517] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-08T19:09:11.271220] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T19:09:11.297033] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T19:09:12.017569] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-08T19:09:12.802331] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:09:12.817489] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-08T19:09:13.158743] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:09:13.165425] [INFO ] [REMOTE ] GFI: Full fetch complete (76479 records). [2025-10-08T19:09:13.165589] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-08T19:09:13.631733] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-08T19:09:13.656539] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-08T19:09:13.656615] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-08T19:09:13.657562] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-08T19:09:13.657626] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-08T19:09:13.659289] [DEBUG] [LOCAL ] GFI: Trimmed 76479 records to 53098 (keeping 200 days of data) [2025-10-08T19:09:13.884161] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:09:14.001004] [DEBUG] [LOCAL ] GFI: Primary data saved (53098 records). [2025-10-08T19:09:14.001146] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-08T19:09:14.001238] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 37.5s. Estimated remaining: 3h 22m 17s. Rate: 7.2 symbols/min [2025-10-08T19:09:14.171551] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:14.176726] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-08T19:09:14.176907] [INFO ] [MAIN ] GGZ: Loaded 2428 existing records. [2025-10-08T19:09:14.355096] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:14.355306] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-08T19:09:14.355353] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-08T19:09:14.355480] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-08T19:09:14.355518] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-08T19:09:14.422779] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-08T19:09:14.704686] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:15.199936] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:09:15.217491] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-08T19:09:16.017849] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-08T19:09:16.023885] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T19:09:16.684355] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T19:09:16.744352] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:09:16.817525] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-08T19:09:17.617548] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-08T19:09:17.883464] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:09:18.417548] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-08T19:09:18.992465] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T19:09:19.217502] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-08T19:09:19.267281] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:09:20.017549] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-08T19:09:20.794253] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:09:20.817511] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-08T19:09:20.837358] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:09:21.617567] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-08T19:09:22.226157] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:09:22.417543] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-08T19:09:23.099185] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:09:23.217557] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-08T19:09:23.826096] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:09:24.017610] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-08T19:09:24.613752] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:09:24.817551] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-08T19:09:25.442913] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:09:25.446277] [INFO ] [REMOTE ] GGG: Full fetch complete (59401 records). [2025-10-08T19:09:25.446410] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-08T19:09:25.625359] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-08T19:09:25.859249] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-08T19:09:25.859378] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-08T19:09:25.860930] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-08T19:09:25.861021] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-08T19:09:25.862574] [DEBUG] [LOCAL ] GGG: Trimmed 59401 records to 40765 (keeping 200 days of data) [2025-10-08T19:09:26.114070] [DEBUG] [LOCAL ] GGG: Primary data saved (40765 records). [2025-10-08T19:09:26.114204] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-08T19:09:26.114309] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGG took 26.0s. Estimated remaining: 3h 22m 14s. Rate: 7.1 symbols/min [2025-10-08T19:09:26.194722] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T19:09:26.326980] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:26.332148] [DEBUG] [LOCAL ] GHC: Loaded 2760 existing records from primary storage. [2025-10-08T19:09:26.332289] [INFO ] [MAIN ] GHC: Loaded 2760 existing records. [2025-10-08T19:09:26.421984] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-08T19:09:26.514846] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:26.515116] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-08T19:09:26.515326] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-08T19:09:26.515505] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-08T19:09:26.515581] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-08T19:09:26.654768] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T19:09:26.934137] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:27.217576] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-08T19:09:27.429818] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:09:27.608897] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-08T19:09:28.017551] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-08T19:09:28.817569] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-08T19:09:29.013590] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T19:09:29.015436] [INFO ] [REMOTE ] GGT: Full fetch complete (18775 records). [2025-10-08T19:09:29.015538] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-08T19:09:29.318752] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T19:09:29.412301] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-08T19:09:29.412422] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-08T19:09:29.413069] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-08T19:09:29.413139] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-08T19:09:29.414323] [DEBUG] [LOCAL ] GGT: Trimmed 18775 records to 14116 (keeping 200 days of data) [2025-10-08T19:09:29.506729] [DEBUG] [LOCAL ] GGT: Primary data saved (14116 records). [2025-10-08T19:09:29.506951] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-08T19:09:29.507058] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGT took 26.1s. Estimated remaining: 3h 21m 58s. Rate: 7.2 symbols/min [2025-10-08T19:09:29.621668] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-08T19:09:29.703907] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:29.711354] [DEBUG] [LOCAL ] GHG: Loaded 3190 existing records from primary storage. [2025-10-08T19:09:29.711685] [INFO ] [MAIN ] GHG: Loaded 3190 existing records. [2025-10-08T19:09:29.909726] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:29.910068] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-08T19:09:29.910120] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-08T19:09:29.910310] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-08T19:09:29.910401] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-08T19:09:30.324329] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:30.417599] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-08T19:09:30.894192] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T19:09:31.069025] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:09:31.073798] [INFO ] [REMOTE ] GGB: Full fetch complete (74110 records). [2025-10-08T19:09:31.073953] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-08T19:09:31.222816] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-08T19:09:31.563161] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-08T19:09:31.563296] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-08T19:09:31.564547] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-08T19:09:31.564635] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-08T19:09:31.566529] [DEBUG] [LOCAL ] GGB: Trimmed 74110 records to 51174 (keeping 200 days of data) [2025-10-08T19:09:31.818465] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T19:09:31.929724] [DEBUG] [LOCAL ] GGB: Primary data saved (51174 records). [2025-10-08T19:09:31.929943] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-08T19:09:31.930086] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGB took 45.2s. Estimated remaining: 3h 21m 40s. Rate: 7.2 symbols/min [2025-10-08T19:09:32.022732] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-08T19:09:32.143577] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:32.155765] [DEBUG] [LOCAL ] GHI: Loaded 7175 existing records from primary storage. [2025-10-08T19:09:32.156050] [INFO ] [MAIN ] GHI: Loaded 7175 existing records. [2025-10-08T19:09:32.347718] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:32.347977] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-08T19:09:32.348090] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-08T19:09:32.348306] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-08T19:09:32.348362] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-08T19:09:32.605594] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T19:09:32.730510] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:32.817603] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-08T19:09:33.155622] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:09:33.617567] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-08T19:09:34.152549] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:09:34.417550] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-08T19:09:34.732671] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-08T19:09:35.217571] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-08T19:09:35.844409] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T19:09:36.017591] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-08T19:09:36.817527] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-08T19:09:36.831497] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:09:37.112463] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-08T19:09:37.617553] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-08T19:09:38.213715] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T19:09:38.417569] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-08T19:09:38.890397] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T19:09:39.217552] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-08T19:09:39.677494] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-08T19:09:40.017611] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-08T19:09:40.470098] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:09:40.817557] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-08T19:09:41.388978] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:09:41.617638] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-08T19:09:42.418107] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-08T19:09:42.422571] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:09:42.760841] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T19:09:43.217554] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-08T19:09:43.693956] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T19:09:44.017548] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-08T19:09:44.504283] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T19:09:44.817549] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-08T19:09:45.422136] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:09:45.617559] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-08T19:09:46.204957] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T19:09:46.417600] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-08T19:09:46.958424] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T19:09:47.217559] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-08T19:09:47.776949] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T19:09:48.017559] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-08T19:09:48.454718] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T19:09:48.817557] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-08T19:09:49.396130] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:09:49.617616] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-08T19:09:50.088747] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T19:09:50.417566] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-08T19:09:51.031086] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T19:09:51.217595] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-08T19:09:51.963730] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:09:52.017569] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-08T19:09:52.755584] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:09:52.817517] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-08T19:09:53.290342] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T19:09:53.617590] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-08T19:09:54.246406] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:09:54.247330] [INFO ] [REMOTE ] GHC: Full fetch complete (3460 records). [2025-10-08T19:09:54.247399] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-08T19:09:54.418875] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-08T19:09:54.646637] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-08T19:09:54.646782] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-08T19:09:54.647061] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-08T19:09:54.647133] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-08T19:09:54.647582] [DEBUG] [LOCAL ] GHC: Trimmed 3460 records to 2780 (keeping 200 days of data) [2025-10-08T19:09:54.667054] [DEBUG] [LOCAL ] GHC: Primary data saved (2780 records). [2025-10-08T19:09:54.667145] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-08T19:09:54.667248] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GHC took 28.6s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-08T19:09:54.849981] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:09:54.857789] [DEBUG] [LOCAL ] GHLD: Loaded 4186 existing records from primary storage. [2025-10-08T19:09:54.858029] [INFO ] [MAIN ] GHLD: Loaded 4186 existing records. [2025-10-08T19:09:54.966048] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T19:09:55.072327] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:09:55.072692] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-08T19:09:55.072800] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-08T19:09:55.073025] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-08T19:09:55.073087] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-08T19:09:55.232231] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-08T19:09:55.463461] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:09:55.819914] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T19:09:56.017515] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-08T19:09:56.613292] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:09:56.817557] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-08T19:09:57.226122] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T19:09:57.617528] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-08T19:09:58.358952] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:09:58.417575] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-08T19:09:59.192346] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T19:09:59.217511] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-08T19:09:59.739517] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T19:10:00.017548] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-08T19:10:00.583516] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T19:10:00.584409] [INFO ] [REMOTE ] GHG: Full fetch complete (4078 records). [2025-10-08T19:10:00.584478] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-08T19:10:00.822717] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-08T19:10:00.951456] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-08T19:10:00.951558] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-08T19:10:00.951742] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-08T19:10:00.951804] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-08T19:10:00.952165] [DEBUG] [LOCAL ] GHG: Trimmed 4078 records to 3211 (keeping 200 days of data) [2025-10-08T19:10:00.970942] [DEBUG] [LOCAL ] GHG: Primary data saved (3211 records). [2025-10-08T19:10:00.971037] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-08T19:10:00.971197] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHG took 31.5s. Estimated remaining: 3h 21m 43s. Rate: 7.1 symbols/min [2025-10-08T19:10:01.136485] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:01.152247] [DEBUG] [LOCAL ] GHM: Loaded 14153 existing records from primary storage. [2025-10-08T19:10:01.152502] [INFO ] [MAIN ] GHM: Loaded 14153 existing records. [2025-10-08T19:10:01.328483] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:01.328715] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-08T19:10:01.328773] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-08T19:10:01.328978] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-08T19:10:01.329036] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-08T19:10:01.405515] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:10:01.622712] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-08T19:10:01.689495] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:02.417566] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-08T19:10:02.620741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T19:10:02.622020] [INFO ] [REMOTE ] GHI: Full fetch complete (11407 records). [2025-10-08T19:10:02.622101] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-08T19:10:02.988399] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-08T19:10:02.988545] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-08T19:10:02.988868] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-08T19:10:02.988929] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-08T19:10:02.989384] [DEBUG] [LOCAL ] GHI: Trimmed 11407 records to 7185 (keeping 200 days of data) [2025-10-08T19:10:03.035266] [DEBUG] [LOCAL ] GHI: Primary data saved (7185 records). [2025-10-08T19:10:03.035412] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-08T19:10:03.035498] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHI took 31.1s. Estimated remaining: 3h 21m 25s. Rate: 7.2 symbols/min [2025-10-08T19:10:03.211143] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:03.217531] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-08T19:10:03.238575] [DEBUG] [LOCAL ] GHY: Loaded 20933 existing records from primary storage. [2025-10-08T19:10:03.238873] [INFO ] [MAIN ] GHY: Loaded 20933 existing records. [2025-10-08T19:10:03.380207] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:10:03.437768] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:03.438041] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-08T19:10:03.438090] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-08T19:10:03.438406] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-08T19:10:03.438494] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-08T19:10:03.647877] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T19:10:03.836409] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:04.017562] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-08T19:10:04.817541] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-08T19:10:04.831673] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:10:05.341987] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T19:10:05.617546] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-08T19:10:06.417515] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-08T19:10:06.657517] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:10:06.706631] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-08T19:10:07.217566] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-08T19:10:08.017566] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-08T19:10:08.226000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:10:08.500063] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T19:10:08.817551] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-08T19:10:09.348884] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T19:10:09.617581] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-08T19:10:10.275015] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T19:10:10.417560] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-08T19:10:11.034539] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T19:10:11.217575] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-08T19:10:12.017559] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-08T19:10:12.214781] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:10:12.433034] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T19:10:12.433863] [INFO ] [REMOTE ] GGZ: Full fetch complete (4077 records). [2025-10-08T19:10:12.433934] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-08T19:10:12.786665] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-08T19:10:12.786767] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-08T19:10:12.786915] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-08T19:10:12.786954] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-08T19:10:12.787298] [DEBUG] [LOCAL ] GGZ: Trimmed 4077 records to 2428 (keeping 200 days of data) [2025-10-08T19:10:12.802238] [DEBUG] [LOCAL ] GGZ: Primary data saved (2428 records). [2025-10-08T19:10:12.802307] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-08T19:10:12.802378] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GGZ took 58.8s. Estimated remaining: 3h 21m 18s. Rate: 7.2 symbols/min [2025-10-08T19:10:12.822731] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-08T19:10:12.972005] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:13.009892] [DEBUG] [LOCAL ] GIB: Loaded 31877 existing records from primary storage. [2025-10-08T19:10:13.010215] [INFO ] [MAIN ] GIB: Loaded 31877 existing records. [2025-10-08T19:10:13.182796] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:13.183026] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-08T19:10:13.183073] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-08T19:10:13.183289] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-08T19:10:13.183346] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-08T19:10:13.528697] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:13.617501] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-08T19:10:13.985301] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:10:14.417517] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-08T19:10:14.772499] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:10:14.934096] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T19:10:15.217560] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-08T19:10:16.017527] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-08T19:10:16.176102] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T19:10:16.817530] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-08T19:10:17.202711] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:10:17.591126] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:10:17.617525] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-08T19:10:18.422617] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-08T19:10:18.431755] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T19:10:19.217592] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-08T19:10:19.309163] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T19:10:20.017572] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-08T19:10:20.299921] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:10:20.817523] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-08T19:10:20.827722] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:10:21.235557] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T19:10:21.617542] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-08T19:10:22.417536] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-08T19:10:22.648750] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:10:23.006024] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:10:23.007252] [INFO ] [REMOTE ] GHLD: Full fetch complete (4859 records). [2025-10-08T19:10:23.007345] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-08T19:10:23.225425] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-08T19:10:23.406276] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-08T19:10:23.406354] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-08T19:10:23.406507] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-08T19:10:23.406545] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-08T19:10:23.406945] [DEBUG] [LOCAL ] GHLD: Trimmed 4859 records to 4184 (keeping 200 days of data) [2025-10-08T19:10:23.431849] [DEBUG] [LOCAL ] GHLD: Primary data saved (4184 records). [2025-10-08T19:10:23.431941] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-08T19:10:23.432019] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHLD took 28.8s. Estimated remaining: 3h 21m 13s. Rate: 7.2 symbols/min [2025-10-08T19:10:23.607945] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:23.625834] [DEBUG] [LOCAL ] GIC: Loaded 13473 existing records from primary storage. [2025-10-08T19:10:23.626124] [INFO ] [MAIN ] GIC: Loaded 13473 existing records. [2025-10-08T19:10:23.857484] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:23.857929] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-08T19:10:23.858012] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-08T19:10:23.866769] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-08T19:10:23.867803] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:10:23.867907] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-08T19:10:24.022569] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-08T19:10:24.231623] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:24.798199] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:10:24.817504] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-08T19:10:25.433041] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T19:10:25.617545] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-08T19:10:26.417513] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-08T19:10:26.681776] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T19:10:27.075518] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:10:27.217564] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-08T19:10:27.999574] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T19:10:28.017506] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-08T19:10:28.817527] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-08T19:10:29.062811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:10:29.542912] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T19:10:29.617586] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-08T19:10:30.417605] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-08T19:10:30.820570] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T19:10:31.217536] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-08T19:10:31.386343] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:10:31.388522] [INFO ] [REMOTE ] GHY: Full fetch complete (32303 records). [2025-10-08T19:10:31.388603] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-08T19:10:31.757857] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-08T19:10:31.757939] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-08T19:10:31.758549] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-08T19:10:31.758610] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-08T19:10:31.759393] [DEBUG] [LOCAL ] GHY: Trimmed 32303 records to 20935 (keeping 200 days of data) [2025-10-08T19:10:31.889031] [DEBUG] [LOCAL ] GHY: Primary data saved (20935 records). [2025-10-08T19:10:31.889167] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-08T19:10:31.889247] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHY took 28.9s. Estimated remaining: 3h 21m 5s. Rate: 7.2 symbols/min [2025-10-08T19:10:32.017872] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-08T19:10:32.072847] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:32.114113] [DEBUG] [LOCAL ] GIL: Loaded 43629 existing records from primary storage. [2025-10-08T19:10:32.114430] [INFO ] [MAIN ] GIL: Loaded 43629 existing records. [2025-10-08T19:10:32.227383] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:10:32.311216] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:32.311437] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-08T19:10:32.311483] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-08T19:10:32.311740] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-08T19:10:32.311799] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-08T19:10:32.677630] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:32.817542] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-08T19:10:32.927838] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:10:33.617568] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-08T19:10:34.260946] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:10:34.417517] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-08T19:10:34.445265] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T19:10:35.217548] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-08T19:10:35.884325] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:10:35.886340] [INFO ] [REMOTE ] GHM: Full fetch complete (21850 records). [2025-10-08T19:10:35.908226] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-08T19:10:35.910298] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T19:10:36.022722] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-08T19:10:36.321995] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-08T19:10:36.322180] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-08T19:10:36.322906] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-08T19:10:36.322973] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-08T19:10:36.324236] [DEBUG] [LOCAL ] GHM: Trimmed 21850 records to 14150 (keeping 200 days of data) [2025-10-08T19:10:36.417974] [DEBUG] [LOCAL ] GHM: Primary data saved (14150 records). [2025-10-08T19:10:36.418207] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-08T19:10:36.418319] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GHM took 35.4s. Estimated remaining: 3h 20m 51s. Rate: 7.2 symbols/min [2025-10-08T19:10:36.617380] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:36.679625] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-08T19:10:36.680131] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-08T19:10:36.822726] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-08T19:10:36.891412] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:36.891767] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-08T19:10:36.891845] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-08T19:10:36.892220] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-08T19:10:36.892285] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-08T19:10:37.034258] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:10:37.323596] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:37.617611] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-08T19:10:38.049372] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:10:38.417497] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-08T19:10:38.889418] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:10:39.217569] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-08T19:10:39.947113] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:10:40.017503] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-08T19:10:40.218298] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:10:40.817542] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-08T19:10:41.561870] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:10:41.603166] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T19:10:41.617485] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-08T19:10:42.390707] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T19:10:42.417511] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-08T19:10:43.217596] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-08T19:10:43.237041] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T19:10:44.017565] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-08T19:10:44.817523] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-08T19:10:45.110872] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T19:10:45.167111] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:10:45.617533] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-08T19:10:45.849844] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:10:46.417554] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-08T19:10:47.133402] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:10:47.217536] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-08T19:10:47.704634] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T19:10:48.017569] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-08T19:10:48.678632] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T19:10:48.817553] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-08T19:10:48.917200] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T19:10:49.311964] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T19:10:49.617599] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-08T19:10:50.417540] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-08T19:10:50.535177] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T19:10:50.536843] [INFO ] [REMOTE ] GIC: Full fetch complete (20210 records). [2025-10-08T19:10:50.536952] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-08T19:10:50.930341] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-08T19:10:50.930448] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-08T19:10:50.931183] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-08T19:10:50.931249] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-08T19:10:50.932092] [DEBUG] [LOCAL ] GIC: Trimmed 20210 records to 13439 (keeping 200 days of data) [2025-10-08T19:10:51.016735] [DEBUG] [LOCAL ] GIC: Primary data saved (13439 records). [2025-10-08T19:10:51.016878] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-08T19:10:51.016963] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 27.6s. Estimated remaining: 3h 20m 52s. Rate: 7.1 symbols/min [2025-10-08T19:10:51.191742] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:10:51.217595] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-08T19:10:51.232246] [DEBUG] [LOCAL ] GKOS: Loaded 42637 existing records from primary storage. [2025-10-08T19:10:51.232566] [INFO ] [MAIN ] GKOS: Loaded 42637 existing records. [2025-10-08T19:10:51.428717] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:10:51.428990] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-08T19:10:51.429046] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-08T19:10:51.429271] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-08T19:10:51.429332] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-08T19:10:51.923552] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:10:52.022908] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-08T19:10:52.110343] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:10:52.817574] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-08T19:10:53.072610] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T19:10:53.229011] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:10:53.617590] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-08T19:10:54.360535] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:10:54.417519] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-08T19:10:55.147427] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:10:55.217609] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-08T19:10:55.609010] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:10:56.017571] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-08T19:10:56.771841] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:10:56.817525] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-08T19:10:57.417929] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:10:57.617571] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-08T19:10:58.253146] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:10:58.417609] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-08T19:10:59.213248] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:10:59.224289] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-08T19:10:59.924848] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T19:10:59.928392] [INFO ] [REMOTE ] GIL: Full fetch complete (61791 records). [2025-10-08T19:10:59.928532] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-08T19:11:00.024125] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-08T19:11:00.311840] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-08T19:11:00.311926] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-08T19:11:00.312749] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-08T19:11:00.312828] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-08T19:11:00.314181] [DEBUG] [LOCAL ] GIL: Trimmed 61791 records to 43687 (keeping 200 days of data) [2025-10-08T19:11:00.581524] [DEBUG] [LOCAL ] GIL: Primary data saved (43687 records). [2025-10-08T19:11:00.581694] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-08T19:11:00.581796] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIL took 28.7s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-10-08T19:11:00.752703] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:00.796371] [DEBUG] [LOCAL ] GL: Loaded 37747 existing records from primary storage. [2025-10-08T19:11:00.796786] [INFO ] [MAIN ] GL: Loaded 37747 existing records. [2025-10-08T19:11:00.828490] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-08T19:11:00.982941] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:00.983276] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-08T19:11:00.983490] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-08T19:11:00.983877] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-08T19:11:00.983986] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-08T19:11:01.290951] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-08T19:11:01.388245] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:01.617518] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-08T19:11:02.063218] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T19:11:02.112769] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:11:02.417559] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-08T19:11:02.856227] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T19:11:03.217560] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-08T19:11:03.625914] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:11:03.629315] [INFO ] [REMOTE ] GIB: Full fetch complete (45765 records). [2025-10-08T19:11:03.629413] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-08T19:11:03.995254] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-08T19:11:03.995338] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-08T19:11:03.996026] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-08T19:11:03.996088] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-08T19:11:04.000450] [DEBUG] [LOCAL ] GIB: Trimmed 45765 records to 31842 (keeping 200 days of data) [2025-10-08T19:11:04.058894] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-08T19:11:04.209130] [DEBUG] [LOCAL ] GIB: Primary data saved (31842 records). [2025-10-08T19:11:04.209314] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-08T19:11:04.209416] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIB took 51.4s. Estimated remaining: 3h 20m 30s. Rate: 7.2 symbols/min [2025-10-08T19:11:04.374021] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:04.418004] [DEBUG] [LOCAL ] GLOB: Loaded 47732 existing records from primary storage. [2025-10-08T19:11:04.418332] [INFO ] [MAIN ] GLOB: Loaded 47732 existing records. [2025-10-08T19:11:04.593974] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:04.594370] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-08T19:11:04.594497] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-08T19:11:04.594806] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-08T19:11:04.594865] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-08T19:11:04.838308] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-08T19:11:04.961734] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:04.991755] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:11:05.617529] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-08T19:11:05.823071] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:11:06.417561] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-08T19:11:06.457536] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T19:11:06.654089] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:11:07.217553] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-08T19:11:07.692616] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:11:08.017575] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-08T19:11:08.434699] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:11:08.817610] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-08T19:11:09.193702] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:11:09.617612] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-08T19:11:10.274721] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:11:10.417564] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-08T19:11:11.217961] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-08T19:11:11.219450] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T19:11:11.942869] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:11:12.017520] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-08T19:11:12.817570] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-08T19:11:12.856613] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:11:13.201867] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T19:11:13.617558] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-08T19:11:14.417575] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-08T19:11:14.587875] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T19:11:15.140495] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:11:15.217511] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-08T19:11:15.535315] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:11:16.017556] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-08T19:11:16.658370] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:11:16.817524] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-08T19:11:17.617508] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-08T19:11:17.745246] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T19:11:18.368741] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:11:18.417493] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-08T19:11:19.047814] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:11:19.051021] [INFO ] [REMOTE ] GKOS: Full fetch complete (60065 records). [2025-10-08T19:11:19.051113] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-08T19:11:19.222938] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-08T19:11:19.437168] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-08T19:11:19.437247] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-08T19:11:19.438065] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-08T19:11:19.438128] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-08T19:11:19.441931] [DEBUG] [LOCAL ] GKOS: Trimmed 60065 records to 42550 (keeping 200 days of data) [2025-10-08T19:11:19.697848] [DEBUG] [LOCAL ] GKOS: Primary data saved (42550 records). [2025-10-08T19:11:19.697980] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-08T19:11:19.698063] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GKOS took 28.7s. Estimated remaining: 3h 20m 32s. Rate: 7.1 symbols/min [2025-10-08T19:11:19.867487] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:19.879043] [DEBUG] [LOCAL ] GLP: Loaded 9284 existing records from primary storage. [2025-10-08T19:11:19.879265] [INFO ] [MAIN ] GLP: Loaded 9284 existing records. [2025-10-08T19:11:20.021546] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-08T19:11:20.063447] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:20.063737] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-08T19:11:20.063863] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-08T19:11:20.064121] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-08T19:11:20.064212] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-08T19:11:20.464991] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:20.459370] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T19:11:20.817511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-08T19:11:20.877950] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T19:11:21.595743] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T19:11:21.617507] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-08T19:11:21.729895] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:11:22.417562] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-08T19:11:23.217554] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-08T19:11:23.255115] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:11:24.017584] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-08T19:11:24.226526] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:11:24.562703] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:11:24.697572] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:11:24.817511] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-08T19:11:25.589545] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:11:25.617498] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-08T19:11:26.409793] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:11:26.417489] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-08T19:11:27.096250] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:11:27.217575] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-08T19:11:28.017574] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-08T19:11:28.817522] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-08T19:11:28.946369] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:11:29.435562] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:11:29.617517] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-08T19:11:29.703357] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:11:30.417609] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-08T19:11:31.217620] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-08T19:11:31.362903] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T19:11:32.017634] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-08T19:11:32.343552] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T19:11:32.347994] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-08T19:11:32.348180] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-08T19:11:32.779790] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-08T19:11:32.782616] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-08T19:11:32.783759] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-08T19:11:32.783874] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-08T19:11:32.785995] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:11:32.797011] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 53672 (keeping 200 days of data) [2025-10-08T19:11:32.853748] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-08T19:11:33.134384] [DEBUG] [LOCAL ] GIS: Primary data saved (53672 records). [2025-10-08T19:11:33.134588] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-08T19:11:33.134727] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 56.7s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-08T19:11:33.305362] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:33.355328] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-08T19:11:33.355709] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-08T19:11:33.538900] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:33.539263] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-08T19:11:33.539344] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-08T19:11:33.539672] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-08T19:11:33.539741] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-08T19:11:33.620145] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-08T19:11:33.653961] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:11:33.670326] [INFO ] [REMOTE ] GLOB: Full fetch complete (64662 records). [2025-10-08T19:11:33.724594] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-08T19:11:33.717886] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T19:11:34.131734] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:34.339903] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-08T19:11:34.340025] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-08T19:11:34.340991] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-08T19:11:34.341058] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-08T19:11:34.342512] [DEBUG] [LOCAL ] GLOB: Trimmed 64662 records to 47776 (keeping 200 days of data) [2025-10-08T19:11:34.430987] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-08T19:11:34.631027] [DEBUG] [LOCAL ] GLOB: Primary data saved (47776 records). [2025-10-08T19:11:34.631158] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-08T19:11:34.631243] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GLOB took 30.4s. Estimated remaining: 3h 20m 12s. Rate: 7.1 symbols/min [2025-10-08T19:11:34.801237] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:34.856619] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-08T19:11:34.857054] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-08T19:11:35.038370] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:35.039068] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-08T19:11:35.039254] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-08T19:11:35.039530] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-08T19:11:35.039588] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-08T19:11:35.144204] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T19:11:35.228535] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-08T19:11:35.245683] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T19:11:35.455373] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:36.017574] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-08T19:11:36.076948] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:11:36.817612] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-08T19:11:37.398283] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T19:11:37.617559] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-08T19:11:38.417568] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-08T19:11:38.977814] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T19:11:38.999003] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:11:39.002188] [INFO ] [REMOTE ] GL: Full fetch complete (55254 records). [2025-10-08T19:11:39.002367] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-08T19:11:39.144197] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:11:39.227328] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-08T19:11:39.414791] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-08T19:11:39.414879] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-08T19:11:39.415630] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-08T19:11:39.415712] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-08T19:11:39.417005] [DEBUG] [LOCAL ] GL: Trimmed 55254 records to 37792 (keeping 200 days of data) [2025-10-08T19:11:39.663814] [DEBUG] [LOCAL ] GL: Primary data saved (37792 records). [2025-10-08T19:11:39.664002] [INFO ] [MAIN ] GL: Full history saved. [2025-10-08T19:11:39.665572] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GL took 39.1s. Estimated remaining: 3h 19m 59s. Rate: 7.2 symbols/min [2025-10-08T19:11:39.835478] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:39.895460] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-08T19:11:39.895846] [INFO ] [MAIN ] GME: Loaded 53782 existing records. [2025-10-08T19:11:40.022735] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-08T19:11:40.079555] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:40.080245] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-08T19:11:40.080303] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-08T19:11:40.080504] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-08T19:11:40.080563] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-08T19:11:40.438459] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:40.817570] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-08T19:11:41.419413] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-08T19:11:41.471799] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T19:11:41.473064] [INFO ] [REMOTE ] GLP: Full fetch complete (14289 records). [2025-10-08T19:11:41.473133] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-08T19:11:41.622765] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-08T19:11:41.861666] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-08T19:11:41.861991] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-08T19:11:41.862605] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-08T19:11:41.862730] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-08T19:11:41.863560] [DEBUG] [LOCAL ] GLP: Trimmed 14289 records to 9242 (keeping 200 days of data) [2025-10-08T19:11:41.920883] [DEBUG] [LOCAL ] GLP: Primary data saved (9242 records). [2025-10-08T19:11:41.921021] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-08T19:11:41.921164] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLP took 22.2s. Estimated remaining: 3h 19m 41s. Rate: 7.2 symbols/min [2025-10-08T19:11:42.092175] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:11:42.124741] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-08T19:11:42.176145] [DEBUG] [LOCAL ] GMED: Loaded 48385 existing records from primary storage. [2025-10-08T19:11:42.176478] [INFO ] [MAIN ] GMED: Loaded 48385 existing records. [2025-10-08T19:11:42.350278] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:11:42.350525] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-08T19:11:42.350578] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-08T19:11:42.350819] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-08T19:11:42.350877] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-08T19:11:42.424815] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-08T19:11:42.749869] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:11:43.217618] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-08T19:11:44.017693] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-08T19:11:44.657916] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (3.04 seconds). [2025-10-08T19:11:44.817546] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-08T19:11:44.895539] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-08T19:11:45.265870] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T19:11:45.617625] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-08T19:11:46.417682] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-08T19:11:46.462497] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-08T19:11:47.217553] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-08T19:11:48.402955] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (3.59 seconds). [2025-10-08T19:11:48.414686] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-08T19:11:48.473175] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-08T19:11:48.554404] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T19:11:48.640380] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T19:11:48.817516] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-08T19:11:49.617556] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-08T19:11:50.417504] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-08T19:11:50.582412] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-08T19:11:50.863750] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:11:50.980518] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:11:51.217569] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-08T19:11:51.891971] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:11:52.017568] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-08T19:11:52.819094] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-08T19:11:52.821798] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:11:53.441894] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:11:53.617586] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-08T19:11:54.417704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-08T19:11:54.920996] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T19:11:55.130775] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:11:55.217578] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-08T19:11:56.017600] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-08T19:11:56.679426] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-08T19:11:56.817590] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-08T19:11:56.946067] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:11:57.325375] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:11:57.617549] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-08T19:11:58.417553] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-08T19:11:59.126962] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-08T19:11:59.217565] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-08T19:11:59.602258] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-08T19:12:00.017534] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-08T19:12:00.329699] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:12:00.817587] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-08T19:12:01.617593] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-08T19:12:01.837474] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-08T19:12:01.882635] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T19:12:02.424553] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-08T19:12:02.434979] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:12:03.217561] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-08T19:12:03.600100] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T19:12:03.993810] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:12:04.017546] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-08T19:12:04.817584] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-08T19:12:04.935737] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T19:12:05.438251] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:12:05.617571] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-08T19:12:06.417627] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-08T19:12:06.775884] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T19:12:07.217609] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-08T19:12:07.424300] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T19:12:08.017590] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-08T19:12:08.630150] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T19:12:08.817572] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-08T19:12:09.617525] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-08T19:12:09.708115] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-08T19:12:09.767621] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:12:09.772554] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-08T19:12:09.772829] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-08T19:12:10.199489] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-08T19:12:10.199608] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-08T19:12:10.200709] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-08T19:12:10.200796] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-08T19:12:10.202719] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 53729 (keeping 200 days of data) [2025-10-08T19:12:10.418532] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-08T19:12:10.541285] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-08T19:12:10.541427] [INFO ] [MAIN ] GM: Full history saved. [2025-10-08T19:12:10.541523] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GM took 35.9s. Estimated remaining: 3h 20m 4s. Rate: 7.1 symbols/min [2025-10-08T19:12:10.628403] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T19:12:10.665865] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-08T19:12:10.681600] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-08T19:12:10.784214] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:11.087437] [DEBUG] [LOCAL ] GMRE: Loaded 37200 existing records from primary storage. [2025-10-08T19:12:11.098878] [INFO ] [MAIN ] GMRE: Loaded 37200 existing records. [2025-10-08T19:12:11.338762] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-08T19:12:11.344171] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-08T19:12:11.407343] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-08T19:12:11.413833] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:11.414314] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-08T19:12:11.414114] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-08T19:12:11.414844] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-08T19:12:11.415545] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-08T19:12:11.415724] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-08T19:12:11.459768] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 53636 (keeping 200 days of data) [2025-10-08T19:12:11.771898] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T19:12:11.845271] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-08T19:12:11.972664] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:12.055963] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-08T19:12:12.218953] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-08T19:12:12.219096] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-08T19:12:12.219191] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GLW took 39.1s. Estimated remaining: 3h 19m 45s. Rate: 7.1 symbols/min [2025-10-08T19:12:12.388866] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:12.408807] [DEBUG] [LOCAL ] GNE: Loaded 17867 existing records from primary storage. [2025-10-08T19:12:12.409099] [INFO ] [MAIN ] GNE: Loaded 17867 existing records. [2025-10-08T19:12:12.604995] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:12.605462] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-08T19:12:12.605761] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-08T19:12:12.606221] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-08T19:12:12.606325] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-08T19:12:12.747324] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-08T19:12:12.822971] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-08T19:12:13.026422] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:13.409772] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:12:13.462515] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:12:13.617586] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-08T19:12:14.417613] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-08T19:12:15.078069] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:12:15.164445] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T19:12:15.197197] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-08T19:12:15.217503] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-08T19:12:16.017568] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-08T19:12:16.817606] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-08T19:12:17.454485] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-08T19:12:17.458678] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-08T19:12:17.458805] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-08T19:12:17.619164] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-08T19:12:17.779603] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:12:17.820181] [INFO ] [REMOTE ] GMED: Full fetch complete (69721 records). [2025-10-08T19:12:17.867433] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-08T19:12:18.005182] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-08T19:12:18.017290] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-08T19:12:18.023742] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-08T19:12:18.023913] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-08T19:12:18.045074] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:12:18.151958] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53783 (keeping 200 days of data) [2025-10-08T19:12:18.426153] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-08T19:12:18.451362] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-08T19:12:18.451511] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-08T19:12:18.452447] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-08T19:12:18.453293] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-08T19:12:18.459460] [DEBUG] [LOCAL ] GMED: Trimmed 69721 records to 48352 (keeping 200 days of data) [2025-10-08T19:12:18.564312] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:12:18.915680] [DEBUG] [LOCAL ] GMED: Primary data saved (48352 records). [2025-10-08T19:12:18.916366] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-08T19:12:18.916788] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 37.0s. Estimated remaining: 3h 19m 34s. Rate: 7.1 symbols/min [2025-10-08T19:12:19.160048] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:19.208470] [DEBUG] [LOCAL ] GME: Primary data saved (53783 records). [2025-10-08T19:12:19.209353] [DEBUG] [LOCAL ] GNK: Loaded 40272 existing records from primary storage. [2025-10-08T19:12:19.209449] [INFO ] [MAIN ] GME: Full history saved. [2025-10-08T19:12:19.209560] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 39.5s. Estimated remaining: 3h 19m 13s. Rate: 7.2 symbols/min [2025-10-08T19:12:19.221424] [INFO ] [MAIN ] GNK: Loaded 40272 existing records. [2025-10-08T19:12:19.221219] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-08T19:12:19.569265] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:19.573868] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:19.574915] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-08T19:12:19.575217] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-08T19:12:19.575773] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-08T19:12:19.575838] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-08T19:12:19.955429] [DEBUG] [LOCAL ] GNL: Loaded 46755 existing records from primary storage. [2025-10-08T19:12:19.972841] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:12:19.971226] [INFO ] [MAIN ] GNL: Loaded 46755 existing records. [2025-10-08T19:12:20.017729] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-08T19:12:20.112784] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:20.133120] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:12:20.231572] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:20.231761] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-08T19:12:20.231809] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-08T19:12:20.232014] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-08T19:12:20.232071] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-08T19:12:20.586420] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:20.817597] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-08T19:12:21.593070] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:12:21.617510] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-08T19:12:21.766439] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:12:22.417633] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-08T19:12:22.650157] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:12:23.217594] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-08T19:12:23.869727] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:12:24.017538] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-08T19:12:24.146268] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T19:12:24.817615] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-08T19:12:25.617558] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-08T19:12:25.891692] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T19:12:26.417524] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-08T19:12:26.728998] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:12:26.762475] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-08T19:12:27.217561] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-08T19:12:27.620440] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:12:28.017592] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-08T19:12:28.509200] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T19:12:28.817549] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-08T19:12:29.010088] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:12:29.617556] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-08T19:12:30.359818] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:12:30.417573] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-08T19:12:30.602636] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T19:12:31.217579] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-08T19:12:31.864495] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:12:32.017584] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-08T19:12:32.771260] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T19:12:32.817505] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-08T19:12:33.538904] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:12:33.617497] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-08T19:12:34.348847] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T19:12:34.417549] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-08T19:12:34.994261] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:12:35.217594] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-08T19:12:35.916232] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:12:36.017589] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-08T19:12:36.297229] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T19:12:36.817629] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-08T19:12:37.584558] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:12:37.617701] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-08T19:12:38.276091] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:12:38.417571] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-08T19:12:39.139166] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:12:39.217568] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-08T19:12:39.433967] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:12:39.436455] [INFO ] [REMOTE ] GMRE: Full fetch complete (53059 records). [2025-10-08T19:12:39.436559] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-08T19:12:39.819000] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-08T19:12:39.819093] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-08T19:12:39.819842] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-08T19:12:39.819904] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-08T19:12:39.821035] [DEBUG] [LOCAL ] GMRE: Trimmed 53059 records to 37133 (keeping 200 days of data) [2025-10-08T19:12:40.019689] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-08T19:12:40.051548] [DEBUG] [LOCAL ] GMRE: Primary data saved (37133 records). [2025-10-08T19:12:40.051734] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-08T19:12:40.051848] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GMRE took 29.5s. Estimated remaining: 3h 19m 24s. Rate: 7.1 symbols/min [2025-10-08T19:12:40.220905] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:40.262852] [DEBUG] [LOCAL ] GNRC: Loaded 45210 existing records from primary storage. [2025-10-08T19:12:40.263182] [INFO ] [MAIN ] GNRC: Loaded 45210 existing records. [2025-10-08T19:12:40.443064] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:40.443354] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-08T19:12:40.443456] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-08T19:12:40.451462] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-08T19:12:40.464698] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-08T19:12:40.531371] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T19:12:40.838224] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:40.832323] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-08T19:12:40.930109] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T19:12:41.617556] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-08T19:12:41.835133] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:12:42.417569] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-08T19:12:42.876449] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:12:43.217611] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-08T19:12:43.787289] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:12:44.017575] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-08T19:12:44.409431] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T19:12:44.817567] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-08T19:12:45.261005] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T19:12:45.617525] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-08T19:12:45.695174] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:12:46.417552] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-08T19:12:47.145462] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:12:47.217566] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-08T19:12:48.022764] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-08T19:12:48.040602] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:12:48.794806] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T19:12:48.817503] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-08T19:12:48.850262] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T19:12:49.617537] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-08T19:12:50.224250] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:12:50.227767] [INFO ] [REMOTE ] GNL: Full fetch complete (68151 records). [2025-10-08T19:12:50.227867] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-08T19:12:50.422738] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-08T19:12:50.615850] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-08T19:12:50.615978] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-08T19:12:50.616885] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-08T19:12:50.616949] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-08T19:12:50.618259] [DEBUG] [LOCAL ] GNL: Trimmed 68151 records to 46764 (keeping 200 days of data) [2025-10-08T19:12:50.889356] [DEBUG] [LOCAL ] GNL: Primary data saved (46764 records). [2025-10-08T19:12:50.889497] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-08T19:12:50.889582] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNL took 31.7s. Estimated remaining: 3h 19m 19s. Rate: 7.1 symbols/min [2025-10-08T19:12:51.069015] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:51.080982] [DEBUG] [LOCAL ] GNT: Loaded 8259 existing records from primary storage. [2025-10-08T19:12:51.081408] [INFO ] [MAIN ] GNT: Loaded 8259 existing records. [2025-10-08T19:12:51.233689] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-08T19:12:51.276995] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:51.277508] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-08T19:12:51.277591] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-08T19:12:51.287008] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-08T19:12:51.292313] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-08T19:12:51.387810] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:12:51.439472] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:12:51.484580] [INFO ] [REMOTE ] GNE: Full fetch complete (22478 records). [2025-10-08T19:12:51.486247] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-08T19:12:51.888715] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:52.022720] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-08T19:12:52.086060] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-08T19:12:52.086148] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-08T19:12:52.086637] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-08T19:12:52.086728] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-08T19:12:52.087513] [DEBUG] [LOCAL ] GNE: Trimmed 22478 records to 17869 (keeping 200 days of data) [2025-10-08T19:12:52.198832] [DEBUG] [LOCAL ] GNE: Primary data saved (17869 records). [2025-10-08T19:12:52.198982] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-08T19:12:52.199067] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNE took 40.0s. Estimated remaining: 3h 18m 60s. Rate: 7.1 symbols/min [2025-10-08T19:12:52.369636] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:12:52.417540] [DEBUG] [LOCAL ] GNW: Loaded 51367 existing records from primary storage. [2025-10-08T19:12:52.417927] [INFO ] [MAIN ] GNW: Loaded 51367 existing records. [2025-10-08T19:12:52.601722] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:12:52.602031] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-08T19:12:52.602078] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-08T19:12:52.602297] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-08T19:12:52.602355] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-08T19:12:52.820055] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-08T19:12:53.005123] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:12:53.007426] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:12:53.310593] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T19:12:53.355876] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:12:53.617586] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-08T19:12:54.417579] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-08T19:12:54.969202] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:12:55.217599] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-08T19:12:56.017518] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-08T19:12:56.114270] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T19:12:56.478997] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T19:12:56.801627] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:12:56.817494] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-08T19:12:57.617595] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-08T19:12:58.356363] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:12:58.417586] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-08T19:12:58.942150] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:12:59.217567] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-08T19:12:59.728729] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T19:13:00.017600] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-08T19:13:00.817554] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-08T19:13:00.982884] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:13:01.225267] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:13:01.388808] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:13:01.617553] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-08T19:13:02.417561] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-08T19:13:02.947626] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:13:02.951124] [INFO ] [REMOTE ] GNK: Full fetch complete (57208 records). [2025-10-08T19:13:02.951259] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-08T19:13:03.222801] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-08T19:13:03.351309] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-08T19:13:03.351392] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-08T19:13:03.352200] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-08T19:13:03.352266] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-08T19:13:03.353442] [DEBUG] [LOCAL ] GNK: Trimmed 57208 records to 40257 (keeping 200 days of data) [2025-10-08T19:13:03.600335] [DEBUG] [LOCAL ] GNK: Primary data saved (40257 records). [2025-10-08T19:13:03.600468] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-08T19:13:03.600551] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 44.7s. Estimated remaining: 3h 18m 56s. Rate: 7.1 symbols/min [2025-10-08T19:13:03.798271] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:03.807897] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:13:03.812277] [INFO ] [REMOTE ] GNRC: Full fetch complete (65389 records). [2025-10-08T19:13:03.812407] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-08T19:13:03.921142] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:13:04.018093] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-08T19:13:04.144819] [DEBUG] [LOCAL ] GOF: Loaded 42499 existing records from primary storage. [2025-10-08T19:13:04.155989] [INFO ] [MAIN ] GOF: Loaded 42499 existing records. [2025-10-08T19:13:04.402280] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-08T19:13:04.421769] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-08T19:13:04.444803] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-08T19:13:04.444937] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-08T19:13:04.443842] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:04.445243] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-08T19:13:04.445301] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-08T19:13:04.446201] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-08T19:13:04.446313] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-08T19:13:04.548296] [DEBUG] [LOCAL ] GNRC: Trimmed 65389 records to 45257 (keeping 200 days of data) [2025-10-08T19:13:04.822836] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-08T19:13:04.931845] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:05.112191] [DEBUG] [LOCAL ] GNRC: Primary data saved (45257 records). [2025-10-08T19:13:05.112329] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-08T19:13:05.112417] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 25.1s. Estimated remaining: 3h 18m 37s. Rate: 7.1 symbols/min [2025-10-08T19:13:05.281785] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:05.312480] [DEBUG] [LOCAL ] GOLF: Loaded 31098 existing records from primary storage. [2025-10-08T19:13:05.312800] [INFO ] [MAIN ] GOLF: Loaded 31098 existing records. [2025-10-08T19:13:05.498356] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:05.505479] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:13:05.505629] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-08T19:13:05.508741] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-08T19:13:05.509158] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-08T19:13:05.509233] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-08T19:13:05.618000] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-08T19:13:05.926878] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:13:05.925409] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:06.373592] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:13:06.417604] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-08T19:13:07.217616] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-08T19:13:08.017522] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-08T19:13:08.275605] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T19:13:08.414897] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:13:08.817508] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-08T19:13:08.974385] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:13:09.617561] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-08T19:13:10.237873] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:13:10.417540] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-08T19:13:10.785276] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:13:11.217565] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-08T19:13:11.995950] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T19:13:12.001882] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:13:12.017499] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-08T19:13:12.817567] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-08T19:13:13.617636] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-08T19:13:13.762001] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:13:14.182469] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:13:14.417622] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-08T19:13:14.940901] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:13:15.217605] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-08T19:13:16.017533] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-08T19:13:16.085751] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:13:16.440807] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T19:13:16.738971] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T19:13:16.817602] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-08T19:13:17.617567] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-08T19:13:18.368544] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:13:18.417499] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-08T19:13:18.932787] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T19:13:19.217690] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-08T19:13:19.860912] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:13:20.017590] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-08T19:13:20.532533] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:13:20.817559] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-08T19:13:21.448634] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T19:13:21.617514] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-08T19:13:21.764364] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:13:22.273450] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:13:22.417555] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-08T19:13:23.217560] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-08T19:13:24.017514] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-08T19:13:24.087763] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:13:24.089801] [INFO ] [REMOTE ] GNT: Full fetch complete (11001 records). [2025-10-08T19:13:24.089891] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-08T19:13:24.374941] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T19:13:24.553504] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-08T19:13:24.553588] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-08T19:13:24.553870] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-08T19:13:24.553930] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-08T19:13:24.554377] [DEBUG] [LOCAL ] GNT: Trimmed 11001 records to 8298 (keeping 200 days of data) [2025-10-08T19:13:24.603479] [DEBUG] [LOCAL ] GNT: Primary data saved (8298 records). [2025-10-08T19:13:24.603665] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-08T19:13:24.603778] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNT took 33.7s. Estimated remaining: 3h 18m 46s. Rate: 7.1 symbols/min [2025-10-08T19:13:24.778923] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:24.823101] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-08T19:13:24.826318] [DEBUG] [LOCAL ] GOOS: Loaded 44748 existing records from primary storage. [2025-10-08T19:13:24.826720] [INFO ] [MAIN ] GOOS: Loaded 44748 existing records. [2025-10-08T19:13:25.016763] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:25.017016] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-08T19:13:25.017076] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-08T19:13:25.017318] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-08T19:13:25.017375] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-08T19:13:25.398872] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:25.415281] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:13:25.617518] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-08T19:13:26.417544] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-08T19:13:26.577433] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:13:26.581513] [INFO ] [REMOTE ] GNW: Full fetch complete (73662 records). [2025-10-08T19:13:26.581628] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-08T19:13:26.984453] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-08T19:13:26.984622] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-08T19:13:26.985742] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-08T19:13:26.985855] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-08T19:13:26.987838] [DEBUG] [LOCAL ] GNW: Trimmed 73662 records to 51342 (keeping 200 days of data) [2025-10-08T19:13:27.061260] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:13:27.240050] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-08T19:13:27.346638] [DEBUG] [LOCAL ] GNW: Primary data saved (51342 records). [2025-10-08T19:13:27.346834] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-08T19:13:27.346942] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 35.1s. Estimated remaining: 3h 18m 29s. Rate: 7.1 symbols/min [2025-10-08T19:13:27.515742] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:27.550926] [DEBUG] [LOCAL ] GOTU: Loaded 37911 existing records from primary storage. [2025-10-08T19:13:27.551246] [INFO ] [MAIN ] GOTU: Loaded 37911 existing records. [2025-10-08T19:13:27.731902] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:27.732355] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-08T19:13:27.732524] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-08T19:13:27.732813] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-08T19:13:27.732903] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-08T19:13:27.872074] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:13:28.025387] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-08T19:13:28.139387] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:28.817635] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-08T19:13:28.920303] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:13:29.153478] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:13:29.617592] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-08T19:13:30.196513] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:13:30.417581] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-08T19:13:30.906818] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T19:13:31.217566] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-08T19:13:31.899134] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T19:13:32.017547] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-08T19:13:32.778098] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:13:32.817500] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-08T19:13:33.617524] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-08T19:13:34.073987] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T19:13:34.417522] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-08T19:13:34.723320] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T19:13:34.763414] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T19:13:35.217550] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-08T19:13:35.826705] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:13:36.017560] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-08T19:13:36.393899] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:13:36.396729] [INFO ] [REMOTE ] GOLF: Full fetch complete (45103 records). [2025-10-08T19:13:36.396814] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-08T19:13:36.769347] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-08T19:13:36.769437] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-08T19:13:36.770106] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-08T19:13:36.770168] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-08T19:13:36.773063] [DEBUG] [LOCAL ] GOLF: Trimmed 45103 records to 31026 (keeping 200 days of data) [2025-10-08T19:13:36.830142] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-08T19:13:36.972693] [DEBUG] [LOCAL ] GOLF: Primary data saved (31026 records). [2025-10-08T19:13:36.972808] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-08T19:13:36.972911] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 31.9s. Estimated remaining: 3h 18m 22s. Rate: 7.1 symbols/min [2025-10-08T19:13:37.139739] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:37.184891] [DEBUG] [LOCAL ] GPC: Loaded 46229 existing records from primary storage. [2025-10-08T19:13:37.185267] [INFO ] [MAIN ] GPC: Loaded 46229 existing records. [2025-10-08T19:13:37.372446] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:37.372794] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-08T19:13:37.372846] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-08T19:13:37.373406] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-08T19:13:37.373464] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-08T19:13:37.628166] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-08T19:13:37.741143] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:37.773092] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T19:13:38.314667] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:13:38.417610] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-08T19:13:38.893119] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T19:13:39.217580] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-08T19:13:40.028587] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-08T19:13:40.031624] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T19:13:40.431388] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:13:40.817607] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-08T19:13:41.617585] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-08T19:13:41.823158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:13:42.048079] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:13:42.417565] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-08T19:13:43.049542] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:13:43.217526] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-08T19:13:43.733764] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T19:13:43.737812] [INFO ] [REMOTE ] GOF: Full fetch complete (62065 records). [2025-10-08T19:13:43.738102] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-08T19:13:44.022756] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-08T19:13:44.135926] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-08T19:13:44.136020] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-08T19:13:44.136938] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-08T19:13:44.137006] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-08T19:13:44.138236] [DEBUG] [LOCAL ] GOF: Trimmed 62065 records to 42523 (keeping 200 days of data) [2025-10-08T19:13:44.403695] [DEBUG] [LOCAL ] GOF: Primary data saved (42523 records). [2025-10-08T19:13:44.403833] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-08T19:13:44.403914] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOF took 40.8s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-08T19:13:44.575005] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:44.590568] [DEBUG] [LOCAL ] GPI: Loaded 14631 existing records from primary storage. [2025-10-08T19:13:44.590812] [INFO ] [MAIN ] GPI: Loaded 14631 existing records. [2025-10-08T19:13:44.774867] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:44.775379] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-08T19:13:44.775467] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-08T19:13:44.775750] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-08T19:13:44.775812] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-08T19:13:44.832977] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-08T19:13:44.896619] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:13:45.170874] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:45.296974] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:13:45.617597] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-08T19:13:46.204200] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:13:46.417563] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-08T19:13:47.217536] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-08T19:13:47.390522] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T19:13:47.895557] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T19:13:48.017552] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-08T19:13:48.093083] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:13:48.817729] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-08T19:13:49.389314] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:13:49.617510] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-08T19:13:49.770810] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:13:50.417555] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-08T19:13:51.217525] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-08T19:13:51.317059] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:13:51.779583] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T19:13:52.017550] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-08T19:13:52.715256] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:13:52.817535] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-08T19:13:53.135345] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:13:53.617555] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-08T19:13:54.187888] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:13:54.417555] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-08T19:13:55.217572] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-08T19:13:55.347878] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T19:13:55.864413] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T19:13:56.017588] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-08T19:13:56.426825] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:13:56.817557] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-08T19:13:57.323809] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:13:57.327257] [INFO ] [REMOTE ] GOTU: Full fetch complete (58769 records). [2025-10-08T19:13:57.327367] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-08T19:13:57.622824] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-08T19:13:57.742404] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-08T19:13:57.742532] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-08T19:13:57.743394] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-08T19:13:57.743458] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-08T19:13:57.744673] [DEBUG] [LOCAL ] GOTU: Trimmed 58769 records to 37800 (keeping 200 days of data) [2025-10-08T19:13:57.958260] [DEBUG] [LOCAL ] GOTU: Primary data saved (37800 records). [2025-10-08T19:13:57.958406] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-08T19:13:57.958526] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOTU took 30.6s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-08T19:13:58.131336] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:13:58.139050] [DEBUG] [LOCAL ] GPJA: Loaded 4266 existing records from primary storage. [2025-10-08T19:13:58.139253] [INFO ] [MAIN ] GPJA: Loaded 4266 existing records. [2025-10-08T19:13:58.272033] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:13:58.305604] [INFO ] [REMOTE ] GOOS: Full fetch complete (65185 records). [2025-10-08T19:13:58.315952] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-08T19:13:58.336777] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:13:58.337439] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-08T19:13:58.337540] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-08T19:13:58.337953] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-08T19:13:58.338032] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-08T19:13:58.424494] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-08T19:13:59.134318] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-08T19:13:59.130875] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:13:59.134786] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-08T19:13:59.136137] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-08T19:13:59.136204] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-08T19:13:59.138991] [DEBUG] [LOCAL ] GOOS: Trimmed 65185 records to 44801 (keeping 200 days of data) [2025-10-08T19:13:59.226624] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-08T19:13:59.413260] [DEBUG] [LOCAL ] GOOS: Primary data saved (44801 records). [2025-10-08T19:13:59.413481] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-08T19:13:59.413623] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOOS took 34.8s. Estimated remaining: 3h 17m 53s. Rate: 7.1 symbols/min [2025-10-08T19:13:59.475784] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:13:59.824795] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:13:59.894905] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T19:14:00.017594] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-08T19:14:00.817621] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-08T19:14:01.512621] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:14:01.617546] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-08T19:14:01.730429] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T19:14:02.417579] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-08T19:14:03.217560] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-08T19:14:03.389665] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:14:03.391032] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:14:04.017567] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-08T19:14:04.101848] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T19:14:04.817604] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-08T19:14:05.355185] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T19:14:05.556469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:14:05.617497] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-08T19:14:06.417545] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-08T19:14:06.880267] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T19:14:07.208259] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:14:07.217755] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-08T19:14:08.017613] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-08T19:14:08.659045] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:14:08.794391] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T19:14:08.817503] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-08T19:14:09.482824] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T19:14:09.617566] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-08T19:14:10.190910] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:14:10.417601] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-08T19:14:10.897793] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T19:14:11.217593] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-08T19:14:12.017588] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-08T19:14:12.134427] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:14:12.817551] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-08T19:14:13.430953] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:14:13.434536] [INFO ] [REMOTE ] GPC: Full fetch complete (68792 records). [2025-10-08T19:14:13.434726] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-08T19:14:13.625553] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-08T19:14:13.755552] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:14:13.799199] [INFO ] [REMOTE ] GPI: Full fetch complete (21105 records). [2025-10-08T19:14:13.819627] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-08T19:14:13.836634] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-08T19:14:13.868787] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-08T19:14:13.908582] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-08T19:14:13.914418] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-08T19:14:13.968440] [DEBUG] [LOCAL ] GPC: Trimmed 68792 records to 46159 (keeping 200 days of data) [2025-10-08T19:14:14.322763] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-08T19:14:14.323867] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-08T19:14:14.324938] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-08T19:14:14.330435] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-08T19:14:14.330611] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T19:14:14.335700] [DEBUG] [LOCAL ] GPI: Trimmed 21105 records to 14622 (keeping 200 days of data) [2025-10-08T19:14:14.417909] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-08T19:14:14.550201] [DEBUG] [LOCAL ] GPI: Primary data saved (14622 records). [2025-10-08T19:14:14.551081] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-08T19:14:14.551219] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPI took 30.1s. Estimated remaining: 3h 17m 54s. Rate: 7.1 symbols/min [2025-10-08T19:14:14.621879] [DEBUG] [LOCAL ] GPC: Primary data saved (46159 records). [2025-10-08T19:14:14.622016] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-08T19:14:14.622099] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPC took 37.6s. Estimated remaining: 3h 17m 34s. Rate: 7.1 symbols/min [2025-10-08T19:14:14.994406] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:14:15.217597] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-08T19:14:15.790034] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T19:14:16.017623] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-08T19:14:16.599803] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T19:14:16.817635] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-08T19:14:17.341754] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:14:17.342914] [INFO ] [REMOTE ] GPJA: Full fetch complete (7237 records). [2025-10-08T19:14:17.342993] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-08T19:14:17.725568] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-08T19:14:17.725683] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-08T19:14:17.725892] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-08T19:14:17.725935] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-08T19:14:17.726329] [DEBUG] [LOCAL ] GPJA: Trimmed 7237 records to 4265 (keeping 200 days of data) [2025-10-08T19:14:17.752786] [DEBUG] [LOCAL ] GPJA: Primary data saved (4265 records). [2025-10-08T19:14:17.752897] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-08T19:14:17.752988] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPJA took 19.8s. Estimated remaining: 3h 17m 18s. Rate: 7.2 symbols/min [2025-10-08T19:14:18.411600] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.330593] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.515451] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.513969] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:18.562269] [DEBUG] [LOCAL ] GPMT: Loaded 25876 existing records from primary storage. [2025-10-08T19:14:18.575729] [INFO ] [MAIN ] GPMT: Loaded 25876 existing records. [2025-10-08T19:14:18.575227] [DEBUG] [LOCAL ] GPOR: Loaded 23208 existing records from primary storage. [2025-10-08T19:14:18.581319] [INFO ] [MAIN ] GPOR: Loaded 23208 existing records. [2025-10-08T19:14:18.814569] [DEBUG] [LOCAL ] GPN: Loaded 52045 existing records from primary storage. [2025-10-08T19:14:18.867578] [DEBUG] [LOCAL ] GPK: Loaded 52658 existing records from primary storage. [2025-10-08T19:14:18.892426] [INFO ] [MAIN ] GPN: Loaded 52045 existing records. [2025-10-08T19:14:18.950869] [INFO ] [MAIN ] GPK: Loaded 52658 existing records. [2025-10-08T19:14:19.014670] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.048415] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.070282] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.080681] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-08T19:14:19.114307] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.119682] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-08T19:14:19.124895] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-08T19:14:19.181987] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-08T19:14:19.192525] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-08T19:14:19.197939] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-08T19:14:19.689367] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.802811] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.798338] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:19.883394] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-08T19:14:19.904161] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-08T19:14:19.907101] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-08T19:14:19.978606] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-08T19:14:19.952431] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-08T19:14:20.063390] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-08T19:14:20.052615] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-08T19:14:20.485522] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:20.491866] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-08T19:14:20.583790] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:20.584945] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-08T19:14:21.220191] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:21.246466] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-08T19:14:21.250293] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:21.252614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-08T19:14:21.826307] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:14:21.832810] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-08T19:14:21.983635] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T19:14:21.989404] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-08T19:14:22.573586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:14:22.591306] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-08T19:14:22.601066] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:14:22.662996] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:14:23.219324] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-08T19:14:23.221584] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:14:23.923219] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T19:14:24.017514] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-08T19:14:24.224463] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:14:24.817602] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-08T19:14:25.075465] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:14:25.617540] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-08T19:14:26.418532] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-08T19:14:26.424325] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:14:26.658132] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:14:27.217601] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-08T19:14:27.733286] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:14:28.017609] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-08T19:14:28.817592] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-08T19:14:28.985358] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T19:14:29.617523] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-08T19:14:29.669966] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T19:14:29.740719] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:14:30.417531] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-08T19:14:30.729313] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:14:31.217518] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-08T19:14:32.017534] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-08T19:14:32.077905] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:14:32.393928] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:14:32.817629] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-08T19:14:33.155248] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:14:33.617541] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-08T19:14:34.417518] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-08T19:14:34.805354] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:14:35.217525] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-08T19:14:35.313305] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:14:35.707994] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:14:36.017557] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-08T19:14:36.256453] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T19:14:36.817601] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-08T19:14:37.617593] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-08T19:14:37.694946] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:14:37.759739] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:14:38.417558] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-08T19:14:38.755737] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:14:39.217590] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-08T19:14:40.017565] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-08T19:14:40.219811] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:14:40.244432] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:14:40.817554] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-08T19:14:41.202001] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T19:14:41.617561] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-08T19:14:42.417572] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-08T19:14:42.495990] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:14:42.554358] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T19:14:43.217560] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-08T19:14:44.017562] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-08T19:14:44.108718] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:14:44.358576] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:14:44.817607] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-08T19:14:45.263509] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T19:14:45.617554] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-08T19:14:46.417563] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-08T19:14:47.002530] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T19:14:47.141534] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T19:14:47.146299] [INFO ] [REMOTE ] GPK: Full fetch complete (75618 records). [2025-10-08T19:14:47.146478] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-08T19:14:47.224570] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-08T19:14:47.350253] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T19:14:47.607862] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-08T19:14:47.607959] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-08T19:14:47.608927] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-08T19:14:47.608992] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-08T19:14:47.610503] [DEBUG] [LOCAL ] GPK: Trimmed 75618 records to 52672 (keeping 200 days of data) [2025-10-08T19:14:47.946737] [DEBUG] [LOCAL ] GPK: Primary data saved (52672 records). [2025-10-08T19:14:47.946900] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-08T19:14:47.947006] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPK took 30.2s. Estimated remaining: 3h 17m 41s. Rate: 7.1 symbols/min [2025-10-08T19:14:48.022701] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-08T19:14:48.121505] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:48.159030] [DEBUG] [LOCAL ] GPRK: Loaded 39388 existing records from primary storage. [2025-10-08T19:14:48.159365] [INFO ] [MAIN ] GPRK: Loaded 39388 existing records. [2025-10-08T19:14:48.336683] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:48.336897] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-08T19:14:48.336944] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-08T19:14:48.337171] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-08T19:14:48.337228] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-08T19:14:48.696250] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:48.817539] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-08T19:14:48.893137] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:14:48.895076] [INFO ] [REMOTE ] GPMT: Full fetch complete (37116 records). [2025-10-08T19:14:48.895153] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-08T19:14:49.221339] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-08T19:14:49.313901] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-08T19:14:49.313987] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-08T19:14:49.314701] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-08T19:14:49.314764] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-08T19:14:49.315623] [DEBUG] [LOCAL ] GPMT: Trimmed 37116 records to 25869 (keeping 200 days of data) [2025-10-08T19:14:49.470174] [DEBUG] [LOCAL ] GPMT: Primary data saved (25869 records). [2025-10-08T19:14:49.470327] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-08T19:14:49.470414] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 31.7s. Estimated remaining: 3h 17m 23s. Rate: 7.1 symbols/min [2025-10-08T19:14:49.623435] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-08T19:14:49.642115] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:49.669627] [DEBUG] [LOCAL ] GRBK: Loaded 26976 existing records from primary storage. [2025-10-08T19:14:49.669941] [INFO ] [MAIN ] GRBK: Loaded 26976 existing records. [2025-10-08T19:14:49.845106] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:49.845351] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-08T19:14:49.845397] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-08T19:14:49.845676] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-08T19:14:49.845735] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-08T19:14:50.241157] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:50.265903] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:14:50.417549] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-08T19:14:51.144977] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:14:51.217552] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-08T19:14:51.479947] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:14:52.017621] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-08T19:14:52.536209] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:14:52.817578] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-08T19:14:53.206281] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:14:53.208761] [INFO ] [REMOTE ] GPOR: Full fetch complete (35003 records). [2025-10-08T19:14:53.208845] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-08T19:14:53.620896] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-08T19:14:53.620602] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-08T19:14:53.621810] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-08T19:14:53.622435] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-08T19:14:53.622478] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-08T19:14:53.623551] [DEBUG] [LOCAL ] GPOR: Trimmed 35003 records to 23230 (keeping 200 days of data) [2025-10-08T19:14:53.771616] [DEBUG] [LOCAL ] GPOR: Primary data saved (23230 records). [2025-10-08T19:14:53.771828] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-08T19:14:53.771931] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPOR took 36.0s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-08T19:14:53.937732] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:14:53.948395] [DEBUG] [LOCAL ] GRC: Loaded 9198 existing records from primary storage. [2025-10-08T19:14:53.948674] [INFO ] [MAIN ] GRC: Loaded 9198 existing records. [2025-10-08T19:14:54.127410] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:14:54.127672] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-08T19:14:54.127744] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-08T19:14:54.128073] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-08T19:14:54.128141] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-08T19:14:54.420537] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-08T19:14:54.530634] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:14:54.545128] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T19:14:54.584292] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:14:55.217602] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-08T19:14:55.462131] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:14:55.996011] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T19:14:56.017504] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-08T19:14:56.684015] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T19:14:56.817588] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-08T19:14:57.560075] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T19:14:57.617500] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-08T19:14:58.254208] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:14:58.417540] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-08T19:14:59.092864] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:14:59.217561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-08T19:14:59.968391] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:15:00.017546] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-08T19:15:00.817719] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-08T19:15:01.617551] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-08T19:15:01.654498] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T19:15:01.703425] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:15:02.417567] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-08T19:15:03.136692] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:15:03.217564] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-08T19:15:03.348222] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:15:03.353069] [INFO ] [REMOTE ] GPN: Full fetch complete (74914 records). [2025-10-08T19:15:03.353201] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-08T19:15:03.768333] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-08T19:15:03.768578] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-08T19:15:03.769683] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-08T19:15:03.769765] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-08T19:15:03.771174] [DEBUG] [LOCAL ] GPN: Trimmed 74914 records to 52027 (keeping 200 days of data) [2025-10-08T19:15:03.869301] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T19:15:04.017613] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-08T19:15:04.104131] [DEBUG] [LOCAL ] GPN: Primary data saved (52027 records). [2025-10-08T19:15:04.104283] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-08T19:15:04.104371] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 46.4s. Estimated remaining: 3h 17m 3s. Rate: 7.1 symbols/min [2025-10-08T19:15:04.271559] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:04.292105] [DEBUG] [LOCAL ] GRDN: Loaded 20854 existing records from primary storage. [2025-10-08T19:15:04.292360] [INFO ] [MAIN ] GRDN: Loaded 20854 existing records. [2025-10-08T19:15:04.467484] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:04.467689] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-08T19:15:04.467747] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-08T19:15:04.468037] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-08T19:15:04.468095] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-08T19:15:04.817524] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:04.817730] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-08T19:15:05.252791] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:15:05.617590] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-08T19:15:05.769838] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:15:06.417599] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-08T19:15:07.217524] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-08T19:15:07.311595] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:15:07.374524] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:15:07.926887] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T19:15:08.017512] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-08T19:15:08.815019] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:15:08.818345] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-08T19:15:09.617599] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-08T19:15:09.739540] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:15:10.417604] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-08T19:15:11.217573] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-08T19:15:11.254244] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:15:11.749713] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:15:11.833074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:15:12.017573] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-08T19:15:12.817614] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-08T19:15:13.350319] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:15:13.452563] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:15:13.454244] [INFO ] [REMOTE ] GRC: Full fetch complete (13282 records). [2025-10-08T19:15:13.454336] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-08T19:15:13.621201] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-08T19:15:13.849906] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-08T19:15:13.850008] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-08T19:15:13.850348] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-08T19:15:13.850389] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-08T19:15:13.850897] [DEBUG] [LOCAL ] GRC: Trimmed 13282 records to 9202 (keeping 200 days of data) [2025-10-08T19:15:13.908824] [DEBUG] [LOCAL ] GRC: Primary data saved (9202 records). [2025-10-08T19:15:13.908977] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-08T19:15:13.909067] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GRC took 20.1s. Estimated remaining: 3h 16m 56s. Rate: 7.1 symbols/min [2025-10-08T19:15:14.076095] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:14.114974] [DEBUG] [LOCAL ] GRMN: Loaded 40786 existing records from primary storage. [2025-10-08T19:15:14.115280] [INFO ] [MAIN ] GRMN: Loaded 40786 existing records. [2025-10-08T19:15:14.291008] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:14.291271] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-08T19:15:14.291317] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-08T19:15:14.291571] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-08T19:15:14.291628] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-08T19:15:14.430158] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-08T19:15:14.657503] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:14.853139] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:15:14.954481] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T19:15:15.217574] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-08T19:15:16.017581] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-08T19:15:16.199299] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T19:15:16.817567] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-08T19:15:17.217528] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:15:17.512209] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T19:15:17.617508] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-08T19:15:18.417620] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-08T19:15:18.962536] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T19:15:19.217610] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-08T19:15:19.777476] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:15:20.017548] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-08T19:15:20.726811] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:15:20.817512] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-08T19:15:20.949596] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T19:15:21.617597] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-08T19:15:22.226391] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:15:22.229833] [INFO ] [REMOTE ] GPRK: Full fetch complete (57687 records). [2025-10-08T19:15:22.229935] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-08T19:15:22.428594] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-08T19:15:22.621760] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-08T19:15:22.621845] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-08T19:15:22.622627] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-08T19:15:22.622716] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-08T19:15:22.624046] [DEBUG] [LOCAL ] GPRK: Trimmed 57687 records to 39463 (keeping 200 days of data) [2025-10-08T19:15:22.859996] [DEBUG] [LOCAL ] GPRK: Primary data saved (39463 records). [2025-10-08T19:15:22.860146] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-08T19:15:22.860232] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 34.9s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-08T19:15:23.072595] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:23.097024] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:15:23.152405] [DEBUG] [LOCAL ] GRND: Loaded 49989 existing records from primary storage. [2025-10-08T19:15:23.152779] [INFO ] [MAIN ] GRND: Loaded 49989 existing records. [2025-10-08T19:15:23.222820] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-08T19:15:23.356990] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:23.357248] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-08T19:15:23.357336] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-08T19:15:23.358079] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-08T19:15:23.358142] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-08T19:15:23.753519] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:23.754870] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:15:24.017566] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-08T19:15:24.406810] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:15:24.817569] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-08T19:15:25.270569] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T19:15:25.617574] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-08T19:15:26.421023] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-08T19:15:26.426494] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:15:26.478796] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T19:15:27.217573] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-08T19:15:27.736957] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:15:28.017565] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-08T19:15:28.476688] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:15:28.817540] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-08T19:15:29.595200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:15:29.617590] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-08T19:15:30.411068] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T19:15:30.424956] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-08T19:15:30.480126] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:15:30.484680] [INFO ] [REMOTE ] GRBK: Full fetch complete (40523 records). [2025-10-08T19:15:30.484872] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-08T19:15:30.879278] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-08T19:15:30.879375] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-08T19:15:30.880109] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-08T19:15:30.880171] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-08T19:15:30.882083] [DEBUG] [LOCAL ] GRBK: Trimmed 40523 records to 26912 (keeping 200 days of data) [2025-10-08T19:15:31.047699] [DEBUG] [LOCAL ] GRBK: Primary data saved (26912 records). [2025-10-08T19:15:31.047855] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-08T19:15:31.048001] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRBK took 41.6s. Estimated remaining: 3h 16m 40s. Rate: 7.1 symbols/min [2025-10-08T19:15:31.221593] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-08T19:15:31.223299] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:31.257125] [DEBUG] [LOCAL ] GRNT: Loaded 33812 existing records from primary storage. [2025-10-08T19:15:31.257485] [INFO ] [MAIN ] GRNT: Loaded 33812 existing records. [2025-10-08T19:15:31.441062] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:31.441349] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-08T19:15:31.441413] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-08T19:15:31.442329] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-08T19:15:31.442391] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-08T19:15:31.806069] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:31.877295] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:15:32.017547] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-08T19:15:32.108012] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T19:15:32.817677] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-08T19:15:33.277208] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:15:33.617575] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-08T19:15:33.892703] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:15:34.417600] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-08T19:15:35.222675] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-08T19:15:35.243200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:15:35.271877] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T19:15:36.017548] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-08T19:15:36.554081] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:15:36.817549] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-08T19:15:37.101440] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:15:37.104385] [INFO ] [REMOTE ] GRDN: Full fetch complete (26327 records). [2025-10-08T19:15:37.104480] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-08T19:15:37.473291] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-08T19:15:37.473381] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-08T19:15:37.474003] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-08T19:15:37.474067] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-08T19:15:37.474891] [DEBUG] [LOCAL ] GRDN: Trimmed 26327 records to 20937 (keeping 200 days of data) [2025-10-08T19:15:37.607231] [DEBUG] [LOCAL ] GRDN: Primary data saved (20937 records). [2025-10-08T19:15:37.607405] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-08T19:15:37.607575] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRDN took 33.5s. Estimated remaining: 3h 16m 29s. Rate: 7.1 symbols/min [2025-10-08T19:15:37.622798] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-08T19:15:37.783749] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:37.794391] [DEBUG] [LOCAL ] GROV: Loaded 8861 existing records from primary storage. [2025-10-08T19:15:37.794686] [INFO ] [MAIN ] GROV: Loaded 8861 existing records. [2025-10-08T19:15:37.972152] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:37.972411] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-08T19:15:37.972458] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-08T19:15:37.972873] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-08T19:15:37.972934] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-08T19:15:38.369186] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:38.397554] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:15:38.417511] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-08T19:15:39.217601] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-08T19:15:39.431570] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:15:39.737974] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:15:39.767993] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T19:15:40.017628] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-08T19:15:40.817580] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-08T19:15:40.887009] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:15:41.617542] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-08T19:15:42.165931] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:15:42.417564] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-08T19:15:42.468520] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T19:15:43.217575] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-08T19:15:43.722175] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:15:44.017551] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-08T19:15:44.067519] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:15:44.817560] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-08T19:15:45.622845] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-08T19:15:45.641277] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:15:46.017329] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:15:46.188609] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T19:15:46.417568] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-08T19:15:47.217707] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-08T19:15:47.925930] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:15:47.988630] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:15:48.017504] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-08T19:15:48.778068] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:15:48.817560] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-08T19:15:49.395071] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T19:15:49.617587] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-08T19:15:50.326411] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T19:15:50.417559] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-08T19:15:51.165592] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:15:51.217495] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-08T19:15:51.826873] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:15:52.017597] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-08T19:15:52.645193] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:15:52.646326] [INFO ] [REMOTE ] GROV: Full fetch complete (14295 records). [2025-10-08T19:15:52.646426] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-08T19:15:52.825464] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-08T19:15:53.043684] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-08T19:15:53.043772] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-08T19:15:53.044128] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-08T19:15:53.044166] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-08T19:15:53.044663] [DEBUG] [LOCAL ] GROV: Trimmed 14295 records to 8857 (keeping 200 days of data) [2025-10-08T19:15:53.097147] [DEBUG] [LOCAL ] GROV: Primary data saved (8857 records). [2025-10-08T19:15:53.097280] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-08T19:15:53.097380] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GROV took 15.5s. Estimated remaining: 3h 16m 31s. Rate: 7.1 symbols/min [2025-10-08T19:15:53.286813] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:53.294031] [DEBUG] [LOCAL ] GRX: Loaded 4786 existing records from primary storage. [2025-10-08T19:15:53.294251] [INFO ] [MAIN ] GRX: Loaded 4786 existing records. [2025-10-08T19:15:53.485524] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:53.485771] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-08T19:15:53.485833] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-08T19:15:53.486142] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-08T19:15:53.486201] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-08T19:15:53.622700] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-08T19:15:53.870918] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:54.095990] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:15:54.417544] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-08T19:15:55.035443] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T19:15:55.075932] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:15:55.079721] [INFO ] [REMOTE ] GRND: Full fetch complete (71100 records). [2025-10-08T19:15:55.079832] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-08T19:15:55.222706] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-08T19:15:55.489582] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-08T19:15:55.489744] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-08T19:15:55.490782] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-08T19:15:55.490847] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-08T19:15:55.493124] [DEBUG] [LOCAL ] GRND: Trimmed 71100 records to 49969 (keeping 200 days of data) [2025-10-08T19:15:55.799624] [DEBUG] [LOCAL ] GRND: Primary data saved (49969 records). [2025-10-08T19:15:55.799766] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-08T19:15:55.799868] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRND took 32.9s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-10-08T19:15:55.905272] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T19:15:56.020438] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:15:56.020505] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-08T19:15:56.075396] [DEBUG] [LOCAL ] GS: Loaded 51792 existing records from primary storage. [2025-10-08T19:15:56.075751] [INFO ] [MAIN ] GS: Loaded 51792 existing records. [2025-10-08T19:15:56.256673] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:15:56.257044] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-08T19:15:56.257113] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-08T19:15:56.258755] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-08T19:15:56.258818] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-08T19:15:56.610812] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:15:56.616036] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:15:56.817531] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-08T19:15:57.617609] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-08T19:15:58.175057] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T19:15:58.417520] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-08T19:15:58.557506] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:15:58.983877] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T19:15:59.217553] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-08T19:15:59.581631] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T19:16:00.017565] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-08T19:16:00.817591] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-08T19:16:01.308956] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:16:01.376151] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:16:01.617562] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-08T19:16:02.417637] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-08T19:16:03.026354] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:16:03.217550] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-08T19:16:03.694186] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T19:16:04.017540] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-08T19:16:04.369107] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T19:16:04.817515] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-08T19:16:05.286261] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T19:16:05.437800] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T19:16:05.617626] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-08T19:16:06.143920] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-08T19:16:06.417630] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-08T19:16:07.217564] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-08T19:16:07.988087] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T19:16:07.989239] [INFO ] [REMOTE ] GRX: Full fetch complete (6622 records). [2025-10-08T19:16:07.989312] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-08T19:16:08.022720] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-08T19:16:08.365266] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-08T19:16:08.365350] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-08T19:16:08.365540] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-08T19:16:08.365577] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-08T19:16:08.366010] [DEBUG] [LOCAL ] GRX: Trimmed 6622 records to 4764 (keeping 200 days of data) [2025-10-08T19:16:08.394818] [DEBUG] [LOCAL ] GRX: Primary data saved (4764 records). [2025-10-08T19:16:08.394996] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-08T19:16:08.395125] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRX took 15.3s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-08T19:16:08.583514] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:08.624412] [DEBUG] [LOCAL ] GSBD: Loaded 39246 existing records from primary storage. [2025-10-08T19:16:08.624935] [INFO ] [MAIN ] GSBD: Loaded 39246 existing records. [2025-10-08T19:16:08.826808] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-08T19:16:08.840360] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:08.853770] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-08T19:16:08.853843] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-08T19:16:08.856363] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-08T19:16:08.856294] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-08T19:16:08.856849] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-08T19:16:09.232135] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:09.257332] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:16:09.617571] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-08T19:16:10.235956] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:16:10.417617] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-08T19:16:10.828095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T19:16:11.217577] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-08T19:16:11.561832] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:16:12.017577] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-08T19:16:12.324760] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:16:12.327772] [INFO ] [REMOTE ] GRMN: Full fetch complete (59807 records). [2025-10-08T19:16:12.327892] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-08T19:16:12.774967] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-08T19:16:12.775061] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-08T19:16:12.775969] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-08T19:16:12.776038] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-08T19:16:12.777440] [DEBUG] [LOCAL ] GRMN: Trimmed 59807 records to 40656 (keeping 200 days of data) [2025-10-08T19:16:12.860562] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-08T19:16:13.105002] [DEBUG] [LOCAL ] GRMN: Primary data saved (40656 records). [2025-10-08T19:16:13.105286] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-08T19:16:13.105502] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRMN took 59.2s. Estimated remaining: 3h 15m 58s. Rate: 7.1 symbols/min [2025-10-08T19:16:13.315751] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:13.370992] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-08T19:16:13.371362] [INFO ] [MAIN ] GSK: Loaded 53502 existing records. [2025-10-08T19:16:13.548787] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:13.549174] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-08T19:16:13.549293] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-08T19:16:13.550838] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-08T19:16:13.550900] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-08T19:16:13.624781] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-08T19:16:13.916541] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T19:16:13.947279] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:13.980836] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:16:14.417611] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-08T19:16:15.218156] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-08T19:16:15.423730] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T19:16:16.008705] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:16:16.017494] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-08T19:16:16.681502] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:16:16.817557] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-08T19:16:17.617553] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-08T19:16:17.671872] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T19:16:18.417607] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-08T19:16:19.217542] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-08T19:16:19.341151] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-08T19:16:19.512364] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:16:19.626512] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:16:20.017586] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-08T19:16:20.817546] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-08T19:16:20.896352] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:16:21.617550] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-08T19:16:21.863634] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T19:16:22.417639] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-08T19:16:22.612968] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:16:22.686733] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:16:23.217524] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-08T19:16:23.585245] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T19:16:24.017581] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-08T19:16:24.817614] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-08T19:16:25.032273] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T19:16:25.180536] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:16:25.183911] [INFO ] [REMOTE ] GRNT: Full fetch complete (48437 records). [2025-10-08T19:16:25.184021] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-08T19:16:25.622771] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-08T19:16:25.626185] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-08T19:16:25.626240] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-08T19:16:25.627151] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-08T19:16:25.627315] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-08T19:16:25.628603] [DEBUG] [LOCAL ] GRNT: Trimmed 48437 records to 33908 (keeping 200 days of data) [2025-10-08T19:16:25.833700] [DEBUG] [LOCAL ] GRNT: Primary data saved (33908 records). [2025-10-08T19:16:25.833865] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-08T19:16:25.833972] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRNT took 54.8s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-08T19:16:26.020963] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:26.054169] [DEBUG] [LOCAL ] GSL: Loaded 33185 existing records from primary storage. [2025-10-08T19:16:26.054518] [INFO ] [MAIN ] GSL: Loaded 33185 existing records. [2025-10-08T19:16:26.240089] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:26.240447] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-08T19:16:26.240520] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-08T19:16:26.241683] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-08T19:16:26.241748] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-08T19:16:26.418202] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-08T19:16:26.656967] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:26.690601] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T19:16:27.217631] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-08T19:16:27.764875] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:16:27.895151] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T19:16:28.017556] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-08T19:16:28.729591] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:16:28.817531] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-08T19:16:29.374443] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T19:16:29.617567] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-08T19:16:30.417561] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-08T19:16:30.725394] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T19:16:30.919237] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:16:31.217610] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-08T19:16:31.743444] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T19:16:32.017553] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-08T19:16:32.762100] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:16:32.817563] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-08T19:16:33.060122] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:16:33.617572] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-08T19:16:34.417621] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-08T19:16:34.943427] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T19:16:34.996303] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T19:16:35.217554] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-08T19:16:35.626577] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:16:36.017632] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-08T19:16:36.602054] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:16:36.817582] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-08T19:16:37.617550] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-08T19:16:38.031041] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T19:16:38.208636] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:16:38.417563] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-08T19:16:38.684017] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T19:16:39.217599] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-08T19:16:39.855169] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:16:39.858782] [INFO ] [REMOTE ] GSBD: Full fetch complete (58478 records). [2025-10-08T19:16:39.858893] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-08T19:16:40.035722] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-08T19:16:40.253818] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-08T19:16:40.253919] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-08T19:16:40.254741] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-08T19:16:40.254807] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-08T19:16:40.256155] [DEBUG] [LOCAL ] GSBD: Trimmed 58478 records to 39374 (keeping 200 days of data) [2025-10-08T19:16:40.509055] [DEBUG] [LOCAL ] GSBD: Primary data saved (39374 records). [2025-10-08T19:16:40.509224] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-08T19:16:40.509340] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GSBD took 32.1s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-08T19:16:40.697077] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:40.742585] [DEBUG] [LOCAL ] GTES: Loaded 50458 existing records from primary storage. [2025-10-08T19:16:40.742970] [INFO ] [MAIN ] GTES: Loaded 50458 existing records. [2025-10-08T19:16:40.822478] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-08T19:16:40.926670] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:40.926940] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-08T19:16:40.928029] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-08T19:16:40.929469] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-08T19:16:40.929532] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-08T19:16:41.298808] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:41.320783] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:16:41.358452] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T19:16:41.617552] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-08T19:16:42.417616] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-08T19:16:42.753040] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T19:16:43.217573] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-08T19:16:43.345763] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:16:43.349520] [INFO ] [REMOTE ] GS: Full fetch complete (75647 records). [2025-10-08T19:16:43.349625] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-08T19:16:43.741126] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-08T19:16:43.741242] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-08T19:16:43.742244] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-08T19:16:43.742327] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-08T19:16:43.743988] [DEBUG] [LOCAL ] GS: Trimmed 75647 records to 51771 (keeping 200 days of data) [2025-10-08T19:16:43.864256] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:16:44.017522] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-08T19:16:44.107841] [DEBUG] [LOCAL ] GS: Primary data saved (51771 records). [2025-10-08T19:16:44.108004] [INFO ] [MAIN ] GS: Full history saved. [2025-10-08T19:16:44.109066] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GS took 48.3s. Estimated remaining: 3h 15m 41s. Rate: 7.1 symbols/min [2025-10-08T19:16:44.273411] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:44.316417] [DEBUG] [LOCAL ] GTLS: Loaded 42987 existing records from primary storage. [2025-10-08T19:16:44.316756] [INFO ] [MAIN ] GTLS: Loaded 42987 existing records. [2025-10-08T19:16:44.495841] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:44.496083] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-08T19:16:44.496128] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-08T19:16:44.497425] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-08T19:16:44.497489] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-08T19:16:44.821161] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-08T19:16:44.883229] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:44.943512] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T19:16:45.279599] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T19:16:45.617551] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-08T19:16:46.417506] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-08T19:16:46.619553] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T19:16:46.735512] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:16:47.217565] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-08T19:16:47.620311] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:16:48.017561] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-08T19:16:48.817536] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-08T19:16:48.838512] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:16:48.843012] [INFO ] [REMOTE ] GSK: Full fetch complete (77475 records). [2025-10-08T19:16:48.843141] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-08T19:16:49.247519] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-08T19:16:49.247663] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-08T19:16:49.249466] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-08T19:16:49.249738] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-08T19:16:49.251458] [DEBUG] [LOCAL ] GSK: Trimmed 77475 records to 53500 (keeping 200 days of data) [2025-10-08T19:16:49.631391] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-08T19:16:49.634841] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T19:16:49.661008] [DEBUG] [LOCAL ] GSK: Primary data saved (53500 records). [2025-10-08T19:16:49.661132] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-08T19:16:49.661229] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSK took 36.6s. Estimated remaining: 3h 15m 29s. Rate: 7.1 symbols/min [2025-10-08T19:16:49.852007] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:49.901625] [DEBUG] [LOCAL ] GTN: Loaded 45327 existing records from primary storage. [2025-10-08T19:16:49.902022] [INFO ] [MAIN ] GTN: Loaded 45327 existing records. [2025-10-08T19:16:50.077998] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:50.078230] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-08T19:16:50.078279] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-08T19:16:50.079521] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-08T19:16:50.079581] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-08T19:16:50.432358] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-08T19:16:50.438187] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:50.465023] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:16:50.740319] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:16:50.743033] [INFO ] [REMOTE ] GSL: Full fetch complete (47956 records). [2025-10-08T19:16:50.743126] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-08T19:16:51.161352] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-08T19:16:51.161431] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-08T19:16:51.162140] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-08T19:16:51.162202] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-08T19:16:51.163181] [DEBUG] [LOCAL ] GSL: Trimmed 47956 records to 33224 (keeping 200 days of data) [2025-10-08T19:16:51.224097] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-08T19:16:51.368083] [DEBUG] [LOCAL ] GSL: Primary data saved (33224 records). [2025-10-08T19:16:51.368247] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-08T19:16:51.368336] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 25.5s. Estimated remaining: 3h 15m 11s. Rate: 7.1 symbols/min [2025-10-08T19:16:51.536627] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:16:51.573112] [DEBUG] [LOCAL ] GTY: Loaded 30174 existing records from primary storage. [2025-10-08T19:16:51.573635] [INFO ] [MAIN ] GTY: Loaded 30174 existing records. [2025-10-08T19:16:51.762505] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:16:51.762823] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-08T19:16:51.762872] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-08T19:16:51.763979] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-08T19:16:51.764041] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-08T19:16:52.020832] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-08T19:16:52.158718] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:16:52.171195] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T19:16:52.438128] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:16:52.817560] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-08T19:16:53.396604] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:16:53.617561] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-08T19:16:54.427479] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-08T19:16:54.453716] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:16:55.217570] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-08T19:16:55.293750] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T19:16:55.364049] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:16:56.017541] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-08T19:16:56.644031] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:16:56.817472] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-08T19:16:57.617583] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-08T19:16:57.664148] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T19:16:58.296059] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:16:58.417495] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-08T19:16:59.071103] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:16:59.217493] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-08T19:16:59.746148] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:17:00.017547] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-08T19:17:00.723234] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:17:00.817499] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-08T19:17:01.283541] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:17:01.617546] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-08T19:17:02.417607] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-08T19:17:02.527299] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T19:17:03.075822] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:17:03.217615] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-08T19:17:03.701307] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:17:04.017550] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-08T19:17:04.118448] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:17:04.817607] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-08T19:17:05.319991] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T19:17:05.617549] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-08T19:17:05.813828] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:17:06.417567] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-08T19:17:07.217555] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-08T19:17:07.345828] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T19:17:07.828333] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:17:08.017638] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-08T19:17:08.616894] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:17:08.817573] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-08T19:17:09.357031] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T19:17:09.617545] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-08T19:17:10.101399] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:17:10.417552] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-08T19:17:10.437692] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T19:17:11.217635] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-08T19:17:11.815445] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T19:17:11.819559] [INFO ] [REMOTE ] GTLS: Full fetch complete (61427 records). [2025-10-08T19:17:11.819706] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-08T19:17:12.026588] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-08T19:17:12.212942] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-08T19:17:12.213035] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-08T19:17:12.213891] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-08T19:17:12.213959] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-08T19:17:12.215520] [DEBUG] [LOCAL ] GTLS: Trimmed 61427 records to 42973 (keeping 200 days of data) [2025-10-08T19:17:12.486670] [DEBUG] [LOCAL ] GTLS: Primary data saved (42973 records). [2025-10-08T19:17:12.486809] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-08T19:17:12.486907] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTLS took 28.4s. Estimated remaining: 3h 15m 20s. Rate: 7.1 symbols/min [2025-10-08T19:17:12.653453] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:17:12.672500] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:12.676428] [INFO ] [REMOTE ] GTES: Full fetch complete (73800 records). [2025-10-08T19:17:12.676515] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-08T19:17:12.839410] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-08T19:17:12.886888] [DEBUG] [LOCAL ] GUG: Loaded 12172 existing records from primary storage. [2025-10-08T19:17:12.933415] [INFO ] [MAIN ] GUG: Loaded 12172 existing records. [2025-10-08T19:17:13.265862] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-08T19:17:13.286121] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-08T19:17:13.286060] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:13.287444] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-08T19:17:13.287611] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-08T19:17:13.287703] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-08T19:17:13.287765] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-08T19:17:13.288295] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-08T19:17:13.288619] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-08T19:17:13.375444] [DEBUG] [LOCAL ] GTES: Trimmed 73800 records to 50433 (keeping 200 days of data) [2025-10-08T19:17:13.788848] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:13.790325] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-08T19:17:13.836739] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:17:14.057164] [DEBUG] [LOCAL ] GTES: Primary data saved (50433 records). [2025-10-08T19:17:14.057371] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-08T19:17:14.057487] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 33.5s. Estimated remaining: 3h 15m 2s. Rate: 7.1 symbols/min [2025-10-08T19:17:14.313791] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:14.318448] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:17:14.366384] [DEBUG] [LOCAL ] GUT: Loaded 15453 existing records from primary storage. [2025-10-08T19:17:14.366822] [INFO ] [MAIN ] GUT: Loaded 15453 existing records. [2025-10-08T19:17:14.420022] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-08T19:17:14.677185] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:14.677519] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-08T19:17:14.677602] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-08T19:17:14.678380] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-08T19:17:14.678495] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-08T19:17:14.903807] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T19:17:15.184774] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:15.217581] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-08T19:17:15.794879] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:17:16.017577] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-08T19:17:16.034471] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T19:17:16.817595] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-08T19:17:17.622614] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-08T19:17:17.627373] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:17:17.701154] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:17:18.227757] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:17:18.417691] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-08T19:17:19.217716] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-08T19:17:19.781017] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:17:20.017593] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-08T19:17:20.163079] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T19:17:20.817600] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-08T19:17:21.453979] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:17:21.617597] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-08T19:17:21.683972] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T19:17:22.417568] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-08T19:17:22.661395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:17:23.217580] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-08T19:17:24.017600] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-08T19:17:24.118046] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T19:17:24.143226] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:17:24.817606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-08T19:17:24.982791] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:17:25.431241] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T19:17:25.617617] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-08T19:17:26.417577] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-08T19:17:26.538504] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T19:17:27.217567] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-08T19:17:27.831798] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:17:28.017567] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-08T19:17:28.235912] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T19:17:28.817563] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-08T19:17:29.230544] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:17:29.617559] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-08T19:17:29.655961] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:17:30.417545] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-08T19:17:30.810395] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:17:30.813031] [INFO ] [REMOTE ] GTY: Full fetch complete (43733 records). [2025-10-08T19:17:30.813129] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-08T19:17:31.226080] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-08T19:17:31.246772] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-08T19:17:31.246868] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-08T19:17:31.247905] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-08T19:17:31.248104] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-08T19:17:31.253102] [DEBUG] [LOCAL ] GTY: Trimmed 43733 records to 30191 (keeping 200 days of data) [2025-10-08T19:17:31.459813] [DEBUG] [LOCAL ] GTY: Primary data saved (30191 records). [2025-10-08T19:17:31.459978] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-08T19:17:31.460130] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTY took 40.1s. Estimated remaining: 3h 15m 7s. Rate: 7.1 symbols/min [2025-10-08T19:17:31.654786] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:31.689809] [DEBUG] [LOCAL ] GVA: Loaded 32996 existing records from primary storage. [2025-10-08T19:17:31.690127] [INFO ] [MAIN ] GVA: Loaded 32996 existing records. [2025-10-08T19:17:31.875450] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:31.875773] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-08T19:17:31.875860] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-08T19:17:31.885666] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-08T19:17:31.885853] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-08T19:17:31.892779] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:17:31.962572] [INFO ] [REMOTE ] GTN: Full fetch complete (66265 records). [2025-10-08T19:17:31.981158] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-08T19:17:32.033977] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:17:32.022624] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-08T19:17:32.601531] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:32.705109] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-08T19:17:32.705201] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-08T19:17:32.706102] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-08T19:17:32.706169] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-08T19:17:32.707522] [DEBUG] [LOCAL ] GTN: Trimmed 66265 records to 45251 (keeping 200 days of data) [2025-10-08T19:17:32.823794] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-08T19:17:32.978411] [DEBUG] [LOCAL ] GTN: Primary data saved (45251 records). [2025-10-08T19:17:32.978582] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-08T19:17:32.978717] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTN took 43.3s. Estimated remaining: 3h 14m 48s. Rate: 7.1 symbols/min [2025-10-08T19:17:33.092964] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:17:33.167955] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:33.185542] [DEBUG] [LOCAL ] GWH: Loaded 16885 existing records from primary storage. [2025-10-08T19:17:33.185865] [INFO ] [MAIN ] GWH: Loaded 16885 existing records. [2025-10-08T19:17:33.360900] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:33.361156] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-08T19:17:33.361204] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-08T19:17:33.361788] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-08T19:17:33.361848] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-08T19:17:33.618261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-08T19:17:33.738032] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:33.739403] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:17:34.417591] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-08T19:17:35.069050] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:17:35.160931] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:17:35.217558] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-08T19:17:36.017547] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-08T19:17:36.189773] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T19:17:36.720570] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:17:36.817580] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-08T19:17:37.410040] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T19:17:37.617572] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-08T19:17:38.417575] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-08T19:17:38.479149] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:17:38.480691] [INFO ] [REMOTE ] GUT: Full fetch complete (22659 records). [2025-10-08T19:17:38.480783] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-08T19:17:38.850306] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-08T19:17:38.850374] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-08T19:17:38.850874] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-08T19:17:38.850936] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-08T19:17:38.851595] [DEBUG] [LOCAL ] GUT: Trimmed 22659 records to 15479 (keeping 200 days of data) [2025-10-08T19:17:38.943065] [DEBUG] [LOCAL ] GUT: Primary data saved (15479 records). [2025-10-08T19:17:38.943207] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-08T19:17:38.943292] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUT took 24.9s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-08T19:17:39.125791] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:39.163701] [DEBUG] [LOCAL ] GWRE: Loaded 40202 existing records from primary storage. [2025-10-08T19:17:39.164060] [INFO ] [MAIN ] GWRE: Loaded 40202 existing records. [2025-10-08T19:17:39.222697] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-08T19:17:39.363584] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:17:39.367636] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:39.371331] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-08T19:17:39.371414] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-08T19:17:39.372626] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-08T19:17:39.372711] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-08T19:17:39.755846] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:40.017531] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-08T19:17:40.101849] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:17:40.817553] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-08T19:17:41.617517] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-08T19:17:41.752628] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:17:41.873776] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:17:42.088990] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T19:17:42.417547] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-08T19:17:43.012678] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:17:43.217553] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-08T19:17:44.017606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-08T19:17:44.626058] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:17:44.817504] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-08T19:17:44.839232] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T19:17:44.840669] [INFO ] [REMOTE ] GUG: Full fetch complete (19574 records). [2025-10-08T19:17:44.840746] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-08T19:17:45.200204] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-08T19:17:45.200291] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-08T19:17:45.200714] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-08T19:17:45.200773] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-08T19:17:45.201300] [DEBUG] [LOCAL ] GUG: Trimmed 19574 records to 12241 (keeping 200 days of data) [2025-10-08T19:17:45.277170] [DEBUG] [LOCAL ] GUG: Primary data saved (12241 records). [2025-10-08T19:17:45.277319] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-08T19:17:45.277410] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 32.8s. Estimated remaining: 3h 14m 25s. Rate: 7.1 symbols/min [2025-10-08T19:17:45.443733] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:17:45.467818] [DEBUG] [LOCAL ] GWW: Loaded 19466 existing records from primary storage. [2025-10-08T19:17:45.468235] [INFO ] [MAIN ] GWW: Loaded 19466 existing records. [2025-10-08T19:17:45.622457] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-08T19:17:45.647695] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:17:45.648064] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-08T19:17:45.648131] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-08T19:17:45.648974] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-08T19:17:45.649037] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-08T19:17:46.041197] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:17:46.325632] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:17:46.417539] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-08T19:17:46.520839] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T19:17:47.217535] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-08T19:17:47.464737] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:17:48.017553] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-08T19:17:48.520842] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:17:48.778393] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:17:48.817599] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-08T19:17:49.617553] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-08T19:17:49.911170] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T19:17:50.417572] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-08T19:17:50.899250] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:17:51.217608] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-08T19:17:51.700289] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:17:51.977187] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:17:52.017567] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-08T19:17:52.817547] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-08T19:17:53.617748] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T19:17:53.618017] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-08T19:17:53.674614] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T19:17:54.264019] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T19:17:54.417561] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-08T19:17:55.217564] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-08T19:17:55.475559] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T19:17:56.017525] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-08T19:17:56.337129] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:17:56.817563] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-08T19:17:57.577402] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:17:57.617539] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-08T19:17:57.737625] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:17:58.417700] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-08T19:17:58.679396] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:17:59.217601] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-08T19:17:59.566885] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:18:00.017544] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-08T19:18:00.119774] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T19:18:00.817581] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-08T19:18:01.070011] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:18:01.617559] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-08T19:18:01.865960] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T19:18:02.417557] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-08T19:18:02.657592] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:18:03.217551] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-08T19:18:03.432520] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T19:18:03.435200] [INFO ] [REMOTE ] GVA: Full fetch complete (48485 records). [2025-10-08T19:18:03.435301] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-08T19:18:03.827772] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-08T19:18:03.827866] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-08T19:18:03.828675] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-08T19:18:03.828744] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-08T19:18:03.829832] [DEBUG] [LOCAL ] GVA: Trimmed 48485 records to 32831 (keeping 200 days of data) [2025-10-08T19:18:04.017692] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-08T19:18:04.041846] [DEBUG] [LOCAL ] GVA: Primary data saved (32831 records). [2025-10-08T19:18:04.041993] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-08T19:18:04.042096] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GVA took 32.6s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-10-08T19:18:04.234584] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:04.249186] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:18:04.304471] [DEBUG] [LOCAL ] GXO: Loaded 47159 existing records from primary storage. [2025-10-08T19:18:04.304961] [INFO ] [MAIN ] GXO: Loaded 47159 existing records. [2025-10-08T19:18:04.540671] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:04.540959] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-08T19:18:04.541018] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-08T19:18:04.542247] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-08T19:18:04.542308] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-08T19:18:04.822761] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-08T19:18:05.011129] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:05.197400] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:18:05.617596] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-08T19:18:06.417520] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-08T19:18:06.530439] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T19:18:06.753254] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:18:06.755914] [INFO ] [REMOTE ] GWH: Full fetch complete (21997 records). [2025-10-08T19:18:06.756005] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-08T19:18:07.124381] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-08T19:18:07.124460] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-08T19:18:07.124942] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-08T19:18:07.125003] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-08T19:18:07.125588] [DEBUG] [LOCAL ] GWH: Trimmed 21997 records to 17046 (keeping 200 days of data) [2025-10-08T19:18:07.221057] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-08T19:18:07.224907] [DEBUG] [LOCAL ] GWH: Primary data saved (17046 records). [2025-10-08T19:18:07.226283] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-08T19:18:07.226430] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWH took 34.2s. Estimated remaining: 3h 14m 16s. Rate: 7.1 symbols/min [2025-10-08T19:18:07.401086] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:07.413536] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:18:07.419940] [DEBUG] [LOCAL ] GYLD: Loaded 1538 existing records from primary storage. [2025-10-08T19:18:07.420110] [INFO ] [MAIN ] GYLD: Loaded 1538 existing records. [2025-10-08T19:18:07.592361] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:07.592565] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-08T19:18:07.592629] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-08T19:18:07.592871] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-08T19:18:07.592929] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-08T19:18:07.950798] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:08.017513] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-08T19:18:08.312449] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-08T19:18:08.735309] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:18:08.817514] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-08T19:18:09.617597] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-08T19:18:10.417534] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-08T19:18:10.464360] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:18:10.545929] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:18:10.702077] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-08T19:18:11.217579] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-08T19:18:12.017550] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-08T19:18:12.380760] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T19:18:12.629586] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:18:12.817535] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-08T19:18:13.617560] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-08T19:18:13.896439] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:18:14.417565] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-08T19:18:14.497374] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:18:14.845807] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-08T19:18:15.217590] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-08T19:18:16.017629] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-08T19:18:16.791785] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T19:18:16.817528] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-08T19:18:16.926328] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:18:17.594904] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T19:18:17.597221] [INFO ] [REMOTE ] GWW: Full fetch complete (29145 records). [2025-10-08T19:18:17.597323] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-08T19:18:17.627675] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-08T19:18:17.993756] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-08T19:18:17.993846] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-08T19:18:17.994384] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-08T19:18:17.994424] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-08T19:18:17.995146] [DEBUG] [LOCAL ] GWW: Trimmed 29145 records to 19426 (keeping 200 days of data) [2025-10-08T19:18:18.120486] [DEBUG] [LOCAL ] GWW: Primary data saved (19426 records). [2025-10-08T19:18:18.120611] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-08T19:18:18.120737] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWW took 32.8s. Estimated remaining: 3h 14m 11s. Rate: 7.1 symbols/min [2025-10-08T19:18:18.288046] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:18.334320] [DEBUG] [LOCAL ] H: Loaded 44572 existing records from primary storage. [2025-10-08T19:18:18.334629] [INFO ] [MAIN ] H: Loaded 44572 existing records. [2025-10-08T19:18:18.423221] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-08T19:18:18.513074] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:18.513263] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-08T19:18:18.513308] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-08T19:18:18.514999] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-08T19:18:18.515060] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-08T19:18:18.864562] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:19.217616] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-08T19:18:19.392910] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T19:18:19.955452] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:18:20.017562] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-08T19:18:20.407367] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:18:20.817613] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-08T19:18:21.617519] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-08T19:18:21.866999] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:18:21.904198] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T19:18:22.092104] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T19:18:22.417554] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-08T19:18:23.217638] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-08T19:18:23.539550] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T19:18:23.943288] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:18:24.017582] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-08T19:18:24.817568] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-08T19:18:25.620349] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-08T19:18:25.628172] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:18:26.072597] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T19:18:26.102967] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T19:18:26.417570] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-08T19:18:27.217538] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-08T19:18:27.689125] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T19:18:27.900275] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:18:27.903244] [INFO ] [REMOTE ] GWRE: Full fetch complete (60580 records). [2025-10-08T19:18:27.903348] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-08T19:18:28.022811] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-08T19:18:28.280325] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-08T19:18:28.280408] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-08T19:18:28.281206] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-08T19:18:28.281268] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-08T19:18:28.282486] [DEBUG] [LOCAL ] GWRE: Trimmed 60580 records to 40142 (keeping 200 days of data) [2025-10-08T19:18:28.521538] [DEBUG] [LOCAL ] GWRE: Primary data saved (40142 records). [2025-10-08T19:18:28.521706] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-08T19:18:28.521803] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 49.6s. Estimated remaining: 3h 14m 5s. Rate: 7.1 symbols/min [2025-10-08T19:18:28.689912] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:28.725766] [DEBUG] [LOCAL ] HAE: Loaded 39434 existing records from primary storage. [2025-10-08T19:18:28.726059] [INFO ] [MAIN ] HAE: Loaded 39434 existing records. [2025-10-08T19:18:28.822814] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-08T19:18:28.905191] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:28.905398] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-08T19:18:28.905444] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-08T19:18:28.906544] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-08T19:18:28.906604] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-08T19:18:29.244289] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-08T19:18:29.268342] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:29.617541] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-08T19:18:29.712992] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:18:30.417567] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-08T19:18:31.155304] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:18:31.217492] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-08T19:18:31.934316] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:18:32.017598] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-08T19:18:32.817544] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-08T19:18:32.897147] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:18:33.185939] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:18:33.617559] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-08T19:18:34.157764] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:18:34.417571] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-08T19:18:34.882292] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T19:18:34.971138] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:18:35.217548] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-08T19:18:35.944688] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:18:35.945399] [INFO ] [REMOTE ] GYLD: Full fetch complete (2072 records). [2025-10-08T19:18:35.945468] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-08T19:18:36.022670] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-08T19:18:36.305706] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-08T19:18:36.305796] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-08T19:18:36.305897] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-08T19:18:36.305937] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-08T19:18:36.306275] [DEBUG] [LOCAL ] GYLD: Trimmed 2072 records to 1535 (keeping 200 days of data) [2025-10-08T19:18:36.316006] [DEBUG] [LOCAL ] GYLD: Primary data saved (1535 records). [2025-10-08T19:18:36.316085] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-08T19:18:36.316166] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 29.1s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-10-08T19:18:36.486023] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:36.527834] [DEBUG] [LOCAL ] HAFN: Loaded 43197 existing records from primary storage. [2025-10-08T19:18:36.528140] [INFO ] [MAIN ] HAFN: Loaded 43197 existing records. [2025-10-08T19:18:36.709512] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:36.709829] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-08T19:18:36.709889] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-08T19:18:36.711164] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-08T19:18:36.711226] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-08T19:18:36.822711] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-08T19:18:37.080836] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:37.572755] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:18:37.617556] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-08T19:18:38.371422] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:18:38.417499] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-08T19:18:39.158625] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:18:39.217531] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-08T19:18:40.017576] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-08T19:18:40.051667] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:18:40.817569] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-08T19:18:41.005383] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:18:41.617564] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-08T19:18:41.648406] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:18:41.948588] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T19:18:42.417554] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-08T19:18:43.110574] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:18:43.217544] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-08T19:18:43.817694] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:18:44.017563] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-08T19:18:44.817534] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-08T19:18:44.949134] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:18:45.548758] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T19:18:45.553316] [INFO ] [REMOTE ] GXO: Full fetch complete (69797 records). [2025-10-08T19:18:45.553694] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-08T19:18:45.622845] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-08T19:18:45.944465] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-08T19:18:45.944544] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-08T19:18:45.945429] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-08T19:18:45.945493] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-08T19:18:45.946858] [DEBUG] [LOCAL ] GXO: Trimmed 69797 records to 47078 (keeping 200 days of data) [2025-10-08T19:18:46.217490] [DEBUG] [LOCAL ] GXO: Primary data saved (47078 records). [2025-10-08T19:18:46.217630] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-08T19:18:46.217757] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GXO took 42.2s. Estimated remaining: 3h 13m 49s. Rate: 7.1 symbols/min [2025-10-08T19:18:46.392426] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:46.419966] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-08T19:18:46.444869] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:18:46.470381] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-08T19:18:46.470747] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-08T19:18:46.647092] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:46.647336] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-08T19:18:46.647382] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-08T19:18:46.648966] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-08T19:18:46.649028] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-08T19:18:46.994578] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:47.217541] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-08T19:18:47.244971] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:18:47.903360] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:18:48.017579] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-08T19:18:48.642779] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T19:18:48.817559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-08T19:18:49.066615] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:18:49.617551] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-08T19:18:50.417633] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-08T19:18:50.548270] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:18:51.217584] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-08T19:18:51.254542] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:18:51.641703] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:18:52.017559] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-08T19:18:52.572469] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:18:52.817549] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-08T19:18:53.461440] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:18:53.464905] [INFO ] [REMOTE ] H: Full fetch complete (62565 records). [2025-10-08T19:18:53.465001] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-08T19:18:53.626385] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-08T19:18:53.853709] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-08T19:18:53.853795] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-08T19:18:53.854594] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-08T19:18:53.854635] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-08T19:18:53.855956] [DEBUG] [LOCAL ] H: Trimmed 62565 records to 44514 (keeping 200 days of data) [2025-10-08T19:18:54.136704] [DEBUG] [LOCAL ] H: Primary data saved (44514 records). [2025-10-08T19:18:54.136850] [INFO ] [MAIN ] H: Full history saved. [2025-10-08T19:18:54.137928] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. H took 36.0s. Estimated remaining: 3h 13m 40s. Rate: 7.1 symbols/min [2025-10-08T19:18:54.336674] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:18:54.375334] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:18:54.424866] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-08T19:18:54.429774] [DEBUG] [LOCAL ] HASI: Loaded 47253 existing records from primary storage. [2025-10-08T19:18:54.430064] [INFO ] [MAIN ] HASI: Loaded 47253 existing records. [2025-10-08T19:18:54.607009] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:18:54.607231] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-08T19:18:54.607277] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-08T19:18:54.608693] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-08T19:18:54.608757] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-08T19:18:54.954929] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:18:55.217558] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-08T19:18:55.529167] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T19:18:56.022677] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-08T19:18:56.039272] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:18:56.439264] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:18:56.817597] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-08T19:18:57.617569] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-08T19:18:58.098758] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T19:18:58.249869] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T19:18:58.417560] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-08T19:18:58.892816] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:18:59.217521] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-08T19:18:59.981528] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:19:00.017507] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-08T19:19:00.804455] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:19:00.817491] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-08T19:19:01.617614] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-08T19:19:02.132838] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T19:19:02.198990] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:19:02.417559] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-08T19:19:03.034606] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:19:03.217621] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-08T19:19:04.017541] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-08T19:19:04.616663] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T19:19:04.817693] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-08T19:19:04.829874] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:19:05.617522] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-08T19:19:05.723506] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:19:06.417560] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-08T19:19:06.575982] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:19:06.684397] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:19:07.217577] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-08T19:19:07.713994] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:19:07.717282] [INFO ] [REMOTE ] HAFN: Full fetch complete (65245 records). [2025-10-08T19:19:07.717401] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-08T19:19:08.020311] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-08T19:19:08.114916] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-08T19:19:08.115000] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-08T19:19:08.115900] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-08T19:19:08.115966] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-08T19:19:08.117255] [DEBUG] [LOCAL ] HAFN: Trimmed 65245 records to 43141 (keeping 200 days of data) [2025-10-08T19:19:08.377133] [DEBUG] [LOCAL ] HAFN: Primary data saved (43141 records). [2025-10-08T19:19:08.377540] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-08T19:19:08.377667] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAFN took 32.1s. Estimated remaining: 3h 13m 40s. Rate: 7.1 symbols/min [2025-10-08T19:19:08.544775] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:08.588938] [DEBUG] [LOCAL ] HAYW: Loaded 48748 existing records from primary storage. [2025-10-08T19:19:08.589249] [INFO ] [MAIN ] HAYW: Loaded 48748 existing records. [2025-10-08T19:19:08.772779] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:08.773103] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-08T19:19:08.773173] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-08T19:19:08.774893] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-08T19:19:08.774980] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-08T19:19:08.826923] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-08T19:19:09.240826] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:09.287971] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T19:19:09.617572] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-08T19:19:09.796266] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T19:19:10.120059] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:19:10.124228] [INFO ] [REMOTE ] HAE: Full fetch complete (58547 records). [2025-10-08T19:19:10.124347] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-08T19:19:10.422777] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-08T19:19:10.500934] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-08T19:19:10.501144] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-08T19:19:10.501993] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-08T19:19:10.502056] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-08T19:19:10.503369] [DEBUG] [LOCAL ] HAE: Trimmed 58547 records to 39439 (keeping 200 days of data) [2025-10-08T19:19:10.744921] [DEBUG] [LOCAL ] HAE: Primary data saved (39439 records). [2025-10-08T19:19:10.745108] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-08T19:19:10.745212] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 42.2s. Estimated remaining: 3h 13m 23s. Rate: 7.1 symbols/min [2025-10-08T19:19:10.918750] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:10.927402] [DEBUG] [LOCAL ] HBB: Loaded 6499 existing records from primary storage. [2025-10-08T19:19:10.927686] [INFO ] [MAIN ] HBB: Loaded 6499 existing records. [2025-10-08T19:19:11.139957] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:11.140427] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-08T19:19:11.140550] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-08T19:19:11.140957] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-08T19:19:11.141019] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-08T19:19:11.217544] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-08T19:19:11.515713] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:11.547630] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T19:19:11.913985] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:19:12.017553] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-08T19:19:12.465185] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:19:12.555097] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T19:19:12.817588] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-08T19:19:13.617592] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-08T19:19:14.417596] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-08T19:19:14.879026] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T19:19:15.169588] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:19:15.217589] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-08T19:19:15.826087] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:19:16.017588] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-08T19:19:16.817530] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-08T19:19:17.038292] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T19:19:17.043322] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-08T19:19:17.043522] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-08T19:19:17.501020] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-08T19:19:17.501148] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-08T19:19:17.502229] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-08T19:19:17.502417] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-08T19:19:17.504264] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 53718 (keeping 200 days of data) [2025-10-08T19:19:17.621961] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-08T19:19:17.636983] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:19:17.888519] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-08T19:19:17.888845] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-08T19:19:17.888979] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAL took 31.7s. Estimated remaining: 3h 13m 13s. Rate: 7.1 symbols/min [2025-10-08T19:19:18.068726] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:18.101712] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:19:18.118679] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T19:19:18.160283] [DEBUG] [LOCAL ] HBI: Loaded 52991 existing records from primary storage. [2025-10-08T19:19:18.160710] [INFO ] [MAIN ] HBI: Loaded 52991 existing records. [2025-10-08T19:19:18.340208] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:18.340460] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-08T19:19:18.340508] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-08T19:19:18.341844] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-08T19:19:18.341905] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-08T19:19:18.422746] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-08T19:19:18.699513] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:19.071178] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:19:19.217572] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-08T19:19:19.953293] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:19:20.017580] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-08T19:19:20.817634] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-08T19:19:21.392497] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:19:21.617526] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-08T19:19:22.419328] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-08T19:19:22.422880] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T19:19:22.521532] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:19:23.217605] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-08T19:19:24.017551] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-08T19:19:24.063312] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:19:24.610226] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T19:19:24.768904] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:19:24.817563] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-08T19:19:25.617591] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-08T19:19:26.417522] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-08T19:19:26.485954] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T19:19:26.489715] [INFO ] [REMOTE ] HASI: Full fetch complete (68049 records). [2025-10-08T19:19:26.489856] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-08T19:19:26.896733] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-08T19:19:26.896934] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-08T19:19:26.897986] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-08T19:19:26.898065] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-08T19:19:26.900279] [DEBUG] [LOCAL ] HASI: Trimmed 68049 records to 47306 (keeping 200 days of data) [2025-10-08T19:19:27.042862] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:19:27.048369] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:19:27.223238] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-08T19:19:27.248989] [DEBUG] [LOCAL ] HASI: Primary data saved (47306 records). [2025-10-08T19:19:27.249136] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-08T19:19:27.249237] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HASI took 33.1s. Estimated remaining: 3h 13m 6s. Rate: 7.1 symbols/min [2025-10-08T19:19:27.416797] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:27.467322] [DEBUG] [LOCAL ] HBM: Loaded 52924 existing records from primary storage. [2025-10-08T19:19:27.467722] [INFO ] [MAIN ] HBM: Loaded 52924 existing records. [2025-10-08T19:19:27.659721] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:27.659975] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-08T19:19:27.660022] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-08T19:19:27.661427] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-08T19:19:27.661490] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-08T19:19:27.949499] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T19:19:28.022935] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-08T19:19:28.022870] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:28.817607] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-08T19:19:29.571668] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:19:29.617534] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-08T19:19:30.417521] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-08T19:19:30.543804] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:19:31.023182] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T19:19:31.217511] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-08T19:19:31.277239] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T19:19:32.017552] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-08T19:19:32.817514] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-08T19:19:32.996124] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T19:19:33.617545] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-08T19:19:33.681398] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T19:19:34.417561] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-08T19:19:35.225433] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-08T19:19:35.249619] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:19:35.489445] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-08T19:19:35.808214] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T19:19:36.017561] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-08T19:19:36.396446] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T19:19:36.605850] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T19:19:36.606761] [INFO ] [REMOTE ] HBB: Full fetch complete (9444 records). [2025-10-08T19:19:36.606833] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-08T19:19:36.823617] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-08T19:19:36.988605] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-08T19:19:36.988715] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-08T19:19:36.988976] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-08T19:19:36.989016] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-08T19:19:36.989435] [DEBUG] [LOCAL ] HBB: Trimmed 9444 records to 6485 (keeping 200 days of data) [2025-10-08T19:19:37.031011] [DEBUG] [LOCAL ] HBB: Primary data saved (6485 records). [2025-10-08T19:19:37.031155] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-08T19:19:37.031245] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 26.3s. Estimated remaining: 3h 12m 59s. Rate: 7.1 symbols/min [2025-10-08T19:19:37.199247] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:37.245374] [DEBUG] [LOCAL ] HCA: Loaded 46862 existing records from primary storage. [2025-10-08T19:19:37.245730] [INFO ] [MAIN ] HCA: Loaded 46862 existing records. [2025-10-08T19:19:37.435047] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:37.435355] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-08T19:19:37.435421] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-08T19:19:37.435695] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-08T19:19:37.435752] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-08T19:19:37.624110] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-08T19:19:37.807163] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:38.391995] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T19:19:38.417507] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-08T19:19:39.217546] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-08T19:19:39.278855] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T19:19:39.282508] [INFO ] [REMOTE ] HAYW: Full fetch complete (70783 records). [2025-10-08T19:19:39.282625] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-08T19:19:39.687003] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-08T19:19:39.687189] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-08T19:19:39.688549] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-08T19:19:39.688708] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-08T19:19:39.691235] [DEBUG] [LOCAL ] HAYW: Trimmed 70783 records to 48747 (keeping 200 days of data) [2025-10-08T19:19:39.991527] [DEBUG] [LOCAL ] HAYW: Primary data saved (48747 records). [2025-10-08T19:19:39.991709] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-08T19:19:39.991851] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HAYW took 31.6s. Estimated remaining: 3h 12m 43s. Rate: 7.1 symbols/min [2025-10-08T19:19:40.029928] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-08T19:19:40.186805] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:19:40.213374] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T19:19:40.264639] [DEBUG] [LOCAL ] HCC: Loaded 45348 existing records from primary storage. [2025-10-08T19:19:40.265014] [INFO ] [MAIN ] HCC: Loaded 45348 existing records. [2025-10-08T19:19:40.439426] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:19:40.439728] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-08T19:19:40.439787] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-08T19:19:40.440510] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-08T19:19:40.440568] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-08T19:19:40.829101] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-08T19:19:40.835517] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:19:40.908168] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:19:41.617564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-08T19:19:41.743372] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:19:42.417580] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-08T19:19:42.622535] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:19:43.076156] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:19:43.217584] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-08T19:19:43.890729] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T19:19:44.017581] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-08T19:19:44.464790] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:19:44.817577] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-08T19:19:45.404591] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T19:19:45.617525] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-08T19:19:46.407070] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:19:46.417484] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-08T19:19:47.121180] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:19:47.217530] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-08T19:19:47.600871] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:19:48.017564] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-08T19:19:48.817525] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-08T19:19:49.039158] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T19:19:49.394255] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:19:49.617548] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-08T19:19:50.132694] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:19:50.417609] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-08T19:19:51.217531] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-08T19:19:51.472471] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:19:52.017719] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-08T19:19:52.100151] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:19:52.712898] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:19:52.817548] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-08T19:19:53.617573] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-08T19:19:53.730781] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:19:54.268247] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:19:54.417607] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-08T19:19:55.217575] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-08T19:19:55.260228] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:19:56.017519] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-08T19:19:56.137405] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:19:56.817544] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-08T19:19:56.897014] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:19:57.400476] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T19:19:57.617562] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-08T19:19:58.329774] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T19:19:58.417551] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-08T19:19:59.217591] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-08T19:19:59.285625] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:20:00.017538] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-08T19:20:00.273609] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:20:00.819700] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-08T19:20:00.825805] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:20:01.617574] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-08T19:20:02.163334] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T19:20:02.417521] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-08T19:20:02.450243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T19:20:03.222687] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-08T19:20:03.242400] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:20:04.017520] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-08T19:20:04.243373] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:20:04.569888] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T19:20:04.573864] [INFO ] [REMOTE ] HCC: Full fetch complete (64622 records). [2025-10-08T19:20:04.573981] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-08T19:20:04.827137] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-08T19:20:04.969136] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-08T19:20:04.969223] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-08T19:20:04.970081] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-08T19:20:04.970145] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-08T19:20:04.971485] [DEBUG] [LOCAL ] HCC: Trimmed 64622 records to 45290 (keeping 200 days of data) [2025-10-08T19:20:05.250980] [DEBUG] [LOCAL ] HCC: Primary data saved (45290 records). [2025-10-08T19:20:05.251136] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-08T19:20:05.251236] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HCC took 25.3s. Estimated remaining: 3h 12m 58s. Rate: 7.1 symbols/min [2025-10-08T19:20:05.617516] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-08T19:20:05.766894] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:20:06.417573] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-08T19:20:06.816588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T19:20:06.986537] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:20:07.217612] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-08T19:20:07.676602] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:20:08.017587] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-08T19:20:08.822735] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-08T19:20:08.837116] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:20:08.844249] [INFO ] [REMOTE ] HBI: Full fetch complete (76878 records). [2025-10-08T19:20:08.844526] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-08T19:20:09.467258] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:20:09.471150] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-08T19:20:09.474230] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-08T19:20:09.475755] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-08T19:20:09.475837] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-08T19:20:09.476734] [INFO ] [REMOTE ] HCA: Full fetch complete (68729 records). [2025-10-08T19:20:09.476927] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-08T19:20:09.483062] [DEBUG] [LOCAL ] HBI: Trimmed 76878 records to 52987 (keeping 200 days of data) [2025-10-08T19:20:09.988315] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-08T19:20:09.991389] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-08T19:20:09.993570] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-08T19:20:09.995865] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-08T19:20:10.011486] [DEBUG] [LOCAL ] HCA: Trimmed 68729 records to 46889 (keeping 200 days of data) [2025-10-08T19:20:10.305675] [DEBUG] [LOCAL ] HBI: Primary data saved (52987 records). [2025-10-08T19:20:10.306769] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-08T19:20:10.307357] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 52.4s. Estimated remaining: 3h 12m 45s. Rate: 7.1 symbols/min [2025-10-08T19:20:10.505937] [DEBUG] [LOCAL ] HCA: Primary data saved (46889 records). [2025-10-08T19:20:10.506273] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-08T19:20:10.506429] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCA took 33.5s. Estimated remaining: 3h 12m 26s. Rate: 7.1 symbols/min [2025-10-08T19:20:10.669342] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T19:20:10.674081] [INFO ] [REMOTE ] HBM: Full fetch complete (76335 records). [2025-10-08T19:20:10.674262] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-08T19:20:11.077028] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-08T19:20:11.077112] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-08T19:20:11.078078] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-08T19:20:11.078143] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-08T19:20:11.079671] [DEBUG] [LOCAL ] HBM: Trimmed 76335 records to 52928 (keeping 200 days of data) [2025-10-08T19:20:11.398704] [DEBUG] [LOCAL ] HBM: Primary data saved (52928 records). [2025-10-08T19:20:11.398863] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-08T19:20:11.398951] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 44.1s. Estimated remaining: 3h 12m 7s. Rate: 7.1 symbols/min [2025-10-08T19:20:12.044000] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.069089] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.112833] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-08T19:20:12.112979] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-08T19:20:12.113938] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.147166] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:12.147328] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-08T19:20:12.148023] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-08T19:20:12.148092] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-08T19:20:12.148128] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-08T19:20:12.289669] [DEBUG] [LOCAL ] HCI: Loaded 14035 existing records from primary storage. [2025-10-08T19:20:12.312485] [INFO ] [MAIN ] HCI: Loaded 14035 existing records. [2025-10-08T19:20:12.704037] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-08T19:20:12.738283] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-08T19:20:12.761588] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:12.733550] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-10-08T19:20:12.765211] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:12.770988] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-08T19:20:12.789708] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-08T19:20:12.790974] [INFO ] [MAIN ] HDB: Loaded 51936 existing records. [2025-10-08T19:20:12.790882] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-08T19:20:12.913323] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-08T19:20:12.936595] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-08T19:20:13.207834] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:13.269096] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T19:20:13.258310] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:13.273586] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-08T19:20:13.274844] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-08T19:20:13.273895] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-08T19:20:13.275172] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-08T19:20:13.290875] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-08T19:20:13.314407] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-08T19:20:13.387110] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-08T19:20:13.410544] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-08T19:20:13.410491] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-08T19:20:13.656829] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T19:20:13.763606] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-08T19:20:13.767034] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:13.834435] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-08T19:20:14.101390] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:20:14.122235] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-08T19:20:14.240253] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:14.263579] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-08T19:20:14.292866] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:14.417525] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-08T19:20:14.545494] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T19:20:14.995128] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:20:15.217604] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-08T19:20:15.637447] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T19:20:15.866823] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:20:16.017552] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-08T19:20:16.461148] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-08T19:20:16.813584] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T19:20:16.817488] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-08T19:20:17.617535] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-08T19:20:17.852336] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-08T19:20:18.417528] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-08T19:20:18.863187] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T19:20:19.217574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-08T19:20:19.309536] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T19:20:19.460107] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:20:20.017693] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-08T19:20:20.286629] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-08T19:20:20.817544] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-08T19:20:21.069263] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-08T19:20:21.617565] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-08T19:20:21.859856] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-08T19:20:22.417548] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-08T19:20:23.217601] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-08T19:20:23.965568] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:20:24.017575] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-08T19:20:24.817550] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-08T19:20:25.256853] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:20:25.260937] [INFO ] [REMOTE ] HCXY: Full fetch complete (536 records). [2025-10-08T19:20:25.261155] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-08T19:20:25.269096] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:20:25.484142] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-08T19:20:25.487407] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:20:25.487734] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:20:25.488242] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-08T19:20:25.489606] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-08T19:20:25.489856] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-08T19:20:25.500189] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-08T19:20:25.500606] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-08T19:20:25.500738] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 14.1s. Estimated remaining: 3h 12m 6s. Rate: 7.1 symbols/min [2025-10-08T19:20:25.622741] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-08T19:20:25.667552] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:25.714951] [DEBUG] [LOCAL ] HE: Loaded 48998 existing records from primary storage. [2025-10-08T19:20:25.715269] [INFO ] [MAIN ] HE: Loaded 48998 existing records. [2025-10-08T19:20:25.890126] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:25.890373] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-08T19:20:25.890420] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-08T19:20:25.890626] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-08T19:20:25.890718] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-08T19:20:26.242793] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:26.374521] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:20:26.417536] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-08T19:20:27.217551] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-08T19:20:28.017525] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-08T19:20:28.300864] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:20:28.494856] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T19:20:28.817553] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-08T19:20:29.617568] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-08T19:20:29.659307] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T19:20:29.679029] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T19:20:30.417565] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-08T19:20:31.217568] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-08T19:20:31.495032] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:20:32.017543] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-08T19:20:32.328436] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T19:20:32.817568] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-08T19:20:33.029600] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T19:20:33.512994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:20:33.617521] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-08T19:20:34.417523] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-08T19:20:34.590067] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:20:35.066406] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T19:20:35.217546] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-08T19:20:35.538012] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T19:20:36.017518] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-08T19:20:36.177829] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:20:36.817599] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-08T19:20:37.466020] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:20:37.617519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-08T19:20:37.810871] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T19:20:38.417602] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-08T19:20:39.217527] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-08T19:20:39.548938] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:20:39.826279] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:20:39.913169] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:20:40.017559] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-08T19:20:40.817632] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-08T19:20:41.617541] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-08T19:20:42.306928] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T19:20:42.396865] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:20:42.417519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-08T19:20:43.000778] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:20:43.217537] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-08T19:20:44.017612] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-08T19:20:44.315333] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T19:20:44.460058] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:20:44.817519] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-08T19:20:44.880011] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:20:44.881865] [INFO ] [REMOTE ] HCI: Full fetch complete (19519 records). [2025-10-08T19:20:44.881941] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-08T19:20:45.284974] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-08T19:20:45.285073] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-08T19:20:45.285502] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-08T19:20:45.285542] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-08T19:20:45.286109] [DEBUG] [LOCAL ] HCI: Trimmed 19519 records to 14077 (keeping 200 days of data) [2025-10-08T19:20:45.374303] [DEBUG] [LOCAL ] HCI: Primary data saved (14077 records). [2025-10-08T19:20:45.374442] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-08T19:20:45.374524] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 34.0s. Estimated remaining: 3h 12m 13s. Rate: 7.1 symbols/min [2025-10-08T19:20:45.553512] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:45.587084] [DEBUG] [LOCAL ] HEI: Loaded 31750 existing records from primary storage. [2025-10-08T19:20:45.587373] [INFO ] [MAIN ] HEI: Loaded 31750 existing records. [2025-10-08T19:20:45.622707] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-08T19:20:45.776119] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:45.776381] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-08T19:20:45.776430] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-08T19:20:45.776687] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-08T19:20:45.776749] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-08T19:20:46.155036] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:46.417521] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-08T19:20:46.914192] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-08T19:20:46.970286] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:20:47.217607] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-08T19:20:47.980661] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:20:48.017540] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-08T19:20:48.549805] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T19:20:48.817638] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-08T19:20:49.364562] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:20:49.617566] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-08T19:20:50.417514] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-08T19:20:50.759809] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:20:50.764146] [INFO ] [REMOTE ] HD: Full fetch complete (77447 records). [2025-10-08T19:20:50.764282] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-08T19:20:51.162549] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-08T19:20:51.162772] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-08T19:20:51.163721] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-08T19:20:51.163849] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-08T19:20:51.165528] [DEBUG] [LOCAL ] HD: Trimmed 77447 records to 53492 (keeping 200 days of data) [2025-10-08T19:20:51.275138] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-08T19:20:51.318116] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T19:20:51.574615] [DEBUG] [LOCAL ] HD: Primary data saved (53492 records). [2025-10-08T19:20:51.574783] [INFO ] [MAIN ] HD: Full history saved. [2025-10-08T19:20:51.574872] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HD took 40.2s. Estimated remaining: 3h 12m 2s. Rate: 7.1 symbols/min [2025-10-08T19:20:51.751823] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:51.761405] [DEBUG] [LOCAL ] HEQ: Loaded 6524 existing records from primary storage. [2025-10-08T19:20:51.761694] [INFO ] [MAIN ] HEQ: Loaded 6524 existing records. [2025-10-08T19:20:51.992165] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:51.992455] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-08T19:20:51.992854] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-08T19:20:51.995455] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-08T19:20:51.995377] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:20:51.995571] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-08T19:20:52.029312] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-08T19:20:52.406863] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:52.625505] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:20:52.817526] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-08T19:20:53.612198] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:20:53.621882] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-08T19:20:54.237264] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T19:20:54.303461] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:20:54.417555] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-08T19:20:55.217543] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-08T19:20:55.859893] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:20:56.017533] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-08T19:20:56.729305] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:20:56.817548] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-08T19:20:57.617567] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-08T19:20:57.745698] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:20:57.749698] [INFO ] [REMOTE ] HDB: Full fetch complete (75320 records). [2025-10-08T19:20:57.749815] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-08T19:20:58.135041] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-08T19:20:58.135125] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-08T19:20:58.136122] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-08T19:20:58.136185] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-08T19:20:58.137683] [DEBUG] [LOCAL ] HDB: Trimmed 75320 records to 51940 (keeping 200 days of data) [2025-10-08T19:20:58.384244] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:20:58.417523] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-08T19:20:58.498969] [DEBUG] [LOCAL ] HDB: Primary data saved (51940 records). [2025-10-08T19:20:58.499112] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-08T19:20:58.500163] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 47.0s. Estimated remaining: 3h 11m 51s. Rate: 7.1 symbols/min [2025-10-08T19:20:58.670297] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:20:58.715989] [DEBUG] [LOCAL ] HESM: Loaded 48284 existing records from primary storage. [2025-10-08T19:20:58.716303] [INFO ] [MAIN ] HESM: Loaded 48284 existing records. [2025-10-08T19:20:58.901158] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:20:58.901537] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-08T19:20:58.901639] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-08T19:20:58.902106] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-08T19:20:58.902178] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-08T19:20:59.187404] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:20:59.230136] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-08T19:20:59.315240] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:20:59.310886] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:21:00.017565] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-08T19:21:00.817600] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-08T19:21:01.273780] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T19:21:01.284392] [INFO ] [REMOTE ] HE: Full fetch complete (72241 records). [2025-10-08T19:21:01.284764] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-08T19:21:01.623467] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-08T19:21:01.913441] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T19:21:01.918334] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-08T19:21:01.918763] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-08T19:21:01.927366] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-08T19:21:01.927934] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-08T19:21:01.930725] [DEBUG] [LOCAL ] HE: Trimmed 72241 records to 48999 (keeping 200 days of data) [2025-10-08T19:21:02.074977] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:21:02.188304] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:21:02.282562] [DEBUG] [LOCAL ] HE: Primary data saved (48999 records). [2025-10-08T19:21:02.282773] [INFO ] [MAIN ] HE: Full history saved. [2025-10-08T19:21:02.282873] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HE took 36.8s. Estimated remaining: 3h 11m 37s. Rate: 7.1 symbols/min [2025-10-08T19:21:02.422727] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-08T19:21:02.471438] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:02.471733] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-08T19:21:02.471790] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-08T19:21:02.471947] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-08T19:21:02.471992] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-08T19:21:02.472033] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-08T19:21:02.472065] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-08T19:21:02.888976] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:03.105209] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T19:21:03.217600] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-08T19:21:03.576164] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:21:04.017562] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-08T19:21:04.346929] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T19:21:04.817584] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-08T19:21:05.617585] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-08T19:21:05.881400] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-08T19:21:06.189141] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:21:06.417590] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-08T19:21:07.217575] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-08T19:21:07.859833] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:21:08.017627] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-08T19:21:08.268103] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-08T19:21:08.761701] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T19:21:08.817579] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-08T19:21:09.617568] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-08T19:21:09.913047] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:21:10.348933] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T19:21:10.417527] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-08T19:21:11.212348] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T19:21:11.217481] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-08T19:21:11.893512] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:21:12.017538] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-08T19:21:12.817612] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-08T19:21:13.522603] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:21:13.574895] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:21:13.617580] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-08T19:21:13.876120] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-08T19:21:14.417616] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-08T19:21:14.695840] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-08T19:21:15.217613] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-08T19:21:16.017575] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-08T19:21:16.799702] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:21:16.817496] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-08T19:21:17.235291] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:21:17.237937] [INFO ] [REMOTE ] HEI: Full fetch complete (48169 records). [2025-10-08T19:21:17.238057] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-08T19:21:17.623169] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-08T19:21:17.625970] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-08T19:21:17.626970] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-08T19:21:17.627733] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-08T19:21:17.627796] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-08T19:21:17.629058] [DEBUG] [LOCAL ] HEI: Trimmed 48169 records to 31659 (keeping 200 days of data) [2025-10-08T19:21:17.831197] [DEBUG] [LOCAL ] HEI: Primary data saved (31659 records). [2025-10-08T19:21:17.831357] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-08T19:21:17.831444] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 32.5s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-08T19:21:17.941163] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-08T19:21:18.017529] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:18.017844] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-08T19:21:18.017939] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-08T19:21:18.018083] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-08T19:21:18.018127] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-08T19:21:18.018170] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-08T19:21:18.018201] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-08T19:21:18.410528] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:18.423024] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-08T19:21:18.442388] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T19:21:18.670278] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-08T19:21:19.217550] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-08T19:21:19.450002] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-08T19:21:20.017590] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-08T19:21:20.671949] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T19:21:20.817568] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-08T19:21:21.060295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-08T19:21:21.617539] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-08T19:21:21.981594] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T19:21:21.982292] [INFO ] [REMOTE ] HF: Full fetch complete (446 records). [2025-10-08T19:21:21.982401] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-08T19:21:22.174355] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-08T19:21:22.174559] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:21:22.174629] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:21:22.174717] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-08T19:21:22.174783] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-08T19:21:22.174820] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-08T19:21:22.174887] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-08T19:21:22.174969] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HF took 19.9s. Estimated remaining: 3h 11m 24s. Rate: 7.1 symbols/min [2025-10-08T19:21:22.354354] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:22.375470] [DEBUG] [LOCAL ] HFRO: Loaded 17508 existing records from primary storage. [2025-10-08T19:21:22.375774] [INFO ] [MAIN ] HFRO: Loaded 17508 existing records. [2025-10-08T19:21:22.422783] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-08T19:21:22.593569] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:22.594087] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-08T19:21:22.594151] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-08T19:21:22.594491] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-08T19:21:22.594580] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-08T19:21:22.986497] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:22.991389] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T19:21:23.217590] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-08T19:21:23.558145] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:21:24.017591] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-08T19:21:24.817573] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-08T19:21:25.324235] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:21:25.617542] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-08T19:21:26.375675] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:21:26.424231] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-08T19:21:26.429797] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T19:21:26.754611] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:21:27.217547] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-08T19:21:28.017563] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-08T19:21:28.684692] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:21:28.686021] [INFO ] [REMOTE ] HEQ: Full fetch complete (9437 records). [2025-10-08T19:21:28.686095] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-08T19:21:28.819490] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-08T19:21:29.125603] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-08T19:21:29.134269] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-08T19:21:29.137491] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-08T19:21:29.137809] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-08T19:21:29.139736] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:21:29.149802] [DEBUG] [LOCAL ] HEQ: Trimmed 9437 records to 6596 (keeping 200 days of data) [2025-10-08T19:21:29.195751] [DEBUG] [LOCAL ] HEQ: Primary data saved (6596 records). [2025-10-08T19:21:29.195921] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-08T19:21:29.196116] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEQ took 37.6s. Estimated remaining: 3h 11m 14s. Rate: 7.1 symbols/min [2025-10-08T19:21:29.369376] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:29.385864] [DEBUG] [LOCAL ] HGER: Loaded 14155 existing records from primary storage. [2025-10-08T19:21:29.386118] [INFO ] [MAIN ] HGER: Loaded 14155 existing records. [2025-10-08T19:21:29.561109] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:29.561312] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-08T19:21:29.561357] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-08T19:21:29.561561] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-08T19:21:29.561619] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-08T19:21:29.624583] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-08T19:21:29.938269] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:29.953705] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:21:30.097772] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T19:21:30.417559] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-08T19:21:31.217564] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-08T19:21:31.649595] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T19:21:32.017569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-08T19:21:32.329684] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:21:32.730059] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T19:21:32.817559] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-08T19:21:33.617513] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-08T19:21:33.933154] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T19:21:33.955319] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T19:21:34.417559] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-08T19:21:35.217532] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-08T19:21:35.406436] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T19:21:36.017573] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-08T19:21:36.706508] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:21:36.817577] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-08T19:21:36.887986] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:21:37.055926] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:21:37.617549] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-08T19:21:37.725937] [DEBUG] [REMOTE ] HGER: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T19:21:37.726324] [WARN ] [REMOTE ] HGER: No data returned for month 2025-01 [2025-10-08T19:21:37.726415] [FATAL] [REMOTE ] HGER: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:21:37.726568] [FATAL] [MAIN ] HGER: Failed to fetch primary data. [2025-10-08T19:21:37.726688] [WARN ] [MAIN ] HGER: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:21:37.726784] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-08T19:21:37.726858] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-08T19:21:37.726918] [INFO ] [LOCAL ] HGER: Starting deletion of derivative data. [2025-10-08T19:21:37.727269] [DEBUG] [LOCAL ] HGER: Deleted derivative data file. [2025-10-08T19:21:37.727374] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HGER took 8.5s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-08T19:21:37.956437] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:37.969507] [DEBUG] [LOCAL ] HGLB: Loaded 9696 existing records from primary storage. [2025-10-08T19:21:37.969791] [INFO ] [MAIN ] HGLB: Loaded 9696 existing records. [2025-10-08T19:21:38.192143] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:38.192441] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-08T19:21:38.192499] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-08T19:21:38.192676] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-08T19:21:38.192747] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-08T19:21:38.422700] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-08T19:21:38.560151] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:38.836286] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:21:39.217555] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-08T19:21:40.017579] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-08T19:21:40.713030] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:21:40.817525] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-08T19:21:40.829257] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T19:21:41.617548] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-08T19:21:42.386518] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:21:42.417537] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-08T19:21:42.525876] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T19:21:42.529929] [INFO ] [REMOTE ] HESM: Full fetch complete (69412 records). [2025-10-08T19:21:42.530108] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-08T19:21:42.943992] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T19:21:42.944381] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-08T19:21:42.947501] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-08T19:21:42.948569] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-08T19:21:42.948636] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-08T19:21:42.950815] [DEBUG] [LOCAL ] HESM: Trimmed 69412 records to 48300 (keeping 200 days of data) [2025-10-08T19:21:43.217732] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-08T19:21:43.287354] [DEBUG] [LOCAL ] HESM: Primary data saved (48300 records). [2025-10-08T19:21:43.287504] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-08T19:21:43.287605] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HESM took 44.8s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-08T19:21:43.500130] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:21:43.517785] [DEBUG] [LOCAL ] HGTY: Loaded 13274 existing records from primary storage. [2025-10-08T19:21:43.518066] [INFO ] [MAIN ] HGTY: Loaded 13274 existing records. [2025-10-08T19:21:43.668333] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T19:21:43.752139] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:21:43.752411] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-08T19:21:43.752508] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-08T19:21:43.752756] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-08T19:21:43.752816] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-08T19:21:44.025759] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-08T19:21:44.156690] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:21:44.817534] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-08T19:21:44.829880] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:21:45.456716] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T19:21:45.617569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-08T19:21:46.417592] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-08T19:21:46.545867] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:21:47.217584] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-08T19:21:47.231684] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:21:48.005496] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:21:48.017504] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-08T19:21:48.817546] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-08T19:21:48.882723] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T19:21:49.617582] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-08T19:21:49.789182] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T19:21:50.149378] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T19:21:50.417599] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-08T19:21:51.075270] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T19:21:51.217569] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-08T19:21:52.017570] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-08T19:21:52.286631] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:21:52.746313] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:21:52.817542] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-08T19:21:53.390996] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:21:53.617557] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-08T19:21:54.417544] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-08T19:21:54.429062] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:21:55.012444] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T19:21:55.217567] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-08T19:21:55.732753] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T19:21:56.017596] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-08T19:21:56.796689] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:21:56.817506] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-08T19:21:57.565215] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:21:57.617528] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-08T19:21:58.193754] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T19:21:58.417593] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-08T19:21:59.217575] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-08T19:21:59.489235] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:21:59.912059] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T19:22:00.017573] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-08T19:22:00.817562] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-08T19:22:00.917066] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:22:01.617550] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-08T19:22:01.941570] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T19:22:01.943751] [INFO ] [REMOTE ] HFRO: Full fetch complete (28642 records). [2025-10-08T19:22:01.943900] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-08T19:22:02.085691] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T19:22:02.337971] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-08T19:22:02.338061] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-08T19:22:02.338627] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-08T19:22:02.338712] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-08T19:22:02.340090] [DEBUG] [LOCAL ] HFRO: Trimmed 28642 records to 17481 (keeping 200 days of data) [2025-10-08T19:22:02.417967] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-08T19:22:02.450493] [DEBUG] [LOCAL ] HFRO: Primary data saved (17481 records). [2025-10-08T19:22:02.450677] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-08T19:22:02.450790] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 40.3s. Estimated remaining: 3h 10m 59s. Rate: 7.1 symbols/min [2025-10-08T19:22:02.624478] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:02.670948] [DEBUG] [LOCAL ] HGV: Loaded 46457 existing records from primary storage. [2025-10-08T19:22:02.671286] [INFO ] [MAIN ] HGV: Loaded 46457 existing records. [2025-10-08T19:22:02.849543] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:02.849824] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-08T19:22:02.849894] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-08T19:22:02.850153] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-08T19:22:02.850209] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-08T19:22:03.196100] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:03.217500] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-08T19:22:03.449992] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T19:22:04.017571] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-08T19:22:04.422571] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T19:22:04.817576] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-08T19:22:05.039167] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:22:05.040755] [INFO ] [REMOTE ] HGTY: Full fetch complete (17316 records). [2025-10-08T19:22:05.040855] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-08T19:22:05.408298] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-08T19:22:05.408384] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-08T19:22:05.408827] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-08T19:22:05.408890] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-08T19:22:05.409544] [DEBUG] [LOCAL ] HGTY: Trimmed 17316 records to 13249 (keeping 200 days of data) [2025-10-08T19:22:05.486565] [DEBUG] [LOCAL ] HGTY: Primary data saved (13249 records). [2025-10-08T19:22:05.486755] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-08T19:22:05.486857] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 22.2s. Estimated remaining: 3h 10m 44s. Rate: 7.1 symbols/min [2025-10-08T19:22:05.626045] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-08T19:22:05.659235] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:05.693701] [DEBUG] [LOCAL ] HHH: Loaded 32912 existing records from primary storage. [2025-10-08T19:22:05.694029] [INFO ] [MAIN ] HHH: Loaded 32912 existing records. [2025-10-08T19:22:05.877330] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:05.877599] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-08T19:22:05.877674] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-08T19:22:05.877948] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-08T19:22:05.878005] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-08T19:22:06.231306] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:22:06.256673] [INFO ] [REMOTE ] HFND: Full fetch complete (1781 records). [2025-10-08T19:22:06.262946] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-08T19:22:06.262687] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:06.425256] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-08T19:22:06.511269] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-08T19:22:06.513627] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:22:06.513995] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:22:06.523304] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:22:06.523384] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-08T19:22:06.523452] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-08T19:22:06.523489] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-08T19:22:06.523529] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-08T19:22:06.523594] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HFND took 48.7s. Estimated remaining: 3h 10m 25s. Rate: 7.1 symbols/min [2025-10-08T19:22:06.692787] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:06.728310] [DEBUG] [LOCAL ] HI: Loaded 35337 existing records from primary storage. [2025-10-08T19:22:06.728674] [INFO ] [MAIN ] HI: Loaded 35337 existing records. [2025-10-08T19:22:06.908341] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:06.908595] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-08T19:22:06.908874] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-08T19:22:06.909184] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-08T19:22:06.909244] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-08T19:22:07.222693] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-08T19:22:07.281305] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:07.334711] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T19:22:07.336276] [INFO ] [REMOTE ] HGLB: Full fetch complete (14876 records). [2025-10-08T19:22:07.336348] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-08T19:22:07.705103] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-08T19:22:07.705192] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-08T19:22:07.705556] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-08T19:22:07.705598] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-08T19:22:07.706367] [DEBUG] [LOCAL ] HGLB: Trimmed 14876 records to 9688 (keeping 200 days of data) [2025-10-08T19:22:07.768414] [DEBUG] [LOCAL ] HGLB: Primary data saved (9688 records). [2025-10-08T19:22:07.768601] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-08T19:22:07.768755] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGLB took 30.0s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-08T19:22:07.948205] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:08.009111] [DEBUG] [LOCAL ] HIG: Loaded 51176 existing records from primary storage. [2025-10-08T19:22:08.009517] [INFO ] [MAIN ] HIG: Loaded 51176 existing records. [2025-10-08T19:22:08.022685] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-08T19:22:08.204322] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:08.204665] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-08T19:22:08.204736] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-08T19:22:08.204966] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-08T19:22:08.205023] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-08T19:22:08.508232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:22:08.593015] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:08.817564] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-08T19:22:09.047715] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:22:09.617546] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-08T19:22:10.417637] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-08T19:22:10.566882] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T19:22:10.919467] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:22:11.217600] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-08T19:22:11.430296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:22:12.017604] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-08T19:22:12.419259] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T19:22:12.817613] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-08T19:22:13.314267] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:22:13.617563] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-08T19:22:14.417568] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-08T19:22:14.457620] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:22:14.703331] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:22:15.217567] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-08T19:22:16.017539] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-08T19:22:16.152522] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:22:16.413048] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T19:22:16.817551] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-08T19:22:17.385560] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:22:17.617582] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-08T19:22:18.399720] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:22:18.417590] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-08T19:22:19.181083] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:22:19.217519] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-08T19:22:19.451532] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:22:20.017548] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-08T19:22:20.612193] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T19:22:20.817563] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-08T19:22:21.260558] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T19:22:21.617535] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-08T19:22:22.187602] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:22:22.417562] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-08T19:22:22.586327] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T19:22:23.217527] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-08T19:22:23.561720] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:22:24.017555] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-08T19:22:24.817533] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-08T19:22:24.901624] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T19:22:25.441996] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:22:25.617538] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-08T19:22:26.417558] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-08T19:22:26.458587] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:22:27.183539] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:22:27.217523] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-08T19:22:27.929454] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:22:28.017601] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-08T19:22:28.717846] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:22:28.817503] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-08T19:22:29.572060] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:22:29.617493] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-08T19:22:30.230143] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T19:22:30.417547] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-08T19:22:30.627427] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:22:31.217544] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-08T19:22:32.017591] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-08T19:22:32.272326] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T19:22:32.306048] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:22:32.817614] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-08T19:22:33.571521] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T19:22:33.617525] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-08T19:22:34.417709] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-08T19:22:34.582420] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T19:22:35.217512] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-08T19:22:35.361199] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:22:35.423844] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:22:36.017606] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-08T19:22:36.619019] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:22:36.817527] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-08T19:22:37.351533] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:22:37.354340] [INFO ] [REMOTE ] HI: Full fetch complete (49977 records). [2025-10-08T19:22:37.354444] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-08T19:22:37.622638] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-08T19:22:37.739791] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-08T19:22:37.739891] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-08T19:22:37.740846] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-08T19:22:37.740908] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-08T19:22:37.742096] [DEBUG] [LOCAL ] HI: Trimmed 49977 records to 35330 (keeping 200 days of data) [2025-10-08T19:22:37.858049] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T19:22:37.862936] [INFO ] [REMOTE ] HHH: Full fetch complete (45768 records). [2025-10-08T19:22:37.864056] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-08T19:22:38.354607] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-08T19:22:38.356241] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-08T19:22:38.356973] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-08T19:22:38.357331] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-08T19:22:38.362214] [DEBUG] [LOCAL ] HHH: Trimmed 45768 records to 32955 (keeping 200 days of data) [2025-10-08T19:22:38.421379] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-08T19:22:38.469396] [DEBUG] [LOCAL ] HI: Primary data saved (35330 records). [2025-10-08T19:22:38.471844] [INFO ] [MAIN ] HI: Full history saved. [2025-10-08T19:22:38.472724] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HI took 31.9s. Estimated remaining: 3h 10m 29s. Rate: 7.1 symbols/min [2025-10-08T19:22:38.659138] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:38.767090] [DEBUG] [LOCAL ] HII: Loaded 34213 existing records from primary storage. [2025-10-08T19:22:38.768834] [INFO ] [MAIN ] HII: Loaded 34213 existing records. [2025-10-08T19:22:38.959897] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:38.963012] [DEBUG] [LOCAL ] HHH: Primary data saved (32955 records). [2025-10-08T19:22:38.963348] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-08T19:22:38.963603] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-08T19:22:38.963523] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-08T19:22:38.963809] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HHH took 33.5s. Estimated remaining: 3h 10m 10s. Rate: 7.1 symbols/min [2025-10-08T19:22:39.018202] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-08T19:22:39.032238] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-08T19:22:39.263318] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:39.535832] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:22:39.533735] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:39.545188] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-08T19:22:39.587881] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-08T19:22:39.588280] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-08T19:22:39.765473] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:39.765778] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-08T19:22:39.765836] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-08T19:22:39.766144] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-08T19:22:39.766216] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-08T19:22:40.045196] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-08T19:22:40.079187] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T19:22:40.142251] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:40.138634] [INFO ] [REMOTE ] HIG: Full fetch complete (73189 records). [2025-10-08T19:22:40.142443] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-08T19:22:40.525737] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-08T19:22:40.525823] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-08T19:22:40.526748] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-08T19:22:40.526812] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-08T19:22:40.528230] [DEBUG] [LOCAL ] HIG: Trimmed 73189 records to 51163 (keeping 200 days of data) [2025-10-08T19:22:40.818971] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-08T19:22:40.861599] [DEBUG] [LOCAL ] HIG: Primary data saved (51163 records). [2025-10-08T19:22:40.861750] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-08T19:22:40.861849] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HIG took 33.1s. Estimated remaining: 3h 9m 53s. Rate: 7.1 symbols/min [2025-10-08T19:22:41.035099] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:41.057769] [DEBUG] [LOCAL ] HIO: Loaded 24020 existing records from primary storage. [2025-10-08T19:22:41.058029] [INFO ] [MAIN ] HIO: Loaded 24020 existing records. [2025-10-08T19:22:41.263898] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:41.264308] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-08T19:22:41.264454] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-08T19:22:41.265229] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-08T19:22:41.266467] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:22:41.266683] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-08T19:22:41.628254] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-08T19:22:41.668161] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T19:22:41.674214] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:42.417573] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-08T19:22:43.179034] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:22:43.217497] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-08T19:22:43.288401] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T19:22:43.445762] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:22:43.449163] [INFO ] [REMOTE ] HGV: Full fetch complete (65907 records). [2025-10-08T19:22:43.449276] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-08T19:22:43.843699] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-08T19:22:43.843791] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-08T19:22:43.844634] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-08T19:22:43.844712] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-08T19:22:43.846007] [DEBUG] [LOCAL ] HGV: Trimmed 65907 records to 46408 (keeping 200 days of data) [2025-10-08T19:22:44.022467] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-08T19:22:44.125156] [DEBUG] [LOCAL ] HGV: Primary data saved (46408 records). [2025-10-08T19:22:44.125317] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-08T19:22:44.125419] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HGV took 41.7s. Estimated remaining: 3h 9m 37s. Rate: 7.1 symbols/min [2025-10-08T19:22:44.295131] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:22:44.316952] [DEBUG] [LOCAL ] HIPO: Loaded 22014 existing records from primary storage. [2025-10-08T19:22:44.317312] [INFO ] [MAIN ] HIPO: Loaded 22014 existing records. [2025-10-08T19:22:44.505054] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:22:44.505314] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-08T19:22:44.505376] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-08T19:22:44.505572] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-08T19:22:44.505629] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-08T19:22:44.827555] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-08T19:22:44.872809] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:22:44.899677] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:22:45.617623] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-08T19:22:45.733016] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:22:46.398807] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-08T19:22:46.417500] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-08T19:22:47.217515] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-08T19:22:47.427450] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:22:48.017587] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-08T19:22:48.085982] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:22:48.616454] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-08T19:22:48.817524] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-08T19:22:49.045479] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:22:49.617568] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-08T19:22:49.638241] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:22:50.417543] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-08T19:22:51.217582] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-08T19:22:51.349543] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:22:51.415149] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:22:52.017575] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-08T19:22:52.817615] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-08T19:22:53.617556] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-08T19:23:05.641487] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (13.62 seconds). [2025-10-08T19:23:05.647413] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-08T19:23:07.874450] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (16.66 seconds). [2025-10-08T19:23:07.885605] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-08T19:23:08.428065] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (14.81 seconds). [2025-10-08T19:23:08.432513] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-08T19:23:09.318036] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T19:23:09.322236] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-08T19:23:09.457582] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (16.64 seconds). [2025-10-08T19:23:09.466416] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-08T19:23:09.975679] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (4.33 seconds). [2025-10-08T19:23:09.980264] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-08T19:23:10.413074] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:23:10.418321] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-08T19:23:10.744596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:23:10.752797] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-08T19:23:10.876214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T19:23:10.880929] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-08T19:23:11.236311] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T19:23:11.241469] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-08T19:23:12.003819] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (4.12 seconds). [2025-10-08T19:23:12.033837] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T19:23:12.040973] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-08T19:23:12.042500] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-08T19:23:12.073094] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:23:12.081373] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-08T19:23:12.133347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T19:23:12.139111] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-08T19:23:13.393331] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T19:23:13.400137] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-08T19:23:13.420731] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:23:13.426949] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-08T19:23:13.650109] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:23:13.657172] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-08T19:23:14.231258] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:23:14.236426] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-08T19:23:14.510102] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-08T19:23:14.522275] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-08T19:23:14.566397] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:23:14.572705] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-08T19:23:14.944720] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T19:23:14.950121] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-08T19:23:15.136253] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:23:15.143809] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-08T19:23:15.551088] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:23:15.554033] [INFO ] [REMOTE ] HIO: Full fetch complete (37859 records). [2025-10-08T19:23:15.554113] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-08T19:23:15.917597] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T19:23:15.959329] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-08T19:23:15.976197] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-08T19:23:15.976288] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-08T19:23:15.976942] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-08T19:23:15.977007] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-08T19:23:15.977882] [DEBUG] [LOCAL ] HIO: Trimmed 37859 records to 24054 (keeping 200 days of data) [2025-10-08T19:23:16.118521] [DEBUG] [LOCAL ] HIO: Primary data saved (24054 records). [2025-10-08T19:23:16.118688] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-08T19:23:16.118791] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIO took 35.3s. Estimated remaining: 3h 10m 0s. Rate: 7.1 symbols/min [2025-10-08T19:23:16.298618] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:23:16.302176] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:16.305831] [INFO ] [REMOTE ] HII: Full fetch complete (52638 records). [2025-10-08T19:23:16.306057] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-08T19:23:16.642121] [DEBUG] [LOCAL ] HIW: Loaded 44561 existing records from primary storage. [2025-10-08T19:23:16.668457] [INFO ] [MAIN ] HIW: Loaded 44561 existing records. [2025-10-08T19:23:16.800549] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-08T19:23:16.812285] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-08T19:23:16.823995] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-08T19:23:16.835290] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-08T19:23:16.921431] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:16.922445] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-08T19:23:16.922629] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-08T19:23:16.922863] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:23:16.921605] [DEBUG] [LOCAL ] HII: Trimmed 52638 records to 34069 (keeping 200 days of data) [2025-10-08T19:23:16.923182] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-08T19:23:16.924659] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-08T19:23:17.011396] [INFO ] [REMOTE ] HIPO: Full fetch complete (31424 records). [2025-10-08T19:23:17.031246] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-08T19:23:17.678759] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:17.710243] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-08T19:23:17.856153] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (3.33 seconds). [2025-10-08T19:23:17.854751] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-08T19:23:17.869629] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-08T19:23:17.870282] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-08T19:23:17.871036] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-08T19:23:17.871727] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-08T19:23:17.876110] [DEBUG] [LOCAL ] HIPO: Trimmed 31424 records to 21980 (keeping 200 days of data) [2025-10-08T19:23:18.116132] [DEBUG] [LOCAL ] HIPO: Primary data saved (21980 records). [2025-10-08T19:23:18.117292] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-08T19:23:18.117963] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIPO took 34.0s. Estimated remaining: 3h 9m 43s. Rate: 7.1 symbols/min [2025-10-08T19:23:18.233973] [DEBUG] [LOCAL ] HII: Primary data saved (34069 records). [2025-10-08T19:23:18.236950] [INFO ] [MAIN ] HII: Full history saved. [2025-10-08T19:23:18.237474] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HII took 39.8s. Estimated remaining: 3h 9m 24s. Rate: 7.1 symbols/min [2025-10-08T19:23:18.435938] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:18.514842] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:18.524318] [DEBUG] [LOCAL ] HIX: Loaded 20709 existing records from primary storage. [2025-10-08T19:23:18.524723] [INFO ] [MAIN ] HIX: Loaded 20709 existing records. [2025-10-08T19:23:18.689093] [DEBUG] [LOCAL ] HKD: Loaded 18519 existing records from primary storage. [2025-10-08T19:23:18.719951] [INFO ] [MAIN ] HKD: Loaded 18519 existing records. [2025-10-08T19:23:18.719751] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:18.757983] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-08T19:23:18.758065] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-08T19:23:18.788715] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-08T19:23:18.805755] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-08T19:23:19.016509] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:19.017668] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-08T19:23:19.028054] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-08T19:23:19.056850] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-08T19:23:19.101668] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-08T19:23:19.439079] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:19.458794] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-08T19:23:19.643383] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T19:23:19.687695] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-08T19:23:19.721340] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:19.722433] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-08T19:23:20.348268] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T19:23:20.362102] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-08T19:23:20.682693] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T19:23:20.689138] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-08T19:23:20.884255] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T19:23:20.895843] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-08T19:23:21.089280] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:23:21.096327] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-08T19:23:21.556639] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T19:23:21.562431] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-08T19:23:22.047352] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:23:22.056372] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-08T19:23:22.281232] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T19:23:22.285973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-08T19:23:22.633263] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T19:23:22.634208] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:23:22.648876] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-08T19:23:23.092143] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:23:23.217527] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-08T19:23:23.434951] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:23:23.468129] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:23:24.017545] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-08T19:23:24.817595] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-08T19:23:25.390013] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:23:25.491939] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-08T19:23:25.617500] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-08T19:23:25.856592] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:23:26.417608] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-08T19:23:27.217574] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-08T19:23:27.618225] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T19:23:28.017516] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-08T19:23:28.056937] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-08T19:23:28.061750] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-08T19:23:28.061911] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-08T19:23:28.495454] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-08T19:23:28.495617] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-08T19:23:28.496725] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-08T19:23:28.496866] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-08T19:23:28.498543] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 53817 (keeping 200 days of data) [2025-10-08T19:23:28.749867] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:23:28.837389] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-08T19:23:28.911476] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-08T19:23:28.911662] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-08T19:23:28.911786] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIMS took 49.9s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-08T19:23:29.083627] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:29.095548] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:23:29.146296] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-10-08T19:23:29.146684] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-10-08T19:23:29.320464] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:29.320731] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-08T19:23:29.320792] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-08T19:23:29.321025] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-08T19:23:29.321082] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-08T19:23:29.620053] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-08T19:23:29.703633] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:30.417572] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-08T19:23:30.483002] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:23:30.741792] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:23:31.217567] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-08T19:23:31.360676] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:23:32.017627] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-08T19:23:32.747689] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:23:32.817554] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-08T19:23:33.391529] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T19:23:33.617617] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-08T19:23:34.417613] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-08T19:23:34.710442] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T19:23:35.117958] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:23:35.217524] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-08T19:23:35.242777] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T19:23:36.017572] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-08T19:23:36.794092] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T19:23:36.817499] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-08T19:23:37.617517] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-08T19:23:37.857182] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T19:23:38.249135] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:23:38.253264] [INFO ] [REMOTE ] HIW: Full fetch complete (64830 records). [2025-10-08T19:23:38.253546] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-08T19:23:38.420905] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-08T19:23:38.669445] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-08T19:23:38.669607] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-08T19:23:38.670675] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-08T19:23:38.676176] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-08T19:23:38.681774] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:23:38.686513] [DEBUG] [LOCAL ] HIW: Trimmed 64830 records to 44497 (keeping 200 days of data) [2025-10-08T19:23:38.970204] [DEBUG] [LOCAL ] HIW: Primary data saved (44497 records). [2025-10-08T19:23:38.970370] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-08T19:23:38.970509] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIW took 22.9s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-08T19:23:39.149557] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:39.194147] [DEBUG] [LOCAL ] HLF: Loaded 48469 existing records from primary storage. [2025-10-08T19:23:39.194520] [INFO ] [MAIN ] HLF: Loaded 48469 existing records. [2025-10-08T19:23:39.225424] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-08T19:23:39.373813] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:39.374028] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-08T19:23:39.374075] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-08T19:23:39.374294] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-08T19:23:39.374350] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-08T19:23:39.738882] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:40.017523] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-08T19:23:40.197867] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:23:40.325756] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:23:40.817639] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-08T19:23:41.561223] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:23:41.617583] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-08T19:23:42.015215] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T19:23:42.417511] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-08T19:23:42.758852] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:23:43.217557] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-08T19:23:43.947753] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T19:23:44.017495] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-08T19:23:44.426582] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T19:23:44.817522] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-08T19:23:45.471600] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T19:23:45.617562] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-08T19:23:45.994691] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:23:45.996578] [INFO ] [REMOTE ] HKD: Full fetch complete (28284 records). [2025-10-08T19:23:45.996690] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-08T19:23:46.360667] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-08T19:23:46.360758] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-08T19:23:46.361335] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-08T19:23:46.361373] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-08T19:23:46.362093] [DEBUG] [LOCAL ] HKD: Trimmed 28284 records to 18518 (keeping 200 days of data) [2025-10-08T19:23:46.440144] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-08T19:23:46.474960] [DEBUG] [LOCAL ] HKD: Primary data saved (18518 records). [2025-10-08T19:23:46.475122] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-08T19:23:46.475223] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HKD took 28.2s. Estimated remaining: 3h 9m 2s. Rate: 7.1 symbols/min [2025-10-08T19:23:46.644526] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:46.677221] [DEBUG] [LOCAL ] HLI: Loaded 30814 existing records from primary storage. [2025-10-08T19:23:46.677501] [INFO ] [MAIN ] HLI: Loaded 30814 existing records. [2025-10-08T19:23:46.856717] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:46.856981] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-08T19:23:46.857030] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-08T19:23:46.857307] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-08T19:23:46.857364] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-08T19:23:47.218448] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-08T19:23:47.222188] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:47.543533] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:23:47.640918] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T19:23:48.017569] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-08T19:23:48.235104] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:23:48.817575] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-08T19:23:49.617539] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-08T19:23:49.809494] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T19:23:50.417854] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-08T19:23:50.418075] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:23:50.421311] [INFO ] [REMOTE ] HIX: Full fetch complete (30562 records). [2025-10-08T19:23:50.421392] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-08T19:23:50.822832] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T19:23:50.870971] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-08T19:23:50.871037] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-08T19:23:50.871603] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-08T19:23:50.871720] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-08T19:23:50.872462] [DEBUG] [LOCAL ] HIX: Trimmed 30562 records to 20688 (keeping 200 days of data) [2025-10-08T19:23:50.999863] [DEBUG] [LOCAL ] HIX: Primary data saved (20688 records). [2025-10-08T19:23:51.000018] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-08T19:23:51.000121] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIX took 32.9s. Estimated remaining: 3h 8m 49s. Rate: 7.1 symbols/min [2025-10-08T19:23:51.204985] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:23:51.222973] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-08T19:23:51.237917] [DEBUG] [LOCAL ] HLIO: Loaded 27889 existing records from primary storage. [2025-10-08T19:23:51.238197] [INFO ] [MAIN ] HLIO: Loaded 27889 existing records. [2025-10-08T19:23:51.419741] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:23:51.419944] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-08T19:23:51.419994] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-08T19:23:51.420230] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-08T19:23:51.420288] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-08T19:23:51.790093] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:23:51.813294] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T19:23:52.017552] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-08T19:23:52.817631] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-08T19:23:52.867478] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:23:52.906193] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T19:23:53.617578] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-08T19:23:54.326238] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T19:23:54.417591] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-08T19:23:54.660465] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:23:55.217786] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-08T19:23:56.022666] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-08T19:23:56.037370] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:23:56.299169] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T19:23:56.817531] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-08T19:23:57.028935] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:23:57.617618] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-08T19:23:58.259543] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:23:58.417539] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-08T19:23:59.217557] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-08T19:23:59.484009] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:23:59.524881] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:24:00.017557] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-08T19:24:00.817529] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-08T19:24:00.982465] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:24:01.045438] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:24:01.617566] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-08T19:24:02.417580] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-08T19:24:02.971179] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T19:24:02.983297] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T19:24:03.217639] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-08T19:24:03.734241] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:24:04.017610] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-08T19:24:04.571303] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:24:04.817559] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-08T19:24:05.617513] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-08T19:24:05.913692] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:24:05.927008] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:24:06.417551] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-08T19:24:07.089417] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:24:07.217557] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-08T19:24:08.017605] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-08T19:24:08.179759] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T19:24:08.270797] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T19:24:08.817546] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-08T19:24:09.617566] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-08T19:24:09.674531] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T19:24:09.978165] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T19:24:10.417562] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-08T19:24:10.679132] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:24:11.217550] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-08T19:24:11.752509] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:24:12.017528] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-08T19:24:12.598063] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T19:24:12.817557] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-08T19:24:13.617546] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-08T19:24:13.920943] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T19:24:13.959601] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T19:24:13.964613] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-08T19:24:13.964791] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-08T19:24:14.367178] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-08T19:24:14.367307] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-08T19:24:14.368436] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-08T19:24:14.368623] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-08T19:24:14.370386] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 53672 (keeping 200 days of data) [2025-10-08T19:24:14.426220] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-08T19:24:14.484226] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T19:24:14.725570] [DEBUG] [LOCAL ] HL: Primary data saved (53672 records). [2025-10-08T19:24:14.725749] [INFO ] [MAIN ] HL: Full history saved. [2025-10-08T19:24:14.725841] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HL took 45.8s. Estimated remaining: 3h 9m 1s. Rate: 7.1 symbols/min [2025-10-08T19:24:14.896200] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:14.928639] [DEBUG] [LOCAL ] HLLY: Loaded 33426 existing records from primary storage. [2025-10-08T19:24:14.929018] [INFO ] [MAIN ] HLLY: Loaded 33426 existing records. [2025-10-08T19:24:15.125336] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:15.125588] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-08T19:24:15.125680] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-08T19:24:15.125947] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-08T19:24:15.126006] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-08T19:24:15.222824] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-08T19:24:15.508746] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:15.833213] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T19:24:16.017616] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-08T19:24:16.817600] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-08T19:24:16.852260] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:24:16.855981] [INFO ] [REMOTE ] HLF: Full fetch complete (70997 records). [2025-10-08T19:24:16.856112] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-08T19:24:17.261537] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-08T19:24:17.261669] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-08T19:24:17.262685] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-08T19:24:17.262820] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-08T19:24:17.264355] [DEBUG] [LOCAL ] HLF: Trimmed 70997 records to 48417 (keeping 200 days of data) [2025-10-08T19:24:17.371534] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T19:24:17.576234] [DEBUG] [LOCAL ] HLF: Primary data saved (48417 records). [2025-10-08T19:24:17.576429] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-08T19:24:17.576535] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 38.6s. Estimated remaining: 3h 8m 45s. Rate: 7.1 symbols/min [2025-10-08T19:24:17.622745] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-08T19:24:17.763181] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T19:24:17.762698] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:17.766263] [INFO ] [REMOTE ] HLIO: Full fetch complete (36412 records). [2025-10-08T19:24:17.766367] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-08T19:24:18.141923] [DEBUG] [LOCAL ] HLN: Loaded 53099 existing records from primary storage. [2025-10-08T19:24:18.176495] [INFO ] [MAIN ] HLN: Loaded 53099 existing records. [2025-10-08T19:24:18.259967] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-08T19:24:18.265692] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-08T19:24:18.271602] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-08T19:24:18.282468] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-08T19:24:18.332932] [DEBUG] [LOCAL ] HLIO: Trimmed 36412 records to 27907 (keeping 200 days of data) [2025-10-08T19:24:18.424788] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-08T19:24:18.373470] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:18.434301] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-08T19:24:18.435416] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-08T19:24:18.462837] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-08T19:24:18.463343] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-08T19:24:18.814502] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:24:18.873861] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:18.870773] [INFO ] [REMOTE ] HLI: Full fetch complete (45148 records). [2025-10-08T19:24:18.874566] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-08T19:24:19.222605] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-08T19:24:19.302084] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-08T19:24:19.303668] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-08T19:24:19.305529] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-08T19:24:19.305864] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-08T19:24:19.348403] [DEBUG] [LOCAL ] HLI: Trimmed 45148 records to 30808 (keeping 200 days of data) [2025-10-08T19:24:19.455312] [DEBUG] [LOCAL ] HLIO: Primary data saved (27907 records). [2025-10-08T19:24:19.456002] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-08T19:24:19.456613] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLIO took 28.5s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-10-08T19:24:19.638885] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:19.699523] [DEBUG] [LOCAL ] HLT: Loaded 50618 existing records from primary storage. [2025-10-08T19:24:19.734004] [INFO ] [MAIN ] HLT: Loaded 50618 existing records. [2025-10-08T19:24:19.810242] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:24:19.969164] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:19.971397] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-08T19:24:19.971811] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-08T19:24:19.972720] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-08T19:24:19.973345] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-08T19:24:20.018687] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-08T19:24:20.238397] [DEBUG] [LOCAL ] HLI: Primary data saved (30808 records). [2025-10-08T19:24:20.249766] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-08T19:24:20.274288] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLI took 33.8s. Estimated remaining: 3h 8m 10s. Rate: 7.1 symbols/min [2025-10-08T19:24:20.473477] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:20.526682] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:20.568444] [DEBUG] [LOCAL ] HLX: Loaded 47654 existing records from primary storage. [2025-10-08T19:24:20.568813] [INFO ] [MAIN ] HLX: Loaded 47654 existing records. [2025-10-08T19:24:20.752302] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:20.752595] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-08T19:24:20.752706] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-08T19:24:20.752935] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-08T19:24:20.752993] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-08T19:24:20.826143] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-08T19:24:21.123237] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:21.166354] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T19:24:21.178354] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:24:21.617573] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-08T19:24:22.359732] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:24:22.417499] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-08T19:24:23.217559] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-08T19:24:23.333379] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:24:23.828632] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:24:24.017544] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-08T19:24:24.817515] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-08T19:24:24.913748] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:24:25.617527] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-08T19:24:25.653789] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T19:24:25.740412] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T19:24:26.417545] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-08T19:24:27.217478] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-08T19:24:27.280927] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:24:28.017550] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-08T19:24:28.344999] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:24:28.811737] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:24:28.821312] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-08T19:24:29.503424] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:24:29.617533] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-08T19:24:30.417538] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-08T19:24:30.522961] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T19:24:31.217527] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-08T19:24:31.501813] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:24:31.673669] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T19:24:32.017562] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-08T19:24:32.684306] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:24:32.817570] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-08T19:24:33.350423] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:24:33.617576] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-08T19:24:34.331236] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:24:34.417505] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-08T19:24:34.913449] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:24:35.217622] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-08T19:24:36.017567] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-08T19:24:36.241710] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:24:36.278766] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:24:36.817631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-08T19:24:37.395549] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:24:37.617623] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-08T19:24:38.205249] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:24:38.417579] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-08T19:24:39.201976] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:24:39.217502] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-08T19:24:39.925481] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T19:24:40.017563] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-08T19:24:40.469938] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T19:24:40.817548] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-08T19:24:41.617584] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-08T19:24:41.777048] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:24:42.417516] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-08T19:24:42.532590] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T19:24:43.099500] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:24:43.217567] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-08T19:24:43.430595] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T19:24:44.017578] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-08T19:24:44.817539] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-08T19:24:44.953198] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:24:45.540470] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:24:45.617514] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-08T19:24:45.908307] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:24:46.417690] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-08T19:24:47.174744] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:24:47.217633] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-08T19:24:47.661388] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T19:24:47.664365] [INFO ] [REMOTE ] HLLY: Full fetch complete (46268 records). [2025-10-08T19:24:47.664495] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-08T19:24:48.025400] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-08T19:24:48.067551] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-08T19:24:48.067671] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-08T19:24:48.068392] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-08T19:24:48.068437] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-08T19:24:48.069986] [DEBUG] [LOCAL ] HLLY: Trimmed 46268 records to 33454 (keeping 200 days of data) [2025-10-08T19:24:48.265404] [DEBUG] [LOCAL ] HLLY: Primary data saved (33454 records). [2025-10-08T19:24:48.265575] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-08T19:24:48.265712] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 33.5s. Estimated remaining: 3h 8m 27s. Rate: 7.1 symbols/min [2025-10-08T19:24:48.432427] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:48.474569] [DEBUG] [LOCAL ] HMC: Loaded 46638 existing records from primary storage. [2025-10-08T19:24:48.474943] [INFO ] [MAIN ] HMC: Loaded 46638 existing records. [2025-10-08T19:24:48.652989] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:48.653254] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-08T19:24:48.653305] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-08T19:24:48.653566] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-08T19:24:48.653624] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-08T19:24:48.823716] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-08T19:24:49.060937] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:49.092083] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T19:24:49.302753] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:24:49.617571] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-08T19:24:50.401452] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:24:50.405780] [INFO ] [REMOTE ] HLN: Full fetch complete (76823 records). [2025-10-08T19:24:50.405963] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-08T19:24:50.422718] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-08T19:24:50.838879] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-08T19:24:50.838972] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-08T19:24:50.839993] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-08T19:24:50.840060] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-08T19:24:50.841614] [DEBUG] [LOCAL ] HLN: Trimmed 76823 records to 53097 (keeping 200 days of data) [2025-10-08T19:24:51.165114] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:24:51.169938] [INFO ] [REMOTE ] HLX: Full fetch complete (69073 records). [2025-10-08T19:24:51.170844] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-08T19:24:51.227698] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-08T19:24:51.597832] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-08T19:24:51.597550] [DEBUG] [LOCAL ] HLN: Primary data saved (53097 records). [2025-10-08T19:24:51.597946] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-08T19:24:51.598023] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-08T19:24:51.598982] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-08T19:24:51.599121] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLN took 34.0s. Estimated remaining: 3h 8m 12s. Rate: 7.1 symbols/min [2025-10-08T19:24:51.599194] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-08T19:24:51.698550] [DEBUG] [LOCAL ] HLX: Trimmed 69073 records to 47588 (keeping 200 days of data) [2025-10-08T19:24:51.851368] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:51.914380] [DEBUG] [LOCAL ] HMN: Loaded 23451 existing records from primary storage. [2025-10-08T19:24:51.916170] [INFO ] [MAIN ] HMN: Loaded 23451 existing records. [2025-10-08T19:24:52.111244] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:52.113595] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-08T19:24:52.114285] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-08T19:24:52.129685] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-08T19:24:52.130191] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-08T19:24:52.191182] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:24:52.253803] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-08T19:24:52.626171] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:52.697659] [DEBUG] [LOCAL ] HLX: Primary data saved (47588 records). [2025-10-08T19:24:52.697813] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-08T19:24:52.697904] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLX took 32.4s. Estimated remaining: 3h 7m 54s. Rate: 7.1 symbols/min [2025-10-08T19:24:52.828566] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-08T19:24:52.877911] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:52.939797] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:24:52.967414] [DEBUG] [LOCAL ] HMY: Loaded 53140 existing records from primary storage. [2025-10-08T19:24:52.967813] [INFO ] [MAIN ] HMY: Loaded 53140 existing records. [2025-10-08T19:24:53.148315] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:24:53.148611] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-08T19:24:53.148696] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-08T19:24:53.149068] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-08T19:24:53.149128] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-08T19:24:53.531061] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:24:53.622638] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-08T19:24:53.630767] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T19:24:53.676062] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:24:54.417560] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-08T19:24:55.217567] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-08T19:24:55.426676] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T19:24:55.862915] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T19:24:55.937972] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:24:56.017556] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-08T19:24:56.817524] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-08T19:24:57.043892] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:24:57.617586] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-08T19:24:58.371795] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:24:58.376935] [INFO ] [REMOTE ] HLT: Full fetch complete (73527 records). [2025-10-08T19:24:58.377155] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-08T19:24:58.422639] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-08T19:24:58.545577] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T19:24:58.789910] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-08T19:24:58.790045] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-08T19:24:58.791183] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-08T19:24:58.791248] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-08T19:24:58.792951] [DEBUG] [LOCAL ] HLT: Trimmed 73527 records to 50612 (keeping 200 days of data) [2025-10-08T19:24:59.123361] [DEBUG] [LOCAL ] HLT: Primary data saved (50612 records). [2025-10-08T19:24:59.123633] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-08T19:24:59.123773] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLT took 39.7s. Estimated remaining: 3h 7m 43s. Rate: 7.1 symbols/min [2025-10-08T19:24:59.222876] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-08T19:24:59.298412] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:24:59.298625] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-08T19:24:59.298702] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-08T19:24:59.298904] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-08T19:24:59.298984] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-08T19:24:59.299080] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-08T19:24:59.299134] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-08T19:24:59.666382] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:00.017502] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-08T19:25:00.119956] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:25:00.430501] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:25:00.817586] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-08T19:25:00.995561] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:25:00.995901] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-08T19:25:00.995992] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:25:00.996039] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-08T19:25:00.996096] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:25:00.996168] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-08T19:25:00.996231] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-08T19:25:00.996265] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-08T19:25:00.996319] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-08T19:25:00.996390] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 1.9s. Estimated remaining: 3h 7m 26s. Rate: 7.1 symbols/min [2025-10-08T19:25:01.170781] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:01.200832] [DEBUG] [LOCAL ] HNI: Loaded 29406 existing records from primary storage. [2025-10-08T19:25:01.201141] [INFO ] [MAIN ] HNI: Loaded 29406 existing records. [2025-10-08T19:25:01.385282] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:01.385720] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-08T19:25:01.385941] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-08T19:25:01.386283] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-08T19:25:01.386412] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-08T19:25:01.625415] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-08T19:25:01.645753] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:25:01.868165] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:02.417562] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-08T19:25:03.144095] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:25:03.217510] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-08T19:25:04.017509] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-08T19:25:04.247045] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T19:25:04.393809] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:25:04.817562] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-08T19:25:05.617517] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-08T19:25:05.902610] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:25:05.990552] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:25:06.417525] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-08T19:25:07.155184] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T19:25:07.217506] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-08T19:25:07.650465] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:25:08.017554] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-08T19:25:08.817582] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-08T19:25:08.908885] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:25:08.934128] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:25:09.617556] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-08T19:25:09.746249] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T19:25:10.417570] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-08T19:25:11.217555] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-08T19:25:11.469310] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:25:11.560314] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T19:25:12.017523] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-08T19:25:12.266789] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T19:25:12.817546] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-08T19:25:13.617564] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-08T19:25:13.680392] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T19:25:14.417523] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-08T19:25:14.527489] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:25:14.754141] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:25:14.755990] [INFO ] [REMOTE ] HMN: Full fetch complete (31429 records). [2025-10-08T19:25:14.756077] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-08T19:25:15.135685] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-08T19:25:15.135778] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-08T19:25:15.136371] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-08T19:25:15.136434] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-08T19:25:15.137267] [DEBUG] [LOCAL ] HMN: Trimmed 31429 records to 23391 (keeping 200 days of data) [2025-10-08T19:25:15.225791] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-08T19:25:15.284958] [DEBUG] [LOCAL ] HMN: Primary data saved (23391 records). [2025-10-08T19:25:15.285096] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-08T19:25:15.285178] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 23.7s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-08T19:25:15.460440] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:15.509776] [DEBUG] [LOCAL ] HOG: Loaded 51064 existing records from primary storage. [2025-10-08T19:25:15.510112] [INFO ] [MAIN ] HOG: Loaded 51064 existing records. [2025-10-08T19:25:15.692208] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:15.692544] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-08T19:25:15.692603] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-08T19:25:15.693135] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-08T19:25:15.693193] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-08T19:25:15.985017] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:25:16.022632] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-08T19:25:16.088012] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:16.817576] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-08T19:25:16.936492] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:25:17.054048] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:25:17.617546] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-08T19:25:18.417529] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-08T19:25:18.497788] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:25:19.217509] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-08T19:25:19.692983] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T19:25:19.756918] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T19:25:20.017548] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-08T19:25:20.589850] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:25:20.817537] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-08T19:25:21.115257] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T19:25:21.617552] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-08T19:25:22.417561] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-08T19:25:22.724918] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T19:25:23.178175] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T19:25:23.217495] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-08T19:25:23.325196] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:25:24.017567] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-08T19:25:24.453815] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:25:24.817536] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-08T19:25:25.617543] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-08T19:25:26.351757] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T19:25:26.419760] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-08T19:25:26.425359] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:25:27.222697] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-08T19:25:27.240629] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:25:28.017553] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-08T19:25:28.366770] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-08T19:25:28.372887] [INFO ] [REMOTE ] HMY: Full fetch complete (76769 records). [2025-10-08T19:25:28.373060] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-08T19:25:28.789506] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-08T19:25:28.789697] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-08T19:25:28.790785] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-08T19:25:28.790887] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-08T19:25:28.793086] [DEBUG] [LOCAL ] HMY: Trimmed 76769 records to 53135 (keeping 200 days of data) [2025-10-08T19:25:28.849880] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-08T19:25:28.921573] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T19:25:29.183676] [DEBUG] [LOCAL ] HMY: Primary data saved (53135 records). [2025-10-08T19:25:29.183849] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-08T19:25:29.183973] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMY took 36.5s. Estimated remaining: 3h 7m 24s. Rate: 7.1 symbols/min [2025-10-08T19:25:29.397457] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:29.421801] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:25:29.468036] [DEBUG] [LOCAL ] HOMB: Loaded 43458 existing records from primary storage. [2025-10-08T19:25:29.468399] [INFO ] [MAIN ] HOMB: Loaded 43458 existing records. [2025-10-08T19:25:29.623771] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-08T19:25:29.653952] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:29.654194] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-08T19:25:29.654241] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-08T19:25:29.654572] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-08T19:25:29.654629] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-08T19:25:30.011792] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:30.321273] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T19:25:30.417529] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-08T19:25:30.872463] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T19:25:30.875172] [INFO ] [REMOTE ] HNI: Full fetch complete (41951 records). [2025-10-08T19:25:30.875256] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-08T19:25:31.217729] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-08T19:25:31.248777] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-08T19:25:31.248870] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-08T19:25:31.249570] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-08T19:25:31.249804] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-08T19:25:31.251083] [DEBUG] [LOCAL ] HNI: Trimmed 41951 records to 29303 (keeping 200 days of data) [2025-10-08T19:25:31.441630] [DEBUG] [LOCAL ] HNI: Primary data saved (29303 records). [2025-10-08T19:25:31.441808] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-08T19:25:31.441916] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNI took 30.4s. Estimated remaining: 3h 7m 7s. Rate: 7.1 symbols/min [2025-10-08T19:25:32.017528] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-08T19:25:32.132080] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:25:32.802360] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T19:25:32.817507] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-08T19:25:33.596967] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T19:25:33.617504] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-08T19:25:34.167282] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:25:34.417553] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-08T19:25:34.938024] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:25:35.217586] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-08T19:25:36.017552] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-08T19:25:36.103237] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:25:36.605547] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:25:36.817543] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-08T19:25:37.065008] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:25:37.617621] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-08T19:25:38.417521] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-08T19:25:38.610231] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:25:38.941987] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:25:39.217624] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-08T19:25:39.756414] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:25:39.759977] [INFO ] [REMOTE ] HMC: Full fetch complete (69174 records). [2025-10-08T19:25:39.760111] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-08T19:25:40.026616] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-08T19:25:40.153018] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-08T19:25:40.153107] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-08T19:25:40.154006] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-08T19:25:40.154075] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-08T19:25:40.156756] [DEBUG] [LOCAL ] HMC: Trimmed 69174 records to 46543 (keeping 200 days of data) [2025-10-08T19:25:40.442847] [DEBUG] [LOCAL ] HMC: Primary data saved (46543 records). [2025-10-08T19:25:40.442999] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-08T19:25:40.443099] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMC took 52.2s. Estimated remaining: 3h 6m 60s. Rate: 7.1 symbols/min [2025-10-08T19:25:40.494908] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:25:40.817553] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-08T19:25:41.785404] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T19:25:41.797929] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-08T19:25:42.248073] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:25:42.417618] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-08T19:25:43.053118] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T19:25:43.056868] [INFO ] [REMOTE ] HOG: Full fetch complete (74142 records). [2025-10-08T19:25:43.056977] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-08T19:25:43.467730] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-08T19:25:43.468012] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-08T19:25:43.469077] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-08T19:25:43.469161] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-08T19:25:43.470721] [DEBUG] [LOCAL ] HOG: Trimmed 74142 records to 51002 (keeping 200 days of data) [2025-10-08T19:25:43.609426] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T19:25:43.625489] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-08T19:25:43.844433] [DEBUG] [LOCAL ] HOG: Primary data saved (51002 records). [2025-10-08T19:25:43.844570] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-08T19:25:43.844679] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOG took 28.6s. Estimated remaining: 3h 6m 45s. Rate: 7.1 symbols/min [2025-10-08T19:25:45.243228] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:25:45.253727] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-08T19:25:46.714704] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:25:46.726191] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-08T19:25:47.953275] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:25:47.964092] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-08T19:25:49.355528] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:25:49.359204] [INFO ] [REMOTE ] HOMB: Full fetch complete (63989 records). [2025-10-08T19:25:49.359300] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-08T19:25:49.745397] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-08T19:25:49.745534] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-08T19:25:49.746456] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-08T19:25:49.746524] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-08T19:25:49.747989] [DEBUG] [LOCAL ] HOMB: Trimmed 63989 records to 43436 (keeping 200 days of data) [2025-10-08T19:25:50.024917] [DEBUG] [LOCAL ] HOMB: Primary data saved (43436 records). [2025-10-08T19:25:50.025075] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-08T19:25:50.025166] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOMB took 20.8s. Estimated remaining: 3h 6m 33s. Rate: 7.1 symbols/min [2025-10-08T19:25:50.618141] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.684957] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.779218] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.796820] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:25:50.827162] [DEBUG] [LOCAL ] HOV: Loaded 13932 existing records from primary storage. [2025-10-08T19:25:50.827628] [INFO ] [MAIN ] HOV: Loaded 13932 existing records. [2025-10-08T19:25:50.998749] [DEBUG] [LOCAL ] HOUS: Loaded 44807 existing records from primary storage. [2025-10-08T19:25:51.004925] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-08T19:25:51.020991] [INFO ] [MAIN ] HOUS: Loaded 44807 existing records. [2025-10-08T19:25:51.061241] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-08T19:25:51.164474] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.222502] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.290329] [DEBUG] [LOCAL ] HP: Loaded 51653 existing records from primary storage. [2025-10-08T19:25:51.301892] [INFO ] [MAIN ] HP: Loaded 51653 existing records. [2025-10-08T19:25:51.285972] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-08T19:25:51.396743] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-08T19:25:51.498926] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.443140] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-08T19:25:51.528418] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.571768] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-08T19:25:51.590637] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.599543] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.626860] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-08T19:25:51.621609] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-08T19:25:51.665505] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-08T19:25:51.665621] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-08T19:25:51.743315] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-08T19:25:51.807103] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:25:51.846868] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-08T19:25:51.944227] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-08T19:25:51.987098] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-08T19:25:52.033428] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-08T19:25:52.844072] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:52.877532] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-08T19:25:53.073940] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.145630] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-08T19:25:53.162035] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.188033] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-08T19:25:53.219419] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:25:53.222052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-08T19:25:53.849821] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T19:25:53.853591] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-08T19:25:54.587194] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:25:54.595952] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-08T19:25:54.667275] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:25:54.670940] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-08T19:25:54.702407] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:25:54.712720] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-08T19:25:54.860731] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:25:54.871605] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-08T19:25:55.221234] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T19:25:55.224126] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-08T19:25:55.653303] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T19:25:55.668342] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-08T19:25:55.832808] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:25:55.849695] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-08T19:25:55.864437] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:25:56.017696] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-08T19:25:56.350152] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:25:56.817602] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-08T19:25:56.935406] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T19:25:57.105235] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:25:57.230180] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:25:57.617515] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-08T19:25:58.417582] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-08T19:25:58.571383] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T19:25:59.073634] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:25:59.217576] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-08T19:25:59.597469] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:26:00.017555] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-08T19:26:00.817521] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-08T19:26:01.060690] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T19:26:01.617562] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-08T19:26:01.765412] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T19:26:02.178197] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:26:02.417607] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-08T19:26:02.467405] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:26:03.217562] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-08T19:26:04.017557] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-08T19:26:04.177479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:26:04.657840] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:26:04.817554] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-08T19:26:04.945743] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T19:26:05.617568] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-08T19:26:06.288636] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:26:06.417515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-08T19:26:06.665939] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T19:26:07.217555] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-08T19:26:08.017572] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-08T19:26:08.067841] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:26:08.817515] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-08T19:26:08.920736] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:26:09.254994] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:26:09.617557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-08T19:26:10.417517] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-08T19:26:10.583560] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:26:11.217530] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-08T19:26:11.288749] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T19:26:11.333737] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T19:26:12.017552] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-08T19:26:12.817529] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-08T19:26:12.956246] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:26:13.617570] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-08T19:26:13.714531] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T19:26:13.870134] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:26:14.417557] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-08T19:26:15.107082] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:26:15.217561] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-08T19:26:16.017565] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-08T19:26:16.071258] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:26:16.628091] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:26:16.629596] [INFO ] [REMOTE ] HOV: Full fetch complete (19130 records). [2025-10-08T19:26:16.629703] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-08T19:26:16.822472] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-08T19:26:17.015197] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-08T19:26:17.015379] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-08T19:26:17.015918] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-08T19:26:17.016001] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-08T19:26:17.016887] [DEBUG] [LOCAL ] HOV: Trimmed 19130 records to 13912 (keeping 200 days of data) [2025-10-08T19:26:17.111124] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:26:17.146876] [DEBUG] [LOCAL ] HOV: Primary data saved (13912 records). [2025-10-08T19:26:17.147032] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-08T19:26:17.147134] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 27.1s. Estimated remaining: 3h 6m 49s. Rate: 7.1 symbols/min [2025-10-08T19:26:17.322883] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:17.333369] [DEBUG] [LOCAL ] HPF: Loaded 7495 existing records from primary storage. [2025-10-08T19:26:17.333619] [INFO ] [MAIN ] HPF: Loaded 7495 existing records. [2025-10-08T19:26:17.517140] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:17.517462] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-08T19:26:17.517565] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-08T19:26:17.517822] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-08T19:26:17.517879] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-08T19:26:17.622717] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-08T19:26:17.870544] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:18.417589] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-08T19:26:18.544396] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:26:18.548810] [INFO ] [REMOTE ] HP: Full fetch complete (73991 records). [2025-10-08T19:26:18.548955] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-08T19:26:19.004569] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-08T19:26:19.004794] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-08T19:26:19.006447] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-08T19:26:19.006572] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-08T19:26:19.032715] [DEBUG] [LOCAL ] HP: Trimmed 73991 records to 51643 (keeping 200 days of data) [2025-10-08T19:26:19.035281] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:26:19.225085] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-08T19:26:19.358935] [DEBUG] [LOCAL ] HP: Primary data saved (51643 records). [2025-10-08T19:26:19.359091] [INFO ] [MAIN ] HP: Full history saved. [2025-10-08T19:26:19.359212] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HP took 29.3s. Estimated remaining: 3h 6m 33s. Rate: 7.1 symbols/min [2025-10-08T19:26:19.529849] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:19.542442] [DEBUG] [LOCAL ] HPI: Loaded 10570 existing records from primary storage. [2025-10-08T19:26:19.542699] [INFO ] [MAIN ] HPI: Loaded 10570 existing records. [2025-10-08T19:26:19.725990] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:19.726196] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-08T19:26:19.726242] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-08T19:26:19.726431] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-08T19:26:19.726490] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-08T19:26:20.022704] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-08T19:26:20.139602] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:20.452046] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T19:26:20.817538] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-08T19:26:20.909384] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:26:20.926585] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T19:26:21.314428] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T19:26:21.617555] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-08T19:26:22.407433] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T19:26:22.417555] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-08T19:26:23.104841] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T19:26:23.217552] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-08T19:26:24.017591] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-08T19:26:24.672324] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T19:26:24.817520] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-08T19:26:25.138725] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:26:25.142674] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-08T19:26:25.142794] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-08T19:26:25.556215] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:26:25.560122] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-08T19:26:25.562491] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-08T19:26:25.563729] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-08T19:26:25.564207] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-08T19:26:25.565680] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 53697 (keeping 200 days of data) [2025-10-08T19:26:25.622715] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-08T19:26:25.912061] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-08T19:26:25.912231] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-08T19:26:25.912325] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HPE took 35.9s. Estimated remaining: 3h 6m 22s. Rate: 7.1 symbols/min [2025-10-08T19:26:26.088804] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:26.139341] [DEBUG] [LOCAL ] HPP: Loaded 51040 existing records from primary storage. [2025-10-08T19:26:26.139729] [INFO ] [MAIN ] HPP: Loaded 51040 existing records. [2025-10-08T19:26:26.324384] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:26.324866] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-08T19:26:26.324929] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-08T19:26:26.325208] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-08T19:26:26.325267] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-08T19:26:26.422689] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-08T19:26:26.433500] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:26:26.691484] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:27.217631] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-08T19:26:27.899248] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:26:28.017542] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-08T19:26:28.053924] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:26:28.057930] [INFO ] [REMOTE ] HOUS: Full fetch complete (63887 records). [2025-10-08T19:26:28.058052] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-08T19:26:28.454740] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-08T19:26:28.454919] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-08T19:26:28.455772] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-08T19:26:28.455835] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-08T19:26:28.457140] [DEBUG] [LOCAL ] HOUS: Trimmed 63887 records to 44857 (keeping 200 days of data) [2025-10-08T19:26:28.710975] [DEBUG] [LOCAL ] HOUS: Primary data saved (44857 records). [2025-10-08T19:26:28.711116] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-08T19:26:28.711244] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HOUS took 38.7s. Estimated remaining: 3h 6m 6s. Rate: 7.1 symbols/min [2025-10-08T19:26:28.822730] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-08T19:26:28.886779] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:28.937429] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-08T19:26:28.937784] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-08T19:26:29.121781] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:29.122052] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-08T19:26:29.122109] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-08T19:26:29.122575] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-08T19:26:29.122637] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-08T19:26:29.498578] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:29.553907] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:26:29.617546] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-08T19:26:29.624667] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:26:30.417548] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-08T19:26:31.217575] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-08T19:26:31.266781] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:26:31.974536] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T19:26:32.006954] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T19:26:32.017744] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-08T19:26:32.817574] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-08T19:26:33.550614] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:26:33.617516] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-08T19:26:33.895567] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T19:26:34.417570] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-08T19:26:34.833299] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T19:26:35.217557] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-08T19:26:36.017519] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-08T19:26:36.204200] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:26:36.240975] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T19:26:36.815075] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T19:26:36.817484] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-08T19:26:37.434745] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T19:26:37.617570] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-08T19:26:38.172042] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T19:26:38.417610] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-08T19:26:39.217579] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-08T19:26:39.236267] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:26:39.988897] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:26:40.017539] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-08T19:26:40.817605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-08T19:26:40.874856] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:26:41.552089] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:26:41.617536] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-08T19:26:42.161496] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T19:26:42.162672] [INFO ] [REMOTE ] HPF: Full fetch complete (10776 records). [2025-10-08T19:26:42.162744] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-08T19:26:42.422625] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-08T19:26:42.524391] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-08T19:26:42.524470] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-08T19:26:42.524786] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-08T19:26:42.524845] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-08T19:26:42.525327] [DEBUG] [LOCAL ] HPF: Trimmed 10776 records to 7485 (keeping 200 days of data) [2025-10-08T19:26:42.571154] [DEBUG] [LOCAL ] HPF: Primary data saved (7485 records). [2025-10-08T19:26:42.571282] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-08T19:26:42.571364] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 25.4s. Estimated remaining: 3h 6m 5s. Rate: 7.1 symbols/min [2025-10-08T19:26:42.735547] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:42.748190] [DEBUG] [LOCAL ] HPS: Loaded 10266 existing records from primary storage. [2025-10-08T19:26:42.748420] [INFO ] [MAIN ] HPS: Loaded 10266 existing records. [2025-10-08T19:26:42.924168] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:42.924414] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-08T19:26:42.924460] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-08T19:26:42.924691] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-08T19:26:42.924750] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-08T19:26:43.232230] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-08T19:26:43.272857] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:44.017563] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-08T19:26:44.114517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:26:44.149784] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:26:44.817529] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-08T19:26:44.846268] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:26:45.617551] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-08T19:26:46.197852] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:26:46.378401] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:26:46.417568] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-08T19:26:47.217531] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-08T19:26:47.352824] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:26:47.354302] [INFO ] [REMOTE ] HPI: Full fetch complete (13982 records). [2025-10-08T19:26:47.354374] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-08T19:26:47.761462] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-08T19:26:47.761594] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-08T19:26:47.762134] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-08T19:26:47.762269] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-08T19:26:47.763215] [DEBUG] [LOCAL ] HPI: Trimmed 13982 records to 10608 (keeping 200 days of data) [2025-10-08T19:26:47.841699] [DEBUG] [LOCAL ] HPI: Primary data saved (10608 records). [2025-10-08T19:26:47.841879] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-08T19:26:47.841974] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 28.5s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-10-08T19:26:48.022834] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-08T19:26:48.121668] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:26:48.128953] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:26:48.162452] [DEBUG] [LOCAL ] HQH: Loaded 25466 existing records from primary storage. [2025-10-08T19:26:48.162809] [INFO ] [MAIN ] HQH: Loaded 25466 existing records. [2025-10-08T19:26:48.406262] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:26:48.406571] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-08T19:26:48.406629] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-08T19:26:48.406897] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-08T19:26:48.406967] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-08T19:26:48.822672] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-08T19:26:48.903212] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:26:49.617566] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-08T19:26:49.824970] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:26:50.068378] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T19:26:50.417592] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-08T19:26:50.982810] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:26:51.217573] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-08T19:26:52.017599] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-08T19:26:52.061606] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T19:26:52.316256] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T19:26:52.817581] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-08T19:26:53.350551] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:26:53.564941] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:26:53.617504] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-08T19:26:54.413473] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T19:26:54.417492] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-08T19:26:55.217522] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-08T19:26:55.354863] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T19:26:56.017597] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-08T19:26:56.719816] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T19:26:56.817513] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-08T19:26:56.975667] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:26:57.617564] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-08T19:26:58.022498] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T19:26:58.417561] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-08T19:26:59.217544] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-08T19:26:59.312932] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:26:59.564924] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:27:00.017566] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-08T19:27:00.817516] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-08T19:27:01.184733] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-08T19:27:01.339013] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:27:01.617528] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-08T19:27:01.908186] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:27:02.397921] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T19:27:02.417544] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-08T19:27:03.217618] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-08T19:27:04.017531] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-08T19:27:04.257885] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:27:04.392117] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T19:27:04.636428] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T19:27:04.638132] [INFO ] [REMOTE ] HPS: Full fetch complete (15243 records). [2025-10-08T19:27:04.638223] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-08T19:27:04.821511] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-08T19:27:05.039843] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-08T19:27:05.039923] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-08T19:27:05.040258] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-08T19:27:05.040296] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-08T19:27:05.040863] [DEBUG] [LOCAL ] HPS: Trimmed 15243 records to 10270 (keeping 200 days of data) [2025-10-08T19:27:05.105107] [DEBUG] [LOCAL ] HPS: Primary data saved (10270 records). [2025-10-08T19:27:05.105270] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-08T19:27:05.105370] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPS took 22.5s. Estimated remaining: 3h 5m 55s. Rate: 7.1 symbols/min [2025-10-08T19:27:05.281340] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:05.299787] [DEBUG] [LOCAL ] HQL: Loaded 16555 existing records from primary storage. [2025-10-08T19:27:05.300038] [INFO ] [MAIN ] HQL: Loaded 16555 existing records. [2025-10-08T19:27:05.476668] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:05.476865] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-08T19:27:05.476911] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-08T19:27:05.477108] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-08T19:27:05.477165] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-08T19:27:05.622738] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-08T19:27:05.837677] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:06.417527] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-08T19:27:06.911372] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-08T19:27:07.045108] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:27:07.217582] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-08T19:27:07.642793] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T19:27:08.017608] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-08T19:27:08.218900] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T19:27:08.817594] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-08T19:27:09.617567] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-08T19:27:09.672374] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:27:10.389419] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:27:10.417494] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-08T19:27:10.501698] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:27:11.109810] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T19:27:11.217516] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-08T19:27:12.017562] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-08T19:27:12.211492] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:27:12.817550] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-08T19:27:13.539694] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T19:27:13.617495] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-08T19:27:13.657522] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:27:13.661401] [INFO ] [REMOTE ] HPP: Full fetch complete (73296 records). [2025-10-08T19:27:13.661502] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-08T19:27:14.062830] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-08T19:27:14.062918] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-08T19:27:14.063876] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-08T19:27:14.063939] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-08T19:27:14.065516] [DEBUG] [LOCAL ] HPP: Trimmed 73296 records to 51041 (keeping 200 days of data) [2025-10-08T19:27:14.372536] [DEBUG] [LOCAL ] HPP: Primary data saved (51041 records). [2025-10-08T19:27:14.372704] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-08T19:27:14.372806] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPP took 48.5s. Estimated remaining: 3h 5m 48s. Rate: 7.1 symbols/min [2025-10-08T19:27:14.421179] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-08T19:27:14.566138] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:14.613905] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T19:27:14.640028] [DEBUG] [LOCAL ] HR: Loaded 51972 existing records from primary storage. [2025-10-08T19:27:14.640402] [INFO ] [MAIN ] HR: Loaded 51972 existing records. [2025-10-08T19:27:14.833467] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:14.833723] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-08T19:27:14.833782] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-08T19:27:14.834280] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-08T19:27:14.834337] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-08T19:27:15.208383] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:15.217496] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-08T19:27:15.421047] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:27:16.017591] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-08T19:27:16.817581] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-08T19:27:16.943611] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:27:17.475500] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T19:27:17.479437] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-08T19:27:17.479548] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-08T19:27:17.618787] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-08T19:27:17.648379] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T19:27:17.897314] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-08T19:27:17.897437] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-08T19:27:17.898415] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-08T19:27:17.898481] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-08T19:27:17.900087] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 53668 (keeping 200 days of data) [2025-10-08T19:27:18.233915] [DEBUG] [LOCAL ] HPQ: Primary data saved (53668 records). [2025-10-08T19:27:18.234061] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-08T19:27:18.234148] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPQ took 49.5s. Estimated remaining: 3h 5m 34s. Rate: 7.1 symbols/min [2025-10-08T19:27:18.400958] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:18.426155] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-08T19:27:18.446318] [DEBUG] [LOCAL ] HRB: Loaded 48437 existing records from primary storage. [2025-10-08T19:27:18.446626] [INFO ] [MAIN ] HRB: Loaded 48437 existing records. [2025-10-08T19:27:18.632991] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:18.633175] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-08T19:27:18.633222] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-08T19:27:18.633551] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-08T19:27:18.633609] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-08T19:27:19.000197] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:19.217516] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-08T19:27:19.286394] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:27:19.348095] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:27:20.017556] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-08T19:27:20.369844] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:27:20.817556] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-08T19:27:21.617531] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-08T19:27:21.738361] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T19:27:21.765523] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T19:27:22.417516] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-08T19:27:22.746680] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:27:23.217581] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-08T19:27:23.410693] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T19:27:24.017615] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-08T19:27:24.752172] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:27:24.817545] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-08T19:27:24.892426] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:27:24.895237] [INFO ] [REMOTE ] HQH: Full fetch complete (37404 records). [2025-10-08T19:27:24.895333] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-08T19:27:25.275906] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-08T19:27:25.276013] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-08T19:27:25.276746] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-08T19:27:25.276810] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-08T19:27:25.277770] [DEBUG] [LOCAL ] HQH: Trimmed 37404 records to 25511 (keeping 200 days of data) [2025-10-08T19:27:25.446010] [DEBUG] [LOCAL ] HQH: Primary data saved (25511 records). [2025-10-08T19:27:25.446214] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-08T19:27:25.446330] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HQH took 37.6s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-08T19:27:25.616885] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:25.617730] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-08T19:27:25.654124] [DEBUG] [LOCAL ] HRI: Loaded 32653 existing records from primary storage. [2025-10-08T19:27:25.654454] [INFO ] [MAIN ] HRI: Loaded 32653 existing records. [2025-10-08T19:27:25.838156] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:25.838413] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-08T19:27:25.838462] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-08T19:27:25.839096] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-08T19:27:25.839159] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-08T19:27:26.212129] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:26.277582] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:27:26.417556] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-08T19:27:26.596790] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:27:27.217585] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-08T19:27:27.461787] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:27:28.017587] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-08T19:27:28.754749] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T19:27:28.771556] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T19:27:28.773769] [INFO ] [REMOTE ] HQL: Full fetch complete (25093 records). [2025-10-08T19:27:28.773848] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-08T19:27:28.827707] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-08T19:27:29.152027] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-08T19:27:29.152114] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-08T19:27:29.152730] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-08T19:27:29.152795] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-08T19:27:29.153511] [DEBUG] [LOCAL ] HQL: Trimmed 25093 records to 16673 (keeping 200 days of data) [2025-10-08T19:27:29.257828] [DEBUG] [LOCAL ] HQL: Primary data saved (16673 records). [2025-10-08T19:27:29.258001] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-08T19:27:29.258092] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQL took 24.2s. Estimated remaining: 3h 5m 9s. Rate: 7.1 symbols/min [2025-10-08T19:27:29.426708] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:29.477147] [DEBUG] [LOCAL ] HRL: Loaded 53093 existing records from primary storage. [2025-10-08T19:27:29.477472] [INFO ] [MAIN ] HRL: Loaded 53093 existing records. [2025-10-08T19:27:29.622833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-08T19:27:29.660217] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:29.660456] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-08T19:27:29.660502] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-08T19:27:29.660815] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-08T19:27:29.660874] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-08T19:27:30.023636] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:30.423014] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-08T19:27:30.448259] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:27:30.721112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T19:27:31.217617] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-08T19:27:31.874584] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T19:27:32.017567] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-08T19:27:32.820258] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-08T19:27:32.825964] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:27:33.617540] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-08T19:27:33.769518] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T19:27:34.289777] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T19:27:34.417525] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-08T19:27:35.013959] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:27:35.217552] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-08T19:27:35.843432] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:27:36.017557] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-08T19:27:36.724137] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:27:36.817557] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-08T19:27:37.297542] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:27:37.617589] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-08T19:27:38.379140] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:27:38.417503] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-08T19:27:39.219973] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-08T19:27:39.223264] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:27:39.815009] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T19:27:40.017564] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-08T19:27:40.600984] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:27:40.817585] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-08T19:27:41.335102] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:27:41.617607] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-08T19:27:42.417517] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-08T19:27:42.669053] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T19:27:43.217521] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-08T19:27:43.407396] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:27:43.773036] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:27:44.017597] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-08T19:27:44.135845] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:27:44.817603] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-08T19:27:45.617550] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-08T19:27:45.950751] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T19:27:46.033780] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T19:27:46.417590] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-08T19:27:47.217525] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-08T19:27:47.252130] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:27:47.735032] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:27:48.017571] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-08T19:27:48.817539] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-08T19:27:48.885782] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:27:49.342235] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T19:27:49.617545] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-08T19:27:50.422894] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-08T19:27:50.425893] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T19:27:51.017390] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T19:27:51.020145] [INFO ] [REMOTE ] HRI: Full fetch complete (46248 records). [2025-10-08T19:27:51.020239] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-08T19:27:51.230145] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-08T19:27:51.447266] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-08T19:27:51.447354] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-08T19:27:51.448122] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-08T19:27:51.448186] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-08T19:27:51.449464] [DEBUG] [LOCAL ] HRI: Trimmed 46248 records to 32605 (keeping 200 days of data) [2025-10-08T19:27:51.658182] [DEBUG] [LOCAL ] HRI: Primary data saved (32605 records). [2025-10-08T19:27:51.658325] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-08T19:27:51.658407] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HRI took 26.2s. Estimated remaining: 3h 5m 19s. Rate: 7.1 symbols/min [2025-10-08T19:27:51.828748] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:51.862705] [DEBUG] [LOCAL ] HRTG: Loaded 33749 existing records from primary storage. [2025-10-08T19:27:51.863003] [INFO ] [MAIN ] HRTG: Loaded 33749 existing records. [2025-10-08T19:27:52.043978] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:27:52.044043] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-08T19:27:52.045365] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-08T19:27:52.045490] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-08T19:27:52.045867] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-08T19:27:52.045973] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-08T19:27:52.193965] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:27:52.450736] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:52.541303] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T19:27:52.817540] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-08T19:27:53.617562] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-08T19:27:53.783960] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:27:54.357688] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:27:54.417537] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-08T19:27:55.217533] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-08T19:27:55.378145] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:27:55.383813] [INFO ] [REMOTE ] HR: Full fetch complete (74840 records). [2025-10-08T19:27:55.383986] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-08T19:27:55.789027] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-08T19:27:55.789125] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-08T19:27:55.790177] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-08T19:27:55.790242] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-08T19:27:55.794164] [DEBUG] [LOCAL ] HR: Trimmed 74840 records to 51997 (keeping 200 days of data) [2025-10-08T19:27:56.018053] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-08T19:27:56.125606] [DEBUG] [LOCAL ] HR: Primary data saved (51997 records). [2025-10-08T19:27:56.125774] [INFO ] [MAIN ] HR: Full history saved. [2025-10-08T19:27:56.125885] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HR took 41.8s. Estimated remaining: 3h 5m 5s. Rate: 7.1 symbols/min [2025-10-08T19:27:56.301916] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:27:56.302169] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-08T19:27:56.302241] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-08T19:27:56.302423] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-08T19:27:56.302497] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-08T19:27:56.302610] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-08T19:27:56.302691] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-08T19:27:56.516373] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T19:27:56.719479] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:27:56.764077] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:27:56.817491] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-08T19:27:57.137206] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:27:57.617558] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-08T19:27:58.419952] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-08T19:27:58.422343] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:27:59.197430] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:27:59.201103] [INFO ] [REMOTE ] HRB: Full fetch complete (69931 records). [2025-10-08T19:27:59.201201] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-08T19:27:59.222749] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-08T19:27:59.597542] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-08T19:27:59.597631] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-08T19:27:59.598622] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-08T19:27:59.598715] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-08T19:27:59.600172] [DEBUG] [LOCAL ] HRB: Trimmed 69931 records to 48391 (keeping 200 days of data) [2025-10-08T19:27:59.898522] [DEBUG] [LOCAL ] HRB: Primary data saved (48391 records). [2025-10-08T19:27:59.898697] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-08T19:27:59.898821] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRB took 41.7s. Estimated remaining: 3h 4m 51s. Rate: 7.1 symbols/min [2025-10-08T19:28:00.017564] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-08T19:28:00.078415] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:00.095040] [DEBUG] [LOCAL ] HSHP: Loaded 15141 existing records from primary storage. [2025-10-08T19:28:00.095310] [INFO ] [MAIN ] HSHP: Loaded 15141 existing records. [2025-10-08T19:28:00.295189] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:00.318682] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-08T19:28:00.321792] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-08T19:28:00.335102] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T19:28:00.348215] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T19:28:00.353512] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-08T19:28:00.353699] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-08T19:28:00.707847] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:00.817504] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-08T19:28:01.617580] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-08T19:28:01.655443] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:28:01.662971] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T19:28:01.668923] [INFO ] [REMOTE ] HRL: Full fetch complete (76686 records). [2025-10-08T19:28:01.669179] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-08T19:28:02.086551] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-08T19:28:02.086682] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-08T19:28:02.087774] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-08T19:28:02.087892] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-08T19:28:02.089702] [DEBUG] [LOCAL ] HRL: Trimmed 76686 records to 53097 (keeping 200 days of data) [2025-10-08T19:28:02.417539] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-08T19:28:02.441224] [DEBUG] [LOCAL ] HRL: Primary data saved (53097 records). [2025-10-08T19:28:02.441406] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-08T19:28:02.441538] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRL took 33.2s. Estimated remaining: 3h 4m 35s. Rate: 7.1 symbols/min [2025-10-08T19:28:02.615268] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:02.631857] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:28:02.685687] [DEBUG] [LOCAL ] HSY: Loaded 50359 existing records from primary storage. [2025-10-08T19:28:02.686076] [INFO ] [MAIN ] HSY: Loaded 50359 existing records. [2025-10-08T19:28:02.867714] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:02.867962] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-08T19:28:02.868012] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-08T19:28:02.869633] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-08T19:28:02.869719] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-08T19:28:03.222713] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-08T19:28:03.226690] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T19:28:03.246317] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:04.017573] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-08T19:28:04.820795] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-08T19:28:04.827879] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:28:05.617524] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-08T19:28:05.908770] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T19:28:05.996435] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T19:28:06.417567] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-08T19:28:07.217532] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-08T19:28:07.395289] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:28:08.017517] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-08T19:28:08.279847] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T19:28:08.339632] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T19:28:08.817547] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-08T19:28:09.617525] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-08T19:28:09.805270] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T19:28:10.417557] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-08T19:28:10.627870] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:28:10.814037] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T19:28:11.217561] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-08T19:28:11.735597] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:28:12.017554] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-08T19:28:12.780554] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:28:12.817517] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-08T19:28:12.827888] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:28:13.617618] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-08T19:28:14.417522] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-08T19:28:14.719492] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:28:14.968941] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T19:28:15.217560] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-08T19:28:15.599220] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:28:15.695202] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T19:28:16.017556] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-08T19:28:16.817535] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-08T19:28:17.467728] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:28:17.617634] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-08T19:28:17.820182] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:28:18.417572] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-08T19:28:19.138639] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:28:19.217494] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-08T19:28:19.376398] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:28:20.017707] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-08T19:28:20.820956] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-08T19:28:20.822526] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T19:28:20.871854] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T19:28:21.617550] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-08T19:28:22.250066] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T19:28:22.417575] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-08T19:28:23.217532] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-08T19:28:23.265472] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:28:24.017577] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-08T19:28:24.211080] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T19:28:24.334718] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T19:28:24.817516] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-08T19:28:25.363511] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:28:25.617551] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-08T19:28:26.303091] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:28:26.417511] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-08T19:28:27.220376] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-08T19:28:27.223712] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:28:28.017705] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-08T19:28:28.152805] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:28:28.589520] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T19:28:28.592974] [INFO ] [REMOTE ] HRTG: Full fetch complete (43382 records). [2025-10-08T19:28:28.593113] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-08T19:28:28.822666] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-08T19:28:29.008426] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-08T19:28:29.008542] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-08T19:28:29.009283] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-08T19:28:29.009346] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-08T19:28:29.010433] [DEBUG] [LOCAL ] HRTG: Trimmed 43382 records to 33817 (keeping 200 days of data) [2025-10-08T19:28:29.215763] [DEBUG] [LOCAL ] HRTG: Primary data saved (33817 records). [2025-10-08T19:28:29.215992] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-08T19:28:29.216169] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 37.6s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-08T19:28:29.391192] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:29.391449] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-08T19:28:29.391580] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-08T19:28:29.391846] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-08T19:28:29.391988] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-08T19:28:29.392120] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-08T19:28:29.392175] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-08T19:28:29.627824] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-08T19:28:29.786404] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:29.788855] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:28:30.417606] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-08T19:28:30.598875] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:28:30.600300] [INFO ] [REMOTE ] HSHP: Full fetch complete (23231 records). [2025-10-08T19:28:30.600375] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-08T19:28:30.919257] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T19:28:31.014479] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-08T19:28:31.014576] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-08T19:28:31.015105] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-08T19:28:31.015168] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-08T19:28:31.016037] [DEBUG] [LOCAL ] HSHP: Trimmed 23231 records to 15044 (keeping 200 days of data) [2025-10-08T19:28:31.106058] [DEBUG] [LOCAL ] HSHP: Primary data saved (15044 records). [2025-10-08T19:28:31.106239] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-08T19:28:31.106395] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HSHP took 31.2s. Estimated remaining: 3h 4m 33s. Rate: 7.1 symbols/min [2025-10-08T19:28:31.222684] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-08T19:28:31.281939] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:31.297269] [DEBUG] [LOCAL ] HTD: Loaded 13918 existing records from primary storage. [2025-10-08T19:28:31.297524] [INFO ] [MAIN ] HTD: Loaded 13918 existing records. [2025-10-08T19:28:31.474258] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:31.474491] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-08T19:28:31.474537] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-08T19:28:31.475159] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-08T19:28:31.475237] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-08T19:28:31.519735] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:28:31.558344] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-08T19:28:31.580257] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:28:31.580421] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-08T19:28:31.580574] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:28:31.581077] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-08T19:28:31.596985] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-08T19:28:31.602215] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-08T19:28:31.631624] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-08T19:28:31.668790] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HTB took 2.5s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-08T19:28:32.035187] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-08T19:28:32.035099] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:32.041394] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:32.043319] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-08T19:28:32.043576] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-08T19:28:32.043784] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-08T19:28:32.043884] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-08T19:28:32.044120] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-08T19:28:32.044206] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-08T19:28:32.336787] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:28:32.470069] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:32.817794] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-08T19:28:33.617631] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-08T19:28:33.800352] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:28:33.973103] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T19:28:34.288464] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:28:34.292499] [INFO ] [REMOTE ] HSY: Full fetch complete (73529 records). [2025-10-08T19:28:34.292679] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-08T19:28:34.433837] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-08T19:28:34.699283] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-08T19:28:34.699369] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-08T19:28:34.700377] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-08T19:28:34.700446] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-08T19:28:34.701969] [DEBUG] [LOCAL ] HSY: Trimmed 73529 records to 50345 (keeping 200 days of data) [2025-10-08T19:28:34.798034] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T19:28:35.032129] [DEBUG] [LOCAL ] HSY: Primary data saved (50345 records). [2025-10-08T19:28:35.032345] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-08T19:28:35.033342] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSY took 32.6s. Estimated remaining: 3h 4m 0s. Rate: 7.1 symbols/min [2025-10-08T19:28:35.201455] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:35.226421] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-08T19:28:35.250426] [DEBUG] [LOCAL ] HTGC: Loaded 47448 existing records from primary storage. [2025-10-08T19:28:35.250774] [INFO ] [MAIN ] HTGC: Loaded 47448 existing records. [2025-10-08T19:28:35.425555] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:35.425857] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-08T19:28:35.425917] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-08T19:28:35.427253] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-08T19:28:35.427314] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-08T19:28:35.599153] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T19:28:35.798712] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:36.017566] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-08T19:28:36.817574] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-08T19:28:37.130517] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-08T19:28:37.617547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-08T19:28:37.674532] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T19:28:38.042777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T19:28:38.417561] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-08T19:28:38.732607] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T19:28:39.217620] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-08T19:28:40.017559] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-08T19:28:40.051904] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:28:40.256319] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-08T19:28:40.817560] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-08T19:28:41.617593] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-08T19:28:41.671687] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T19:28:42.417555] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-08T19:28:42.650280] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-08T19:28:43.095446] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:28:43.099199] [INFO ] [REMOTE ] HSBC: Full fetch complete (73796 records). [2025-10-08T19:28:43.099297] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-08T19:28:43.222705] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-08T19:28:43.484516] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-08T19:28:43.484599] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-08T19:28:43.485510] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-08T19:28:43.485573] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-08T19:28:43.486960] [DEBUG] [LOCAL ] HSBC: Trimmed 73796 records to 50946 (keeping 200 days of data) [2025-10-08T19:28:43.554681] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T19:28:43.803473] [DEBUG] [LOCAL ] HSBC: Primary data saved (50946 records). [2025-10-08T19:28:43.803625] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-08T19:28:43.803739] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HSBC took 47.7s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-10-08T19:28:43.977499] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:44.009259] [DEBUG] [LOCAL ] HTH: Loaded 32391 existing records from primary storage. [2025-10-08T19:28:44.009546] [INFO ] [MAIN ] HTH: Loaded 32391 existing records. [2025-10-08T19:28:44.022637] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-08T19:28:44.190047] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:44.190281] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-08T19:28:44.190328] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-08T19:28:44.191282] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-08T19:28:44.191342] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-08T19:28:44.583724] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:44.817534] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-08T19:28:45.617529] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-08T19:28:45.667741] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T19:28:45.744605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T19:28:46.421450] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-08T19:28:46.422616] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:28:46.763132] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-08T19:28:47.217547] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-08T19:28:48.017583] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-08T19:28:48.817526] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-08T19:28:48.854852] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T19:28:49.617509] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-08T19:28:49.885751] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:28:50.417618] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-08T19:28:50.517027] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T19:28:51.217579] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-08T19:28:51.238058] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (4.02 seconds). [2025-10-08T19:28:51.239031] [INFO ] [REMOTE ] HTFC: Full fetch complete (846 records). [2025-10-08T19:28:51.239106] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-08T19:28:51.425202] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-08T19:28:51.425475] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:28:51.425712] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:28:51.425800] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-08T19:28:51.425964] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-08T19:28:51.426025] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-08T19:28:51.426131] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-08T19:28:51.426214] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTFC took 19.7s. Estimated remaining: 3h 3m 43s. Rate: 7.1 symbols/min [2025-10-08T19:28:51.601882] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:28:51.625729] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:28:51.666955] [DEBUG] [LOCAL ] HUBB: Loaded 36598 existing records from primary storage. [2025-10-08T19:28:51.667272] [INFO ] [MAIN ] HUBB: Loaded 36598 existing records. [2025-10-08T19:28:51.869686] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:28:51.871466] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-08T19:28:51.871269] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T19:28:51.871625] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-08T19:28:51.876818] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-08T19:28:51.876881] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-08T19:28:52.022764] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-08T19:28:52.225807] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:28:52.817508] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-08T19:28:53.049810] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T19:28:53.617510] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-08T19:28:53.669951] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:28:54.417588] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-08T19:28:54.765290] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:28:55.217596] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-08T19:28:55.377678] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:28:56.017573] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-08T19:28:56.733700] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:28:56.817606] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-08T19:28:57.620667] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-08T19:28:57.625236] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T19:28:58.064871] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:28:58.227067] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T19:28:58.417578] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-08T19:28:59.217534] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-08T19:29:00.009353] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:29:00.017893] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-08T19:29:00.027321] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T19:29:00.817534] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-08T19:29:01.530345] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:29:01.617503] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-08T19:29:02.422700] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-08T19:29:02.445262] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:29:02.964200] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:29:03.217545] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-08T19:29:03.787544] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:29:04.017554] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-08T19:29:04.481043] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:29:04.817682] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-08T19:29:05.297735] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:29:05.617576] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-08T19:29:06.142054] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:29:06.417527] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-08T19:29:07.109215] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T19:29:07.217553] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-08T19:29:07.476857] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:29:08.017562] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-08T19:29:08.797387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:29:08.817520] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-08T19:29:08.985108] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:29:08.987253] [INFO ] [REMOTE ] HTD: Full fetch complete (19149 records). [2025-10-08T19:29:08.987353] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-08T19:29:09.375766] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-08T19:29:09.375879] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-08T19:29:09.376691] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-08T19:29:09.376768] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-08T19:29:09.377558] [DEBUG] [LOCAL ] HTD: Trimmed 19149 records to 13925 (keeping 200 days of data) [2025-10-08T19:29:09.461763] [DEBUG] [LOCAL ] HTD: Primary data saved (13925 records). [2025-10-08T19:29:09.461905] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-08T19:29:09.462002] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTD took 38.4s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-08T19:29:09.625743] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-08T19:29:09.628281] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:09.668366] [DEBUG] [LOCAL ] HUBS: Loaded 39612 existing records from primary storage. [2025-10-08T19:29:09.668727] [INFO ] [MAIN ] HUBS: Loaded 39612 existing records. [2025-10-08T19:29:09.846989] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:09.847269] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-08T19:29:09.847324] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-08T19:29:09.848608] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-08T19:29:09.848696] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-08T19:29:10.203049] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:10.417516] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-08T19:29:10.574404] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:29:10.903135] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:29:11.217534] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-08T19:29:11.808947] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:29:12.017553] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-08T19:29:12.258744] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T19:29:12.817552] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-08T19:29:13.392007] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:29:13.617556] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-08T19:29:13.894056] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:29:14.417549] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-08T19:29:15.051614] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T19:29:15.217542] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-08T19:29:15.960928] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:29:16.017494] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-08T19:29:16.377978] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T19:29:16.382419] [INFO ] [REMOTE ] HTGC: Full fetch complete (68401 records). [2025-10-08T19:29:16.382541] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-08T19:29:16.823288] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-08T19:29:16.826731] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-08T19:29:16.827667] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-08T19:29:16.828595] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-08T19:29:16.828724] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-08T19:29:16.830326] [DEBUG] [LOCAL ] HTGC: Trimmed 68401 records to 47466 (keeping 200 days of data) [2025-10-08T19:29:17.127142] [DEBUG] [LOCAL ] HTGC: Primary data saved (47466 records). [2025-10-08T19:29:17.127263] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-08T19:29:17.127349] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTGC took 42.1s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-08T19:29:17.302372] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:17.348589] [DEBUG] [LOCAL ] HUM: Loaded 48999 existing records from primary storage. [2025-10-08T19:29:17.349079] [INFO ] [MAIN ] HUM: Loaded 48999 existing records. [2025-10-08T19:29:17.468302] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:29:17.564966] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:17.565194] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-08T19:29:17.565244] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-08T19:29:17.567000] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-08T19:29:17.567062] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-08T19:29:17.635440] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-08T19:29:17.925711] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:18.100126] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:29:18.417563] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-08T19:29:19.008684] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:29:19.217576] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-08T19:29:20.017531] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-08T19:29:20.190148] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:29:20.822885] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-08T19:29:20.828437] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T19:29:21.194225] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T19:29:21.197291] [INFO ] [REMOTE ] HTH: Full fetch complete (46816 records). [2025-10-08T19:29:21.197407] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-08T19:29:21.613344] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-08T19:29:21.613467] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-08T19:29:21.614593] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-08T19:29:21.614684] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-08T19:29:21.616225] [DEBUG] [LOCAL ] HTH: Trimmed 46816 records to 32417 (keeping 200 days of data) [2025-10-08T19:29:21.617849] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-08T19:29:21.827536] [DEBUG] [LOCAL ] HTH: Primary data saved (32417 records). [2025-10-08T19:29:21.827703] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-08T19:29:21.827798] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 38.0s. Estimated remaining: 3h 3m 24s. Rate: 7.1 symbols/min [2025-10-08T19:29:21.985360] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:29:22.053052] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:22.110204] [DEBUG] [LOCAL ] HUN: Loaded 53204 existing records from primary storage. [2025-10-08T19:29:22.110531] [INFO ] [MAIN ] HUN: Loaded 53204 existing records. [2025-10-08T19:29:22.288132] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:22.288367] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-08T19:29:22.288413] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-08T19:29:22.290157] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-08T19:29:22.290217] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-08T19:29:22.426519] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-08T19:29:22.639963] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:22.955783] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:29:23.217546] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-08T19:29:23.785438] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:29:23.788327] [INFO ] [REMOTE ] HUBB: Full fetch complete (53875 records). [2025-10-08T19:29:23.788420] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-08T19:29:24.028442] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-08T19:29:24.167530] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-08T19:29:24.167704] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-08T19:29:24.173189] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-08T19:29:24.173455] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-08T19:29:24.176004] [DEBUG] [LOCAL ] HUBB: Trimmed 53875 records to 36591 (keeping 200 days of data) [2025-10-08T19:29:24.409479] [DEBUG] [LOCAL ] HUBB: Primary data saved (36591 records). [2025-10-08T19:29:24.409637] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-08T19:29:24.409766] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 33.0s. Estimated remaining: 3h 3m 8s. Rate: 7.1 symbols/min [2025-10-08T19:29:24.582020] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:24.627244] [DEBUG] [LOCAL ] HUYA: Loaded 43908 existing records from primary storage. [2025-10-08T19:29:24.627588] [INFO ] [MAIN ] HUYA: Loaded 43908 existing records. [2025-10-08T19:29:24.818226] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-08T19:29:24.818056] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:24.819965] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-08T19:29:24.820128] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-08T19:29:24.821681] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-08T19:29:24.821923] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-08T19:29:25.150171] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T19:29:25.245027] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:25.493237] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T19:29:25.617592] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-08T19:29:26.377163] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:29:26.417561] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-08T19:29:27.161811] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:29:27.217544] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-08T19:29:28.017578] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-08T19:29:28.089680] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T19:29:28.694639] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T19:29:28.817566] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-08T19:29:29.416348] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:29:29.617562] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-08T19:29:30.280219] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:29:30.417545] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-08T19:29:31.217526] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-08T19:29:31.311435] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T19:29:32.017571] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-08T19:29:32.239548] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:29:32.758840] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:29:32.817513] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-08T19:29:33.048581] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T19:29:33.617619] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-08T19:29:34.417523] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-08T19:29:34.501485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T19:29:35.206152] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:29:35.217494] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-08T19:29:36.017522] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-08T19:29:36.400240] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T19:29:36.509072] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:29:36.817613] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-08T19:29:37.282678] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T19:29:37.617563] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-08T19:29:38.417540] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-08T19:29:38.484256] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:29:39.107394] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:29:39.217533] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-08T19:29:39.755035] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:29:40.017549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-08T19:29:40.782696] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T19:29:40.786900] [INFO ] [REMOTE ] HUBS: Full fetch complete (55921 records). [2025-10-08T19:29:40.787033] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-08T19:29:40.823106] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-08T19:29:41.191874] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-08T19:29:41.192201] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-08T19:29:41.193019] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-08T19:29:41.193083] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-08T19:29:41.194320] [DEBUG] [LOCAL ] HUBS: Trimmed 55921 records to 39673 (keeping 200 days of data) [2025-10-08T19:29:41.436843] [DEBUG] [LOCAL ] HUBS: Primary data saved (39673 records). [2025-10-08T19:29:41.437009] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-08T19:29:41.437097] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUBS took 32.0s. Estimated remaining: 3h 3m 10s. Rate: 7.1 symbols/min [2025-10-08T19:29:41.604431] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:41.620182] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-08T19:29:41.620554] [DEBUG] [LOCAL ] HVT: Loaded 15322 existing records from primary storage. [2025-10-08T19:29:41.621564] [INFO ] [MAIN ] HVT: Loaded 15322 existing records. [2025-10-08T19:29:41.810291] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:41.810830] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-08T19:29:41.810956] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-08T19:29:41.812079] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-08T19:29:41.812142] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-08T19:29:42.173072] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T19:29:42.238440] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:42.417576] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-08T19:29:42.617676] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:29:42.833611] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:29:43.217627] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-08T19:29:43.421989] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T19:29:44.017577] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-08T19:29:44.614510] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T19:29:44.817525] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-08T19:29:44.969164] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T19:29:45.617552] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-08T19:29:46.263557] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T19:29:46.417540] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-08T19:29:46.610854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:29:47.217574] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-08T19:29:48.023054] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-08T19:29:48.028955] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T19:29:48.782833] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:29:48.817503] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-08T19:29:49.617568] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-08T19:29:49.765035] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:29:50.269300] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:29:50.417510] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-08T19:29:50.453111] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T19:29:51.217549] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-08T19:29:52.017533] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-08T19:29:52.179510] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T19:29:52.817568] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-08T19:29:53.043310] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T19:29:53.306556] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T19:29:53.617550] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-08T19:29:53.874050] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:29:54.417572] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-08T19:29:55.217583] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-08T19:29:55.239465] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T19:29:55.243451] [INFO ] [REMOTE ] HUN: Full fetch complete (76726 records). [2025-10-08T19:29:55.243606] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-08T19:29:55.698623] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-08T19:29:55.698826] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-08T19:29:55.699969] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-08T19:29:55.700035] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-08T19:29:55.703632] [DEBUG] [LOCAL ] HUN: Trimmed 76726 records to 53202 (keeping 200 days of data) [2025-10-08T19:29:55.957277] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T19:29:56.020713] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-08T19:29:56.071419] [DEBUG] [LOCAL ] HUN: Primary data saved (53202 records). [2025-10-08T19:29:56.071543] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-08T19:29:56.071637] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUN took 34.2s. Estimated remaining: 3h 3m 10s. Rate: 7.1 symbols/min [2025-10-08T19:29:56.261228] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:56.313401] [DEBUG] [LOCAL ] HWM: Loaded 52904 existing records from primary storage. [2025-10-08T19:29:56.313754] [INFO ] [MAIN ] HWM: Loaded 52904 existing records. [2025-10-08T19:29:56.502920] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:56.503150] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-08T19:29:56.503247] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-08T19:29:56.503492] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-08T19:29:56.503548] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-08T19:29:56.808222] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:29:56.818919] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-08T19:29:56.882279] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:56.882442] [INFO ] [REMOTE ] HUM: Full fetch complete (70990 records). [2025-10-08T19:29:56.882606] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-08T19:29:57.249027] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T19:29:57.264596] [INFO ] [REMOTE ] HUYA: Full fetch complete (63778 records). [2025-10-08T19:29:57.282085] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-08T19:29:57.282233] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-08T19:29:57.282445] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-08T19:29:57.283473] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-08T19:29:57.283564] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-08T19:29:57.390209] [DEBUG] [LOCAL ] HUM: Trimmed 70990 records to 49032 (keeping 200 days of data) [2025-10-08T19:29:57.624732] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-08T19:29:57.906790] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-08T19:29:57.912139] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-08T19:29:57.913226] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-08T19:29:57.925206] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-08T19:29:57.934951] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T19:29:57.945230] [DEBUG] [LOCAL ] HUYA: Trimmed 63778 records to 43890 (keeping 200 days of data) [2025-10-08T19:29:58.271001] [DEBUG] [LOCAL ] HUYA: Primary data saved (43890 records). [2025-10-08T19:29:58.271697] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-08T19:29:58.271856] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUYA took 33.9s. Estimated remaining: 3h 2m 54s. Rate: 7.1 symbols/min [2025-10-08T19:29:58.347036] [DEBUG] [LOCAL ] HUM: Primary data saved (49032 records). [2025-10-08T19:29:58.369720] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-08T19:29:58.370942] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUM took 41.2s. Estimated remaining: 3h 2m 35s. Rate: 7.1 symbols/min [2025-10-08T19:29:58.422082] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-08T19:29:58.586343] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:58.632075] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:29:58.642935] [DEBUG] [LOCAL ] HY: Loaded 10004 existing records from primary storage. [2025-10-08T19:29:58.643267] [INFO ] [MAIN ] HY: Loaded 10004 existing records. [2025-10-08T19:29:58.835640] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:58.848302] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-08T19:29:58.848386] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-08T19:29:58.849153] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-08T19:29:58.849112] [DEBUG] [LOCAL ] HXL: Loaded 45917 existing records from primary storage. [2025-10-08T19:29:58.849273] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-08T19:29:58.875882] [INFO ] [MAIN ] HXL: Loaded 45917 existing records. [2025-10-08T19:29:59.269561] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:29:59.299036] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-08T19:29:59.326601] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-08T19:29:59.344014] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-08T19:29:59.364237] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-08T19:29:59.576040] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:29:59.576769] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-08T19:29:59.801094] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-08T19:29:59.865133] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T19:29:59.900106] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:00.017554] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-08T19:30:00.440349] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T19:30:00.817550] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-08T19:30:01.341782] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:30:01.617703] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-08T19:30:02.417519] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-08T19:30:02.834931] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-08T19:30:03.170920] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:30:03.217533] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-08T19:30:03.275785] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:30:03.819819] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:30:04.017560] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-08T19:30:04.817616] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-08T19:30:05.481812] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:30:05.496672] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:30:05.617540] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-08T19:30:06.417589] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-08T19:30:07.062499] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T19:30:07.113376] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:30:07.217547] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-08T19:30:08.017530] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-08T19:30:08.099805] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T19:30:08.817535] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-08T19:30:09.617520] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-08T19:30:09.794617] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:30:10.319533] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T19:30:10.382506] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:30:10.417504] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-08T19:30:11.217611] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-08T19:30:11.817440] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:30:11.982343] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:30:12.017510] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-08T19:30:12.565206] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T19:30:12.817554] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-08T19:30:13.617576] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-08T19:30:13.670048] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:30:14.417558] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-08T19:30:14.445840] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T19:30:15.217587] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-08T19:30:16.017526] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-08T19:30:16.080486] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T19:30:16.123358] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T19:30:16.817544] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-08T19:30:17.617517] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-08T19:30:17.758128] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:30:18.292887] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T19:30:18.417516] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-08T19:30:18.458020] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:30:19.217559] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-08T19:30:19.228033] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:30:19.230290] [INFO ] [REMOTE ] HVT: Full fetch complete (23274 records). [2025-10-08T19:30:19.230470] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-08T19:30:19.634296] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-08T19:30:19.634418] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-08T19:30:19.635394] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-08T19:30:19.635523] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-08T19:30:19.637571] [DEBUG] [LOCAL ] HVT: Trimmed 23274 records to 15297 (keeping 200 days of data) [2025-10-08T19:30:19.737559] [DEBUG] [LOCAL ] HVT: Primary data saved (15297 records). [2025-10-08T19:30:19.737742] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-08T19:30:19.737853] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HVT took 38.3s. Estimated remaining: 3h 2m 42s. Rate: 7.1 symbols/min [2025-10-08T19:30:19.903965] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:19.904146] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-08T19:30:19.904184] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-08T19:30:19.904297] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-08T19:30:19.904337] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-08T19:30:19.904378] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-08T19:30:19.904410] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-08T19:30:20.022743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-08T19:30:20.258948] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:20.697773] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T19:30:20.817571] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-08T19:30:21.047992] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T19:30:21.617547] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-08T19:30:22.057749] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:30:22.417584] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-08T19:30:23.217599] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-08T19:30:23.475288] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-08T19:30:23.640631] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:30:23.661415] [INFO ] [REMOTE ] HY: Full fetch complete (15137 records). [2025-10-08T19:30:23.662860] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-08T19:30:23.665562] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T19:30:24.019332] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-08T19:30:24.050145] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-08T19:30:24.050264] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-08T19:30:24.050778] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-08T19:30:24.050843] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-08T19:30:24.051548] [DEBUG] [LOCAL ] HY: Trimmed 15137 records to 9989 (keeping 200 days of data) [2025-10-08T19:30:24.117005] [DEBUG] [LOCAL ] HY: Primary data saved (9989 records). [2025-10-08T19:30:24.117150] [INFO ] [MAIN ] HY: Full history saved. [2025-10-08T19:30:24.117289] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HY took 25.7s. Estimated remaining: 3h 2m 29s. Rate: 7.1 symbols/min [2025-10-08T19:30:24.285985] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:24.286228] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-08T19:30:24.286279] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-08T19:30:24.286424] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-08T19:30:24.286469] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-08T19:30:24.286512] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-08T19:30:24.286545] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-08T19:30:24.365731] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T19:30:24.647593] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:24.817607] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-08T19:30:25.101054] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-08T19:30:25.617579] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-08T19:30:25.883847] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-08T19:30:26.417592] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-08T19:30:26.740583] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T19:30:27.217563] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-08T19:30:28.017575] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-08T19:30:28.238692] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-08T19:30:28.736174] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:30:28.817563] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-08T19:30:29.147052] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-08T19:30:29.617563] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-08T19:30:29.971676] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T19:30:30.417557] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-08T19:30:31.217565] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-08T19:30:31.776915] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:30:31.780841] [INFO ] [REMOTE ] HXL: Full fetch complete (66280 records). [2025-10-08T19:30:31.780997] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-08T19:30:32.022771] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-08T19:30:32.184031] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-08T19:30:32.184153] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-08T19:30:32.185135] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-08T19:30:32.185199] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-08T19:30:32.186772] [DEBUG] [LOCAL ] HXL: Trimmed 66280 records to 45893 (keeping 200 days of data) [2025-10-08T19:30:32.423462] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T19:30:32.473309] [DEBUG] [LOCAL ] HXL: Primary data saved (45893 records). [2025-10-08T19:30:32.473463] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-08T19:30:32.473565] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HXL took 34.2s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-08T19:30:32.647210] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:32.659911] [DEBUG] [LOCAL ] HYI: Loaded 9882 existing records from primary storage. [2025-10-08T19:30:32.660182] [INFO ] [MAIN ] HYI: Loaded 9882 existing records. [2025-10-08T19:30:32.821699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-08T19:30:32.852848] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:32.853956] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-08T19:30:32.854007] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-08T19:30:32.854183] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-08T19:30:32.854240] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-08T19:30:33.256962] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:33.313717] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T19:30:33.380463] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T19:30:33.617560] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-08T19:30:34.166585] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T19:30:34.417578] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-08T19:30:34.650320] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-08T19:30:35.217612] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-08T19:30:35.439865] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-08T19:30:36.017627] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-08T19:30:36.601538] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:30:36.817557] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-08T19:30:37.359359] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T19:30:37.617629] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-08T19:30:37.917761] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-08T19:30:38.417614] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-08T19:30:38.720016] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T19:30:38.720797] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-10-08T19:30:38.720871] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-08T19:30:38.721234] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-03) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T19:30:38.721347] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:30:38.721391] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:30:38.721443] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-08T19:30:38.721550] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-08T19:30:38.721621] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-08T19:30:38.721733] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-08T19:30:38.721814] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 19.0s. Estimated remaining: 3h 2m 9s. Rate: 7.1 symbols/min [2025-10-08T19:30:38.897872] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:38.935526] [DEBUG] [LOCAL ] HYT: Loaded 33699 existing records from primary storage. [2025-10-08T19:30:38.935876] [INFO ] [MAIN ] HYT: Loaded 33699 existing records. [2025-10-08T19:30:39.171148] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:39.171428] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-08T19:30:39.171484] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-08T19:30:39.172006] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-08T19:30:39.172066] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-08T19:30:39.222718] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-08T19:30:39.542344] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:39.545880] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-08T19:30:40.017567] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-08T19:30:40.318466] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:30:40.817549] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-08T19:30:41.617549] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-08T19:30:42.417558] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-08T19:30:42.677341] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:30:42.749232] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-08T19:30:42.831611] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T19:30:43.217558] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-08T19:30:44.017586] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-08T19:30:44.125929] [DEBUG] [REMOTE ] HYT: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-08T19:30:44.126232] [WARN ] [REMOTE ] HYT: No data returned for month 2025-01 [2025-10-08T19:30:44.126322] [FATAL] [REMOTE ] HYT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:30:44.126442] [FATAL] [MAIN ] HYT: Failed to fetch primary data. [2025-10-08T19:30:44.126510] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:30:44.126580] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-08T19:30:44.126665] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-08T19:30:44.126723] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-10-08T19:30:44.126963] [DEBUG] [LOCAL ] HYT: Deleted derivative data file. [2025-10-08T19:30:44.127048] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYT took 5.4s. Estimated remaining: 3h 1m 57s. Rate: 7.1 symbols/min [2025-10-08T19:30:44.295714] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:44.301186] [DEBUG] [LOCAL ] HYTR: Loaded 3134 existing records from primary storage. [2025-10-08T19:30:44.301375] [INFO ] [MAIN ] HYTR: Loaded 3134 existing records. [2025-10-08T19:30:44.475791] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:44.476024] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-08T19:30:44.476070] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-08T19:30:44.476229] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-08T19:30:44.476285] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-08T19:30:44.823036] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-08T19:30:44.827876] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:44.956779] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:30:45.417478] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T19:30:45.617587] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-08T19:30:46.007289] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-08T19:30:46.417591] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-08T19:30:46.746729] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T19:30:47.217572] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-08T19:30:47.647233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T19:30:48.017563] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-08T19:30:48.396429] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-08T19:30:48.817577] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-08T19:30:49.617596] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-08T19:30:49.898268] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-08T19:30:50.417537] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-08T19:30:50.507599] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:30:51.049715] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-08T19:30:51.217570] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-08T19:30:52.017577] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-08T19:30:52.540006] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T19:30:52.774774] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T19:30:52.778719] [INFO ] [REMOTE ] HWM: Full fetch complete (76572 records). [2025-10-08T19:30:52.778867] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-08T19:30:52.822680] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-08T19:30:53.198739] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-08T19:30:53.198845] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-08T19:30:53.200260] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-08T19:30:53.200325] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-08T19:30:53.201878] [DEBUG] [LOCAL ] HWM: Trimmed 76572 records to 52895 (keeping 200 days of data) [2025-10-08T19:30:53.306684] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T19:30:53.549207] [DEBUG] [LOCAL ] HWM: Primary data saved (52895 records). [2025-10-08T19:30:53.549364] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-08T19:30:53.549471] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HWM took 57.5s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-08T19:30:53.622680] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-08T19:30:53.720581] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:53.748526] [DEBUG] [LOCAL ] HZO: Loaded 29133 existing records from primary storage. [2025-10-08T19:30:53.748862] [INFO ] [MAIN ] HZO: Loaded 29133 existing records. [2025-10-08T19:30:53.924942] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:30:53.925128] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-08T19:30:53.925173] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-08T19:30:53.925414] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-08T19:30:53.925472] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-08T19:30:54.033936] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T19:30:54.291990] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:30:54.417598] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-08T19:30:55.124464] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:30:55.217585] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-08T19:30:55.738351] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:30:56.017567] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-08T19:30:56.817529] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-08T19:30:56.859280] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T19:30:57.377363] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T19:30:57.617550] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-08T19:30:58.417578] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-08T19:30:58.840183] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T19:30:59.024135] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:30:59.217603] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-08T19:30:59.624043] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T19:30:59.624753] [INFO ] [REMOTE ] HYBX: Full fetch complete (729 records). [2025-10-08T19:30:59.624822] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-08T19:30:59.799672] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-08T19:30:59.799865] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:30:59.799970] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:30:59.800043] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-08T19:30:59.800121] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-08T19:30:59.800185] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-08T19:30:59.800240] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-08T19:30:59.800318] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYBX took 35.7s. Estimated remaining: 3h 1m 39s. Rate: 7.1 symbols/min [2025-10-08T19:30:59.972585] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:30:59.981353] [DEBUG] [LOCAL ] IAE: Loaded 6054 existing records from primary storage. [2025-10-08T19:30:59.981582] [INFO ] [MAIN ] IAE: Loaded 6054 existing records. [2025-10-08T19:31:00.022850] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-08T19:31:00.161121] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:00.161360] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-08T19:31:00.161408] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-08T19:31:00.161568] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-08T19:31:00.161627] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-08T19:31:00.546168] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:00.817539] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-08T19:31:01.256259] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:31:01.490019] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T19:31:01.617569] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-08T19:31:02.417570] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-08T19:31:02.852560] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T19:31:03.036019] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T19:31:03.217549] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-08T19:31:04.017559] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-08T19:31:04.549539] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:31:04.786706] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:31:04.817605] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-08T19:31:05.516799] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T19:31:05.617588] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-08T19:31:06.374280] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:31:06.417499] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-08T19:31:07.217540] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-08T19:31:07.227948] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:31:08.017519] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-08T19:31:08.418604] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T19:31:08.567866] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:31:08.570058] [INFO ] [REMOTE ] HYI: Full fetch complete (13934 records). [2025-10-08T19:31:08.570136] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-08T19:31:08.822679] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-08T19:31:08.985542] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-08T19:31:08.985681] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-08T19:31:08.986293] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-08T19:31:08.986379] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-08T19:31:08.987329] [DEBUG] [LOCAL ] HYI: Trimmed 13934 records to 9914 (keeping 200 days of data) [2025-10-08T19:31:09.051399] [DEBUG] [LOCAL ] HYI: Primary data saved (9914 records). [2025-10-08T19:31:09.051543] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-08T19:31:09.051686] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYI took 36.6s. Estimated remaining: 3h 1m 32s. Rate: 7.1 symbols/min [2025-10-08T19:31:09.537897] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:31:09.617518] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-08T19:31:10.006741] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-08T19:31:10.417543] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-08T19:31:11.217561] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-08T19:31:11.420785] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T19:31:11.589844] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-08T19:31:12.017516] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-08T19:31:12.716438] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T19:31:12.817552] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-08T19:31:13.617560] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-08T19:31:13.883871] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T19:31:14.213181] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:31:14.417596] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-08T19:31:14.801829] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T19:31:15.217567] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-08T19:31:15.568414] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-08T19:31:16.017580] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-08T19:31:16.817553] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-08T19:31:17.292920] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:31:17.306849] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T19:31:17.617717] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-08T19:31:18.273547] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T19:31:18.417536] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-08T19:31:19.177181] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:31:19.217546] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-08T19:31:19.725589] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T19:31:19.726767] [INFO ] [REMOTE ] IAE: Full fetch complete (8754 records). [2025-10-08T19:31:19.726838] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-08T19:31:20.022757] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-08T19:31:20.090894] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-08T19:31:20.091004] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-08T19:31:20.091273] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-08T19:31:20.091382] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-08T19:31:20.092031] [DEBUG] [LOCAL ] IAE: Trimmed 8754 records to 6125 (keeping 200 days of data) [2025-10-08T19:31:20.129389] [DEBUG] [LOCAL ] IAE: Primary data saved (6125 records). [2025-10-08T19:31:20.129530] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-08T19:31:20.129617] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. IAE took 20.3s. Estimated remaining: 3h 1m 27s. Rate: 7.1 symbols/min [2025-10-08T19:31:20.817558] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-08T19:31:21.287113] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:31:21.300225] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-08T19:31:21.617561] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-08T19:31:22.417562] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-08T19:31:22.808002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T19:31:22.808962] [INFO ] [REMOTE ] HYTR: Full fetch complete (4598 records). [2025-10-08T19:31:22.809033] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-08T19:31:22.894637] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:31:22.920778] [INFO ] [REMOTE ] HZO: Full fetch complete (41086 records). [2025-10-08T19:31:22.931490] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-08T19:31:23.511562] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-08T19:31:23.521867] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-08T19:31:23.522438] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-08T19:31:23.523214] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-08T19:31:23.575228] [DEBUG] [LOCAL ] HYTR: Trimmed 4598 records to 3113 (keeping 200 days of data) [2025-10-08T19:31:23.632112] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-08T19:31:23.633210] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-08T19:31:23.634378] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-08T19:31:23.634823] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-08T19:31:23.638454] [DEBUG] [LOCAL ] HZO: Trimmed 41086 records to 29050 (keeping 200 days of data) [2025-10-08T19:31:23.640755] [DEBUG] [LOCAL ] HYTR: Primary data saved (3113 records). [2025-10-08T19:31:23.640945] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-08T19:31:23.641057] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYTR took 39.5s. Estimated remaining: 3h 1m 12s. Rate: 7.1 symbols/min [2025-10-08T19:31:23.811828] [DEBUG] [LOCAL ] HZO: Primary data saved (29050 records). [2025-10-08T19:31:23.811986] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-08T19:31:23.812121] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 30.3s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-08T19:31:24.451016] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.494053] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.559509] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.561537] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:24.625627] [DEBUG] [LOCAL ] IBP: Loaded 28806 existing records from primary storage. [2025-10-08T19:31:24.626441] [INFO ] [MAIN ] IBP: Loaded 28806 existing records. [2025-10-08T19:31:24.698338] [DEBUG] [LOCAL ] IBN: Loaded 52857 existing records from primary storage. [2025-10-08T19:31:24.750026] [INFO ] [MAIN ] IBN: Loaded 52857 existing records. [2025-10-08T19:31:24.816185] [DEBUG] [LOCAL ] IAG: Loaded 53461 existing records from primary storage. [2025-10-08T19:31:24.822572] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-08T19:31:24.837852] [INFO ] [MAIN ] IBM: Loaded 53631 existing records. [2025-10-08T19:31:24.838448] [INFO ] [MAIN ] IAG: Loaded 53461 existing records. [2025-10-08T19:31:25.055371] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.140047] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.170048] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-08T19:31:25.190959] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-08T19:31:25.227177] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-08T19:31:25.394159] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.474851] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.541688] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-08T19:31:25.498397] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.581933] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.582039] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-08T19:31:25.582082] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-08T19:31:25.581731] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:25.582203] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-08T19:31:25.582842] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-08T19:31:25.593311] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-08T19:31:25.582777] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-08T19:31:25.644557] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-08T19:31:25.756213] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-08T19:31:25.827867] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-08T19:31:26.552055] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.583322] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-08T19:31:26.896663] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.912805] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-08T19:31:26.961070] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:26.961748] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-08T19:31:27.043016] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:27.043342] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-08T19:31:27.872576] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:31:27.878788] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-08T19:31:28.653522] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:31:28.665353] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-08T19:31:28.761965] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:31:28.772615] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-08T19:31:28.788736] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:31:28.817519] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-08T19:31:29.343751] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-08T19:31:29.617608] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-08T19:31:29.694814] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T19:31:30.216667] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:31:30.285409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T19:31:30.417500] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-08T19:31:31.217586] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-08T19:31:31.524795] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T19:31:31.849822] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T19:31:32.017550] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-08T19:31:32.817521] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-08T19:31:33.079900] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:31:33.131325] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T19:31:33.617552] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-08T19:31:34.417513] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-08T19:31:34.910808] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-08T19:31:35.217571] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-08T19:31:35.463265] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T19:31:35.559751] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:31:36.017588] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-08T19:31:36.817603] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-08T19:31:37.319182] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T19:31:37.440774] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T19:31:37.617587] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-08T19:31:38.295809] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:31:38.417498] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-08T19:31:38.586787] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:31:39.217515] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-08T19:31:40.017534] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-08T19:31:40.320850] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T19:31:40.392156] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:31:40.817595] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-08T19:31:41.563346] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:31:41.617503] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-08T19:31:42.302847] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T19:31:42.417570] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-08T19:31:43.217518] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-08T19:31:43.375938] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:31:44.017613] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-08T19:31:44.456874] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T19:31:44.817620] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-08T19:31:45.047233] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T19:31:45.367340] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T19:31:45.617555] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-08T19:31:46.417572] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-08T19:31:46.953525] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T19:31:47.217541] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-08T19:31:47.323545] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:31:48.017619] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-08T19:31:48.239271] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T19:31:48.817576] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-08T19:31:48.986229] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:31:49.017292] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:31:49.617554] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-08T19:31:50.417576] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-08T19:31:50.666489] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T19:31:50.668806] [INFO ] [REMOTE ] IBP: Full fetch complete (41138 records). [2025-10-08T19:31:50.668891] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-08T19:31:51.026814] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-08T19:31:51.112508] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-08T19:31:51.112595] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-08T19:31:51.113240] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-08T19:31:51.113300] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-08T19:31:51.114144] [DEBUG] [LOCAL ] IBP: Trimmed 41138 records to 28771 (keeping 200 days of data) [2025-10-08T19:31:51.219627] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-08T19:31:51.300333] [DEBUG] [LOCAL ] IBP: Primary data saved (28771 records). [2025-10-08T19:31:51.300472] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-08T19:31:51.300565] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 27.5s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-08T19:31:51.470336] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:51.505778] [DEBUG] [LOCAL ] IBTA: Loaded 37273 existing records from primary storage. [2025-10-08T19:31:51.506071] [INFO ] [MAIN ] IBTA: Loaded 37273 existing records. [2025-10-08T19:31:51.685491] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:51.685914] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-08T19:31:51.685964] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-08T19:31:51.686183] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-08T19:31:51.686240] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-08T19:31:52.039448] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-08T19:31:52.095329] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:52.168568] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:31:52.817572] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-08T19:31:53.441484] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-08T19:31:53.617506] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-08T19:31:54.070474] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T19:31:54.163178] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:31:54.417547] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-08T19:31:55.217548] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-08T19:31:55.615266] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T19:31:56.017522] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-08T19:31:56.161817] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T19:31:56.165830] [INFO ] [REMOTE ] IBN: Full fetch complete (76332 records). [2025-10-08T19:31:56.165960] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-08T19:31:56.571821] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-08T19:31:56.571904] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-08T19:31:56.572843] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-08T19:31:56.572913] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-08T19:31:56.574335] [DEBUG] [LOCAL ] IBN: Trimmed 76332 records to 52860 (keeping 200 days of data) [2025-10-08T19:31:56.728995] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:31:56.840599] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-08T19:31:56.967875] [DEBUG] [LOCAL ] IBN: Primary data saved (52860 records). [2025-10-08T19:31:56.968047] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-08T19:31:56.968176] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 33.1s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-08T19:31:57.101683] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:31:57.184251] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:57.236200] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-08T19:31:57.236536] [INFO ] [MAIN ] ICE: Loaded 53011 existing records. [2025-10-08T19:31:57.419602] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:57.419889] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-08T19:31:57.419939] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-08T19:31:57.420177] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-08T19:31:57.420234] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-08T19:31:57.625637] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-08T19:31:57.785137] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:31:58.417572] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-08T19:31:58.549392] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T19:31:58.556735] [INFO ] [REMOTE ] IAG: Full fetch complete (77275 records). [2025-10-08T19:31:58.556947] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-08T19:31:58.998693] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-08T19:31:58.998849] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-08T19:31:58.999840] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-08T19:31:58.999993] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-08T19:31:59.015478] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:31:59.021796] [DEBUG] [LOCAL ] IAG: Trimmed 77275 records to 53473 (keeping 200 days of data) [2025-10-08T19:31:59.218360] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-08T19:31:59.336358] [DEBUG] [LOCAL ] IAG: Primary data saved (53473 records). [2025-10-08T19:31:59.336515] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-08T19:31:59.336604] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IAG took 35.5s. Estimated remaining: 3h 0m 41s. Rate: 7.1 symbols/min [2025-10-08T19:31:59.502011] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:31:59.537687] [DEBUG] [LOCAL ] ICL: Loaded 38342 existing records from primary storage. [2025-10-08T19:31:59.537991] [INFO ] [MAIN ] ICL: Loaded 38342 existing records. [2025-10-08T19:31:59.710835] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:31:59.711074] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-08T19:31:59.711121] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-08T19:31:59.711361] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-08T19:31:59.711417] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-08T19:32:00.022724] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-08T19:32:00.063987] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:00.437397] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T19:32:00.817577] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-08T19:32:01.175312] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-08T19:32:01.628873] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-08T19:32:01.633045] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:32:01.797083] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T19:32:02.417550] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-08T19:32:02.845613] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T19:32:03.217593] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-08T19:32:03.847148] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:32:04.017526] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-08T19:32:04.809567] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T19:32:04.819100] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-08T19:32:05.420810] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:32:05.617550] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-08T19:32:06.417521] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-08T19:32:06.805444] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:32:07.217558] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-08T19:32:07.333423] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-08T19:32:07.338155] [INFO ] [REMOTE ] IBM: Full fetch complete (77623 records). [2025-10-08T19:32:07.338300] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-08T19:32:07.738590] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T19:32:07.786111] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-08T19:32:07.786554] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-08T19:32:07.787577] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-08T19:32:07.787665] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-08T19:32:07.789406] [DEBUG] [LOCAL ] IBM: Trimmed 77623 records to 53631 (keeping 200 days of data) [2025-10-08T19:32:08.024725] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-08T19:32:08.149342] [DEBUG] [LOCAL ] IBM: Primary data saved (53631 records). [2025-10-08T19:32:08.149514] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-08T19:32:08.150343] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 44.3s. Estimated remaining: 3h 0m 33s. Rate: 7.1 symbols/min [2025-10-08T19:32:08.339978] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:08.378865] [DEBUG] [LOCAL ] IDA: Loaded 32522 existing records from primary storage. [2025-10-08T19:32:08.379194] [INFO ] [MAIN ] IDA: Loaded 32522 existing records. [2025-10-08T19:32:08.565573] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:08.565897] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-08T19:32:08.565945] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-08T19:32:08.566166] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-08T19:32:08.566251] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-08T19:32:08.823013] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-08T19:32:08.978179] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T19:32:08.976495] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:09.388713] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:32:09.617564] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-08T19:32:09.935285] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:32:10.417562] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-08T19:32:10.856020] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T19:32:11.217562] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-08T19:32:11.832587] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:32:12.017553] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-08T19:32:12.659871] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T19:32:12.817507] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-08T19:32:13.293808] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:32:13.617569] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-08T19:32:14.233856] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T19:32:14.417573] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-08T19:32:14.776094] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T19:32:15.217583] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-08T19:32:16.017509] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-08T19:32:16.159218] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:32:16.711220] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:32:16.817600] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-08T19:32:17.494743] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T19:32:17.617549] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-08T19:32:18.124054] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:32:18.417515] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-08T19:32:19.217517] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-08T19:32:19.418847] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:32:20.017612] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-08T19:32:20.057477] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T19:32:20.317560] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:32:20.817629] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-08T19:32:21.460586] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:32:21.617525] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-08T19:32:21.663816] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T19:32:22.417606] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-08T19:32:23.083543] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T19:32:23.217556] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-08T19:32:23.379262] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:32:23.382079] [INFO ] [REMOTE ] IBTA: Full fetch complete (50972 records). [2025-10-08T19:32:23.382187] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-08T19:32:23.773070] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-08T19:32:23.773152] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-08T19:32:23.773976] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-08T19:32:23.774045] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-08T19:32:23.775113] [DEBUG] [LOCAL ] IBTA: Trimmed 50972 records to 37145 (keeping 200 days of data) [2025-10-08T19:32:23.990271] [DEBUG] [LOCAL ] IBTA: Primary data saved (37145 records). [2025-10-08T19:32:23.990433] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-08T19:32:23.990536] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IBTA took 32.7s. Estimated remaining: 3h 0m 33s. Rate: 7.1 symbols/min [2025-10-08T19:32:24.022616] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-08T19:32:24.165306] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:24.176284] [DEBUG] [LOCAL ] IDE: Loaded 8835 existing records from primary storage. [2025-10-08T19:32:24.176507] [INFO ] [MAIN ] IDE: Loaded 8835 existing records. [2025-10-08T19:32:24.363568] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:24.363947] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-08T19:32:24.364053] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-08T19:32:24.364263] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-08T19:32:24.364324] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-08T19:32:24.477350] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T19:32:24.507574] [INFO ] [REMOTE ] ICL: Full fetch complete (55874 records). [2025-10-08T19:32:24.531443] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-08T19:32:24.828342] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-08T19:32:24.895568] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:25.138446] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-08T19:32:25.138597] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-08T19:32:25.139514] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-08T19:32:25.139637] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-08T19:32:25.141176] [DEBUG] [LOCAL ] ICL: Trimmed 55874 records to 38375 (keeping 200 days of data) [2025-10-08T19:32:25.353086] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T19:32:25.387777] [DEBUG] [LOCAL ] ICL: Primary data saved (38375 records). [2025-10-08T19:32:25.387945] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-08T19:32:25.388037] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 26.1s. Estimated remaining: 3h 0m 17s. Rate: 7.1 symbols/min [2025-10-08T19:32:25.556631] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:25.578980] [DEBUG] [LOCAL ] IDT: Loaded 18116 existing records from primary storage. [2025-10-08T19:32:25.579371] [INFO ] [MAIN ] IDT: Loaded 18116 existing records. [2025-10-08T19:32:25.622763] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-08T19:32:25.770278] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:25.770571] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-08T19:32:25.770630] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-08T19:32:25.770883] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-08T19:32:25.770939] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-08T19:32:26.115513] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:26.417511] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-08T19:32:26.450145] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T19:32:26.753434] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:32:27.217613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-08T19:32:27.556768] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:32:27.971535] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T19:32:28.017541] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-08T19:32:28.753101] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:32:28.817520] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-08T19:32:29.591359] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:32:29.617499] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-08T19:32:30.417528] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-08T19:32:30.657473] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:32:31.217600] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-08T19:32:32.017570] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-08T19:32:32.042605] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T19:32:32.211823] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:32:32.817607] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-08T19:32:33.376080] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:32:33.410265] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:32:33.617526] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-08T19:32:34.417563] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-08T19:32:35.123295] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:32:35.217516] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-08T19:32:35.493081] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:32:35.862384] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T19:32:36.017596] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-08T19:32:36.817560] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-08T19:32:37.617590] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-08T19:32:37.873094] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-08T19:32:37.877367] [INFO ] [REMOTE ] ICE: Full fetch complete (76763 records). [2025-10-08T19:32:37.877555] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-08T19:32:38.287971] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:32:38.311680] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T19:32:38.399741] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-08T19:32:38.399822] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-08T19:32:38.400753] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-08T19:32:38.400817] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-08T19:32:38.403175] [DEBUG] [LOCAL ] ICE: Trimmed 76763 records to 53012 (keeping 200 days of data) [2025-10-08T19:32:38.463434] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-08T19:32:38.751583] [DEBUG] [LOCAL ] ICE: Primary data saved (53012 records). [2025-10-08T19:32:38.751748] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-08T19:32:38.751838] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. ICE took 41.8s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-08T19:32:38.929341] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:38.968121] [DEBUG] [LOCAL ] IEX: Loaded 38343 existing records from primary storage. [2025-10-08T19:32:38.968473] [INFO ] [MAIN ] IEX: Loaded 38343 existing records. [2025-10-08T19:32:39.149872] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:39.150112] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-08T19:32:39.150175] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-08T19:32:39.150377] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-08T19:32:39.150435] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-08T19:32:39.221047] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-08T19:32:39.261279] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:32:39.522447] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:40.017567] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-08T19:32:40.577943] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T19:32:40.822331] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-08T19:32:40.824693] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:32:41.617546] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-08T19:32:42.285019] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:32:42.369339] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:32:42.417603] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-08T19:32:43.217562] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-08T19:32:43.563704] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T19:32:44.017614] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-08T19:32:44.269417] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T19:32:44.817581] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-08T19:32:45.328469] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:32:45.331793] [INFO ] [REMOTE ] IDA: Full fetch complete (44984 records). [2025-10-08T19:32:45.331904] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-08T19:32:45.461362] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T19:32:45.622632] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-08T19:32:45.748198] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-08T19:32:45.748272] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-08T19:32:45.749007] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-08T19:32:45.749070] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-08T19:32:45.750092] [DEBUG] [LOCAL ] IDA: Trimmed 44984 records to 32579 (keeping 200 days of data) [2025-10-08T19:32:45.955093] [DEBUG] [LOCAL ] IDA: Primary data saved (32579 records). [2025-10-08T19:32:45.955251] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-08T19:32:45.956189] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDA took 37.8s. Estimated remaining: 3h 0m 4s. Rate: 7.1 symbols/min [2025-10-08T19:32:46.131065] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:46.181140] [DEBUG] [LOCAL ] IFF: Loaded 51041 existing records from primary storage. [2025-10-08T19:32:46.181470] [INFO ] [MAIN ] IFF: Loaded 51041 existing records. [2025-10-08T19:32:46.374493] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:46.374742] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-08T19:32:46.374795] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-08T19:32:46.375016] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-08T19:32:46.375074] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-08T19:32:46.418739] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-08T19:32:46.746359] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:46.758519] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:32:47.135048] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:32:47.217558] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-08T19:32:48.017604] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-08T19:32:48.604317] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:32:48.817539] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-08T19:32:48.995825] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:32:49.617604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-08T19:32:50.160186] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:32:50.417592] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-08T19:32:51.177906] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:32:51.222066] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-08T19:32:51.228335] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:32:51.880860] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:32:52.017564] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-08T19:32:52.817527] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-08T19:32:52.834759] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T19:32:53.617555] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-08T19:32:54.417582] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-08T19:32:54.512859] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:32:54.985862] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T19:32:54.987049] [INFO ] [REMOTE ] IDE: Full fetch complete (12571 records). [2025-10-08T19:32:54.987139] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-08T19:32:55.182173] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T19:32:55.225060] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-08T19:32:55.386878] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-08T19:32:55.386955] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-08T19:32:55.387227] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-08T19:32:55.387265] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-08T19:32:55.387733] [DEBUG] [LOCAL ] IDE: Trimmed 12571 records to 8882 (keeping 200 days of data) [2025-10-08T19:32:55.440326] [DEBUG] [LOCAL ] IDE: Primary data saved (8882 records). [2025-10-08T19:32:55.440442] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-08T19:32:55.440536] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDE took 31.4s. Estimated remaining: 2h 59m 57s. Rate: 7.1 symbols/min [2025-10-08T19:32:55.609289] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:55.629332] [DEBUG] [LOCAL ] IFN: Loaded 18399 existing records from primary storage. [2025-10-08T19:32:55.629568] [INFO ] [MAIN ] IFN: Loaded 18399 existing records. [2025-10-08T19:32:55.804779] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:32:55.805029] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-08T19:32:55.805084] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-08T19:32:55.805243] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-08T19:32:55.805284] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-08T19:32:56.022690] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-08T19:32:56.157108] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:56.817518] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-08T19:32:56.860995] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T19:32:57.343180] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:32:57.617533] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-08T19:32:57.900478] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:32:57.902777] [INFO ] [REMOTE ] IDT: Full fetch complete (23340 records). [2025-10-08T19:32:57.902857] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-08T19:32:58.267094] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-08T19:32:58.267234] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-08T19:32:58.267781] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-08T19:32:58.267855] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-08T19:32:58.268475] [DEBUG] [LOCAL ] IDT: Trimmed 23340 records to 18163 (keeping 200 days of data) [2025-10-08T19:32:58.381341] [DEBUG] [LOCAL ] IDT: Primary data saved (18163 records). [2025-10-08T19:32:58.381473] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-08T19:32:58.381556] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDT took 33.0s. Estimated remaining: 2h 59m 42s. Rate: 7.1 symbols/min [2025-10-08T19:32:58.424716] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-08T19:32:58.564061] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:32:58.564484] [DEBUG] [LOCAL ] IFS: No existing data file found in primary storage. [2025-10-08T19:32:58.564560] [WARN ] [MAIN ] IFS: No existing data found, performing full refresh instead. [2025-10-08T19:32:58.564785] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-08T19:32:58.564835] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-08T19:32:58.564882] [DEBUG] [LOCAL ] IFS: No primary data file found to delete. [2025-10-08T19:32:58.564920] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-08T19:32:58.740448] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T19:32:58.941865] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:32:59.217553] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-08T19:33:00.017589] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-08T19:33:00.086299] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T19:33:00.403281] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:33:00.817509] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-08T19:33:01.155913] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:33:01.617564] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-08T19:33:01.672177] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T19:33:02.417550] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-08T19:33:03.127143] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:33:03.164349] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T19:33:03.217511] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-08T19:33:04.017562] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-08T19:33:04.658492] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:33:04.817517] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-08T19:33:05.146756] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:33:05.602153] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:33:05.617492] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-08T19:33:06.417584] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-08T19:33:06.702667] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T19:33:07.217589] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-08T19:33:07.609906] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:33:08.017550] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-08T19:33:08.413528] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:33:08.817545] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-08T19:33:09.207487] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T19:33:09.617565] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-08T19:33:10.269941] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:33:10.417532] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-08T19:33:10.452755] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T19:33:11.217607] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-08T19:33:12.017549] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-08T19:33:12.189782] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T19:33:12.439338] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:33:12.817507] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-08T19:33:13.195789] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:33:13.617553] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-08T19:33:14.273297] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T19:33:14.417543] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-08T19:33:14.570484] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:33:15.217637] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-08T19:33:15.762807] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T19:33:15.766165] [INFO ] [REMOTE ] IEX: Full fetch complete (53482 records). [2025-10-08T19:33:15.766298] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-08T19:33:16.030929] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-08T19:33:16.211474] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T19:33:16.286058] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-08T19:33:16.286167] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-08T19:33:16.287216] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-08T19:33:16.287292] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-08T19:33:16.288873] [DEBUG] [LOCAL ] IEX: Trimmed 53482 records to 38329 (keeping 200 days of data) [2025-10-08T19:33:16.561204] [DEBUG] [LOCAL ] IEX: Primary data saved (38329 records). [2025-10-08T19:33:16.561372] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-08T19:33:16.561478] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IEX took 37.8s. Estimated remaining: 2h 59m 45s. Rate: 7.1 symbols/min [2025-10-08T19:33:16.793125] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:16.807188] [DEBUG] [LOCAL ] IGA: Loaded 9969 existing records from primary storage. [2025-10-08T19:33:16.807467] [INFO ] [MAIN ] IGA: Loaded 9969 existing records. [2025-10-08T19:33:16.822816] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-08T19:33:17.053958] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:17.054303] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-08T19:33:17.054379] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-08T19:33:17.054634] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-08T19:33:17.054740] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-08T19:33:17.272387] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T19:33:17.492906] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:17.617512] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-08T19:33:17.669260] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T19:33:18.298399] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T19:33:18.417497] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-08T19:33:19.181053] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T19:33:19.217511] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-08T19:33:19.953712] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T19:33:20.017495] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-08T19:33:20.789387] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:33:20.817500] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-08T19:33:21.492841] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T19:33:21.617567] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-08T19:33:22.372005] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:33:22.417518] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-08T19:33:23.143556] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:33:23.217551] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-08T19:33:24.017587] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-08T19:33:24.758518] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:33:24.805348] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T19:33:24.817513] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-08T19:33:25.480734] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T19:33:25.617563] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-08T19:33:26.417520] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-08T19:33:26.729833] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T19:33:26.951765] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T19:33:27.217604] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-08T19:33:28.017517] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-08T19:33:28.817518] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-08T19:33:28.867400] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T19:33:29.156975] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:33:29.612814] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T19:33:29.617533] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-08T19:33:30.417560] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-08T19:33:30.598861] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:33:30.601223] [INFO ] [REMOTE ] IFS: Full fetch complete (31711 records). [2025-10-08T19:33:30.601365] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-08T19:33:30.994361] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-08T19:33:30.994461] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-08T19:33:30.995284] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-08T19:33:30.995350] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-08T19:33:30.996270] [DEBUG] [LOCAL ] IFS: Trimmed 31711 records to 22937 (keeping 200 days of data) [2025-10-08T19:33:31.134841] [DEBUG] [LOCAL ] IFS: Primary data saved (22937 records). [2025-10-08T19:33:31.134976] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-08T19:33:31.135089] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IFS took 32.8s. Estimated remaining: 2h 59m 44s. Rate: 7.1 symbols/min [2025-10-08T19:33:31.227386] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-08T19:33:31.332772] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T19:33:31.336305] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:31.361108] [DEBUG] [LOCAL ] IGD: Loaded 19232 existing records from primary storage. [2025-10-08T19:33:31.361403] [INFO ] [MAIN ] IGD: Loaded 19232 existing records. [2025-10-08T19:33:31.537537] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:31.537800] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-08T19:33:31.537849] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-08T19:33:31.538050] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-08T19:33:31.538107] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-08T19:33:31.906138] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:32.017587] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-08T19:33:32.817605] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-08T19:33:32.920889] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:33:32.922831] [INFO ] [REMOTE ] IFN: Full fetch complete (28903 records). [2025-10-08T19:33:32.922938] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-08T19:33:33.313682] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-08T19:33:33.313775] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-08T19:33:33.314344] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-08T19:33:33.314419] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-08T19:33:33.345545] [DEBUG] [LOCAL ] IFN: Trimmed 28903 records to 18362 (keeping 200 days of data) [2025-10-08T19:33:33.347862] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-08T19:33:33.476741] [DEBUG] [LOCAL ] IFN: Primary data saved (18362 records). [2025-10-08T19:33:33.476908] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-08T19:33:33.477007] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 38.0s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-08T19:33:33.621791] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-08T19:33:33.651519] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:33.652495] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T19:33:33.654482] [INFO ] [REMOTE ] IGA: Full fetch complete (13861 records). [2025-10-08T19:33:33.654562] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-08T19:33:33.738312] [DEBUG] [LOCAL ] IGI: Loaded 3734 existing records from primary storage. [2025-10-08T19:33:33.759535] [INFO ] [MAIN ] IGI: Loaded 3734 existing records. [2025-10-08T19:33:34.150384] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:34.153018] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-08T19:33:34.153129] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-08T19:33:34.174501] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-08T19:33:34.192293] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-08T19:33:34.341851] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-08T19:33:34.347063] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-08T19:33:34.352637] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-08T19:33:34.360433] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-08T19:33:34.377154] [DEBUG] [LOCAL ] IGA: Trimmed 13861 records to 10005 (keeping 200 days of data) [2025-10-08T19:33:34.435154] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-08T19:33:34.759354] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:34.769935] [DEBUG] [LOCAL ] IGA: Primary data saved (10005 records). [2025-10-08T19:33:34.770023] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-08T19:33:34.770094] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IGA took 18.2s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-08T19:33:34.938463] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:34.969935] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-08T19:33:34.970247] [INFO ] [MAIN ] IGR: Loaded 30409 existing records. [2025-10-08T19:33:35.189626] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:35.190159] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-08T19:33:35.190394] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-08T19:33:35.190830] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-08T19:33:35.190897] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-08T19:33:35.221831] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-08T19:33:35.575037] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T19:33:35.614141] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:35.627887] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:33:35.926337] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:33:36.017558] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-08T19:33:36.328279] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-08T19:33:36.817621] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-08T19:33:37.617593] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-08T19:33:38.252525] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:33:38.257167] [INFO ] [REMOTE ] IFF: Full fetch complete (73194 records). [2025-10-08T19:33:38.257320] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-08T19:33:38.422747] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-08T19:33:38.695464] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-08T19:33:38.695606] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-08T19:33:38.696596] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-08T19:33:38.696709] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-08T19:33:38.717494] [DEBUG] [LOCAL ] IFF: Trimmed 73194 records to 51052 (keeping 200 days of data) [2025-10-08T19:33:38.719540] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:33:39.061328] [DEBUG] [LOCAL ] IFF: Primary data saved (51052 records). [2025-10-08T19:33:39.061503] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-08T19:33:39.061615] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFF took 53.1s. Estimated remaining: 2h 58m 58s. Rate: 7.1 symbols/min [2025-10-08T19:33:39.224699] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-08T19:33:39.227418] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:33:39.234363] [DEBUG] [LOCAL ] IH: Loaded 2861 existing records from primary storage. [2025-10-08T19:33:39.234558] [INFO ] [MAIN ] IH: Loaded 2861 existing records. [2025-10-08T19:33:39.413395] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:33:39.413682] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-08T19:33:39.413837] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-08T19:33:39.414133] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-08T19:33:39.414212] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-08T19:33:39.711283] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T19:33:39.722901] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T19:33:39.813852] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:33:40.017525] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-08T19:33:40.390501] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-08T19:33:40.817716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-08T19:33:41.250778] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T19:33:41.617560] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-08T19:33:42.417539] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-08T19:33:42.616815] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:33:43.217627] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-08T19:33:43.837844] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T19:33:43.892479] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T19:33:44.017530] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-08T19:33:44.817531] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-08T19:33:45.209114] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T19:33:45.617589] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-08T19:33:46.346943] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:33:46.389445] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T19:33:46.417525] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-08T19:33:47.217578] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-08T19:33:47.736304] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:33:47.989990] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:33:48.017521] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-08T19:33:48.768932] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:33:48.817582] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-08T19:33:49.617569] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-08T19:33:50.152613] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T19:33:50.182797] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:33:50.417534] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-08T19:33:51.213227] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T19:33:51.218810] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-08T19:33:52.017598] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-08T19:33:52.343513] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-08T19:33:52.458387] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T19:33:52.817569] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-08T19:33:53.617616] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-08T19:33:53.826293] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:33:53.936846] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-08T19:33:54.417561] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-08T19:33:55.217540] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-08T19:33:55.640021] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:33:55.886029] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T19:33:56.017532] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-08T19:33:56.567400] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T19:33:56.817543] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-08T19:33:57.495051] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T19:33:57.617601] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-08T19:33:58.154758] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T19:33:58.417542] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-08T19:33:59.217517] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-08T19:33:59.583200] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:33:59.774977] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T19:34:00.017550] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-08T19:34:00.817548] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-08T19:34:01.253583] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T19:34:01.419774] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:34:01.617554] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-08T19:34:02.417550] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-08T19:34:03.217590] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-08T19:34:03.466343] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T19:34:03.483603] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:34:04.017516] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-08T19:34:04.075928] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T19:34:04.817525] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-08T19:34:04.908958] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T19:34:04.911604] [INFO ] [REMOTE ] IGD: Full fetch complete (29727 records). [2025-10-08T19:34:04.911741] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-08T19:34:05.373353] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-08T19:34:05.373460] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-08T19:34:05.374218] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-08T19:34:05.374294] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-08T19:34:05.375209] [DEBUG] [LOCAL ] IGD: Trimmed 29727 records to 19218 (keeping 200 days of data) [2025-10-08T19:34:05.495096] [DEBUG] [LOCAL ] IGD: Primary data saved (19218 records). [2025-10-08T19:34:05.495251] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-08T19:34:05.495336] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGD took 34.4s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-08T19:34:05.622624] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-08T19:34:05.686879] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:05.702604] [DEBUG] [LOCAL ] IHD: Loaded 7017 existing records from primary storage. [2025-10-08T19:34:05.703036] [INFO ] [MAIN ] IHD: Loaded 7017 existing records. [2025-10-08T19:34:05.902091] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:05.902411] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-08T19:34:05.902484] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-08T19:34:05.908184] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-08T19:34:05.918147] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-08T19:34:05.963754] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T19:34:06.227737] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:34:06.292725] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:06.417548] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-08T19:34:07.217545] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-08T19:34:07.543246] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:34:07.545550] [INFO ] [REMOTE ] IGR: Full fetch complete (45342 records). [2025-10-08T19:34:07.545688] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-08T19:34:07.844380] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T19:34:07.848204] [INFO ] [REMOTE ] IH: Full fetch complete (4966 records). [2025-10-08T19:34:07.848302] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-08T19:34:08.022419] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-08T19:34:08.095267] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-08T19:34:08.095481] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-08T19:34:08.172078] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-08T19:34:08.194375] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-08T19:34:08.235736] [DEBUG] [LOCAL ] IGR: Trimmed 45342 records to 30399 (keeping 200 days of data) [2025-10-08T19:34:08.400104] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-08T19:34:08.400715] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-08T19:34:08.401133] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-08T19:34:08.401545] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-08T19:34:08.402364] [DEBUG] [LOCAL ] IH: Trimmed 4966 records to 2853 (keeping 200 days of data) [2025-10-08T19:34:08.424072] [DEBUG] [LOCAL ] IH: Primary data saved (2853 records). [2025-10-08T19:34:08.424484] [INFO ] [MAIN ] IH: Full history saved. [2025-10-08T19:34:08.426875] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IH took 29.4s. Estimated remaining: 2h 58m 56s. Rate: 7.1 symbols/min [2025-10-08T19:34:08.690734] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:08.699560] [DEBUG] [LOCAL ] IGR: Primary data saved (30399 records). [2025-10-08T19:34:08.699843] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-08T19:34:08.699945] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGR took 33.9s. Estimated remaining: 2h 58m 38s. Rate: 7.1 symbols/min [2025-10-08T19:34:08.821060] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-08T19:34:08.884863] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:08.894998] [DEBUG] [LOCAL ] IHG: Loaded 24318 existing records from primary storage. [2025-10-08T19:34:08.895302] [INFO ] [MAIN ] IHG: Loaded 24318 existing records. [2025-10-08T19:34:08.987202] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T19:34:09.115194] [DEBUG] [LOCAL ] IHS: Loaded 38502 existing records from primary storage. [2025-10-08T19:34:09.118591] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:09.118897] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-08T19:34:09.119221] [INFO ] [MAIN ] IHS: Loaded 38502 existing records. [2025-10-08T19:34:09.119098] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-08T19:34:09.151050] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-08T19:34:09.162481] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-08T19:34:09.513742] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:09.540101] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-08T19:34:09.552885] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-08T19:34:09.552822] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T19:34:09.584208] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-08T19:34:09.609865] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-08T19:34:09.626842] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-08T19:34:09.801276] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:10.073406] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:10.367091] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T19:34:10.417523] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-08T19:34:11.217556] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-08T19:34:11.727849] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:34:11.892021] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T19:34:12.017595] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-08T19:34:12.624328] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T19:34:12.625444] [INFO ] [REMOTE ] IGI: Full fetch complete (5346 records). [2025-10-08T19:34:12.625516] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-08T19:34:12.822674] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-08T19:34:13.031253] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-08T19:34:13.031340] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-08T19:34:13.031513] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-08T19:34:13.031553] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-08T19:34:13.031988] [DEBUG] [LOCAL ] IGI: Trimmed 5346 records to 3787 (keeping 200 days of data) [2025-10-08T19:34:13.055730] [DEBUG] [LOCAL ] IGI: Primary data saved (3787 records). [2025-10-08T19:34:13.055862] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-08T19:34:13.055948] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGI took 39.6s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-08T19:34:13.236182] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:13.244240] [DEBUG] [LOCAL ] IIF: Loaded 5685 existing records from primary storage. [2025-10-08T19:34:13.244440] [INFO ] [MAIN ] IIF: Loaded 5685 existing records. [2025-10-08T19:34:13.431472] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:13.431730] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-08T19:34:13.431783] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-08T19:34:13.431971] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-08T19:34:13.432028] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-08T19:34:13.528176] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T19:34:13.623117] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-08T19:34:13.798636] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:14.417566] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-08T19:34:15.151177] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:34:15.217491] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-08T19:34:15.427719] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T19:34:16.017527] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-08T19:34:16.385941] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:34:16.817543] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-08T19:34:16.831363] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T19:34:17.617593] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-08T19:34:17.971126] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:34:18.396193] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T19:34:18.417520] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-08T19:34:19.062678] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:34:19.217589] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-08T19:34:19.946815] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T19:34:20.017583] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-08T19:34:20.817530] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-08T19:34:21.131405] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T19:34:21.400026] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T19:34:21.617584] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-08T19:34:22.160744] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T19:34:22.417603] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-08T19:34:23.140818] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T19:34:23.217566] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-08T19:34:24.017565] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-08T19:34:24.208203] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T19:34:24.817595] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-08T19:34:25.503746] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:34:25.548946] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:34:25.617550] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-08T19:34:26.417608] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-08T19:34:26.666134] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:34:27.217612] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-08T19:34:27.363575] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T19:34:28.017574] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-08T19:34:28.488476] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T19:34:28.817605] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-08T19:34:28.840116] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T19:34:29.617578] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-08T19:34:29.875292] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:34:30.417605] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-08T19:34:30.873059] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:34:31.080208] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T19:34:31.217532] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-08T19:34:31.821128] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T19:34:32.017571] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-08T19:34:32.495383] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:34:32.817559] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-08T19:34:33.617561] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-08T19:34:34.178590] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T19:34:34.297979] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:34:34.417585] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-08T19:34:35.217552] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-08T19:34:35.919571] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:34:35.991693] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T19:34:36.017512] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-08T19:34:36.600743] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T19:34:36.817615] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-08T19:34:37.617513] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-08T19:34:37.666368] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T19:34:38.417554] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-08T19:34:38.453504] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T19:34:39.217568] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-08T19:34:39.417715] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:34:40.017509] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-08T19:34:40.314798] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:34:40.558829] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T19:34:40.560060] [INFO ] [REMOTE ] IHD: Full fetch complete (11860 records). [2025-10-08T19:34:40.560130] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-08T19:34:40.822683] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-08T19:34:40.923004] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-08T19:34:40.923081] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-08T19:34:40.923359] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-08T19:34:40.923396] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-08T19:34:40.923859] [DEBUG] [LOCAL ] IHD: Trimmed 11860 records to 7064 (keeping 200 days of data) [2025-10-08T19:34:40.965428] [DEBUG] [LOCAL ] IHD: Primary data saved (7064 records). [2025-10-08T19:34:40.965535] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-08T19:34:40.965615] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IHD took 35.5s. Estimated remaining: 2h 58m 39s. Rate: 7.1 symbols/min [2025-10-08T19:34:41.133127] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:41.156011] [DEBUG] [LOCAL ] IIIN: Loaded 16171 existing records from primary storage. [2025-10-08T19:34:41.156443] [INFO ] [MAIN ] IIIN: Loaded 16171 existing records. [2025-10-08T19:34:41.332990] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:41.333360] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-08T19:34:41.333448] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-08T19:34:41.333946] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-08T19:34:41.334006] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-08T19:34:41.622706] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-08T19:34:41.694701] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:42.152433] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:34:42.333304] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T19:34:42.417511] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-08T19:34:43.064450] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T19:34:43.217551] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-08T19:34:43.715912] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T19:34:43.716838] [INFO ] [REMOTE ] IIF: Full fetch complete (9203 records). [2025-10-08T19:34:43.716910] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-08T19:34:44.032335] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-08T19:34:44.077811] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-08T19:34:44.077894] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-08T19:34:44.078151] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-08T19:34:44.078191] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-08T19:34:44.078748] [DEBUG] [LOCAL ] IIF: Trimmed 9203 records to 5659 (keeping 200 days of data) [2025-10-08T19:34:44.114915] [DEBUG] [LOCAL ] IIF: Primary data saved (5659 records). [2025-10-08T19:34:44.115075] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-08T19:34:44.115166] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IIF took 31.1s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-08T19:34:44.286008] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:44.303352] [DEBUG] [LOCAL ] IIM: Loaded 15838 existing records from primary storage. [2025-10-08T19:34:44.303601] [INFO ] [MAIN ] IIM: Loaded 15838 existing records. [2025-10-08T19:34:44.493216] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:44.493453] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-08T19:34:44.493501] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-08T19:34:44.493759] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-08T19:34:44.493819] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-08T19:34:44.822698] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-08T19:34:44.854330] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:45.297351] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:34:45.617546] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-08T19:34:45.779918] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:34:45.782419] [INFO ] [REMOTE ] IHS: Full fetch complete (51502 records). [2025-10-08T19:34:45.782522] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-08T19:34:46.173710] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-08T19:34:46.173806] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-08T19:34:46.174551] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-08T19:34:46.174593] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-08T19:34:46.175827] [DEBUG] [LOCAL ] IHS: Trimmed 51502 records to 38329 (keeping 200 days of data) [2025-10-08T19:34:46.397964] [DEBUG] [LOCAL ] IHS: Primary data saved (38329 records). [2025-10-08T19:34:46.398255] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-08T19:34:46.398427] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 37.7s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-10-08T19:34:46.416404] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:34:46.425811] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-08T19:34:46.429392] [INFO ] [REMOTE ] IHG: Full fetch complete (33785 records). [2025-10-08T19:34:46.440420] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-08T19:34:46.740158] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:46.987025] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-08T19:34:46.987125] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-08T19:34:46.987837] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-08T19:34:46.987962] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-08T19:34:46.997755] [DEBUG] [LOCAL ] IHG: Trimmed 33785 records to 24221 (keeping 200 days of data) [2025-10-08T19:34:46.999791] [DEBUG] [LOCAL ] IIPR: Loaded 29578 existing records from primary storage. [2025-10-08T19:34:47.000272] [INFO ] [MAIN ] IIPR: Loaded 29578 existing records. [2025-10-08T19:34:47.222595] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-08T19:34:47.284625] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:47.290706] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-08T19:34:47.291474] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-08T19:34:47.292368] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-08T19:34:47.292686] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-08T19:34:47.692200] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:47.707257] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T19:34:47.744365] [DEBUG] [LOCAL ] IHG: Primary data saved (24221 records). [2025-10-08T19:34:47.744504] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-08T19:34:47.744603] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHG took 39.3s. Estimated remaining: 2h 57m 53s. Rate: 7.1 symbols/min [2025-10-08T19:34:47.914790] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:34:47.955728] [DEBUG] [LOCAL ] IMAX: Loaded 42871 existing records from primary storage. [2025-10-08T19:34:47.956050] [INFO ] [MAIN ] IMAX: Loaded 42871 existing records. [2025-10-08T19:34:48.022697] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-08T19:34:48.145178] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:34:48.145421] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-08T19:34:48.145469] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-08T19:34:48.145897] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-08T19:34:48.145959] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-08T19:34:48.584784] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:34:48.585879] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:34:48.817556] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-08T19:34:49.322980] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:34:49.617528] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-08T19:34:49.732124] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T19:34:50.417577] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-08T19:34:50.967442] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:34:51.217532] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-08T19:34:51.460579] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:34:52.017568] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-08T19:34:52.518929] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:34:52.817506] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-08T19:34:52.901076] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T19:34:53.617518] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-08T19:34:53.651928] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T19:34:54.417597] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-08T19:34:54.652719] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:34:55.217554] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-08T19:34:55.910380] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T19:34:56.017555] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-08T19:34:56.315093] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T19:34:56.817588] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-08T19:34:57.035048] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T19:34:57.392858] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:34:57.617549] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-08T19:34:58.417513] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-08T19:34:58.547264] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:34:59.217501] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-08T19:34:59.393020] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T19:35:00.017544] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-08T19:35:00.817529] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-08T19:35:00.918364] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:35:01.103823] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:35:01.617518] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-08T19:35:01.861815] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:35:02.417589] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-08T19:35:03.035804] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:35:03.111081] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T19:35:03.217592] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-08T19:35:04.017607] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-08T19:35:04.432404] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:35:04.817594] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-08T19:35:05.093040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:35:05.330026] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T19:35:05.617563] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-08T19:35:06.417599] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-08T19:35:07.217523] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-08T19:35:07.567899] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:35:07.704091] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:35:07.705630] [INFO ] [REMOTE ] IIIN: Full fetch complete (24724 records). [2025-10-08T19:35:07.705755] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-08T19:35:07.989759] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:35:08.022691] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-08T19:35:08.105132] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-08T19:35:08.105432] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-08T19:35:08.106065] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-08T19:35:08.106127] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-08T19:35:08.106810] [DEBUG] [LOCAL ] IIIN: Trimmed 24724 records to 16149 (keeping 200 days of data) [2025-10-08T19:35:08.205710] [DEBUG] [LOCAL ] IIIN: Primary data saved (16149 records). [2025-10-08T19:35:08.205854] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-08T19:35:08.205939] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIIN took 27.2s. Estimated remaining: 2h 57m 58s. Rate: 7.1 symbols/min [2025-10-08T19:35:08.384601] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:08.431008] [DEBUG] [LOCAL ] INFA: Loaded 49429 existing records from primary storage. [2025-10-08T19:35:08.431352] [INFO ] [MAIN ] INFA: Loaded 49429 existing records. [2025-10-08T19:35:08.612225] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:08.612492] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-08T19:35:08.612543] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-08T19:35:08.612768] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-08T19:35:08.612826] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-08T19:35:08.827541] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-08T19:35:08.987574] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:09.617518] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-08T19:35:09.670968] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T19:35:09.869753] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T19:35:10.417572] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-08T19:35:10.648317] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T19:35:11.217751] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-08T19:35:12.017519] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-08T19:35:12.129356] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T19:35:12.250922] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:35:12.817540] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-08T19:35:13.617612] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-08T19:35:13.846314] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:35:14.276335] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:35:14.417622] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-08T19:35:14.529450] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T19:35:15.217557] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-08T19:35:15.940415] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:35:16.017586] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-08T19:35:16.817575] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-08T19:35:17.010687] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:35:17.617537] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-08T19:35:17.682083] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T19:35:17.963757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:35:17.966388] [INFO ] [REMOTE ] IIPR: Full fetch complete (44858 records). [2025-10-08T19:35:17.966492] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-08T19:35:18.359462] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T19:35:18.363374] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-08T19:35:18.363976] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-08T19:35:18.365226] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-08T19:35:18.365294] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-08T19:35:18.366299] [DEBUG] [LOCAL ] IIPR: Trimmed 44858 records to 29456 (keeping 200 days of data) [2025-10-08T19:35:18.423284] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-08T19:35:18.556256] [DEBUG] [LOCAL ] IIPR: Primary data saved (29456 records). [2025-10-08T19:35:18.556399] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-08T19:35:18.556535] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIPR took 32.2s. Estimated remaining: 2h 57m 52s. Rate: 7.1 symbols/min [2025-10-08T19:35:18.731965] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:18.787609] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-08T19:35:18.788024] [INFO ] [MAIN ] INFY: Loaded 53595 existing records. [2025-10-08T19:35:18.967550] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:18.967803] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-08T19:35:18.967851] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-08T19:35:18.968056] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-08T19:35:18.968112] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-08T19:35:19.225041] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-08T19:35:19.234596] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T19:35:19.344970] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:20.017559] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-08T19:35:20.817533] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-08T19:35:20.935226] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:35:21.524332] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:35:21.617528] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-08T19:35:21.819174] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:35:22.417551] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-08T19:35:23.032545] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:35:23.036098] [INFO ] [REMOTE ] IMAX: Full fetch complete (60010 records). [2025-10-08T19:35:23.036215] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-08T19:35:23.220253] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-08T19:35:23.438852] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-08T19:35:23.438943] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-08T19:35:23.439794] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-08T19:35:23.439861] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-08T19:35:23.443276] [DEBUG] [LOCAL ] IMAX: Trimmed 60010 records to 42877 (keeping 200 days of data) [2025-10-08T19:35:23.699545] [DEBUG] [LOCAL ] IMAX: Primary data saved (42877 records). [2025-10-08T19:35:23.699749] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-08T19:35:23.699856] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IMAX took 36.0s. Estimated remaining: 2h 57m 40s. Rate: 7.1 symbols/min [2025-10-08T19:35:23.866545] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:23.914059] [DEBUG] [LOCAL ] ING: Loaded 50705 existing records from primary storage. [2025-10-08T19:35:23.914401] [INFO ] [MAIN ] ING: Loaded 50705 existing records. [2025-10-08T19:35:24.021741] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-08T19:35:24.099555] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:24.099832] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-08T19:35:24.099904] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-08T19:35:24.100345] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-08T19:35:24.100662] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-08T19:35:24.440961] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T19:35:24.512563] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:24.556761] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:35:24.817579] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-08T19:35:25.150587] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:35:25.617619] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-08T19:35:26.417530] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-08T19:35:26.425504] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:35:26.427782] [INFO ] [REMOTE ] IIM: Full fetch complete (25426 records). [2025-10-08T19:35:26.428039] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-08T19:35:26.516538] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T19:35:26.920880] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-08T19:35:26.920982] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-08T19:35:26.921594] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-08T19:35:26.921701] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-08T19:35:26.922427] [DEBUG] [LOCAL ] IIM: Trimmed 25426 records to 15846 (keeping 200 days of data) [2025-10-08T19:35:27.038481] [DEBUG] [LOCAL ] IIM: Primary data saved (15846 records). [2025-10-08T19:35:27.038810] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-08T19:35:27.039051] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIM took 42.9s. Estimated remaining: 2h 57m 25s. Rate: 7.1 symbols/min [2025-10-08T19:35:27.230468] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-08T19:35:27.271111] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:27.306011] [DEBUG] [LOCAL ] INGM: Loaded 28689 existing records from primary storage. [2025-10-08T19:35:27.306350] [INFO ] [MAIN ] INGM: Loaded 28689 existing records. [2025-10-08T19:35:27.551570] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:27.551911] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-08T19:35:27.551995] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-08T19:35:27.552327] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-08T19:35:27.552395] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-08T19:35:28.021777] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-08T19:35:28.021623] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:28.202560] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:35:28.817513] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-08T19:35:29.017751] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:35:29.362745] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:35:29.617604] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-08T19:35:29.866335] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T19:35:30.417577] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-08T19:35:31.205443] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T19:35:31.217494] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-08T19:35:31.700629] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:35:32.017582] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-08T19:35:32.817524] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-08T19:35:33.014581] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:35:33.624489] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-08T19:35:33.629879] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T19:35:34.396619] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T19:35:34.417493] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-08T19:35:35.217532] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-08T19:35:35.258718] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T19:35:35.863492] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T19:35:36.023278] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-08T19:35:36.035975] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T19:35:36.817588] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-08T19:35:37.617526] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-08T19:35:37.772526] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T19:35:38.417540] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-08T19:35:38.694258] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T19:35:38.776450] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:35:39.217563] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-08T19:35:39.923590] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:35:40.017537] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-08T19:35:40.435788] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:35:40.439308] [INFO ] [REMOTE ] INFA: Full fetch complete (71020 records). [2025-10-08T19:35:40.439464] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-08T19:35:40.822684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-08T19:35:40.845187] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-08T19:35:40.846144] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-08T19:35:40.847180] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-08T19:35:40.847348] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-08T19:35:40.848868] [DEBUG] [LOCAL ] INFA: Trimmed 71020 records to 49319 (keeping 200 days of data) [2025-10-08T19:35:41.141251] [DEBUG] [LOCAL ] INFA: Primary data saved (49319 records). [2025-10-08T19:35:41.141392] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-08T19:35:41.141488] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. INFA took 32.9s. Estimated remaining: 2h 57m 24s. Rate: 7.1 symbols/min [2025-10-08T19:35:41.320365] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:41.355633] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-10-08T19:35:41.355953] [INFO ] [MAIN ] INGR: Loaded 33657 existing records. [2025-10-08T19:35:41.542632] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:41.543018] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-08T19:35:41.543190] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-08T19:35:41.543438] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-08T19:35:41.543495] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-08T19:35:41.621378] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-08T19:35:41.955348] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T19:35:41.959966] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:41.986887] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:35:42.417605] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-08T19:35:43.221763] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-08T19:35:43.227741] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:35:43.996756] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:35:44.017490] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-08T19:35:44.291470] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:35:44.817557] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-08T19:35:45.617533] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-08T19:35:45.874763] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:35:46.208996] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:35:46.417599] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-08T19:35:46.529180] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T19:35:47.217555] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-08T19:35:48.017539] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-08T19:35:48.137405] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T19:35:48.809476] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:35:48.817471] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-08T19:35:49.520698] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T19:35:49.617498] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-08T19:35:50.351291] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:35:50.417724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-08T19:35:51.211787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:35:51.222479] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-08T19:35:51.825412] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:35:52.017546] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-08T19:35:52.817544] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-08T19:35:53.126340] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T19:35:53.397257] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:35:53.617568] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-08T19:35:54.417540] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-08T19:35:54.739435] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:35:54.785219] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T19:35:55.217577] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-08T19:35:56.017525] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-08T19:35:56.146380] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:35:56.150305] [INFO ] [REMOTE ] ING: Full fetch complete (73611 records). [2025-10-08T19:35:56.150455] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-08T19:35:56.561564] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-08T19:35:56.561746] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-08T19:35:56.562784] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-08T19:35:56.562849] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-08T19:35:56.564355] [DEBUG] [LOCAL ] ING: Trimmed 73611 records to 50706 (keeping 200 days of data) [2025-10-08T19:35:56.809717] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T19:35:56.824297] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-08T19:35:56.921314] [DEBUG] [LOCAL ] ING: Primary data saved (50706 records). [2025-10-08T19:35:56.921469] [INFO ] [MAIN ] ING: Full history saved. [2025-10-08T19:35:56.921573] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. ING took 33.2s. Estimated remaining: 2h 57m 23s. Rate: 7.1 symbols/min [2025-10-08T19:35:57.146218] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:57.190791] [DEBUG] [LOCAL ] INN: Loaded 41813 existing records from primary storage. [2025-10-08T19:35:57.191155] [INFO ] [MAIN ] INN: Loaded 41813 existing records. [2025-10-08T19:35:57.415832] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:35:57.416262] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-08T19:35:57.416349] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-08T19:35:57.416695] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-08T19:35:57.416861] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-08T19:35:57.533570] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:35:57.622634] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-08T19:35:57.838128] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:35:58.417542] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-08T19:35:58.590698] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T19:35:58.594800] [INFO ] [REMOTE ] INFY: Full fetch complete (77545 records). [2025-10-08T19:35:58.594946] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-08T19:35:58.800217] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:35:59.057819] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-08T19:35:59.057908] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-08T19:35:59.058879] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-08T19:35:59.058950] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-08T19:35:59.060520] [DEBUG] [LOCAL ] INFY: Trimmed 77545 records to 53594 (keeping 200 days of data) [2025-10-08T19:35:59.257868] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-08T19:35:59.415146] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-10-08T19:35:59.415306] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-08T19:35:59.415431] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INFY took 40.9s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-08T19:35:59.603459] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:35:59.603803] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-08T19:35:59.603924] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-08T19:35:59.604149] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-08T19:35:59.604268] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-08T19:35:59.604418] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-08T19:35:59.604542] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-08T19:35:59.733865] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:36:00.023846] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-08T19:36:00.038102] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:00.148319] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T19:36:00.817550] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-08T19:36:01.418386] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:36:01.617627] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-08T19:36:02.095579] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:36:02.417599] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-08T19:36:02.514086] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T19:36:03.217609] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-08T19:36:03.811744] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:36:03.815097] [INFO ] [REMOTE ] INGR: Full fetch complete (50425 records). [2025-10-08T19:36:03.815191] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-08T19:36:04.022699] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-08T19:36:04.220139] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-08T19:36:04.220254] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-08T19:36:04.221019] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-08T19:36:04.221081] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-08T19:36:04.222200] [DEBUG] [LOCAL ] INGR: Trimmed 50425 records to 33594 (keeping 200 days of data) [2025-10-08T19:36:04.391990] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:36:04.416488] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-08T19:36:04.418997] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:36:04.424009] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-08T19:36:04.424830] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:36:04.427291] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-08T19:36:04.428914] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-08T19:36:04.430616] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-08T19:36:04.433482] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-08T19:36:04.435762] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INR took 5.0s. Estimated remaining: 2h 56m 56s. Rate: 7.1 symbols/min [2025-10-08T19:36:04.655197] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:04.659368] [DEBUG] [LOCAL ] INGR: Primary data saved (33594 records). [2025-10-08T19:36:04.659539] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-08T19:36:04.661343] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T19:36:04.662077] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INGR took 23.5s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-08T19:36:04.829664] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-08T19:36:04.863677] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:04.875671] [DEBUG] [LOCAL ] INSP: Loaded 37565 existing records from primary storage. [2025-10-08T19:36:04.875970] [INFO ] [MAIN ] INSP: Loaded 37565 existing records. [2025-10-08T19:36:05.068029] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:05.068328] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-08T19:36:05.068378] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-08T19:36:05.068749] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-08T19:36:05.068806] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-08T19:36:05.185265] [DEBUG] [LOCAL ] INSW: Loaded 39831 existing records from primary storage. [2025-10-08T19:36:05.201330] [INFO ] [MAIN ] INSW: Loaded 39831 existing records. [2025-10-08T19:36:05.599197] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:05.635564] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-08T19:36:05.635445] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-08T19:36:05.641773] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:05.642926] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-08T19:36:05.643269] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-08T19:36:05.643340] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-08T19:36:06.029398] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:06.154417] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:36:06.417708] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-08T19:36:07.121494] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T19:36:07.217571] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-08T19:36:07.935320] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T19:36:08.017550] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-08T19:36:08.657148] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:36:08.820474] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-08T19:36:08.824497] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:36:09.617559] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-08T19:36:10.226487] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:36:10.417595] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-08T19:36:11.217564] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-08T19:36:11.445425] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T19:36:11.761932] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:36:12.017589] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-08T19:36:12.332629] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:36:12.817561] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-08T19:36:12.882828] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:36:12.885345] [INFO ] [REMOTE ] INGM: Full fetch complete (42244 records). [2025-10-08T19:36:12.885449] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-08T19:36:13.255147] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-08T19:36:13.255232] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-08T19:36:13.255913] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-08T19:36:13.255978] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-08T19:36:13.256995] [DEBUG] [LOCAL ] INGM: Trimmed 42244 records to 28664 (keeping 200 days of data) [2025-10-08T19:36:13.435091] [DEBUG] [LOCAL ] INGM: Primary data saved (28664 records). [2025-10-08T19:36:13.435254] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-08T19:36:13.435341] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGM took 46.4s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-08T19:36:13.604835] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:13.617568] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-08T19:36:13.654334] [DEBUG] [LOCAL ] INVH: Loaded 53160 existing records from primary storage. [2025-10-08T19:36:13.654700] [INFO ] [MAIN ] INVH: Loaded 53160 existing records. [2025-10-08T19:36:13.834858] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:13.835096] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-08T19:36:13.835179] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-08T19:36:13.835467] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-08T19:36:13.835526] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-08T19:36:14.197510] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:14.284242] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T19:36:14.417565] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-08T19:36:14.729061] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T19:36:15.217567] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-08T19:36:15.645936] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T19:36:16.017626] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-08T19:36:16.794203] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:36:16.817534] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-08T19:36:17.625866] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-08T19:36:17.643368] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T19:36:18.385893] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:36:18.417499] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-08T19:36:18.798684] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T19:36:19.217598] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-08T19:36:19.684704] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T19:36:20.017558] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-08T19:36:20.183251] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T19:36:20.817588] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-08T19:36:21.406386] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:36:21.617551] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-08T19:36:21.828385] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:36:22.417590] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-08T19:36:23.217617] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-08T19:36:23.341446] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:36:24.009271] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:36:24.022556] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-08T19:36:24.561593] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T19:36:24.817577] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-08T19:36:25.617576] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-08T19:36:25.737928] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T19:36:25.978112] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T19:36:26.417623] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-08T19:36:27.109326] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:36:27.217623] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-08T19:36:27.869840] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:36:28.017567] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-08T19:36:28.817517] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-08T19:36:28.886618] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:36:29.109120] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T19:36:29.112302] [INFO ] [REMOTE ] INN: Full fetch complete (57862 records). [2025-10-08T19:36:29.112401] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-08T19:36:29.522170] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-08T19:36:29.522258] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-08T19:36:29.523150] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-08T19:36:29.523215] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-08T19:36:29.524484] [DEBUG] [LOCAL ] INN: Trimmed 57862 records to 41765 (keeping 200 days of data) [2025-10-08T19:36:29.617777] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-08T19:36:29.779866] [DEBUG] [LOCAL ] INN: Primary data saved (41765 records). [2025-10-08T19:36:29.780008] [INFO ] [MAIN ] INN: Full history saved. [2025-10-08T19:36:29.780092] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 32.9s. Estimated remaining: 2h 56m 31s. Rate: 7.1 symbols/min [2025-10-08T19:36:29.951424] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:29.979004] [DEBUG] [LOCAL ] INVX: Loaded 29163 existing records from primary storage. [2025-10-08T19:36:29.979281] [INFO ] [MAIN ] INVX: Loaded 29163 existing records. [2025-10-08T19:36:30.158232] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:30.158479] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-08T19:36:30.158564] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-08T19:36:30.159317] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-08T19:36:30.159380] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-08T19:36:30.420266] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-08T19:36:30.535878] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:30.583102] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T19:36:30.793175] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:36:31.217616] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-08T19:36:31.581170] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T19:36:32.017596] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-08T19:36:32.681481] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:36:32.817543] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-08T19:36:33.487429] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:36:33.617591] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-08T19:36:34.142050] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T19:36:34.417588] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-08T19:36:34.808252] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T19:36:34.812075] [INFO ] [REMOTE ] INSP: Full fetch complete (53241 records). [2025-10-08T19:36:34.812227] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-08T19:36:35.210130] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-08T19:36:35.210215] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-08T19:36:35.211043] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-08T19:36:35.211108] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-08T19:36:35.212267] [DEBUG] [LOCAL ] INSP: Trimmed 53241 records to 37638 (keeping 200 days of data) [2025-10-08T19:36:35.265332] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-08T19:36:35.456911] [DEBUG] [LOCAL ] INSP: Primary data saved (37638 records). [2025-10-08T19:36:35.457065] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-08T19:36:35.457151] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSP took 31.0s. Estimated remaining: 2h 56m 19s. Rate: 7.1 symbols/min [2025-10-08T19:36:35.636187] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:35.689124] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-08T19:36:35.689459] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-08T19:36:35.889376] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:35.889582] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-08T19:36:35.889629] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-08T19:36:35.891614] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-08T19:36:35.891698] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-08T19:36:36.048818] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-08T19:36:36.311130] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:36.328128] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:36:36.822676] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-08T19:36:36.835054] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T19:36:37.617530] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-08T19:36:37.877792] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:36:38.417515] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-08T19:36:38.652252] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T19:36:38.848305] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:36:39.217616] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-08T19:36:40.017523] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-08T19:36:40.347906] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T19:36:40.817577] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-08T19:36:40.861833] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-08T19:36:41.112166] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:36:41.617581] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-08T19:36:42.245238] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T19:36:42.417558] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-08T19:36:42.944031] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:36:43.217553] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-08T19:36:43.807353] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:36:44.017567] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-08T19:36:44.714263] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:36:44.817532] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-08T19:36:45.308987] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:36:45.617573] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-08T19:36:46.417561] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-08T19:36:47.117032] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T19:36:47.121005] [INFO ] [REMOTE ] INVH: Full fetch complete (76743 records). [2025-10-08T19:36:47.121131] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-08T19:36:47.219227] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-08T19:36:47.534718] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-08T19:36:47.534947] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-08T19:36:47.536095] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-08T19:36:47.536287] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-08T19:36:47.548333] [DEBUG] [LOCAL ] INVH: Trimmed 76743 records to 53162 (keeping 200 days of data) [2025-10-08T19:36:47.570891] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-08T19:36:47.709041] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:36:47.713955] [INFO ] [REMOTE ] INSW: Full fetch complete (60233 records). [2025-10-08T19:36:47.714614] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-08T19:36:48.032815] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-08T19:36:48.314938] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-08T19:36:48.316822] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-08T19:36:48.317680] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-08T19:36:48.317875] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-08T19:36:48.326077] [DEBUG] [LOCAL ] INSW: Trimmed 60233 records to 39755 (keeping 200 days of data) [2025-10-08T19:36:48.384821] [DEBUG] [LOCAL ] INVH: Primary data saved (53162 records). [2025-10-08T19:36:48.394297] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-08T19:36:48.420480] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INVH took 35.0s. Estimated remaining: 2h 56m 16s. Rate: 7.1 symbols/min [2025-10-08T19:36:48.731347] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:36:48.759280] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:36:48.786554] [DEBUG] [LOCAL ] INSW: Primary data saved (39755 records). [2025-10-08T19:36:48.786844] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-08T19:36:48.786952] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 44.1s. Estimated remaining: 2h 55m 58s. Rate: 7.1 symbols/min [2025-10-08T19:36:48.823927] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-08T19:36:48.826793] [DEBUG] [LOCAL ] IOT: Loaded 53472 existing records from primary storage. [2025-10-08T19:36:48.827186] [INFO ] [MAIN ] IOT: Loaded 53472 existing records. [2025-10-08T19:36:49.003181] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:36:49.003382] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-08T19:36:49.003428] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-08T19:36:49.004902] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-08T19:36:49.004963] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-08T19:36:49.357035] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:36:49.617534] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-08T19:36:49.934135] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T19:36:50.417571] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-08T19:36:50.664139] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-08T19:36:51.217517] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-08T19:36:51.372241] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T19:36:51.483866] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T19:36:52.017608] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-08T19:36:52.817576] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-08T19:36:53.133156] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:36:53.617562] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-08T19:36:53.665185] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-08T19:36:54.417563] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-08T19:36:54.456574] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:36:54.728225] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:36:54.730802] [INFO ] [REMOTE ] INVX: Full fetch complete (43746 records). [2025-10-08T19:36:54.730889] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-08T19:36:55.178321] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-08T19:36:55.178415] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-08T19:36:55.179204] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-08T19:36:55.179276] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-08T19:36:55.180394] [DEBUG] [LOCAL ] INVX: Trimmed 43746 records to 29189 (keeping 200 days of data) [2025-10-08T19:36:55.228148] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-08T19:36:55.356093] [DEBUG] [LOCAL ] INVX: Primary data saved (29189 records). [2025-10-08T19:36:55.356281] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-08T19:36:55.356391] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 25.6s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-08T19:36:56.987897] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T19:36:56.999100] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-08T19:36:57.194193] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-08T19:36:57.205483] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-08T19:36:58.689921] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:36:58.702110] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-08T19:36:59.888525] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-08T19:36:59.900407] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-08T19:37:00.060370] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:37:00.073133] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-08T19:37:01.942357] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:37:01.953885] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-08T19:37:02.267275] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-08T19:37:02.278244] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-08T19:37:03.656197] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:37:03.667386] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-08T19:37:05.102912] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-08T19:37:05.114799] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-08T19:37:05.277755] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T19:37:05.289481] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-08T19:37:07.251887] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T19:37:07.263335] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-08T19:37:07.883708] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-08T19:37:07.895519] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-08T19:37:08.862639] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:37:08.874508] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-08T19:37:10.513535] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:37:10.529906] [INFO ] [REMOTE ] IOT: Full fetch complete (77394 records). [2025-10-08T19:37:10.548056] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-08T19:37:10.549712] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-08T19:37:10.620450] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-08T19:37:10.963348] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-08T19:37:10.963445] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-08T19:37:10.964453] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-08T19:37:10.964522] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-08T19:37:10.966192] [DEBUG] [LOCAL ] IOT: Trimmed 77394 records to 53475 (keeping 200 days of data) [2025-10-08T19:37:11.300134] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-08T19:37:11.300269] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-08T19:37:11.300351] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IOT took 22.9s. Estimated remaining: 2h 55m 48s. Rate: 7.1 symbols/min [2025-10-08T19:37:13.196048] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-08T19:37:13.205447] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-08T19:37:13.205702] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-08T19:37:13.671918] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-08T19:37:13.672046] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-08T19:37:13.673212] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-08T19:37:13.673285] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-08T19:37:13.674929] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-08T19:37:14.010616] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-08T19:37:14.010800] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-08T19:37:14.010885] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 38.6s. Estimated remaining: 2h 55m 33s. Rate: 7.1 symbols/min [2025-10-08T19:37:14.750190] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.862353] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.852912] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:14.989211] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:15.030821] [DEBUG] [LOCAL ] IPI: Loaded 21533 existing records from primary storage. [2025-10-08T19:37:15.033701] [INFO ] [MAIN ] IPI: Loaded 21533 existing records. [2025-10-08T19:37:15.055576] [DEBUG] [LOCAL ] IQI: Loaded 18006 existing records from primary storage. [2025-10-08T19:37:15.056122] [INFO ] [MAIN ] IQI: Loaded 18006 existing records. [2025-10-08T19:37:15.393013] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-08T19:37:15.492486] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-08T19:37:15.582947] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:15.594411] [DEBUG] [LOCAL ] IP: Loaded 53319 existing records from primary storage. [2025-10-08T19:37:15.625708] [INFO ] [MAIN ] IP: Loaded 53319 existing records. [2025-10-08T19:37:15.625459] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-08T19:37:15.695170] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-08T19:37:15.897501] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-08T19:37:15.892264] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:15.958101] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-08T19:37:15.970415] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.057018] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-08T19:37:16.075396] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:16.130249] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-08T19:37:16.146035] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.140723] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-08T19:37:16.158437] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-08T19:37:16.236178] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:16.231749] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-08T19:37:16.258079] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-08T19:37:16.258168] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-08T19:37:16.338795] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-08T19:37:16.539140] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-08T19:37:16.620012] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-08T19:37:17.249520] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.286677] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-08T19:37:17.481412] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.502183] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-08T19:37:17.535238] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.541626] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-08T19:37:17.683839] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:17.684143] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-08T19:37:18.351140] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:37:18.354925] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-08T19:37:18.932269] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T19:37:18.937881] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-08T19:37:19.053787] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:37:19.064566] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-08T19:37:19.214848] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T19:37:19.218624] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-08T19:37:19.711433] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:37:19.715808] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-08T19:37:19.781224] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-08T19:37:19.792782] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-08T19:37:19.831268] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T19:37:19.835534] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-08T19:37:20.498677] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T19:37:20.509722] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-08T19:37:20.556859] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:37:20.562336] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-08T19:37:20.667495] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T19:37:20.672981] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-08T19:37:21.166290] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T19:37:21.177022] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-08T19:37:21.546103] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T19:37:21.552473] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-08T19:37:21.649799] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T19:37:21.654752] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-08T19:37:22.060619] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:37:22.070677] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-08T19:37:22.460413] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:37:22.471273] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-08T19:37:22.487742] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:37:22.494980] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-08T19:37:22.509171] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T19:37:23.217530] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-08T19:37:23.263735] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T19:37:23.777908] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:37:23.873913] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T19:37:23.874994] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T19:37:24.017539] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-08T19:37:24.817516] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-08T19:37:24.955756] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:37:25.617547] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-08T19:37:26.426330] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-08T19:37:26.451426] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:37:27.217529] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-08T19:37:27.443990] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T19:37:27.467407] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T19:37:28.017555] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-08T19:37:28.688608] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-08T19:37:28.730113] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:37:28.817562] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-08T19:37:29.617519] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-08T19:37:30.417562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-08T19:37:30.675603] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T19:37:30.689546] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:37:31.217616] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-08T19:37:31.882311] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T19:37:32.017617] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-08T19:37:32.199635] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:37:32.817527] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-08T19:37:33.595001] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:37:33.617508] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-08T19:37:34.417562] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-08T19:37:34.521259] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T19:37:35.217557] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-08T19:37:35.502772] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:37:35.533530] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T19:37:36.017562] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-08T19:37:36.819264] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-08T19:37:36.822232] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:37:37.325004] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:37:37.617571] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-08T19:37:37.796917] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:37:38.417567] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-08T19:37:39.180581] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T19:37:39.185295] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-08T19:37:39.185422] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-08T19:37:39.222770] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-08T19:37:39.499381] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:37:39.545495] [INFO ] [REMOTE ] IQI: Full fetch complete (26790 records). [2025-10-08T19:37:39.548431] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-08T19:37:39.668963] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-08T19:37:39.687353] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-08T19:37:39.690912] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-08T19:37:39.691345] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-08T19:37:39.767718] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53330 (keeping 200 days of data) [2025-10-08T19:37:40.051549] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-08T19:37:40.084218] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-08T19:37:40.089079] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-08T19:37:40.095214] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-08T19:37:40.096580] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-08T19:37:40.104218] [DEBUG] [LOCAL ] IQI: Trimmed 26790 records to 17978 (keeping 200 days of data) [2025-10-08T19:37:40.322860] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T19:37:40.392884] [INFO ] [REMOTE ] IPI: Full fetch complete (29582 records). [2025-10-08T19:37:40.399196] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-08T19:37:40.736141] [DEBUG] [LOCAL ] IQI: Primary data saved (17978 records). [2025-10-08T19:37:40.750055] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-08T19:37:40.750177] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-08T19:37:40.755556] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-08T19:37:40.760908] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPG took 26.7s. Estimated remaining: 2h 55m 45s. Rate: 7.1 symbols/min [2025-10-08T19:37:40.800960] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IQI took 26.8s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-08T19:37:40.900559] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-08T19:37:40.918312] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-08T19:37:40.969083] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-08T19:37:41.012106] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-08T19:37:41.049437] [DEBUG] [LOCAL ] IPI: Trimmed 29582 records to 21556 (keeping 200 days of data) [2025-10-08T19:37:41.223250] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.250216] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.353974] [DEBUG] [LOCAL ] IPI: Primary data saved (21556 records). [2025-10-08T19:37:41.354210] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-08T19:37:41.354387] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IPI took 27.3s. Estimated remaining: 2h 55m 10s. Rate: 7.1 symbols/min [2025-10-08T19:37:41.413972] [DEBUG] [LOCAL ] IQV: Loaded 50087 existing records from primary storage. [2025-10-08T19:37:41.434419] [INFO ] [MAIN ] IQV: Loaded 50087 existing records. [2025-10-08T19:37:41.472881] [DEBUG] [LOCAL ] IR: Loaded 52740 existing records from primary storage. [2025-10-08T19:37:41.497281] [INFO ] [MAIN ] IR: Loaded 52740 existing records. [2025-10-08T19:37:41.717276] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:41.900924] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:41.941609] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-08T19:37:41.952327] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-08T19:37:41.983800] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:41.978926] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-08T19:37:41.984542] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-08T19:37:41.996176] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-08T19:37:41.996388] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-08T19:37:42.043348] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-08T19:37:42.043599] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-08T19:37:42.348491] [DEBUG] [LOCAL ] IRM: Loaded 49283 existing records from primary storage. [2025-10-08T19:37:42.400425] [INFO ] [MAIN ] IRM: Loaded 49283 existing records. [2025-10-08T19:37:42.468957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T19:37:42.692851] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-08T19:37:42.936954] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:42.989098] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-08T19:37:42.983635] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:43.015910] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-08T19:37:43.027779] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-08T19:37:43.062844] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:43.063201] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-08T19:37:43.056244] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-08T19:37:43.064492] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-08T19:37:43.424983] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:43.425334] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-08T19:37:44.358742] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T19:37:44.370274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-08T19:37:44.728832] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:37:44.826913] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-08T19:37:44.832515] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:37:45.151079] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T19:37:45.617611] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-08T19:37:46.118700] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T19:37:46.122773] [INFO ] [REMOTE ] IP: Full fetch complete (77169 records). [2025-10-08T19:37:46.122906] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-08T19:37:46.433058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-08T19:37:46.541573] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-08T19:37:46.541848] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-08T19:37:46.543014] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-08T19:37:46.543122] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-08T19:37:46.545169] [DEBUG] [LOCAL ] IP: Trimmed 77169 records to 53317 (keeping 200 days of data) [2025-10-08T19:37:46.670456] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T19:37:46.915275] [DEBUG] [LOCAL ] IP: Primary data saved (53317 records). [2025-10-08T19:37:46.915421] [INFO ] [MAIN ] IP: Full history saved. [2025-10-08T19:37:46.915505] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IP took 32.9s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-08T19:37:47.089842] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:37:47.117872] [DEBUG] [LOCAL ] IRS: Loaded 22364 existing records from primary storage. [2025-10-08T19:37:47.118351] [INFO ] [MAIN ] IRS: Loaded 22364 existing records. [2025-10-08T19:37:47.218638] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-08T19:37:47.302243] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:37:47.311612] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-08T19:37:47.324376] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-08T19:37:47.328528] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-08T19:37:47.328452] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T19:37:47.328676] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-08T19:37:47.686087] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:37:48.017511] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-08T19:37:48.309277] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T19:37:48.401366] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:37:48.817558] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-08T19:37:48.989512] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T19:37:49.617546] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-08T19:37:50.417542] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-08T19:37:50.478735] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T19:37:51.072349] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T19:37:51.217575] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-08T19:37:51.576839] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:37:52.017560] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-08T19:37:52.330097] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:37:52.817599] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-08T19:37:53.617521] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-08T19:37:53.727199] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:37:54.417580] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-08T19:37:54.701427] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T19:37:54.741382] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T19:37:55.217573] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-08T19:37:56.022675] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-08T19:37:56.048298] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:37:56.770278] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:37:56.817542] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-08T19:37:57.617729] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-08T19:37:57.839726] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:37:58.343682] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:37:58.366525] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:37:58.417613] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-08T19:37:59.217564] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-08T19:37:59.934463] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:38:00.017545] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-08T19:38:00.822703] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-08T19:38:00.858209] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:38:01.617603] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-08T19:38:01.837752] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T19:38:02.417547] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-08T19:38:02.526166] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T19:38:02.773274] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T19:38:03.217547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-08T19:38:03.958323] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:38:04.017556] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-08T19:38:04.762341] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:38:04.817568] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-08T19:38:05.034586] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:38:05.617630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-08T19:38:06.234833] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:38:06.417587] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-08T19:38:06.442634] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T19:38:07.217630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-08T19:38:08.031161] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-08T19:38:08.034674] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:38:08.177447] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:38:08.817567] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-08T19:38:09.344960] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:38:09.617547] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-08T19:38:10.416198] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:38:10.425720] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-08T19:38:11.217563] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-08T19:38:11.367277] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T19:38:11.380963] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T19:38:12.017596] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-08T19:38:12.817550] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-08T19:38:13.001486] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T19:38:13.617548] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-08T19:38:13.931447] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-08T19:38:14.417521] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-08T19:38:14.454627] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T19:38:14.458625] [INFO ] [REMOTE ] IQV: Full fetch complete (72148 records). [2025-10-08T19:38:14.458773] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-08T19:38:14.754961] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T19:38:14.880022] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-08T19:38:14.880105] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-08T19:38:14.881058] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-08T19:38:14.881123] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-08T19:38:14.882549] [DEBUG] [LOCAL ] IQV: Trimmed 72148 records to 50072 (keeping 200 days of data) [2025-10-08T19:38:15.195412] [DEBUG] [LOCAL ] IQV: Primary data saved (50072 records). [2025-10-08T19:38:15.195580] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-08T19:38:15.195775] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQV took 34.4s. Estimated remaining: 2h 55m 12s. Rate: 7.1 symbols/min [2025-10-08T19:38:15.227013] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-08T19:38:15.365172] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:15.410359] [DEBUG] [LOCAL ] IRT: Loaded 50400 existing records from primary storage. [2025-10-08T19:38:15.410711] [INFO ] [MAIN ] IRT: Loaded 50400 existing records. [2025-10-08T19:38:15.582869] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:15.583066] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-08T19:38:15.583115] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-08T19:38:15.584273] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-08T19:38:15.584337] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-08T19:38:15.935948] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:16.017509] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-08T19:38:16.093114] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T19:38:16.097141] [INFO ] [REMOTE ] IR: Full fetch complete (76230 records). [2025-10-08T19:38:16.097316] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-08T19:38:16.484042] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-08T19:38:16.484324] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-08T19:38:16.485528] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-08T19:38:16.485720] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-08T19:38:16.487275] [DEBUG] [LOCAL ] IR: Trimmed 76230 records to 52750 (keeping 200 days of data) [2025-10-08T19:38:16.755092] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T19:38:16.824401] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-08T19:38:16.872254] [DEBUG] [LOCAL ] IR: Primary data saved (52750 records). [2025-10-08T19:38:16.872422] [INFO ] [MAIN ] IR: Full history saved. [2025-10-08T19:38:16.872510] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IR took 36.0s. Estimated remaining: 2h 54m 56s. Rate: 7.1 symbols/min [2025-10-08T19:38:17.052965] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:17.070887] [DEBUG] [LOCAL ] ISD: Loaded 15796 existing records from primary storage. [2025-10-08T19:38:17.071216] [INFO ] [MAIN ] ISD: Loaded 15796 existing records. [2025-10-08T19:38:17.340764] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:17.341187] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-08T19:38:17.341361] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-08T19:38:17.342252] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-08T19:38:17.342434] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-08T19:38:17.495823] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:38:17.622708] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-08T19:38:17.856486] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:17.905537] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:38:17.908080] [INFO ] [REMOTE ] IRS: Full fetch complete (32335 records). [2025-10-08T19:38:17.908165] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-08T19:38:18.269944] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-08T19:38:18.270030] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-08T19:38:18.270728] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-08T19:38:18.270791] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-08T19:38:18.271575] [DEBUG] [LOCAL ] IRS: Trimmed 32335 records to 22476 (keeping 200 days of data) [2025-10-08T19:38:18.401709] [DEBUG] [LOCAL ] IRS: Primary data saved (22476 records). [2025-10-08T19:38:18.401847] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-08T19:38:18.401930] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRS took 31.5s. Estimated remaining: 2h 54m 40s. Rate: 7.1 symbols/min [2025-10-08T19:38:18.422674] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-08T19:38:18.570708] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:18.610684] [DEBUG] [LOCAL ] IT: Loaded 42202 existing records from primary storage. [2025-10-08T19:38:18.610993] [INFO ] [MAIN ] IT: Loaded 42202 existing records. [2025-10-08T19:38:18.782712] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:18.782925] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-08T19:38:18.782971] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-08T19:38:18.783180] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-08T19:38:18.783238] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-08T19:38:19.139377] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:19.217509] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-08T19:38:19.285931] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:38:19.652935] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:38:20.017570] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-08T19:38:20.320963] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:38:20.817545] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-08T19:38:21.088638] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:38:21.617567] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-08T19:38:22.351946] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:38:22.417542] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-08T19:38:23.027491] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:38:23.217563] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-08T19:38:23.870958] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:38:24.017554] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-08T19:38:24.629595] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:38:24.633938] [INFO ] [REMOTE ] IRM: Full fetch complete (72303 records). [2025-10-08T19:38:24.634075] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-08T19:38:24.822800] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-08T19:38:25.077901] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-08T19:38:25.078000] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-08T19:38:25.078982] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-08T19:38:25.079047] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-08T19:38:25.080495] [DEBUG] [LOCAL ] IRM: Trimmed 72303 records to 49267 (keeping 200 days of data) [2025-10-08T19:38:25.394514] [DEBUG] [LOCAL ] IRM: Primary data saved (49267 records). [2025-10-08T19:38:25.394699] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-08T19:38:25.394801] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRM took 44.0s. Estimated remaining: 2h 54m 30s. Rate: 7.1 symbols/min [2025-10-08T19:38:25.581671] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T19:38:25.598589] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:25.617507] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-08T19:38:25.645099] [DEBUG] [LOCAL ] ITGR: Loaded 31277 existing records from primary storage. [2025-10-08T19:38:25.645394] [INFO ] [MAIN ] ITGR: Loaded 31277 existing records. [2025-10-08T19:38:25.820633] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:25.820912] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-08T19:38:25.820960] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-08T19:38:25.821428] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-08T19:38:25.821486] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-08T19:38:26.175199] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:26.193681] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T19:38:26.417530] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-08T19:38:26.802300] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:38:27.217520] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-08T19:38:27.347075] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T19:38:28.017566] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-08T19:38:28.080811] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T19:38:28.817539] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-08T19:38:29.020081] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T19:38:29.617557] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-08T19:38:29.674272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T19:38:30.417544] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-08T19:38:31.184379] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:38:31.217562] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-08T19:38:32.013798] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T19:38:32.023194] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-08T19:38:32.483787] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T19:38:32.817586] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-08T19:38:33.074747] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T19:38:33.617562] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-08T19:38:34.204859] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:38:34.417602] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-08T19:38:35.121608] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:38:35.217550] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-08T19:38:36.017585] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-08T19:38:36.092062] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T19:38:36.687180] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:38:36.817534] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-08T19:38:37.012869] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T19:38:37.617580] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-08T19:38:38.368625] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:38:38.417544] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-08T19:38:38.533804] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T19:38:39.217566] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-08T19:38:40.010227] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T19:38:40.014568] [INFO ] [REMOTE ] IRT: Full fetch complete (72762 records). [2025-10-08T19:38:40.014749] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-08T19:38:40.026603] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-08T19:38:40.152045] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:38:40.437468] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-08T19:38:40.437562] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-08T19:38:40.438551] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-08T19:38:40.438621] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-08T19:38:40.440167] [DEBUG] [LOCAL ] IRT: Trimmed 72762 records to 50424 (keeping 200 days of data) [2025-10-08T19:38:40.751333] [DEBUG] [LOCAL ] IRT: Primary data saved (50424 records). [2025-10-08T19:38:40.751499] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-08T19:38:40.751589] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRT took 25.6s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-08T19:38:40.826829] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-08T19:38:40.923951] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:40.960307] [DEBUG] [LOCAL ] ITT: Loaded 32663 existing records from primary storage. [2025-10-08T19:38:40.960594] [INFO ] [MAIN ] ITT: Loaded 32663 existing records. [2025-10-08T19:38:41.140573] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:41.140850] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-08T19:38:41.140898] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-08T19:38:41.141141] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-08T19:38:41.141198] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-08T19:38:41.521111] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:41.565908] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:38:41.617543] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-08T19:38:42.382142] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:38:42.417541] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-08T19:38:42.690287] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T19:38:43.217598] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-08T19:38:43.938721] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:38:44.017505] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-08T19:38:44.446218] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:38:44.817530] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-08T19:38:45.590391] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:38:45.594835] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T19:38:45.617492] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-08T19:38:46.417568] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-08T19:38:47.217522] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-08T19:38:47.293231] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T19:38:47.296709] [INFO ] [REMOTE ] IT: Full fetch complete (56681 records). [2025-10-08T19:38:47.296810] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-08T19:38:47.666624] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:38:47.714356] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-08T19:38:47.714903] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-08T19:38:47.715942] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-08T19:38:47.716010] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-08T19:38:47.717419] [DEBUG] [LOCAL ] IT: Trimmed 56681 records to 42164 (keeping 200 days of data) [2025-10-08T19:38:47.981851] [DEBUG] [LOCAL ] IT: Primary data saved (42164 records). [2025-10-08T19:38:47.981990] [INFO ] [MAIN ] IT: Full history saved. [2025-10-08T19:38:47.982084] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IT took 29.6s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-10-08T19:38:48.024088] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-08T19:38:48.162685] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:48.211915] [DEBUG] [LOCAL ] ITUB: Loaded 53315 existing records from primary storage. [2025-10-08T19:38:48.212276] [INFO ] [MAIN ] ITUB: Loaded 53315 existing records. [2025-10-08T19:38:48.392229] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:48.392470] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-08T19:38:48.392548] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-08T19:38:48.392900] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-08T19:38:48.393022] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-08T19:38:48.502354] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:38:48.769313] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:48.817490] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-08T19:38:49.099828] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T19:38:49.617617] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-08T19:38:50.297878] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:38:50.417564] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-08T19:38:50.840855] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:38:51.217519] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-08T19:38:51.273127] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:38:52.017580] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-08T19:38:52.380394] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:38:52.817580] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-08T19:38:53.324589] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:38:53.478326] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:38:53.480304] [INFO ] [REMOTE ] ISD: Full fetch complete (24125 records). [2025-10-08T19:38:53.480383] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-08T19:38:53.622799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-08T19:38:53.848352] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-08T19:38:53.848433] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-08T19:38:53.849002] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-08T19:38:53.849066] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-08T19:38:53.849740] [DEBUG] [LOCAL ] ISD: Trimmed 24125 records to 15838 (keeping 200 days of data) [2025-10-08T19:38:53.953001] [DEBUG] [LOCAL ] ISD: Primary data saved (15838 records). [2025-10-08T19:38:53.953147] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-08T19:38:53.953234] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ISD took 37.1s. Estimated remaining: 2h 54m 9s. Rate: 7.1 symbols/min [2025-10-08T19:38:54.130795] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:38:54.176954] [DEBUG] [LOCAL ] ITW: Loaded 45729 existing records from primary storage. [2025-10-08T19:38:54.177270] [INFO ] [MAIN ] ITW: Loaded 45729 existing records. [2025-10-08T19:38:54.350847] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:38:54.351116] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-08T19:38:54.351169] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-08T19:38:54.351417] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-08T19:38:54.351474] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-08T19:38:54.422705] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-08T19:38:54.704511] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:38:55.163170] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T19:38:55.217495] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-08T19:38:55.744434] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:38:56.017573] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-08T19:38:56.744155] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T19:38:56.817520] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-08T19:38:57.015322] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T19:38:57.617550] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-08T19:38:58.417529] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-08T19:38:58.656719] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:38:58.679223] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:38:59.217577] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-08T19:38:59.827295] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T19:39:00.017682] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-08T19:39:00.568123] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:39:00.817695] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-08T19:39:01.617523] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-08T19:39:01.892025] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T19:39:02.417573] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-08T19:39:02.725415] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T19:39:02.830676] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:39:02.833253] [INFO ] [REMOTE ] ITGR: Full fetch complete (42248 records). [2025-10-08T19:39:02.833352] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-08T19:39:03.216771] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-08T19:39:03.216857] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-08T19:39:03.217671] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-08T19:39:03.217593] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-08T19:39:03.218810] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-08T19:39:03.219879] [DEBUG] [LOCAL ] ITGR: Trimmed 42248 records to 31212 (keeping 200 days of data) [2025-10-08T19:39:03.418293] [DEBUG] [LOCAL ] ITGR: Primary data saved (31212 records). [2025-10-08T19:39:03.418466] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-08T19:39:03.418616] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITGR took 38.0s. Estimated remaining: 2h 54m 1s. Rate: 7.1 symbols/min [2025-10-08T19:39:03.605472] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:03.651565] [DEBUG] [LOCAL ] IVR: Loaded 48059 existing records from primary storage. [2025-10-08T19:39:03.651984] [INFO ] [MAIN ] IVR: Loaded 48059 existing records. [2025-10-08T19:39:03.849719] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:03.850012] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-08T19:39:03.850096] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-08T19:39:03.850401] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-08T19:39:03.850483] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-08T19:39:04.019630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-08T19:39:04.117145] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T19:39:04.267777] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:04.817515] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-08T19:39:04.849251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T19:39:05.622632] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-08T19:39:05.643669] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:39:06.348468] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T19:39:06.417510] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-08T19:39:06.763156] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:39:07.217572] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-08T19:39:08.017601] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-08T19:39:08.337115] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T19:39:08.817597] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-08T19:39:08.948957] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:39:08.978986] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:39:09.617561] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-08T19:39:10.417605] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-08T19:39:10.505743] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T19:39:10.680521] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:39:11.217560] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-08T19:39:11.713373] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:39:12.017545] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-08T19:39:12.817510] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-08T19:39:12.924025] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:39:13.560743] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:39:13.617527] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-08T19:39:14.417566] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-08T19:39:14.475116] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T19:39:15.121518] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:39:15.217526] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-08T19:39:15.753513] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T19:39:16.017604] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-08T19:39:16.692872] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:39:16.817548] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-08T19:39:17.317536] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:39:17.617546] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-08T19:39:18.056864] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:39:18.417547] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-08T19:39:19.217550] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-08T19:39:19.541560] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:39:19.547532] [INFO ] [REMOTE ] ITUB: Full fetch complete (77157 records). [2025-10-08T19:39:19.547823] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-08T19:39:19.972221] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-08T19:39:19.972325] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-08T19:39:19.973383] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-08T19:39:19.973518] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-08T19:39:19.975640] [DEBUG] [LOCAL ] ITUB: Trimmed 77157 records to 53313 (keeping 200 days of data) [2025-10-08T19:39:20.026167] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-08T19:39:20.111240] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:39:20.339467] [DEBUG] [LOCAL ] ITUB: Primary data saved (53313 records). [2025-10-08T19:39:20.339612] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-08T19:39:20.339722] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITUB took 32.4s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-10-08T19:39:20.540691] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:20.575489] [DEBUG] [LOCAL ] IVT: Loaded 30888 existing records from primary storage. [2025-10-08T19:39:20.575849] [INFO ] [MAIN ] IVT: Loaded 30888 existing records. [2025-10-08T19:39:20.823119] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-08T19:39:20.822966] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:20.825096] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-08T19:39:20.825167] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-08T19:39:20.825401] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-08T19:39:20.825490] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-08T19:39:21.207059] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:21.241158] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T19:39:21.313062] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:39:21.315768] [INFO ] [REMOTE ] ITT: Full fetch complete (46965 records). [2025-10-08T19:39:21.315913] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-08T19:39:21.622732] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-08T19:39:21.784355] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-08T19:39:21.784455] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-08T19:39:21.785662] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-08T19:39:21.785729] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-08T19:39:21.787168] [DEBUG] [LOCAL ] ITT: Trimmed 46965 records to 32595 (keeping 200 days of data) [2025-10-08T19:39:22.009066] [DEBUG] [LOCAL ] ITT: Primary data saved (32595 records). [2025-10-08T19:39:22.009224] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-08T19:39:22.010203] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 41.3s. Estimated remaining: 2h 53m 46s. Rate: 7.1 symbols/min [2025-10-08T19:39:22.211835] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:22.266994] [DEBUG] [LOCAL ] IVZ: Loaded 53132 existing records from primary storage. [2025-10-08T19:39:22.267462] [INFO ] [MAIN ] IVZ: Loaded 53132 existing records. [2025-10-08T19:39:22.450819] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:22.451057] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-08T19:39:22.452766] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-08T19:39:22.452864] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-08T19:39:22.453252] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-08T19:39:22.453458] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-08T19:39:22.575233] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:39:23.004378] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:23.217519] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-08T19:39:23.328707] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:39:23.829007] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:39:24.017611] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-08T19:39:24.813579] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T19:39:24.823408] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-08T19:39:25.617513] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-08T19:39:25.685759] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T19:39:26.137025] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:39:26.417588] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-08T19:39:27.066709] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:39:27.217571] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-08T19:39:28.017607] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-08T19:39:28.107672] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T19:39:28.111562] [INFO ] [REMOTE ] IVR: Full fetch complete (69207 records). [2025-10-08T19:39:28.111720] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-08T19:39:28.507183] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-08T19:39:28.507283] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-08T19:39:28.508207] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-08T19:39:28.508279] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-08T19:39:28.509834] [DEBUG] [LOCAL ] IVR: Trimmed 69207 records to 48111 (keeping 200 days of data) [2025-10-08T19:39:28.802508] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T19:39:28.828207] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-08T19:39:28.843550] [DEBUG] [LOCAL ] IVR: Primary data saved (48111 records). [2025-10-08T19:39:28.843733] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-08T19:39:28.843835] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. IVR took 25.4s. Estimated remaining: 2h 53m 36s. Rate: 7.1 symbols/min [2025-10-08T19:39:29.027457] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:29.049296] [DEBUG] [LOCAL ] IX: Loaded 22307 existing records from primary storage. [2025-10-08T19:39:29.049676] [INFO ] [MAIN ] IX: Loaded 22307 existing records. [2025-10-08T19:39:29.246909] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:29.247141] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-08T19:39:29.247190] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-08T19:39:29.247400] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-08T19:39:29.247459] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-08T19:39:29.630639] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-08T19:39:29.671179] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:29.707761] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T19:39:30.083401] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:39:30.417530] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-08T19:39:31.217622] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-08T19:39:31.489420] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:39:31.489160] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:39:32.017586] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-08T19:39:32.228338] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T19:39:32.431337] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-08T19:39:32.817548] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-08T19:39:33.617555] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-08T19:39:34.375272] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T19:39:34.417571] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-08T19:39:34.950813] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:39:35.217561] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-08T19:39:35.935386] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T19:39:36.017546] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-08T19:39:36.563402] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:39:36.817718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-08T19:39:37.613256] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:39:37.622270] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-08T19:39:38.417520] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-08T19:39:38.465771] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T19:39:38.668828] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:39:39.217524] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-08T19:39:39.263696] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:39:40.017622] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-08T19:39:40.817512] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-08T19:39:40.857811] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T19:39:41.392211] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T19:39:41.541544] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T19:39:41.617544] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-08T19:39:42.417552] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-08T19:39:42.915877] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:39:43.217549] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-08T19:39:43.394007] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:39:44.017554] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-08T19:39:44.594592] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:39:44.598013] [INFO ] [REMOTE ] ITW: Full fetch complete (66425 records). [2025-10-08T19:39:44.598141] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-08T19:39:44.824687] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-08T19:39:44.999316] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-08T19:39:44.999405] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-08T19:39:45.000370] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-08T19:39:45.000435] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-08T19:39:45.001761] [DEBUG] [LOCAL ] ITW: Trimmed 66425 records to 45750 (keeping 200 days of data) [2025-10-08T19:39:45.299176] [DEBUG] [LOCAL ] ITW: Primary data saved (45750 records). [2025-10-08T19:39:45.299332] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-08T19:39:45.299455] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITW took 51.3s. Estimated remaining: 2h 53m 36s. Rate: 7.1 symbols/min [2025-10-08T19:39:45.476583] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:45.503712] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:39:45.549552] [DEBUG] [LOCAL ] J: Loaded 40213 existing records from primary storage. [2025-10-08T19:39:45.550017] [INFO ] [MAIN ] J: Loaded 40213 existing records. [2025-10-08T19:39:45.622693] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-08T19:39:45.760135] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:45.761480] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:39:45.761686] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-08T19:39:45.767578] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-08T19:39:45.768134] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-08T19:39:45.768191] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-08T19:39:46.116965] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:46.417550] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-08T19:39:46.681540] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:39:46.685942] [INFO ] [REMOTE ] IVT: Full fetch complete (45624 records). [2025-10-08T19:39:46.686092] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-08T19:39:47.097254] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-08T19:39:47.097337] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-08T19:39:47.098145] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-08T19:39:47.098240] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-08T19:39:47.099426] [DEBUG] [LOCAL ] IVT: Trimmed 45624 records to 30981 (keeping 200 days of data) [2025-10-08T19:39:47.218716] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-08T19:39:47.304883] [DEBUG] [LOCAL ] IVT: Primary data saved (30981 records). [2025-10-08T19:39:47.305033] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-08T19:39:47.305169] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVT took 27.0s. Estimated remaining: 2h 53m 21s. Rate: 7.1 symbols/min [2025-10-08T19:39:47.488934] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:39:47.518328] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:39:47.565524] [DEBUG] [LOCAL ] JBGS: Loaded 42319 existing records from primary storage. [2025-10-08T19:39:47.565864] [INFO ] [MAIN ] JBGS: Loaded 42319 existing records. [2025-10-08T19:39:47.747740] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:39:47.747986] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-08T19:39:47.748034] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-08T19:39:47.748246] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-08T19:39:47.748304] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-08T19:39:48.022747] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-08T19:39:48.145810] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:39:48.305529] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T19:39:48.817569] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-08T19:39:49.625795] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-08T19:39:49.646023] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T19:39:49.898552] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:39:50.417573] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-08T19:39:50.968232] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:39:51.217608] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-08T19:39:52.017583] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-08T19:39:52.162571] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T19:39:52.383953] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:39:52.817631] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-08T19:39:52.946463] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T19:39:53.617599] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-08T19:39:54.417735] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-08T19:39:54.418995] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T19:39:54.680076] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T19:39:55.217587] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-08T19:39:56.017542] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-08T19:39:56.131154] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T19:39:56.513004] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:39:56.817616] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-08T19:39:57.616517] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T19:39:57.625097] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-08T19:39:58.317108] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T19:39:58.417530] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-08T19:39:59.087283] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:39:59.217569] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-08T19:39:59.925066] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T19:40:00.017588] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-08T19:40:00.817573] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-08T19:40:00.830057] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T19:40:00.834113] [INFO ] [REMOTE ] IVZ: Full fetch complete (76815 records). [2025-10-08T19:40:00.834227] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-08T19:40:01.233303] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-08T19:40:01.233513] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-08T19:40:01.234810] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-08T19:40:01.234919] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-08T19:40:01.237373] [DEBUG] [LOCAL ] IVZ: Trimmed 76815 records to 53114 (keeping 200 days of data) [2025-10-08T19:40:01.375331] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T19:40:01.614011] [DEBUG] [LOCAL ] IVZ: Primary data saved (53114 records). [2025-10-08T19:40:01.614171] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-08T19:40:01.614286] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IVZ took 39.6s. Estimated remaining: 2h 53m 19s. Rate: 7.1 symbols/min [2025-10-08T19:40:01.626022] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-08T19:40:01.810629] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:01.854180] [DEBUG] [LOCAL ] JBI: Loaded 43410 existing records from primary storage. [2025-10-08T19:40:01.854550] [INFO ] [MAIN ] JBI: Loaded 43410 existing records. [2025-10-08T19:40:02.040763] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:02.040996] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-08T19:40:02.041044] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-08T19:40:02.041306] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-08T19:40:02.041376] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-08T19:40:02.428897] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-08T19:40:02.487211] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:02.784139] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T19:40:02.875299] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T19:40:03.217597] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-08T19:40:04.017513] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-08T19:40:04.052187] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T19:40:04.817600] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-08T19:40:04.881023] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T19:40:05.281750] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T19:40:05.431959] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T19:40:05.617598] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-08T19:40:06.417535] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-08T19:40:06.568100] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T19:40:06.570710] [INFO ] [REMOTE ] IX: Full fetch complete (27704 records). [2025-10-08T19:40:06.570892] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-08T19:40:06.981562] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-08T19:40:06.981731] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-08T19:40:06.982706] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-08T19:40:06.982775] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-08T19:40:06.984143] [DEBUG] [LOCAL ] IX: Trimmed 27704 records to 22302 (keeping 200 days of data) [2025-10-08T19:40:07.149379] [DEBUG] [LOCAL ] IX: Primary data saved (22302 records). [2025-10-08T19:40:07.149586] [INFO ] [MAIN ] IX: Full history saved. [2025-10-08T19:40:07.149726] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IX took 38.3s. Estimated remaining: 2h 53m 7s. Rate: 7.1 symbols/min [2025-10-08T19:40:07.231208] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-08T19:40:07.357574] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:07.415197] [DEBUG] [LOCAL ] JBL: Loaded 48387 existing records from primary storage. [2025-10-08T19:40:07.415736] [INFO ] [MAIN ] JBL: Loaded 48387 existing records. [2025-10-08T19:40:07.610062] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:07.610595] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-08T19:40:07.610771] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-08T19:40:07.611159] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-08T19:40:07.611230] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-08T19:40:07.909432] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:40:08.040615] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-08T19:40:08.047037] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:08.683687] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:40:08.817584] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-08T19:40:09.149912] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:40:09.617591] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-08T19:40:09.807943] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T19:40:10.417574] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-08T19:40:11.112249] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:40:11.217571] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-08T19:40:11.996062] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:40:12.017582] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-08T19:40:12.328150] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T19:40:12.817556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-08T19:40:13.439398] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:40:13.442618] [INFO ] [REMOTE ] JBGS: Full fetch complete (59414 records). [2025-10-08T19:40:13.442750] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-08T19:40:13.630235] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-08T19:40:13.844129] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-08T19:40:13.844227] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-08T19:40:13.845061] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-08T19:40:13.845125] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-08T19:40:13.846461] [DEBUG] [LOCAL ] JBGS: Trimmed 59414 records to 42213 (keeping 200 days of data) [2025-10-08T19:40:14.101321] [DEBUG] [LOCAL ] JBGS: Primary data saved (42213 records). [2025-10-08T19:40:14.101474] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-08T19:40:14.101562] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. JBGS took 26.8s. Estimated remaining: 2h 52m 57s. Rate: 7.1 symbols/min [2025-10-08T19:40:14.279862] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:14.307152] [DEBUG] [LOCAL ] JBND: Loaded 26404 existing records from primary storage. [2025-10-08T19:40:14.307430] [INFO ] [MAIN ] JBND: Loaded 26404 existing records. [2025-10-08T19:40:14.429524] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-08T19:40:14.492100] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:14.492668] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-08T19:40:14.492890] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-08T19:40:14.493184] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-08T19:40:14.493341] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-08T19:40:14.624352] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T19:40:14.908223] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:15.009868] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T19:40:15.217559] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-08T19:40:15.708842] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T19:40:16.017556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-08T19:40:16.550287] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:40:16.817578] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-08T19:40:17.623931] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-08T19:40:17.647318] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T19:40:17.806420] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:40:18.417636] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-08T19:40:19.057734] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:40:19.062597] [INFO ] [REMOTE ] J: Full fetch complete (59191 records). [2025-10-08T19:40:19.062799] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-08T19:40:19.222742] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-08T19:40:19.476576] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-08T19:40:19.476681] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-08T19:40:19.477580] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-08T19:40:19.477665] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-08T19:40:19.478890] [DEBUG] [LOCAL ] J: Trimmed 59191 records to 40192 (keeping 200 days of data) [2025-10-08T19:40:19.734500] [DEBUG] [LOCAL ] J: Primary data saved (40192 records). [2025-10-08T19:40:19.734629] [INFO ] [MAIN ] J: Full history saved. [2025-10-08T19:40:19.734744] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. J took 34.4s. Estimated remaining: 2h 52m 46s. Rate: 7.1 symbols/min [2025-10-08T19:40:19.909010] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:19.909170] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-08T19:40:19.909206] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-08T19:40:19.909336] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-08T19:40:19.909380] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-08T19:40:19.909420] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-08T19:40:19.909452] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-08T19:40:20.018742] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-08T19:40:20.289458] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:20.320840] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T19:40:20.817571] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-08T19:40:20.956631] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T19:40:21.027503] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:40:21.027864] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-08T19:40:21.027956] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:40:21.028022] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-08T19:40:21.028086] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:40:21.028158] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-08T19:40:21.028223] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-08T19:40:21.028258] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-08T19:40:21.028297] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-08T19:40:21.028386] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBS took 1.3s. Estimated remaining: 2h 52m 30s. Rate: 7.1 symbols/min [2025-10-08T19:40:21.202308] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:21.202558] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-08T19:40:21.202626] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-08T19:40:21.202789] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-08T19:40:21.202849] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-08T19:40:21.202997] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-08T19:40:21.203162] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-08T19:40:21.351027] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T19:40:21.618581] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-08T19:40:21.621709] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:22.377162] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T19:40:22.417540] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-08T19:40:23.217582] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-08T19:40:23.482179] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:40:24.017548] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-08T19:40:24.817525] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-08T19:40:25.004395] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:40:25.005209] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-08T19:40:25.005359] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:40:25.007520] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T19:40:25.007627] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-08T19:40:25.011679] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:40:25.018286] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-08T19:40:25.019019] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-08T19:40:25.019483] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-08T19:40:25.019553] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-08T19:40:25.019606] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBTM took 4.0s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-08T19:40:25.208421] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:25.224548] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T19:40:25.235854] [DEBUG] [LOCAL ] JCE: Loaded 7029 existing records from primary storage. [2025-10-08T19:40:25.236057] [INFO ] [MAIN ] JCE: Loaded 7029 existing records. [2025-10-08T19:40:25.410855] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:25.411059] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-08T19:40:25.411107] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-08T19:40:25.411337] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-08T19:40:25.411395] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-08T19:40:25.622746] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-08T19:40:25.765002] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:26.417611] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-08T19:40:27.217525] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-08T19:40:27.301228] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:40:27.702106] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T19:40:28.022834] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-08T19:40:28.038799] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T19:40:28.556219] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T19:40:28.817561] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-08T19:40:29.617586] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-08T19:40:29.902309] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T19:40:30.417572] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-08T19:40:31.067530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:40:31.217527] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-08T19:40:31.794057] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T19:40:31.867146] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:40:32.017604] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-08T19:40:32.817612] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-08T19:40:33.545233] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T19:40:33.617513] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-08T19:40:33.636714] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T19:40:34.417552] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-08T19:40:34.960605] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T19:40:35.217520] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-08T19:40:35.304333] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T19:40:36.017556] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-08T19:40:36.656776] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:40:36.817582] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-08T19:40:37.311693] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:40:37.617575] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-08T19:40:37.861219] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T19:40:38.112706] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T19:40:38.417594] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-08T19:40:39.217554] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-08T19:40:39.989095] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:40:40.017547] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-08T19:40:40.572581] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T19:40:40.575904] [INFO ] [REMOTE ] JBI: Full fetch complete (64155 records). [2025-10-08T19:40:40.576027] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-08T19:40:40.691201] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:40:40.822734] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-08T19:40:40.985188] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-08T19:40:40.985283] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-08T19:40:40.986194] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-08T19:40:40.986262] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-08T19:40:40.987692] [DEBUG] [LOCAL ] JBI: Trimmed 64155 records to 43319 (keeping 200 days of data) [2025-10-08T19:40:41.234527] [DEBUG] [LOCAL ] JBI: Primary data saved (43319 records). [2025-10-08T19:40:41.234689] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-08T19:40:41.234788] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBI took 39.6s. Estimated remaining: 2h 52m 17s. Rate: 7.1 symbols/min [2025-10-08T19:40:41.407324] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:41.459557] [DEBUG] [LOCAL ] JCI: Loaded 53538 existing records from primary storage. [2025-10-08T19:40:41.460034] [INFO ] [MAIN ] JCI: Loaded 53538 existing records. [2025-10-08T19:40:41.617736] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-08T19:40:41.639176] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:41.640335] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-08T19:40:41.640388] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-08T19:40:41.640601] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-08T19:40:41.640702] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-08T19:40:42.004780] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:42.266333] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T19:40:42.417504] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-08T19:40:42.682985] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T19:40:43.135734] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:40:43.217546] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-08T19:40:44.017573] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-08T19:40:44.593526] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T19:40:44.754459] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:40:44.758183] [INFO ] [REMOTE ] JBL: Full fetch complete (70387 records). [2025-10-08T19:40:44.758301] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-08T19:40:44.822725] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-08T19:40:45.169434] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-08T19:40:45.169525] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-08T19:40:45.170515] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-08T19:40:45.170584] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-08T19:40:45.172026] [DEBUG] [LOCAL ] JBL: Trimmed 70387 records to 48364 (keeping 200 days of data) [2025-10-08T19:40:45.484561] [DEBUG] [LOCAL ] JBL: Primary data saved (48364 records). [2025-10-08T19:40:45.484770] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-08T19:40:45.484881] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBL took 38.3s. Estimated remaining: 2h 52m 4s. Rate: 7.1 symbols/min [2025-10-08T19:40:45.623491] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-08T19:40:45.657289] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:45.704363] [DEBUG] [LOCAL ] JEF: Loaded 50041 existing records from primary storage. [2025-10-08T19:40:45.704741] [INFO ] [MAIN ] JEF: Loaded 50041 existing records. [2025-10-08T19:40:45.891950] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:45.892183] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-08T19:40:45.892233] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-08T19:40:45.892512] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-08T19:40:45.892573] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-08T19:40:46.195148] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:40:46.285577] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:46.417596] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-08T19:40:47.217590] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-08T19:40:47.457589] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T19:40:48.024620] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-08T19:40:48.030527] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T19:40:48.272613] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:40:48.817602] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-08T19:40:49.432605] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:40:49.464527] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T19:40:49.617549] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-08T19:40:50.417553] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-08T19:40:51.209095] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T19:40:51.218886] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-08T19:40:51.591369] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:40:51.594283] [INFO ] [REMOTE ] JBND: Full fetch complete (34806 records). [2025-10-08T19:40:51.594367] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-08T19:40:51.894920] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T19:40:51.924809] [INFO ] [REMOTE ] JCE: Full fetch complete (9640 records). [2025-10-08T19:40:51.943424] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-08T19:40:52.026291] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-08T19:40:52.026506] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-08T19:40:52.038071] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-08T19:40:52.058094] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-08T19:40:52.070066] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-08T19:40:52.090097] [DEBUG] [LOCAL ] JBND: Trimmed 34806 records to 26515 (keeping 200 days of data) [2025-10-08T19:40:52.480829] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-08T19:40:52.482232] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-08T19:40:52.485433] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-08T19:40:52.486762] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-08T19:40:52.491198] [DEBUG] [LOCAL ] JCE: Trimmed 9640 records to 7134 (keeping 200 days of data) [2025-10-08T19:40:52.573256] [DEBUG] [LOCAL ] JCE: Primary data saved (7134 records). [2025-10-08T19:40:52.573873] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-08T19:40:52.573997] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 27.6s. Estimated remaining: 2h 51m 54s. Rate: 7.1 symbols/min [2025-10-08T19:40:52.714289] [DEBUG] [LOCAL ] JBND: Primary data saved (26515 records). [2025-10-08T19:40:52.734246] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-08T19:40:52.760525] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBND took 38.7s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-10-08T19:40:52.760429] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:52.824797] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-08T19:40:52.938158] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:40:52.958765] [DEBUG] [LOCAL ] JEQ: Loaded 8664 existing records from primary storage. [2025-10-08T19:40:52.959735] [INFO ] [MAIN ] JEQ: Loaded 8664 existing records. [2025-10-08T19:40:53.043512] [DEBUG] [LOCAL ] JELD: Loaded 46120 existing records from primary storage. [2025-10-08T19:40:53.092008] [INFO ] [MAIN ] JELD: Loaded 46120 existing records. [2025-10-08T19:40:53.288215] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:53.299076] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-08T19:40:53.299476] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-08T19:40:53.315428] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-08T19:40:53.325778] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-08T19:40:53.468862] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:40:53.479701] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-08T19:40:53.496020] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-08T19:40:53.496675] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-08T19:40:53.502455] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-08T19:40:54.127379] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:54.149518] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-08T19:40:54.149030] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:40:54.183970] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-08T19:40:54.417576] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-08T19:40:54.718348] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:40:55.217508] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-08T19:40:55.656859] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T19:40:55.691265] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:40:55.794425] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:40:56.017563] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-08T19:40:56.817615] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-08T19:40:57.429278] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:40:57.629061] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-08T19:40:57.657841] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T19:40:58.417560] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-08T19:40:58.850103] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T19:40:59.194800] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:40:59.217506] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-08T19:41:00.017573] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-08T19:41:00.817616] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-08T19:41:01.039937] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T19:41:01.513604] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:41:01.617710] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-08T19:41:02.054120] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T19:41:02.417570] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-08T19:41:02.654603] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T19:41:03.026018] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T19:41:03.217587] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-08T19:41:04.017584] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-08T19:41:04.817505] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-08T19:41:04.957553] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:41:05.426198] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:41:05.617562] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-08T19:41:06.200249] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T19:41:06.417558] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-08T19:41:07.118191] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T19:41:07.217572] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-08T19:41:08.017639] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-08T19:41:08.147785] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:41:08.458480] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:41:08.740823] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T19:41:08.817579] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-08T19:41:09.420434] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T19:41:09.617554] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-08T19:41:10.417613] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-08T19:41:11.194341] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:41:11.217494] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-08T19:41:11.688084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T19:41:12.017600] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-08T19:41:12.817519] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-08T19:41:13.061492] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T19:41:13.599483] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:41:13.617498] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-08T19:41:14.078923] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T19:41:14.080959] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:41:14.417558] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-08T19:41:15.007911] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:41:15.217541] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-08T19:41:16.017625] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-08T19:41:16.346627] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T19:41:16.817566] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-08T19:41:17.617581] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-08T19:41:17.698157] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T19:41:18.364239] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:41:18.417507] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-08T19:41:19.217510] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-08T19:41:19.500829] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:41:20.001745] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:41:20.019485] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-08T19:41:20.023735] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T19:41:20.817609] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-08T19:41:21.617573] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-08T19:41:21.744538] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:41:21.748337] [INFO ] [REMOTE ] JEF: Full fetch complete (73020 records). [2025-10-08T19:41:21.748437] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-08T19:41:22.223328] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-08T19:41:22.223675] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-08T19:41:22.225954] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-08T19:41:22.226046] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-08T19:41:22.228554] [DEBUG] [LOCAL ] JEF: Trimmed 73020 records to 50129 (keeping 200 days of data) [2025-10-08T19:41:22.335758] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T19:41:22.339777] [INFO ] [REMOTE ] JEQ: Full fetch complete (11882 records). [2025-10-08T19:41:22.340863] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-08T19:41:22.418056] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-08T19:41:22.638153] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T19:41:22.923358] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-08T19:41:22.924826] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-08T19:41:22.927094] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-08T19:41:22.928221] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-08T19:41:22.941306] [DEBUG] [LOCAL ] JEQ: Trimmed 11882 records to 8667 (keeping 200 days of data) [2025-10-08T19:41:23.067767] [DEBUG] [LOCAL ] JEQ: Primary data saved (8667 records). [2025-10-08T19:41:23.068497] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-08T19:41:23.069011] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JEQ took 30.3s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-08T19:41:23.174607] [DEBUG] [LOCAL ] JEF: Primary data saved (50129 records). [2025-10-08T19:41:23.174782] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-08T19:41:23.174873] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 37.7s. Estimated remaining: 2h 51m 34s. Rate: 7.1 symbols/min [2025-10-08T19:41:23.227799] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-08T19:41:23.362615] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:23.440372] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:23.468537] [DEBUG] [LOCAL ] JFR: Loaded 31002 existing records from primary storage. [2025-10-08T19:41:23.468920] [INFO ] [MAIN ] JFR: Loaded 31002 existing records. [2025-10-08T19:41:23.553915] [DEBUG] [LOCAL ] JGH: Loaded 11315 existing records from primary storage. [2025-10-08T19:41:23.572877] [INFO ] [MAIN ] JGH: Loaded 11315 existing records. [2025-10-08T19:41:23.793167] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:23.858485] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-08T19:41:23.864755] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-08T19:41:23.864596] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:23.865631] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-08T19:41:23.865767] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-08T19:41:23.866057] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-08T19:41:23.866184] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-08T19:41:23.871369] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-08T19:41:23.914545] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-08T19:41:24.621410] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-08T19:41:24.704437] [INFO ] [REMOTE ] JCI: Full fetch complete (77410 records). [2025-10-08T19:41:24.673088] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:24.706483] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T19:41:24.704288] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:24.705337] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-08T19:41:24.705738] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-08T19:41:24.723938] [INFO ] [REMOTE ] JELD: Full fetch complete (64136 records). [2025-10-08T19:41:24.752850] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-08T19:41:24.819532] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-08T19:41:25.478562] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-08T19:41:25.485139] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-08T19:41:25.513002] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-08T19:41:25.516257] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-08T19:41:25.605826] [DEBUG] [LOCAL ] JCI: Trimmed 77410 records to 53539 (keeping 200 days of data) [2025-10-08T19:41:25.634777] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-08T19:41:25.634952] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-08T19:41:25.635623] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-08T19:41:25.635772] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-08T19:41:25.691402] [DEBUG] [LOCAL ] JELD: Trimmed 64136 records to 46112 (keeping 200 days of data) [2025-10-08T19:41:26.093453] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:41:26.115006] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-08T19:41:26.119463] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:41:26.289927] [DEBUG] [LOCAL ] JELD: Primary data saved (46112 records). [2025-10-08T19:41:26.290937] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-08T19:41:26.291385] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JELD took 33.7s. Estimated remaining: 2h 51m 20s. Rate: 7.1 symbols/min [2025-10-08T19:41:26.421715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-08T19:41:26.477525] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:26.496568] [DEBUG] [LOCAL ] JCI: Primary data saved (53539 records). [2025-10-08T19:41:26.496880] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-08T19:41:26.496992] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JCI took 45.3s. Estimated remaining: 2h 51m 3s. Rate: 7.1 symbols/min [2025-10-08T19:41:26.684061] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:26.710981] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T19:41:26.714961] [DEBUG] [LOCAL ] JHG: Loaded 47590 existing records from primary storage. [2025-10-08T19:41:26.715495] [INFO ] [MAIN ] JHG: Loaded 47590 existing records. [2025-10-08T19:41:26.802550] [DEBUG] [LOCAL ] JHI: Loaded 3696 existing records from primary storage. [2025-10-08T19:41:26.823549] [INFO ] [MAIN ] JHI: Loaded 3696 existing records. [2025-10-08T19:41:27.046698] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:27.067189] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-08T19:41:27.076487] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-08T19:41:27.090218] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:27.090431] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-08T19:41:27.090480] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-08T19:41:27.090566] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-08T19:41:27.090717] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-08T19:41:27.121963] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-08T19:41:27.137128] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-08T19:41:27.233081] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-08T19:41:27.657736] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:27.830304] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:27.836314] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T19:41:27.870818] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:41:28.017548] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-08T19:41:28.594808] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T19:41:28.817577] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-08T19:41:29.275109] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-08T19:41:29.617546] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-08T19:41:30.352585] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T19:41:30.417556] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-08T19:41:31.217538] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-08T19:41:31.287400] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T19:41:32.017553] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-08T19:41:32.817576] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-08T19:41:33.053436] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T19:41:33.429162] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T19:41:33.430487] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:41:33.617579] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-08T19:41:34.417567] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-08T19:41:34.960425] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T19:41:35.167806] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:41:35.217509] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-08T19:41:36.017572] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-08T19:41:36.185703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:41:36.487148] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T19:41:36.817572] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-08T19:41:37.617554] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-08T19:41:38.182445] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T19:41:38.325117] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:41:38.417550] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-08T19:41:38.863748] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T19:41:39.217557] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-08T19:41:39.829784] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T19:41:40.017546] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-08T19:41:40.795879] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T19:41:40.817495] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-08T19:41:41.449960] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T19:41:41.617582] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-08T19:41:42.417569] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-08T19:41:42.536951] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T19:41:42.538486] [INFO ] [REMOTE ] JGH: Full fetch complete (15159 records). [2025-10-08T19:41:42.538611] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-08T19:41:42.908888] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-08T19:41:42.908981] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-08T19:41:42.909375] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-08T19:41:42.909419] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-08T19:41:42.910123] [DEBUG] [LOCAL ] JGH: Trimmed 15159 records to 11365 (keeping 200 days of data) [2025-10-08T19:41:42.983162] [DEBUG] [LOCAL ] JGH: Primary data saved (11365 records). [2025-10-08T19:41:42.983341] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-08T19:41:42.983469] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JGH took 19.8s. Estimated remaining: 2h 51m 3s. Rate: 7.1 symbols/min [2025-10-08T19:41:43.159927] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:41:43.165908] [DEBUG] [LOCAL ] JHS: Loaded 2876 existing records from primary storage. [2025-10-08T19:41:43.166122] [INFO ] [MAIN ] JHS: Loaded 2876 existing records. [2025-10-08T19:41:43.223991] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-08T19:41:43.358834] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:41:43.359102] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-08T19:41:43.359153] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-08T19:41:43.359292] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-08T19:41:43.359330] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-08T19:41:43.705775] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T19:41:43.775581] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:41:44.017561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-08T19:41:44.521197] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:41:44.817605] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-08T19:41:45.266822] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:41:45.617597] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-08T19:41:46.034067] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T19:41:46.274304] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:41:46.417534] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-08T19:41:47.217550] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-08T19:41:47.628388] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-08T19:41:47.889206] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T19:41:48.017553] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-08T19:41:48.464471] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T19:41:48.817595] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-08T19:41:49.617561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-08T19:41:50.012979] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T19:41:50.417523] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-08T19:41:50.727534] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:41:50.797523] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T19:41:51.217552] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-08T19:41:51.771558] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:41:52.017568] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-08T19:41:52.604576] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:41:52.817592] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-08T19:41:53.617634] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-08T19:41:54.173206] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:41:54.187466] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T19:41:54.417626] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-08T19:41:54.869183] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:41:55.217580] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-08T19:41:55.748541] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T19:41:56.017574] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-08T19:41:56.467692] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T19:41:56.817597] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-08T19:41:57.617578] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-08T19:41:58.217934] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T19:41:58.427367] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-08T19:41:58.442387] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T19:41:58.874225] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T19:41:59.217603] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-08T19:41:59.816931] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T19:41:59.818364] [INFO ] [REMOTE ] JHI: Full fetch complete (5328 records). [2025-10-08T19:41:59.818870] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-08T19:42:00.024705] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-08T19:42:00.194730] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-08T19:42:00.194819] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-08T19:42:00.194992] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-08T19:42:00.195035] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-08T19:42:00.195401] [DEBUG] [LOCAL ] JHI: Trimmed 5328 records to 3717 (keeping 200 days of data) [2025-10-08T19:42:00.218145] [DEBUG] [LOCAL ] JHI: Primary data saved (3717 records). [2025-10-08T19:42:00.218214] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-08T19:42:00.218308] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JHI took 33.7s. Estimated remaining: 2h 51m 4s. Rate: 7.1 symbols/min [2025-10-08T19:42:00.391148] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:00.442819] [DEBUG] [LOCAL ] JHX: Loaded 52906 existing records from primary storage. [2025-10-08T19:42:00.443239] [INFO ] [MAIN ] JHX: Loaded 52906 existing records. [2025-10-08T19:42:00.617870] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:00.618094] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-08T19:42:00.618156] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-08T19:42:00.618377] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-08T19:42:00.618436] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-08T19:42:00.822719] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-08T19:42:00.969899] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:01.570006] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:42:01.611347] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:42:01.621484] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-08T19:42:02.417582] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-08T19:42:02.668940] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T19:42:03.217604] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-08T19:42:03.968959] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T19:42:04.017567] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-08T19:42:04.568609] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T19:42:04.817559] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-08T19:42:05.471433] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T19:42:05.474960] [INFO ] [REMOTE ] JHG: Full fetch complete (68246 records). [2025-10-08T19:42:05.475069] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-08T19:42:05.626041] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-08T19:42:05.877139] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-08T19:42:05.877234] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-08T19:42:05.878150] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-08T19:42:05.878217] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-08T19:42:05.879723] [DEBUG] [LOCAL ] JHG: Trimmed 68246 records to 47568 (keeping 200 days of data) [2025-10-08T19:42:06.103498] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T19:42:06.108373] [INFO ] [REMOTE ] JFR: Full fetch complete (48331 records). [2025-10-08T19:42:06.109096] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-08T19:42:06.420041] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-08T19:42:06.538321] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-08T19:42:06.539227] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-08T19:42:06.540481] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-08T19:42:06.541370] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-08T19:42:06.545981] [DEBUG] [LOCAL ] JFR: Trimmed 48331 records to 31030 (keeping 200 days of data) [2025-10-08T19:42:06.656102] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T19:42:06.727298] [DEBUG] [LOCAL ] JHG: Primary data saved (47568 records). [2025-10-08T19:42:06.727965] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-08T19:42:06.728394] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JHG took 40.4s. Estimated remaining: 2h 50m 54s. Rate: 7.1 symbols/min [2025-10-08T19:42:06.927220] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:06.932934] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T19:42:07.010571] [DEBUG] [LOCAL ] JILL: Loaded 16381 existing records from primary storage. [2025-10-08T19:42:07.016047] [INFO ] [MAIN ] JILL: Loaded 16381 existing records. [2025-10-08T19:42:07.125434] [DEBUG] [LOCAL ] JFR: Primary data saved (31030 records). [2025-10-08T19:42:07.141253] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-08T19:42:07.151682] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JFR took 44.1s. Estimated remaining: 2h 50m 37s. Rate: 7.1 symbols/min [2025-10-08T19:42:07.222666] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-08T19:42:07.250132] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:07.279103] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-08T19:42:07.284613] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-08T19:42:07.316170] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-08T19:42:07.318719] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-08T19:42:07.498688] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:07.784094] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:07.799809] [DEBUG] [LOCAL ] JKS: Loaded 39913 existing records from primary storage. [2025-10-08T19:42:07.800144] [INFO ] [MAIN ] JKS: Loaded 39913 existing records. [2025-10-08T19:42:08.000822] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:08.001067] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-08T19:42:08.001115] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-08T19:42:08.001358] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-08T19:42:08.001415] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-08T19:42:08.022757] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-08T19:42:08.297779] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T19:42:08.380161] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:08.817579] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-08T19:42:08.936555] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:42:09.406220] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T19:42:09.617573] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-08T19:42:10.417582] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-08T19:42:10.508288] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T19:42:11.217573] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-08T19:42:11.597330] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:42:12.017583] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-08T19:42:12.635067] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:42:12.683209] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T19:42:12.817558] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-08T19:42:13.617497] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-08T19:42:13.720681] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T19:42:14.036965] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T19:42:14.417579] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-08T19:42:15.217560] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-08T19:42:16.017564] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-08T19:42:16.142224] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:42:16.353356] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:42:16.817566] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-08T19:42:17.459446] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T19:42:17.617603] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-08T19:42:18.131946] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T19:42:18.132831] [INFO ] [REMOTE ] JHS: Full fetch complete (4464 records). [2025-10-08T19:42:18.132919] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-08T19:42:18.428022] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-08T19:42:18.540704] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-08T19:42:18.550250] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-08T19:42:18.550447] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-08T19:42:18.550728] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-08T19:42:18.552237] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:42:18.552804] [DEBUG] [LOCAL ] JHS: Trimmed 4464 records to 2900 (keeping 200 days of data) [2025-10-08T19:42:18.579569] [DEBUG] [LOCAL ] JHS: Primary data saved (2900 records). [2025-10-08T19:42:18.579682] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-08T19:42:18.579820] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHS took 35.6s. Estimated remaining: 2h 50m 32s. Rate: 7.1 symbols/min [2025-10-08T19:42:18.757840] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:18.792130] [DEBUG] [LOCAL ] JLL: Loaded 31486 existing records from primary storage. [2025-10-08T19:42:18.792423] [INFO ] [MAIN ] JLL: Loaded 31486 existing records. [2025-10-08T19:42:18.981236] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:18.981468] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-08T19:42:18.981516] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-08T19:42:18.981737] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-08T19:42:18.981797] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-08T19:42:19.235500] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-08T19:42:19.276065] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:42:19.381225] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:20.017582] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-08T19:42:20.817553] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-08T19:42:21.056432] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:42:21.316592] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T19:42:21.617589] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-08T19:42:22.139774] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:42:22.417558] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-08T19:42:22.624509] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:42:23.217592] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-08T19:42:23.638049] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T19:42:23.968624] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T19:42:24.017584] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-08T19:42:24.817575] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-08T19:42:25.617587] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-08T19:42:25.707519] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T19:42:26.285883] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:42:26.417583] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-08T19:42:26.537531] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:42:27.217613] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-08T19:42:27.983371] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:42:28.017508] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-08T19:42:28.632453] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:42:28.817561] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-08T19:42:29.355578] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:42:29.573765] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:42:29.617499] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-08T19:42:30.286513] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:42:30.288053] [INFO ] [REMOTE ] JILL: Full fetch complete (22645 records). [2025-10-08T19:42:30.288126] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-08T19:42:30.430452] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-08T19:42:30.716138] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-08T19:42:30.716320] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-08T19:42:30.717210] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-08T19:42:30.717280] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-08T19:42:30.717989] [DEBUG] [LOCAL ] JILL: Trimmed 22645 records to 16249 (keeping 200 days of data) [2025-10-08T19:42:30.819226] [DEBUG] [LOCAL ] JILL: Primary data saved (16249 records). [2025-10-08T19:42:30.819374] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-08T19:42:30.819496] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JILL took 24.1s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-08T19:42:31.217596] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-08T19:42:31.875722] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:42:32.017541] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-08T19:42:32.754586] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T19:42:32.817499] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-08T19:42:33.617517] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-08T19:42:34.096603] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T19:42:34.296811] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:42:34.417542] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-08T19:42:35.085583] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T19:42:35.217570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-08T19:42:35.461077] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T19:42:36.017562] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-08T19:42:36.199187] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T19:42:36.817560] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-08T19:42:37.238398] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T19:42:37.617570] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-08T19:42:38.410957] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T19:42:38.421425] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-08T19:42:38.500949] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:42:39.217571] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-08T19:42:39.618952] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:42:39.622339] [INFO ] [REMOTE ] JKS: Full fetch complete (58745 records). [2025-10-08T19:42:39.622467] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-08T19:42:40.023396] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-08T19:42:40.027314] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-08T19:42:40.027373] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-08T19:42:40.028440] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-08T19:42:40.028639] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-08T19:42:40.030026] [DEBUG] [LOCAL ] JKS: Trimmed 58745 records to 39841 (keeping 200 days of data) [2025-10-08T19:42:40.274537] [DEBUG] [LOCAL ] JKS: Primary data saved (39841 records). [2025-10-08T19:42:40.274727] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-08T19:42:40.274827] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JKS took 33.1s. Estimated remaining: 2h 50m 20s. Rate: 7.1 symbols/min [2025-10-08T19:42:40.712085] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T19:42:40.717951] [INFO ] [REMOTE ] JHX: Full fetch complete (59891 records). [2025-10-08T19:42:40.718132] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-08T19:42:41.134145] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-08T19:42:41.134273] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-08T19:42:41.135240] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-08T19:42:41.135326] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-08T19:42:41.136950] [DEBUG] [LOCAL ] JHX: Trimmed 59891 records to 53151 (keeping 200 days of data) [2025-10-08T19:42:41.369566] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:42:41.380928] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-08T19:42:41.498920] [DEBUG] [LOCAL ] JHX: Primary data saved (53151 records). [2025-10-08T19:42:41.499086] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-08T19:42:41.499175] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 41.3s. Estimated remaining: 2h 50m 4s. Rate: 7.1 symbols/min [2025-10-08T19:42:42.824859] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:42:42.832792] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-08T19:42:44.200142] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:42:44.206912] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-08T19:42:45.178016] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:42:45.181151] [INFO ] [REMOTE ] JLL: Full fetch complete (44738 records). [2025-10-08T19:42:45.181438] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-08T19:42:45.741992] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-08T19:42:45.742135] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-08T19:42:45.742987] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-08T19:42:45.743064] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-08T19:42:45.744409] [DEBUG] [LOCAL ] JLL: Trimmed 44738 records to 31422 (keeping 200 days of data) [2025-10-08T19:42:45.983354] [DEBUG] [LOCAL ] JLL: Primary data saved (31422 records). [2025-10-08T19:42:45.983517] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-08T19:42:45.983607] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JLL took 27.4s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-08T19:42:46.679153] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.688232] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.709704] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-08T19:42:46.758705] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-08T19:42:46.750243] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.784800] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-08T19:42:46.786070] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-08T19:42:46.786569] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-08T19:42:46.785922] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:42:46.786802] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-08T19:42:46.803695] [DEBUG] [LOCAL ] JLS: Loaded 4146 existing records from primary storage. [2025-10-08T19:42:46.809473] [INFO ] [MAIN ] JLS: Loaded 4146 existing records. [2025-10-08T19:42:47.198483] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:47.209242] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-08T19:42:47.209561] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-08T19:42:47.242343] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-08T19:42:47.254563] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-08T19:42:47.243993] [DEBUG] [LOCAL ] JMIA: Loaded 50814 existing records from primary storage. [2025-10-08T19:42:47.317329] [INFO ] [MAIN ] JMIA: Loaded 50814 existing records. [2025-10-08T19:42:47.388533] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-08T19:42:47.428487] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-08T19:42:47.984472] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:47.967037] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.001033] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-08T19:42:48.001477] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-08T19:42:48.011869] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-08T19:42:48.137145] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-08T19:42:48.156484] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:42:48.158854] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-08T19:42:48.179957] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-08T19:42:48.210943] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-08T19:42:48.313185] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.335678] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-08T19:42:48.346952] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-08T19:42:48.336017] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-08T19:42:48.794286] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T19:42:48.832157] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-08T19:42:48.877274] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:48.896452] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-08T19:42:49.021602] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T19:42:49.031111] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-08T19:42:49.028664] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:42:49.032749] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-08T19:42:49.175104] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:42:49.176196] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-08T19:42:49.576568] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:42:49.578784] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-08T19:42:49.584614] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:42:49.617499] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-08T19:42:49.950542] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T19:42:49.985062] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:42:50.417514] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-08T19:42:50.722718] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-08T19:42:50.856968] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T19:42:51.186315] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T19:42:51.217527] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-08T19:42:52.017551] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-08T19:42:52.817523] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-08T19:42:53.441420] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T19:42:53.444669] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T19:42:53.617510] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-08T19:42:53.676521] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T19:42:54.417603] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-08T19:42:55.021056] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T19:42:55.217588] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-08T19:42:55.952084] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-08T19:42:56.017605] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-08T19:42:56.731163] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:42:56.817510] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-08T19:42:57.617552] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-08T19:42:58.092029] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T19:42:58.206369] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-08T19:42:58.355922] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:42:58.417630] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-08T19:42:58.781801] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T19:42:59.217607] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-08T19:43:00.017617] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-08T19:43:00.817562] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-08T19:43:01.583343] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T19:43:01.603462] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T19:43:01.617525] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-08T19:43:01.860985] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T19:43:01.905485] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-08T19:43:02.417591] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-08T19:43:03.217567] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-08T19:43:04.017572] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-08T19:43:04.220468] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:43:04.350610] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-08T19:43:04.817587] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-08T19:43:05.490934] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-08T19:43:05.617608] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-08T19:43:05.971293] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-08T19:43:05.972147] [INFO ] [REMOTE ] JMM: Full fetch complete (2313 records). [2025-10-08T19:43:05.972224] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-08T19:43:06.180568] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-08T19:43:06.180966] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:43:06.181056] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:43:06.181135] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-08T19:43:06.181243] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-08T19:43:06.181304] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-08T19:43:06.181374] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-08T19:43:06.181467] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 20.2s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-08T19:43:06.361873] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:06.414143] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-08T19:43:06.414522] [INFO ] [MAIN ] JOBY: Loaded 53801 existing records. [2025-10-08T19:43:06.425428] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-08T19:43:06.599187] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:06.599615] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-08T19:43:06.599761] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-08T19:43:06.600106] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-08T19:43:06.600175] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-08T19:43:06.743110] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T19:43:07.018210] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:07.217577] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-08T19:43:08.017598] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-08T19:43:08.532923] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T19:43:08.630105] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T19:43:08.817607] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-08T19:43:09.617576] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-08T19:43:09.663449] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-08T19:43:10.417567] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-08T19:43:10.916456] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-08T19:43:11.000682] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T19:43:11.217549] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-08T19:43:11.507252] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T19:43:12.017563] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-08T19:43:12.817584] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-08T19:43:13.190401] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T19:43:13.301830] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T19:43:13.617569] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-08T19:43:14.417578] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-08T19:43:14.592607] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-08T19:43:15.217555] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-08T19:43:15.397545] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T19:43:16.017589] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-08T19:43:16.242903] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:43:16.817550] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-08T19:43:17.231533] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T19:43:17.256438] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T19:43:17.617557] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-08T19:43:18.047275] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:43:18.076161] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-08T19:43:18.080087] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-08T19:43:18.080217] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-08T19:43:18.422753] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-08T19:43:18.470063] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-08T19:43:18.470145] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-08T19:43:18.471175] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-08T19:43:18.471286] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-08T19:43:18.473198] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 53753 (keeping 200 days of data) [2025-10-08T19:43:18.835156] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-08T19:43:18.835400] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-08T19:43:18.835520] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JNJ took 32.8s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-08T19:43:18.939741] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:43:18.946330] [INFO ] [REMOTE ] JLS: Full fetch complete (5816 records). [2025-10-08T19:43:18.956672] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-08T19:43:19.116297] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:19.222629] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-08T19:43:19.324751] [DEBUG] [LOCAL ] JOE: Loaded 23982 existing records from primary storage. [2025-10-08T19:43:19.335798] [INFO ] [MAIN ] JOE: Loaded 23982 existing records. [2025-10-08T19:43:19.521816] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-08T19:43:19.527537] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-08T19:43:19.543126] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-08T19:43:19.548301] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-08T19:43:19.572921] [DEBUG] [LOCAL ] JLS: Trimmed 5816 records to 4144 (keeping 200 days of data) [2025-10-08T19:43:19.613191] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:19.621254] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-08T19:43:19.621591] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-08T19:43:19.622386] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-08T19:43:19.622695] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-08T19:43:19.787450] [DEBUG] [LOCAL ] JLS: Primary data saved (4144 records). [2025-10-08T19:43:19.816004] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-08T19:43:19.881676] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLS took 33.9s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-08T19:43:20.029639] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-08T19:43:20.123958] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:20.178092] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:20.187130] [DEBUG] [LOCAL ] JOF: Loaded 6917 existing records from primary storage. [2025-10-08T19:43:20.187347] [INFO ] [MAIN ] JOF: Loaded 6917 existing records. [2025-10-08T19:43:20.363310] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:20.363521] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-08T19:43:20.363578] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-08T19:43:20.363794] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-08T19:43:20.363855] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-08T19:43:20.739410] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:20.817497] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-08T19:43:21.288320] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T19:43:21.459830] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-08T19:43:21.617553] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-08T19:43:22.194126] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:43:22.417526] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-08T19:43:22.606754] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-08T19:43:23.217567] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-08T19:43:24.017589] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-08T19:43:24.340530] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-08T19:43:24.344412] [INFO ] [REMOTE ] JMIA: Full fetch complete (73286 records). [2025-10-08T19:43:24.344519] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-08T19:43:24.639574] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:43:24.740216] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-08T19:43:24.740328] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-08T19:43:24.741277] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-08T19:43:24.741342] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-08T19:43:24.742849] [DEBUG] [LOCAL ] JMIA: Trimmed 73286 records to 50849 (keeping 200 days of data) [2025-10-08T19:43:24.822899] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-08T19:43:25.042980] [DEBUG] [LOCAL ] JMIA: Primary data saved (50849 records). [2025-10-08T19:43:25.043139] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-08T19:43:25.043230] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 39.0s. Estimated remaining: 2h 49m 23s. Rate: 7.1 symbols/min [2025-10-08T19:43:25.210151] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:25.245366] [DEBUG] [LOCAL ] JPC: Loaded 37176 existing records from primary storage. [2025-10-08T19:43:25.245720] [INFO ] [MAIN ] JPC: Loaded 37176 existing records. [2025-10-08T19:43:25.434621] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:25.435172] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-08T19:43:25.435461] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-08T19:43:25.435879] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-08T19:43:25.435945] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-08T19:43:25.537499] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:43:25.628453] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-08T19:43:25.818825] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:25.849909] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-08T19:43:26.417550] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-08T19:43:26.858949] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:43:27.217559] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-08T19:43:27.840767] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T19:43:28.017553] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-08T19:43:28.774243] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T19:43:28.817512] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-08T19:43:29.338210] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T19:43:29.617554] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-08T19:43:30.327416] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:43:30.417573] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-08T19:43:31.217542] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-08T19:43:31.706572] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T19:43:31.795453] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:43:31.859487] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-08T19:43:32.017546] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-08T19:43:32.699456] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:43:32.817627] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-08T19:43:33.348356] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T19:43:33.617555] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-08T19:43:34.417565] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-08T19:43:35.163220] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:43:35.167323] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:43:35.217513] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-08T19:43:36.017585] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-08T19:43:36.387087] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T19:43:36.817601] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-08T19:43:37.617578] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-08T19:43:37.647607] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T19:43:38.417543] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-08T19:43:38.570664] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-08T19:43:39.052002] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T19:43:39.217516] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-08T19:43:39.386373] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T19:43:40.017593] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-08T19:43:40.626060] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:43:40.817630] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-08T19:43:41.320029] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:43:41.518722] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T19:43:41.520035] [INFO ] [REMOTE ] JOF: Full fetch complete (9517 records). [2025-10-08T19:43:41.520112] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-08T19:43:41.622808] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-08T19:43:41.943067] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-08T19:43:41.943190] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-08T19:43:41.943548] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-08T19:43:41.943692] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-08T19:43:41.944414] [DEBUG] [LOCAL ] JOF: Trimmed 9517 records to 6878 (keeping 200 days of data) [2025-10-08T19:43:42.001267] [DEBUG] [LOCAL ] JOF: Primary data saved (6878 records). [2025-10-08T19:43:42.001485] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-08T19:43:42.001617] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOF took 22.1s. Estimated remaining: 2h 49m 24s. Rate: 7.1 symbols/min [2025-10-08T19:43:42.184758] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:42.251848] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-08T19:43:42.252382] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-08T19:43:42.422723] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-08T19:43:42.457014] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:42.457547] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-08T19:43:42.457611] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-08T19:43:42.458062] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-08T19:43:42.458126] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-08T19:43:42.851965] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:42.983605] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T19:43:43.217589] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-08T19:43:43.703543] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:43:44.017577] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-08T19:43:44.817557] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-08T19:43:45.517316] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-08T19:43:45.595224] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:43:45.617495] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-08T19:43:46.275167] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-08T19:43:46.417594] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-08T19:43:46.651781] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T19:43:47.217608] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-08T19:43:47.770800] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:43:48.017601] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-08T19:43:48.177798] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:43:48.817557] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-08T19:43:49.157728] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:43:49.617621] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-08T19:43:50.417608] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-08T19:43:50.877811] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:43:51.217537] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-08T19:43:51.562610] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-08T19:43:52.017574] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-08T19:43:52.349206] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:43:52.352689] [INFO ] [REMOTE ] JPC: Full fetch complete (55472 records). [2025-10-08T19:43:52.352873] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-08T19:43:52.751964] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-08T19:43:52.752150] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-08T19:43:52.753272] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-08T19:43:52.753574] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-08T19:43:52.761720] [DEBUG] [LOCAL ] JPC: Trimmed 55472 records to 37230 (keeping 200 days of data) [2025-10-08T19:43:52.771045] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T19:43:52.827165] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-08T19:43:52.902073] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-08T19:43:53.059458] [DEBUG] [LOCAL ] JPC: Primary data saved (37230 records). [2025-10-08T19:43:53.059669] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-08T19:43:53.059801] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JPC took 28.0s. Estimated remaining: 2h 49m 18s. Rate: 7.1 symbols/min [2025-10-08T19:43:53.226752] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:53.264726] [DEBUG] [LOCAL ] JQC: Loaded 34440 existing records from primary storage. [2025-10-08T19:43:53.265081] [INFO ] [MAIN ] JQC: Loaded 34440 existing records. [2025-10-08T19:43:53.444631] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:53.444920] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-08T19:43:53.444982] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-08T19:43:53.445260] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-08T19:43:53.445317] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-08T19:43:53.623257] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-08T19:43:53.843560] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:53.844696] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:43:54.417591] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-08T19:43:55.217526] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-08T19:43:55.393269] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T19:43:55.395276] [INFO ] [REMOTE ] JOE: Full fetch complete (35819 records). [2025-10-08T19:43:55.395353] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-08T19:43:55.794931] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-08T19:43:55.795036] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-08T19:43:55.795932] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-08T19:43:55.796004] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-08T19:43:55.797203] [DEBUG] [LOCAL ] JOE: Trimmed 35819 records to 23935 (keeping 200 days of data) [2025-10-08T19:43:55.952773] [DEBUG] [LOCAL ] JOE: Primary data saved (23935 records). [2025-10-08T19:43:55.952914] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-08T19:43:55.953032] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOE took 37.1s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-08T19:43:56.023873] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-08T19:43:56.181355] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:56.191289] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.57 seconds). [2025-10-08T19:43:56.203189] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-08T19:43:56.203406] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-08T19:43:56.309696] [DEBUG] [LOCAL ] JRI: Loaded 15101 existing records from primary storage. [2025-10-08T19:43:56.320892] [INFO ] [MAIN ] JRI: Loaded 15101 existing records. [2025-10-08T19:43:56.736874] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:56.752790] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-08T19:43:56.759628] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-08T19:43:56.775795] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-08T19:43:56.775969] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-08T19:43:57.046171] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-08T19:43:57.060900] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-08T19:43:57.091242] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-08T19:43:57.174154] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-08T19:43:57.256913] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53801 (keeping 200 days of data) [2025-10-08T19:43:57.350947] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:57.398852] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:43:57.395710] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-08T19:43:57.468139] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T19:43:57.617838] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-08T19:43:57.706917] [DEBUG] [LOCAL ] JOBY: Primary data saved (53801 records). [2025-10-08T19:43:57.707087] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-08T19:43:57.707220] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOBY took 51.5s. Estimated remaining: 2h 48m 49s. Rate: 7.1 symbols/min [2025-10-08T19:43:57.873917] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:43:57.887900] [DEBUG] [LOCAL ] JRS: Loaded 11483 existing records from primary storage. [2025-10-08T19:43:57.888153] [INFO ] [MAIN ] JRS: Loaded 11483 existing records. [2025-10-08T19:43:58.079000] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:43:58.079248] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-08T19:43:58.079295] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-08T19:43:58.079478] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-08T19:43:58.079536] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-08T19:43:58.420534] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-08T19:43:58.474493] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T19:43:58.480135] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:43:59.217610] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-08T19:43:59.574023] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:43:59.854375] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-08T19:43:59.892972] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T19:44:00.017558] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-08T19:44:00.817534] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-08T19:44:01.015539] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:44:01.617569] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-08T19:44:02.417542] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-08T19:44:02.891964] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:44:03.072934] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-08T19:44:03.188893] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:44:03.217546] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-08T19:44:04.017558] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-08T19:44:04.048226] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T19:44:04.817702] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-08T19:44:05.518616] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T19:44:05.617557] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-08T19:44:05.840342] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T19:44:06.417613] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-08T19:44:06.554278] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:44:07.217547] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-08T19:44:07.983927] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T19:44:08.017494] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-08T19:44:08.612533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T19:44:08.716733] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:44:08.817551] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-08T19:44:09.617579] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-08T19:44:09.920868] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:44:10.417553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-08T19:44:11.048305] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T19:44:11.204947] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T19:44:11.217488] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-08T19:44:12.002684] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T19:44:12.017511] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-08T19:44:12.817551] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-08T19:44:12.872635] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T19:44:13.455298] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T19:44:13.617556] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-08T19:44:14.417559] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-08T19:44:15.217589] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-08T19:44:15.822800] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-08T19:44:15.872940] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T19:44:15.964313] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T19:44:16.017501] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-08T19:44:16.817564] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-08T19:44:17.309360] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:44:17.617521] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-08T19:44:17.778103] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T19:44:17.779945] [INFO ] [REMOTE ] JRI: Full fetch complete (23260 records). [2025-10-08T19:44:17.780040] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-08T19:44:18.147291] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-08T19:44:18.147399] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-08T19:44:18.148038] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-08T19:44:18.148102] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-08T19:44:18.148771] [DEBUG] [LOCAL ] JRI: Trimmed 23260 records to 15167 (keeping 200 days of data) [2025-10-08T19:44:18.243020] [DEBUG] [LOCAL ] JRI: Primary data saved (15167 records). [2025-10-08T19:44:18.243168] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-08T19:44:18.243253] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JRI took 22.3s. Estimated remaining: 2h 48m 53s. Rate: 7.1 symbols/min [2025-10-08T19:44:18.409684] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:18.417518] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-08T19:44:18.458113] [DEBUG] [LOCAL ] JXN: Loaded 45206 existing records from primary storage. [2025-10-08T19:44:18.458759] [INFO ] [MAIN ] JXN: Loaded 45206 existing records. [2025-10-08T19:44:18.642418] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:18.642780] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-08T19:44:18.642851] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-08T19:44:18.643241] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-08T19:44:18.643298] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-08T19:44:18.995499] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:19.003112] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T19:44:19.217507] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-08T19:44:19.477711] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T19:44:20.017538] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-08T19:44:20.687431] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T19:44:20.817522] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-08T19:44:21.234000] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:44:21.617555] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-08T19:44:22.313417] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:44:22.339968] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:44:22.417508] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-08T19:44:23.217574] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-08T19:44:23.861270] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-08T19:44:23.983904] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T19:44:24.017554] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-08T19:44:24.817572] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-08T19:44:25.554836] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:44:25.617587] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-08T19:44:26.417576] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-08T19:44:26.677935] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:44:26.983243] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-08T19:44:27.217592] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-08T19:44:27.234279] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:44:28.017551] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-08T19:44:28.817513] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-08T19:44:28.897719] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T19:44:29.567575] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-08T19:44:29.572234] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-08T19:44:29.572359] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-08T19:44:29.622679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-08T19:44:29.977188] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-08T19:44:29.977269] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-08T19:44:29.978256] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-08T19:44:29.978321] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-08T19:44:29.979810] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 53794 (keeping 200 days of data) [2025-10-08T19:44:30.330426] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-08T19:44:30.330625] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-08T19:44:30.330766] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPM took 48.3s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-08T19:44:30.422172] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-08T19:44:30.507361] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:30.518858] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T19:44:30.521852] [INFO ] [REMOTE ] JRS: Full fetch complete (16351 records). [2025-10-08T19:44:30.522055] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-08T19:44:30.868046] [DEBUG] [LOCAL ] K: Loaded 50101 existing records from primary storage. [2025-10-08T19:44:30.897716] [INFO ] [MAIN ] K: Loaded 50101 existing records. [2025-10-08T19:44:30.931404] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-08T19:44:31.149707] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-08T19:44:31.150047] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-08T19:44:31.155834] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-08T19:44:31.155927] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-08T19:44:31.201913] [DEBUG] [LOCAL ] JRS: Trimmed 16351 records to 11551 (keeping 200 days of data) [2025-10-08T19:44:31.229424] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-08T19:44:31.237094] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:31.237375] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-08T19:44:31.237440] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-08T19:44:31.264891] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-08T19:44:31.271204] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-08T19:44:31.496319] [DEBUG] [LOCAL ] JRS: Primary data saved (11551 records). [2025-10-08T19:44:31.522498] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-08T19:44:31.546528] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JRS took 33.8s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-08T19:44:31.791596] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:31.794833] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T19:44:31.919415] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:31.939383] [DEBUG] [LOCAL ] KAI: Loaded 13296 existing records from primary storage. [2025-10-08T19:44:31.939736] [INFO ] [MAIN ] KAI: Loaded 13296 existing records. [2025-10-08T19:44:32.022723] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-08T19:44:32.123842] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:32.124067] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-08T19:44:32.124144] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-08T19:44:32.124410] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-08T19:44:32.124471] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-08T19:44:32.475031] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:32.817582] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-08T19:44:32.856079] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:44:33.218841] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:44:33.222570] [INFO ] [REMOTE ] JQC: Full fetch complete (49441 records). [2025-10-08T19:44:33.222705] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-08T19:44:33.622726] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-08T19:44:33.701040] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-08T19:44:33.701178] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-08T19:44:33.702616] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-08T19:44:33.702882] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-08T19:44:33.712802] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T19:44:33.716547] [DEBUG] [LOCAL ] JQC: Trimmed 49441 records to 34236 (keeping 200 days of data) [2025-10-08T19:44:33.955096] [DEBUG] [LOCAL ] JQC: Primary data saved (34236 records). [2025-10-08T19:44:33.955317] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-08T19:44:33.955439] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JQC took 40.9s. Estimated remaining: 2h 48m 18s. Rate: 7.1 symbols/min [2025-10-08T19:44:34.144331] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:34.187128] [DEBUG] [LOCAL ] KAR: Loaded 40083 existing records from primary storage. [2025-10-08T19:44:34.187564] [INFO ] [MAIN ] KAR: Loaded 40083 existing records. [2025-10-08T19:44:34.380510] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:34.380902] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-08T19:44:34.380967] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-08T19:44:34.381235] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-08T19:44:34.381295] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-08T19:44:34.426389] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-08T19:44:34.769389] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:35.006560] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:44:35.217604] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-08T19:44:35.687491] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T19:44:36.017525] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-08T19:44:36.817572] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-08T19:44:36.886787] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:44:36.960398] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T19:44:37.617554] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-08T19:44:38.095047] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:44:38.417598] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-08T19:44:38.921049] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T19:44:39.217579] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-08T19:44:39.827568] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T19:44:39.909943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T19:44:40.017549] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-08T19:44:40.817592] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-08T19:44:41.156961] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:44:41.617525] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-08T19:44:42.122268] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T19:44:42.417617] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-08T19:44:42.886229] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T19:44:43.217617] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-08T19:44:43.457364] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:44:44.017554] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-08T19:44:44.671713] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:44:44.778334] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T19:44:44.817558] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-08T19:44:45.617566] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-08T19:44:46.221201] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:44:46.288974] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T19:44:46.417734] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-08T19:44:47.217577] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-08T19:44:48.017611] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-08T19:44:48.060413] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T19:44:48.510681] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:44:48.817513] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-08T19:44:48.974162] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T19:44:49.617591] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-08T19:44:50.296303] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:44:50.356617] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T19:44:50.417572] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-08T19:44:51.217633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-08T19:44:52.017602] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-08T19:44:52.098587] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T19:44:52.546308] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T19:44:52.673484] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T19:44:52.817579] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-08T19:44:53.617685] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-08T19:44:53.633767] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T19:44:54.417568] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-08T19:44:54.994492] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:44:54.997626] [INFO ] [REMOTE ] JXN: Full fetch complete (65128 records). [2025-10-08T19:44:54.997763] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-08T19:44:55.222719] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-08T19:44:55.384737] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-08T19:44:55.384900] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-08T19:44:55.385801] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-08T19:44:55.385863] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-08T19:44:55.387208] [DEBUG] [LOCAL ] JXN: Trimmed 65128 records to 45065 (keeping 200 days of data) [2025-10-08T19:44:55.642424] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T19:44:55.707958] [DEBUG] [LOCAL ] JXN: Primary data saved (45065 records). [2025-10-08T19:44:55.708122] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-08T19:44:55.708232] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JXN took 37.5s. Estimated remaining: 2h 48m 23s. Rate: 7.1 symbols/min [2025-10-08T19:44:55.875141] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:44:55.897810] [DEBUG] [LOCAL ] KB: Loaded 23640 existing records from primary storage. [2025-10-08T19:44:55.898076] [INFO ] [MAIN ] KB: Loaded 23640 existing records. [2025-10-08T19:44:56.020894] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-08T19:44:56.080831] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:44:56.081010] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-08T19:44:56.081056] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-08T19:44:56.081321] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-08T19:44:56.081380] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-08T19:44:56.205043] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:44:56.449865] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:44:56.817561] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-08T19:44:57.169121] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T19:44:57.617558] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-08T19:44:57.771916] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T19:44:58.417637] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-08T19:44:59.067091] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T19:44:59.211330] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T19:44:59.220394] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-08T19:45:00.017569] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-08T19:45:00.684234] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T19:45:00.685695] [INFO ] [REMOTE ] KAI: Full fetch complete (18780 records). [2025-10-08T19:45:00.685771] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-08T19:45:00.818680] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-08T19:45:01.078189] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-08T19:45:01.078415] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-08T19:45:01.079020] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-08T19:45:01.089375] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-08T19:45:01.109396] [DEBUG] [LOCAL ] KAI: Trimmed 18780 records to 13277 (keeping 200 days of data) [2025-10-08T19:45:01.148115] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T19:45:01.211309] [DEBUG] [LOCAL ] KAI: Primary data saved (13277 records). [2025-10-08T19:45:01.211474] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-08T19:45:01.211565] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 29.6s. Estimated remaining: 2h 48m 11s. Rate: 7.1 symbols/min [2025-10-08T19:45:01.400456] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:01.424276] [DEBUG] [LOCAL ] KBDC: Loaded 21539 existing records from primary storage. [2025-10-08T19:45:01.424586] [INFO ] [MAIN ] KBDC: Loaded 21539 existing records. [2025-10-08T19:45:01.623228] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-08T19:45:01.628628] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:01.629761] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-08T19:45:01.629836] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-08T19:45:01.630111] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-08T19:45:01.630182] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-08T19:45:02.039164] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:02.090592] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:45:02.417603] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-08T19:45:02.818794] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T19:45:03.217561] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-08T19:45:03.481757] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:45:04.017576] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-08T19:45:04.167940] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T19:45:04.817590] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-08T19:45:05.351109] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T19:45:05.617564] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-08T19:45:05.865241] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T19:45:06.417565] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-08T19:45:07.217531] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-08T19:45:07.261603] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:45:07.662359] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T19:45:08.022512] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-08T19:45:08.025916] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T19:45:08.817602] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-08T19:45:09.228960] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:45:09.617579] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-08T19:45:09.842699] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T19:45:10.417558] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-08T19:45:10.853582] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T19:45:11.217543] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-08T19:45:11.357924] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:45:12.017590] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-08T19:45:12.461734] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T19:45:12.817557] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-08T19:45:13.063603] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T19:45:13.617587] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-08T19:45:14.243911] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:45:14.248001] [INFO ] [REMOTE ] K: Full fetch complete (72107 records). [2025-10-08T19:45:14.248178] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-08T19:45:14.424345] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-08T19:45:14.560924] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T19:45:14.659685] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-08T19:45:14.659793] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-08T19:45:14.660756] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-08T19:45:14.660823] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-08T19:45:14.662318] [DEBUG] [LOCAL ] K: Trimmed 72107 records to 50112 (keeping 200 days of data) [2025-10-08T19:45:14.978040] [DEBUG] [LOCAL ] K: Primary data saved (50112 records). [2025-10-08T19:45:14.978186] [INFO ] [MAIN ] K: Full history saved. [2025-10-08T19:45:14.978274] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. K took 44.6s. Estimated remaining: 2h 48m 8s. Rate: 7.1 symbols/min [2025-10-08T19:45:15.142734] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:15.188108] [DEBUG] [LOCAL ] KBH: Loaded 48893 existing records from primary storage. [2025-10-08T19:45:15.188465] [INFO ] [MAIN ] KBH: Loaded 48893 existing records. [2025-10-08T19:45:15.222986] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-08T19:45:15.364850] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:15.365085] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-08T19:45:15.365135] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-08T19:45:15.365402] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-08T19:45:15.365462] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-08T19:45:15.719137] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:15.983542] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:45:16.017521] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-08T19:45:16.349896] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T19:45:16.817556] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-08T19:45:17.191550] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T19:45:17.194781] [INFO ] [REMOTE ] KAR: Full fetch complete (56843 records). [2025-10-08T19:45:17.194870] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-08T19:45:17.604633] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-08T19:45:17.604751] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-08T19:45:17.605703] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-08T19:45:17.605769] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-08T19:45:17.607019] [DEBUG] [LOCAL ] KAR: Trimmed 56843 records to 40090 (keeping 200 days of data) [2025-10-08T19:45:17.656636] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-08T19:45:17.862049] [DEBUG] [LOCAL ] KAR: Primary data saved (40090 records). [2025-10-08T19:45:17.862186] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-08T19:45:17.862267] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 43.9s. Estimated remaining: 2h 47m 54s. Rate: 7.1 symbols/min [2025-10-08T19:45:18.071074] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:18.114451] [DEBUG] [LOCAL ] KBR: Loaded 47906 existing records from primary storage. [2025-10-08T19:45:18.114812] [INFO ] [MAIN ] KBR: Loaded 47906 existing records. [2025-10-08T19:45:18.301145] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:18.301666] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-08T19:45:18.301750] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-08T19:45:18.302161] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-08T19:45:18.302240] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-08T19:45:18.420762] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-08T19:45:18.626828] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T19:45:18.723119] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:18.768301] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T19:45:19.217515] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-08T19:45:19.515251] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T19:45:20.017547] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-08T19:45:20.278675] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:45:20.280392] [INFO ] [REMOTE ] KB: Full fetch complete (33826 records). [2025-10-08T19:45:20.280467] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-08T19:45:20.678939] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-08T19:45:20.679021] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-08T19:45:20.679670] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-08T19:45:20.679731] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-08T19:45:20.680481] [DEBUG] [LOCAL ] KB: Trimmed 33826 records to 23644 (keeping 200 days of data) [2025-10-08T19:45:20.822399] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-08T19:45:20.832130] [DEBUG] [LOCAL ] KB: Primary data saved (23644 records). [2025-10-08T19:45:20.832249] [INFO ] [MAIN ] KB: Full history saved. [2025-10-08T19:45:20.832361] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 25.1s. Estimated remaining: 2h 47m 40s. Rate: 7.1 symbols/min [2025-10-08T19:45:21.054310] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:21.115280] [DEBUG] [LOCAL ] KD: Loaded 52329 existing records from primary storage. [2025-10-08T19:45:21.115930] [INFO ] [MAIN ] KD: Loaded 52329 existing records. [2025-10-08T19:45:21.329694] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:21.329981] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-08T19:45:21.330167] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-08T19:45:21.330756] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-08T19:45:21.330866] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-08T19:45:21.567404] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T19:45:21.624583] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-08T19:45:21.752076] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:21.790734] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T19:45:22.417545] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-08T19:45:23.217553] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-08T19:45:23.559747] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T19:45:23.839010] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:45:24.017559] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-08T19:45:24.764372] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T19:45:24.817555] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-08T19:45:25.197183] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:45:25.617556] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-08T19:45:26.363141] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T19:45:26.417556] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-08T19:45:27.217521] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-08T19:45:27.340448] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:45:28.017522] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-08T19:45:28.103047] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:45:28.817534] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-08T19:45:28.995272] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T19:45:29.149923] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T19:45:29.617545] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-08T19:45:30.393611] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:45:30.417513] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-08T19:45:30.832325] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:45:30.835620] [INFO ] [REMOTE ] KBDC: Full fetch complete (29415 records). [2025-10-08T19:45:30.835804] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-08T19:45:31.222686] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-08T19:45:31.287212] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-08T19:45:31.287296] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-08T19:45:31.287966] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-08T19:45:31.288030] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-08T19:45:31.289025] [DEBUG] [LOCAL ] KBDC: Trimmed 29415 records to 21569 (keeping 200 days of data) [2025-10-08T19:45:31.425088] [DEBUG] [LOCAL ] KBDC: Primary data saved (21569 records). [2025-10-08T19:45:31.425224] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-08T19:45:31.425328] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 30.2s. Estimated remaining: 2h 47m 34s. Rate: 7.1 symbols/min [2025-10-08T19:45:31.591773] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:31.599885] [DEBUG] [LOCAL ] KEN: Loaded 4674 existing records from primary storage. [2025-10-08T19:45:31.600095] [INFO ] [MAIN ] KEN: Loaded 4674 existing records. [2025-10-08T19:45:31.780190] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:31.780485] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-08T19:45:31.780546] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-08T19:45:31.780837] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-08T19:45:31.780896] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-08T19:45:32.022719] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-08T19:45:32.145466] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:32.177878] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T19:45:32.539575] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:45:32.817606] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-08T19:45:33.530932] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:45:33.617538] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-08T19:45:34.417530] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-08T19:45:34.675547] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T19:45:35.052520] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:45:35.217622] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-08T19:45:35.915211] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:45:36.017563] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-08T19:45:36.668022] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:45:36.817559] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-08T19:45:37.308509] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T19:45:37.461772] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T19:45:37.617566] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-08T19:45:38.417604] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-08T19:45:39.217636] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-08T19:45:39.347784] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T19:45:39.772253] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T19:45:39.806235] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:45:40.017529] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-08T19:45:40.817606] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-08T19:45:41.617565] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-08T19:45:41.688931] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T19:45:42.430746] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-08T19:45:42.433466] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T19:45:42.886714] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T19:45:42.974211] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:45:43.217639] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-08T19:45:43.724125] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-08T19:45:44.017596] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-08T19:45:44.817564] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-08T19:45:44.873979] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T19:45:45.617561] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-08T19:45:46.234425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T19:45:46.236080] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:45:46.417530] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-08T19:45:47.217558] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-08T19:45:47.836618] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T19:45:48.017519] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-08T19:45:48.277750] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T19:45:48.817558] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-08T19:45:49.375378] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T19:45:49.617631] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-08T19:45:50.028450] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:45:50.180315] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T19:45:50.417594] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-08T19:45:51.009894] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T19:45:51.217555] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-08T19:45:52.017571] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-08T19:45:52.586416] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:45:52.622911] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:45:52.626830] [INFO ] [REMOTE ] KBR: Full fetch complete (69785 records). [2025-10-08T19:45:52.626975] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-08T19:45:52.824865] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-08T19:45:53.034630] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-08T19:45:53.034760] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-08T19:45:53.035743] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-08T19:45:53.035813] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-08T19:45:53.037469] [DEBUG] [LOCAL ] KBR: Trimmed 69785 records to 47850 (keeping 200 days of data) [2025-10-08T19:45:53.334856] [DEBUG] [LOCAL ] KBR: Primary data saved (47850 records). [2025-10-08T19:45:53.335018] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-08T19:45:53.335126] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBR took 35.5s. Estimated remaining: 2h 47m 39s. Rate: 7.1 symbols/min [2025-10-08T19:45:53.504440] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:53.536966] [DEBUG] [LOCAL ] KEP: Loaded 31291 existing records from primary storage. [2025-10-08T19:45:53.537249] [INFO ] [MAIN ] KEP: Loaded 31291 existing records. [2025-10-08T19:45:53.625270] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-08T19:45:53.753258] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:53.753538] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-08T19:45:53.753598] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-08T19:45:53.753905] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-08T19:45:53.753976] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-08T19:45:54.103404] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:54.252303] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T19:45:54.256250] [INFO ] [REMOTE ] KBH: Full fetch complete (70817 records). [2025-10-08T19:45:54.256359] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-08T19:45:54.350308] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T19:45:54.361808] [INFO ] [REMOTE ] KEN: Full fetch complete (5937 records). [2025-10-08T19:45:54.361911] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-08T19:45:54.433896] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-08T19:45:54.970254] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-08T19:45:54.988267] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-08T19:45:55.001396] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-08T19:45:55.009713] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-08T19:45:55.031800] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-08T19:45:55.031872] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-08T19:45:55.032038] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-08T19:45:55.032323] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-08T19:45:55.033019] [DEBUG] [LOCAL ] KEN: Trimmed 5937 records to 4677 (keeping 200 days of data) [2025-10-08T19:45:55.034065] [DEBUG] [LOCAL ] KBH: Trimmed 70817 records to 48855 (keeping 200 days of data) [2025-10-08T19:45:55.156009] [DEBUG] [LOCAL ] KEN: Primary data saved (4677 records). [2025-10-08T19:45:55.156591] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-08T19:45:55.157238] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 23.7s. Estimated remaining: 2h 47m 24s. Rate: 7.1 symbols/min [2025-10-08T19:45:55.222774] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-08T19:45:55.342887] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:55.478705] [DEBUG] [LOCAL ] KEX: Loaded 38453 existing records from primary storage. [2025-10-08T19:45:55.479509] [INFO ] [MAIN ] KEX: Loaded 38453 existing records. [2025-10-08T19:45:55.669105] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:45:55.670725] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-08T19:45:55.671328] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-08T19:45:55.672691] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-08T19:45:55.673045] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-08T19:45:56.056966] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:56.058227] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-08T19:45:56.119927] [DEBUG] [LOCAL ] KBH: Primary data saved (48855 records). [2025-10-08T19:45:56.120093] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-08T19:45:56.120182] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBH took 41.1s. Estimated remaining: 2h 47m 8s. Rate: 7.1 symbols/min [2025-10-08T19:45:56.297245] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:45:56.297527] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-08T19:45:56.297582] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-08T19:45:56.297718] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-08T19:45:56.297805] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-08T19:45:56.297868] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-08T19:45:56.297903] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-08T19:45:56.678819] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T19:45:56.682940] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:45:56.725908] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-08T19:45:56.817551] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-08T19:45:57.547008] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T19:45:57.617527] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-08T19:45:58.417523] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-08T19:45:58.679842] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T19:45:59.217531] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-08T19:45:59.403359] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T19:45:59.534123] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T19:46:00.017567] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-08T19:46:00.127289] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T19:46:00.817576] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-08T19:46:01.617569] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-08T19:46:01.996513] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-08T19:46:02.000485] [INFO ] [REMOTE ] KD: Full fetch complete (75708 records). [2025-10-08T19:46:02.000634] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-08T19:46:02.403590] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-08T19:46:02.404184] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-08T19:46:02.405170] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-08T19:46:02.405578] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-08T19:46:02.417580] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-08T19:46:02.419973] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:46:02.426878] [DEBUG] [LOCAL ] KD: Trimmed 75708 records to 52320 (keeping 200 days of data) [2025-10-08T19:46:02.544347] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:46:02.787623] [DEBUG] [LOCAL ] KD: Primary data saved (52320 records). [2025-10-08T19:46:02.787819] [INFO ] [MAIN ] KD: Full history saved. [2025-10-08T19:46:02.787922] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KD took 42.0s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-08T19:46:02.966999] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:03.009821] [DEBUG] [LOCAL ] KEYS: Loaded 43149 existing records from primary storage. [2025-10-08T19:46:03.010130] [INFO ] [MAIN ] KEYS: Loaded 43149 existing records. [2025-10-08T19:46:03.183157] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:03.183338] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-08T19:46:03.183384] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-08T19:46:03.183704] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-08T19:46:03.183761] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-08T19:46:03.225359] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-08T19:46:03.536507] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:03.696818] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:46:04.017737] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-08T19:46:04.094259] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T19:46:04.817618] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-08T19:46:05.458117] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:46:05.617593] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-08T19:46:06.002100] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T19:46:06.417570] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-08T19:46:07.208903] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T19:46:07.217613] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-08T19:46:07.497760] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:46:08.017544] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-08T19:46:08.566735] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T19:46:08.817547] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-08T19:46:09.583022] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T19:46:09.617505] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-08T19:46:10.162978] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T19:46:10.417598] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-08T19:46:10.632147] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T19:46:11.217560] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-08T19:46:11.825149] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:46:12.017593] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-08T19:46:12.817512] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-08T19:46:13.090979] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T19:46:13.213564] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T19:46:13.617605] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-08T19:46:14.295252] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T19:46:14.417543] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-08T19:46:15.194632] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T19:46:15.217514] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-08T19:46:15.993409] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:46:16.017517] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-08T19:46:16.477452] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T19:46:16.817562] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-08T19:46:17.617513] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-08T19:46:17.870151] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T19:46:18.261066] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:46:18.417556] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-08T19:46:18.897685] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T19:46:18.901012] [INFO ] [REMOTE ] KEX: Full fetch complete (55826 records). [2025-10-08T19:46:18.901135] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-08T19:46:19.227328] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-08T19:46:19.281788] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-08T19:46:19.281881] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-08T19:46:19.282734] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-08T19:46:19.282798] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-08T19:46:19.284026] [DEBUG] [LOCAL ] KEX: Trimmed 55826 records to 38497 (keeping 200 days of data) [2025-10-08T19:46:19.524570] [DEBUG] [LOCAL ] KEX: Primary data saved (38497 records). [2025-10-08T19:46:19.524820] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-08T19:46:19.524964] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KEX took 24.4s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-10-08T19:46:19.697728] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:19.703086] [DEBUG] [LOCAL ] KF: Loaded 2377 existing records from primary storage. [2025-10-08T19:46:19.703264] [INFO ] [MAIN ] KF: Loaded 2377 existing records. [2025-10-08T19:46:19.894735] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:46:19.900517] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:19.907309] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-08T19:46:19.907517] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-08T19:46:19.908017] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-08T19:46:19.908084] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-08T19:46:20.022756] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-08T19:46:20.266760] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:20.586746] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T19:46:20.817560] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-08T19:46:21.464913] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T19:46:21.617513] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-08T19:46:21.873666] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T19:46:22.417546] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-08T19:46:22.816560] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:46:22.824763] [INFO ] [REMOTE ] KEP: Full fetch complete (41887 records). [2025-10-08T19:46:22.824947] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-08T19:46:22.937891] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T19:46:23.219960] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-08T19:46:23.219501] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-08T19:46:23.220952] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-08T19:46:23.221702] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-08T19:46:23.221774] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-08T19:46:23.222915] [DEBUG] [LOCAL ] KEP: Trimmed 41887 records to 31433 (keeping 200 days of data) [2025-10-08T19:46:23.414521] [DEBUG] [LOCAL ] KEP: Primary data saved (31433 records). [2025-10-08T19:46:23.414715] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-08T19:46:23.414885] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 30.1s. Estimated remaining: 2h 46m 45s. Rate: 7.1 symbols/min [2025-10-08T19:46:23.584184] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:23.605215] [DEBUG] [LOCAL ] KFRC: Loaded 19897 existing records from primary storage. [2025-10-08T19:46:23.605516] [INFO ] [MAIN ] KFRC: Loaded 19897 existing records. [2025-10-08T19:46:23.789077] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:23.789481] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-08T19:46:23.789553] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-08T19:46:23.789998] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-08T19:46:23.790058] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-08T19:46:24.026303] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-08T19:46:24.146092] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:24.435829] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-08T19:46:24.817523] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-08T19:46:25.134673] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:46:25.310097] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T19:46:25.617590] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-08T19:46:26.417590] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-08T19:46:27.059059] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:46:27.217621] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-08T19:46:27.329876] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T19:46:28.017561] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-08T19:46:28.583296] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:46:28.817508] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-08T19:46:28.931777] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T19:46:29.617570] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-08T19:46:30.417560] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-08T19:46:30.460385] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T19:46:30.582919] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T19:46:30.760140] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T19:46:31.217598] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-08T19:46:31.522710] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-08T19:46:32.017605] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-08T19:46:32.817699] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-08T19:46:33.523310] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:46:33.591140] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T19:46:33.617516] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-08T19:46:34.417555] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-08T19:46:34.555452] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T19:46:34.759938] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T19:46:35.217592] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-08T19:46:36.017577] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-08T19:46:36.445606] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T19:46:36.817529] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-08T19:46:37.298294] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-08T19:46:37.302576] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-08T19:46:37.302752] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-08T19:46:37.498606] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T19:46:37.499375] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:46:37.499446] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:46:37.499522] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-08T19:46:37.499602] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-08T19:46:37.499683] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-08T19:46:37.499810] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-08T19:46:37.499915] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEY took 41.4s. Estimated remaining: 2h 46m 42s. Rate: 7.1 symbols/min [2025-10-08T19:46:37.622768] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-08T19:46:37.675997] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:37.686811] [DEBUG] [LOCAL ] KFS: Loaded 8525 existing records from primary storage. [2025-10-08T19:46:37.687138] [INFO ] [MAIN ] KFS: Loaded 8525 existing records. [2025-10-08T19:46:37.882413] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:37.889580] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-08T19:46:37.890274] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-08T19:46:37.890191] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:46:37.894257] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-08T19:46:37.895063] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-08T19:46:38.174782] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:46:38.196377] [INFO ] [REMOTE ] KF: Full fetch complete (3560 records). [2025-10-08T19:46:38.196603] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-08T19:46:38.419668] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-08T19:46:38.423789] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:38.747770] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-08T19:46:38.747883] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-08T19:46:38.748054] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-08T19:46:38.748096] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-08T19:46:38.748524] [DEBUG] [LOCAL ] KF: Trimmed 3560 records to 2375 (keeping 200 days of data) [2025-10-08T19:46:38.765738] [DEBUG] [LOCAL ] KF: Primary data saved (2375 records). [2025-10-08T19:46:38.765890] [INFO ] [MAIN ] KF: Full history saved. [2025-10-08T19:46:38.766023] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KF took 19.2s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-08T19:46:38.948972] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:38.949214] [DEBUG] [LOCAL ] KFY: No existing data file found in primary storage. [2025-10-08T19:46:38.949253] [WARN ] [MAIN ] KFY: No existing data found, performing full refresh instead. [2025-10-08T19:46:38.949371] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-08T19:46:38.949411] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-08T19:46:38.949451] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-08T19:46:38.949482] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-08T19:46:39.222809] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-08T19:46:39.325103] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:40.017508] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-08T19:46:40.138814] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:46:40.287215] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:46:40.817606] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-08T19:46:41.035369] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T19:46:41.617556] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-08T19:46:42.154165] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T19:46:42.175112] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T19:46:42.417582] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-08T19:46:43.040797] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T19:46:43.217576] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-08T19:46:44.017530] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-08T19:46:44.037293] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T19:46:44.817571] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-08T19:46:45.232349] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T19:46:45.381728] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:46:45.617567] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-08T19:46:46.188615] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T19:46:46.417606] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-08T19:46:47.217595] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-08T19:46:47.938470] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T19:46:48.017610] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-08T19:46:48.363177] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:46:48.802148] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T19:46:48.817501] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-08T19:46:49.366229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T19:46:49.617577] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-08T19:46:50.417602] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-08T19:46:50.901873] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:46:51.152392] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T19:46:51.217550] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-08T19:46:52.017528] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-08T19:46:52.062398] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T19:46:52.817527] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-08T19:46:53.182282] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T19:46:53.617608] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-08T19:46:53.849751] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T19:46:54.417562] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-08T19:46:55.183615] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:46:55.217504] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-08T19:46:55.613973] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T19:46:56.017602] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-08T19:46:56.635539] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:46:56.638837] [INFO ] [REMOTE ] KEYS: Full fetch complete (62654 records). [2025-10-08T19:46:56.638945] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-08T19:46:56.826599] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-08T19:46:57.029997] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-08T19:46:57.030163] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-08T19:46:57.031152] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-08T19:46:57.031294] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-08T19:46:57.032559] [DEBUG] [LOCAL ] KEYS: Trimmed 62654 records to 43126 (keeping 200 days of data) [2025-10-08T19:46:57.266041] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T19:46:57.326848] [DEBUG] [LOCAL ] KEYS: Primary data saved (43126 records). [2025-10-08T19:46:57.326981] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-08T19:46:57.327059] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEYS took 54.5s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-08T19:46:57.496595] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:46:57.548377] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-08T19:46:57.548754] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-08T19:46:57.622806] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-08T19:46:57.739368] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:46:57.745791] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-08T19:46:57.745936] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-08T19:46:57.746670] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T19:46:57.748851] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-08T19:46:57.749551] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-08T19:46:58.101484] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:46:58.417545] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-08T19:46:59.084687] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:46:59.135294] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T19:46:59.217548] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-08T19:46:59.660864] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:47:00.017561] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-08T19:47:00.817563] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-08T19:47:01.067305] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T19:47:01.069542] [INFO ] [REMOTE ] KFRC: Full fetch complete (26077 records). [2025-10-08T19:47:01.069672] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-08T19:47:01.457263] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-08T19:47:01.457373] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-08T19:47:01.458019] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-08T19:47:01.458081] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-08T19:47:01.458938] [DEBUG] [LOCAL ] KFRC: Trimmed 26077 records to 20015 (keeping 200 days of data) [2025-10-08T19:47:01.580862] [DEBUG] [LOCAL ] KFRC: Primary data saved (20015 records). [2025-10-08T19:47:01.580998] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-08T19:47:01.581091] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KFRC took 38.2s. Estimated remaining: 2h 46m 16s. Rate: 7.1 symbols/min [2025-10-08T19:47:01.623448] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-08T19:47:01.759152] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:01.808831] [DEBUG] [LOCAL ] KGS: Loaded 45896 existing records from primary storage. [2025-10-08T19:47:01.809269] [INFO ] [MAIN ] KGS: Loaded 45896 existing records. [2025-10-08T19:47:02.007333] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:02.007664] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-08T19:47:02.007813] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-08T19:47:02.014678] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-08T19:47:02.025913] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-08T19:47:02.094875] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:47:02.392830] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:02.417495] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-08T19:47:03.217538] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-08T19:47:03.527327] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T19:47:03.611797] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T19:47:03.882950] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T19:47:04.017543] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-08T19:47:04.817554] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-08T19:47:05.356432] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:47:05.617523] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-08T19:47:06.397941] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T19:47:06.417490] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-08T19:47:07.096978] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:47:07.217553] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-08T19:47:08.017596] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-08T19:47:08.267847] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T19:47:08.594828] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T19:47:08.736236] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T19:47:08.737434] [INFO ] [REMOTE ] KFS: Full fetch complete (10716 records). [2025-10-08T19:47:08.737506] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-08T19:47:08.822772] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-08T19:47:09.099513] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-08T19:47:09.099594] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-08T19:47:09.099908] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-08T19:47:09.099968] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-08T19:47:09.100557] [DEBUG] [LOCAL ] KFS: Trimmed 10716 records to 8566 (keeping 200 days of data) [2025-10-08T19:47:09.150256] [DEBUG] [LOCAL ] KFS: Primary data saved (8566 records). [2025-10-08T19:47:09.150395] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-08T19:47:09.150481] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 31.7s. Estimated remaining: 2h 46m 6s. Rate: 7.1 symbols/min [2025-10-08T19:47:09.322514] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:09.373812] [DEBUG] [LOCAL ] KIM: Loaded 53026 existing records from primary storage. [2025-10-08T19:47:09.374131] [INFO ] [MAIN ] KIM: Loaded 53026 existing records. [2025-10-08T19:47:09.552606] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:09.552824] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-08T19:47:09.552880] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-08T19:47:09.554631] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-08T19:47:09.554741] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-08T19:47:09.622638] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-08T19:47:09.911616] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:10.349782] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:47:10.417507] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-08T19:47:11.217580] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-08T19:47:11.312675] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T19:47:11.558958] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T19:47:12.017550] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-08T19:47:12.113394] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T19:47:12.817700] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-08T19:47:13.617562] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-08T19:47:13.912712] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T19:47:14.172596] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T19:47:14.417546] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-08T19:47:14.900154] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T19:47:15.217600] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-08T19:47:15.669195] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T19:47:15.671737] [INFO ] [REMOTE ] KFY: Full fetch complete (43227 records). [2025-10-08T19:47:15.671832] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-08T19:47:16.018470] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-08T19:47:16.111475] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-08T19:47:16.111683] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-08T19:47:16.112419] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-08T19:47:16.112477] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-08T19:47:16.113478] [DEBUG] [LOCAL ] KFY: Trimmed 43227 records to 29870 (keeping 200 days of data) [2025-10-08T19:47:16.299339] [DEBUG] [LOCAL ] KFY: Primary data saved (29870 records). [2025-10-08T19:47:16.299502] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-08T19:47:16.299633] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 37.5s. Estimated remaining: 2h 45m 57s. Rate: 7.1 symbols/min [2025-10-08T19:47:16.465830] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:16.487377] [DEBUG] [LOCAL ] KIO: Loaded 21383 existing records from primary storage. [2025-10-08T19:47:16.487662] [INFO ] [MAIN ] KIO: Loaded 21383 existing records. [2025-10-08T19:47:16.665714] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:16.666036] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-08T19:47:16.666106] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-08T19:47:16.667066] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-08T19:47:16.667149] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-08T19:47:16.812325] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:47:16.822805] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-08T19:47:17.084431] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:17.313507] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T19:47:17.617562] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-08T19:47:18.417575] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-08T19:47:18.755810] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:47:19.061888] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T19:47:19.217586] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-08T19:47:20.003209] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T19:47:20.017509] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-08T19:47:20.817538] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-08T19:47:20.872114] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T19:47:21.322030] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T19:47:21.617533] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-08T19:47:22.417557] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-08T19:47:22.742195] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T19:47:23.132481] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:47:23.201257] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:47:23.217552] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-08T19:47:24.017677] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-08T19:47:24.590122] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:47:24.817582] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-08T19:47:25.617528] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-08T19:47:25.718441] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T19:47:26.051636] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:47:26.417617] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-08T19:47:27.190866] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T19:47:27.217500] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-08T19:47:27.985991] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:47:28.017503] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-08T19:47:28.538847] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T19:47:28.543379] [INFO ] [REMOTE ] KGS: Full fetch complete (66359 records). [2025-10-08T19:47:28.543605] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-08T19:47:28.822754] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-08T19:47:28.989030] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-08T19:47:28.989200] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-08T19:47:28.991089] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-08T19:47:28.991175] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-08T19:47:28.993125] [DEBUG] [LOCAL ] KGS: Trimmed 66359 records to 45924 (keeping 200 days of data) [2025-10-08T19:47:29.321300] [DEBUG] [LOCAL ] KGS: Primary data saved (45924 records). [2025-10-08T19:47:29.321487] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-08T19:47:29.321621] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGS took 27.7s. Estimated remaining: 2h 45m 53s. Rate: 7.1 symbols/min [2025-10-08T19:47:29.513401] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:29.544526] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:47:29.606713] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-08T19:47:29.607105] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-10-08T19:47:29.627603] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-08T19:47:29.789851] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:29.790072] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-08T19:47:29.790118] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-08T19:47:29.792035] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-08T19:47:29.792097] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-08T19:47:30.107878] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T19:47:30.177685] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:30.417561] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-08T19:47:31.217527] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-08T19:47:31.470133] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T19:47:31.661914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T19:47:32.017590] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-08T19:47:32.639231] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T19:47:32.817578] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-08T19:47:33.617576] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-08T19:47:34.144923] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-08T19:47:34.417600] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-08T19:47:34.675702] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T19:47:34.714907] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T19:47:35.217625] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-08T19:47:36.017517] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-08T19:47:36.152230] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T19:47:36.413673] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T19:47:36.817584] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-08T19:47:37.588098] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T19:47:37.617727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-08T19:47:38.417574] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-08T19:47:38.581032] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:47:38.835977] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T19:47:38.840581] [INFO ] [REMOTE ] KGC: Full fetch complete (77701 records). [2025-10-08T19:47:38.840778] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-08T19:47:39.222789] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-08T19:47:39.349381] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-08T19:47:39.349488] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-08T19:47:39.350561] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-08T19:47:39.350635] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-08T19:47:39.352313] [DEBUG] [LOCAL ] KGC: Trimmed 77701 records to 53699 (keeping 200 days of data) [2025-10-08T19:47:39.702444] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-08T19:47:39.702597] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-08T19:47:39.702708] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 42.4s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-08T19:47:39.877532] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:39.885326] [DEBUG] [LOCAL ] KKRS: Loaded 5718 existing records from primary storage. [2025-10-08T19:47:39.885611] [INFO ] [MAIN ] KKRS: Loaded 5718 existing records. [2025-10-08T19:47:40.018730] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-08T19:47:40.084622] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:40.085092] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-08T19:47:40.085167] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-08T19:47:40.085828] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-08T19:47:40.085913] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-08T19:47:40.308422] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:47:40.498134] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T19:47:40.550251] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:40.817564] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-08T19:47:41.413727] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:47:41.532859] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T19:47:41.617526] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-08T19:47:42.417603] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-08T19:47:42.965842] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T19:47:43.217559] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-08T19:47:43.432454] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T19:47:44.017551] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-08T19:47:44.308463] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:47:44.817611] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-08T19:47:45.617587] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-08T19:47:45.856156] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T19:47:46.146506] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T19:47:46.417578] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-08T19:47:46.512416] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T19:47:47.217585] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-08T19:47:47.232429] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T19:47:47.234629] [INFO ] [REMOTE ] KIO: Full fetch complete (31500 records). [2025-10-08T19:47:47.234891] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-08T19:47:47.608958] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-08T19:47:47.609090] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-08T19:47:47.609756] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-08T19:47:47.609818] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-08T19:47:47.610677] [DEBUG] [LOCAL ] KIO: Trimmed 31500 records to 21461 (keeping 200 days of data) [2025-10-08T19:47:47.744972] [DEBUG] [LOCAL ] KIO: Primary data saved (21461 records). [2025-10-08T19:47:47.745136] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-08T19:47:47.745263] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 31.4s. Estimated remaining: 2h 45m 37s. Rate: 7.1 symbols/min [2025-10-08T19:47:47.922564] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:47.922819] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-08T19:47:47.922877] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-08T19:47:47.923014] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-08T19:47:47.923058] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-08T19:47:47.923104] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-08T19:47:47.923138] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-08T19:47:48.022787] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-08T19:47:48.342904] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:48.817532] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-08T19:47:49.014603] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:47:49.015036] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-08T19:47:49.015159] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:47:49.015214] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-08T19:47:49.015248] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:47:49.015287] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-08T19:47:49.015346] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-08T19:47:49.015488] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-08T19:47:49.015573] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-08T19:47:49.015725] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KKRT took 1.3s. Estimated remaining: 2h 45m 22s. Rate: 7.1 symbols/min [2025-10-08T19:47:49.199390] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:49.199770] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-08T19:47:49.199899] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-08T19:47:49.200065] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-08T19:47:49.200134] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-08T19:47:49.200221] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-08T19:47:49.200324] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-08T19:47:49.578146] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:49.593301] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-08T19:47:49.617499] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-08T19:47:50.112586] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-08T19:47:50.116581] [INFO ] [REMOTE ] KIM: Full fetch complete (76814 records). [2025-10-08T19:47:50.116755] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-08T19:47:50.422827] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-08T19:47:50.512591] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-08T19:47:50.512716] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-08T19:47:50.513916] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-08T19:47:50.513982] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-08T19:47:50.515512] [DEBUG] [LOCAL ] KIM: Trimmed 76814 records to 53001 (keeping 200 days of data) [2025-10-08T19:47:50.708254] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:47:50.734893] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-08T19:47:50.735462] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:47:50.735547] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-08T19:47:50.736370] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:47:50.737044] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-08T19:47:50.737573] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-08T19:47:50.737669] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-08T19:47:50.738250] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-08T19:47:50.738878] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KLAR took 1.7s. Estimated remaining: 2h 45m 7s. Rate: 7.1 symbols/min [2025-10-08T19:47:50.940677] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:50.987911] [DEBUG] [LOCAL ] KLC: Loaded 36880 existing records from primary storage. [2025-10-08T19:47:50.990906] [INFO ] [MAIN ] KLC: Loaded 36880 existing records. [2025-10-08T19:47:51.233861] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-08T19:47:51.241429] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:51.244300] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-08T19:47:51.244717] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-08T19:47:51.246684] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-08T19:47:51.247187] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-08T19:47:51.662781] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:51.667703] [DEBUG] [LOCAL ] KIM: Primary data saved (53001 records). [2025-10-08T19:47:51.667997] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-08T19:47:51.668127] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KIM took 42.5s. Estimated remaining: 2h 44m 51s. Rate: 7.1 symbols/min [2025-10-08T19:47:51.858512] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:47:51.863869] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T19:47:51.898338] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T19:47:51.963035] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-08T19:47:51.963405] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-08T19:47:52.027725] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-08T19:47:52.168942] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:47:52.169171] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-08T19:47:52.169218] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-08T19:47:52.170920] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-08T19:47:52.170995] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-08T19:47:52.559956] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:47:52.636901] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T19:47:52.817585] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-08T19:47:53.617598] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-08T19:47:53.974863] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:47:53.994743] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T19:47:54.417572] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-08T19:47:55.217569] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-08T19:47:56.017532] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-08T19:47:56.440582] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T19:47:56.466856] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T19:47:56.499830] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T19:47:56.817578] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-08T19:47:57.617551] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-08T19:47:58.417538] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-08T19:47:58.654964] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T19:47:59.217571] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-08T19:47:59.511282] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T19:47:59.643064] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T19:47:59.644739] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-08T19:48:00.017574] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-08T19:48:00.817585] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-08T19:48:01.494052] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T19:48:01.617584] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-08T19:48:02.260317] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T19:48:02.417537] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-08T19:48:02.818919] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T19:48:03.217557] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-08T19:48:04.017550] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-08T19:48:04.362425] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T19:48:04.451678] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T19:48:04.817554] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-08T19:48:05.617558] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-08T19:48:05.915758] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T19:48:06.190749] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T19:48:06.417572] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-08T19:48:06.860127] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:48:06.861049] [INFO ] [REMOTE ] KKRS: Full fetch complete (7755 records). [2025-10-08T19:48:06.861140] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-08T19:48:07.220155] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-08T19:48:07.277478] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-08T19:48:07.277591] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-08T19:48:07.278070] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-08T19:48:07.278149] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-08T19:48:07.279076] [DEBUG] [LOCAL ] KKRS: Trimmed 7755 records to 5729 (keeping 200 days of data) [2025-10-08T19:48:07.338222] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-08T19:48:07.359978] [DEBUG] [LOCAL ] KKRS: Primary data saved (5729 records). [2025-10-08T19:48:07.360120] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-08T19:48:07.360208] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKRS took 27.7s. Estimated remaining: 2h 44m 50s. Rate: 7.1 symbols/min [2025-10-08T19:48:08.017556] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-08T19:48:08.651749] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T19:48:08.817574] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-08T19:48:09.617544] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-08T19:48:09.701120] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:48:09.870142] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T19:48:10.417547] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-08T19:48:11.075440] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:48:11.217550] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-08T19:48:11.726162] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T19:48:12.017518] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-08T19:48:12.626143] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:48:12.630250] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-08T19:48:12.630406] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-08T19:48:12.827453] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-08T19:48:13.038092] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-08T19:48:13.038178] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-08T19:48:13.039189] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-08T19:48:13.039259] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-08T19:48:13.040784] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 53502 (keeping 200 days of data) [2025-10-08T19:48:13.386496] [DEBUG] [LOCAL ] KKR: Primary data saved (53502 records). [2025-10-08T19:48:13.386680] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-08T19:48:13.387535] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KKR took 44.1s. Estimated remaining: 2h 44m 39s. Rate: 7.1 symbols/min [2025-10-08T19:48:13.796917] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T19:48:13.808511] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-08T19:48:14.480124] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T19:48:14.489728] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-08T19:48:15.419495] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:48:15.431405] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-08T19:48:15.546956] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:48:16.017538] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-08T19:48:17.459505] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:48:17.462719] [INFO ] [REMOTE ] KLC: Full fetch complete (50576 records). [2025-10-08T19:48:17.462860] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-08T19:48:17.807564] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T19:48:17.874306] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-08T19:48:17.911996] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-08T19:48:17.912072] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-08T19:48:17.912880] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-08T19:48:17.912971] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-08T19:48:17.914305] [DEBUG] [LOCAL ] KLC: Trimmed 50576 records to 36726 (keeping 200 days of data) [2025-10-08T19:48:18.135354] [DEBUG] [LOCAL ] KLC: Primary data saved (36726 records). [2025-10-08T19:48:18.135539] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-08T19:48:18.135705] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 27.4s. Estimated remaining: 2h 44m 27s. Rate: 7.1 symbols/min [2025-10-08T19:48:19.866008] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T19:48:19.877533] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-08T19:48:21.578359] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T19:48:21.590390] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-08T19:48:23.219218] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T19:48:23.225313] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-08T19:48:23.225463] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-08T19:48:23.636436] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-08T19:48:23.636528] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-08T19:48:23.637569] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-08T19:48:23.637724] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-08T19:48:23.639413] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 53693 (keeping 200 days of data) [2025-10-08T19:48:23.977970] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-08T19:48:23.978157] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-08T19:48:23.978271] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KMI took 32.3s. Estimated remaining: 2h 44m 16s. Rate: 7.1 symbols/min [2025-10-08T19:48:24.582428] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.643770] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.795538] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.793395] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:24.799418] [DEBUG] [LOCAL ] KMPB: Loaded 3812 existing records from primary storage. [2025-10-08T19:48:24.800614] [INFO ] [MAIN ] KMPB: Loaded 3812 existing records. [2025-10-08T19:48:25.046303] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:25.049406] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-08T19:48:25.063017] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-08T19:48:25.061341] [DEBUG] [LOCAL ] KMT: Loaded 43017 existing records from primary storage. [2025-10-08T19:48:25.064192] [INFO ] [MAIN ] KMT: Loaded 43017 existing records. [2025-10-08T19:48:25.069519] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-08T19:48:25.097397] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-08T19:48:25.113860] [DEBUG] [LOCAL ] KMPR: Loaded 39271 existing records from primary storage. [2025-10-08T19:48:25.130925] [INFO ] [MAIN ] KMPR: Loaded 39271 existing records. [2025-10-08T19:48:25.121322] [DEBUG] [LOCAL ] KMX: Loaded 53191 existing records from primary storage. [2025-10-08T19:48:25.259282] [INFO ] [MAIN ] KMX: Loaded 53191 existing records. [2025-10-08T19:48:25.712061] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:25.738440] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-08T19:48:25.777837] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-08T19:48:25.838967] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-08T19:48:25.859866] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-08T19:48:25.959093] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:26.005963] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-08T19:48:26.029380] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-08T19:48:26.017806] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:26.050781] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-08T19:48:26.095889] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-08T19:48:26.096121] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-08T19:48:26.116079] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-08T19:48:26.121401] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-08T19:48:26.145867] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-08T19:48:26.281898] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:26.377612] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-08T19:48:27.100347] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T19:48:27.179030] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-08T19:48:27.152336] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.200885] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-08T19:48:27.229189] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.241543] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-08T19:48:27.310351] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:27.310783] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-08T19:48:27.701116] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T19:48:27.702409] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-08T19:48:28.322705] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T19:48:28.324014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-08T19:48:28.464732] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:48:28.470314] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-08T19:48:28.624424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T19:48:28.634215] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-08T19:48:28.748820] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T19:48:28.750466] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-08T19:48:29.048678] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-08T19:48:29.050086] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-08T19:48:29.087200] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:48:29.097752] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-08T19:48:29.306551] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T19:48:29.312500] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-08T19:48:29.350423] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-08T19:48:29.617579] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-08T19:48:29.668554] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:48:30.089297] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T19:48:30.309209] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:48:30.417521] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-08T19:48:30.832676] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T19:48:31.217572] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-08T19:48:31.734587] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T19:48:31.951100] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T19:48:32.017539] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-08T19:48:32.817599] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-08T19:48:33.195569] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:48:33.392374] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T19:48:33.617569] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-08T19:48:34.417600] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-08T19:48:35.068555] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T19:48:35.107680] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T19:48:35.217611] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-08T19:48:36.017568] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-08T19:48:36.318605] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:48:36.817608] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-08T19:48:37.142876] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T19:48:37.279327] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T19:48:37.280355] [INFO ] [REMOTE ] KMPB: Full fetch complete (5157 records). [2025-10-08T19:48:37.280439] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-08T19:48:37.625037] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-08T19:48:37.671628] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-08T19:48:37.671751] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-08T19:48:37.671937] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-08T19:48:37.671977] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-08T19:48:37.672418] [DEBUG] [LOCAL ] KMPB: Trimmed 5157 records to 3832 (keeping 200 days of data) [2025-10-08T19:48:37.697211] [DEBUG] [LOCAL ] KMPB: Primary data saved (3832 records). [2025-10-08T19:48:37.697341] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-08T19:48:37.697470] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 13.7s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-08T19:48:37.874457] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:37.914978] [DEBUG] [LOCAL ] KN: Loaded 38610 existing records from primary storage. [2025-10-08T19:48:37.915307] [INFO ] [MAIN ] KN: Loaded 38610 existing records. [2025-10-08T19:48:38.101997] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:38.102287] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-08T19:48:38.102350] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-08T19:48:38.103071] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-08T19:48:38.103133] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-08T19:48:38.422891] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-08T19:48:38.486826] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:39.081092] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:48:39.217566] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-08T19:48:39.558891] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T19:48:40.017537] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-08T19:48:40.559047] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:48:40.817547] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-08T19:48:41.269846] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T19:48:41.617600] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-08T19:48:42.000456] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:48:42.417617] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-08T19:48:42.710903] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T19:48:43.217620] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-08T19:48:43.420626] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T19:48:44.017526] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-08T19:48:44.826422] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-08T19:48:44.832025] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T19:48:45.485919] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T19:48:45.617569] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-08T19:48:46.417516] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-08T19:48:46.636925] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:48:47.165554] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T19:48:47.217501] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-08T19:48:47.831160] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:48:48.017502] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-08T19:48:48.605513] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T19:48:48.817577] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-08T19:48:49.453574] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T19:48:49.457487] [INFO ] [REMOTE ] KMT: Full fetch complete (62020 records). [2025-10-08T19:48:49.457764] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-08T19:48:49.642784] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-08T19:48:49.873048] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-08T19:48:49.873231] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-08T19:48:49.874186] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-08T19:48:49.874252] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-08T19:48:49.875702] [DEBUG] [LOCAL ] KMT: Trimmed 62020 records to 42969 (keeping 200 days of data) [2025-10-08T19:48:50.017691] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T19:48:50.186418] [DEBUG] [LOCAL ] KMT: Primary data saved (42969 records). [2025-10-08T19:48:50.186636] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-08T19:48:50.186814] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMT took 26.2s. Estimated remaining: 2h 44m 8s. Rate: 7.1 symbols/min [2025-10-08T19:48:50.352528] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:50.387665] [DEBUG] [LOCAL ] KNF: Loaded 36138 existing records from primary storage. [2025-10-08T19:48:50.387993] [INFO ] [MAIN ] KNF: Loaded 36138 existing records. [2025-10-08T19:48:50.422877] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-08T19:48:50.571565] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:48:50.571866] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-08T19:48:50.571936] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-08T19:48:50.573041] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-08T19:48:50.573144] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-08T19:48:50.963191] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:51.217550] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-08T19:48:51.795531] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T19:48:52.019733] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-08T19:48:52.023035] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:48:52.468156] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T19:48:52.817569] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-08T19:48:53.617570] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-08T19:48:53.980273] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T19:48:54.033154] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T19:48:54.037579] [INFO ] [REMOTE ] KMPR: Full fetch complete (51969 records). [2025-10-08T19:48:54.037805] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-08T19:48:54.417684] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-08T19:48:54.435933] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-08T19:48:54.436021] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-08T19:48:54.436918] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-08T19:48:54.436986] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-08T19:48:54.438177] [DEBUG] [LOCAL ] KMPR: Trimmed 51969 records to 39350 (keeping 200 days of data) [2025-10-08T19:48:54.687692] [DEBUG] [LOCAL ] KMPR: Primary data saved (39350 records). [2025-10-08T19:48:54.687974] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-08T19:48:54.688135] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMPR took 30.7s. Estimated remaining: 2h 43m 56s. Rate: 7.1 symbols/min [2025-10-08T19:48:54.886250] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T19:48:54.888710] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:48:54.897510] [DEBUG] [LOCAL ] KNOP: No existing data file found in primary storage. [2025-10-08T19:48:54.897627] [WARN ] [MAIN ] KNOP: No existing data found, performing full refresh instead. [2025-10-08T19:48:54.897792] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-08T19:48:54.897836] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-08T19:48:54.897876] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-08T19:48:54.897909] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-08T19:48:55.222794] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-08T19:48:55.280135] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:48:56.017595] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-08T19:48:56.220784] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T19:48:56.817571] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-08T19:48:56.959390] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:48:57.165507] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T19:48:57.423841] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T19:48:57.617555] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-08T19:48:58.201176] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T19:48:58.417578] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-08T19:48:59.217602] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-08T19:48:59.698370] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:49:00.017556] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-08T19:49:00.817542] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-08T19:49:01.002589] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T19:49:01.434407] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T19:49:01.537728] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T19:49:01.617564] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-08T19:49:02.417560] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-08T19:49:02.921801] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T19:49:03.217581] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-08T19:49:04.017506] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-08T19:49:04.275185] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T19:49:04.360102] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:49:04.540581] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T19:49:04.817566] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-08T19:49:05.617563] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-08T19:49:06.183782] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T19:49:06.417609] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-08T19:49:07.100233] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:49:07.217557] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-08T19:49:07.701403] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T19:49:08.017563] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-08T19:49:08.165524] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T19:49:08.817590] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-08T19:49:09.617577] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-08T19:49:09.736723] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T19:49:09.740787] [INFO ] [REMOTE ] KMX: Full fetch complete (76099 records). [2025-10-08T19:49:09.740917] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-08T19:49:10.199563] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-08T19:49:10.200505] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-08T19:49:10.201184] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T19:49:10.202252] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-08T19:49:10.202767] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-08T19:49:10.207376] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:49:10.219245] [DEBUG] [LOCAL ] KMX: Trimmed 76099 records to 53215 (keeping 200 days of data) [2025-10-08T19:49:10.422843] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-08T19:49:10.539093] [DEBUG] [LOCAL ] KMX: Primary data saved (53215 records). [2025-10-08T19:49:10.539247] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-08T19:49:10.539343] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMX took 46.6s. Estimated remaining: 2h 43m 55s. Rate: 7.1 symbols/min [2025-10-08T19:49:10.710149] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:10.728419] [DEBUG] [LOCAL ] KNSL: Loaded 18443 existing records from primary storage. [2025-10-08T19:49:10.728761] [INFO ] [MAIN ] KNSL: Loaded 18443 existing records. [2025-10-08T19:49:10.904013] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:10.904243] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-08T19:49:10.904288] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-08T19:49:10.904896] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-08T19:49:10.904957] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-08T19:49:11.222688] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-08T19:49:11.258720] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:11.757486] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T19:49:11.903995] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T19:49:12.017511] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-08T19:49:12.817555] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-08T19:49:13.617596] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-08T19:49:14.143007] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T19:49:14.378378] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-08T19:49:14.417496] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-08T19:49:14.735997] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:49:15.174723] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:49:15.217546] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-08T19:49:16.017519] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-08T19:49:16.071765] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T19:49:16.817559] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-08T19:49:17.294028] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:49:17.617563] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-08T19:49:17.883747] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:49:18.417591] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-08T19:49:18.942710] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:49:18.945940] [INFO ] [REMOTE ] KN: Full fetch complete (56527 records). [2025-10-08T19:49:18.946072] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-08T19:49:19.222735] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-08T19:49:19.335913] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-08T19:49:19.336004] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-08T19:49:19.336825] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-08T19:49:19.336886] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-08T19:49:19.338009] [DEBUG] [LOCAL ] KN: Trimmed 56527 records to 38528 (keeping 200 days of data) [2025-10-08T19:49:19.440581] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:49:19.443742] [INFO ] [REMOTE ] KNOP: Full fetch complete (14703 records). [2025-10-08T19:49:19.445362] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-08T19:49:19.868561] [DEBUG] [LOCAL ] KN: Primary data saved (38528 records). [2025-10-08T19:49:19.871988] [INFO ] [MAIN ] KN: Full history saved. [2025-10-08T19:49:19.872106] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KN took 42.2s. Estimated remaining: 2h 43m 47s. Rate: 7.1 symbols/min [2025-10-08T19:49:20.057430] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-08T19:49:20.021390] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-08T19:49:20.057631] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-08T19:49:20.058808] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-08T19:49:20.058887] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-08T19:49:20.070492] [DEBUG] [LOCAL ] KNOP: Trimmed 14703 records to 10498 (keeping 200 days of data) [2025-10-08T19:49:20.224467] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:20.235440] [DEBUG] [LOCAL ] KNOP: Primary data saved (10498 records). [2025-10-08T19:49:20.235602] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-08T19:49:20.235724] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 25.5s. Estimated remaining: 2h 43m 31s. Rate: 7.1 symbols/min [2025-10-08T19:49:20.410599] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:20.439932] [DEBUG] [LOCAL ] KNTK: Loaded 46489 existing records from primary storage. [2025-10-08T19:49:20.440275] [INFO ] [MAIN ] KNTK: Loaded 46489 existing records. [2025-10-08T19:49:20.646989] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:20.647398] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-08T19:49:20.647580] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-08T19:49:20.663369] [DEBUG] [LOCAL ] KNX: Loaded 52597 existing records from primary storage. [2025-10-08T19:49:20.663668] [INFO ] [MAIN ] KNX: Loaded 52597 existing records. [2025-10-08T19:49:20.663717] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-08T19:49:20.663832] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-08T19:49:21.065042] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:21.083246] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-08T19:49:21.111627] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-08T19:49:21.163558] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-08T19:49:21.179828] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-08T19:49:21.181171] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T19:49:21.326519] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:21.345907] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-08T19:49:21.371291] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T19:49:21.634046] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:21.629167] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-08T19:49:22.417516] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-08T19:49:22.867584] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:49:22.970124] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T19:49:23.217560] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-08T19:49:24.017520] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-08T19:49:24.102694] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T19:49:24.452866] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T19:49:24.456625] [INFO ] [REMOTE ] KNF: Full fetch complete (51003 records). [2025-10-08T19:49:24.456789] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-08T19:49:24.825188] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-08T19:49:24.868757] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-08T19:49:24.868840] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-08T19:49:24.869583] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-08T19:49:24.869624] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-08T19:49:24.870738] [DEBUG] [LOCAL ] KNF: Trimmed 51003 records to 36214 (keeping 200 days of data) [2025-10-08T19:49:25.099453] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T19:49:25.104278] [DEBUG] [LOCAL ] KNF: Primary data saved (36214 records). [2025-10-08T19:49:25.109394] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-08T19:49:25.109510] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNF took 34.9s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-08T19:49:25.275471] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:25.275706] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-08T19:49:25.275757] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-08T19:49:25.275871] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-08T19:49:25.275912] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-08T19:49:25.275952] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-08T19:49:25.275984] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-08T19:49:25.618764] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-08T19:49:25.622524] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:26.220255] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T19:49:26.417633] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-08T19:49:27.217550] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-08T19:49:27.302959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T19:49:27.492563] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T19:49:28.017611] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-08T19:49:28.364945] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:49:28.817714] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-08T19:49:29.594570] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T19:49:29.617497] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-08T19:49:30.417581] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-08T19:49:30.538896] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T19:49:31.192358] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:49:31.217511] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-08T19:49:32.017592] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-08T19:49:32.758992] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-08T19:49:32.817530] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-08T19:49:32.883836] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:49:33.617548] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-08T19:49:33.888338] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T19:49:34.417530] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-08T19:49:34.773180] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T19:49:35.148849] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-08T19:49:35.217520] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-08T19:49:36.017521] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-08T19:49:36.105240] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:49:36.793276] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T19:49:36.817497] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-08T19:49:37.518840] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-08T19:49:37.544242] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T19:49:37.617515] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-08T19:49:38.417518] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-08T19:49:38.720936] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T19:49:39.217581] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-08T19:49:40.017549] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-08T19:49:40.288416] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T19:49:40.743975] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-08T19:49:40.817546] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-08T19:49:41.617517] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-08T19:49:41.762404] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:49:41.845341] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T19:49:42.417607] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-08T19:49:43.217633] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-08T19:49:44.017706] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-08T19:49:44.128582] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:49:44.175578] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-08T19:49:44.187737] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:49:44.190928] [INFO ] [REMOTE ] KNSL: Full fetch complete (26833 records). [2025-10-08T19:49:44.191020] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-08T19:49:44.567609] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-08T19:49:44.567789] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-08T19:49:44.568459] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-08T19:49:44.568501] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-08T19:49:44.569365] [DEBUG] [LOCAL ] KNSL: Trimmed 26833 records to 18414 (keeping 200 days of data) [2025-10-08T19:49:44.688970] [DEBUG] [LOCAL ] KNSL: Primary data saved (18414 records). [2025-10-08T19:49:44.689141] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-08T19:49:44.689250] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNSL took 34.1s. Estimated remaining: 2h 43m 22s. Rate: 7.1 symbols/min [2025-10-08T19:49:44.827541] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-08T19:49:44.861689] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:49:44.904174] [DEBUG] [LOCAL ] KODK: Loaded 43411 existing records from primary storage. [2025-10-08T19:49:44.904553] [INFO ] [MAIN ] KODK: Loaded 43411 existing records. [2025-10-08T19:49:45.079107] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:49:45.079402] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-08T19:49:45.079450] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-08T19:49:45.080335] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-08T19:49:45.080395] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-08T19:49:45.427384] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:49:45.617562] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-08T19:49:45.857820] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T19:49:46.417572] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-08T19:49:46.946083] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T19:49:47.217565] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-08T19:49:47.481280] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-08T19:49:47.980900] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:49:48.017521] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-08T19:49:48.546299] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T19:49:48.817615] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-08T19:49:49.617563] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-08T19:49:49.680496] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T19:49:50.417552] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-08T19:49:51.094279] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T19:49:51.173228] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-08T19:49:51.217552] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-08T19:49:51.926091] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T19:49:52.017576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-08T19:49:52.817604] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-08T19:49:52.918815] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T19:49:53.617617] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-08T19:49:54.265011] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:49:54.417515] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-08T19:49:54.455348] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-08T19:49:55.217707] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-08T19:49:55.271084] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:49:55.556663] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T19:49:56.017591] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-08T19:49:56.678420] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:49:56.817584] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-08T19:49:57.617568] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-08T19:49:57.666219] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:49:58.417534] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-08T19:49:58.545896] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:49:58.550983] [INFO ] [REMOTE ] KNX: Full fetch complete (75907 records). [2025-10-08T19:49:58.551169] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-08T19:49:58.979930] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-08T19:49:58.980021] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-08T19:49:58.981021] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-08T19:49:58.981085] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-08T19:49:58.983139] [DEBUG] [LOCAL ] KNX: Trimmed 75907 records to 52596 (keeping 200 days of data) [2025-10-08T19:49:59.091868] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T19:49:59.097229] [INFO ] [REMOTE ] KNTK: Full fetch complete (64969 records). [2025-10-08T19:49:59.097933] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-08T19:49:59.221428] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-08T19:49:59.530161] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-08T19:49:59.530529] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-08T19:49:59.532082] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-08T19:49:59.532166] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-08T19:49:59.535994] [DEBUG] [LOCAL ] KNTK: Trimmed 64969 records to 46585 (keeping 200 days of data) [2025-10-08T19:50:00.036717] [DEBUG] [LOCAL ] KNX: Primary data saved (52596 records). [2025-10-08T19:50:00.050012] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-08T19:50:00.051841] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNX took 39.8s. Estimated remaining: 2h 43m 20s. Rate: 7.1 symbols/min [2025-10-08T19:50:00.198875] [DEBUG] [LOCAL ] KNTK: Primary data saved (46585 records). [2025-10-08T19:50:00.249618] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-08T19:50:00.252362] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:00.252684] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 40.4s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-08T19:50:00.440771] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:00.455272] [DEBUG] [LOCAL ] KOF: Loaded 26511 existing records from primary storage. [2025-10-08T19:50:00.455869] [INFO ] [MAIN ] KOF: Loaded 26511 existing records. [2025-10-08T19:50:00.575779] [DEBUG] [LOCAL ] KOP: Loaded 17540 existing records from primary storage. [2025-10-08T19:50:00.592928] [INFO ] [MAIN ] KOP: Loaded 17540 existing records. [2025-10-08T19:50:00.750843] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:00.762307] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-08T19:50:00.773124] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-08T19:50:00.779989] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-08T19:50:00.795855] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-08T19:50:00.930981] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T19:50:01.072479] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-08T19:50:01.071713] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:01.084055] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-08T19:50:01.089432] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-08T19:50:01.178175] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-08T19:50:01.216445] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-08T19:50:01.508898] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:01.532905] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-08T19:50:01.552460] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (3.13 seconds). [2025-10-08T19:50:01.622612] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-08T19:50:01.841151] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:02.417563] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-08T19:50:02.602450] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T19:50:02.766442] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T19:50:03.217512] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-08T19:50:03.460013] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T19:50:03.979351] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-08T19:50:04.017518] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-08T19:50:04.042130] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T19:50:04.817568] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-08T19:50:05.005191] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T19:50:05.617510] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-08T19:50:05.781170] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T19:50:06.417516] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-08T19:50:06.629031] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:50:07.217553] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-08T19:50:07.959636] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T19:50:08.017535] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-08T19:50:08.235776] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T19:50:08.817613] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-08T19:50:09.617536] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-08T19:50:09.787242] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T19:50:10.386774] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-08T19:50:10.391886] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-08T19:50:10.392033] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-08T19:50:10.423194] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-08T19:50:10.594437] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T19:50:10.595350] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:50:10.595431] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:50:10.595505] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-08T19:50:10.595578] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-08T19:50:10.595615] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-08T19:50:10.595701] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-08T19:50:10.595795] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KO took 45.5s. Estimated remaining: 2h 42m 57s. Rate: 7.1 symbols/min [2025-10-08T19:50:10.774879] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:10.779900] [DEBUG] [LOCAL ] KORE: Loaded 2093 existing records from primary storage. [2025-10-08T19:50:10.780101] [INFO ] [MAIN ] KORE: Loaded 2093 existing records. [2025-10-08T19:50:10.972048] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:10.972589] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-08T19:50:10.972683] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-08T19:50:10.972872] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-08T19:50:10.972929] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-08T19:50:11.118791] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:50:11.225046] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-08T19:50:11.394715] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:11.681851] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:50:12.017564] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-08T19:50:12.817533] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-08T19:50:12.839378] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-08T19:50:12.843076] [INFO ] [REMOTE ] KODK: Full fetch complete (63345 records). [2025-10-08T19:50:12.843207] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-08T19:50:13.188320] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T19:50:13.283108] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-08T19:50:13.283203] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-08T19:50:13.284147] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-08T19:50:13.284213] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-08T19:50:13.285514] [DEBUG] [LOCAL ] KODK: Trimmed 63345 records to 43452 (keeping 200 days of data) [2025-10-08T19:50:13.534472] [DEBUG] [LOCAL ] KODK: Primary data saved (43452 records). [2025-10-08T19:50:13.534611] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-08T19:50:13.534725] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 28.8s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-08T19:50:13.622672] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-08T19:50:13.719692] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:13.769718] [DEBUG] [LOCAL ] KOS: Loaded 53067 existing records from primary storage. [2025-10-08T19:50:13.770053] [INFO ] [MAIN ] KOS: Loaded 53067 existing records. [2025-10-08T19:50:13.913898] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T19:50:13.974779] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:13.975005] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-08T19:50:13.975058] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-08T19:50:13.975259] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-08T19:50:13.975315] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-08T19:50:14.341999] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:14.349581] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T19:50:14.417573] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-08T19:50:14.921861] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T19:50:15.217558] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-08T19:50:15.977583] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T19:50:16.017550] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-08T19:50:16.716988] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T19:50:16.817614] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-08T19:50:17.257942] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T19:50:17.617550] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-08T19:50:18.068043] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T19:50:18.417636] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-08T19:50:18.868971] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T19:50:19.217612] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-08T19:50:20.017537] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-08T19:50:20.463516] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T19:50:20.625040] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T19:50:20.817608] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-08T19:50:21.617625] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-08T19:50:22.080801] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T19:50:22.188700] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:50:22.417508] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-08T19:50:23.217573] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-08T19:50:23.429580] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T19:50:24.017518] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-08T19:50:24.371251] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T19:50:24.644441] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T19:50:24.817556] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-08T19:50:25.155544] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T19:50:25.617555] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-08T19:50:26.417559] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-08T19:50:27.217504] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-08T19:50:27.409977] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T19:50:27.506103] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T19:50:27.666809] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T19:50:28.017550] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-08T19:50:28.442704] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T19:50:28.443733] [INFO ] [REMOTE ] KORE: Full fetch complete (5661 records). [2025-10-08T19:50:28.443828] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-08T19:50:28.822738] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-08T19:50:28.891022] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-08T19:50:28.891111] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-08T19:50:28.891357] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-08T19:50:28.891469] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-08T19:50:28.892071] [DEBUG] [LOCAL ] KORE: Trimmed 5661 records to 2116 (keeping 200 days of data) [2025-10-08T19:50:28.905050] [DEBUG] [LOCAL ] KORE: Primary data saved (2116 records). [2025-10-08T19:50:28.905251] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-08T19:50:28.905373] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KORE took 18.3s. Estimated remaining: 2h 42m 41s. Rate: 7.1 symbols/min [2025-10-08T19:50:29.126863] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:29.187350] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-08T19:50:29.187803] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-08T19:50:29.388697] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:29.388938] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-08T19:50:29.388985] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-08T19:50:29.389397] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-08T19:50:29.389455] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-08T19:50:29.624944] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-08T19:50:29.784047] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:30.417533] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-08T19:50:30.656706] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T19:50:30.857923] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T19:50:31.217554] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-08T19:50:31.451874] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:50:31.453605] [INFO ] [REMOTE ] KOP: Full fetch complete (25521 records). [2025-10-08T19:50:31.453709] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-08T19:50:31.826503] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-08T19:50:31.826673] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-08T19:50:31.827245] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-08T19:50:31.827287] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-08T19:50:31.827941] [DEBUG] [LOCAL ] KOP: Trimmed 25521 records to 17423 (keeping 200 days of data) [2025-10-08T19:50:31.938298] [DEBUG] [LOCAL ] KOP: Primary data saved (17423 records). [2025-10-08T19:50:31.938465] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-08T19:50:31.938620] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 31.7s. Estimated remaining: 2h 42m 28s. Rate: 7.1 symbols/min [2025-10-08T19:50:32.022764] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-08T19:50:32.109364] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:32.157394] [DEBUG] [LOCAL ] KRC: Loaded 48364 existing records from primary storage. [2025-10-08T19:50:32.157760] [INFO ] [MAIN ] KRC: Loaded 48364 existing records. [2025-10-08T19:50:32.332315] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:32.332554] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-08T19:50:32.332600] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-08T19:50:32.333101] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-08T19:50:32.333160] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-08T19:50:32.698352] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:32.727149] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T19:50:32.817564] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-08T19:50:33.298222] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:50:33.617547] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-08T19:50:34.373918] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:50:34.417552] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-08T19:50:34.559673] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T19:50:34.562584] [INFO ] [REMOTE ] KOF: Full fetch complete (37657 records). [2025-10-08T19:50:34.562747] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-08T19:50:35.053628] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-08T19:50:35.053799] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-08T19:50:35.054580] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-08T19:50:35.054669] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-08T19:50:35.055829] [DEBUG] [LOCAL ] KOF: Trimmed 37657 records to 26540 (keeping 200 days of data) [2025-10-08T19:50:35.224244] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-08T19:50:35.252325] [DEBUG] [LOCAL ] KOF: Primary data saved (26540 records). [2025-10-08T19:50:35.252442] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-08T19:50:35.252530] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 35.2s. Estimated remaining: 2h 42m 15s. Rate: 7.1 symbols/min [2025-10-08T19:50:35.481079] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:50:35.533014] [DEBUG] [LOCAL ] KREF: Loaded 37782 existing records from primary storage. [2025-10-08T19:50:35.533423] [INFO ] [MAIN ] KREF: Loaded 37782 existing records. [2025-10-08T19:50:35.742780] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:50:35.743156] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-08T19:50:35.743327] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-08T19:50:35.743861] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-08T19:50:35.743922] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-08T19:50:36.025242] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-08T19:50:36.140577] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T19:50:36.242493] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:50:36.765899] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:50:36.817515] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-08T19:50:37.617541] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-08T19:50:37.964592] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T19:50:38.191935] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:50:38.417538] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-08T19:50:39.213928] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T19:50:39.224054] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-08T19:50:39.912932] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T19:50:40.017514] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-08T19:50:40.068769] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T19:50:40.817601] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-08T19:50:41.617512] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-08T19:50:41.733762] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T19:50:42.428166] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-08T19:50:42.440053] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T19:50:42.479016] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T19:50:43.217558] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-08T19:50:44.017531] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-08T19:50:44.152775] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T19:50:44.817516] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-08T19:50:45.081779] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T19:50:45.617577] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-08T19:50:45.662609] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T19:50:46.417525] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-08T19:50:46.636683] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T19:50:47.079588] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:50:47.217545] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-08T19:50:48.021776] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-08T19:50:48.027721] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T19:50:48.817550] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-08T19:50:49.124989] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T19:50:49.617520] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-08T19:50:49.654532] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T19:50:50.383570] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T19:50:50.417499] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-08T19:50:51.217504] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-08T19:50:51.264932] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T19:50:52.017566] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-08T19:50:52.745383] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-08T19:50:52.810730] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T19:50:52.824728] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-08T19:50:53.546342] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:50:53.617558] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-08T19:50:54.393747] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T19:50:54.417530] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-08T19:50:54.531949] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T19:50:55.217557] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-08T19:50:56.017522] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-08T19:50:56.213780] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T19:50:56.631280] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T19:50:56.817519] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-08T19:50:57.141289] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:50:57.617554] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-08T19:50:58.417571] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-08T19:50:58.743887] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T19:50:58.792489] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T19:50:59.217627] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-08T19:51:00.017614] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-08T19:51:00.096552] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T19:51:00.521223] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T19:51:00.817549] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-08T19:51:01.432867] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:51:01.617547] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-08T19:51:02.417561] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-08T19:51:02.812054] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T19:51:02.845801] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:51:03.217554] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-08T19:51:04.017517] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-08T19:51:04.210964] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T19:51:04.215682] [INFO ] [REMOTE ] KOS: Full fetch complete (76872 records). [2025-10-08T19:51:04.215844] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-08T19:51:04.549763] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T19:51:04.587415] [INFO ] [REMOTE ] KREF: Full fetch complete (52710 records). [2025-10-08T19:51:04.612448] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-08T19:51:04.710455] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-08T19:51:04.721927] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-08T19:51:04.735275] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-08T19:51:04.746748] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-08T19:51:04.816294] [DEBUG] [LOCAL ] KOS: Trimmed 76872 records to 53075 (keeping 200 days of data) [2025-10-08T19:51:04.830840] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-08T19:51:05.195368] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-08T19:51:05.195861] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-08T19:51:05.197528] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-08T19:51:05.197972] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-08T19:51:05.202398] [DEBUG] [LOCAL ] KREF: Trimmed 52710 records to 37756 (keeping 200 days of data) [2025-10-08T19:51:05.568083] [DEBUG] [LOCAL ] KREF: Primary data saved (37756 records). [2025-10-08T19:51:05.568835] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-08T19:51:05.568981] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KREF took 30.3s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-08T19:51:05.751378] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:05.871017] [DEBUG] [LOCAL ] KRG: Loaded 49208 existing records from primary storage. [2025-10-08T19:51:05.875105] [DEBUG] [LOCAL ] KOS: Primary data saved (53075 records). [2025-10-08T19:51:05.875024] [INFO ] [MAIN ] KRG: Loaded 49208 existing records. [2025-10-08T19:51:05.875278] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-08T19:51:05.887135] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 52.4s. Estimated remaining: 2h 42m 11s. Rate: 7.1 symbols/min [2025-10-08T19:51:06.206530] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:06.219459] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-08T19:51:06.256315] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-08T19:51:06.250938] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:06.269323] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-08T19:51:06.269487] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-08T19:51:06.269692] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-08T19:51:06.269926] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-08T19:51:06.271970] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-08T19:51:06.270551] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-08T19:51:06.283249] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-08T19:51:06.271748] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-08T19:51:06.302123] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-08T19:51:06.438338] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-08T19:51:06.494865] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-08T19:51:06.525425] [INFO ] [REMOTE ] KRC: Full fetch complete (69930 records). [2025-10-08T19:51:06.541938] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-08T19:51:07.173183] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:07.202842] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-08T19:51:07.406083] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:07.410031] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-08T19:51:07.523407] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-08T19:51:07.523536] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-08T19:51:07.525110] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-08T19:51:07.525194] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-08T19:51:07.527390] [DEBUG] [LOCAL ] KRC: Trimmed 69930 records to 48354 (keeping 200 days of data) [2025-10-08T19:51:07.671204] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:51:07.674369] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-08T19:51:07.674983] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:51:07.675499] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-08T19:51:07.676165] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:51:07.677542] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-08T19:51:07.678117] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-08T19:51:07.678561] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-08T19:51:07.679139] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-08T19:51:07.679899] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KRMN took 1.8s. Estimated remaining: 2h 41m 56s. Rate: 7.1 symbols/min [2025-10-08T19:51:07.868520] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:08.006105] [DEBUG] [LOCAL ] KRO: Loaded 26164 existing records from primary storage. [2025-10-08T19:51:08.009431] [INFO ] [MAIN ] KRO: Loaded 26164 existing records. [2025-10-08T19:51:08.204609] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:08.206460] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-08T19:51:08.206574] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-08T19:51:08.209321] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-08T19:51:08.209691] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-08T19:51:08.463261] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-08T19:51:08.527260] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-10-08T19:51:08.531839] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-08T19:51:08.753024] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:08.753977] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-08T19:51:08.943083] [DEBUG] [LOCAL ] KRC: Primary data saved (48354 records). [2025-10-08T19:51:08.953481] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-08T19:51:08.971108] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KRC took 37.0s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-08T19:51:09.338144] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:09.341160] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-08T19:51:09.340713] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T19:51:09.341930] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-08T19:51:09.344384] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-08T19:51:09.355230] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-08T19:51:09.355441] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-08T19:51:09.359310] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 53681 (keeping 200 days of data) [2025-10-08T19:51:09.531435] [DEBUG] [LOCAL ] KRP: Loaded 36699 existing records from primary storage. [2025-10-08T19:51:09.589337] [INFO ] [MAIN ] KRP: Loaded 36699 existing records. [2025-10-08T19:51:09.847742] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:09.859534] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-08T19:51:09.859872] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-08T19:51:09.860259] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-08T19:51:09.860323] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-08T19:51:10.162445] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:51:10.227687] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-08T19:51:10.217958] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-08T19:51:10.233164] [INFO ] [MAIN ] KR: Full history saved. [2025-10-08T19:51:10.240989] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KR took 41.3s. Estimated remaining: 2h 41m 26s. Rate: 7.1 symbols/min [2025-10-08T19:51:10.496330] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:10.512906] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-08T19:51:10.596414] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:10.687891] [DEBUG] [LOCAL ] KSS: Loaded 53600 existing records from primary storage. [2025-10-08T19:51:10.689107] [INFO ] [MAIN ] KSS: Loaded 53600 existing records. [2025-10-08T19:51:10.914288] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:51:11.072734] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:11.073052] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-08T19:51:11.073122] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-08T19:51:11.073592] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-08T19:51:11.073696] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-08T19:51:11.222907] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-08T19:51:11.528270] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:51:11.612379] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:11.641832] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:51:12.017571] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-08T19:51:12.606734] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:51:12.817605] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-08T19:51:13.574991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:51:13.617605] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-08T19:51:14.417562] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-08T19:51:14.549000] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T19:51:15.228877] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-08T19:51:15.235717] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T19:51:15.394434] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T19:51:16.017542] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-08T19:51:16.480356] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T19:51:16.817556] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-08T19:51:17.617537] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-08T19:51:17.802486] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T19:51:18.417547] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-08T19:51:18.452378] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:51:19.217533] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-08T19:51:19.284833] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:51:19.823125] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:51:20.017551] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-08T19:51:20.110096] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T19:51:20.817592] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-08T19:51:21.539100] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T19:51:21.617522] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-08T19:51:21.929059] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:51:22.417722] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-08T19:51:22.955921] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T19:51:23.217635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-08T19:51:23.875437] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T19:51:24.017541] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-08T19:51:24.817589] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-08T19:51:25.106507] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T19:51:25.382017] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T19:51:25.617635] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-08T19:51:26.338718] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:51:26.417677] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-08T19:51:27.128515] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T19:51:27.217626] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-08T19:51:28.017621] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-08T19:51:28.549920] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:51:28.626126] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-08T19:51:28.817632] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-08T19:51:29.593327] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T19:51:29.597847] [INFO ] [REMOTE ] KRG: Full fetch complete (71117 records). [2025-10-08T19:51:29.598017] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-08T19:51:29.623589] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-08T19:51:30.063954] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-08T19:51:30.070549] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-08T19:51:30.082551] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-08T19:51:30.082693] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-08T19:51:30.085395] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T19:51:30.093433] [DEBUG] [LOCAL ] KRG: Trimmed 71117 records to 49171 (keeping 200 days of data) [2025-10-08T19:51:30.404678] [DEBUG] [LOCAL ] KRG: Primary data saved (49171 records). [2025-10-08T19:51:30.404875] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-08T19:51:30.405002] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 24.8s. Estimated remaining: 2h 41m 28s. Rate: 7.1 symbols/min [2025-10-08T19:51:30.427285] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-08T19:51:30.583815] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:30.628596] [DEBUG] [LOCAL ] KT: Loaded 45597 existing records from primary storage. [2025-10-08T19:51:30.628992] [INFO ] [MAIN ] KT: Loaded 45597 existing records. [2025-10-08T19:51:30.813035] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:30.813293] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-08T19:51:30.813341] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-08T19:51:30.813731] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-08T19:51:30.813789] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-08T19:51:31.179994] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:31.217564] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-08T19:51:31.650058] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T19:51:31.986219] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:51:32.017503] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-08T19:51:32.792753] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T19:51:32.817561] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-08T19:51:33.135960] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:51:33.617602] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-08T19:51:34.099729] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:51:34.417595] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-08T19:51:35.217540] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-08T19:51:35.662948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T19:51:35.699456] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T19:51:36.017599] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-08T19:51:36.215632] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T19:51:36.817562] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-08T19:51:37.229122] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T19:51:37.617554] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-08T19:51:38.417520] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-08T19:51:38.645361] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T19:51:38.850825] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T19:51:39.217570] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-08T19:51:39.475560] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T19:51:40.017553] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-08T19:51:40.817553] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-08T19:51:40.876950] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T19:51:41.617609] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-08T19:51:42.129744] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T19:51:42.140876] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T19:51:42.417620] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-08T19:51:42.686802] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:51:43.217612] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-08T19:51:43.631582] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T19:51:43.634199] [INFO ] [REMOTE ] KRO: Full fetch complete (35061 records). [2025-10-08T19:51:43.634346] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-08T19:51:44.032746] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-08T19:51:44.035540] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-08T19:51:44.035710] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-08T19:51:44.037929] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-08T19:51:44.038023] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-08T19:51:44.039267] [DEBUG] [LOCAL ] KRO: Trimmed 35061 records to 26221 (keeping 200 days of data) [2025-10-08T19:51:44.202781] [DEBUG] [LOCAL ] KRO: Primary data saved (26221 records). [2025-10-08T19:51:44.211909] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-08T19:51:44.212365] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T19:51:44.212677] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 36.5s. Estimated remaining: 2h 41m 25s. Rate: 7.1 symbols/min [2025-10-08T19:51:44.248455] [INFO ] [REMOTE ] KRP: Full fetch complete (54791 records). [2025-10-08T19:51:44.284609] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-08T19:51:44.563565] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:44.818554] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-08T19:51:44.840089] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-08T19:51:44.840251] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-08T19:51:44.841348] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-08T19:51:44.841531] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-08T19:51:44.858054] [DEBUG] [LOCAL ] KTB: Loaded 40697 existing records from primary storage. [2025-10-08T19:51:44.858279] [DEBUG] [LOCAL ] KRP: Trimmed 54791 records to 36701 (keeping 200 days of data) [2025-10-08T19:51:44.859014] [INFO ] [MAIN ] KTB: Loaded 40697 existing records. [2025-10-08T19:51:45.210615] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:45.211389] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-08T19:51:45.211471] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-08T19:51:45.214982] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-08T19:51:45.215070] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-08T19:51:45.767334] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:45.768958] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-08T19:51:45.824937] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:51:45.847006] [DEBUG] [LOCAL ] KRP: Primary data saved (36701 records). [2025-10-08T19:51:45.847258] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-08T19:51:45.847387] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRP took 36.9s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-08T19:51:46.050197] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:46.068015] [DEBUG] [LOCAL ] KTF: Loaded 12066 existing records from primary storage. [2025-10-08T19:51:46.068435] [INFO ] [MAIN ] KTF: Loaded 12066 existing records. [2025-10-08T19:51:46.279674] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:51:46.279984] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-08T19:51:46.280042] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-08T19:51:46.280311] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-08T19:51:46.280374] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-08T19:51:46.422926] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-08T19:51:46.711740] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:46.977637] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T19:51:47.217604] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-08T19:51:47.249742] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:51:48.017562] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-08T19:51:48.060098] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T19:51:48.817532] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-08T19:51:48.992061] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T19:51:49.328245] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:51:49.617578] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-08T19:51:49.900742] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T19:51:50.417608] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-08T19:51:51.142396] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T19:51:51.217577] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-08T19:51:51.986298] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T19:51:52.017585] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-08T19:51:52.151684] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T19:51:52.155761] [INFO ] [REMOTE ] KSS: Full fetch complete (77628 records). [2025-10-08T19:51:52.155892] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-08T19:51:52.574602] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-08T19:51:52.574856] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-08T19:51:52.576002] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-08T19:51:52.576072] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-08T19:51:52.577740] [DEBUG] [LOCAL ] KSS: Trimmed 77628 records to 53597 (keeping 200 days of data) [2025-10-08T19:51:52.817814] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-08T19:51:52.911596] [DEBUG] [LOCAL ] KSS: Primary data saved (53597 records). [2025-10-08T19:51:52.911775] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-08T19:51:52.911866] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KSS took 42.7s. Estimated remaining: 2h 41m 1s. Rate: 7.1 symbols/min [2025-10-08T19:51:53.085890] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:51:53.086085] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-08T19:51:53.086131] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-08T19:51:53.086271] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-08T19:51:53.086331] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-08T19:51:53.086379] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-08T19:51:53.086414] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-08T19:51:53.448896] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:51:53.459337] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T19:51:53.489738] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T19:51:53.617560] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-08T19:51:54.417526] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-08T19:51:55.009699] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T19:51:55.079451] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T19:51:55.217532] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-08T19:51:55.991549] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T19:51:56.017497] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-08T19:51:56.730025] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T19:51:56.817544] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-08T19:51:57.617517] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-08T19:51:57.759574] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T19:51:58.417561] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-08T19:51:58.519065] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T19:51:59.164011] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T19:51:59.217501] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-08T19:51:59.842691] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T19:52:00.017550] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-08T19:52:00.694726] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T19:52:00.817539] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-08T19:52:01.571368] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:52:01.617554] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-08T19:52:02.024003] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T19:52:02.417551] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-08T19:52:03.217604] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-08T19:52:03.555147] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T19:52:03.558585] [INFO ] [REMOTE ] KT: Full fetch complete (66485 records). [2025-10-08T19:52:03.558740] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-08T19:52:03.956893] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-08T19:52:03.956977] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-08T19:52:03.957893] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-08T19:52:03.957958] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-08T19:52:03.959316] [DEBUG] [LOCAL ] KT: Trimmed 66485 records to 45551 (keeping 200 days of data) [2025-10-08T19:52:04.021302] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-08T19:52:04.059779] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T19:52:04.253703] [DEBUG] [LOCAL ] KT: Primary data saved (45551 records). [2025-10-08T19:52:04.254062] [INFO ] [MAIN ] KT: Full history saved. [2025-10-08T19:52:04.254154] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KT took 33.8s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-08T19:52:04.422945] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:04.476339] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-08T19:52:04.476711] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-08T19:52:04.652721] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:04.652999] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-08T19:52:04.653046] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-08T19:52:04.653898] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-08T19:52:04.653957] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-08T19:52:04.823329] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-08T19:52:05.039204] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:05.287227] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T19:52:05.389692] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T19:52:05.617575] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-08T19:52:06.417535] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-08T19:52:06.670693] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-08T19:52:06.993357] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T19:52:07.217600] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-08T19:52:08.017592] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-08T19:52:08.448558] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T19:52:08.711453] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:52:08.817561] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-08T19:52:09.617564] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-08T19:52:10.417577] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-08T19:52:10.487872] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T19:52:10.969787] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T19:52:11.217534] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-08T19:52:11.297887] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T19:52:12.017569] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-08T19:52:12.059887] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T19:52:12.817598] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-08T19:52:13.576281] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T19:52:13.617522] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-08T19:52:13.761471] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:52:14.301358] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T19:52:14.302791] [INFO ] [REMOTE ] KTF: Full fetch complete (17541 records). [2025-10-08T19:52:14.302874] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-08T19:52:14.422775] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-08T19:52:14.676521] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-08T19:52:14.676607] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-08T19:52:14.677029] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-08T19:52:14.677089] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-08T19:52:14.677632] [DEBUG] [LOCAL ] KTF: Trimmed 17541 records to 12064 (keeping 200 days of data) [2025-10-08T19:52:14.751149] [DEBUG] [LOCAL ] KTF: Primary data saved (12064 records). [2025-10-08T19:52:14.751289] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-08T19:52:14.751373] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KTF took 28.9s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-08T19:52:14.915410] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:14.968699] [DEBUG] [LOCAL ] KVYO: Loaded 50334 existing records from primary storage. [2025-10-08T19:52:14.969098] [INFO ] [MAIN ] KVYO: Loaded 50334 existing records. [2025-10-08T19:52:15.142274] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:15.142535] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-08T19:52:15.142625] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-08T19:52:15.142864] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-08T19:52:15.142920] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-08T19:52:15.222678] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-08T19:52:15.565908] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:15.933425] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T19:52:16.017510] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-08T19:52:16.781584] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T19:52:16.817521] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-08T19:52:17.617532] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-08T19:52:17.855128] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T19:52:17.891399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:52:18.417548] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-08T19:52:18.941526] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:52:19.217563] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-08T19:52:20.017625] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-08T19:52:20.227982] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T19:52:20.327753] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T19:52:20.817571] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-08T19:52:21.617564] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-08T19:52:21.689835] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:52:22.295834] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T19:52:22.417583] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-08T19:52:23.222676] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-08T19:52:23.246275] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T19:52:23.728423] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T19:52:24.017528] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-08T19:52:24.827476] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-08T19:52:24.832957] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T19:52:25.586040] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T19:52:25.617529] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-08T19:52:26.422671] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-08T19:52:26.442704] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T19:52:27.217555] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-08T19:52:27.536890] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T19:52:27.821782] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T19:52:28.017570] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-08T19:52:28.817528] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-08T19:52:29.017449] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T19:52:29.035910] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T19:52:29.037577] [INFO ] [REMOTE ] KUKE: Full fetch complete (8753 records). [2025-10-08T19:52:29.037675] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-08T19:52:29.230920] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T19:52:29.231200] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T19:52:29.231270] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T19:52:29.231318] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-08T19:52:29.231377] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-08T19:52:29.231410] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-08T19:52:29.231448] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-08T19:52:29.231506] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KUKE took 36.3s. Estimated remaining: 2h 40m 46s. Rate: 7.1 symbols/min [2025-10-08T19:52:29.405816] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:29.450272] [DEBUG] [LOCAL ] KW: Loaded 40422 existing records from primary storage. [2025-10-08T19:52:29.450587] [INFO ] [MAIN ] KW: Loaded 40422 existing records. [2025-10-08T19:52:29.629987] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-08T19:52:29.635889] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:29.637120] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-08T19:52:29.637191] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-08T19:52:29.637463] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-08T19:52:29.637530] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-08T19:52:30.028122] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:30.417632] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-08T19:52:31.001986] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T19:52:31.007858] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-08T19:52:31.008026] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-08T19:52:31.250154] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-08T19:52:31.421387] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-08T19:52:31.421528] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-08T19:52:31.422583] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-08T19:52:31.422694] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-08T19:52:31.454887] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 53667 (keeping 200 days of data) [2025-10-08T19:52:31.457427] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T19:52:31.816093] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-08T19:52:31.816315] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-08T19:52:31.816461] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KVUE took 27.6s. Estimated remaining: 2h 40m 32s. Rate: 7.1 symbols/min [2025-10-08T19:52:31.993917] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:32.016892] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T19:52:32.024389] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-08T19:52:32.040374] [DEBUG] [LOCAL ] KWR: Loaded 16316 existing records from primary storage. [2025-10-08T19:52:32.040714] [INFO ] [MAIN ] KWR: Loaded 16316 existing records. [2025-10-08T19:52:32.221841] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:32.222131] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-08T19:52:32.222181] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-08T19:52:32.222423] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-08T19:52:32.222481] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-08T19:52:32.558163] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T19:52:32.587981] [INFO ] [REMOTE ] KTB: Full fetch complete (57949 records). [2025-10-08T19:52:32.611096] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-08T19:52:32.705390] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:32.823729] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-08T19:52:33.060929] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-08T19:52:33.061029] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-08T19:52:33.061923] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-08T19:52:33.061989] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-08T19:52:33.063333] [DEBUG] [LOCAL ] KTB: Trimmed 57949 records to 40584 (keeping 200 days of data) [2025-10-08T19:52:33.340009] [DEBUG] [LOCAL ] KTB: Primary data saved (40584 records). [2025-10-08T19:52:33.340166] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-08T19:52:33.340259] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KTB took 49.1s. Estimated remaining: 2h 40m 17s. Rate: 7.1 symbols/min [2025-10-08T19:52:33.526828] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:33.564257] [DEBUG] [LOCAL ] KYN: Loaded 29972 existing records from primary storage. [2025-10-08T19:52:33.564720] [INFO ] [MAIN ] KYN: Loaded 29972 existing records. [2025-10-08T19:52:33.632762] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-08T19:52:33.768020] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:33.782076] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-08T19:52:33.782199] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-08T19:52:33.782857] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-08T19:52:33.783951] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:52:33.782920] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-08T19:52:34.217504] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:34.246043] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T19:52:34.417538] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-08T19:52:34.787026] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T19:52:35.217619] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-08T19:52:35.724053] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:52:36.017606] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-08T19:52:36.535015] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T19:52:36.817586] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-08T19:52:37.278727] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:52:37.617563] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-08T19:52:38.180988] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T19:52:38.417572] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-08T19:52:39.058827] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T19:52:39.150327] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T19:52:39.217599] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-08T19:52:40.017586] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-08T19:52:40.232058] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T19:52:40.817604] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-08T19:52:41.175394] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T19:52:41.617547] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-08T19:52:42.417540] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-08T19:52:42.531603] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T19:52:42.561614] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T19:52:43.217580] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-08T19:52:43.696358] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:52:43.958155] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T19:52:44.017537] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-08T19:52:44.817571] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-08T19:52:45.617518] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-08T19:52:46.417609] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-08T19:52:46.578058] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T19:52:46.582909] [INFO ] [REMOTE ] KVYO: Full fetch complete (71760 records). [2025-10-08T19:52:46.583114] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-08T19:52:46.902391] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-08T19:52:47.128562] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-08T19:52:47.128740] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-08T19:52:47.130002] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-08T19:52:47.130070] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-08T19:52:47.131746] [DEBUG] [LOCAL ] KVYO: Trimmed 71760 records to 50429 (keeping 200 days of data) [2025-10-08T19:52:47.230225] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-08T19:52:47.482784] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:52:47.505711] [DEBUG] [LOCAL ] KVYO: Primary data saved (50429 records). [2025-10-08T19:52:47.505870] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-08T19:52:47.506985] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVYO took 32.8s. Estimated remaining: 2h 40m 14s. Rate: 7.1 symbols/min [2025-10-08T19:52:47.727398] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:47.776031] [DEBUG] [LOCAL ] L: Loaded 41121 existing records from primary storage. [2025-10-08T19:52:47.776396] [INFO ] [MAIN ] L: Loaded 41121 existing records. [2025-10-08T19:52:48.018970] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:48.019243] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-08T19:52:48.019794] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-08T19:52:48.020880] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-08T19:52:48.021153] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-08T19:52:48.021215] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-08T19:52:48.417835] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T19:52:48.499941] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:48.817600] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-08T19:52:49.317810] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (3.70 seconds). [2025-10-08T19:52:49.617520] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-08T19:52:49.836241] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T19:52:50.417574] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-08T19:52:50.515700] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-08T19:52:50.832803] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:52:51.217531] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-08T19:52:51.707222] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T19:52:52.017610] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-08T19:52:52.614539] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:52:52.817544] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-08T19:52:52.994884] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T19:52:53.617541] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-08T19:52:54.333309] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:52:54.417543] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-08T19:52:55.212687] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:52:55.221126] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-08T19:52:55.546982] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T19:52:56.017564] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-08T19:52:56.109282] [DEBUG] [REMOTE ] L: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-08T19:52:56.109621] [WARN ] [REMOTE ] L: No data returned for month 2025-03 [2025-10-08T19:52:56.109732] [FATAL] [REMOTE ] L: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:52:56.109819] [FATAL] [MAIN ] L: Failed to fetch primary data. [2025-10-08T19:52:56.109883] [WARN ] [MAIN ] L: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:52:56.109960] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-08T19:52:56.110026] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-08T19:52:56.110063] [INFO ] [LOCAL ] L: Starting deletion of derivative data. [2025-10-08T19:52:56.110312] [DEBUG] [LOCAL ] L: Deleted derivative data file. [2025-10-08T19:52:56.111069] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. L took 8.6s. Estimated remaining: 2h 40m 6s. Rate: 7.1 symbols/min [2025-10-08T19:52:56.296846] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:52:56.350897] [DEBUG] [LOCAL ] LAC: Loaded 52426 existing records from primary storage. [2025-10-08T19:52:56.351332] [INFO ] [MAIN ] LAC: Loaded 52426 existing records. [2025-10-08T19:52:56.552414] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:52:56.553961] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-08T19:52:56.560245] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-08T19:52:56.560801] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-08T19:52:56.561394] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-08T19:52:56.561453] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-08T19:52:56.822612] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-08T19:52:56.930892] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:52:57.617603] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-08T19:52:58.383057] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T19:52:58.417498] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-08T19:52:59.217546] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-08T19:52:59.482826] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:53:00.017578] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-08T19:53:00.555066] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T19:53:00.736857] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (3.12 seconds). [2025-10-08T19:53:00.817510] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-08T19:53:00.887146] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T19:53:01.617598] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-08T19:53:01.941320] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T19:53:02.417608] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-08T19:53:03.217507] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-08T19:53:03.675246] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T19:53:03.716770] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:53:03.718262] [INFO ] [REMOTE ] KWR: Full fetch complete (23880 records). [2025-10-08T19:53:03.718354] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-08T19:53:04.019146] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-08T19:53:04.107409] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-08T19:53:04.107488] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-08T19:53:04.108019] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-08T19:53:04.108081] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-08T19:53:04.108741] [DEBUG] [LOCAL ] KWR: Trimmed 23880 records to 16250 (keeping 200 days of data) [2025-10-08T19:53:04.211463] [DEBUG] [LOCAL ] KWR: Primary data saved (16250 records). [2025-10-08T19:53:04.211616] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-08T19:53:04.211754] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KWR took 32.4s. Estimated remaining: 2h 39m 57s. Rate: 7.1 symbols/min [2025-10-08T19:53:04.383929] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:04.407991] [DEBUG] [LOCAL ] LAD: Loaded 23615 existing records from primary storage. [2025-10-08T19:53:04.408265] [INFO ] [MAIN ] LAD: Loaded 23615 existing records. [2025-10-08T19:53:04.534850] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:53:04.621732] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:04.621974] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-08T19:53:04.622022] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-08T19:53:04.622306] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-08T19:53:04.622364] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-08T19:53:04.823038] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-08T19:53:04.987178] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:05.617513] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-08T19:53:05.800780] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T19:53:06.207598] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:53:06.210930] [INFO ] [REMOTE ] KW: Full fetch complete (57086 records). [2025-10-08T19:53:06.211044] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-08T19:53:06.424078] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-08T19:53:06.604434] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-08T19:53:06.604585] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-08T19:53:06.605423] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-08T19:53:06.605486] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-08T19:53:06.606768] [DEBUG] [LOCAL ] KW: Trimmed 57086 records to 40373 (keeping 200 days of data) [2025-10-08T19:53:06.845632] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T19:53:06.873434] [DEBUG] [LOCAL ] KW: Primary data saved (40373 records). [2025-10-08T19:53:06.873571] [INFO ] [MAIN ] KW: Full history saved. [2025-10-08T19:53:06.873692] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KW took 37.6s. Estimated remaining: 2h 39m 43s. Rate: 7.1 symbols/min [2025-10-08T19:53:07.046054] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:07.084176] [DEBUG] [LOCAL ] LADR: Loaded 39140 existing records from primary storage. [2025-10-08T19:53:07.084486] [INFO ] [MAIN ] LADR: Loaded 39140 existing records. [2025-10-08T19:53:07.226254] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-08T19:53:07.272900] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:07.273201] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-08T19:53:07.273259] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-08T19:53:07.273779] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-08T19:53:07.273841] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-08T19:53:07.662460] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:08.017631] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-08T19:53:08.415016] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:53:08.677758] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T19:53:08.817543] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-08T19:53:09.278147] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T19:53:09.617552] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-08T19:53:10.417565] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-08T19:53:10.618693] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T19:53:10.765873] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T19:53:11.217542] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-08T19:53:11.647957] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T19:53:12.017554] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-08T19:53:12.817635] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-08T19:53:13.017108] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T19:53:13.164706] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:53:13.167748] [INFO ] [REMOTE ] KYN: Full fetch complete (44391 records). [2025-10-08T19:53:13.167911] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-08T19:53:13.616628] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-08T19:53:13.616771] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-08T19:53:13.617801] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-08T19:53:13.618189] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-08T19:53:13.617947] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-08T19:53:13.620961] [DEBUG] [LOCAL ] KYN: Trimmed 44391 records to 30062 (keeping 200 days of data) [2025-10-08T19:53:13.836912] [DEBUG] [LOCAL ] KYN: Primary data saved (30062 records). [2025-10-08T19:53:13.837087] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-08T19:53:13.837182] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 40.5s. Estimated remaining: 2h 39m 33s. Rate: 7.1 symbols/min [2025-10-08T19:53:14.018008] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:14.043742] [DEBUG] [LOCAL ] LANV: Loaded 2798 existing records from primary storage. [2025-10-08T19:53:14.045712] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T19:53:14.045995] [INFO ] [MAIN ] LANV: Loaded 2798 existing records. [2025-10-08T19:53:14.248528] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:14.248886] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-08T19:53:14.248956] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-08T19:53:14.249213] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-08T19:53:14.249280] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-08T19:53:14.429989] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-08T19:53:14.628079] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:14.714362] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T19:53:15.217608] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-08T19:53:15.888528] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:53:16.017493] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-08T19:53:16.592804] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T19:53:16.817582] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-08T19:53:17.073498] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T19:53:17.557073] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T19:53:17.617491] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-08T19:53:18.417579] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-08T19:53:18.684707] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T19:53:19.217574] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-08T19:53:19.682285] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T19:53:20.017530] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-08T19:53:20.278235] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T19:53:20.817574] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-08T19:53:21.617627] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-08T19:53:21.757806] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T19:53:21.957206] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T19:53:22.039448] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T19:53:22.417538] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-08T19:53:23.217527] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-08T19:53:23.278545] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:53:24.017591] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-08T19:53:24.320363] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T19:53:24.360311] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:53:24.817556] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-08T19:53:25.617595] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-08T19:53:26.206158] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T19:53:26.417685] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-08T19:53:26.479776] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:53:27.217624] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-08T19:53:27.975883] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:53:28.017539] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-08T19:53:28.817612] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-08T19:53:29.267869] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T19:53:29.336088] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T19:53:29.416292] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T19:53:29.617563] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-08T19:53:30.417576] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-08T19:53:30.755963] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T19:53:31.217505] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-08T19:53:31.506839] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-08T19:53:31.539379] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T19:53:32.017537] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-08T19:53:32.817615] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-08T19:53:33.521241] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T19:53:33.617532] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-08T19:53:34.417584] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-08T19:53:34.742855] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:53:34.746438] [INFO ] [REMOTE ] LADR: Full fetch complete (55553 records). [2025-10-08T19:53:34.746554] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-08T19:53:35.153077] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-08T19:53:35.202950] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-08T19:53:35.203104] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-08T19:53:35.203994] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-08T19:53:35.204061] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-08T19:53:35.205392] [DEBUG] [LOCAL ] LADR: Trimmed 55553 records to 39156 (keeping 200 days of data) [2025-10-08T19:53:35.259545] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-08T19:53:35.455787] [DEBUG] [LOCAL ] LADR: Primary data saved (39156 records). [2025-10-08T19:53:35.456076] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-08T19:53:35.456250] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LADR took 28.6s. Estimated remaining: 2h 39m 37s. Rate: 7.1 symbols/min [2025-10-08T19:53:35.570091] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T19:53:35.616358] [INFO ] [REMOTE ] LAD: Full fetch complete (35375 records). [2025-10-08T19:53:35.626226] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-08T19:53:35.695572] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:35.733169] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-08T19:53:35.751715] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-08T19:53:35.754240] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-08T19:53:35.754671] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-08T19:53:35.760199] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-08T19:53:35.760294] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-08T19:53:36.021467] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-08T19:53:36.481075] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-08T19:53:36.487485] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:36.488478] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-08T19:53:36.492310] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-08T19:53:36.492481] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T19:53:36.492612] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-08T19:53:36.494780] [DEBUG] [LOCAL ] LAD: Trimmed 35375 records to 23558 (keeping 200 days of data) [2025-10-08T19:53:36.641927] [DEBUG] [LOCAL ] LAD: Primary data saved (23558 records). [2025-10-08T19:53:36.642065] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-08T19:53:36.642152] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAD took 32.4s. Estimated remaining: 2h 39m 22s. Rate: 7.1 symbols/min [2025-10-08T19:53:36.817527] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:36.817713] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-08T19:53:36.838551] [DEBUG] [LOCAL ] LAW: Loaded 14260 existing records from primary storage. [2025-10-08T19:53:36.838889] [INFO ] [MAIN ] LAW: Loaded 14260 existing records. [2025-10-08T19:53:37.015546] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:37.015793] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-08T19:53:37.015850] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-08T19:53:37.016054] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-08T19:53:37.016112] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-08T19:53:37.305608] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T19:53:37.385965] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:37.556781] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-08T19:53:37.560782] [INFO ] [REMOTE ] LAC: Full fetch complete (75999 records). [2025-10-08T19:53:37.560915] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-08T19:53:37.623731] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-08T19:53:37.990359] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-08T19:53:37.990450] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-08T19:53:37.991436] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-08T19:53:37.991504] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-08T19:53:37.993181] [DEBUG] [LOCAL ] LAC: Trimmed 75999 records to 52443 (keeping 200 days of data) [2025-10-08T19:53:38.291240] [DEBUG] [LOCAL ] LAC: Primary data saved (52443 records). [2025-10-08T19:53:38.291391] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-08T19:53:38.292858] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAC took 42.2s. Estimated remaining: 2h 39m 7s. Rate: 7.1 symbols/min [2025-10-08T19:53:38.385774] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T19:53:38.417498] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-08T19:53:39.158518] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:53:39.217557] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-08T19:53:39.423518] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T19:53:39.423895] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-08T19:53:39.423991] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T19:53:39.424043] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-08T19:53:39.424103] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T19:53:39.424171] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-08T19:53:39.424234] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-08T19:53:39.424269] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-08T19:53:39.424306] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-08T19:53:39.424351] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LAR took 4.0s. Estimated remaining: 2h 38m 52s. Rate: 7.1 symbols/min [2025-10-08T19:53:40.017581] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-08T19:53:40.416192] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T19:53:40.817577] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-08T19:53:41.362013] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T19:53:41.617589] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-08T19:53:42.173678] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T19:53:42.174873] [INFO ] [REMOTE ] LANV: Full fetch complete (4388 records). [2025-10-08T19:53:42.174950] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-08T19:53:42.430752] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-08T19:53:42.564957] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-08T19:53:42.565051] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-08T19:53:42.565245] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-08T19:53:42.565284] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-08T19:53:42.565690] [DEBUG] [LOCAL ] LANV: Trimmed 4388 records to 2763 (keeping 200 days of data) [2025-10-08T19:53:42.581991] [DEBUG] [LOCAL ] LANV: Primary data saved (2763 records). [2025-10-08T19:53:42.582075] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-08T19:53:42.582191] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LANV took 28.7s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-08T19:53:43.182287] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T19:53:43.217533] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-08T19:53:44.016814] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:53:44.020314] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-08T19:53:44.728533] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T19:53:44.817599] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-08T19:53:45.482846] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T19:53:45.617582] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-08T19:53:46.373030] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T19:53:46.417552] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-08T19:53:47.068574] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T19:53:47.217578] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-08T19:53:48.080292] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:53:48.084172] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-08T19:53:49.101245] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T19:53:49.105456] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-08T19:53:49.900901] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T19:53:49.902581] [INFO ] [REMOTE ] LAW: Full fetch complete (20691 records). [2025-10-08T19:53:49.902684] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-08T19:53:50.266978] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-08T19:53:50.267086] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-08T19:53:50.267568] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-08T19:53:50.267608] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-08T19:53:50.268241] [DEBUG] [LOCAL ] LAW: Trimmed 20691 records to 14259 (keeping 200 days of data) [2025-10-08T19:53:50.346358] [DEBUG] [LOCAL ] LAW: Primary data saved (14259 records). [2025-10-08T19:53:50.346503] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-08T19:53:50.346587] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAW took 13.7s. Estimated remaining: 2h 38m 30s. Rate: 7.1 symbols/min [2025-10-08T19:53:50.868210] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:50.966156] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.067260] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.071256] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:53:51.071777] [DEBUG] [LOCAL ] LC: No existing data file found in primary storage. [2025-10-08T19:53:51.071925] [WARN ] [MAIN ] LC: No existing data found, performing full refresh instead. [2025-10-08T19:53:51.072325] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-08T19:53:51.073381] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-08T19:53:51.073585] [DEBUG] [LOCAL ] LC: No primary data file found to delete. [2025-10-08T19:53:51.074032] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-08T19:53:51.229045] [DEBUG] [LOCAL ] LB: Loaded 37759 existing records from primary storage. [2025-10-08T19:53:51.269527] [INFO ] [MAIN ] LB: Loaded 37759 existing records. [2025-10-08T19:53:51.429858] [DEBUG] [LOCAL ] LAZ: Loaded 44783 existing records from primary storage. [2025-10-08T19:53:51.468881] [INFO ] [MAIN ] LAZ: Loaded 44783 existing records. [2025-10-08T19:53:51.629753] [DEBUG] [LOCAL ] LBRT: Loaded 52933 existing records from primary storage. [2025-10-08T19:53:51.740530] [INFO ] [MAIN ] LBRT: Loaded 52933 existing records. [2025-10-08T19:53:51.771903] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:51.783793] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-08T19:53:51.767810] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:51.803631] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-08T19:53:51.905071] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-08T19:53:51.975380] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-08T19:53:51.987888] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-08T19:53:52.086973] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:52.134385] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-08T19:53:52.134097] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:53:52.170880] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-08T19:53:52.183110] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-08T19:53:52.177916] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-08T19:53:52.204244] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-08T19:53:52.204418] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-08T19:53:52.230509] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-08T19:53:52.256272] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-08T19:53:52.953322] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:52.983145] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-08T19:53:53.174173] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:53.187926] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-08T19:53:53.213961] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:53:53.214689] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-08T19:53:53.637689] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T19:53:53.648899] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-08T19:53:54.288552] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T19:53:54.297762] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-08T19:53:54.415826] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T19:53:54.424548] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-08T19:53:54.956354] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T19:53:55.217704] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-08T19:53:55.449349] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T19:53:55.981084] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T19:53:56.017491] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-08T19:53:56.051739] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T19:53:56.616904] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T19:53:56.817607] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-08T19:53:57.291405] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T19:53:57.617515] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-08T19:53:58.376043] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:53:58.417520] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-08T19:53:58.771008] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T19:53:59.217560] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-08T19:53:59.743736] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T19:54:00.017544] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-08T19:54:00.817587] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-08T19:54:00.946442] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T19:54:01.403519] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T19:54:01.617540] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-08T19:54:02.422742] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-08T19:54:02.440671] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T19:54:03.065133] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T19:54:03.217609] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-08T19:54:04.017576] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-08T19:54:04.237865] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T19:54:04.493239] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T19:54:04.817686] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-08T19:54:05.573262] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:54:05.617579] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-08T19:54:06.417600] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-08T19:54:06.510130] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:54:07.217521] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-08T19:54:07.292501] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T19:54:07.814275] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T19:54:08.017555] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-08T19:54:08.631216] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T19:54:08.817692] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-08T19:54:09.359800] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T19:54:09.617619] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-08T19:54:10.417527] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-08T19:54:10.606446] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T19:54:10.740779] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:54:11.217595] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-08T19:54:11.914821] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T19:54:12.017532] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-08T19:54:12.777394] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T19:54:12.817556] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-08T19:54:13.390438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T19:54:13.617577] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-08T19:54:14.261578] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:54:14.417570] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-08T19:54:15.056087] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T19:54:15.217563] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-08T19:54:15.835144] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T19:54:16.017542] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-08T19:54:16.502478] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:54:16.817594] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-08T19:54:17.219975] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:54:17.224492] [INFO ] [REMOTE ] LC: Full fetch complete (70502 records). [2025-10-08T19:54:17.224680] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-08T19:54:17.623282] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-08T19:54:17.622703] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-08T19:54:17.624289] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-08T19:54:17.625512] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-08T19:54:17.625738] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-08T19:54:17.627318] [DEBUG] [LOCAL ] LC: Trimmed 70502 records to 47939 (keeping 200 days of data) [2025-10-08T19:54:17.923568] [DEBUG] [LOCAL ] LC: Primary data saved (47939 records). [2025-10-08T19:54:17.923744] [INFO ] [MAIN ] LC: Full history saved. [2025-10-08T19:54:17.923835] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LC took 27.6s. Estimated remaining: 2h 38m 39s. Rate: 7.1 symbols/min [2025-10-08T19:54:18.106411] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:18.135814] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T19:54:18.170351] [DEBUG] [LOCAL ] LCII: Loaded 27755 existing records from primary storage. [2025-10-08T19:54:18.170688] [INFO ] [MAIN ] LCII: Loaded 27755 existing records. [2025-10-08T19:54:18.354004] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:18.354291] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-08T19:54:18.354365] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-08T19:54:18.354754] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-08T19:54:18.354837] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-08T19:54:18.422672] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-08T19:54:18.709677] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:18.978724] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T19:54:19.217574] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-08T19:54:20.017535] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-08T19:54:20.309805] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T19:54:20.375174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T19:54:20.817577] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-08T19:54:21.545065] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:54:21.617517] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-08T19:54:21.959688] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T19:54:22.417563] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-08T19:54:22.748814] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T19:54:23.217716] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-08T19:54:23.833550] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:54:23.836936] [INFO ] [REMOTE ] LAZ: Full fetch complete (65808 records). [2025-10-08T19:54:23.837096] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-08T19:54:24.018922] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-08T19:54:24.251684] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-08T19:54:24.251796] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-08T19:54:24.252719] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-08T19:54:24.252788] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-08T19:54:24.254250] [DEBUG] [LOCAL ] LAZ: Trimmed 65808 records to 44782 (keeping 200 days of data) [2025-10-08T19:54:24.542416] [DEBUG] [LOCAL ] LAZ: Primary data saved (44782 records). [2025-10-08T19:54:24.542558] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-08T19:54:24.542690] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 34.2s. Estimated remaining: 2h 38m 29s. Rate: 7.1 symbols/min [2025-10-08T19:54:24.714199] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:24.761442] [DEBUG] [LOCAL ] LDI: Loaded 44391 existing records from primary storage. [2025-10-08T19:54:24.761818] [INFO ] [MAIN ] LDI: Loaded 44391 existing records. [2025-10-08T19:54:24.824752] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-08T19:54:24.954631] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:24.954941] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-08T19:54:24.955024] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-08T19:54:24.955432] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-08T19:54:24.955495] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-08T19:54:25.289897] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T19:54:25.362277] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:25.436978] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:54:25.441734] [INFO ] [REMOTE ] LB: Full fetch complete (55899 records). [2025-10-08T19:54:25.441846] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-08T19:54:25.619834] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-08T19:54:25.891599] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-08T19:54:25.892260] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-08T19:54:25.893425] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T19:54:25.894445] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-08T19:54:25.901570] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-08T19:54:25.903853] [DEBUG] [LOCAL ] LB: Trimmed 55899 records to 37667 (keeping 200 days of data) [2025-10-08T19:54:26.136128] [DEBUG] [LOCAL ] LB: Primary data saved (37667 records). [2025-10-08T19:54:26.136310] [INFO ] [MAIN ] LB: Full history saved. [2025-10-08T19:54:26.136421] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LB took 35.8s. Estimated remaining: 2h 38m 14s. Rate: 7.1 symbols/min [2025-10-08T19:54:26.305297] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:26.350538] [DEBUG] [LOCAL ] LDOS: Loaded 45428 existing records from primary storage. [2025-10-08T19:54:26.350907] [INFO ] [MAIN ] LDOS: Loaded 45428 existing records. [2025-10-08T19:54:26.423577] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-08T19:54:26.529735] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:26.530002] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-08T19:54:26.530049] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-08T19:54:26.530299] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-08T19:54:26.530356] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-08T19:54:26.889000] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:27.217561] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-08T19:54:27.460948] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T19:54:27.465006] [INFO ] [REMOTE ] LBRT: Full fetch complete (76620 records). [2025-10-08T19:54:27.465132] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-08T19:54:27.758610] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T19:54:27.888323] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-08T19:54:27.888412] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-08T19:54:27.889464] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-08T19:54:27.889527] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-08T19:54:27.891019] [DEBUG] [LOCAL ] LBRT: Trimmed 76620 records to 52937 (keeping 200 days of data) [2025-10-08T19:54:28.018362] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-08T19:54:28.226332] [DEBUG] [LOCAL ] LBRT: Primary data saved (52937 records). [2025-10-08T19:54:28.226555] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-08T19:54:28.226687] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 37.9s. Estimated remaining: 2h 38m 0s. Rate: 7.1 symbols/min [2025-10-08T19:54:28.429815] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:28.445942] [DEBUG] [LOCAL ] LDP: Loaded 12973 existing records from primary storage. [2025-10-08T19:54:28.446142] [INFO ] [MAIN ] LDP: Loaded 12973 existing records. [2025-10-08T19:54:28.626546] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:28.627079] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-08T19:54:28.627161] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-08T19:54:28.627463] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-08T19:54:28.627747] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-08T19:54:28.734603] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T19:54:28.820588] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-08T19:54:29.026454] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:29.483345] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T19:54:29.617556] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-08T19:54:30.235026] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T19:54:30.417690] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-08T19:54:31.217578] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-08T19:54:31.355247] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:54:31.412450] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T19:54:32.017504] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-08T19:54:32.128946] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T19:54:32.817581] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-08T19:54:33.365200] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T19:54:33.569733] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T19:54:33.617511] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-08T19:54:34.417579] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-08T19:54:34.871860] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T19:54:35.217579] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-08T19:54:35.939998] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T19:54:36.013866] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T19:54:36.017483] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-08T19:54:36.817565] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-08T19:54:36.910428] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T19:54:37.617569] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-08T19:54:37.997514] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T19:54:38.417569] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-08T19:54:38.911288] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T19:54:39.217559] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-08T19:54:40.004113] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:54:40.017499] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-08T19:54:40.328206] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T19:54:40.817561] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-08T19:54:41.419236] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:54:41.617581] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-08T19:54:42.095228] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T19:54:42.417548] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-08T19:54:43.088547] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T19:54:43.217541] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-08T19:54:43.355686] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T19:54:44.017563] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-08T19:54:44.702721] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T19:54:44.817573] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-08T19:54:45.420332] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:54:45.617574] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-08T19:54:46.011256] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T19:54:46.417549] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-08T19:54:46.555297] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:54:47.217559] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-08T19:54:47.720280] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T19:54:48.017541] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-08T19:54:48.193407] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T19:54:48.817583] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-08T19:54:48.953180] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T19:54:49.617529] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-08T19:54:50.351235] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:54:50.417575] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-08T19:54:50.546860] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T19:54:51.217595] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-08T19:54:51.335713] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T19:54:52.017592] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-08T19:54:52.275906] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T19:54:52.278018] [INFO ] [REMOTE ] LCII: Full fetch complete (39148 records). [2025-10-08T19:54:52.278157] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-08T19:54:52.673476] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-08T19:54:52.673568] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-08T19:54:52.674368] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-08T19:54:52.674451] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-08T19:54:52.675521] [DEBUG] [LOCAL ] LCII: Trimmed 39148 records to 27674 (keeping 200 days of data) [2025-10-08T19:54:52.830420] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-08T19:54:52.862313] [DEBUG] [LOCAL ] LCII: Primary data saved (27674 records). [2025-10-08T19:54:52.862481] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-08T19:54:52.862714] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LCII took 34.9s. Estimated remaining: 2h 38m 6s. Rate: 7.1 symbols/min [2025-10-08T19:54:53.068826] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:53.110874] [DEBUG] [LOCAL ] LEA: Loaded 41646 existing records from primary storage. [2025-10-08T19:54:53.111203] [INFO ] [MAIN ] LEA: Loaded 41646 existing records. [2025-10-08T19:54:53.293937] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:53.294175] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-08T19:54:53.294226] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-08T19:54:53.294567] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-08T19:54:53.294685] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-08T19:54:53.620929] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-08T19:54:53.750913] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:53.778325] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:54:54.417570] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-08T19:54:54.481942] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T19:54:55.058928] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-08T19:54:55.217592] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-08T19:54:56.000954] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T19:54:56.017626] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-08T19:54:56.744870] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T19:54:56.817688] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-08T19:54:57.119973] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T19:54:57.126949] [INFO ] [REMOTE ] LDI: Full fetch complete (61077 records). [2025-10-08T19:54:57.127355] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-08T19:54:57.622761] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-08T19:54:57.712713] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-08T19:54:57.712832] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-08T19:54:57.713793] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-08T19:54:57.713858] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-08T19:54:57.715479] [DEBUG] [LOCAL ] LDI: Trimmed 61077 records to 44485 (keeping 200 days of data) [2025-10-08T19:54:57.973253] [DEBUG] [LOCAL ] LDI: Primary data saved (44485 records). [2025-10-08T19:54:57.973392] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-08T19:54:57.974431] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDI took 33.4s. Estimated remaining: 2h 37m 55s. Rate: 7.1 symbols/min [2025-10-08T19:54:58.149442] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:58.199631] [DEBUG] [LOCAL ] LEG: Loaded 50216 existing records from primary storage. [2025-10-08T19:54:58.221720] [INFO ] [MAIN ] LEG: Loaded 50216 existing records. [2025-10-08T19:54:58.301551] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:54:58.412968] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:54:58.413181] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-08T19:54:58.413242] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-08T19:54:58.413627] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-08T19:54:58.413720] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-08T19:54:58.424867] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-08T19:54:58.763833] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:54:59.176253] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T19:54:59.217512] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-08T19:54:59.286669] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T19:54:59.288081] [INFO ] [REMOTE ] LDP: Full fetch complete (19141 records). [2025-10-08T19:54:59.288153] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-08T19:54:59.655757] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-08T19:54:59.655843] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-08T19:54:59.656305] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-08T19:54:59.656362] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-08T19:54:59.656928] [DEBUG] [LOCAL ] LDP: Trimmed 19141 records to 12929 (keeping 200 days of data) [2025-10-08T19:54:59.736364] [DEBUG] [LOCAL ] LDP: Primary data saved (12929 records). [2025-10-08T19:54:59.736525] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-08T19:54:59.736671] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDP took 31.5s. Estimated remaining: 2h 37m 41s. Rate: 7.1 symbols/min [2025-10-08T19:54:59.902514] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:54:59.958049] [DEBUG] [LOCAL ] LEN: Loaded 53171 existing records from primary storage. [2025-10-08T19:54:59.958370] [INFO ] [MAIN ] LEN: Loaded 53171 existing records. [2025-10-08T19:55:00.022775] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-08T19:55:00.141417] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:00.141660] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-08T19:55:00.141723] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-08T19:55:00.142126] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-08T19:55:00.142190] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-08T19:55:00.489980] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:00.701874] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T19:55:00.817702] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-08T19:55:01.318056] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T19:55:01.617606] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-08T19:55:02.414862] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T19:55:02.423558] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-08T19:55:02.996259] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T19:55:03.217560] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-08T19:55:04.017539] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-08T19:55:04.342282] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T19:55:04.637463] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T19:55:04.817548] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-08T19:55:05.617529] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-08T19:55:05.841555] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T19:55:06.357157] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T19:55:06.417625] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-08T19:55:07.030606] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T19:55:07.034398] [INFO ] [REMOTE ] LDOS: Full fetch complete (67440 records). [2025-10-08T19:55:07.034569] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-08T19:55:07.223481] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-08T19:55:07.450404] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-08T19:55:07.450496] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-08T19:55:07.451593] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-08T19:55:07.451689] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-08T19:55:07.453106] [DEBUG] [LOCAL ] LDOS: Trimmed 67440 records to 45346 (keeping 200 days of data) [2025-10-08T19:55:07.750306] [DEBUG] [LOCAL ] LDOS: Primary data saved (45346 records). [2025-10-08T19:55:07.750491] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-08T19:55:07.751574] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 41.6s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-08T19:55:07.928410] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:07.950042] [DEBUG] [LOCAL ] LEO: Loaded 16872 existing records from primary storage. [2025-10-08T19:55:07.950364] [INFO ] [MAIN ] LEO: Loaded 16872 existing records. [2025-10-08T19:55:08.020534] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-08T19:55:08.175897] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:08.179406] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-08T19:55:08.181044] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T19:55:08.179953] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-08T19:55:08.191138] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-08T19:55:08.191358] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-08T19:55:08.548440] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:08.817579] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-08T19:55:09.109052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T19:55:09.336354] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T19:55:09.617583] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-08T19:55:10.217416] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T19:55:10.417582] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-08T19:55:10.823036] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T19:55:11.217545] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-08T19:55:12.017607] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-08T19:55:12.324756] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:55:12.348122] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T19:55:12.817554] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-08T19:55:13.435361] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:55:13.617503] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-08T19:55:13.851767] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T19:55:14.417557] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-08T19:55:14.978033] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T19:55:15.217604] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-08T19:55:16.017535] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-08T19:55:16.405546] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T19:55:16.428792] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T19:55:16.817537] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-08T19:55:17.199329] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T19:55:17.617545] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-08T19:55:18.372572] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T19:55:18.417504] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-08T19:55:19.095612] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:55:19.217567] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-08T19:55:19.824481] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T19:55:20.017559] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-08T19:55:20.349118] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T19:55:20.817631] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-08T19:55:21.617522] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-08T19:55:21.687062] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T19:55:21.827086] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T19:55:22.417539] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-08T19:55:22.767916] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T19:55:23.217617] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-08T19:55:23.678797] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T19:55:24.017559] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-08T19:55:24.551223] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T19:55:24.817570] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-08T19:55:25.617601] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-08T19:55:25.767758] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T19:55:26.332109] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:55:26.361980] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T19:55:26.365705] [INFO ] [REMOTE ] LEG: Full fetch complete (73008 records). [2025-10-08T19:55:26.365824] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-08T19:55:26.426675] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-08T19:55:26.756636] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-08T19:55:26.756759] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-08T19:55:26.757730] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-08T19:55:26.757794] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-08T19:55:26.759249] [DEBUG] [LOCAL ] LEG: Trimmed 73008 records to 50168 (keeping 200 days of data) [2025-10-08T19:55:27.078589] [DEBUG] [LOCAL ] LEG: Primary data saved (50168 records). [2025-10-08T19:55:27.078801] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-08T19:55:27.080250] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LEG took 29.1s. Estimated remaining: 2h 37m 33s. Rate: 7.1 symbols/min [2025-10-08T19:55:27.226617] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-08T19:55:27.252826] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:27.305722] [DEBUG] [LOCAL ] LEVI: Loaded 51650 existing records from primary storage. [2025-10-08T19:55:27.306053] [INFO ] [MAIN ] LEVI: Loaded 51650 existing records. [2025-10-08T19:55:27.485217] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:27.485471] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-08T19:55:27.485527] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-08T19:55:27.485806] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-08T19:55:27.485867] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-08T19:55:27.881826] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:28.017530] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-08T19:55:28.443613] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T19:55:28.782260] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T19:55:28.817490] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-08T19:55:29.408782] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T19:55:29.617508] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-08T19:55:29.949880] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T19:55:29.953056] [INFO ] [REMOTE ] LEA: Full fetch complete (60677 records). [2025-10-08T19:55:29.953157] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-08T19:55:30.323340] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-08T19:55:30.323419] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-08T19:55:30.324265] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-08T19:55:30.324327] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-08T19:55:30.325558] [DEBUG] [LOCAL ] LEA: Trimmed 60677 records to 41557 (keeping 200 days of data) [2025-10-08T19:55:30.417533] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-08T19:55:30.585894] [DEBUG] [LOCAL ] LEA: Primary data saved (41557 records). [2025-10-08T19:55:30.586058] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-08T19:55:30.586154] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 37.7s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-10-08T19:55:30.750001] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:30.768944] [DEBUG] [LOCAL ] LFT: Loaded 18415 existing records from primary storage. [2025-10-08T19:55:30.769207] [INFO ] [MAIN ] LFT: Loaded 18415 existing records. [2025-10-08T19:55:30.940314] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:30.940552] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-08T19:55:30.940598] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-08T19:55:30.940913] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-08T19:55:30.940971] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-08T19:55:31.222589] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-08T19:55:31.296633] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:31.409899] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T19:55:32.017520] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-08T19:55:32.127698] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T19:55:32.181194] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T19:55:32.817585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-08T19:55:33.617595] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-08T19:55:33.874150] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T19:55:34.055551] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T19:55:34.417585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-08T19:55:34.936323] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T19:55:35.004431] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T19:55:35.217595] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-08T19:55:36.017524] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-08T19:55:36.175923] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:55:36.672409] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T19:55:36.817574] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-08T19:55:37.617586] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-08T19:55:38.264748] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:55:38.417505] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-08T19:55:39.217636] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-08T19:55:39.576449] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-08T19:55:39.580918] [INFO ] [REMOTE ] LEN: Full fetch complete (77045 records). [2025-10-08T19:55:39.581081] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-08T19:55:39.933908] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T19:55:40.032763] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-08T19:55:40.032408] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-08T19:55:40.033957] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-08T19:55:40.034996] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-08T19:55:40.035164] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-08T19:55:40.036716] [DEBUG] [LOCAL ] LEN: Trimmed 77045 records to 53170 (keeping 200 days of data) [2025-10-08T19:55:40.302218] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T19:55:40.421622] [DEBUG] [LOCAL ] LEN: Primary data saved (53170 records). [2025-10-08T19:55:40.421807] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-08T19:55:40.421908] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEN took 40.7s. Estimated remaining: 2h 37m 13s. Rate: 7.1 symbols/min [2025-10-08T19:55:40.594766] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:40.606245] [DEBUG] [LOCAL ] LGI: Loaded 9857 existing records from primary storage. [2025-10-08T19:55:40.606447] [INFO ] [MAIN ] LGI: Loaded 9857 existing records. [2025-10-08T19:55:40.790222] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:40.790478] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-08T19:55:40.790530] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-08T19:55:40.790793] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-08T19:55:40.790851] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-08T19:55:40.822774] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-08T19:55:41.095256] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T19:55:41.177933] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:41.617528] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-08T19:55:41.775871] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T19:55:42.278523] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T19:55:42.280070] [INFO ] [REMOTE ] LEO: Full fetch complete (26640 records). [2025-10-08T19:55:42.280146] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-08T19:55:42.422677] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-08T19:55:42.649925] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-08T19:55:42.650003] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-08T19:55:42.650554] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-08T19:55:42.650597] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-08T19:55:42.651241] [DEBUG] [LOCAL ] LEO: Trimmed 26640 records to 16882 (keeping 200 days of data) [2025-10-08T19:55:42.754409] [DEBUG] [LOCAL ] LEO: Primary data saved (16882 records). [2025-10-08T19:55:42.754582] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-08T19:55:42.754723] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 35.0s. Estimated remaining: 2h 36m 59s. Rate: 7.1 symbols/min [2025-10-08T19:55:42.928073] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:55:42.971616] [DEBUG] [LOCAL ] LH: Loaded 37744 existing records from primary storage. [2025-10-08T19:55:42.971967] [INFO ] [MAIN ] LH: Loaded 37744 existing records. [2025-10-08T19:55:43.146303] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:55:43.146521] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-08T19:55:43.146567] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-08T19:55:43.146915] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-08T19:55:43.146974] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-08T19:55:43.220949] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-08T19:55:43.518290] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:55:43.533638] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T19:55:43.984596] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T19:55:44.017510] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-08T19:55:44.760483] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:55:44.817520] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-08T19:55:45.617568] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-08T19:55:46.260791] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T19:55:46.417518] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-08T19:55:46.464298] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T19:55:47.217594] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-08T19:55:47.774869] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T19:55:47.897819] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T19:55:48.017553] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-08T19:55:48.784315] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T19:55:48.817498] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-08T19:55:49.454681] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T19:55:49.617543] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-08T19:55:50.417563] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-08T19:55:51.109121] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T19:55:51.217542] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-08T19:55:51.644972] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:55:52.017604] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-08T19:55:52.133826] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T19:55:52.817624] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-08T19:55:53.378286] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T19:55:53.617524] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-08T19:55:53.818142] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T19:55:54.354107] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T19:55:54.417592] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-08T19:55:55.217569] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-08T19:55:55.341831] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:55:56.017594] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-08T19:55:56.713429] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T19:55:56.817585] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-08T19:55:57.626536] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-08T19:55:57.659923] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T19:55:57.686502] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T19:55:58.417599] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-08T19:55:59.230207] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-08T19:55:59.255571] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T19:56:00.017527] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-08T19:56:00.070173] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T19:56:00.096839] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T19:56:00.817569] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-08T19:56:01.622707] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-08T19:56:01.638214] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T19:56:02.336904] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T19:56:02.341045] [INFO ] [REMOTE ] LEVI: Full fetch complete (74548 records). [2025-10-08T19:56:02.341176] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-08T19:56:02.422690] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-08T19:56:02.762029] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-08T19:56:02.762160] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-08T19:56:02.763177] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-08T19:56:02.763262] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-08T19:56:02.764853] [DEBUG] [LOCAL ] LEVI: Trimmed 74548 records to 51674 (keeping 200 days of data) [2025-10-08T19:56:02.869146] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T19:56:03.120794] [DEBUG] [LOCAL ] LEVI: Primary data saved (51674 records). [2025-10-08T19:56:03.121000] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-08T19:56:03.122009] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEVI took 36.0s. Estimated remaining: 2h 37m 2s. Rate: 7.1 symbols/min [2025-10-08T19:56:03.222840] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-08T19:56:03.322681] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:03.372369] [DEBUG] [LOCAL ] LHX: Loaded 48596 existing records from primary storage. [2025-10-08T19:56:03.372745] [INFO ] [MAIN ] LHX: Loaded 48596 existing records. [2025-10-08T19:56:03.549764] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:03.550029] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-08T19:56:03.550075] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-08T19:56:03.550355] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-08T19:56:03.550415] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-08T19:56:03.914222] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:03.947086] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T19:56:04.017507] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-08T19:56:04.080598] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T19:56:04.817705] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-08T19:56:05.465127] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:56:05.617558] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-08T19:56:06.359035] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:56:06.417560] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-08T19:56:07.209326] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T19:56:07.228019] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-08T19:56:07.256754] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T19:56:07.916295] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T19:56:07.918841] [INFO ] [REMOTE ] LGI: Full fetch complete (14345 records). [2025-10-08T19:56:07.918984] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-08T19:56:08.022757] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-08T19:56:08.436404] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-08T19:56:08.436526] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-08T19:56:08.437111] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-08T19:56:08.437212] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-08T19:56:08.438281] [DEBUG] [LOCAL ] LGI: Trimmed 14345 records to 9878 (keeping 200 days of data) [2025-10-08T19:56:08.521382] [DEBUG] [LOCAL ] LGI: Primary data saved (9878 records). [2025-10-08T19:56:08.521566] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-08T19:56:08.521697] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LGI took 28.1s. Estimated remaining: 2h 36m 50s. Rate: 7.1 symbols/min [2025-10-08T19:56:08.738072] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:08.766613] [DEBUG] [LOCAL ] LII: Loaded 28025 existing records from primary storage. [2025-10-08T19:56:08.766949] [INFO ] [MAIN ] LII: Loaded 28025 existing records. [2025-10-08T19:56:08.829421] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-08T19:56:08.949172] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:08.949454] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-08T19:56:08.949512] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-08T19:56:08.949924] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-08T19:56:08.949983] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-08T19:56:09.374431] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:09.544033] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:56:09.617586] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-08T19:56:09.860989] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T19:56:09.862624] [INFO ] [REMOTE ] LFT: Full fetch complete (24058 records). [2025-10-08T19:56:09.862736] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-08T19:56:10.270477] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-08T19:56:10.270561] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-08T19:56:10.271157] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-08T19:56:10.271222] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-08T19:56:10.271943] [DEBUG] [LOCAL ] LFT: Trimmed 24058 records to 18400 (keeping 200 days of data) [2025-10-08T19:56:10.383616] [DEBUG] [LOCAL ] LFT: Primary data saved (18400 records). [2025-10-08T19:56:10.383802] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-08T19:56:10.383892] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LFT took 39.8s. Estimated remaining: 2h 36m 36s. Rate: 7.1 symbols/min [2025-10-08T19:56:10.422749] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-08T19:56:10.560374] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:10.604222] [DEBUG] [LOCAL ] LION: Loaded 45160 existing records from primary storage. [2025-10-08T19:56:10.604565] [INFO ] [MAIN ] LION: Loaded 45160 existing records. [2025-10-08T19:56:10.785722] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:10.785962] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-08T19:56:10.786007] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-08T19:56:10.786390] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-08T19:56:10.786449] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-08T19:56:11.150279] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:11.217526] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-08T19:56:11.328072] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T19:56:11.557294] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T19:56:12.017589] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-08T19:56:12.111741] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T19:56:12.817574] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-08T19:56:13.085504] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T19:56:13.611052] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T19:56:13.617486] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-08T19:56:14.417604] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-08T19:56:14.685579] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T19:56:15.217613] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-08T19:56:15.758474] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T19:56:15.762305] [INFO ] [REMOTE ] LH: Full fetch complete (55040 records). [2025-10-08T19:56:15.762415] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-08T19:56:16.028010] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-08T19:56:16.185870] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-08T19:56:16.185977] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-08T19:56:16.186830] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-08T19:56:16.186894] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-08T19:56:16.188393] [DEBUG] [LOCAL ] LH: Trimmed 55040 records to 37766 (keeping 200 days of data) [2025-10-08T19:56:16.433926] [DEBUG] [LOCAL ] LH: Primary data saved (37766 records). [2025-10-08T19:56:16.434087] [INFO ] [MAIN ] LH: Full history saved. [2025-10-08T19:56:16.435153] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LH took 33.7s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-08T19:56:16.616727] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:16.625350] [DEBUG] [LOCAL ] LITB: Loaded 4268 existing records from primary storage. [2025-10-08T19:56:16.625602] [INFO ] [MAIN ] LITB: Loaded 4268 existing records. [2025-10-08T19:56:16.816399] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:16.816900] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-08T19:56:16.817091] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-08T19:56:16.817386] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-08T19:56:16.817447] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-08T19:56:16.822637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-08T19:56:17.200871] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:17.231743] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T19:56:17.393744] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T19:56:17.617522] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-08T19:56:17.671172] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T19:56:18.417566] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-08T19:56:18.899357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T19:56:19.217538] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-08T19:56:19.423320] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:56:20.017593] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-08T19:56:20.416801] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T19:56:20.603609] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T19:56:20.817577] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-08T19:56:21.617562] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-08T19:56:22.074592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T19:56:22.417694] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-08T19:56:22.573120] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T19:56:22.744985] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T19:56:23.217610] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-08T19:56:24.017567] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-08T19:56:24.659558] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:56:24.674707] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T19:56:24.817541] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-08T19:56:25.471986] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T19:56:25.617568] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-08T19:56:26.004023] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-08T19:56:26.417568] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-08T19:56:27.217615] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-08T19:56:28.017570] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-08T19:56:28.182859] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:56:28.470394] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T19:56:28.535298] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T19:56:28.817515] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-08T19:56:29.617599] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-08T19:56:29.848314] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:56:30.417572] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-08T19:56:31.217533] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-08T19:56:31.509513] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T19:56:32.008359] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T19:56:32.017857] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-08T19:56:32.340612] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-08T19:56:32.437141] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T19:56:32.817603] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-08T19:56:33.617625] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-08T19:56:33.996612] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T19:56:34.417571] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-08T19:56:34.884002] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T19:56:35.217566] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-08T19:56:35.333592] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T19:56:36.017556] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-08T19:56:36.460615] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T19:56:36.817551] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-08T19:56:36.906429] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T19:56:37.498987] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T19:56:37.617540] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-08T19:56:38.166941] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T19:56:38.167883] [INFO ] [REMOTE ] LITB: Full fetch complete (5643 records). [2025-10-08T19:56:38.167958] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-08T19:56:38.427474] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-08T19:56:38.569232] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-08T19:56:38.569322] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-08T19:56:38.569522] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-08T19:56:38.569585] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-08T19:56:38.570110] [DEBUG] [LOCAL ] LITB: Trimmed 5643 records to 4249 (keeping 200 days of data) [2025-10-08T19:56:38.595853] [DEBUG] [LOCAL ] LITB: Primary data saved (4249 records). [2025-10-08T19:56:38.596008] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-08T19:56:38.596097] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LITB took 22.2s. Estimated remaining: 2h 36m 29s. Rate: 7.1 symbols/min [2025-10-08T19:56:38.777252] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:38.846278] [DEBUG] [LOCAL ] LLY: Loaded 53301 existing records from primary storage. [2025-10-08T19:56:38.846750] [INFO ] [MAIN ] LLY: Loaded 53301 existing records. [2025-10-08T19:56:39.032483] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:39.032769] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-08T19:56:39.032821] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-08T19:56:39.033055] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-08T19:56:39.033111] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-08T19:56:39.222996] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-08T19:56:39.405676] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:39.838522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T19:56:40.017557] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-08T19:56:40.818826] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-08T19:56:40.824745] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T19:56:41.249901] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:56:41.617518] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-08T19:56:42.070488] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T19:56:42.417562] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-08T19:56:43.217552] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-08T19:56:43.360359] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T19:56:44.017590] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-08T19:56:44.597292] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:56:44.601061] [INFO ] [REMOTE ] LION: Full fetch complete (56046 records). [2025-10-08T19:56:44.601182] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-08T19:56:44.825901] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-08T19:56:45.001315] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-08T19:56:45.001531] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-08T19:56:45.002470] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-08T19:56:45.002583] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-08T19:56:45.019884] [DEBUG] [LOCAL ] LION: Trimmed 56046 records to 45437 (keeping 200 days of data) [2025-10-08T19:56:45.034546] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-08T19:56:45.308589] [DEBUG] [LOCAL ] LION: Primary data saved (45437 records). [2025-10-08T19:56:45.308846] [INFO ] [MAIN ] LION: Full history saved. [2025-10-08T19:56:45.309031] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LION took 34.9s. Estimated remaining: 2h 36m 20s. Rate: 7.1 symbols/min [2025-10-08T19:56:45.502174] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:45.507135] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T19:56:45.563326] [DEBUG] [LOCAL ] LMND: Loaded 51976 existing records from primary storage. [2025-10-08T19:56:45.563728] [INFO ] [MAIN ] LMND: Loaded 51976 existing records. [2025-10-08T19:56:45.625045] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-08T19:56:45.740636] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:45.740878] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-08T19:56:45.740926] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-08T19:56:45.741978] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-08T19:56:45.742039] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-08T19:56:46.094964] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:46.203433] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:56:46.206036] [INFO ] [REMOTE ] LII: Full fetch complete (41490 records). [2025-10-08T19:56:46.206141] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-08T19:56:46.425274] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-08T19:56:46.585042] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-08T19:56:46.585125] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-08T19:56:46.585835] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-08T19:56:46.585896] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-08T19:56:46.586838] [DEBUG] [LOCAL ] LII: Trimmed 41490 records to 28016 (keeping 200 days of data) [2025-10-08T19:56:46.770933] [DEBUG] [LOCAL ] LII: Primary data saved (28016 records). [2025-10-08T19:56:46.771079] [INFO ] [MAIN ] LII: Full history saved. [2025-10-08T19:56:46.771178] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LII took 38.2s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-08T19:56:46.950566] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:47.004340] [DEBUG] [LOCAL ] LMT: Loaded 49815 existing records from primary storage. [2025-10-08T19:56:47.004779] [INFO ] [MAIN ] LMT: Loaded 49815 existing records. [2025-10-08T19:56:47.186746] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:47.186992] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-08T19:56:47.187048] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-08T19:56:47.188042] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-08T19:56:47.188102] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-08T19:56:47.229782] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-08T19:56:47.536137] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:47.870317] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-08T19:56:48.022286] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-08T19:56:48.027436] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T19:56:48.033104] [INFO ] [REMOTE ] LHX: Full fetch complete (70607 records). [2025-10-08T19:56:48.033289] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-08T19:56:48.421088] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-08T19:56:48.421177] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-08T19:56:48.422092] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-08T19:56:48.422155] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-08T19:56:48.423836] [DEBUG] [LOCAL ] LHX: Trimmed 70607 records to 48559 (keeping 200 days of data) [2025-10-08T19:56:48.734159] [DEBUG] [LOCAL ] LHX: Primary data saved (48559 records). [2025-10-08T19:56:48.734296] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-08T19:56:48.735109] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LHX took 45.6s. Estimated remaining: 2h 35m 51s. Rate: 7.1 symbols/min [2025-10-08T19:56:48.830934] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-08T19:56:48.914115] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:56:48.970635] [DEBUG] [LOCAL ] LNC: Loaded 51640 existing records from primary storage. [2025-10-08T19:56:48.971065] [INFO ] [MAIN ] LNC: Loaded 51640 existing records. [2025-10-08T19:56:49.149917] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:56:49.150182] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-08T19:56:49.150255] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-08T19:56:49.151323] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-08T19:56:49.151384] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-08T19:56:49.517169] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:56:49.546719] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-08T19:56:49.617527] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-08T19:56:50.418421] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-08T19:56:50.418337] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-08T19:56:50.510732] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T19:56:51.217535] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-08T19:56:51.289976] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T19:56:51.974196] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T19:56:52.017498] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-08T19:56:52.817544] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-08T19:56:53.138899] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T19:56:53.604976] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T19:56:53.617489] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-08T19:56:54.291154] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T19:56:54.417562] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-08T19:56:55.029508] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T19:56:55.217548] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-08T19:56:56.017528] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-08T19:56:56.203034] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:56:56.668399] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T19:56:56.817520] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-08T19:56:57.295215] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T19:56:57.617559] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-08T19:56:58.417592] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-08T19:56:58.628792] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T19:56:59.037591] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T19:56:59.217633] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-08T19:57:00.017621] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-08T19:57:00.612595] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-08T19:57:00.817572] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-08T19:57:01.617593] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-08T19:57:01.688808] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T19:57:01.730234] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T19:57:02.417553] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-08T19:57:02.839635] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T19:57:03.217514] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-08T19:57:03.307020] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T19:57:04.017574] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-08T19:57:04.506048] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T19:57:04.822070] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-08T19:57:04.827914] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T19:57:05.617519] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-08T19:57:06.114076] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T19:57:06.417714] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-08T19:57:07.184225] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T19:57:07.217505] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-08T19:57:07.378130] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:57:08.017611] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-08T19:57:08.610139] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T19:57:08.817559] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-08T19:57:09.528733] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-08T19:57:09.617546] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-08T19:57:09.799496] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T19:57:10.203541] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T19:57:10.417569] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-08T19:57:11.217547] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-08T19:57:12.017548] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-08T19:57:12.247737] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-08T19:57:12.583913] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T19:57:12.638032] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T19:57:12.817580] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-08T19:57:13.617579] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-08T19:57:14.103620] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T19:57:14.255114] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T19:57:14.417602] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-08T19:57:15.217524] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-08T19:57:15.708953] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T19:57:15.838461] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T19:57:15.842371] [INFO ] [REMOTE ] LNC: Full fetch complete (74366 records). [2025-10-08T19:57:15.842487] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-08T19:57:16.020356] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-08T19:57:16.238947] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-08T19:57:16.239049] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-08T19:57:16.240066] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-08T19:57:16.240149] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-08T19:57:16.241793] [DEBUG] [LOCAL ] LNC: Trimmed 74366 records to 51610 (keeping 200 days of data) [2025-10-08T19:57:16.561398] [DEBUG] [LOCAL ] LNC: Primary data saved (51610 records). [2025-10-08T19:57:16.561661] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-08T19:57:16.562878] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LNC took 27.8s. Estimated remaining: 2h 35m 60s. Rate: 7.1 symbols/min [2025-10-08T19:57:16.777530] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:16.785627] [DEBUG] [LOCAL ] LND: Loaded 4946 existing records from primary storage. [2025-10-08T19:57:16.785919] [INFO ] [MAIN ] LND: Loaded 4946 existing records. [2025-10-08T19:57:16.827470] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-08T19:57:16.964560] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:16.964843] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-08T19:57:16.964892] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-08T19:57:16.965220] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-08T19:57:16.965279] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-08T19:57:17.361240] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:17.591339] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-08T19:57:17.617544] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-08T19:57:18.417541] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-08T19:57:18.479925] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-08T19:57:18.484015] [INFO ] [REMOTE ] LMND: Full fetch complete (75328 records). [2025-10-08T19:57:18.484159] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-08T19:57:18.896525] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-08T19:57:18.896727] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-08T19:57:18.897758] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-08T19:57:18.897926] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-08T19:57:18.899513] [DEBUG] [LOCAL ] LMND: Trimmed 75328 records to 51987 (keeping 200 days of data) [2025-10-08T19:57:19.113725] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T19:57:19.151638] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-08T19:57:19.221011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-08T19:57:19.258314] [DEBUG] [LOCAL ] LMND: Primary data saved (51987 records). [2025-10-08T19:57:19.258414] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-08T19:57:19.258490] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMND took 33.9s. Estimated remaining: 2h 35m 46s. Rate: 7.1 symbols/min [2025-10-08T19:57:19.430361] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:19.480029] [DEBUG] [LOCAL ] LNG: Loaded 51300 existing records from primary storage. [2025-10-08T19:57:19.480391] [INFO ] [MAIN ] LNG: Loaded 51300 existing records. [2025-10-08T19:57:19.654045] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:19.654748] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-08T19:57:19.654858] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-08T19:57:19.656064] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-08T19:57:19.656123] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-08T19:57:19.929241] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T19:57:20.020798] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-08T19:57:20.020720] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:20.056995] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-08T19:57:20.817542] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-08T19:57:21.617562] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-08T19:57:21.902692] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T19:57:22.066496] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T19:57:22.070816] [INFO ] [REMOTE ] LLY: Full fetch complete (77271 records). [2025-10-08T19:57:22.070949] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-08T19:57:22.427242] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-08T19:57:22.501422] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-08T19:57:22.501824] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-08T19:57:22.502889] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-08T19:57:22.503024] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-08T19:57:22.504939] [DEBUG] [LOCAL ] LLY: Trimmed 77271 records to 53293 (keeping 200 days of data) [2025-10-08T19:57:22.633900] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T19:57:22.887412] [DEBUG] [LOCAL ] LLY: Primary data saved (53293 records). [2025-10-08T19:57:22.887577] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-08T19:57:22.888508] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LLY took 44.3s. Estimated remaining: 2h 35m 33s. Rate: 7.1 symbols/min [2025-10-08T19:57:23.056282] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:23.070242] [DEBUG] [LOCAL ] LNN: Loaded 11291 existing records from primary storage. [2025-10-08T19:57:23.070486] [INFO ] [MAIN ] LNN: Loaded 11291 existing records. [2025-10-08T19:57:23.244821] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-08T19:57:23.251131] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:23.251447] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-08T19:57:23.251495] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-08T19:57:23.252041] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-08T19:57:23.252104] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-08T19:57:23.360574] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T19:57:23.612861] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:24.017559] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-08T19:57:24.817550] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-08T19:57:24.817489] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T19:57:24.989282] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-08T19:57:24.992920] [INFO ] [REMOTE ] LMT: Full fetch complete (72397 records). [2025-10-08T19:57:24.993054] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-08T19:57:25.358189] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T19:57:25.453236] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-08T19:57:25.453343] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-08T19:57:25.454314] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-08T19:57:25.454383] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-08T19:57:25.455976] [DEBUG] [LOCAL ] LMT: Trimmed 72397 records to 49773 (keeping 200 days of data) [2025-10-08T19:57:25.649098] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-08T19:57:25.787236] [DEBUG] [LOCAL ] LMT: Primary data saved (49773 records). [2025-10-08T19:57:25.787403] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-08T19:57:25.787493] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 39.0s. Estimated remaining: 2h 35m 20s. Rate: 7.1 symbols/min [2025-10-08T19:57:25.956144] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:25.995207] [DEBUG] [LOCAL ] LOAR: Loaded 42065 existing records from primary storage. [2025-10-08T19:57:25.995515] [INFO ] [MAIN ] LOAR: Loaded 42065 existing records. [2025-10-08T19:57:26.172426] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:26.172666] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-08T19:57:26.172729] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-08T19:57:26.174079] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-08T19:57:26.174140] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-08T19:57:26.422762] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-08T19:57:26.524088] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:26.945200] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T19:57:27.217523] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-08T19:57:27.618490] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T19:57:27.702987] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T19:57:28.017570] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-08T19:57:28.817561] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-08T19:57:29.558315] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T19:57:29.617525] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-08T19:57:29.957528] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T19:57:30.417592] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-08T19:57:30.789566] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T19:57:31.217541] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-08T19:57:31.829903] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:57:31.994864] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T19:57:32.017511] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-08T19:57:32.816260] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T19:57:32.819022] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-08T19:57:33.617547] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-08T19:57:34.417582] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-08T19:57:34.647322] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:57:34.794376] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T19:57:35.217591] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-08T19:57:35.586366] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T19:57:35.660019] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T19:57:36.017547] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-08T19:57:36.479078] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T19:57:36.817560] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-08T19:57:37.617560] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-08T19:57:37.994536] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T19:57:38.050134] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T19:57:38.417555] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-08T19:57:39.217549] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-08T19:57:39.786968] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T19:57:39.832175] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T19:57:40.017555] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-08T19:57:40.817552] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-08T19:57:41.613910] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T19:57:41.622368] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-08T19:57:42.344459] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T19:57:42.417628] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-08T19:57:42.506797] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:57:43.217579] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-08T19:57:44.017585] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-08T19:57:44.157312] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T19:57:44.588005] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T19:57:44.817619] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-08T19:57:44.966587] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T19:57:45.575183] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T19:57:45.617496] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-08T19:57:46.237408] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T19:57:46.417571] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-08T19:57:47.217600] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-08T19:57:47.283591] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T19:57:47.285005] [INFO ] [REMOTE ] LNN: Full fetch complete (15600 records). [2025-10-08T19:57:47.285078] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-08T19:57:47.638843] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-08T19:57:47.638969] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-08T19:57:47.639408] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-08T19:57:47.639450] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-08T19:57:47.640030] [DEBUG] [LOCAL ] LNN: Trimmed 15600 records to 11300 (keeping 200 days of data) [2025-10-08T19:57:47.719868] [DEBUG] [LOCAL ] LNN: Primary data saved (11300 records). [2025-10-08T19:57:47.720030] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-08T19:57:47.720151] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNN took 24.8s. Estimated remaining: 2h 35m 24s. Rate: 7.1 symbols/min [2025-10-08T19:57:47.897836] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:47.925708] [DEBUG] [LOCAL ] LOB: Loaded 27203 existing records from primary storage. [2025-10-08T19:57:47.925988] [INFO ] [MAIN ] LOB: Loaded 27203 existing records. [2025-10-08T19:57:48.023255] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-08T19:57:48.102164] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:48.102375] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-08T19:57:48.102421] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-08T19:57:48.103333] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-08T19:57:48.103395] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-08T19:57:48.448097] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:48.817520] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-08T19:57:48.883264] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T19:57:49.307831] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T19:57:49.373348] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T19:57:49.617560] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-08T19:57:50.417577] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-08T19:57:51.217596] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-08T19:57:51.408145] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T19:57:51.448578] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T19:57:51.657835] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T19:57:51.658911] [INFO ] [REMOTE ] LND: Full fetch complete (8158 records). [2025-10-08T19:57:51.658990] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-08T19:57:52.028747] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-08T19:57:52.037991] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-08T19:57:52.039006] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-08T19:57:52.039328] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-08T19:57:52.039403] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-08T19:57:52.040152] [DEBUG] [LOCAL ] LND: Trimmed 8158 records to 4976 (keeping 200 days of data) [2025-10-08T19:57:52.074924] [DEBUG] [LOCAL ] LND: Primary data saved (4976 records). [2025-10-08T19:57:52.075114] [INFO ] [MAIN ] LND: Full history saved. [2025-10-08T19:57:52.075235] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 35.5s. Estimated remaining: 2h 35m 12s. Rate: 7.1 symbols/min [2025-10-08T19:57:52.326079] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:52.334324] [DEBUG] [LOCAL ] LOCL: Loaded 3633 existing records from primary storage. [2025-10-08T19:57:52.334637] [INFO ] [MAIN ] LOCL: Loaded 3633 existing records. [2025-10-08T19:57:52.626873] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:52.627232] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-08T19:57:52.627310] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-08T19:57:52.627557] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-08T19:57:52.627630] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-08T19:57:52.822737] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-08T19:57:53.119127] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:53.280426] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T19:57:53.617574] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-08T19:57:54.417607] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-08T19:57:54.803005] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T19:57:55.125341] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T19:57:55.217627] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-08T19:57:55.507599] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T19:57:55.670020] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T19:57:56.017627] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-08T19:57:56.817566] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-08T19:57:57.272036] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T19:57:57.514609] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T19:57:57.519532] [INFO ] [REMOTE ] LNG: Full fetch complete (74658 records). [2025-10-08T19:57:57.519746] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-08T19:57:57.622731] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-08T19:57:57.971303] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-08T19:57:57.971397] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-08T19:57:57.972405] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-08T19:57:57.972474] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-08T19:57:57.973994] [DEBUG] [LOCAL ] LNG: Trimmed 74658 records to 51319 (keeping 200 days of data) [2025-10-08T19:57:58.294918] [DEBUG] [LOCAL ] LNG: Primary data saved (51319 records). [2025-10-08T19:57:58.295072] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-08T19:57:58.295164] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNG took 39.0s. Estimated remaining: 2h 35m 1s. Rate: 7.1 symbols/min [2025-10-08T19:57:58.421976] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-08T19:57:58.481913] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:57:58.520307] [DEBUG] [LOCAL ] LOMA: Loaded 32169 existing records from primary storage. [2025-10-08T19:57:58.520748] [INFO ] [MAIN ] LOMA: Loaded 32169 existing records. [2025-10-08T19:57:58.625142] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T19:57:58.739569] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:57:58.739939] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-08T19:57:58.740008] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-08T19:57:58.740476] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-08T19:57:58.740552] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-08T19:57:59.115214] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:57:59.217520] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-08T19:57:59.939467] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T19:58:00.017519] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-08T19:58:00.323051] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T19:58:00.359382] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T19:58:00.817613] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-08T19:58:01.231327] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T19:58:01.617562] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-08T19:58:02.417576] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-08T19:58:02.998474] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T19:58:03.005074] [INFO ] [REMOTE ] LOAR: Full fetch complete (56171 records). [2025-10-08T19:58:03.005268] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-08T19:58:03.222674] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-08T19:58:03.405004] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-08T19:58:03.405092] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-08T19:58:03.406025] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-08T19:58:03.406098] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-08T19:58:03.407367] [DEBUG] [LOCAL ] LOAR: Trimmed 56171 records to 42082 (keeping 200 days of data) [2025-10-08T19:58:03.656082] [DEBUG] [LOCAL ] LOAR: Primary data saved (42082 records). [2025-10-08T19:58:03.656268] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-08T19:58:03.656361] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOAR took 37.9s. Estimated remaining: 2h 34m 50s. Rate: 7.1 symbols/min [2025-10-08T19:58:03.835795] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:03.854318] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T19:58:03.912226] [DEBUG] [LOCAL ] LOW: Loaded 52967 existing records from primary storage. [2025-10-08T19:58:03.912662] [INFO ] [MAIN ] LOW: Loaded 52967 existing records. [2025-10-08T19:58:04.022739] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-08T19:58:04.098638] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:04.098943] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-08T19:58:04.098992] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-08T19:58:04.099293] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-08T19:58:04.099363] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-08T19:58:04.462137] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:04.743853] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T19:58:04.817509] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-08T19:58:05.598359] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:58:05.617504] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-08T19:58:06.143959] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T19:58:06.330534] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T19:58:06.417530] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-08T19:58:07.217521] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-08T19:58:07.266205] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T19:58:08.013665] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T19:58:08.017484] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-08T19:58:08.448020] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T19:58:08.817570] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-08T19:58:09.617560] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-08T19:58:10.417529] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-08T19:58:10.601511] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T19:58:10.657073] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T19:58:10.852144] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-08T19:58:11.217567] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-08T19:58:12.017585] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-08T19:58:12.354424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T19:58:12.817560] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-08T19:58:13.336594] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T19:58:13.617589] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-08T19:58:14.046855] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T19:58:14.417568] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-08T19:58:15.217565] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-08T19:58:15.504021] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-08T19:58:15.530277] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T19:58:15.532786] [INFO ] [REMOTE ] LOB: Full fetch complete (38049 records). [2025-10-08T19:58:15.532867] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-08T19:58:15.628893] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-08T19:58:15.912419] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-08T19:58:15.912506] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-08T19:58:15.913300] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-08T19:58:15.913363] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-08T19:58:15.914250] [DEBUG] [LOCAL ] LOB: Trimmed 38049 records to 27185 (keeping 200 days of data) [2025-10-08T19:58:16.017832] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-08T19:58:16.087166] [DEBUG] [LOCAL ] LOB: Primary data saved (27185 records). [2025-10-08T19:58:16.087316] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-08T19:58:16.087404] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LOB took 28.4s. Estimated remaining: 2h 34m 45s. Rate: 7.1 symbols/min [2025-10-08T19:58:16.256707] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:16.304248] [DEBUG] [LOCAL ] LPG: Loaded 39729 existing records from primary storage. [2025-10-08T19:58:16.304596] [INFO ] [MAIN ] LPG: Loaded 39729 existing records. [2025-10-08T19:58:16.409969] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-08T19:58:16.493822] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:16.494099] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-08T19:58:16.494159] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-08T19:58:16.494540] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-08T19:58:16.494598] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-08T19:58:16.821329] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-08T19:58:16.851793] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:17.383033] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T19:58:17.617557] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-08T19:58:18.417571] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-08T19:58:18.942498] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T19:58:18.943300] [INFO ] [REMOTE ] LOCL: Full fetch complete (4511 records). [2025-10-08T19:58:18.943371] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-08T19:58:19.220724] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-08T19:58:19.318619] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-08T19:58:19.318861] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-08T19:58:19.319073] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-08T19:58:19.319149] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-08T19:58:19.329573] [DEBUG] [LOCAL ] LOCL: Trimmed 4511 records to 3627 (keeping 200 days of data) [2025-10-08T19:58:19.356962] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T19:58:19.379281] [DEBUG] [LOCAL ] LOCL: Primary data saved (3627 records). [2025-10-08T19:58:19.379397] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-08T19:58:19.379474] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOCL took 27.3s. Estimated remaining: 2h 34m 32s. Rate: 7.1 symbols/min [2025-10-08T19:58:19.551525] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:19.579288] [DEBUG] [LOCAL ] LPL: Loaded 27148 existing records from primary storage. [2025-10-08T19:58:19.579597] [INFO ] [MAIN ] LPL: Loaded 27148 existing records. [2025-10-08T19:58:19.759954] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:19.760260] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-08T19:58:19.760320] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-08T19:58:19.760552] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-08T19:58:19.760625] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-08T19:58:20.025854] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-08T19:58:20.119571] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:20.249846] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T19:58:20.817550] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-08T19:58:21.617597] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-08T19:58:21.850534] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T19:58:21.927362] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T19:58:22.417609] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-08T19:58:22.636072] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T19:58:23.217554] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-08T19:58:24.028074] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-08T19:58:24.033439] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T19:58:24.102557] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T19:58:24.817606] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-08T19:58:25.617524] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-08T19:58:25.934568] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T19:58:25.980626] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T19:58:26.417560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-08T19:58:26.916701] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T19:58:27.217530] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-08T19:58:28.017544] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-08T19:58:28.345496] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T19:58:28.402696] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T19:58:28.817602] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-08T19:58:28.896171] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T19:58:29.617550] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-08T19:58:30.417538] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-08T19:58:30.586520] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T19:58:31.120946] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T19:58:31.217525] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-08T19:58:31.309298] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T19:58:32.012199] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T19:58:32.017490] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-08T19:58:32.769575] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T19:58:32.817529] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-08T19:58:33.617548] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-08T19:58:33.939437] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T19:58:34.417573] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-08T19:58:34.797864] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T19:58:35.217540] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-08T19:58:35.645963] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T19:58:36.017546] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-08T19:58:36.817521] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-08T19:58:36.974318] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T19:58:37.561516] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T19:58:37.617566] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-08T19:58:37.901196] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T19:58:37.903964] [INFO ] [REMOTE ] LOMA: Full fetch complete (47706 records). [2025-10-08T19:58:37.904070] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-08T19:58:38.299161] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-08T19:58:38.299253] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-08T19:58:38.300086] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-08T19:58:38.300151] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-08T19:58:38.301219] [DEBUG] [LOCAL ] LOMA: Trimmed 47706 records to 32180 (keeping 200 days of data) [2025-10-08T19:58:38.418441] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-08T19:58:38.494172] [DEBUG] [LOCAL ] LOMA: Primary data saved (32180 records). [2025-10-08T19:58:38.494347] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-08T19:58:38.494457] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOMA took 40.2s. Estimated remaining: 2h 34m 33s. Rate: 7.1 symbols/min [2025-10-08T19:58:38.682812] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:38.699229] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T19:58:38.743411] [DEBUG] [LOCAL ] LPX: Loaded 39780 existing records from primary storage. [2025-10-08T19:58:38.743806] [INFO ] [MAIN ] LPX: Loaded 39780 existing records. [2025-10-08T19:58:38.973490] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:38.973774] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-08T19:58:38.973827] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-08T19:58:38.974051] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-08T19:58:38.974108] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-08T19:58:39.222820] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-08T19:58:39.334430] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:40.017496] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-08T19:58:40.253858] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T19:58:40.459235] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T19:58:40.817615] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-08T19:58:41.478264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:58:41.572076] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T19:58:41.617565] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-08T19:58:42.417613] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-08T19:58:43.160014] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:58:43.217499] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-08T19:58:43.646624] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T19:58:44.017565] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-08T19:58:44.831045] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-08T19:58:44.862318] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T19:58:45.543631] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T19:58:45.617509] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-08T19:58:46.039539] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T19:58:46.417551] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-08T19:58:47.080030] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T19:58:47.217560] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-08T19:58:47.702047] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T19:58:48.017580] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-08T19:58:48.817549] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-08T19:58:49.160372] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T19:58:49.227816] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T19:58:49.617587] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-08T19:58:50.116935] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T19:58:50.120205] [INFO ] [REMOTE ] LPL: Full fetch complete (36156 records). [2025-10-08T19:58:50.120335] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-08T19:58:50.422670] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-08T19:58:50.495886] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-08T19:58:50.495970] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-08T19:58:50.496620] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-08T19:58:50.496718] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-08T19:58:50.497706] [DEBUG] [LOCAL ] LPL: Trimmed 36156 records to 27378 (keeping 200 days of data) [2025-10-08T19:58:50.654945] [DEBUG] [LOCAL ] LPL: Primary data saved (27378 records). [2025-10-08T19:58:50.655082] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-08T19:58:50.655171] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPL took 31.3s. Estimated remaining: 2h 34m 28s. Rate: 7.1 symbols/min [2025-10-08T19:58:50.823887] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:50.865961] [DEBUG] [LOCAL ] LRN: Loaded 39718 existing records from primary storage. [2025-10-08T19:58:50.866289] [INFO ] [MAIN ] LRN: Loaded 39718 existing records. [2025-10-08T19:58:51.052965] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:51.053382] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-08T19:58:51.053522] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-08T19:58:51.053980] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-08T19:58:51.054111] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-08T19:58:51.224066] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-08T19:58:51.458955] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:51.492099] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T19:58:51.513776] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T19:58:51.517713] [INFO ] [REMOTE ] LPG: Full fetch complete (59357 records). [2025-10-08T19:58:51.517896] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-08T19:58:51.951423] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-08T19:58:51.951521] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-08T19:58:51.952386] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-08T19:58:51.952451] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-08T19:58:51.955570] [DEBUG] [LOCAL ] LPG: Trimmed 59357 records to 39690 (keeping 200 days of data) [2025-10-08T19:58:52.022598] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-08T19:58:52.208336] [DEBUG] [LOCAL ] LPG: Primary data saved (39690 records). [2025-10-08T19:58:52.208496] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-08T19:58:52.208597] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LPG took 36.1s. Estimated remaining: 2h 34m 14s. Rate: 7.1 symbols/min [2025-10-08T19:58:52.420050] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:52.466173] [DEBUG] [LOCAL ] LSPD: Loaded 42822 existing records from primary storage. [2025-10-08T19:58:52.466583] [INFO ] [MAIN ] LSPD: Loaded 42822 existing records. [2025-10-08T19:58:52.653936] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:52.654245] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-08T19:58:52.654348] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-08T19:58:52.654684] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-08T19:58:52.654783] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-08T19:58:52.828706] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-08T19:58:52.941822] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T19:58:53.061936] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:53.576745] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T19:58:53.581504] [INFO ] [REMOTE ] LOW: Full fetch complete (76525 records). [2025-10-08T19:58:53.581771] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-08T19:58:53.623282] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-08T19:58:54.050085] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-08T19:58:54.050243] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-08T19:58:54.051827] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-08T19:58:54.051903] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-08T19:58:54.054147] [DEBUG] [LOCAL ] LOW: Trimmed 76525 records to 52977 (keeping 200 days of data) [2025-10-08T19:58:54.338959] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T19:58:54.422167] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-08T19:58:54.481682] [DEBUG] [LOCAL ] LOW: Primary data saved (52977 records). [2025-10-08T19:58:54.481929] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-08T19:58:54.482067] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 50.8s. Estimated remaining: 2h 33m 60s. Rate: 7.1 symbols/min [2025-10-08T19:58:54.689291] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:58:54.726087] [DEBUG] [LOCAL ] LTC: Loaded 30225 existing records from primary storage. [2025-10-08T19:58:54.726595] [INFO ] [MAIN ] LTC: Loaded 30225 existing records. [2025-10-08T19:58:54.925079] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:58:54.925476] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-08T19:58:54.925554] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-08T19:58:54.925916] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-08T19:58:54.925982] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-08T19:58:55.228278] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-08T19:58:55.385993] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:58:55.411442] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T19:58:55.736312] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T19:58:56.017561] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-08T19:58:56.815286] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T19:58:56.823133] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-08T19:58:57.054780] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T19:58:57.617550] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-08T19:58:58.272599] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T19:58:58.417595] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-08T19:58:59.131900] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T19:58:59.217554] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-08T19:58:59.558799] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T19:59:00.017736] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-08T19:59:00.792779] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:59:00.817503] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-08T19:59:01.519431] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T19:59:01.617497] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-08T19:59:02.426035] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-08T19:59:02.444135] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T19:59:03.101972] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T19:59:03.217561] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-08T19:59:03.672605] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T19:59:04.017616] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-08T19:59:04.720232] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T19:59:04.817571] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-08T19:59:05.588139] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T19:59:05.617517] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-08T19:59:06.098482] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T19:59:06.417627] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-08T19:59:07.195112] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T19:59:07.217492] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-08T19:59:07.875585] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T19:59:08.017549] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-08T19:59:08.352796] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T19:59:08.817540] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-08T19:59:09.136613] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T19:59:09.139845] [INFO ] [REMOTE ] LPX: Full fetch complete (58825 records). [2025-10-08T19:59:09.139941] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-08T19:59:09.537251] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-08T19:59:09.537327] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-08T19:59:09.538201] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-08T19:59:09.538266] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-08T19:59:09.539472] [DEBUG] [LOCAL ] LPX: Trimmed 58825 records to 39813 (keeping 200 days of data) [2025-10-08T19:59:09.628710] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-08T19:59:09.785093] [DEBUG] [LOCAL ] LPX: Primary data saved (39813 records). [2025-10-08T19:59:09.785237] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-08T19:59:09.785321] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPX took 31.3s. Estimated remaining: 2h 33m 57s. Rate: 7.1 symbols/min [2025-10-08T19:59:09.959187] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:10.007031] [DEBUG] [LOCAL ] LTH: Loaded 51727 existing records from primary storage. [2025-10-08T19:59:10.007350] [INFO ] [MAIN ] LTH: Loaded 51727 existing records. [2025-10-08T19:59:10.186312] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:10.186528] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-08T19:59:10.186584] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-08T19:59:10.187728] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-08T19:59:10.187806] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-08T19:59:10.424207] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-08T19:59:10.555781] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:10.584611] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T19:59:10.822170] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T19:59:11.217544] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-08T19:59:11.686274] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T19:59:12.017531] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-08T19:59:12.113103] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T19:59:12.817584] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-08T19:59:13.459344] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T19:59:13.617541] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-08T19:59:13.987685] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T19:59:14.417552] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-10-08T19:59:15.066110] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T19:59:15.217541] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-08T19:59:15.700149] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T19:59:16.017587] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-08T19:59:16.692826] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T19:59:16.817567] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-08T19:59:17.304942] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T19:59:17.617602] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-08T19:59:18.221497] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T19:59:18.417563] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-08T19:59:18.805568] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T19:59:19.217604] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-08T19:59:19.791390] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T19:59:19.795202] [INFO ] [REMOTE ] LSPD: Full fetch complete (61747 records). [2025-10-08T19:59:19.795337] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-08T19:59:20.023015] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-08T19:59:20.275057] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-08T19:59:20.275143] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-08T19:59:20.276017] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-08T19:59:20.276081] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-08T19:59:20.277374] [DEBUG] [LOCAL ] LSPD: Trimmed 61747 records to 42846 (keeping 200 days of data) [2025-10-08T19:59:20.560692] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T19:59:20.581408] [DEBUG] [LOCAL ] LSPD: Primary data saved (42846 records). [2025-10-08T19:59:20.581686] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-08T19:59:20.581863] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LSPD took 28.4s. Estimated remaining: 2h 33m 51s. Rate: 7.1 symbols/min [2025-10-08T19:59:20.763869] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:20.802826] [DEBUG] [LOCAL ] LTM: Loaded 37710 existing records from primary storage. [2025-10-08T19:59:20.803171] [INFO ] [MAIN ] LTM: Loaded 37710 existing records. [2025-10-08T19:59:20.824168] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-08T19:59:20.992979] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:20.993224] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-08T19:59:20.993272] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-08T19:59:20.993516] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-08T19:59:20.993572] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-08T19:59:21.388463] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:21.585014] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T19:59:21.617512] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-08T19:59:21.763521] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T19:59:22.417618] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-10-08T19:59:23.217520] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-08T19:59:23.426926] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T19:59:23.512738] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T19:59:24.017555] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-08T19:59:24.417274] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T19:59:24.420177] [INFO ] [REMOTE ] LRN: Full fetch complete (58416 records). [2025-10-08T19:59:24.420261] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-08T19:59:24.796620] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-08T19:59:24.796732] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-08T19:59:24.797541] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-08T19:59:24.797584] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-08T19:59:24.798802] [DEBUG] [LOCAL ] LRN: Trimmed 58416 records to 39676 (keeping 200 days of data) [2025-10-08T19:59:24.851753] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-08T19:59:25.045788] [DEBUG] [LOCAL ] LRN: Primary data saved (39676 records). [2025-10-08T19:59:25.045954] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-08T19:59:25.047228] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 34.4s. Estimated remaining: 2h 33m 39s. Rate: 7.1 symbols/min [2025-10-08T19:59:25.617541] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-08T19:59:25.700862] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:59:25.737281] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T19:59:26.417571] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-08T19:59:27.143078] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T19:59:27.217541] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-08T19:59:28.017593] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-08T19:59:28.175307] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T19:59:28.239243] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T19:59:28.817508] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-08T19:59:29.217188] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T19:59:29.617546] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-08T19:59:29.842383] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T19:59:30.417624] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-08T19:59:30.798741] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T19:59:31.217554] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-08T19:59:32.017521] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-08T19:59:32.088122] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T19:59:32.519784] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T19:59:32.817629] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-08T19:59:33.368087] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:59:33.617536] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-08T19:59:33.787067] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T19:59:33.789775] [INFO ] [REMOTE ] LTC: Full fetch complete (43538 records). [2025-10-08T19:59:33.789869] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-08T19:59:34.178925] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-08T19:59:34.179010] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-08T19:59:34.179854] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-08T19:59:34.179924] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-08T19:59:34.180949] [DEBUG] [LOCAL ] LTC: Trimmed 43538 records to 30272 (keeping 200 days of data) [2025-10-08T19:59:34.370636] [DEBUG] [LOCAL ] LTC: Primary data saved (30272 records). [2025-10-08T19:59:34.370813] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-08T19:59:34.370907] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 39.9s. Estimated remaining: 2h 33m 31s. Rate: 7.1 symbols/min [2025-10-08T19:59:34.417514] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-08T19:59:34.715262] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T19:59:35.217535] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-08T19:59:35.822853] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T19:59:36.017548] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-08T19:59:36.533077] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T19:59:36.817561] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-08T19:59:37.479606] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T19:59:37.617503] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-08T19:59:37.780680] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T19:59:38.417631] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-08T19:59:39.257368] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T19:59:39.268411] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-08T19:59:39.635457] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T19:59:40.017587] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-08T19:59:41.077872] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T19:59:41.082095] [INFO ] [REMOTE ] LTH: Full fetch complete (74365 records). [2025-10-08T19:59:41.082239] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-08T19:59:41.587542] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-08T19:59:41.587803] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-08T19:59:41.588814] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-08T19:59:41.598272] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-08T19:59:41.617407] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T19:59:41.628835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-08T19:59:41.628951] [DEBUG] [LOCAL ] LTH: Trimmed 74365 records to 51722 (keeping 200 days of data) [2025-10-08T19:59:41.931108] [DEBUG] [LOCAL ] LTH: Primary data saved (51722 records). [2025-10-08T19:59:41.931255] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-08T19:59:41.931342] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTH took 32.1s. Estimated remaining: 2h 33m 22s. Rate: 7.1 symbols/min [2025-10-08T19:59:43.018226] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T19:59:43.021842] [INFO ] [REMOTE ] LTM: Full fetch complete (48908 records). [2025-10-08T19:59:43.021944] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-08T19:59:43.390621] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-08T19:59:43.390735] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-08T19:59:43.391509] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-08T19:59:43.391551] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-08T19:59:43.392755] [DEBUG] [LOCAL ] LTM: Trimmed 48908 records to 37874 (keeping 200 days of data) [2025-10-08T19:59:43.610816] [DEBUG] [LOCAL ] LTM: Primary data saved (37874 records). [2025-10-08T19:59:43.610970] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-08T19:59:43.611059] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTM took 23.0s. Estimated remaining: 2h 33m 8s. Rate: 7.1 symbols/min [2025-10-08T19:59:44.288963] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:44.303249] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:44.312694] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:44.340170] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T19:59:44.381882] [DEBUG] [LOCAL ] LUCK: Loaded 24436 existing records from primary storage. [2025-10-08T19:59:44.382321] [INFO ] [MAIN ] LUCK: Loaded 24436 existing records. [2025-10-08T19:59:44.519436] [DEBUG] [LOCAL ] LUMN: Loaded 53642 existing records from primary storage. [2025-10-08T19:59:44.530190] [INFO ] [MAIN ] LUMN: Loaded 53642 existing records. [2025-10-08T19:59:44.743338] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-08T19:59:44.728015] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:44.749967] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-08T19:59:44.744231] [DEBUG] [LOCAL ] LU: Loaded 48938 existing records from primary storage. [2025-10-08T19:59:44.755376] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-08T19:59:44.770885] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-08T19:59:44.770832] [INFO ] [MAIN ] LU: Loaded 48938 existing records. [2025-10-08T19:59:44.925750] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-08T19:59:44.934538] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-08T19:59:44.894409] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:45.038925] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-08T19:59:45.054482] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-08T19:59:45.109074] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-08T19:59:45.109188] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-08T19:59:45.396606] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:45.424183] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T19:59:45.448561] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-08T19:59:45.438344] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-08T19:59:45.451516] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-08T19:59:45.479578] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-08T19:59:45.492134] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-08T19:59:45.480078] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-08T19:59:45.544323] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-08T19:59:45.578859] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-08T19:59:46.052014] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:46.131320] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-10-08T19:59:46.381280] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:46.406004] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-10-08T19:59:46.642106] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:46.664441] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-10-08T19:59:46.664185] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T19:59:46.664748] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-10-08T19:59:47.448777] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T19:59:47.453907] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-08T19:59:48.078633] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T19:59:48.090557] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-08T19:59:48.158727] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T19:59:48.170054] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-08T19:59:48.206461] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T19:59:48.217470] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-08T19:59:48.555582] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T19:59:48.564031] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-08T19:59:49.277130] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T19:59:49.286454] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-08T19:59:49.943774] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T19:59:49.951939] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-08T19:59:50.050882] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T19:59:50.093071] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T19:59:50.395818] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T19:59:50.417498] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-08T19:59:50.996332] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T19:59:51.217560] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-08T19:59:52.017521] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-08T19:59:52.210527] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T19:59:52.279495] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T19:59:52.817592] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-08T19:59:53.617589] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-08T19:59:53.682984] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T19:59:54.417513] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-08T19:59:54.454916] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T19:59:55.217549] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-08T19:59:55.339697] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T19:59:55.604449] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T19:59:56.017701] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-08T19:59:56.571229] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T19:59:56.817575] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-08T19:59:57.617510] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-08T19:59:57.694676] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T19:59:58.417595] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-08T19:59:58.492736] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T19:59:58.522553] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T19:59:59.217560] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-08T20:00:00.017523] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-08T20:00:00.294740] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T20:00:00.817539] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-08T20:00:00.978629] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T20:00:01.035317] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T20:00:01.617719] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-08T20:00:02.417580] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-08T20:00:02.642715] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T20:00:02.825194] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-08T20:00:03.217595] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-08T20:00:04.017622] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-08T20:00:04.078416] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T20:00:04.817569] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-08T20:00:05.389085] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-08T20:00:05.617693] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-08T20:00:05.969630] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T20:00:06.037434] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T20:00:06.417526] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-08T20:00:07.074346] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T20:00:07.217565] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-08T20:00:07.291710] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T20:00:07.293678] [INFO ] [REMOTE ] LUCK: Full fetch complete (40640 records). [2025-10-08T20:00:07.293787] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-08T20:00:07.661456] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-08T20:00:07.661537] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-08T20:00:07.662146] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-08T20:00:07.662209] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-08T20:00:07.663060] [DEBUG] [LOCAL ] LUCK: Trimmed 40640 records to 24438 (keeping 200 days of data) [2025-10-08T20:00:07.805164] [DEBUG] [LOCAL ] LUCK: Primary data saved (24438 records). [2025-10-08T20:00:07.805311] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-08T20:00:07.805399] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LUCK took 24.2s. Estimated remaining: 2h 33m 13s. Rate: 7.1 symbols/min [2025-10-08T20:00:07.976162] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:07.976420] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-08T20:00:07.976484] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-08T20:00:07.976582] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-08T20:00:07.976633] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-08T20:00:07.976740] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-08T20:00:07.976792] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-08T20:00:08.022695] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-08T20:00:08.336545] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:08.817602] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-10-08T20:00:09.414595] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:00:09.414967] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-10-08T20:00:09.415060] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:00:09.415129] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-08T20:00:09.415195] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:00:09.415268] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-08T20:00:09.415333] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-08T20:00:09.415388] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-08T20:00:09.415455] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-08T20:00:09.415528] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUXE took 1.6s. Estimated remaining: 2h 32m 59s. Rate: 7.1 symbols/min [2025-10-08T20:00:09.602764] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:09.603632] [DEBUG] [LOCAL ] LVS: No existing data file found in primary storage. [2025-10-08T20:00:09.603804] [WARN ] [MAIN ] LVS: No existing data found, performing full refresh instead. [2025-10-08T20:00:09.604569] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-08T20:00:09.630455] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-08T20:00:09.630540] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-08T20:00:09.637253] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T20:00:09.634605] [DEBUG] [LOCAL ] LVS: No primary data file found to delete. [2025-10-08T20:00:09.637547] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-08T20:00:09.793987] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T20:00:10.079629] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:10.417556] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-08T20:00:11.217582] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-08T20:00:11.512543] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T20:00:12.017580] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-10-08T20:00:12.345696] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T20:00:12.611077] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T20:00:12.615198] [INFO ] [REMOTE ] LU: Full fetch complete (70392 records). [2025-10-08T20:00:12.615361] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-08T20:00:12.829216] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-08T20:00:13.042057] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-08T20:00:13.042159] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-08T20:00:13.043157] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-08T20:00:13.043230] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-08T20:00:13.044743] [DEBUG] [LOCAL ] LU: Trimmed 70392 records to 48971 (keeping 200 days of data) [2025-10-08T20:00:13.336519] [DEBUG] [LOCAL ] LU: Primary data saved (48971 records). [2025-10-08T20:00:13.336707] [INFO ] [MAIN ] LU: Full history saved. [2025-10-08T20:00:13.336814] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LU took 29.7s. Estimated remaining: 2h 32m 47s. Rate: 7.1 symbols/min [2025-10-08T20:00:13.529923] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:13.550896] [DEBUG] [LOCAL ] LVWR: Loaded 18123 existing records from primary storage. [2025-10-08T20:00:13.551171] [INFO ] [MAIN ] LVWR: Loaded 18123 existing records. [2025-10-08T20:00:13.619716] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-08T20:00:13.751698] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:13.752199] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-08T20:00:13.752325] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-08T20:00:13.752916] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-08T20:00:13.752997] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-08T20:00:14.152927] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T20:00:14.195038] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:14.417700] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-10-08T20:00:14.770795] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-08T20:00:14.920212] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-08T20:00:15.217566] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-08T20:00:15.545628] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-08T20:00:15.551164] [INFO ] [REMOTE ] LUV: Full fetch complete (77729 records). [2025-10-08T20:00:15.551332] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-08T20:00:15.666188] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T20:00:15.980319] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-08T20:00:15.980424] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-08T20:00:15.981565] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-08T20:00:15.981695] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-08T20:00:15.983479] [DEBUG] [LOCAL ] LUV: Trimmed 77729 records to 53689 (keeping 200 days of data) [2025-10-08T20:00:16.044831] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-08T20:00:16.335196] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-08T20:00:16.335362] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-08T20:00:16.335454] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUV took 32.7s. Estimated remaining: 2h 32m 34s. Rate: 7.1 symbols/min [2025-10-08T20:00:16.510045] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:16.559836] [DEBUG] [LOCAL ] LW: Loaded 51208 existing records from primary storage. [2025-10-08T20:00:16.560216] [INFO ] [MAIN ] LW: Loaded 51208 existing records. [2025-10-08T20:00:16.736183] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:16.736451] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-08T20:00:16.736497] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-08T20:00:16.736829] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-08T20:00:16.736892] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-08T20:00:16.824358] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-08T20:00:17.088997] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:17.302768] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T20:00:17.508829] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T20:00:17.617558] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-08T20:00:18.180598] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T20:00:18.417701] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-08T20:00:19.010771] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T20:00:19.217574] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-08T20:00:20.017569] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-08T20:00:20.817602] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-08T20:00:20.913882] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T20:00:20.979472] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T20:00:21.617548] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-08T20:00:22.417519] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-08T20:00:22.725528] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T20:00:23.035124] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T20:00:23.217568] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-08T20:00:24.017578] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-08T20:00:24.178228] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:00:24.209950] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T20:00:24.817553] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-10-08T20:00:25.617547] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-08T20:00:25.868093] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T20:00:26.180591] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:00:26.417559] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-08T20:00:27.217602] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-08T20:00:27.591898] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T20:00:28.017584] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-08T20:00:28.046949] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T20:00:28.155023] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T20:00:28.817573] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-08T20:00:29.617555] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-08T20:00:29.748787] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T20:00:30.110342] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-08T20:00:30.417553] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-08T20:00:31.217554] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-08T20:00:31.227338] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T20:00:31.229741] [INFO ] [REMOTE ] LVWR: Full fetch complete (20300 records). [2025-10-08T20:00:31.229845] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-08T20:00:31.635173] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-08T20:00:31.635316] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-08T20:00:31.635852] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-08T20:00:31.635933] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-08T20:00:31.664356] [DEBUG] [LOCAL ] LVWR: Trimmed 20300 records to 18174 (keeping 200 days of data) [2025-10-08T20:00:31.667479] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T20:00:31.786404] [DEBUG] [LOCAL ] LVWR: Primary data saved (18174 records). [2025-10-08T20:00:31.786595] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-08T20:00:31.786729] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LVWR took 18.4s. Estimated remaining: 2h 32m 31s. Rate: 7.1 symbols/min [2025-10-08T20:00:31.953148] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:31.971425] [DEBUG] [LOCAL ] LXFR: Loaded 16763 existing records from primary storage. [2025-10-08T20:00:31.971747] [INFO ] [MAIN ] LXFR: Loaded 16763 existing records. [2025-10-08T20:00:32.024383] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-08T20:00:32.151554] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:32.151829] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-08T20:00:32.151878] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-08T20:00:32.152163] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-08T20:00:32.152221] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-08T20:00:32.497464] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:32.817537] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-08T20:00:32.855988] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T20:00:33.617606] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-08T20:00:33.724018] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T20:00:34.417511] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-08T20:00:34.926224] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-08T20:00:35.217581] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-10-08T20:00:35.369270] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T20:00:35.997762] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T20:00:36.017500] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-08T20:00:36.235214] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:00:36.817566] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-08T20:00:37.617522] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-08T20:00:37.802272] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T20:00:38.417556] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-08T20:00:38.529687] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T20:00:38.621418] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T20:00:38.626582] [INFO ] [REMOTE ] LUMN: Full fetch complete (77637 records). [2025-10-08T20:00:38.626786] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-08T20:00:39.051973] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-08T20:00:39.052081] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-08T20:00:39.054184] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-08T20:00:39.054275] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-08T20:00:39.056000] [DEBUG] [LOCAL ] LUMN: Trimmed 77637 records to 53641 (keeping 200 days of data) [2025-10-08T20:00:39.227425] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-08T20:00:39.399672] [DEBUG] [LOCAL ] LUMN: Primary data saved (53641 records). [2025-10-08T20:00:39.399842] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-08T20:00:39.399953] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUMN took 55.8s. Estimated remaining: 2h 32m 22s. Rate: 7.1 symbols/min [2025-10-08T20:00:39.575879] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:39.633530] [DEBUG] [LOCAL ] LXP: Loaded 50755 existing records from primary storage. [2025-10-08T20:00:39.633974] [INFO ] [MAIN ] LXP: Loaded 50755 existing records. [2025-10-08T20:00:39.819144] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:39.819427] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-08T20:00:39.819591] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-08T20:00:39.819910] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-08T20:00:39.820000] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-08T20:00:40.025569] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-08T20:00:40.114134] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T20:00:40.239576] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:40.254007] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T20:00:40.817548] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-10-08T20:00:41.617530] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-08T20:00:41.722495] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T20:00:42.422691] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-08T20:00:42.438421] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T20:00:42.602979] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T20:00:43.217529] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-08T20:00:44.017537] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-08T20:00:44.079258] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T20:00:44.276370] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T20:00:44.817577] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-08T20:00:45.547878] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T20:00:45.617579] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-08T20:00:45.801495] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T20:00:46.417698] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-08T20:00:47.217552] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-08T20:00:47.400445] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T20:00:47.565521] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T20:00:48.017600] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-08T20:00:48.666627] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T20:00:48.671019] [INFO ] [REMOTE ] LVS: Full fetch complete (77517 records). [2025-10-08T20:00:48.671187] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-08T20:00:48.823371] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-08T20:00:49.098579] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-08T20:00:49.098726] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-08T20:00:49.099888] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-08T20:00:49.099953] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-08T20:00:49.101932] [DEBUG] [LOCAL ] LVS: Trimmed 77517 records to 53569 (keeping 200 days of data) [2025-10-08T20:00:49.446106] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-08T20:00:49.446262] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-08T20:00:49.446341] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVS took 40.0s. Estimated remaining: 2h 32m 15s. Rate: 7.1 symbols/min [2025-10-08T20:00:49.625090] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:49.621383] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-08T20:00:49.657145] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T20:00:49.692526] [DEBUG] [LOCAL ] LXU: Loaded 31840 existing records from primary storage. [2025-10-08T20:00:49.692857] [INFO ] [MAIN ] LXU: Loaded 31840 existing records. [2025-10-08T20:00:49.873149] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:49.873383] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-08T20:00:49.873430] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-08T20:00:49.873637] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-08T20:00:49.873722] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-08T20:00:50.237619] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:50.423302] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-08T20:00:50.424698] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T20:00:50.464270] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T20:00:51.217556] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-10-08T20:00:52.017571] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-08T20:00:52.184254] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T20:00:52.204169] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T20:00:52.817554] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-08T20:00:53.278589] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T20:00:53.617564] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-08T20:00:54.332103] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T20:00:54.379397] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T20:00:54.383405] [INFO ] [REMOTE ] LW: Full fetch complete (74677 records). [2025-10-08T20:00:54.383549] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-08T20:00:54.422703] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-08T20:00:54.791673] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-08T20:00:54.791784] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-08T20:00:54.792868] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-08T20:00:54.792938] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-08T20:00:54.794912] [DEBUG] [LOCAL ] LW: Trimmed 74677 records to 51218 (keeping 200 days of data) [2025-10-08T20:00:55.124948] [DEBUG] [LOCAL ] LW: Primary data saved (51218 records). [2025-10-08T20:00:55.125094] [INFO ] [MAIN ] LW: Full history saved. [2025-10-08T20:00:55.125193] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LW took 38.8s. Estimated remaining: 2h 32m 4s. Rate: 7.1 symbols/min [2025-10-08T20:00:55.229675] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-08T20:00:55.243614] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T20:00:55.327008] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:55.388674] [DEBUG] [LOCAL ] LYB: Loaded 53611 existing records from primary storage. [2025-10-08T20:00:55.389086] [INFO ] [MAIN ] LYB: Loaded 53611 existing records. [2025-10-08T20:00:55.567155] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:55.567343] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-08T20:00:55.567426] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-08T20:00:55.567633] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-08T20:00:55.567718] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-08T20:00:55.932280] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:56.017499] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-10-08T20:00:56.817546] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-08T20:00:56.919956] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T20:00:57.573430] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:00:57.575028] [INFO ] [REMOTE ] LXFR: Full fetch complete (24847 records). [2025-10-08T20:00:57.575103] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-08T20:00:57.621463] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-08T20:00:57.992533] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-08T20:00:57.992787] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-08T20:00:57.993483] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-08T20:00:57.993829] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-08T20:00:58.024098] [DEBUG] [LOCAL ] LXFR: Trimmed 24847 records to 16738 (keeping 200 days of data) [2025-10-08T20:00:58.026011] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T20:00:58.141826] [DEBUG] [LOCAL ] LXFR: Primary data saved (16738 records). [2025-10-08T20:00:58.141987] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-08T20:00:58.142079] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LXFR took 26.4s. Estimated remaining: 2h 31m 51s. Rate: 7.1 symbols/min [2025-10-08T20:00:58.312401] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:00:58.372447] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-08T20:00:58.372806] [INFO ] [MAIN ] LYG: Loaded 52778 existing records. [2025-10-08T20:00:58.425970] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-08T20:00:58.552109] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:00:58.552337] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-08T20:00:58.552385] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-08T20:00:58.552639] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-08T20:00:58.552733] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-08T20:00:58.944303] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:00:58.971273] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T20:00:59.217578] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-08T20:01:00.017593] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-10-08T20:01:00.264503] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T20:01:00.817522] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-08T20:01:01.050622] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T20:01:01.540948] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T20:01:01.617542] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-08T20:01:02.417528] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-08T20:01:02.485667] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T20:01:03.217604] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-08T20:01:03.454216] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T20:01:04.017558] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-08T20:01:04.265934] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T20:01:04.817503] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-08T20:01:04.866532] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T20:01:05.195378] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T20:01:05.617591] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-08T20:01:06.417520] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-08T20:01:06.467868] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T20:01:07.217519] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-08T20:01:07.271031] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:01:07.877637] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T20:01:08.017567] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-08T20:01:08.664184] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T20:01:08.817571] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-08T20:01:09.617578] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-08T20:01:09.938391] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T20:01:09.974736] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T20:01:10.417515] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-08T20:01:11.211164] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T20:01:11.221821] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-08T20:01:11.311749] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T20:01:12.017556] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-08T20:01:12.817527] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-08T20:01:13.018801] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T20:01:13.617521] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-08T20:01:13.672448] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:01:14.417561] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-08T20:01:14.760481] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T20:01:15.038682] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T20:01:15.217568] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-08T20:01:15.397562] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T20:01:16.017563] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-08T20:01:16.496778] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T20:01:16.817571] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-08T20:01:17.617552] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-08T20:01:18.016954] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T20:01:18.191311] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T20:01:18.417550] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-08T20:01:18.918132] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T20:01:18.923483] [INFO ] [REMOTE ] LXP: Full fetch complete (72696 records). [2025-10-08T20:01:18.923683] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-08T20:01:19.224098] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-08T20:01:19.339223] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-08T20:01:19.339349] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-08T20:01:19.340743] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-08T20:01:19.340811] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-08T20:01:19.342846] [DEBUG] [LOCAL ] LXP: Trimmed 72696 records to 50725 (keeping 200 days of data) [2025-10-08T20:01:19.652596] [DEBUG] [LOCAL ] LXP: Primary data saved (50725 records). [2025-10-08T20:01:19.652770] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-08T20:01:19.652876] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXP took 40.3s. Estimated remaining: 2h 31m 54s. Rate: 7.1 symbols/min [2025-10-08T20:01:19.837237] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:19.887502] [DEBUG] [LOCAL ] LYV: Loaded 51110 existing records from primary storage. [2025-10-08T20:01:19.887848] [INFO ] [MAIN ] LYV: Loaded 51110 existing records. [2025-10-08T20:01:20.040613] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-08T20:01:20.071965] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:20.073403] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-08T20:01:20.073488] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-08T20:01:20.073728] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-08T20:01:20.073787] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-08T20:01:20.267569] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T20:01:20.515518] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:20.590202] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T20:01:20.817571] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-10-08T20:01:21.617527] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-08T20:01:21.828331] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:01:22.054747] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T20:01:22.417588] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-08T20:01:23.217596] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-08T20:01:23.480230] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T20:01:23.586465] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T20:01:24.017547] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-08T20:01:24.604040] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T20:01:24.817522] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-08T20:01:24.896396] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T20:01:25.617551] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-08T20:01:26.236628] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T20:01:26.417549] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-08T20:01:26.948617] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T20:01:27.217628] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-08T20:01:27.749086] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T20:01:28.017561] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-08T20:01:28.817618] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-08T20:01:29.025699] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T20:01:29.617564] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-08T20:01:29.745308] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T20:01:29.749820] [INFO ] [REMOTE ] LYG: Full fetch complete (76068 records). [2025-10-08T20:01:29.750001] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-08T20:01:30.169435] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-08T20:01:30.169600] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-08T20:01:30.170878] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-08T20:01:30.171030] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-08T20:01:30.172662] [DEBUG] [LOCAL ] LYG: Trimmed 76068 records to 52778 (keeping 200 days of data) [2025-10-08T20:01:30.325373] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T20:01:30.418259] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-08T20:01:30.515531] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T20:01:30.519791] [INFO ] [REMOTE ] LXU: Full fetch complete (45065 records). [2025-10-08T20:01:30.520458] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-08T20:01:30.932980] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-08T20:01:30.933092] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-08T20:01:30.934232] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-08T20:01:30.934329] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-08T20:01:30.937408] [DEBUG] [LOCAL ] LYG: Primary data saved (52778 records). [2025-10-08T20:01:30.937693] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-08T20:01:30.938932] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LYG took 32.8s. Estimated remaining: 2h 31m 48s. Rate: 7.1 symbols/min [2025-10-08T20:01:30.954743] [DEBUG] [LOCAL ] LXU: Trimmed 45065 records to 31834 (keeping 200 days of data) [2025-10-08T20:01:31.215006] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:31.217714] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-08T20:01:31.328097] [DEBUG] [LOCAL ] LZB: Loaded 35179 existing records from primary storage. [2025-10-08T20:01:31.331093] [INFO ] [MAIN ] LZB: Loaded 35179 existing records. [2025-10-08T20:01:31.548829] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:31.550065] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-08T20:01:31.550173] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-08T20:01:31.551698] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-08T20:01:31.552046] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-08T20:01:31.625343] [DEBUG] [LOCAL ] LXU: Primary data saved (31834 records). [2025-10-08T20:01:31.640604] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-08T20:01:31.640739] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXU took 42.2s. Estimated remaining: 2h 31m 33s. Rate: 7.1 symbols/min [2025-10-08T20:01:32.003276] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:32.141845] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:32.142337] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-10-08T20:01:32.150317] [DEBUG] [LOCAL ] LZM: Loaded 14267 existing records from primary storage. [2025-10-08T20:01:32.150840] [INFO ] [MAIN ] LZM: Loaded 14267 existing records. [2025-10-08T20:01:32.372149] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T20:01:32.378275] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:32.378537] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-08T20:01:32.388686] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-08T20:01:32.389244] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-08T20:01:32.389480] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-08T20:01:32.752501] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:32.796571] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T20:01:32.806892] [INFO ] [REMOTE ] LYB: Full fetch complete (77460 records). [2025-10-08T20:01:32.807409] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-08T20:01:32.822853] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-10-08T20:01:33.208827] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-08T20:01:33.208933] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-08T20:01:33.209992] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-08T20:01:33.210058] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-08T20:01:33.211600] [DEBUG] [LOCAL ] LYB: Trimmed 77460 records to 53610 (keeping 200 days of data) [2025-10-08T20:01:33.353942] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:01:33.473224] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T20:01:33.592101] [DEBUG] [LOCAL ] LYB: Primary data saved (53610 records). [2025-10-08T20:01:33.592452] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-08T20:01:33.592553] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYB took 38.5s. Estimated remaining: 2h 31m 19s. Rate: 7.1 symbols/min [2025-10-08T20:01:33.623001] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-08T20:01:33.773286] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:33.824477] [DEBUG] [LOCAL ] M: Loaded 53539 existing records from primary storage. [2025-10-08T20:01:33.825057] [INFO ] [MAIN ] M: Loaded 53539 existing records. [2025-10-08T20:01:34.015494] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:34.015841] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-08T20:01:34.015923] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-08T20:01:34.016248] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-08T20:01:34.016328] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-08T20:01:34.411863] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:34.417499] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-10-08T20:01:35.217518] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-08T20:01:35.373864] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T20:01:36.017550] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-08T20:01:36.110633] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T20:01:36.547089] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T20:01:36.817591] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-08T20:01:37.434166] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T20:01:37.617528] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-08T20:01:38.220283] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T20:01:38.417626] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-08T20:01:39.200277] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T20:01:39.217501] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-08T20:01:39.254239] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T20:01:39.663134] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T20:01:40.017564] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-08T20:01:40.577949] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T20:01:40.817546] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-08T20:01:41.617555] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-08T20:01:41.823150] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T20:01:42.417578] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-08T20:01:42.815612] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T20:01:43.217532] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-08T20:01:44.017533] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-08T20:01:44.148206] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T20:01:44.632945] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T20:01:44.817542] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-08T20:01:45.201753] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-08T20:01:45.617560] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-08T20:01:45.650103] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T20:01:46.417594] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-08T20:01:46.855053] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T20:01:47.175519] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T20:01:47.217521] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-08T20:01:48.017603] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-08T20:01:48.194278] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T20:01:48.817558] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-08T20:01:49.617528] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-08T20:01:49.791305] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T20:01:49.862293] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T20:01:50.417572] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-08T20:01:51.217567] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-08T20:01:51.395901] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T20:01:51.847959] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T20:01:51.860271] [INFO ] [REMOTE ] LYV: Full fetch complete (73796 records). [2025-10-08T20:01:51.860569] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T20:01:51.860867] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-08T20:01:52.018068] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-08T20:01:52.287229] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-08T20:01:52.287379] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-08T20:01:52.289058] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-08T20:01:52.289138] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-08T20:01:52.290939] [DEBUG] [LOCAL ] LYV: Trimmed 73796 records to 51124 (keeping 200 days of data) [2025-10-08T20:01:52.631278] [DEBUG] [LOCAL ] LYV: Primary data saved (51124 records). [2025-10-08T20:01:52.631447] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-08T20:01:52.631537] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYV took 33.0s. Estimated remaining: 2h 31m 19s. Rate: 7.1 symbols/min [2025-10-08T20:01:52.825217] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-08T20:01:52.855286] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:52.923925] [DEBUG] [LOCAL ] MA: Loaded 52508 existing records from primary storage. [2025-10-08T20:01:52.925316] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T20:01:52.925486] [INFO ] [MAIN ] MA: Loaded 52508 existing records. [2025-10-08T20:01:53.114662] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:53.114865] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-08T20:01:53.114912] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-08T20:01:53.115129] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-08T20:01:53.115187] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-08T20:01:53.489566] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:53.617552] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-08T20:01:54.265287] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T20:01:54.332070] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:01:54.334044] [INFO ] [REMOTE ] LZM: Full fetch complete (18835 records). [2025-10-08T20:01:54.334122] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-08T20:01:54.422760] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-08T20:01:54.706163] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-08T20:01:54.706247] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-08T20:01:54.706713] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-08T20:01:54.706775] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-08T20:01:54.707336] [DEBUG] [LOCAL ] LZM: Trimmed 18835 records to 14323 (keeping 200 days of data) [2025-10-08T20:01:54.786018] [DEBUG] [LOCAL ] LZM: Primary data saved (14323 records). [2025-10-08T20:01:54.786151] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-08T20:01:54.786231] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZM took 23.1s. Estimated remaining: 2h 31m 6s. Rate: 7.1 symbols/min [2025-10-08T20:01:54.954321] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:01:54.994499] [DEBUG] [LOCAL ] MAA: Loaded 42654 existing records from primary storage. [2025-10-08T20:01:54.994865] [INFO ] [MAIN ] MAA: Loaded 42654 existing records. [2025-10-08T20:01:55.181931] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:01:55.182196] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-08T20:01:55.182304] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-08T20:01:55.182568] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-08T20:01:55.182628] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-08T20:01:55.226881] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-10-08T20:01:55.551536] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:01:56.017705] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-10-08T20:01:56.402023] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T20:01:56.817511] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-08T20:01:57.233472] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T20:01:57.296542] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T20:01:57.617564] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-08T20:01:58.417633] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-08T20:01:58.846055] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T20:01:59.217542] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-08T20:01:59.315872] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T20:01:59.416999] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T20:02:00.017618] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-08T20:02:00.662625] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T20:02:00.817602] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-08T20:02:01.449936] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:02:01.617551] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-08T20:02:02.092808] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T20:02:02.417593] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-08T20:02:03.181127] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T20:02:03.217605] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-08T20:02:03.554383] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T20:02:03.557155] [INFO ] [REMOTE ] LZB: Full fetch complete (50625 records). [2025-10-08T20:02:03.557278] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-08T20:02:03.949152] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-08T20:02:03.949231] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-08T20:02:03.950003] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-08T20:02:03.950065] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-08T20:02:03.951057] [DEBUG] [LOCAL ] LZB: Trimmed 50625 records to 35057 (keeping 200 days of data) [2025-10-08T20:02:04.018190] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-08T20:02:04.176667] [DEBUG] [LOCAL ] LZB: Primary data saved (35057 records). [2025-10-08T20:02:04.176906] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-08T20:02:04.178385] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZB took 33.2s. Estimated remaining: 2h 30m 58s. Rate: 7.1 symbols/min [2025-10-08T20:02:04.347116] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:04.347287] [DEBUG] [LOCAL ] MAC: No existing data file found in primary storage. [2025-10-08T20:02:04.347327] [WARN ] [MAIN ] MAC: No existing data found, performing full refresh instead. [2025-10-08T20:02:04.347481] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-08T20:02:04.347544] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-08T20:02:04.347588] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-08T20:02:04.347621] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-08T20:02:04.705072] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:04.817540] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-10-08T20:02:04.938824] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T20:02:05.617564] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-08T20:02:05.722706] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T20:02:06.210153] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T20:02:06.417568] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-08T20:02:07.217544] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-08T20:02:07.269639] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:02:08.017577] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-08T20:02:08.160790] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T20:02:08.817594] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-08T20:02:09.130246] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T20:02:09.402261] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T20:02:09.617572] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-08T20:02:10.417564] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-08T20:02:10.827054] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T20:02:11.217567] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-08T20:02:11.414593] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T20:02:11.522304] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:02:12.017564] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-08T20:02:12.817517] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-08T20:02:12.856289] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T20:02:13.617511] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-08T20:02:13.869406] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T20:02:14.350346] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T20:02:14.417630] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-08T20:02:15.217509] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-08T20:02:15.358930] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T20:02:15.965802] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T20:02:16.017552] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-08T20:02:16.516039] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T20:02:16.817592] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-08T20:02:17.562756] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T20:02:17.617549] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-08T20:02:18.308879] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T20:02:18.417543] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-08T20:02:19.217550] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-08T20:02:19.732917] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T20:02:19.805361] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T20:02:20.017549] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-08T20:02:20.817579] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-08T20:02:20.872055] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T20:02:21.617609] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-08T20:02:21.806911] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:02:22.417542] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-08T20:02:22.592012] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T20:02:22.596116] [INFO ] [REMOTE ] M: Full fetch complete (77516 records). [2025-10-08T20:02:22.596258] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-08T20:02:23.000028] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-08T20:02:23.000162] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-08T20:02:23.001379] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-08T20:02:23.001504] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-08T20:02:23.004056] [DEBUG] [LOCAL ] M: Trimmed 77516 records to 53540 (keeping 200 days of data) [2025-10-08T20:02:23.137404] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T20:02:23.238489] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-08T20:02:23.393756] [DEBUG] [LOCAL ] M: Primary data saved (53540 records). [2025-10-08T20:02:23.393917] [INFO ] [MAIN ] M: Full history saved. [2025-10-08T20:02:23.394028] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. M took 49.8s. Estimated remaining: 2h 30m 59s. Rate: 7.1 symbols/min [2025-10-08T20:02:23.567726] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:23.613725] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T20:02:23.636036] [DEBUG] [LOCAL ] MAGN: Loaded 35542 existing records from primary storage. [2025-10-08T20:02:23.636355] [INFO ] [MAIN ] MAGN: Loaded 35542 existing records. [2025-10-08T20:02:23.815847] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:02:23.816099] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-08T20:02:23.816146] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-08T20:02:23.816422] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-08T20:02:23.816479] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-08T20:02:24.022777] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-08T20:02:24.167006] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:24.817540] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-10-08T20:02:25.289883] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T20:02:25.374989] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T20:02:25.617572] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-08T20:02:25.919486] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T20:02:26.417609] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-08T20:02:26.897038] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T20:02:27.217567] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-08T20:02:28.017557] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-08T20:02:28.456238] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-08T20:02:28.461283] [INFO ] [REMOTE ] MA: Full fetch complete (76236 records). [2025-10-08T20:02:28.461463] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-08T20:02:28.784273] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T20:02:28.830057] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-08T20:02:28.890151] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-08T20:02:28.890227] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-08T20:02:28.891213] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-08T20:02:28.891278] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-08T20:02:28.892840] [DEBUG] [LOCAL ] MA: Trimmed 76236 records to 52489 (keeping 200 days of data) [2025-10-08T20:02:29.232780] [DEBUG] [LOCAL ] MA: Primary data saved (52489 records). [2025-10-08T20:02:29.232977] [INFO ] [MAIN ] MA: Full history saved. [2025-10-08T20:02:29.233929] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MA took 36.6s. Estimated remaining: 2h 30m 48s. Rate: 7.1 symbols/min [2025-10-08T20:02:29.414957] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T20:02:29.445498] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:29.493355] [DEBUG] [LOCAL ] MAIN: Loaded 41241 existing records from primary storage. [2025-10-08T20:02:29.493744] [INFO ] [MAIN ] MAIN: Loaded 41241 existing records. [2025-10-08T20:02:29.630692] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-08T20:02:29.671771] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:02:29.672005] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-08T20:02:29.672054] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-08T20:02:29.672374] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-08T20:02:29.672432] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-08T20:02:30.040097] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:30.313832] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T20:02:30.417638] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-10-08T20:02:31.140787] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T20:02:31.217587] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-08T20:02:31.836821] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T20:02:32.017590] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-08T20:02:32.772837] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-08T20:02:32.776531] [INFO ] [REMOTE ] MAC: Full fetch complete (71418 records). [2025-10-08T20:02:32.776704] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-08T20:02:32.822637] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-08T20:02:33.192004] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-08T20:02:33.192084] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-08T20:02:33.193115] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-08T20:02:33.193180] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-08T20:02:33.194565] [DEBUG] [LOCAL ] MAC: Trimmed 71418 records to 49609 (keeping 200 days of data) [2025-10-08T20:02:33.509012] [DEBUG] [LOCAL ] MAC: Primary data saved (49609 records). [2025-10-08T20:02:33.509193] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-08T20:02:33.509284] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. MAC took 29.3s. Estimated remaining: 2h 30m 36s. Rate: 7.1 symbols/min [2025-10-08T20:02:33.618694] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-08T20:02:33.695687] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:33.720988] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T20:02:33.769822] [DEBUG] [LOCAL ] MAN: Loaded 43640 existing records from primary storage. [2025-10-08T20:02:33.770164] [INFO ] [MAIN ] MAN: Loaded 43640 existing records. [2025-10-08T20:02:33.944626] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:02:33.944851] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-08T20:02:33.944896] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-08T20:02:33.945103] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-08T20:02:33.945159] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-08T20:02:34.133429] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T20:02:34.219055] [INFO ] [REMOTE ] MAA: Full fetch complete (61272 records). [2025-10-08T20:02:34.240888] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-08T20:02:34.418304] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-08T20:02:34.438254] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:34.752987] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-08T20:02:34.753603] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-08T20:02:34.754259] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T20:02:34.761768] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-08T20:02:34.762238] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-08T20:02:34.763566] [DEBUG] [LOCAL ] MAA: Trimmed 61272 records to 42651 (keeping 200 days of data) [2025-10-08T20:02:35.061842] [DEBUG] [LOCAL ] MAA: Primary data saved (42651 records). [2025-10-08T20:02:35.061959] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-08T20:02:35.062082] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAA took 40.3s. Estimated remaining: 2h 30m 22s. Rate: 7.1 symbols/min [2025-10-08T20:02:35.237263] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:35.234486] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-10-08T20:02:35.266809] [DEBUG] [LOCAL ] MANU: Loaded 26728 existing records from primary storage. [2025-10-08T20:02:35.267096] [INFO ] [MAIN ] MANU: Loaded 26728 existing records. [2025-10-08T20:02:35.447226] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:02:35.447448] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-08T20:02:35.447532] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-08T20:02:35.447805] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-08T20:02:35.447863] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-08T20:02:35.804510] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:36.017616] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-08T20:02:36.159360] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T20:02:36.477631] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T20:02:36.817561] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-08T20:02:37.384690] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T20:02:37.617565] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-10-08T20:02:38.318338] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T20:02:38.367136] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T20:02:38.417569] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-08T20:02:39.217592] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-08T20:02:40.017582] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-08T20:02:40.138520] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T20:02:40.680432] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T20:02:40.825173] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-08T20:02:40.830090] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T20:02:41.617599] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-08T20:02:42.211415] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T20:02:42.417596] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-08T20:02:42.805592] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T20:02:43.217559] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-08T20:02:43.953638] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T20:02:44.017625] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-08T20:02:44.676671] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T20:02:44.817597] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-08T20:02:45.434093] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T20:02:45.617568] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-08T20:02:45.704755] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T20:02:46.417556] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-08T20:02:47.157252] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T20:02:47.217583] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-08T20:02:47.354595] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T20:02:48.017576] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-08T20:02:48.545708] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T20:02:48.817622] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-08T20:02:48.993815] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T20:02:49.617534] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-08T20:02:50.196483] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T20:02:50.417625] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-08T20:02:50.729092] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:02:51.217575] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-08T20:02:51.569792] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T20:02:52.017592] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-08T20:02:52.353870] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T20:02:52.817566] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-08T20:02:53.396331] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T20:02:53.617541] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-08T20:02:54.295924] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T20:02:54.300367] [INFO ] [REMOTE ] MAGN: Full fetch complete (51545 records). [2025-10-08T20:02:54.300532] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-08T20:02:54.422678] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-08T20:02:54.835424] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-08T20:02:54.835565] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-08T20:02:54.836580] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-08T20:02:54.836676] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-08T20:02:54.838218] [DEBUG] [LOCAL ] MAGN: Trimmed 51545 records to 35662 (keeping 200 days of data) [2025-10-08T20:02:55.103963] [DEBUG] [LOCAL ] MAGN: Primary data saved (35662 records). [2025-10-08T20:02:55.104131] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-08T20:02:55.104271] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAGN took 31.7s. Estimated remaining: 2h 30m 23s. Rate: 7.1 symbols/min [2025-10-08T20:02:55.218765] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-08T20:02:55.300146] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:02:55.330052] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T20:02:55.383271] [DEBUG] [LOCAL ] MAS: Loaded 52291 existing records from primary storage. [2025-10-08T20:02:55.383667] [INFO ] [MAIN ] MAS: Loaded 52291 existing records. [2025-10-08T20:02:55.608373] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:02:55.608662] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-08T20:02:55.608747] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-08T20:02:55.608977] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-08T20:02:55.609034] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-08T20:02:55.978961] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:02:56.007682] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T20:02:56.018074] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-08T20:02:56.308545] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T20:02:56.817597] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-08T20:02:57.617553] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-10-08T20:02:57.760680] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T20:02:57.806703] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T20:02:58.417602] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-08T20:02:58.954618] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T20:02:59.217592] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-08T20:02:59.533693] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T20:03:00.017578] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-08T20:03:00.264843] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T20:03:00.817575] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-08T20:03:01.617571] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-08T20:03:01.686171] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:03:02.189843] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T20:03:02.417626] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-08T20:03:03.009605] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T20:03:03.217635] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-08T20:03:03.574372] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T20:03:03.577296] [INFO ] [REMOTE ] MANU: Full fetch complete (38288 records). [2025-10-08T20:03:03.577507] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-08T20:03:03.980915] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-08T20:03:03.981013] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-08T20:03:03.981711] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-08T20:03:03.981772] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-08T20:03:03.982602] [DEBUG] [LOCAL ] MANU: Trimmed 38288 records to 26742 (keeping 200 days of data) [2025-10-08T20:03:04.032305] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-08T20:03:04.151268] [DEBUG] [LOCAL ] MANU: Primary data saved (26742 records). [2025-10-08T20:03:04.151405] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-08T20:03:04.151517] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MANU took 29.1s. Estimated remaining: 2h 30m 15s. Rate: 7.1 symbols/min [2025-10-08T20:03:04.321178] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:04.356991] [DEBUG] [LOCAL ] MATV: Loaded 36117 existing records from primary storage. [2025-10-08T20:03:04.357307] [INFO ] [MAIN ] MATV: Loaded 36117 existing records. [2025-10-08T20:03:04.542086] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:04.542360] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-08T20:03:04.542416] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-08T20:03:04.542739] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-08T20:03:04.542809] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-08T20:03:04.823405] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-08T20:03:04.908215] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:04.948158] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T20:03:04.952056] [INFO ] [REMOTE ] MAIN: Full fetch complete (60016 records). [2025-10-08T20:03:04.952147] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-08T20:03:05.347939] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-08T20:03:05.348049] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-08T20:03:05.349004] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-08T20:03:05.349073] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-08T20:03:05.350480] [DEBUG] [LOCAL ] MAIN: Trimmed 60016 records to 41339 (keeping 200 days of data) [2025-10-08T20:03:05.626505] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-10-08T20:03:05.632532] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T20:03:05.669624] [DEBUG] [LOCAL ] MAIN: Primary data saved (41339 records). [2025-10-08T20:03:05.669807] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-08T20:03:05.669935] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MAIN took 36.4s. Estimated remaining: 2h 30m 1s. Rate: 7.1 symbols/min [2025-10-08T20:03:05.846446] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:05.881022] [DEBUG] [LOCAL ] MATX: Loaded 31417 existing records from primary storage. [2025-10-08T20:03:05.881351] [INFO ] [MAIN ] MATX: Loaded 31417 existing records. [2025-10-08T20:03:06.068046] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:06.068376] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-08T20:03:06.068492] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-08T20:03:06.068796] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-08T20:03:06.068855] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-08T20:03:06.424573] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-08T20:03:06.456266] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:06.497610] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T20:03:06.968090] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T20:03:07.217571] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-08T20:03:08.017527] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-10-08T20:03:08.108042] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T20:03:08.548560] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T20:03:08.782220] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T20:03:08.817563] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-08T20:03:09.617576] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-08T20:03:09.983186] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T20:03:10.417618] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-08T20:03:10.858533] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T20:03:11.217577] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-08T20:03:11.728393] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T20:03:12.017555] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-08T20:03:12.817511] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-08T20:03:12.875913] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T20:03:13.161235] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T20:03:13.164602] [INFO ] [REMOTE ] MAN: Full fetch complete (62184 records). [2025-10-08T20:03:13.164770] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-08T20:03:13.560499] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-08T20:03:13.560707] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-08T20:03:13.561748] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-08T20:03:13.561815] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-08T20:03:13.563189] [DEBUG] [LOCAL ] MAN: Trimmed 62184 records to 43573 (keeping 200 days of data) [2025-10-08T20:03:13.620120] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-08T20:03:13.855204] [DEBUG] [LOCAL ] MAN: Primary data saved (43573 records). [2025-10-08T20:03:13.855482] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-08T20:03:13.856378] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAN took 40.3s. Estimated remaining: 2h 29m 53s. Rate: 7.1 symbols/min [2025-10-08T20:03:14.038419] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:14.074466] [DEBUG] [LOCAL ] MAX: Loaded 30870 existing records from primary storage. [2025-10-08T20:03:14.074793] [INFO ] [MAIN ] MAX: Loaded 30870 existing records. [2025-10-08T20:03:14.260918] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:14.261229] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-08T20:03:14.261304] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-08T20:03:14.279737] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-08T20:03:14.282603] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-08T20:03:14.290522] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:03:14.422339] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-08T20:03:14.704587] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:15.217507] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-08T20:03:15.398552] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T20:03:15.434154] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T20:03:16.017578] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-10-08T20:03:16.629765] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T20:03:16.817524] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-08T20:03:17.431915] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T20:03:17.617556] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-08T20:03:18.417575] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-08T20:03:18.501790] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-08T20:03:18.583226] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T20:03:19.217597] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-08T20:03:19.530206] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T20:03:20.017538] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-08T20:03:20.055823] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T20:03:20.817549] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-08T20:03:21.213538] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T20:03:21.617558] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-08T20:03:22.297399] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T20:03:22.417546] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-08T20:03:23.085058] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T20:03:23.217591] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-08T20:03:23.780386] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T20:03:24.017567] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-08T20:03:24.613971] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T20:03:24.817551] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-08T20:03:25.617534] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-08T20:03:25.866698] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T20:03:26.002126] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T20:03:26.417577] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-08T20:03:26.787850] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T20:03:27.217622] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-08T20:03:28.017595] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-08T20:03:28.204871] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:03:28.235274] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T20:03:28.817589] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-08T20:03:29.617596] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-08T20:03:29.738622] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T20:03:29.953343] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T20:03:30.417624] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-08T20:03:30.753136] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T20:03:31.217586] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-08T20:03:31.474278] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T20:03:32.017593] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-08T20:03:32.454454] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:03:32.817596] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-08T20:03:33.241854] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T20:03:33.617594] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-08T20:03:33.741317] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T20:03:34.417606] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-08T20:03:34.753057] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T20:03:35.217511] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-08T20:03:35.544153] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T20:03:36.017712] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-08T20:03:36.614210] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T20:03:36.817583] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-08T20:03:36.964418] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T20:03:36.968165] [INFO ] [REMOTE ] MATX: Full fetch complete (42827 records). [2025-10-08T20:03:36.968335] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-08T20:03:37.392169] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-08T20:03:37.392251] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-08T20:03:37.392946] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-08T20:03:37.393008] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-08T20:03:37.394913] [DEBUG] [LOCAL ] MATX: Trimmed 42827 records to 31313 (keeping 200 days of data) [2025-10-08T20:03:37.601146] [DEBUG] [LOCAL ] MATX: Primary data saved (31313 records). [2025-10-08T20:03:37.601304] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-08T20:03:37.601397] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MATX took 31.9s. Estimated remaining: 2h 29m 57s. Rate: 7.1 symbols/min [2025-10-08T20:03:37.622775] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-08T20:03:37.784729] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:37.826666] [DEBUG] [LOCAL ] MBC: Loaded 43468 existing records from primary storage. [2025-10-08T20:03:37.827021] [INFO ] [MAIN ] MBC: Loaded 43468 existing records. [2025-10-08T20:03:38.022475] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:38.022692] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-08T20:03:38.022749] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-08T20:03:38.023021] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-08T20:03:38.023077] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-08T20:03:38.359902] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T20:03:38.404510] [INFO ] [REMOTE ] MAX: Full fetch complete (45427 records). [2025-10-08T20:03:38.428142] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:38.421825] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-08T20:03:38.428227] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-08T20:03:38.776618] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T20:03:38.815132] [INFO ] [REMOTE ] MATV: Full fetch complete (52219 records). [2025-10-08T20:03:38.843600] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-08T20:03:38.920463] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-08T20:03:38.962399] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-08T20:03:38.974994] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-08T20:03:38.985786] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-08T20:03:39.096466] [DEBUG] [LOCAL ] MAX: Trimmed 45427 records to 30989 (keeping 200 days of data) [2025-10-08T20:03:39.221618] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-10-08T20:03:39.598223] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-08T20:03:39.599547] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-08T20:03:39.601283] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-08T20:03:39.601842] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-08T20:03:39.670829] [DEBUG] [LOCAL ] MATV: Trimmed 52219 records to 35918 (keeping 200 days of data) [2025-10-08T20:03:39.821671] [DEBUG] [LOCAL ] MAX: Primary data saved (30989 records). [2025-10-08T20:03:39.823115] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-08T20:03:39.824429] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MAX took 26.0s. Estimated remaining: 2h 29m 43s. Rate: 7.1 symbols/min [2025-10-08T20:03:40.167054] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:40.233372] [DEBUG] [LOCAL ] MBI: Loaded 24208 existing records from primary storage. [2025-10-08T20:03:40.234922] [INFO ] [MAIN ] MBI: Loaded 24208 existing records. [2025-10-08T20:03:40.482131] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T20:03:40.521882] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:40.533466] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-08T20:03:40.535370] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-08T20:03:40.537051] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-08T20:03:40.537811] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-08T20:03:40.538457] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-08T20:03:40.562432] [DEBUG] [LOCAL ] MATV: Primary data saved (35918 records). [2025-10-08T20:03:40.591919] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-08T20:03:40.631515] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 36.5s. Estimated remaining: 2h 29m 29s. Rate: 7.1 symbols/min [2025-10-08T20:03:40.976492] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:41.153808] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:41.163209] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-10-08T20:03:41.166007] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T20:03:41.203531] [DEBUG] [LOCAL ] MC: Loaded 43973 existing records from primary storage. [2025-10-08T20:03:41.203900] [INFO ] [MAIN ] MC: Loaded 43973 existing records. [2025-10-08T20:03:41.377303] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:41.377512] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-08T20:03:41.377559] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-08T20:03:41.377799] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-08T20:03:41.377857] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-08T20:03:41.622697] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-08T20:03:41.726678] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:42.109281] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T20:03:42.113237] [INFO ] [REMOTE ] MAS: Full fetch complete (74901 records). [2025-10-08T20:03:42.113371] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-08T20:03:42.430365] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-10-08T20:03:42.527056] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:03:42.526416] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-08T20:03:42.533363] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-08T20:03:42.534948] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-08T20:03:42.535018] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-08T20:03:42.536582] [DEBUG] [LOCAL ] MAS: Trimmed 74901 records to 52277 (keeping 200 days of data) [2025-10-08T20:03:42.917505] [DEBUG] [LOCAL ] MAS: Primary data saved (52277 records). [2025-10-08T20:03:42.917704] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-08T20:03:42.917836] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MAS took 47.8s. Estimated remaining: 2h 29m 15s. Rate: 7.1 symbols/min [2025-10-08T20:03:43.112728] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:03:43.125470] [DEBUG] [LOCAL ] MCB: Loaded 11266 existing records from primary storage. [2025-10-08T20:03:43.125769] [INFO ] [MAIN ] MCB: Loaded 11266 existing records. [2025-10-08T20:03:43.221663] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-08T20:03:43.304526] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:03:43.304903] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-08T20:03:43.304976] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-08T20:03:43.305219] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-08T20:03:43.305316] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-08T20:03:43.589712] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T20:03:43.700330] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:03:44.017506] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-10-08T20:03:44.060724] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T20:03:44.390597] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T20:03:44.809201] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T20:03:44.817487] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-08T20:03:45.584962] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T20:03:45.617537] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-08T20:03:46.170889] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T20:03:46.417559] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-08T20:03:47.217582] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-08T20:03:47.618674] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T20:03:48.017602] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-08T20:03:48.330870] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:03:48.817560] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-08T20:03:49.178182] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T20:03:49.617579] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-08T20:03:50.321470] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T20:03:50.417562] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-08T20:03:51.107417] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T20:03:51.217553] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-08T20:03:51.983219] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T20:03:52.017598] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-08T20:03:52.376374] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T20:03:52.658180] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T20:03:52.817610] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-08T20:03:53.617565] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-08T20:03:54.417524] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-08T20:03:54.489700] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T20:03:54.878705] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T20:03:55.217722] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-08T20:03:56.018753] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-08T20:03:56.025624] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T20:03:56.817542] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-08T20:03:56.993186] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T20:03:57.363378] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T20:03:57.446291] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-08T20:03:57.617564] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-08T20:03:58.417585] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-08T20:03:58.789002] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T20:03:59.217559] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-08T20:03:59.910167] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:04:00.017585] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-08T20:04:00.430427] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T20:04:00.817571] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-08T20:04:01.443343] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T20:04:01.617607] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-08T20:04:02.191345] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T20:04:02.417589] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-08T20:04:03.180443] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T20:04:03.217497] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-08T20:04:03.472000] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T20:04:04.017562] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-08T20:04:04.717063] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T20:04:04.817556] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-08T20:04:04.911385] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T20:04:05.617548] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-08T20:04:06.016316] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T20:04:06.019726] [INFO ] [REMOTE ] MC: Full fetch complete (62619 records). [2025-10-08T20:04:06.019887] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-08T20:04:06.418838] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-08T20:04:06.463025] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-08T20:04:06.463112] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-08T20:04:06.464140] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-08T20:04:06.464206] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-08T20:04:06.465814] [DEBUG] [LOCAL ] MC: Trimmed 62619 records to 43924 (keeping 200 days of data) [2025-10-08T20:04:06.755488] [DEBUG] [LOCAL ] MC: Primary data saved (43924 records). [2025-10-08T20:04:06.755623] [INFO ] [MAIN ] MC: Full history saved. [2025-10-08T20:04:06.755755] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MC took 26.1s. Estimated remaining: 2h 29m 19s. Rate: 7.1 symbols/min [2025-10-08T20:04:06.980092] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:06.980591] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-08T20:04:06.980842] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-08T20:04:06.981073] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-08T20:04:06.981175] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-08T20:04:06.981437] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-08T20:04:06.981719] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-08T20:04:07.240784] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-08T20:04:07.241292] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T20:04:07.403990] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:04:07.480287] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:08.017572] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-10-08T20:04:08.236548] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:04:08.817561] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-08T20:04:09.617517] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-08T20:04:10.174961] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T20:04:10.220402] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T20:04:10.417561] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-08T20:04:10.633883] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T20:04:11.217560] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-08T20:04:11.344486] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:04:12.017549] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-08T20:04:12.050614] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T20:04:12.768222] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T20:04:12.817557] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-08T20:04:13.623133] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-08T20:04:13.624270] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T20:04:14.417553] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-08T20:04:15.125482] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T20:04:15.129728] [INFO ] [REMOTE ] MBC: Full fetch complete (63156 records). [2025-10-08T20:04:15.129893] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-08T20:04:15.222763] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-08T20:04:15.542587] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-08T20:04:15.542693] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-08T20:04:15.543547] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-08T20:04:15.543590] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-08T20:04:15.544966] [DEBUG] [LOCAL ] MBC: Trimmed 63156 records to 43559 (keeping 200 days of data) [2025-10-08T20:04:15.816313] [DEBUG] [LOCAL ] MBC: Primary data saved (43559 records). [2025-10-08T20:04:15.816481] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-08T20:04:15.816585] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 38.2s. Estimated remaining: 2h 29m 11s. Rate: 7.1 symbols/min [2025-10-08T20:04:15.988737] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:15.998406] [DEBUG] [LOCAL ] MCI: Loaded 6479 existing records from primary storage. [2025-10-08T20:04:15.998683] [INFO ] [MAIN ] MCI: Loaded 6479 existing records. [2025-10-08T20:04:16.022735] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-08T20:04:16.198303] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T20:04:16.202981] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:16.205509] [INFO ] [REMOTE ] MCB: Full fetch complete (16371 records). [2025-10-08T20:04:16.205821] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-08T20:04:16.205726] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-08T20:04:16.205974] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-08T20:04:16.296280] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-08T20:04:16.313891] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-08T20:04:16.808615] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-08T20:04:16.824785] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-08T20:04:16.846476] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-08T20:04:16.859119] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-08T20:04:16.920873] [DEBUG] [LOCAL ] MCB: Trimmed 16371 records to 11261 (keeping 200 days of data) [2025-10-08T20:04:17.037569] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T20:04:17.085089] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:17.087440] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-10-08T20:04:17.086687] [INFO ] [REMOTE ] MBI: Full fetch complete (36640 records). [2025-10-08T20:04:17.089336] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-08T20:04:17.219112] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.80 seconds). [2025-10-08T20:04:17.536065] [DEBUG] [LOCAL ] MCB: Primary data saved (11261 records). [2025-10-08T20:04:17.546621] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-08T20:04:17.572429] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 34.7s. Estimated remaining: 2h 28m 57s. Rate: 7.1 symbols/min [2025-10-08T20:04:17.628964] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-08T20:04:17.659353] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-08T20:04:17.688516] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-08T20:04:17.705892] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-08T20:04:17.748999] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-08T20:04:17.772405] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T20:04:17.826670] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:17.827430] [DEBUG] [LOCAL ] MBI: Trimmed 36640 records to 24241 (keeping 200 days of data) [2025-10-08T20:04:17.960762] [DEBUG] [LOCAL ] MCK: Loaded 38963 existing records from primary storage. [2025-10-08T20:04:17.961959] [INFO ] [MAIN ] MCK: Loaded 38963 existing records. [2025-10-08T20:04:18.162235] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:18.163400] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-08T20:04:18.163830] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-08T20:04:18.164482] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-08T20:04:18.164864] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-08T20:04:18.425841] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-08T20:04:18.540530] [DEBUG] [LOCAL ] MBI: Primary data saved (24241 records). [2025-10-08T20:04:18.558314] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-08T20:04:18.579669] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MBI took 38.8s. Estimated remaining: 2h 28m 43s. Rate: 7.1 symbols/min [2025-10-08T20:04:18.579544] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:18.747523] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:18.758104] [DEBUG] [LOCAL ] MCN: Loaded 8124 existing records from primary storage. [2025-10-08T20:04:18.758337] [INFO ] [MAIN ] MCN: Loaded 8124 existing records. [2025-10-08T20:04:18.941318] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:18.941700] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-08T20:04:18.941773] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-08T20:04:18.941985] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-08T20:04:18.942043] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-08T20:04:19.066333] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:04:19.225537] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-10-08T20:04:19.315089] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:19.517149] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T20:04:20.017567] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-08T20:04:20.438146] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:04:20.817549] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-08T20:04:21.617502] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-08T20:04:21.648580] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T20:04:21.875898] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T20:04:22.417694] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-08T20:04:23.166935] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T20:04:23.195249] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T20:04:23.217493] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-08T20:04:24.017610] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-10-08T20:04:24.511753] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T20:04:24.537612] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T20:04:24.817593] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-08T20:04:25.477373] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T20:04:25.617565] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-08T20:04:26.194315] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T20:04:26.417567] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-08T20:04:27.217568] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-08T20:04:27.798953] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T20:04:27.975102] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T20:04:28.017508] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-08T20:04:28.817597] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-08T20:04:29.584239] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:04:29.617506] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-08T20:04:29.806558] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T20:04:30.153287] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T20:04:30.417584] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-08T20:04:30.991345] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T20:04:31.217593] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-08T20:04:32.017689] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-08T20:04:32.795333] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T20:04:32.817509] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-08T20:04:33.617578] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-08T20:04:33.835772] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T20:04:34.145148] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T20:04:34.168426] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T20:04:34.417566] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-08T20:04:34.799048] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T20:04:35.217609] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-08T20:04:35.795384] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T20:04:36.017524] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-08T20:04:36.605586] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T20:04:36.817550] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-08T20:04:37.425208] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T20:04:37.617563] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-08T20:04:38.104289] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T20:04:38.417515] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-08T20:04:39.194298] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T20:04:39.195377] [INFO ] [REMOTE ] MCI: Full fetch complete (10014 records). [2025-10-08T20:04:39.195470] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-08T20:04:39.225226] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-08T20:04:39.563576] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-08T20:04:39.563688] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-08T20:04:39.564023] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-08T20:04:39.564085] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-08T20:04:39.564591] [DEBUG] [LOCAL ] MCI: Trimmed 10014 records to 6483 (keeping 200 days of data) [2025-10-08T20:04:39.607625] [DEBUG] [LOCAL ] MCI: Primary data saved (6483 records). [2025-10-08T20:04:39.607799] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-08T20:04:39.607900] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MCI took 23.8s. Estimated remaining: 2h 28m 45s. Rate: 7.1 symbols/min [2025-10-08T20:04:39.786246] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:39.825232] [DEBUG] [LOCAL ] MCO: Loaded 39193 existing records from primary storage. [2025-10-08T20:04:39.825543] [INFO ] [MAIN ] MCO: Loaded 39193 existing records. [2025-10-08T20:04:40.008272] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:40.008462] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-08T20:04:40.008514] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-08T20:04:40.008761] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-08T20:04:40.008826] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-08T20:04:40.022614] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-08T20:04:40.121961] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T20:04:40.382926] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:40.817545] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-08T20:04:41.554805] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T20:04:41.617507] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-08T20:04:42.417578] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-10-08T20:04:42.718980] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-08T20:04:42.997556] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T20:04:43.217563] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-08T20:04:43.511123] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T20:04:44.017562] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-08T20:04:44.742089] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T20:04:44.817555] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-08T20:04:45.373690] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T20:04:45.493639] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T20:04:45.617567] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-08T20:04:46.417580] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-08T20:04:47.222707] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-08T20:04:47.234732] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T20:04:47.776066] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T20:04:47.779123] [INFO ] [REMOTE ] MCK: Full fetch complete (57007 records). [2025-10-08T20:04:47.779271] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-08T20:04:48.021061] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-08T20:04:48.108389] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:04:48.204907] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-08T20:04:48.205002] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-08T20:04:48.205923] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-08T20:04:48.205993] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-08T20:04:48.209571] [DEBUG] [LOCAL ] MCK: Trimmed 57007 records to 38873 (keeping 200 days of data) [2025-10-08T20:04:48.467802] [DEBUG] [LOCAL ] MCK: Primary data saved (38873 records). [2025-10-08T20:04:48.467973] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-08T20:04:48.468064] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCK took 30.9s. Estimated remaining: 2h 28m 37s. Rate: 7.1 symbols/min [2025-10-08T20:04:48.646486] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:48.658793] [DEBUG] [LOCAL ] MCR: Loaded 8883 existing records from primary storage. [2025-10-08T20:04:48.659095] [INFO ] [MAIN ] MCR: Loaded 8883 existing records. [2025-10-08T20:04:48.833127] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-08T20:04:48.853724] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:48.854168] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-08T20:04:48.855451] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-08T20:04:48.855780] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-08T20:04:48.855841] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-08T20:04:49.225428] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:49.597276] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:04:49.598474] [INFO ] [REMOTE ] MCN: Full fetch complete (11714 records). [2025-10-08T20:04:49.598548] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-08T20:04:49.626567] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-10-08T20:04:49.996431] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-08T20:04:49.996672] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-08T20:04:49.997015] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-08T20:04:49.997150] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-08T20:04:50.025509] [DEBUG] [LOCAL ] MCN: Trimmed 11714 records to 8177 (keeping 200 days of data) [2025-10-08T20:04:50.047666] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-08T20:04:50.090835] [DEBUG] [LOCAL ] MCN: Primary data saved (8177 records). [2025-10-08T20:04:50.091019] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-08T20:04:50.091117] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCN took 31.5s. Estimated remaining: 2h 28m 23s. Rate: 7.1 symbols/min [2025-10-08T20:04:50.270001] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:04:50.291832] [DEBUG] [LOCAL ] MCS: Loaded 20960 existing records from primary storage. [2025-10-08T20:04:50.292122] [INFO ] [MAIN ] MCS: Loaded 20960 existing records. [2025-10-08T20:04:50.420851] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-08T20:04:50.478715] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:04:50.479293] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-08T20:04:50.479394] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-08T20:04:50.488739] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-08T20:04:50.489978] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T20:04:50.493252] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-08T20:04:50.855470] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:04:51.217545] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-10-08T20:04:52.017547] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-08T20:04:52.277911] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T20:04:52.374709] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T20:04:52.551622] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-08T20:04:52.817586] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-08T20:04:53.617577] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-08T20:04:54.417562] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-08T20:04:54.532396] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T20:04:54.906861] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T20:04:55.217611] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-08T20:04:55.507919] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T20:04:55.989359] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:04:56.017506] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-08T20:04:56.817574] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-08T20:04:57.124942] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T20:04:57.617562] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-08T20:04:57.884666] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T20:04:58.417576] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-08T20:04:59.209105] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T20:04:59.217494] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-08T20:04:59.536433] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T20:05:00.016838] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T20:05:00.023528] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-08T20:05:00.817546] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-08T20:05:00.978522] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T20:05:01.617563] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-08T20:05:02.387412] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T20:05:02.416885] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T20:05:02.424844] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-08T20:05:03.139106] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T20:05:03.217548] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-08T20:05:04.017555] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-08T20:05:04.055572] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T20:05:04.817563] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-08T20:05:05.336708] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T20:05:05.535516] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T20:05:05.617557] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-08T20:05:06.417540] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-08T20:05:07.157401] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T20:05:07.217587] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-08T20:05:08.017603] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-08T20:05:08.311131] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T20:05:08.508168] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T20:05:08.512024] [INFO ] [REMOTE ] MCO: Full fetch complete (57241 records). [2025-10-08T20:05:08.512147] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-08T20:05:08.637771] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:05:08.822667] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-08T20:05:08.950794] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-08T20:05:08.950914] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-08T20:05:08.951939] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-08T20:05:08.952021] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-08T20:05:08.953432] [DEBUG] [LOCAL ] MCO: Trimmed 57241 records to 39229 (keeping 200 days of data) [2025-10-08T20:05:09.217816] [DEBUG] [LOCAL ] MCO: Primary data saved (39229 records). [2025-10-08T20:05:09.217988] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-08T20:05:09.218098] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCO took 29.6s. Estimated remaining: 2h 28m 23s. Rate: 7.1 symbols/min [2025-10-08T20:05:09.446905] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:09.476437] [DEBUG] [LOCAL ] MCY: Loaded 24059 existing records from primary storage. [2025-10-08T20:05:09.476798] [INFO ] [MAIN ] MCY: Loaded 24059 existing records. [2025-10-08T20:05:09.627807] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-08T20:05:09.667026] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:09.667325] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-08T20:05:09.667388] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-08T20:05:09.667612] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-08T20:05:09.667704] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-08T20:05:10.034930] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:10.417592] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-10-08T20:05:10.680268] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T20:05:10.724845] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T20:05:11.217556] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-08T20:05:11.296506] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T20:05:11.605598] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T20:05:11.609587] [INFO ] [REMOTE ] MCD: Full fetch complete (77030 records). [2025-10-08T20:05:11.609746] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-08T20:05:11.814065] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T20:05:11.815175] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:05:11.815255] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:05:11.815330] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-08T20:05:11.815589] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-08T20:05:11.815627] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-08T20:05:11.815754] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-08T20:05:11.815856] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCD took 1m 5s. Estimated remaining: 2h 28m 10s. Rate: 7.1 symbols/min [2025-10-08T20:05:12.017565] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-08T20:05:12.817588] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-08T20:05:13.026111] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T20:05:13.617612] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-08T20:05:14.181032] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T20:05:14.213873] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T20:05:14.417568] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-08T20:05:15.212080] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T20:05:15.217481] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-08T20:05:15.912459] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T20:05:15.914051] [INFO ] [REMOTE ] MCR: Full fetch complete (14066 records). [2025-10-08T20:05:15.914136] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-08T20:05:16.023676] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-08T20:05:16.306499] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-08T20:05:16.306600] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-08T20:05:16.307051] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-08T20:05:16.307117] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-08T20:05:16.307921] [DEBUG] [LOCAL ] MCR: Trimmed 14066 records to 8911 (keeping 200 days of data) [2025-10-08T20:05:16.362507] [DEBUG] [LOCAL ] MCR: Primary data saved (8911 records). [2025-10-08T20:05:16.362688] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-08T20:05:16.362814] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCR took 27.9s. Estimated remaining: 2h 27m 58s. Rate: 7.1 symbols/min [2025-10-08T20:05:16.817554] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-08T20:05:17.463584] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T20:05:17.617545] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-08T20:05:18.026239] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T20:05:18.417600] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-08T20:05:18.731321] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T20:05:19.217586] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-08T20:05:19.462162] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T20:05:20.017700] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-08T20:05:20.470006] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T20:05:20.817574] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-08T20:05:20.891550] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T20:05:20.893900] [INFO ] [REMOTE ] MCS: Full fetch complete (30556 records). [2025-10-08T20:05:20.894010] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-08T20:05:21.279854] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-08T20:05:21.279938] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-08T20:05:21.280590] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-08T20:05:21.280639] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-08T20:05:21.281498] [DEBUG] [LOCAL ] MCS: Trimmed 30556 records to 20952 (keeping 200 days of data) [2025-10-08T20:05:21.414180] [DEBUG] [LOCAL ] MCS: Primary data saved (20952 records). [2025-10-08T20:05:21.414312] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-08T20:05:21.414421] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCS took 31.3s. Estimated remaining: 2h 27m 47s. Rate: 7.1 symbols/min [2025-10-08T20:05:21.819991] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T20:05:21.826321] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-08T20:05:22.690024] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T20:05:22.695130] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-08T20:05:23.851890] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T20:05:23.859434] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-08T20:05:24.972560] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T20:05:24.981760] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-08T20:05:25.878534] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T20:05:25.885607] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-08T20:05:26.736574] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T20:05:26.739465] [INFO ] [REMOTE ] MCY: Full fetch complete (41231 records). [2025-10-08T20:05:26.739566] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-08T20:05:27.127428] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-08T20:05:27.127524] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-08T20:05:27.128213] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-08T20:05:27.128275] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-08T20:05:27.129341] [DEBUG] [LOCAL ] MCY: Trimmed 41231 records to 23972 (keeping 200 days of data) [2025-10-08T20:05:27.280308] [DEBUG] [LOCAL ] MCY: Primary data saved (23972 records). [2025-10-08T20:05:27.280457] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-08T20:05:27.280568] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCY took 18.1s. Estimated remaining: 2h 27m 37s. Rate: 7.1 symbols/min [2025-10-08T20:05:28.060746] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:28.127998] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:28.127104] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:28.131228] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:28.141879] [DEBUG] [LOCAL ] MDST: Loaded 5713 existing records from primary storage. [2025-10-08T20:05:28.142407] [INFO ] [MAIN ] MDST: Loaded 5713 existing records. [2025-10-08T20:05:28.372012] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:28.388183] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-08T20:05:28.389597] [DEBUG] [LOCAL ] MD: Loaded 38498 existing records from primary storage. [2025-10-08T20:05:28.388290] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-08T20:05:28.390470] [INFO ] [MAIN ] MD: Loaded 38498 existing records. [2025-10-08T20:05:28.390531] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-08T20:05:28.422405] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-08T20:05:28.623042] [DEBUG] [LOCAL ] MDU: Loaded 48006 existing records from primary storage. [2025-10-08T20:05:28.630460] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-08T20:05:28.644375] [INFO ] [MAIN ] MDU: Loaded 48006 existing records. [2025-10-08T20:05:28.644796] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-08T20:05:28.999286] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:29.156225] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-08T20:05:29.213686] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-08T20:05:29.341828] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-08T20:05:29.366935] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:29.401088] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-08T20:05:29.400949] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:29.406343] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-08T20:05:29.417046] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-08T20:05:29.513364] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:29.502141] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-08T20:05:29.505109] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-08T20:05:29.513716] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-10-08T20:05:29.518995] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-08T20:05:29.542748] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-08T20:05:29.639064] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-08T20:05:29.654707] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-08T20:05:30.399606] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T20:05:30.412215] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:30.455605] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-10-08T20:05:30.458054] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-08T20:05:30.584365] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:30.584839] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-10-08T20:05:30.684968] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:30.685481] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-10-08T20:05:31.188273] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T20:05:31.190523] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-08T20:05:31.555911] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T20:05:31.558225] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-08T20:05:32.057153] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T20:05:32.066538] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-08T20:05:32.133504] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T20:05:32.150103] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-08T20:05:32.152523] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T20:05:32.190355] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T20:05:32.817552] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-08T20:05:33.471144] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T20:05:33.617526] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-08T20:05:33.808601] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T20:05:34.417514] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-08T20:05:34.530333] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T20:05:34.955307] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T20:05:34.975118] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T20:05:35.217552] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-08T20:05:36.017567] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-08T20:05:36.591157] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:05:36.772763] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T20:05:36.817510] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-08T20:05:37.617556] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-08T20:05:38.396347] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T20:05:38.417500] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-08T20:05:38.624305] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T20:05:39.217555] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-08T20:05:39.880355] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T20:05:40.017622] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-08T20:05:40.817562] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-08T20:05:40.894558] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T20:05:41.384901] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T20:05:41.617534] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-08T20:05:41.668207] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T20:05:42.417553] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-08T20:05:43.217515] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-08T20:05:43.475947] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T20:05:43.569750] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T20:05:43.955422] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T20:05:44.017510] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-08T20:05:44.817561] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-08T20:05:45.441421] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T20:05:45.617577] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-08T20:05:46.417582] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-08T20:05:46.641519] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T20:05:46.807125] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-08T20:05:47.099020] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T20:05:47.217590] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-08T20:05:48.017585] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-08T20:05:48.817628] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-08T20:05:49.248786] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-08T20:05:49.339001] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T20:05:49.617627] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-08T20:05:50.197945] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T20:05:50.417621] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-08T20:05:51.063357] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T20:05:51.217539] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-08T20:05:51.761513] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T20:05:52.017578] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-08T20:05:52.121687] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T20:05:52.817551] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-08T20:05:53.623049] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-08T20:05:53.626089] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T20:05:54.120884] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T20:05:54.414801] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:05:54.415920] [INFO ] [REMOTE ] MDST: Full fetch complete (8544 records). [2025-10-08T20:05:54.415992] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-08T20:05:54.427314] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-08T20:05:54.786426] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-08T20:05:54.786505] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-08T20:05:54.786736] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-08T20:05:54.786842] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-08T20:05:54.787279] [DEBUG] [LOCAL ] MDST: Trimmed 8544 records to 5734 (keeping 200 days of data) [2025-10-08T20:05:54.822749] [DEBUG] [LOCAL ] MDST: Primary data saved (5734 records). [2025-10-08T20:05:54.822854] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-08T20:05:54.822942] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 27.5s. Estimated remaining: 2h 27m 43s. Rate: 7.1 symbols/min [2025-10-08T20:05:54.992260] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:55.003367] [DEBUG] [LOCAL ] MDV: Loaded 8514 existing records from primary storage. [2025-10-08T20:05:55.003611] [INFO ] [MAIN ] MDV: Loaded 8514 existing records. [2025-10-08T20:05:55.179674] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:55.179905] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-08T20:05:55.179952] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-08T20:05:55.180120] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-08T20:05:55.180177] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-08T20:05:55.225110] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-08T20:05:55.548228] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:56.017575] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-08T20:05:56.076450] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T20:05:56.817528] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-08T20:05:57.195232] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-08T20:05:57.199174] [INFO ] [REMOTE ] MDU: Full fetch complete (70407 records). [2025-10-08T20:05:57.199337] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-08T20:05:57.594710] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-08T20:05:57.594871] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-08T20:05:57.596132] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-08T20:05:57.596281] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-08T20:05:57.598138] [DEBUG] [LOCAL ] MDU: Trimmed 70407 records to 47997 (keeping 200 days of data) [2025-10-08T20:05:57.654976] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-10-08T20:05:57.906849] [DEBUG] [LOCAL ] MDU: Primary data saved (47997 records). [2025-10-08T20:05:57.907089] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-08T20:05:57.907211] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MDU took 30.6s. Estimated remaining: 2h 27m 31s. Rate: 7.1 symbols/min [2025-10-08T20:05:58.089017] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:05:58.112792] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T20:05:58.161380] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T20:05:58.178234] [DEBUG] [LOCAL ] MEC: Loaded 16219 existing records from primary storage. [2025-10-08T20:05:58.179304] [INFO ] [MAIN ] MEC: Loaded 16219 existing records. [2025-10-08T20:05:58.195591] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T20:05:58.363971] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:05:58.364193] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-08T20:05:58.364239] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-08T20:05:58.364447] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-08T20:05:58.364504] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-08T20:05:58.425966] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-08T20:05:58.723380] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:05:59.217559] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-08T20:06:00.017595] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-08T20:06:00.374839] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:06:00.484243] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T20:06:00.558919] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T20:06:00.562551] [INFO ] [REMOTE ] MD: Full fetch complete (55229 records). [2025-10-08T20:06:00.562736] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-08T20:06:00.822710] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-08T20:06:00.973152] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-08T20:06:00.973315] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-08T20:06:00.974144] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-08T20:06:00.974208] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-08T20:06:00.975462] [DEBUG] [LOCAL ] MD: Trimmed 55229 records to 38488 (keeping 200 days of data) [2025-10-08T20:06:01.206823] [DEBUG] [LOCAL ] MD: Primary data saved (38488 records). [2025-10-08T20:06:01.207002] [INFO ] [MAIN ] MD: Full history saved. [2025-10-08T20:06:01.207102] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 33.9s. Estimated remaining: 2h 27m 18s. Rate: 7.1 symbols/min [2025-10-08T20:06:01.388380] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:01.412025] [DEBUG] [LOCAL ] MED: Loaded 21400 existing records from primary storage. [2025-10-08T20:06:01.412302] [INFO ] [MAIN ] MED: Loaded 21400 existing records. [2025-10-08T20:06:01.600413] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:01.606515] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T20:06:01.606733] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-08T20:06:01.609243] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-08T20:06:01.609507] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-08T20:06:01.609565] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-08T20:06:01.622839] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-08T20:06:02.046614] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:02.417558] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-10-08T20:06:03.217574] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-10-08T20:06:03.462754] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:06:03.642100] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T20:06:04.017554] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-08T20:06:04.188018] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T20:06:04.817579] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-08T20:06:05.617569] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-08T20:06:05.667254] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T20:06:05.671810] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-10-08T20:06:05.671989] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-08T20:06:05.794382] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:06:06.173088] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-08T20:06:06.173173] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-08T20:06:06.174179] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-08T20:06:06.174248] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-08T20:06:06.175809] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 53678 (keeping 200 days of data) [2025-10-08T20:06:06.417615] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-08T20:06:06.526808] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-08T20:06:06.526970] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-08T20:06:06.527063] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDT took 39.2s. Estimated remaining: 2h 27m 7s. Rate: 7.1 symbols/min [2025-10-08T20:06:06.699106] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:06.734224] [DEBUG] [LOCAL ] MEG: Loaded 31522 existing records from primary storage. [2025-10-08T20:06:06.734520] [INFO ] [MAIN ] MEG: Loaded 31522 existing records. [2025-10-08T20:06:06.947415] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:06.925764] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T20:06:06.948189] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-08T20:06:06.953353] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-08T20:06:06.954865] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-08T20:06:06.955119] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-08T20:06:07.221195] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-08T20:06:07.269814] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T20:06:07.348207] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:08.017540] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-08T20:06:08.398120] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T20:06:08.766748] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T20:06:08.817565] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-08T20:06:09.617568] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-10-08T20:06:09.884350] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T20:06:10.417596] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-08T20:06:10.938840] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:06:11.114288] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T20:06:11.217538] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-08T20:06:11.837470] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T20:06:12.017539] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-08T20:06:12.817571] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-08T20:06:13.000537] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T20:06:13.574048] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T20:06:13.617552] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-08T20:06:14.417571] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-08T20:06:14.434786] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T20:06:15.217540] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-08T20:06:15.581440] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T20:06:15.954344] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T20:06:16.017551] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-08T20:06:16.817724] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-08T20:06:17.290226] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T20:06:17.581327] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T20:06:17.617553] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-08T20:06:18.417574] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-08T20:06:18.945438] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T20:06:19.217609] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-08T20:06:19.243582] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T20:06:19.963892] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T20:06:20.017610] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-08T20:06:20.817577] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-08T20:06:21.442951] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T20:06:21.617576] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-08T20:06:21.647620] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T20:06:22.214594] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T20:06:22.417628] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-08T20:06:23.217621] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-08T20:06:23.722949] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T20:06:24.017554] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-08T20:06:24.075223] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T20:06:24.817597] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-08T20:06:25.225425] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T20:06:25.617600] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-08T20:06:25.828416] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T20:06:26.417594] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-08T20:06:26.429863] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T20:06:26.431152] [INFO ] [REMOTE ] MDV: Full fetch complete (11770 records). [2025-10-08T20:06:26.431227] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-08T20:06:26.797022] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-08T20:06:26.797107] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-08T20:06:26.797442] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-08T20:06:26.797506] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-08T20:06:26.798205] [DEBUG] [LOCAL ] MDV: Trimmed 11770 records to 8529 (keeping 200 days of data) [2025-10-08T20:06:26.853270] [DEBUG] [LOCAL ] MDV: Primary data saved (8529 records). [2025-10-08T20:06:26.853420] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-08T20:06:26.853542] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDV took 32.0s. Estimated remaining: 2h 27m 8s. Rate: 7.1 symbols/min [2025-10-08T20:06:27.025004] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:27.048810] [DEBUG] [LOCAL ] MEGI: Loaded 19956 existing records from primary storage. [2025-10-08T20:06:27.049128] [INFO ] [MAIN ] MEGI: Loaded 19956 existing records. [2025-10-08T20:06:27.229364] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-08T20:06:27.260778] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:27.261234] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-08T20:06:27.262310] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-08T20:06:27.262716] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-08T20:06:27.262792] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-08T20:06:27.615690] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T20:06:27.650783] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:28.017523] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-08T20:06:28.155552] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T20:06:28.817524] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-08T20:06:28.975639] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T20:06:29.617585] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-08T20:06:29.746526] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:06:30.417577] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-10-08T20:06:30.867253] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T20:06:31.217531] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-08T20:06:31.612985] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T20:06:31.871231] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:06:31.873631] [INFO ] [REMOTE ] MED: Full fetch complete (32346 records). [2025-10-08T20:06:31.873758] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-08T20:06:32.036904] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-08T20:06:32.281122] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-08T20:06:32.281219] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-08T20:06:32.281948] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-08T20:06:32.282011] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-08T20:06:32.282970] [DEBUG] [LOCAL ] MED: Trimmed 32346 records to 21379 (keeping 200 days of data) [2025-10-08T20:06:32.417186] [DEBUG] [LOCAL ] MED: Primary data saved (21379 records). [2025-10-08T20:06:32.417345] [INFO ] [MAIN ] MED: Full history saved. [2025-10-08T20:06:32.417551] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MED took 31.2s. Estimated remaining: 2h 26m 58s. Rate: 7.1 symbols/min [2025-10-08T20:06:32.585434] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:32.620398] [DEBUG] [LOCAL ] MEI: Loaded 31840 existing records from primary storage. [2025-10-08T20:06:32.620742] [INFO ] [MAIN ] MEI: Loaded 31840 existing records. [2025-10-08T20:06:32.798102] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:32.798319] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-08T20:06:32.798405] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-08T20:06:32.798636] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-08T20:06:32.798771] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-08T20:06:32.829524] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-08T20:06:33.174730] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:33.187867] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T20:06:33.617514] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-08T20:06:33.660824] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T20:06:34.335096] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T20:06:34.417545] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-08T20:06:35.217507] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-08T20:06:35.307782] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T20:06:36.017620] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-10-08T20:06:36.257867] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T20:06:36.817556] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-08T20:06:37.318886] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T20:06:37.617566] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-08T20:06:37.961899] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T20:06:38.417554] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-08T20:06:38.948903] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T20:06:39.217674] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-08T20:06:39.724972] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T20:06:39.728293] [INFO ] [REMOTE ] MEG: Full fetch complete (47594 records). [2025-10-08T20:06:39.728426] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-08T20:06:40.022827] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-08T20:06:40.165912] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-08T20:06:40.166048] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-08T20:06:40.167767] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-08T20:06:40.167842] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-08T20:06:40.169722] [DEBUG] [LOCAL ] MEG: Trimmed 47594 records to 31440 (keeping 200 days of data) [2025-10-08T20:06:40.290320] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T20:06:40.405844] [DEBUG] [LOCAL ] MEG: Primary data saved (31440 records). [2025-10-08T20:06:40.406054] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-08T20:06:40.406170] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEG took 33.9s. Estimated remaining: 2h 26m 49s. Rate: 7.1 symbols/min [2025-10-08T20:06:40.637382] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:40.708217] [DEBUG] [LOCAL ] MET: Loaded 53326 existing records from primary storage. [2025-10-08T20:06:40.708770] [INFO ] [MAIN ] MET: Loaded 53326 existing records. [2025-10-08T20:06:40.822728] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-08T20:06:40.876245] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T20:06:40.915596] [INFO ] [REMOTE ] MEC: Full fetch complete (22740 records). [2025-10-08T20:06:40.949520] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-08T20:06:40.953635] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:41.018337] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-08T20:06:41.029572] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-08T20:06:41.053155] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-08T20:06:41.055615] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-08T20:06:41.633911] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-08T20:06:41.716814] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-08T20:06:41.731425] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-08T20:06:41.766182] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-08T20:06:41.765322] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:41.766422] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-08T20:06:41.768378] [DEBUG] [LOCAL ] MEC: Trimmed 22740 records to 16257 (keeping 200 days of data) [2025-10-08T20:06:41.862377] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T20:06:41.896676] [DEBUG] [LOCAL ] MEC: Primary data saved (16257 records). [2025-10-08T20:06:41.896863] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-08T20:06:41.896980] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MEC took 44.0s. Estimated remaining: 2h 26m 35s. Rate: 7.1 symbols/min [2025-10-08T20:06:42.065165] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:42.113176] [DEBUG] [LOCAL ] MFA: Loaded 45634 existing records from primary storage. [2025-10-08T20:06:42.113561] [INFO ] [MAIN ] MFA: Loaded 45634 existing records. [2025-10-08T20:06:42.286774] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:42.287006] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-08T20:06:42.287054] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-08T20:06:42.287461] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-08T20:06:42.287520] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-08T20:06:42.422857] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-08T20:06:42.721614] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:43.068939] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T20:06:43.217528] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-08T20:06:43.352606] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T20:06:44.017628] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-10-08T20:06:44.572522] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T20:06:44.817559] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-08T20:06:45.310512] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T20:06:45.539371] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T20:06:45.617497] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-08T20:06:46.417519] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-10-08T20:06:46.586943] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T20:06:47.217600] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-08T20:06:48.017530] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-08T20:06:48.212039] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T20:06:48.255454] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T20:06:48.817526] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-08T20:06:49.114847] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:06:49.617587] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-08T20:06:50.217851] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T20:06:50.417630] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-08T20:06:51.062151] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T20:06:51.217560] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-08T20:06:51.613694] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T20:06:52.017580] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-08T20:06:52.679712] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T20:06:52.817540] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-08T20:06:52.883306] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T20:06:53.617555] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-08T20:06:54.417527] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-08T20:06:54.514460] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T20:06:54.897154] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T20:06:55.036171] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T20:06:55.217549] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-08T20:06:56.017559] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-08T20:06:56.713429] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T20:06:56.817569] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-08T20:06:56.912627] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T20:06:56.914833] [INFO ] [REMOTE ] MEGI: Full fetch complete (30013 records). [2025-10-08T20:06:56.914907] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-08T20:06:57.318918] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-08T20:06:57.319011] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-08T20:06:57.319690] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-08T20:06:57.319754] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-08T20:06:57.320571] [DEBUG] [LOCAL ] MEGI: Trimmed 30013 records to 20022 (keeping 200 days of data) [2025-10-08T20:06:57.449376] [DEBUG] [LOCAL ] MEGI: Primary data saved (20022 records). [2025-10-08T20:06:57.449508] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-08T20:06:57.449590] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 30.6s. Estimated remaining: 2h 26m 32s. Rate: 7.1 symbols/min [2025-10-08T20:06:57.618825] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-08T20:06:57.620392] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:06:57.628939] [DEBUG] [LOCAL ] MFAN: Loaded 4285 existing records from primary storage. [2025-10-08T20:06:57.629145] [INFO ] [MAIN ] MFAN: Loaded 4285 existing records. [2025-10-08T20:06:57.804200] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:06:57.804439] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-08T20:06:57.804535] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-08T20:06:57.804766] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-08T20:06:57.804823] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-08T20:06:58.165453] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:06:58.417527] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-08T20:06:58.697992] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T20:06:59.053908] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T20:06:59.217549] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-08T20:06:59.694616] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T20:07:00.017557] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-08T20:07:00.380156] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T20:07:00.382863] [INFO ] [REMOTE ] MEI: Full fetch complete (45542 records). [2025-10-08T20:07:00.383093] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-08T20:07:00.787196] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-08T20:07:00.787358] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-08T20:07:00.788227] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-08T20:07:00.788295] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-08T20:07:00.789568] [DEBUG] [LOCAL ] MEI: Trimmed 45542 records to 31802 (keeping 200 days of data) [2025-10-08T20:07:00.841740] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-08T20:07:00.988873] [DEBUG] [LOCAL ] MEI: Primary data saved (31802 records). [2025-10-08T20:07:00.989047] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-08T20:07:00.989156] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEI took 28.6s. Estimated remaining: 2h 26m 20s. Rate: 7.1 symbols/min [2025-10-08T20:07:01.162315] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:01.168156] [DEBUG] [LOCAL ] MFAO: Loaded 3908 existing records from primary storage. [2025-10-08T20:07:01.168342] [INFO ] [MAIN ] MFAO: Loaded 3908 existing records. [2025-10-08T20:07:01.358828] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:07:01.359151] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-08T20:07:01.359223] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-08T20:07:01.359511] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-08T20:07:01.359572] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-08T20:07:01.623125] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-10-08T20:07:01.734136] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:01.875815] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T20:07:01.997151] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-08T20:07:02.417542] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-08T20:07:02.776586] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T20:07:03.217538] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-08T20:07:03.941684] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T20:07:04.017539] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-10-08T20:07:04.387375] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-08T20:07:04.813259] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T20:07:04.822191] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-08T20:07:05.365219] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T20:07:05.617558] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-08T20:07:06.098776] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T20:07:06.417539] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-08T20:07:07.217547] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-08T20:07:07.685984] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T20:07:08.017552] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-08T20:07:08.585932] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T20:07:08.817566] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-08T20:07:08.984603] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T20:07:09.359404] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T20:07:09.617570] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-08T20:07:10.417558] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-08T20:07:11.217506] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-08T20:07:11.470531] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T20:07:11.868286] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T20:07:12.017513] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-08T20:07:12.135537] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T20:07:12.588592] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:07:12.817689] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-08T20:07:13.617548] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-08T20:07:14.417521] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-08T20:07:14.595193] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T20:07:14.948333] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T20:07:15.212123] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T20:07:15.221104] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-08T20:07:15.870469] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T20:07:16.017556] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-08T20:07:16.817558] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-08T20:07:17.131445] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-08T20:07:17.585613] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T20:07:17.617512] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-08T20:07:18.417569] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-08T20:07:18.961513] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T20:07:19.123546] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T20:07:19.127763] [INFO ] [REMOTE ] MET: Full fetch complete (77124 records). [2025-10-08T20:07:19.127913] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-08T20:07:19.222623] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-08T20:07:19.525218] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-08T20:07:19.525346] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-08T20:07:19.526349] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-08T20:07:19.526413] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-08T20:07:19.527916] [DEBUG] [LOCAL ] MET: Trimmed 77124 records to 53326 (keeping 200 days of data) [2025-10-08T20:07:19.866549] [DEBUG] [LOCAL ] MET: Primary data saved (53326 records). [2025-10-08T20:07:19.866782] [INFO ] [MAIN ] MET: Full history saved. [2025-10-08T20:07:19.868188] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MET took 39.5s. Estimated remaining: 2h 26m 19s. Rate: 7.1 symbols/min [2025-10-08T20:07:20.021163] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-08T20:07:20.038228] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:20.092536] [DEBUG] [LOCAL ] MFC: Loaded 51121 existing records from primary storage. [2025-10-08T20:07:20.092908] [INFO ] [MAIN ] MFC: Loaded 51121 existing records. [2025-10-08T20:07:20.265990] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:07:20.266218] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-08T20:07:20.266265] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-08T20:07:20.267372] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-08T20:07:20.267432] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-08T20:07:20.626265] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:20.632857] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T20:07:20.817503] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-10-08T20:07:20.949971] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T20:07:21.617589] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-08T20:07:22.196619] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T20:07:22.198535] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T20:07:22.417556] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-08T20:07:23.217537] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-08T20:07:23.873247] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T20:07:24.017527] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-08T20:07:24.085456] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:07:24.650844] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T20:07:24.817569] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-08T20:07:25.617558] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-08T20:07:26.242369] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T20:07:26.243513] [INFO ] [REMOTE ] MFAN: Full fetch complete (5853 records). [2025-10-08T20:07:26.243591] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-08T20:07:26.419601] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-08T20:07:26.642019] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T20:07:26.670475] [INFO ] [REMOTE ] MFA: Full fetch complete (65325 records). [2025-10-08T20:07:26.670808] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-08T20:07:26.946389] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T20:07:27.049932] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-08T20:07:27.071317] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-08T20:07:27.099838] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-08T20:07:27.133967] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-08T20:07:27.222841] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-08T20:07:27.214904] [DEBUG] [LOCAL ] MFAN: Trimmed 5853 records to 4377 (keeping 200 days of data) [2025-10-08T20:07:27.483472] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-08T20:07:27.483327] [DEBUG] [LOCAL ] MFAN: Primary data saved (4377 records). [2025-10-08T20:07:27.483722] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-08T20:07:27.484876] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-08T20:07:27.484990] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-08T20:07:27.485109] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-08T20:07:27.485297] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MFAN took 30.0s. Estimated remaining: 2h 26m 10s. Rate: 7.1 symbols/min [2025-10-08T20:07:27.585290] [DEBUG] [LOCAL ] MFA: Trimmed 65325 records to 45676 (keeping 200 days of data) [2025-10-08T20:07:27.788049] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:27.945234] [DEBUG] [LOCAL ] MFG: Loaded 49321 existing records from primary storage. [2025-10-08T20:07:27.946463] [INFO ] [MAIN ] MFG: Loaded 49321 existing records. [2025-10-08T20:07:28.023809] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-08T20:07:28.144258] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:07:28.149745] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-08T20:07:28.151173] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-08T20:07:28.152864] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-08T20:07:28.153152] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-08T20:07:28.554975] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:28.556402] [DEBUG] [LOCAL ] MFA: Primary data saved (45676 records). [2025-10-08T20:07:28.556523] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-08T20:07:28.556729] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFA took 46.7s. Estimated remaining: 2h 25m 56s. Rate: 7.1 symbols/min [2025-10-08T20:07:28.645290] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:07:28.735680] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:28.752123] [DEBUG] [LOCAL ] MFM: Loaded 14786 existing records from primary storage. [2025-10-08T20:07:28.752370] [INFO ] [MAIN ] MFM: Loaded 14786 existing records. [2025-10-08T20:07:28.820265] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-10-08T20:07:28.958581] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:07:28.958891] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-08T20:07:28.959115] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-08T20:07:28.960964] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-08T20:07:28.960918] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T20:07:28.961081] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-08T20:07:29.329439] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:29.617563] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-10-08T20:07:30.316180] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T20:07:30.389071] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T20:07:30.417557] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-08T20:07:30.750291] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T20:07:31.217538] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-08T20:07:31.615607] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T20:07:32.017572] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-08T20:07:32.817591] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-08T20:07:33.623059] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-08T20:07:33.651093] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T20:07:34.162109] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T20:07:34.216435] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T20:07:34.417570] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-08T20:07:35.217634] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-08T20:07:35.855150] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:07:35.856166] [INFO ] [REMOTE ] MFAO: Full fetch complete (5399 records). [2025-10-08T20:07:35.856237] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-08T20:07:36.030892] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-08T20:07:36.267530] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T20:07:36.275776] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-08T20:07:36.285408] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-08T20:07:36.286572] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-08T20:07:36.286669] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-08T20:07:36.287132] [DEBUG] [LOCAL ] MFAO: Trimmed 5399 records to 3946 (keeping 200 days of data) [2025-10-08T20:07:36.312965] [DEBUG] [LOCAL ] MFAO: Primary data saved (3946 records). [2025-10-08T20:07:36.313134] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-08T20:07:36.313242] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAO took 35.3s. Estimated remaining: 2h 25m 47s. Rate: 7.1 symbols/min [2025-10-08T20:07:36.483533] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:36.483732] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-08T20:07:36.483784] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-08T20:07:36.483920] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-08T20:07:36.483980] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-08T20:07:36.484026] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-08T20:07:36.484058] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-08T20:07:36.793998] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T20:07:36.826273] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-08T20:07:36.859904] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:37.617523] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-10-08T20:07:37.642473] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T20:07:38.035418] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-08T20:07:38.417553] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-08T20:07:39.217585] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-08T20:07:39.343486] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T20:07:40.017624] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-08T20:07:40.662155] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T20:07:40.817546] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-08T20:07:40.920780] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T20:07:41.617599] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-08T20:07:42.122447] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T20:07:42.417607] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-08T20:07:42.998580] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T20:07:43.217591] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-08T20:07:43.820743] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T20:07:44.017526] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-08T20:07:44.817592] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-08T20:07:44.951429] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T20:07:45.367700] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T20:07:45.617534] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-08T20:07:45.701975] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T20:07:45.938468] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-08T20:07:46.417577] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-08T20:07:46.655972] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-08T20:07:47.217551] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-08T20:07:48.017575] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-08T20:07:48.053100] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T20:07:48.347778] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T20:07:48.817617] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-08T20:07:49.617530] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-08T20:07:49.711621] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T20:07:50.417609] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-08T20:07:50.941796] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T20:07:51.217557] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-08T20:07:51.311442] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:07:51.483164] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-08T20:07:52.017563] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-08T20:07:52.817613] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-08T20:07:53.057292] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-08T20:07:53.617570] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-08T20:07:53.728919] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T20:07:54.317939] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T20:07:54.320180] [INFO ] [REMOTE ] MFM: Full fetch complete (19630 records). [2025-10-08T20:07:54.320270] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-08T20:07:54.422742] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-08T20:07:54.715199] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-08T20:07:54.715278] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-08T20:07:54.715817] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-08T20:07:54.715879] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-08T20:07:54.716521] [DEBUG] [LOCAL ] MFM: Trimmed 19630 records to 14800 (keeping 200 days of data) [2025-10-08T20:07:54.806612] [DEBUG] [LOCAL ] MFM: Primary data saved (14800 records). [2025-10-08T20:07:54.806811] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-08T20:07:54.806906] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFM took 26.3s. Estimated remaining: 2h 25m 47s. Rate: 7.1 symbols/min [2025-10-08T20:07:54.891785] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T20:07:54.994291] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:07:55.003484] [DEBUG] [LOCAL ] MFSG: Loaded 5506 existing records from primary storage. [2025-10-08T20:07:55.003760] [INFO ] [MAIN ] MFSG: Loaded 5506 existing records. [2025-10-08T20:07:55.196753] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:07:55.197033] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-08T20:07:55.197099] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-08T20:07:55.197488] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-08T20:07:55.197568] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-08T20:07:55.227508] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-08T20:07:55.564162] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:07:56.017562] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-08T20:07:56.405939] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-08T20:07:56.817564] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-10-08T20:07:56.985952] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T20:07:57.097680] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-08T20:07:57.617546] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-08T20:07:58.417557] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-08T20:07:59.125226] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T20:07:59.217554] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-08T20:07:59.687102] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T20:08:00.017606] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-08T20:08:00.663954] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T20:08:00.817531] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-08T20:08:01.617517] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-08T20:08:01.732092] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T20:08:01.736064] [INFO ] [REMOTE ] MFC: Full fetch complete (74155 records). [2025-10-08T20:08:01.736206] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-08T20:08:02.150795] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-08T20:08:02.150929] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-08T20:08:02.152073] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-08T20:08:02.152146] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-08T20:08:02.153761] [DEBUG] [LOCAL ] MFC: Trimmed 74155 records to 51103 (keeping 200 days of data) [2025-10-08T20:08:02.215115] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T20:08:02.420682] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-08T20:08:02.515729] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T20:08:02.538515] [DEBUG] [LOCAL ] MFC: Primary data saved (51103 records). [2025-10-08T20:08:02.538639] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-08T20:08:02.540693] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFC took 42.7s. Estimated remaining: 2h 25m 38s. Rate: 7.1 symbols/min [2025-10-08T20:08:02.708800] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:02.722513] [DEBUG] [LOCAL ] MFSI: Loaded 11719 existing records from primary storage. [2025-10-08T20:08:02.722811] [INFO ] [MAIN ] MFSI: Loaded 11719 existing records. [2025-10-08T20:08:02.902523] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:02.902775] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-08T20:08:02.902826] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-08T20:08:02.903188] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-08T20:08:02.903249] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-08T20:08:03.190378] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T20:08:03.222635] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-08T20:08:03.298948] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:03.879807] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T20:08:03.880715] [INFO ] [REMOTE ] MFSB: Full fetch complete (1762 records). [2025-10-08T20:08:03.880784] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-08T20:08:04.022693] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-08T20:08:04.058801] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-08T20:08:04.058988] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:08:04.059056] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:08:04.059127] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-08T20:08:04.059190] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-08T20:08:04.059225] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-08T20:08:04.059282] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-08T20:08:04.059360] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFSB took 27.7s. Estimated remaining: 2h 25m 24s. Rate: 7.1 symbols/min [2025-10-08T20:08:04.229460] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:04.233718] [DEBUG] [LOCAL ] MFSV: Loaded 2650 existing records from primary storage. [2025-10-08T20:08:04.233929] [INFO ] [MAIN ] MFSV: Loaded 2650 existing records. [2025-10-08T20:08:04.415253] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:04.415492] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-08T20:08:04.415562] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-08T20:08:04.415838] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-08T20:08:04.415896] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-08T20:08:04.760001] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:04.817491] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-10-08T20:08:05.138543] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-08T20:08:05.422244] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T20:08:05.426040] [INFO ] [REMOTE ] MFG: Full fetch complete (69208 records). [2025-10-08T20:08:05.426158] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-08T20:08:05.622696] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-10-08T20:08:05.827410] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-08T20:08:05.827567] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-08T20:08:05.828615] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-08T20:08:05.828711] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-08T20:08:05.830300] [DEBUG] [LOCAL ] MFG: Trimmed 69208 records to 49362 (keeping 200 days of data) [2025-10-08T20:08:06.120560] [DEBUG] [LOCAL ] MFG: Primary data saved (49362 records). [2025-10-08T20:08:06.120735] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-08T20:08:06.120837] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFG took 38.6s. Estimated remaining: 2h 25m 10s. Rate: 7.1 symbols/min [2025-10-08T20:08:06.283408] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T20:08:06.300945] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:06.318298] [DEBUG] [LOCAL ] MG: Loaded 16268 existing records from primary storage. [2025-10-08T20:08:06.318552] [INFO ] [MAIN ] MG: Loaded 16268 existing records. [2025-10-08T20:08:06.419365] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-08T20:08:06.498237] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:06.498496] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-08T20:08:06.498542] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-08T20:08:06.499046] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-08T20:08:06.499105] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-08T20:08:06.865599] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:06.900672] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T20:08:07.217544] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-08T20:08:07.542585] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T20:08:08.017554] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-08T20:08:08.580293] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T20:08:08.817548] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-10-08T20:08:09.597280] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T20:08:09.617545] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-08T20:08:10.044553] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T20:08:10.417558] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-08T20:08:10.901141] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T20:08:11.217549] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-08T20:08:11.593940] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T20:08:12.017585] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-08T20:08:12.342657] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-08T20:08:12.817550] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-08T20:08:13.395028] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T20:08:13.617577] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-08T20:08:13.969928] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-08T20:08:14.417573] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-08T20:08:14.854864] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T20:08:15.217580] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-08T20:08:15.796705] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T20:08:16.017601] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-08T20:08:16.817574] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-08T20:08:17.006298] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T20:08:17.272873] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-08T20:08:17.617559] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-08T20:08:18.056630] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T20:08:18.417570] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-08T20:08:19.076614] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T20:08:19.217593] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-08T20:08:19.918807] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T20:08:20.017558] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-08T20:08:20.765743] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T20:08:20.817535] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-08T20:08:21.558710] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T20:08:21.617625] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-08T20:08:22.417566] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-08T20:08:22.545548] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T20:08:23.017526] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T20:08:23.217691] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-08T20:08:24.017579] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-08T20:08:24.115013] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:08:24.466164] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T20:08:24.817584] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-08T20:08:25.078949] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-08T20:08:25.617567] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-08T20:08:25.975059] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T20:08:26.417570] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-08T20:08:27.217686] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-08T20:08:27.342623] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T20:08:27.956989] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T20:08:28.017606] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-08T20:08:28.766287] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T20:08:28.817547] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-08T20:08:29.617548] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-08T20:08:29.704883] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T20:08:30.162249] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:08:30.163405] [INFO ] [REMOTE ] MFSG: Full fetch complete (6275 records). [2025-10-08T20:08:30.163477] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-08T20:08:30.422738] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-08T20:08:30.521091] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-08T20:08:30.521170] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-08T20:08:30.521362] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-08T20:08:30.521423] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-08T20:08:30.521866] [DEBUG] [LOCAL ] MFSG: Trimmed 6275 records to 5540 (keeping 200 days of data) [2025-10-08T20:08:30.555271] [DEBUG] [LOCAL ] MFSG: Primary data saved (5540 records). [2025-10-08T20:08:30.555390] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-08T20:08:30.555472] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFSG took 35.7s. Estimated remaining: 2h 25m 14s. Rate: 7.1 symbols/min [2025-10-08T20:08:30.719998] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:30.768485] [DEBUG] [LOCAL ] MGA: Loaded 50687 existing records from primary storage. [2025-10-08T20:08:30.768873] [INFO ] [MAIN ] MGA: Loaded 50687 existing records. [2025-10-08T20:08:30.953541] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:30.953786] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-08T20:08:30.953835] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-08T20:08:30.954926] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-08T20:08:30.954989] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-08T20:08:31.131280] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T20:08:31.222711] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-08T20:08:31.315964] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:31.837552] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T20:08:32.017583] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-10-08T20:08:32.817555] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-08T20:08:33.617547] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-08T20:08:33.730747] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T20:08:33.938696] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T20:08:34.113119] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:08:34.114152] [INFO ] [REMOTE ] MFSV: Full fetch complete (3348 records). [2025-10-08T20:08:34.114222] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-08T20:08:34.422640] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-08T20:08:34.485232] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-08T20:08:34.485347] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-08T20:08:34.485477] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-08T20:08:34.485516] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-08T20:08:34.485896] [DEBUG] [LOCAL ] MFSV: Trimmed 3348 records to 2679 (keeping 200 days of data) [2025-10-08T20:08:34.502462] [DEBUG] [LOCAL ] MFSV: Primary data saved (2679 records). [2025-10-08T20:08:34.502535] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-08T20:08:34.502607] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSV took 30.4s. Estimated remaining: 2h 25m 2s. Rate: 7.1 symbols/min [2025-10-08T20:08:34.673157] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:34.679135] [DEBUG] [LOCAL ] MGF: Loaded 4308 existing records from primary storage. [2025-10-08T20:08:34.679332] [INFO ] [MAIN ] MGF: Loaded 4308 existing records. [2025-10-08T20:08:34.864814] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:34.865091] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-08T20:08:34.865150] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-08T20:08:34.865378] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-08T20:08:34.865437] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-08T20:08:35.228855] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-08T20:08:35.234774] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:35.877627] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T20:08:35.941626] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T20:08:36.017494] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-08T20:08:36.817619] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-08T20:08:36.913904] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T20:08:36.915441] [INFO ] [REMOTE ] MFSI: Full fetch complete (14068 records). [2025-10-08T20:08:36.915511] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-08T20:08:37.272891] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-08T20:08:37.272971] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-08T20:08:37.273237] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-08T20:08:37.273274] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-08T20:08:37.273777] [DEBUG] [LOCAL ] MFSI: Trimmed 14068 records to 11732 (keeping 200 days of data) [2025-10-08T20:08:37.349575] [DEBUG] [LOCAL ] MFSI: Primary data saved (11732 records). [2025-10-08T20:08:37.349798] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-08T20:08:37.349963] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 34.8s. Estimated remaining: 2h 24m 50s. Rate: 7.1 symbols/min [2025-10-08T20:08:37.517446] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:37.576784] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-08T20:08:37.577106] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-08T20:08:37.619765] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-08T20:08:37.759600] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:37.760186] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-08T20:08:37.760263] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-08T20:08:37.761328] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-08T20:08:37.761393] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-08T20:08:37.898026] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:08:38.160753] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:38.417559] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-10-08T20:08:39.081287] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T20:08:39.217505] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-08T20:08:40.017530] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-08T20:08:40.244348] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T20:08:40.615840] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T20:08:40.817559] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-08T20:08:40.918788] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T20:08:41.617562] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-08T20:08:42.321197] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T20:08:42.417522] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-08T20:08:43.113399] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T20:08:43.217549] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-08T20:08:44.017518] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-08T20:08:44.226171] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T20:08:44.762139] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T20:08:44.817508] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-10-08T20:08:45.000227] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T20:08:45.443490] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T20:08:45.617544] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-08T20:08:46.417549] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-08T20:08:46.996852] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T20:08:47.217510] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-08T20:08:47.448857] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T20:08:48.017582] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-08T20:08:48.585527] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T20:08:48.817526] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-08T20:08:48.919456] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T20:08:49.494870] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T20:08:49.496993] [INFO ] [REMOTE ] MG: Full fetch complete (23807 records). [2025-10-08T20:08:49.497104] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-08T20:08:49.622615] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-08T20:08:49.912156] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-08T20:08:49.912239] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-08T20:08:49.912766] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-08T20:08:49.912829] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-08T20:08:49.914617] [DEBUG] [LOCAL ] MG: Trimmed 23807 records to 16154 (keeping 200 days of data) [2025-10-08T20:08:50.010548] [DEBUG] [LOCAL ] MG: Primary data saved (16154 records). [2025-10-08T20:08:50.010718] [INFO ] [MAIN ] MG: Full history saved. [2025-10-08T20:08:50.010813] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MG took 43.9s. Estimated remaining: 2h 24m 45s. Rate: 7.1 symbols/min [2025-10-08T20:08:50.179253] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:08:50.187959] [DEBUG] [LOCAL ] MGR: Loaded 5603 existing records from primary storage. [2025-10-08T20:08:50.188176] [INFO ] [MAIN ] MGR: Loaded 5603 existing records. [2025-10-08T20:08:50.365050] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:08:50.365253] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-08T20:08:50.365300] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-08T20:08:50.365580] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-08T20:08:50.365638] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-08T20:08:50.427630] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-08T20:08:50.729251] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:08:51.015908] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T20:08:51.217536] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-08T20:08:51.378358] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T20:08:52.017550] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-08T20:08:52.637932] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T20:08:52.642454] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T20:08:52.817555] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-08T20:08:53.617560] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-08T20:08:54.252290] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-08T20:08:54.424000] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-08T20:08:54.430468] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T20:08:55.217535] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-08T20:08:55.827516] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T20:08:56.017556] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-10-08T20:08:56.585996] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T20:08:56.817511] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-08T20:08:56.908517] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T20:08:57.257047] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T20:08:57.617610] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-08T20:08:58.417612] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-08T20:08:58.986463] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T20:08:59.217530] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-08T20:08:59.484093] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T20:09:00.017550] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-08T20:09:00.817549] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-08T20:09:01.023303] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T20:09:01.424155] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T20:09:01.617568] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-08T20:09:01.805013] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:09:02.417579] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-08T20:09:02.767368] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T20:09:02.994888] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T20:09:02.998871] [INFO ] [REMOTE ] MGA: Full fetch complete (73711 records). [2025-10-08T20:09:02.998992] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-08T20:09:03.222724] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-08T20:09:03.403514] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-08T20:09:03.403623] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-08T20:09:03.404608] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-08T20:09:03.404690] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-08T20:09:03.406181] [DEBUG] [LOCAL ] MGA: Trimmed 73711 records to 50675 (keeping 200 days of data) [2025-10-08T20:09:03.715212] [DEBUG] [LOCAL ] MGA: Primary data saved (50675 records). [2025-10-08T20:09:03.715361] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-08T20:09:03.715462] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MGA took 33.2s. Estimated remaining: 2h 24m 40s. Rate: 7.1 symbols/min [2025-10-08T20:09:03.889479] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:03.895602] [DEBUG] [LOCAL ] MGRB: Loaded 4054 existing records from primary storage. [2025-10-08T20:09:03.895831] [INFO ] [MAIN ] MGRB: Loaded 4054 existing records. [2025-10-08T20:09:04.022730] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-08T20:09:04.075850] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:04.076019] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-08T20:09:04.076069] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-08T20:09:04.076281] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-08T20:09:04.076339] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-08T20:09:04.437969] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:04.753678] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T20:09:04.817500] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-08T20:09:05.151161] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T20:09:05.352239] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T20:09:05.617568] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-08T20:09:06.089418] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T20:09:06.417584] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-08T20:09:06.850093] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T20:09:07.217547] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-08T20:09:07.798168] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T20:09:08.017550] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-08T20:09:08.452217] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T20:09:08.817569] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-08T20:09:09.247382] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-08T20:09:09.617558] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-08T20:09:10.289621] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:09:10.290601] [INFO ] [REMOTE ] MGF: Full fetch complete (5927 records). [2025-10-08T20:09:10.290720] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-08T20:09:10.430524] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-10-08T20:09:10.687082] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-08T20:09:10.687441] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-08T20:09:10.687933] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-08T20:09:10.688024] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-08T20:09:10.689052] [DEBUG] [LOCAL ] MGF: Trimmed 5927 records to 4286 (keeping 200 days of data) [2025-10-08T20:09:10.720529] [DEBUG] [LOCAL ] MGF: Primary data saved (4286 records). [2025-10-08T20:09:10.720718] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-08T20:09:10.720857] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGF took 36.2s. Estimated remaining: 2h 24m 31s. Rate: 7.1 symbols/min [2025-10-08T20:09:10.947724] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:10.953322] [DEBUG] [LOCAL ] MGRD: Loaded 2228 existing records from primary storage. [2025-10-08T20:09:10.953575] [INFO ] [MAIN ] MGRD: Loaded 2228 existing records. [2025-10-08T20:09:11.221386] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-08T20:09:11.229071] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:11.231556] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-08T20:09:11.231778] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-08T20:09:11.232082] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-08T20:09:11.232159] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-08T20:09:11.316330] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T20:09:11.799916] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:12.017588] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-08T20:09:12.053307] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T20:09:12.403906] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T20:09:12.817697] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-08T20:09:13.297409] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T20:09:13.617583] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-08T20:09:14.417833] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-08T20:09:14.821201] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T20:09:15.217531] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-10-08T20:09:15.454199] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T20:09:15.458932] [INFO ] [REMOTE ] MGM: Full fetch complete (77604 records). [2025-10-08T20:09:15.459097] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-08T20:09:15.817217] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T20:09:15.915006] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-08T20:09:15.915107] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-08T20:09:15.916121] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-08T20:09:15.916215] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-08T20:09:15.917870] [DEBUG] [LOCAL ] MGM: Trimmed 77604 records to 53607 (keeping 200 days of data) [2025-10-08T20:09:16.017865] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-08T20:09:16.252874] [DEBUG] [LOCAL ] MGM: Primary data saved (53607 records). [2025-10-08T20:09:16.253046] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-08T20:09:16.253940] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGM took 38.9s. Estimated remaining: 2h 24m 20s. Rate: 7.1 symbols/min [2025-10-08T20:09:16.430745] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:16.440932] [DEBUG] [LOCAL ] MGRE: Loaded 6662 existing records from primary storage. [2025-10-08T20:09:16.441202] [INFO ] [MAIN ] MGRE: Loaded 6662 existing records. [2025-10-08T20:09:16.572329] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T20:09:16.625453] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:16.625771] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-08T20:09:16.625840] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-08T20:09:16.626188] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-08T20:09:16.626248] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-08T20:09:16.826732] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-08T20:09:16.997620] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:17.264247] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T20:09:17.617583] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-08T20:09:18.066360] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-08T20:09:18.417562] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-08T20:09:18.763389] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T20:09:19.217584] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-08T20:09:19.823637] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:09:19.824999] [INFO ] [REMOTE ] MGR: Full fetch complete (8028 records). [2025-10-08T20:09:19.825099] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-08T20:09:20.022823] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-10-08T20:09:20.203226] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-08T20:09:20.203307] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-08T20:09:20.203529] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-08T20:09:20.203568] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-08T20:09:20.204082] [DEBUG] [LOCAL ] MGR: Trimmed 8028 records to 5606 (keeping 200 days of data) [2025-10-08T20:09:20.239391] [DEBUG] [LOCAL ] MGR: Primary data saved (5606 records). [2025-10-08T20:09:20.239531] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-08T20:09:20.239638] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGR took 30.2s. Estimated remaining: 2h 24m 8s. Rate: 7.1 symbols/min [2025-10-08T20:09:20.408364] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:20.458178] [DEBUG] [LOCAL ] MGY: Loaded 52395 existing records from primary storage. [2025-10-08T20:09:20.458515] [INFO ] [MAIN ] MGY: Loaded 52395 existing records. [2025-10-08T20:09:20.640492] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:20.640887] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-08T20:09:20.640947] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-08T20:09:20.642042] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-08T20:09:20.642104] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-08T20:09:20.820259] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-08T20:09:20.832810] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T20:09:21.008154] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:21.450350] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T20:09:21.617580] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-10-08T20:09:22.417544] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-08T20:09:23.027416] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T20:09:23.217524] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-08T20:09:23.359233] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T20:09:23.824676] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T20:09:24.017596] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-08T20:09:24.571397] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T20:09:24.817560] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-08T20:09:25.218731] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T20:09:25.617600] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-08T20:09:26.417588] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-08T20:09:26.936582] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T20:09:26.973000] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T20:09:27.217579] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-08T20:09:27.774251] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T20:09:28.017610] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-08T20:09:28.650831] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T20:09:28.817566] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-08T20:09:29.449921] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T20:09:29.617556] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-08T20:09:29.989337] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-08T20:09:30.417607] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-08T20:09:31.139806] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:09:31.217529] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-08T20:09:31.823833] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T20:09:32.017558] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-08T20:09:32.485732] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:09:32.486540] [INFO ] [REMOTE ] MGRB: Full fetch complete (5883 records). [2025-10-08T20:09:32.486607] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-08T20:09:32.822705] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-08T20:09:32.853121] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-08T20:09:32.853210] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-08T20:09:32.853426] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-08T20:09:32.853482] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-08T20:09:32.854043] [DEBUG] [LOCAL ] MGRB: Trimmed 5883 records to 4067 (keeping 200 days of data) [2025-10-08T20:09:32.879765] [DEBUG] [LOCAL ] MGRB: Primary data saved (4067 records). [2025-10-08T20:09:32.879863] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-08T20:09:32.879966] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGRB took 29.2s. Estimated remaining: 2h 24m 3s. Rate: 7.1 symbols/min [2025-10-08T20:09:33.046758] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:33.046935] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-08T20:09:33.046975] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-08T20:09:33.047090] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-08T20:09:33.047133] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-08T20:09:33.047176] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-08T20:09:33.047209] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-08T20:09:33.410238] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:33.410721] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T20:09:33.617559] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-08T20:09:34.289533] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T20:09:34.417573] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-08T20:09:35.136908] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:09:35.217517] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-08T20:09:35.920881] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T20:09:36.017563] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-08T20:09:36.790215] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T20:09:36.817499] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-08T20:09:37.415562] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:09:37.416522] [INFO ] [REMOTE ] MGRE: Full fetch complete (9436 records). [2025-10-08T20:09:37.416592] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-08T20:09:37.623913] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-08T20:09:37.776575] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-08T20:09:37.776688] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-08T20:09:37.776974] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-08T20:09:37.777014] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-08T20:09:37.777443] [DEBUG] [LOCAL ] MGRE: Trimmed 9436 records to 6697 (keeping 200 days of data) [2025-10-08T20:09:37.819066] [DEBUG] [LOCAL ] MGRE: Primary data saved (6697 records). [2025-10-08T20:09:37.819210] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-08T20:09:37.819298] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRE took 21.6s. Estimated remaining: 2h 23m 52s. Rate: 7.1 symbols/min [2025-10-08T20:09:38.004320] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:38.019184] [DEBUG] [LOCAL ] MHD: Loaded 12471 existing records from primary storage. [2025-10-08T20:09:38.019470] [INFO ] [MAIN ] MHD: Loaded 12471 existing records. [2025-10-08T20:09:38.214369] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:38.214689] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-08T20:09:38.214750] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-08T20:09:38.215140] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-08T20:09:38.215200] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-08T20:09:38.422803] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-10-08T20:09:38.585418] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:38.721584] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:09:38.722030] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-10-08T20:09:38.722161] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:09:38.722256] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-08T20:09:38.722324] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:09:38.722396] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-08T20:09:38.722465] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-08T20:09:38.722505] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-08T20:09:38.722565] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-08T20:09:38.722637] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MH took 5.8s. Estimated remaining: 2h 23m 38s. Rate: 7.1 symbols/min [2025-10-08T20:09:38.895039] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:38.905527] [DEBUG] [LOCAL ] MHF: Loaded 8672 existing records from primary storage. [2025-10-08T20:09:38.905780] [INFO ] [MAIN ] MHF: Loaded 8672 existing records. [2025-10-08T20:09:39.088894] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:39.089453] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-08T20:09:39.089512] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-08T20:09:39.089892] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-08T20:09:39.089951] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-08T20:09:39.235206] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-10-08T20:09:39.469244] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:39.490564] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T20:09:40.017555] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-10-08T20:09:40.226239] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T20:09:40.796901] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T20:09:40.817506] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-08T20:09:41.424621] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T20:09:41.617545] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-08T20:09:42.283215] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T20:09:42.417556] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-08T20:09:42.761892] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-08T20:09:43.217547] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-08T20:09:43.559363] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T20:09:44.017570] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-08T20:09:44.778747] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T20:09:44.817526] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-08T20:09:45.368593] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T20:09:45.617580] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-08T20:09:46.345547] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T20:09:46.417594] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-08T20:09:47.081224] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T20:09:47.217573] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-08T20:09:47.666684] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T20:09:48.017597] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-08T20:09:48.817584] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-08T20:09:49.206735] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-08T20:09:49.617510] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-08T20:09:49.677822] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T20:09:50.226787] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T20:09:50.417544] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-08T20:09:50.844801] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T20:09:51.217547] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-08T20:09:51.656166] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:09:51.657257] [INFO ] [REMOTE ] MGRD: Full fetch complete (3496 records). [2025-10-08T20:09:51.657335] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-08T20:09:52.027938] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-08T20:09:52.061910] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-08T20:09:52.062087] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-08T20:09:52.062243] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-08T20:09:52.062287] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-08T20:09:52.062726] [DEBUG] [LOCAL ] MGRD: Trimmed 3496 records to 2240 (keeping 200 days of data) [2025-10-08T20:09:52.078950] [DEBUG] [LOCAL ] MGRD: Primary data saved (2240 records). [2025-10-08T20:09:52.079103] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-08T20:09:52.079217] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MGRD took 41.4s. Estimated remaining: 2h 23m 33s. Rate: 7.1 symbols/min [2025-10-08T20:09:52.271882] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:09:52.323912] [DEBUG] [LOCAL ] MHK: Loaded 42217 existing records from primary storage. [2025-10-08T20:09:52.324351] [INFO ] [MAIN ] MHK: Loaded 42217 existing records. [2025-10-08T20:09:52.530952] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:09:52.531270] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-08T20:09:52.531326] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-08T20:09:52.532391] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-08T20:09:52.532456] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-08T20:09:52.822689] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-08T20:09:52.926779] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:09:53.514695] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T20:09:53.617554] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-08T20:09:53.748556] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T20:09:54.421066] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-10-08T20:09:54.424469] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T20:09:55.217544] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-08T20:09:55.971544] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T20:09:56.017502] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-08T20:09:56.817623] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-08T20:09:57.039014] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T20:09:57.466869] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T20:09:57.617525] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-08T20:09:57.647520] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T20:09:58.417561] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-08T20:09:58.476283] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T20:09:59.217571] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-08T20:09:59.984306] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T20:10:00.017506] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-08T20:10:00.293306] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T20:10:00.817608] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-08T20:10:01.617539] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-08T20:10:01.742104] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T20:10:01.844820] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T20:10:02.083433] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T20:10:02.417615] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-08T20:10:03.209152] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T20:10:03.217540] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-08T20:10:03.994768] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T20:10:03.996732] [INFO ] [REMOTE ] MHF: Full fetch complete (12590 records). [2025-10-08T20:10:03.996916] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-08T20:10:04.022706] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-08T20:10:04.382675] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-08T20:10:04.382773] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-08T20:10:04.383084] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-08T20:10:04.383122] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-08T20:10:04.383714] [DEBUG] [LOCAL ] MHF: Trimmed 12590 records to 8688 (keeping 200 days of data) [2025-10-08T20:10:04.438622] [DEBUG] [LOCAL ] MHF: Primary data saved (8688 records). [2025-10-08T20:10:04.438852] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-08T20:10:04.438956] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MHF took 25.7s. Estimated remaining: 2h 23m 27s. Rate: 7.1 symbols/min [2025-10-08T20:10:04.607942] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:04.608173] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-08T20:10:04.608229] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-08T20:10:04.608346] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-08T20:10:04.608387] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-08T20:10:04.608427] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-08T20:10:04.608459] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-08T20:10:04.827467] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-08T20:10:04.962869] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:05.619953] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-08T20:10:05.660875] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T20:10:05.662057] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T20:10:06.417559] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-10-08T20:10:06.861435] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T20:10:07.217533] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-08T20:10:07.386635] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:10:07.673461] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T20:10:08.017582] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-08T20:10:08.684278] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T20:10:08.817615] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-08T20:10:09.617633] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-08T20:10:10.118627] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T20:10:10.364207] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T20:10:10.417573] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-08T20:10:10.793532] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-08T20:10:11.217558] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-08T20:10:11.629390] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T20:10:12.017610] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-08T20:10:12.817565] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-08T20:10:13.602383] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T20:10:13.606448] [INFO ] [REMOTE ] MGY: Full fetch complete (75726 records). [2025-10-08T20:10:13.606592] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-08T20:10:13.628153] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-08T20:10:14.019399] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-08T20:10:14.019483] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-08T20:10:14.020549] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-08T20:10:14.020616] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-08T20:10:14.022178] [DEBUG] [LOCAL ] MGY: Trimmed 75726 records to 52395 (keeping 200 days of data) [2025-10-08T20:10:14.273575] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T20:10:14.402764] [DEBUG] [LOCAL ] MGY: Primary data saved (52395 records). [2025-10-08T20:10:14.402925] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-08T20:10:14.403041] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 54.2s. Estimated remaining: 2h 23m 20s. Rate: 7.1 symbols/min [2025-10-08T20:10:14.424595] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-08T20:10:14.626317] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:14.635529] [DEBUG] [LOCAL ] MHN: Loaded 7657 existing records from primary storage. [2025-10-08T20:10:14.635766] [INFO ] [MAIN ] MHN: Loaded 7657 existing records. [2025-10-08T20:10:14.752856] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:10:14.836705] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:10:14.836935] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-08T20:10:14.836982] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-08T20:10:14.837252] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-08T20:10:14.837311] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-08T20:10:15.199983] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:15.217499] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-10-08T20:10:16.021275] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-08T20:10:16.024229] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T20:10:16.236673] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T20:10:16.510064] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T20:10:16.817609] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-08T20:10:17.617527] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-08T20:10:17.650542] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T20:10:17.652153] [INFO ] [REMOTE ] MHD: Full fetch complete (18711 records). [2025-10-08T20:10:17.652230] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-08T20:10:17.938081] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T20:10:18.022725] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-08T20:10:18.022813] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-08T20:10:18.023212] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-08T20:10:18.023251] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-08T20:10:18.023839] [DEBUG] [LOCAL ] MHD: Trimmed 18711 records to 12479 (keeping 200 days of data) [2025-10-08T20:10:18.100423] [DEBUG] [LOCAL ] MHD: Primary data saved (12479 records). [2025-10-08T20:10:18.100577] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-08T20:10:18.100684] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHD took 40.3s. Estimated remaining: 2h 23m 8s. Rate: 7.1 symbols/min [2025-10-08T20:10:18.265775] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:18.289892] [DEBUG] [LOCAL ] MHO: Loaded 23820 existing records from primary storage. [2025-10-08T20:10:18.290180] [INFO ] [MAIN ] MHO: Loaded 23820 existing records. [2025-10-08T20:10:18.432559] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-08T20:10:18.476045] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:10:18.476279] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-08T20:10:18.476327] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-08T20:10:18.477071] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-08T20:10:18.477131] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-08T20:10:18.825699] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:19.217607] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-08T20:10:19.859103] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T20:10:19.868049] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T20:10:20.017501] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-08T20:10:20.817573] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-08T20:10:21.549862] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T20:10:21.617516] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-08T20:10:21.760087] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T20:10:22.197089] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T20:10:22.417554] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-08T20:10:23.217589] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-08T20:10:23.540024] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-08T20:10:23.951387] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T20:10:24.017558] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-10-08T20:10:24.817579] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-08T20:10:25.035702] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:10:25.617567] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-08T20:10:26.036562] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T20:10:26.417592] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-08T20:10:26.967786] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T20:10:26.982157] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T20:10:27.217557] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-08T20:10:27.687161] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T20:10:28.017558] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-08T20:10:28.258809] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-08T20:10:28.817566] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-08T20:10:29.525831] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T20:10:29.617596] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-08T20:10:30.417548] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-08T20:10:30.994961] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T20:10:31.217552] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-08T20:10:31.992829] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T20:10:31.996079] [INFO ] [REMOTE ] MHK: Full fetch complete (60992 records). [2025-10-08T20:10:31.996207] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-08T20:10:32.027207] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-08T20:10:32.397632] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-08T20:10:32.397802] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-08T20:10:32.398902] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-08T20:10:32.398978] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-08T20:10:32.400410] [DEBUG] [LOCAL ] MHK: Trimmed 60992 records to 42238 (keeping 200 days of data) [2025-10-08T20:10:32.515606] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T20:10:32.646753] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:10:32.697234] [DEBUG] [LOCAL ] MHK: Primary data saved (42238 records). [2025-10-08T20:10:32.697373] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-08T20:10:32.697457] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHK took 40.6s. Estimated remaining: 2h 23m 4s. Rate: 7.1 symbols/min [2025-10-08T20:10:32.822680] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-08T20:10:32.882073] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:32.882289] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-08T20:10:32.882343] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-08T20:10:32.882481] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-08T20:10:32.882548] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-08T20:10:32.882623] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-08T20:10:32.882718] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-08T20:10:33.237729] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:33.617577] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-10-08T20:10:33.818983] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:10:33.819307] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-10-08T20:10:33.819399] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:10:33.819445] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-08T20:10:33.819501] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:10:33.819573] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-08T20:10:33.819636] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-08T20:10:33.819711] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-08T20:10:33.819768] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-08T20:10:33.819826] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MIAX took 1.1s. Estimated remaining: 2h 22m 50s. Rate: 7.1 symbols/min [2025-10-08T20:10:33.991512] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:34.005863] [DEBUG] [LOCAL ] MIN: Loaded 13484 existing records from primary storage. [2025-10-08T20:10:34.006123] [INFO ] [MAIN ] MIN: Loaded 13484 existing records. [2025-10-08T20:10:34.197855] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:10:34.198886] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-08T20:10:34.198945] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-08T20:10:34.199890] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-08T20:10:34.199959] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-08T20:10:34.422721] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-08T20:10:34.597516] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:34.598809] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T20:10:34.808242] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-08T20:10:35.217542] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-10-08T20:10:35.994907] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T20:10:36.017504] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-08T20:10:36.579455] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T20:10:36.817582] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-08T20:10:37.556448] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T20:10:37.617597] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-08T20:10:38.342569] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T20:10:38.417534] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-08T20:10:39.202406] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T20:10:39.217506] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-08T20:10:40.006958] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T20:10:40.017595] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-08T20:10:40.817623] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-08T20:10:41.110785] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T20:10:41.235963] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-08T20:10:41.617548] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-08T20:10:42.268061] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T20:10:42.417572] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-08T20:10:43.217549] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-08T20:10:43.508922] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T20:10:43.714374] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:10:43.716114] [INFO ] [REMOTE ] MHN: Full fetch complete (11686 records). [2025-10-08T20:10:43.716190] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-08T20:10:44.022610] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-08T20:10:44.112545] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-08T20:10:44.112673] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-08T20:10:44.113182] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-08T20:10:44.113248] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-08T20:10:44.114099] [DEBUG] [LOCAL ] MHN: Trimmed 11686 records to 7586 (keeping 200 days of data) [2025-10-08T20:10:44.164096] [DEBUG] [LOCAL ] MHN: Primary data saved (7586 records). [2025-10-08T20:10:44.164264] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-08T20:10:44.164371] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHN took 29.8s. Estimated remaining: 2h 22m 43s. Rate: 7.1 symbols/min [2025-10-08T20:10:44.377100] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:10:44.379884] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T20:10:44.444638] [DEBUG] [LOCAL ] MIR: Loaded 51128 existing records from primary storage. [2025-10-08T20:10:44.445010] [INFO ] [MAIN ] MIR: Loaded 51128 existing records. [2025-10-08T20:10:44.623843] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:10:44.624080] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-08T20:10:44.624203] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-08T20:10:44.625256] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-08T20:10:44.625319] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-08T20:10:44.822687] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-08T20:10:45.008510] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:10:45.617555] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-08T20:10:45.804198] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T20:10:45.944395] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:10:45.945140] [INFO ] [REMOTE ] MHLA: Full fetch complete (1527 records). [2025-10-08T20:10:45.945225] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-08T20:10:46.122247] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-08T20:10:46.122468] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:10:46.122537] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:10:46.122609] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-08T20:10:46.122716] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-08T20:10:46.122773] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-08T20:10:46.122817] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-08T20:10:46.122875] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHLA took 41.7s. Estimated remaining: 2h 22m 30s. Rate: 7.1 symbols/min [2025-10-08T20:10:46.417560] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-08T20:10:47.217540] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-10-08T20:10:47.289600] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T20:10:48.017583] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-08T20:10:48.533958] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:10:48.560989] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T20:10:48.817576] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-08T20:10:49.617576] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-08T20:10:50.182727] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T20:10:50.374371] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T20:10:50.417511] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-08T20:10:51.206607] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:10:51.208458] [INFO ] [REMOTE ] MIN: Full fetch complete (18018 records). [2025-10-08T20:10:51.208551] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-08T20:10:51.222676] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-08T20:10:51.572934] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-08T20:10:51.573017] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-08T20:10:51.573414] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-08T20:10:51.573452] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-08T20:10:51.574026] [DEBUG] [LOCAL ] MIN: Trimmed 18018 records to 13585 (keeping 200 days of data) [2025-10-08T20:10:51.657511] [DEBUG] [LOCAL ] MIN: Primary data saved (13585 records). [2025-10-08T20:10:51.657704] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-08T20:10:51.657816] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIN took 17.8s. Estimated remaining: 2h 22m 20s. Rate: 7.1 symbols/min [2025-10-08T20:10:52.017557] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-08T20:10:52.829985] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T20:10:52.839738] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-08T20:10:53.352722] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T20:10:53.617618] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-08T20:10:54.579589] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T20:10:54.590479] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-08T20:10:54.827253] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T20:10:55.217551] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-08T20:10:55.939770] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T20:10:56.017526] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-08T20:10:56.239069] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T20:10:56.817607] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-08T20:10:57.670497] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T20:10:57.681268] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-08T20:10:57.734819] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T20:10:57.736836] [INFO ] [REMOTE ] MHO: Full fetch complete (36995 records). [2025-10-08T20:10:57.737027] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-08T20:10:58.127754] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-08T20:10:58.127847] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-08T20:10:58.128524] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-08T20:10:58.128587] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-08T20:10:58.129532] [DEBUG] [LOCAL ] MHO: Trimmed 36995 records to 23737 (keeping 200 days of data) [2025-10-08T20:10:58.290226] [DEBUG] [LOCAL ] MHO: Primary data saved (23737 records). [2025-10-08T20:10:58.290376] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-08T20:10:58.290490] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHO took 40.2s. Estimated remaining: 2h 22m 10s. Rate: 7.1 symbols/min [2025-10-08T20:10:59.448321] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T20:10:59.459152] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-08T20:11:01.385794] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T20:11:01.397530] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-08T20:11:03.159514] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T20:11:03.170947] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-08T20:11:04.930876] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T20:11:04.943957] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-08T20:11:06.694262] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-08T20:11:06.698889] [INFO ] [REMOTE ] MIR: Full fetch complete (73525 records). [2025-10-08T20:11:06.699053] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-08T20:11:07.096549] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-08T20:11:07.096672] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-08T20:11:07.097740] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-08T20:11:07.097806] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-08T20:11:07.099731] [DEBUG] [LOCAL ] MIR: Trimmed 73525 records to 51139 (keeping 200 days of data) [2025-10-08T20:11:07.419249] [DEBUG] [LOCAL ] MIR: Primary data saved (51139 records). [2025-10-08T20:11:07.419495] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-08T20:11:07.419624] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIR took 23.3s. Estimated remaining: 2h 22m 2s. Rate: 7.1 symbols/min [2025-10-08T20:11:08.228732] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:08.269230] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:08.273497] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:08.275087] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:08.275915] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-08T20:11:08.276482] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-08T20:11:08.276762] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-08T20:11:08.276877] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-08T20:11:08.276947] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-08T20:11:08.277085] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-08T20:11:08.341184] [DEBUG] [LOCAL ] MITP: Loaded 2373 existing records from primary storage. [2025-10-08T20:11:08.371505] [DEBUG] [LOCAL ] MIY: Loaded 6055 existing records from primary storage. [2025-10-08T20:11:08.376958] [INFO ] [MAIN ] MITP: Loaded 2373 existing records. [2025-10-08T20:11:08.383945] [INFO ] [MAIN ] MIY: Loaded 6055 existing records. [2025-10-08T20:11:08.707807] [DEBUG] [LOCAL ] MITT: Loaded 22776 existing records from primary storage. [2025-10-08T20:11:08.746309] [INFO ] [MAIN ] MITT: Loaded 22776 existing records. [2025-10-08T20:11:09.156369] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:09.233988] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:09.234184] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-08T20:11:09.251479] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-08T20:11:09.277671] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-08T20:11:09.272420] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-08T20:11:09.332341] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-08T20:11:09.308416] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-08T20:11:09.491341] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-08T20:11:09.461781] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:09.500310] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-08T20:11:09.536732] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-10-08T20:11:09.562313] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:09.590877] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-08T20:11:09.647466] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-08T20:11:09.665525] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-08T20:11:09.668764] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-08T20:11:10.012195] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T20:11:10.063631] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-08T20:11:10.476392] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:10.482614] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-10-08T20:11:10.482262] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:10.512883] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-10-08T20:11:10.544215] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-08T20:11:10.596718] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-08T20:11:10.602892] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:10.604127] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-10-08T20:11:11.034101] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-08T20:11:11.035773] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-08T20:11:11.106585] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T20:11:11.107839] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-08T20:11:11.269527] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T20:11:11.272303] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-08T20:11:11.502257] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T20:11:11.503799] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-08T20:11:11.547938] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T20:11:11.554070] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-08T20:11:11.876496] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T20:11:11.877292] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T20:11:11.884395] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-08T20:11:11.898422] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-08T20:11:11.890509] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-08T20:11:11.895838] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T20:11:12.017572] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-08T20:11:12.279465] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-08T20:11:12.420209] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T20:11:12.817735] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-08T20:11:12.859723] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:11:13.520682] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T20:11:13.617579] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-08T20:11:14.187682] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T20:11:14.417639] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-08T20:11:14.888528] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T20:11:15.217632] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-08T20:11:16.017570] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-08T20:11:16.282492] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T20:11:16.282055] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-08T20:11:16.817624] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-08T20:11:17.153208] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T20:11:17.617564] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-08T20:11:18.417518] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-08T20:11:18.577329] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T20:11:18.850421] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T20:11:19.217567] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-08T20:11:19.502286] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-08T20:11:20.017572] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-08T20:11:20.759936] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T20:11:20.817567] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-08T20:11:21.405808] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T20:11:21.617596] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-08T20:11:22.278288] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T20:11:22.417606] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-08T20:11:23.217596] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-08T20:11:23.779323] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T20:11:23.934299] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T20:11:24.017616] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-08T20:11:24.686290] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:11:24.687526] [INFO ] [REMOTE ] MIY: Full fetch complete (8973 records). [2025-10-08T20:11:24.687624] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-08T20:11:24.822758] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-08T20:11:25.056758] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-08T20:11:25.056846] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-08T20:11:25.057062] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-08T20:11:25.057101] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-08T20:11:25.057524] [DEBUG] [LOCAL ] MIY: Trimmed 8973 records to 6115 (keeping 200 days of data) [2025-10-08T20:11:25.094929] [DEBUG] [LOCAL ] MIY: Primary data saved (6115 records). [2025-10-08T20:11:25.095056] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-08T20:11:25.095185] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MIY took 17.7s. Estimated remaining: 2h 22m 0s. Rate: 7.1 symbols/min [2025-10-08T20:11:25.301252] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:25.349373] [DEBUG] [LOCAL ] MKC: Loaded 52516 existing records from primary storage. [2025-10-08T20:11:25.349755] [INFO ] [MAIN ] MKC: Loaded 52516 existing records. [2025-10-08T20:11:25.524221] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:25.524456] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-08T20:11:25.524522] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-08T20:11:25.525596] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-08T20:11:25.525690] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-08T20:11:25.625773] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-08T20:11:25.889835] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:26.014946] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T20:11:26.126275] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:11:26.127157] [INFO ] [REMOTE ] MITN: Full fetch complete (2359 records). [2025-10-08T20:11:26.127228] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-08T20:11:26.313530] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T20:11:26.313800] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:11:26.313875] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:11:26.313949] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-08T20:11:26.314017] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-08T20:11:26.314056] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-08T20:11:26.314100] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-08T20:11:26.314163] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITN took 18.9s. Estimated remaining: 2h 21m 46s. Rate: 7.1 symbols/min [2025-10-08T20:11:26.422726] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-10-08T20:11:26.486695] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:26.526553] [DEBUG] [LOCAL ] MKL: Loaded 34093 existing records from primary storage. [2025-10-08T20:11:26.526869] [INFO ] [MAIN ] MKL: Loaded 34093 existing records. [2025-10-08T20:11:26.707570] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:26.707837] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-08T20:11:26.707885] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-08T20:11:26.708919] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-08T20:11:26.708978] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-08T20:11:27.058560] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:27.217550] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-08T20:11:27.948921] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:11:28.017509] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-08T20:11:28.383671] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T20:11:28.817620] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-10-08T20:11:29.617537] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-08T20:11:29.715948] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T20:11:29.863207] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:11:29.920013] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-08T20:11:30.417550] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-08T20:11:31.217555] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-08T20:11:31.786422] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T20:11:32.017535] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-08T20:11:32.219485] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T20:11:32.817586] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-08T20:11:33.087776] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T20:11:33.617594] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-08T20:11:34.044999] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T20:11:34.372551] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T20:11:34.417622] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-08T20:11:35.217623] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-08T20:11:35.317205] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T20:11:35.486083] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-08T20:11:36.017612] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-08T20:11:36.817588] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-08T20:11:37.193107] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T20:11:37.393074] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T20:11:37.617562] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-08T20:11:38.417558] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-08T20:11:38.682701] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T20:11:39.217585] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-08T20:11:40.017525] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-08T20:11:40.062168] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T20:11:40.100187] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T20:11:40.102154] [INFO ] [REMOTE ] MITT: Full fetch complete (34520 records). [2025-10-08T20:11:40.102234] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-08T20:11:40.481836] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T20:11:40.514076] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-08T20:11:40.514166] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-08T20:11:40.514996] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-08T20:11:40.515066] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-08T20:11:40.516015] [DEBUG] [LOCAL ] MITT: Trimmed 34520 records to 22667 (keeping 200 days of data) [2025-10-08T20:11:40.658208] [DEBUG] [LOCAL ] MITT: Primary data saved (22667 records). [2025-10-08T20:11:40.658383] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-08T20:11:40.658510] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MITT took 33.2s. Estimated remaining: 2h 21m 42s. Rate: 7.1 symbols/min [2025-10-08T20:11:40.826024] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-08T20:11:40.830170] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:40.883390] [DEBUG] [LOCAL ] MLI: Loaded 43511 existing records from primary storage. [2025-10-08T20:11:40.883770] [INFO ] [MAIN ] MLI: Loaded 43511 existing records. [2025-10-08T20:11:41.071699] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:41.071915] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-08T20:11:41.071962] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-08T20:11:41.072834] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-08T20:11:41.072893] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-08T20:11:41.418754] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:41.617520] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-10-08T20:11:42.417703] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-08T20:11:42.600552] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T20:11:42.702532] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-08T20:11:43.222680] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-08T20:11:43.245008] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T20:11:44.017611] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-08T20:11:44.390270] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T20:11:44.817547] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-08T20:11:45.617519] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-08T20:11:45.775764] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T20:11:45.839850] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T20:11:46.098745] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:11:46.099752] [INFO ] [REMOTE ] MITP: Full fetch complete (3321 records). [2025-10-08T20:11:46.099846] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-08T20:11:46.422800] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-08T20:11:46.527313] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-08T20:11:46.527390] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-08T20:11:46.527506] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-08T20:11:46.527542] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-08T20:11:46.527955] [DEBUG] [LOCAL ] MITP: Trimmed 3321 records to 2361 (keeping 200 days of data) [2025-10-08T20:11:46.541553] [DEBUG] [LOCAL ] MITP: Primary data saved (2361 records). [2025-10-08T20:11:46.541612] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-08T20:11:46.541705] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MITP took 39.1s. Estimated remaining: 2h 21m 32s. Rate: 7.1 symbols/min [2025-10-08T20:11:46.714880] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:46.744703] [DEBUG] [LOCAL ] MLM: Loaded 29541 existing records from primary storage. [2025-10-08T20:11:46.744995] [INFO ] [MAIN ] MLM: Loaded 29541 existing records. [2025-10-08T20:11:46.919184] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:46.919446] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-08T20:11:46.919506] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-08T20:11:46.920277] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-08T20:11:46.920338] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-08T20:11:47.232154] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-08T20:11:47.272830] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:11:48.017569] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-08T20:11:48.095123] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:11:48.727623] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T20:11:48.817498] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-08T20:11:49.617508] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-10-08T20:11:49.878750] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T20:11:49.915275] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:11:50.417571] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-08T20:11:50.611443] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T20:11:51.217542] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-08T20:11:51.943110] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T20:11:52.017521] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-08T20:11:52.526296] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T20:11:52.817577] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-08T20:11:53.596139] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T20:11:53.617497] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-08T20:11:53.828949] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T20:11:54.417521] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-08T20:11:55.217599] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-08T20:11:55.245319] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T20:11:55.763311] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T20:11:56.017561] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-08T20:11:56.678292] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T20:11:56.817514] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-08T20:11:57.053920] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T20:11:57.617548] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-08T20:11:58.417510] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-08T20:11:58.574112] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T20:11:58.578049] [INFO ] [REMOTE ] MKC: Full fetch complete (75664 records). [2025-10-08T20:11:58.578160] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-08T20:11:58.989452] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-08T20:11:58.989560] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-08T20:11:58.990549] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-08T20:11:58.990613] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-08T20:11:58.992077] [DEBUG] [LOCAL ] MKC: Trimmed 75664 records to 52525 (keeping 200 days of data) [2025-10-08T20:11:59.220055] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-08T20:11:59.328125] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T20:11:59.359360] [DEBUG] [LOCAL ] MKC: Primary data saved (52525 records). [2025-10-08T20:11:59.359702] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-08T20:11:59.359846] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MKC took 34.3s. Estimated remaining: 2h 21m 27s. Rate: 7.1 symbols/min [2025-10-08T20:11:59.536627] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:11:59.563874] [DEBUG] [LOCAL ] MLNK: Loaded 25703 existing records from primary storage. [2025-10-08T20:11:59.564156] [INFO ] [MAIN ] MLNK: Loaded 25703 existing records. [2025-10-08T20:11:59.747591] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:11:59.747928] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-08T20:11:59.748038] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-08T20:11:59.748460] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-08T20:11:59.748563] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-08T20:12:00.019517] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-08T20:12:00.086638] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T20:12:00.172488] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:00.691517] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T20:12:00.817519] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-08T20:12:01.617578] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-10-08T20:12:01.747521] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T20:12:01.952361] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T20:12:02.417572] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-08T20:12:02.795140] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T20:12:03.217616] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-08T20:12:03.952970] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T20:12:04.017515] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-08T20:12:04.751146] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T20:12:04.817533] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-08T20:12:05.445209] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T20:12:05.617577] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-08T20:12:05.930099] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T20:12:06.417575] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-08T20:12:07.041920] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T20:12:07.217620] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-08T20:12:07.984860] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T20:12:07.987754] [INFO ] [REMOTE ] MKL: Full fetch complete (49731 records). [2025-10-08T20:12:07.987850] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-08T20:12:08.019581] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-08T20:12:08.374701] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-08T20:12:08.374864] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-08T20:12:08.375750] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-08T20:12:08.375835] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-08T20:12:08.376902] [DEBUG] [LOCAL ] MKL: Trimmed 49731 records to 34148 (keeping 200 days of data) [2025-10-08T20:12:08.516447] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T20:12:08.621341] [DEBUG] [LOCAL ] MKL: Primary data saved (34148 records). [2025-10-08T20:12:08.621483] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-08T20:12:08.621598] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKL took 42.3s. Estimated remaining: 2h 21m 19s. Rate: 7.1 symbols/min [2025-10-08T20:12:08.791250] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:08.797247] [DEBUG] [LOCAL ] MLP: Loaded 3010 existing records from primary storage. [2025-10-08T20:12:08.797434] [INFO ] [MAIN ] MLP: Loaded 3010 existing records. [2025-10-08T20:12:08.827704] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-08T20:12:08.976868] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:08.977088] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-08T20:12:08.977133] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-08T20:12:08.977285] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-08T20:12:08.977341] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-08T20:12:09.130100] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:12:09.377586] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:09.617546] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-08T20:12:10.270570] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T20:12:10.417627] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-08T20:12:10.764712] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T20:12:11.217538] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-08T20:12:11.249979] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T20:12:12.017567] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-08T20:12:12.565789] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T20:12:12.817569] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-08T20:12:12.920449] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:12:13.617555] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-08T20:12:14.029896] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T20:12:14.033098] [INFO ] [REMOTE ] MLI: Full fetch complete (63206 records). [2025-10-08T20:12:14.033190] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-08T20:12:14.427691] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-10-08T20:12:14.449213] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-08T20:12:14.449307] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-08T20:12:14.450566] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-08T20:12:14.450792] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-08T20:12:14.452465] [DEBUG] [LOCAL ] MLI: Trimmed 63206 records to 43470 (keeping 200 days of data) [2025-10-08T20:12:14.703033] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T20:12:14.756290] [DEBUG] [LOCAL ] MLI: Primary data saved (43470 records). [2025-10-08T20:12:14.756430] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-08T20:12:14.757392] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MLI took 34.1s. Estimated remaining: 2h 21m 9s. Rate: 7.1 symbols/min [2025-10-08T20:12:14.936952] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:14.951736] [DEBUG] [LOCAL ] MLR: Loaded 12353 existing records from primary storage. [2025-10-08T20:12:14.951984] [INFO ] [MAIN ] MLR: Loaded 12353 existing records. [2025-10-08T20:12:15.138503] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:15.139136] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-08T20:12:15.144938] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-08T20:12:15.146149] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T20:12:15.146240] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-08T20:12:15.146553] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-08T20:12:15.222963] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-08T20:12:15.543729] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:16.017564] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-10-08T20:12:16.615479] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T20:12:16.817536] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-08T20:12:16.873826] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T20:12:17.314480] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T20:12:17.617566] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-08T20:12:18.417551] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-08T20:12:18.792453] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T20:12:19.217579] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-08T20:12:19.547776] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T20:12:19.817265] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T20:12:20.017551] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-08T20:12:20.817574] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-08T20:12:21.142571] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T20:12:21.444059] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-08T20:12:21.617543] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-08T20:12:22.417558] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-08T20:12:22.630031] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T20:12:23.217616] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-08T20:12:23.468437] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T20:12:24.017523] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-08T20:12:24.365995] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T20:12:24.504566] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T20:12:24.817604] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-08T20:12:25.617599] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-08T20:12:26.107416] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T20:12:26.120059] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T20:12:26.417587] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-08T20:12:27.217557] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-08T20:12:27.574081] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T20:12:27.576867] [INFO ] [REMOTE ] MLNK: Full fetch complete (36266 records). [2025-10-08T20:12:27.576974] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-08T20:12:27.966814] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-08T20:12:27.966906] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-08T20:12:27.967670] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-08T20:12:27.967737] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-08T20:12:27.968771] [DEBUG] [LOCAL ] MLNK: Trimmed 36266 records to 25802 (keeping 200 days of data) [2025-10-08T20:12:28.023077] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-08T20:12:28.151849] [DEBUG] [LOCAL ] MLNK: Primary data saved (25802 records). [2025-10-08T20:12:28.152024] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-08T20:12:28.152116] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLNK took 28.8s. Estimated remaining: 2h 21m 4s. Rate: 7.1 symbols/min [2025-10-08T20:12:28.333727] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:28.333972] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T20:12:28.336694] [INFO ] [REMOTE ] MLM: Full fetch complete (45275 records). [2025-10-08T20:12:28.336814] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-08T20:12:28.519471] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T20:12:28.756669] [DEBUG] [LOCAL ] MMC: Loaded 51858 existing records from primary storage. [2025-10-08T20:12:28.757100] [INFO ] [MAIN ] MMC: Loaded 51858 existing records. [2025-10-08T20:12:28.755782] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-08T20:12:28.799672] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-08T20:12:28.821614] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-08T20:12:28.821766] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-08T20:12:28.849620] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-08T20:12:28.920858] [DEBUG] [LOCAL ] MLM: Trimmed 45275 records to 29400 (keeping 200 days of data) [2025-10-08T20:12:28.943577] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:28.944150] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-08T20:12:28.944204] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-08T20:12:28.944555] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-08T20:12:28.944611] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-08T20:12:29.453727] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:29.516569] [DEBUG] [LOCAL ] MLM: Primary data saved (29400 records). [2025-10-08T20:12:29.516721] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-08T20:12:29.516811] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLM took 43.0s. Estimated remaining: 2h 20m 51s. Rate: 7.1 symbols/min [2025-10-08T20:12:29.617503] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-10-08T20:12:29.695862] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:29.708616] [DEBUG] [LOCAL ] MMD: Loaded 11209 existing records from primary storage. [2025-10-08T20:12:29.708920] [INFO ] [MAIN ] MMD: Loaded 11209 existing records. [2025-10-08T20:12:29.890878] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:29.899790] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-08T20:12:29.900559] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T20:12:29.900275] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-08T20:12:29.904459] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-08T20:12:29.904522] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-08T20:12:30.261761] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:30.417558] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-10-08T20:12:31.173831] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T20:12:31.217540] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-08T20:12:31.428621] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T20:12:32.017577] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-08T20:12:32.580775] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T20:12:32.817541] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-08T20:12:33.009011] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T20:12:33.617521] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-08T20:12:33.702980] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T20:12:34.417580] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-08T20:12:35.198287] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T20:12:35.217491] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-08T20:12:35.281928] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T20:12:36.017554] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-08T20:12:36.772387] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T20:12:36.817512] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-08T20:12:36.961719] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T20:12:37.617553] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-08T20:12:38.092997] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T20:12:38.417533] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-08T20:12:38.637608] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T20:12:38.899119] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T20:12:39.217565] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-08T20:12:40.017614] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-08T20:12:40.577876] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T20:12:40.817540] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-08T20:12:40.946793] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T20:12:41.617550] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-08T20:12:41.720399] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:12:42.417566] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-08T20:12:43.008249] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T20:12:43.174788] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T20:12:43.217520] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-08T20:12:44.017562] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-08T20:12:44.151433] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:12:44.539359] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-08T20:12:44.817555] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-08T20:12:45.617514] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-08T20:12:45.774511] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T20:12:46.171544] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T20:12:46.417568] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-08T20:12:46.919749] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T20:12:47.217571] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-08T20:12:48.017532] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-08T20:12:48.084951] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T20:12:48.086516] [INFO ] [REMOTE ] MLR: Full fetch complete (18830 records). [2025-10-08T20:12:48.086598] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-08T20:12:48.457095] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-08T20:12:48.457183] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-08T20:12:48.457615] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-08T20:12:48.457725] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-08T20:12:48.458434] [DEBUG] [LOCAL ] MLR: Trimmed 18830 records to 12370 (keeping 200 days of data) [2025-10-08T20:12:48.545401] [DEBUG] [LOCAL ] MLR: Primary data saved (12370 records). [2025-10-08T20:12:48.545555] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-08T20:12:48.545668] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLR took 33.8s. Estimated remaining: 2h 20m 50s. Rate: 7.1 symbols/min [2025-10-08T20:12:48.630490] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T20:12:48.766669] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:48.783936] [DEBUG] [LOCAL ] MMI: Loaded 15268 existing records from primary storage. [2025-10-08T20:12:48.784204] [INFO ] [MAIN ] MMI: Loaded 15268 existing records. [2025-10-08T20:12:48.822680] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-08T20:12:48.962336] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:48.962587] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-08T20:12:48.962634] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-08T20:12:48.962894] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-08T20:12:48.962952] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-08T20:12:49.329917] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:49.469005] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:12:49.469893] [INFO ] [REMOTE ] MLP: Full fetch complete (4499 records). [2025-10-08T20:12:49.469966] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-08T20:12:49.631621] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-08T20:12:49.833551] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-08T20:12:49.833631] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-08T20:12:49.833824] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-08T20:12:49.833870] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-08T20:12:49.834234] [DEBUG] [LOCAL ] MLP: Trimmed 4499 records to 3000 (keeping 200 days of data) [2025-10-08T20:12:49.851778] [DEBUG] [LOCAL ] MLP: Primary data saved (3000 records). [2025-10-08T20:12:49.851868] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-08T20:12:49.851946] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLP took 41.2s. Estimated remaining: 2h 20m 36s. Rate: 7.1 symbols/min [2025-10-08T20:12:50.020368] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:50.020615] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-08T20:12:50.020692] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-08T20:12:50.020872] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-08T20:12:50.020915] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-08T20:12:50.021003] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-08T20:12:50.021052] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-08T20:12:50.394964] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:50.417502] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-10-08T20:12:50.620899] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:12:50.621232] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-10-08T20:12:50.621321] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:12:50.621373] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-08T20:12:50.621406] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:12:50.621444] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-08T20:12:50.621499] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-08T20:12:50.621535] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-08T20:12:50.621573] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-08T20:12:50.621619] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MMID took 0.8s. Estimated remaining: 2h 20m 22s. Rate: 7.1 symbols/min [2025-10-08T20:12:50.790456] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:50.790696] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-08T20:12:50.790752] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-08T20:12:50.790863] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-08T20:12:50.790903] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-08T20:12:50.790943] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-08T20:12:50.790976] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-08T20:12:51.156194] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:51.217523] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-08T20:12:51.594150] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T20:12:51.937851] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:12:52.017556] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-10-08T20:12:52.787833] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T20:12:52.817507] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-08T20:12:53.453978] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:12:53.617553] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-08T20:12:54.417581] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-08T20:12:55.217584] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-10-08T20:12:55.272755] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T20:12:55.437679] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T20:12:55.482101] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-10-08T20:12:56.017565] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-08T20:12:56.795973] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T20:12:56.817498] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-08T20:12:57.527259] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:12:57.528567] [INFO ] [REMOTE ] MMD: Full fetch complete (17695 records). [2025-10-08T20:12:57.528637] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-08T20:12:57.624206] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-08T20:12:57.910280] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-08T20:12:57.910363] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-08T20:12:57.910815] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-08T20:12:57.910879] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-08T20:12:57.911484] [DEBUG] [LOCAL ] MMD: Trimmed 17695 records to 11207 (keeping 200 days of data) [2025-10-08T20:12:57.990572] [DEBUG] [LOCAL ] MMD: Primary data saved (11207 records). [2025-10-08T20:12:57.991027] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-08T20:12:57.991147] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMD took 28.5s. Estimated remaining: 2h 20m 13s. Rate: 7.1 symbols/min [2025-10-08T20:12:58.193180] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T20:12:58.197660] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:12:58.265728] [DEBUG] [LOCAL ] MMM: Loaded 53140 existing records from primary storage. [2025-10-08T20:12:58.266196] [INFO ] [MAIN ] MMM: Loaded 53140 existing records. [2025-10-08T20:12:58.422827] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-08T20:12:58.504364] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:12:58.505448] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-08T20:12:58.505539] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-08T20:12:58.506584] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-08T20:12:58.506697] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-08T20:12:58.879555] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T20:12:59.011831] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:12:59.217601] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-10-08T20:13:00.017564] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-08T20:13:00.502982] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T20:13:00.817528] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-08T20:13:01.176050] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T20:13:01.224232] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T20:13:01.617583] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-08T20:13:02.417571] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-08T20:13:02.617089] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T20:13:02.698944] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-08T20:13:03.217531] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-08T20:13:04.017534] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-08T20:13:04.324900] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-08T20:13:04.817580] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-08T20:13:05.011853] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T20:13:05.145202] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T20:13:05.617550] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-08T20:13:06.417545] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-08T20:13:07.217563] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-08T20:13:07.518166] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T20:13:07.660838] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T20:13:08.017601] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-08T20:13:08.166807] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T20:13:08.326734] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T20:13:08.817607] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-08T20:13:09.326708] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:13:09.327475] [INFO ] [REMOTE ] MMKT: Full fetch complete (2127 records). [2025-10-08T20:13:09.327547] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-08T20:13:09.506296] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T20:13:09.506516] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:13:09.506590] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:13:09.506682] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-08T20:13:09.506758] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-08T20:13:09.506794] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-08T20:13:09.506833] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-08T20:13:09.506891] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMKT took 18.9s. Estimated remaining: 2h 20m 7s. Rate: 7.1 symbols/min [2025-10-08T20:13:09.622802] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-08T20:13:09.684791] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:09.722511] [DEBUG] [LOCAL ] MMS: Loaded 34006 existing records from primary storage. [2025-10-08T20:13:09.722839] [INFO ] [MAIN ] MMS: Loaded 34006 existing records. [2025-10-08T20:13:09.905361] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:13:09.905578] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-08T20:13:09.905667] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-08T20:13:09.905984] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-08T20:13:09.906045] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-08T20:13:10.270373] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:10.417559] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-08T20:13:11.217616] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-08T20:13:11.343302] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T20:13:11.805306] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-08T20:13:11.810572] [INFO ] [REMOTE ] MMC: Full fetch complete (74767 records). [2025-10-08T20:13:11.810773] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-08T20:13:12.024304] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-10-08T20:13:12.214082] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-08T20:13:12.214171] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-08T20:13:12.215207] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-08T20:13:12.215272] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-08T20:13:12.216857] [DEBUG] [LOCAL ] MMC: Trimmed 74767 records to 51871 (keeping 200 days of data) [2025-10-08T20:13:12.550116] [DEBUG] [LOCAL ] MMC: Primary data saved (51871 records). [2025-10-08T20:13:12.550266] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-08T20:13:12.551919] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMC took 44.4s. Estimated remaining: 2h 19m 54s. Rate: 7.1 symbols/min [2025-10-08T20:13:12.721363] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:12.739880] [DEBUG] [LOCAL ] MMT: Loaded 10518 existing records from primary storage. [2025-10-08T20:13:12.740158] [INFO ] [MAIN ] MMT: Loaded 10518 existing records. [2025-10-08T20:13:12.820103] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-08T20:13:12.923067] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:13:12.923248] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-08T20:13:12.923312] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-08T20:13:12.923483] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-08T20:13:12.923541] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-08T20:13:13.288628] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:13.324427] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-08T20:13:13.622037] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-08T20:13:13.637501] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:13:13.936941] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T20:13:14.417559] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-08T20:13:15.217543] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-10-08T20:13:15.434431] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T20:13:15.432629] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T20:13:16.019407] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-08T20:13:16.022910] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T20:13:16.817583] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-08T20:13:17.617566] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-08T20:13:17.876510] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T20:13:18.417590] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-08T20:13:18.556722] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T20:13:18.652730] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T20:13:18.936616] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T20:13:19.217682] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-08T20:13:20.017566] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-08T20:13:20.817593] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-08T20:13:21.124852] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T20:13:21.522380] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T20:13:21.598869] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T20:13:21.617508] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-08T20:13:22.251115] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T20:13:22.417565] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-08T20:13:23.217616] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-08T20:13:24.017537] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-08T20:13:24.503135] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T20:13:24.551806] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T20:13:24.648295] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-08T20:13:24.817569] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-08T20:13:25.617599] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-08T20:13:26.242576] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T20:13:26.266202] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T20:13:26.417527] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-08T20:13:27.217533] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-08T20:13:27.521744] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:13:28.017586] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-08T20:13:28.124633] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T20:13:28.817636] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-08T20:13:29.617526] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-08T20:13:29.746546] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:13:29.872073] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T20:13:30.153773] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T20:13:30.417545] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-08T20:13:31.217579] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-08T20:13:31.385924] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T20:13:32.017599] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-08T20:13:32.247297] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T20:13:32.817589] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-08T20:13:33.568072] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T20:13:33.623823] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-08T20:13:33.626573] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T20:13:34.417589] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-08T20:13:35.213101] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T20:13:35.217726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-08T20:13:35.217540] [INFO ] [REMOTE ] MMM: Full fetch complete (77058 records). [2025-10-08T20:13:35.218296] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-08T20:13:35.752091] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-08T20:13:35.752407] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-08T20:13:35.753748] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-08T20:13:35.753836] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-08T20:13:35.778638] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T20:13:35.786397] [DEBUG] [LOCAL ] MMM: Trimmed 77058 records to 53127 (keeping 200 days of data) [2025-10-08T20:13:35.918895] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:13:36.025061] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-08T20:13:36.189946] [DEBUG] [LOCAL ] MMM: Primary data saved (53127 records). [2025-10-08T20:13:36.190130] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-08T20:13:36.190223] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMM took 38.2s. Estimated remaining: 2h 19m 57s. Rate: 7.1 symbols/min [2025-10-08T20:13:36.376182] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:36.394887] [DEBUG] [LOCAL ] MMU: Loaded 16773 existing records from primary storage. [2025-10-08T20:13:36.395170] [INFO ] [MAIN ] MMU: Loaded 16773 existing records. [2025-10-08T20:13:36.592233] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:13:36.592481] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-08T20:13:36.592530] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-08T20:13:36.592784] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-08T20:13:36.592841] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-08T20:13:36.826298] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-08T20:13:37.028431] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:37.535826] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T20:13:37.584519] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T20:13:37.617495] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-08T20:13:38.216231] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:13:38.217370] [INFO ] [REMOTE ] MMT: Full fetch complete (15927 records). [2025-10-08T20:13:38.217460] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-08T20:13:38.424813] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-08T20:13:38.597637] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-08T20:13:38.597748] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-08T20:13:38.598094] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-08T20:13:38.598139] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-08T20:13:38.598707] [DEBUG] [LOCAL ] MMT: Trimmed 15927 records to 10386 (keeping 200 days of data) [2025-10-08T20:13:38.660982] [DEBUG] [LOCAL ] MMT: Primary data saved (10386 records). [2025-10-08T20:13:38.661115] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-08T20:13:38.661200] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMT took 26.1s. Estimated remaining: 2h 19m 44s. Rate: 7.1 symbols/min [2025-10-08T20:13:38.839604] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:38.868004] [DEBUG] [LOCAL ] MNR: Loaded 24441 existing records from primary storage. [2025-10-08T20:13:38.868303] [INFO ] [MAIN ] MNR: Loaded 24441 existing records. [2025-10-08T20:13:39.049590] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:13:39.049852] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-08T20:13:39.049907] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-08T20:13:39.050146] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-08T20:13:39.050201] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-08T20:13:39.223013] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-08T20:13:39.416670] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T20:13:39.420767] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:39.423836] [INFO ] [REMOTE ] MMI: Full fetch complete (21387 records). [2025-10-08T20:13:39.423949] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-08T20:13:39.793943] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-08T20:13:39.794046] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-08T20:13:39.794526] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-08T20:13:39.794566] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-08T20:13:39.795369] [DEBUG] [LOCAL ] MMI: Trimmed 21387 records to 15200 (keeping 200 days of data) [2025-10-08T20:13:39.897000] [DEBUG] [LOCAL ] MMI: Primary data saved (15200 records). [2025-10-08T20:13:39.897162] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-08T20:13:39.897269] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMI took 51.4s. Estimated remaining: 2h 19m 31s. Rate: 7.1 symbols/min [2025-10-08T20:13:40.022793] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-10-08T20:13:40.084058] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:40.146247] [DEBUG] [LOCAL ] MNSO: Loaded 44345 existing records from primary storage. [2025-10-08T20:13:40.146681] [INFO ] [MAIN ] MNSO: Loaded 44345 existing records. [2025-10-08T20:13:40.346104] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:13:40.346524] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-08T20:13:40.346587] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-08T20:13:40.346943] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-08T20:13:40.347002] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-08T20:13:40.658863] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T20:13:40.748893] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:40.817507] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-10-08T20:13:40.932090] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T20:13:41.617560] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-08T20:13:42.417560] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-10-08T20:13:42.499609] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-08T20:13:42.539856] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T20:13:43.217515] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-08T20:13:43.300834] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T20:13:44.017583] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-08T20:13:44.183175] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T20:13:44.817524] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-08T20:13:45.103150] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T20:13:45.617568] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-08T20:13:46.341475] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T20:13:46.355059] [INFO ] [REMOTE ] MMS: Full fetch complete (51760 records). [2025-10-08T20:13:46.358004] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T20:13:46.357369] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-08T20:13:46.422629] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-08T20:13:46.766454] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-08T20:13:46.766554] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-08T20:13:46.767420] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-08T20:13:46.767486] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-08T20:13:46.768981] [DEBUG] [LOCAL ] MMS: Trimmed 51760 records to 33877 (keeping 200 days of data) [2025-10-08T20:13:46.995326] [DEBUG] [LOCAL ] MMS: Primary data saved (33877 records). [2025-10-08T20:13:46.995493] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-08T20:13:46.995587] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMS took 37.5s. Estimated remaining: 2h 19m 21s. Rate: 7.1 symbols/min [2025-10-08T20:13:47.211231] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:47.211509] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-08T20:13:47.211566] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-08T20:13:47.211721] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-08T20:13:47.211782] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-08T20:13:47.211851] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-08T20:13:47.211907] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-08T20:13:47.225855] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-08T20:13:47.598146] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:48.017579] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-08T20:13:48.126282] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T20:13:48.686246] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T20:13:48.817523] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-08T20:13:48.862886] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T20:13:49.617524] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-08T20:13:49.702564] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T20:13:50.254557] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T20:13:50.417608] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-08T20:13:51.217628] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-10-08T20:13:51.408949] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:13:51.409515] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-10-08T20:13:51.409684] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:13:51.409773] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-08T20:13:51.409846] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:13:51.409942] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-08T20:13:51.410027] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-08T20:13:51.410068] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-08T20:13:51.410128] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-08T20:13:51.410207] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNTN took 4.4s. Estimated remaining: 2h 19m 10s. Rate: 7.1 symbols/min [2025-10-08T20:13:51.627525] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:13:51.628052] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-08T20:13:51.628132] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-08T20:13:51.628277] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-08T20:13:51.628331] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-08T20:13:51.628375] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-08T20:13:51.628408] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-08T20:13:52.035335] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-08T20:13:52.040468] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:13:52.072087] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T20:13:52.779775] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T20:13:52.817580] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-10-08T20:13:53.617573] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-08T20:13:54.417562] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-08T20:13:54.527408] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T20:13:54.771023] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T20:13:55.188950] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T20:13:55.217525] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-08T20:13:56.017573] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-08T20:13:56.817584] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-08T20:13:56.955291] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T20:13:57.617566] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-08T20:13:57.854232] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T20:13:57.968084] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T20:13:58.417606] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-08T20:13:58.943379] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T20:13:59.217695] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-08T20:13:59.957450] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T20:14:00.017713] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-08T20:14:00.164375] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T20:14:00.817530] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-08T20:14:00.946916] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T20:14:01.617568] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-08T20:14:02.417554] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-08T20:14:02.580265] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T20:14:03.217561] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-08T20:14:03.473117] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T20:14:03.840932] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-08T20:14:04.017555] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-08T20:14:04.562787] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T20:14:04.817565] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-08T20:14:04.909369] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T20:14:05.617578] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-08T20:14:06.145426] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T20:14:06.417554] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-08T20:14:06.554945] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T20:14:06.557002] [INFO ] [REMOTE ] MMU: Full fetch complete (25384 records). [2025-10-08T20:14:06.557092] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-08T20:14:06.948256] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-08T20:14:06.948343] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-08T20:14:06.949256] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-08T20:14:06.949322] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-08T20:14:06.950033] [DEBUG] [LOCAL ] MMU: Trimmed 25384 records to 16804 (keeping 200 days of data) [2025-10-08T20:14:07.054684] [DEBUG] [LOCAL ] MMU: Primary data saved (16804 records). [2025-10-08T20:14:07.054857] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-08T20:14:07.055001] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMU took 30.9s. Estimated remaining: 2h 19m 7s. Rate: 7.1 symbols/min [2025-10-08T20:14:07.223377] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-08T20:14:07.227749] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:07.275799] [DEBUG] [LOCAL ] MOD: Loaded 45030 existing records from primary storage. [2025-10-08T20:14:07.276129] [INFO ] [MAIN ] MOD: Loaded 45030 existing records. [2025-10-08T20:14:07.463310] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:07.463575] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-08T20:14:07.463639] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-08T20:14:07.464064] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-08T20:14:07.464123] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-08T20:14:07.838370] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:07.973930] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T20:14:08.017515] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-08T20:14:08.817564] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-10-08T20:14:09.313962] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T20:14:09.491705] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T20:14:09.617559] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-08T20:14:10.348010] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:14:10.417544] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-08T20:14:11.136377] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T20:14:11.140067] [INFO ] [REMOTE ] MNSO: Full fetch complete (64280 records). [2025-10-08T20:14:11.140209] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-08T20:14:11.222732] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-08T20:14:11.527975] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-08T20:14:11.528072] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-08T20:14:11.529106] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-08T20:14:11.529208] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-08T20:14:11.530685] [DEBUG] [LOCAL ] MNSO: Trimmed 64280 records to 44259 (keeping 200 days of data) [2025-10-08T20:14:11.811593] [DEBUG] [LOCAL ] MNSO: Primary data saved (44259 records). [2025-10-08T20:14:11.811751] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-08T20:14:11.813025] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNSO took 31.9s. Estimated remaining: 2h 18m 56s. Rate: 7.1 symbols/min [2025-10-08T20:14:11.989831] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:12.024226] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-08T20:14:12.047621] [DEBUG] [LOCAL ] MODG: Loaded 51559 existing records from primary storage. [2025-10-08T20:14:12.047989] [INFO ] [MAIN ] MODG: Loaded 51559 existing records. [2025-10-08T20:14:12.247460] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:12.247851] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-08T20:14:12.247927] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-08T20:14:12.248360] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-08T20:14:12.248425] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-08T20:14:12.632577] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:12.741881] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T20:14:12.817587] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-10-08T20:14:12.864624] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T20:14:13.092954] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T20:14:13.617602] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-08T20:14:14.419891] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-08T20:14:14.422663] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:14:15.217587] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-08T20:14:15.575887] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T20:14:15.781977] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-08T20:14:16.017588] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-08T20:14:16.751708] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T20:14:16.817531] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-08T20:14:17.617599] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-08T20:14:18.142666] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T20:14:18.417585] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-08T20:14:18.747263] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T20:14:19.217522] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-08T20:14:19.318523] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T20:14:20.017566] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-08T20:14:20.306723] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T20:14:20.602862] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T20:14:20.809584] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:14:20.811724] [INFO ] [REMOTE ] MNR: Full fetch complete (36584 records). [2025-10-08T20:14:20.812153] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-08T20:14:20.825717] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-08T20:14:21.248878] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-08T20:14:21.249010] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-08T20:14:21.250120] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-08T20:14:21.250186] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-08T20:14:21.251436] [DEBUG] [LOCAL ] MNR: Trimmed 36584 records to 24555 (keeping 200 days of data) [2025-10-08T20:14:21.425540] [DEBUG] [LOCAL ] MNR: Primary data saved (24555 records). [2025-10-08T20:14:21.425772] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-08T20:14:21.425911] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MNR took 42.8s. Estimated remaining: 2h 18m 48s. Rate: 7.1 symbols/min [2025-10-08T20:14:21.617599] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:21.617813] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-08T20:14:21.672202] [DEBUG] [LOCAL ] MOH: Loaded 42038 existing records from primary storage. [2025-10-08T20:14:21.672712] [INFO ] [MAIN ] MOH: Loaded 42038 existing records. [2025-10-08T20:14:21.881980] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:21.882307] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-08T20:14:21.882360] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-08T20:14:21.882790] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-08T20:14:21.882851] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-08T20:14:22.270716] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:22.408618] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T20:14:22.418423] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-08T20:14:22.863776] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T20:14:23.217552] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-10-08T20:14:24.017613] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-08T20:14:24.336897] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T20:14:24.398195] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T20:14:24.817617] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-08T20:14:25.617550] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-08T20:14:25.773340] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T20:14:26.276066] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T20:14:26.417538] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-08T20:14:27.013086] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T20:14:27.217553] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-08T20:14:28.017568] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-08T20:14:28.070440] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T20:14:28.688775] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:14:28.817553] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-08T20:14:29.617568] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-08T20:14:29.774151] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-08T20:14:29.778935] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-10-08T20:14:29.779140] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-08T20:14:30.021668] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T20:14:30.022606] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:14:30.022832] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:14:30.022917] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-08T20:14:30.023111] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-08T20:14:30.023194] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-08T20:14:30.023276] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-08T20:14:30.023380] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MO took 38.6s. Estimated remaining: 2h 18m 40s. Rate: 7.1 symbols/min [2025-10-08T20:14:30.199072] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:30.221299] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T20:14:30.277691] [DEBUG] [LOCAL ] MOS: Loaded 53501 existing records from primary storage. [2025-10-08T20:14:30.278077] [INFO ] [MAIN ] MOS: Loaded 53501 existing records. [2025-10-08T20:14:30.425085] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-08T20:14:30.455710] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:30.456935] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-08T20:14:30.456987] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-08T20:14:30.457566] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-08T20:14:30.457756] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-08T20:14:30.807169] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:31.217545] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-10-08T20:14:31.400707] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T20:14:32.017575] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-08T20:14:32.204006] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T20:14:32.715942] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T20:14:32.817597] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-08T20:14:33.418132] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T20:14:33.617566] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-08T20:14:34.417525] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-08T20:14:34.912104] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T20:14:35.217515] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-08T20:14:35.350933] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T20:14:35.772749] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T20:14:36.017536] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-08T20:14:36.817521] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-08T20:14:36.924541] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T20:14:37.314983] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T20:14:37.617573] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-08T20:14:38.103867] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T20:14:38.417562] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-08T20:14:39.231520] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-08T20:14:39.265282] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T20:14:39.505196] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T20:14:40.017597] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-08T20:14:40.414466] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T20:14:40.817563] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-08T20:14:41.617603] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-08T20:14:41.886243] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T20:14:42.238749] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T20:14:42.417598] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-08T20:14:43.020125] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T20:14:43.024773] [INFO ] [REMOTE ] MODG: Full fetch complete (74791 records). [2025-10-08T20:14:43.024928] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-08T20:14:43.229179] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-08T20:14:43.444916] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-08T20:14:43.445018] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-08T20:14:43.446124] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-08T20:14:43.446200] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-08T20:14:43.447796] [DEBUG] [LOCAL ] MODG: Trimmed 74791 records to 51570 (keeping 200 days of data) [2025-10-08T20:14:43.756563] [DEBUG] [LOCAL ] MODG: Primary data saved (51570 records). [2025-10-08T20:14:43.756732] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-08T20:14:43.757479] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 31.9s. Estimated remaining: 2h 18m 35s. Rate: 7.1 symbols/min [2025-10-08T20:14:43.928428] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:43.951670] [DEBUG] [LOCAL ] MOV: Loaded 21858 existing records from primary storage. [2025-10-08T20:14:43.951942] [INFO ] [MAIN ] MOV: Loaded 21858 existing records. [2025-10-08T20:14:44.027583] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-08T20:14:44.144294] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-08T20:14:44.148738] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:44.151912] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-08T20:14:44.151970] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-08T20:14:44.152149] [INFO ] [REMOTE ] MOD: Full fetch complete (66215 records). [2025-10-08T20:14:44.152229] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-08T20:14:44.152262] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-08T20:14:44.152347] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-08T20:14:44.842811] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:44.870885] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-10-08T20:14:44.922155] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-08T20:14:44.922293] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-08T20:14:44.923337] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-08T20:14:44.923456] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-08T20:14:44.925857] [DEBUG] [LOCAL ] MOD: Trimmed 66215 records to 44995 (keeping 200 days of data) [2025-10-08T20:14:45.082556] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T20:14:45.246133] [DEBUG] [LOCAL ] MOD: Primary data saved (44995 records). [2025-10-08T20:14:45.246267] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-08T20:14:45.246352] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MOD took 38.2s. Estimated remaining: 2h 18m 22s. Rate: 7.1 symbols/min [2025-10-08T20:14:45.425033] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:45.443819] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T20:14:45.502100] [DEBUG] [LOCAL ] MP: Loaded 53690 existing records from primary storage. [2025-10-08T20:14:45.502452] [INFO ] [MAIN ] MP: Loaded 53690 existing records. [2025-10-08T20:14:45.617698] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-08T20:14:45.685614] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:45.685943] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-08T20:14:45.686024] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-08T20:14:45.686748] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-08T20:14:45.698065] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-08T20:14:45.720676] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T20:14:46.054703] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:46.417551] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-08T20:14:47.176139] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T20:14:47.217502] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-08T20:14:47.446556] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T20:14:48.017550] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-08T20:14:48.817528] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-10-08T20:14:49.145206] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T20:14:49.617550] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-08T20:14:49.984757] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T20:14:50.417516] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-08T20:14:50.706694] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T20:14:51.217560] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-08T20:14:51.385861] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T20:14:52.017608] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-08T20:14:52.347793] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T20:14:52.757281] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T20:14:52.817507] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-08T20:14:53.010416] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T20:14:53.617561] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-08T20:14:54.417517] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-08T20:14:54.496033] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T20:14:55.217720] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-08T20:14:55.541117] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T20:14:55.776936] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T20:14:56.017560] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-08T20:14:56.817540] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-08T20:14:57.282355] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-08T20:14:57.415381] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T20:14:57.419484] [INFO ] [REMOTE ] MOH: Full fetch complete (58663 records). [2025-10-08T20:14:57.419772] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-08T20:14:57.626045] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-08T20:14:57.771346] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:14:57.869531] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-08T20:14:57.869620] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-08T20:14:57.870568] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-08T20:14:57.870633] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-08T20:14:57.872110] [DEBUG] [LOCAL ] MOH: Trimmed 58663 records to 42118 (keeping 200 days of data) [2025-10-08T20:14:58.124326] [DEBUG] [LOCAL ] MOH: Primary data saved (42118 records). [2025-10-08T20:14:58.124457] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-08T20:14:58.124539] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOH took 36.7s. Estimated remaining: 2h 18m 16s. Rate: 7.1 symbols/min [2025-10-08T20:14:58.290270] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:14:58.297941] [DEBUG] [LOCAL ] MPA: Loaded 5335 existing records from primary storage. [2025-10-08T20:14:58.298158] [INFO ] [MAIN ] MPA: Loaded 5335 existing records. [2025-10-08T20:14:58.422784] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-08T20:14:58.474370] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:14:58.474767] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-08T20:14:58.474835] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-08T20:14:58.475037] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-08T20:14:58.475095] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-08T20:14:58.881544] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:14:59.217588] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-10-08T20:14:59.427079] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-08T20:14:59.432161] [INFO ] [REMOTE ] MOS: Full fetch complete (77455 records). [2025-10-08T20:14:59.432334] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-08T20:14:59.796768] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T20:14:59.966990] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T20:15:00.018402] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-08T20:15:00.111468] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-08T20:15:00.111615] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-08T20:15:00.113847] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-08T20:15:00.113978] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-08T20:15:00.116351] [DEBUG] [LOCAL ] MOS: Trimmed 77455 records to 53504 (keeping 200 days of data) [2025-10-08T20:15:00.531283] [DEBUG] [LOCAL ] MOS: Primary data saved (53504 records). [2025-10-08T20:15:00.531455] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-08T20:15:00.531559] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOS took 30.5s. Estimated remaining: 2h 18m 4s. Rate: 7.1 symbols/min [2025-10-08T20:15:00.701222] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:00.758563] [DEBUG] [LOCAL ] MPC: Loaded 52072 existing records from primary storage. [2025-10-08T20:15:00.758959] [INFO ] [MAIN ] MPC: Loaded 52072 existing records. [2025-10-08T20:15:00.822848] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-08T20:15:00.947079] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:15:00.947493] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-08T20:15:00.947571] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-08T20:15:00.948223] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-08T20:15:00.948302] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-08T20:15:01.045371] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:15:01.351994] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:01.617621] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-10-08T20:15:02.417595] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-08T20:15:02.956697] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T20:15:03.220697] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-08T20:15:03.237625] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-08T20:15:03.460469] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T20:15:04.017516] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-08T20:15:04.143865] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T20:15:04.817560] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-08T20:15:05.617575] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-08T20:15:05.850603] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T20:15:06.099960] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T20:15:06.207739] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-08T20:15:06.417549] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-08T20:15:07.217536] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-08T20:15:08.017624] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-08T20:15:08.817537] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-08T20:15:08.886729] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-08T20:15:08.958675] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:15:08.982418] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T20:15:09.164711] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T20:15:09.617575] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-08T20:15:10.417585] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-08T20:15:11.135485] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:15:11.217565] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-08T20:15:11.411542] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T20:15:11.638309] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T20:15:12.017562] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-08T20:15:12.817528] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-08T20:15:12.899525] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T20:15:13.479117] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T20:15:13.617571] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-08T20:15:14.417581] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-08T20:15:15.217587] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-08T20:15:15.846798] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T20:15:16.017520] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-08T20:15:16.289948] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-08T20:15:16.385805] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T20:15:16.748133] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:15:16.749933] [INFO ] [REMOTE ] MOV: Full fetch complete (30568 records). [2025-10-08T20:15:16.750033] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-08T20:15:16.822782] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-08T20:15:17.131693] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-08T20:15:17.131786] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-08T20:15:17.132443] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-08T20:15:17.132504] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-08T20:15:17.133377] [DEBUG] [LOCAL ] MOV: Trimmed 30568 records to 21793 (keeping 200 days of data) [2025-10-08T20:15:17.272236] [DEBUG] [LOCAL ] MOV: Primary data saved (21793 records). [2025-10-08T20:15:17.272366] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-08T20:15:17.272449] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MOV took 33.5s. Estimated remaining: 2h 18m 1s. Rate: 7.1 symbols/min [2025-10-08T20:15:17.439874] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:17.458634] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T20:15:17.499784] [DEBUG] [LOCAL ] MPLX: Loaded 50718 existing records from primary storage. [2025-10-08T20:15:17.500124] [INFO ] [MAIN ] MPLX: Loaded 50718 existing records. [2025-10-08T20:15:17.622766] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-08T20:15:17.700588] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:15:17.700833] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-08T20:15:17.700882] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-08T20:15:17.701855] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-08T20:15:17.702071] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-08T20:15:18.101427] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:18.417597] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-08T20:15:18.977084] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T20:15:19.217503] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-08T20:15:19.630677] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T20:15:19.831584] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:15:19.832819] [INFO ] [REMOTE ] MPA: Full fetch complete (7185 records). [2025-10-08T20:15:19.832894] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-08T20:15:20.022725] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-08T20:15:20.204096] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-08T20:15:20.204180] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-08T20:15:20.204391] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-08T20:15:20.204431] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-08T20:15:20.204936] [DEBUG] [LOCAL ] MPA: Trimmed 7185 records to 5322 (keeping 200 days of data) [2025-10-08T20:15:20.239479] [DEBUG] [LOCAL ] MPA: Primary data saved (5322 records). [2025-10-08T20:15:20.239633] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-08T20:15:20.239769] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MPA took 22.1s. Estimated remaining: 2h 17m 49s. Rate: 7.1 symbols/min [2025-10-08T20:15:20.408398] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:20.417813] [DEBUG] [LOCAL ] MPV: Loaded 4894 existing records from primary storage. [2025-10-08T20:15:20.418017] [INFO ] [MAIN ] MPV: Loaded 4894 existing records. [2025-10-08T20:15:20.599393] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:15:20.599619] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-08T20:15:20.599695] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-08T20:15:20.599872] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-08T20:15:20.599929] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-08T20:15:20.822830] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-10-08T20:15:20.959931] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:21.617564] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-10-08T20:15:21.891732] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T20:15:22.298129] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T20:15:22.302517] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T20:15:22.417603] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-08T20:15:23.217566] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-08T20:15:23.824110] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T20:15:24.017570] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-08T20:15:24.164608] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T20:15:24.593272] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T20:15:24.817562] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-08T20:15:25.617579] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-08T20:15:26.247298] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T20:15:26.417513] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-08T20:15:26.488289] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T20:15:27.217594] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-08T20:15:27.840404] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T20:15:28.017589] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-08T20:15:28.119124] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T20:15:28.626825] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T20:15:28.817554] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-08T20:15:29.617576] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-08T20:15:30.344319] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T20:15:30.417497] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-08T20:15:30.954527] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T20:15:31.217539] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-08T20:15:31.361960] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T20:15:31.802864] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T20:15:32.017528] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-08T20:15:32.666376] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T20:15:32.817563] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-08T20:15:33.617571] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-08T20:15:34.121112] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:15:34.122980] [INFO ] [REMOTE ] MPV: Full fetch complete (7952 records). [2025-10-08T20:15:34.123105] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-08T20:15:34.421247] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-08T20:15:34.589382] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-08T20:15:34.589577] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-08T20:15:34.589942] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-08T20:15:34.590042] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-08T20:15:34.591081] [DEBUG] [LOCAL ] MPV: Trimmed 7952 records to 4885 (keeping 200 days of data) [2025-10-08T20:15:34.625441] [DEBUG] [LOCAL ] MPV: Primary data saved (4885 records). [2025-10-08T20:15:34.625780] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-08T20:15:34.625972] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MPV took 14.4s. Estimated remaining: 2h 17m 45s. Rate: 7.1 symbols/min [2025-10-08T20:15:34.844827] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:34.841208] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T20:15:34.845036] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-10-08T20:15:34.845089] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-10-08T20:15:34.849176] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-08T20:15:34.856691] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-08T20:15:34.856989] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-08T20:15:34.857060] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-08T20:15:35.226486] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-08T20:15:35.269419] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:36.017563] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-10-08T20:15:36.817556] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-08T20:15:37.044237] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T20:15:37.120832] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-08T20:15:37.617639] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-08T20:15:37.667729] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T20:15:38.282880] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T20:15:38.417584] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-08T20:15:39.217586] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-08T20:15:39.447114] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T20:15:40.017567] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-08T20:15:40.105166] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T20:15:40.534541] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T20:15:40.817555] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-08T20:15:41.291427] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T20:15:41.617584] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-08T20:15:42.417517] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-08T20:15:42.607725] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T20:15:43.217570] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-08T20:15:44.017570] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-08T20:15:44.341259] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T20:15:44.385851] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-08T20:15:44.390239] [INFO ] [REMOTE ] MP: Full fetch complete (77380 records). [2025-10-08T20:15:44.390417] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-08T20:15:44.795240] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-08T20:15:44.795437] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-08T20:15:44.796572] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-08T20:15:44.796688] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-08T20:15:44.798560] [DEBUG] [LOCAL ] MP: Trimmed 77380 records to 53691 (keeping 200 days of data) [2025-10-08T20:15:44.856737] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-08T20:15:44.948575] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T20:15:45.198517] [DEBUG] [LOCAL ] MP: Primary data saved (53691 records). [2025-10-08T20:15:45.198721] [INFO ] [MAIN ] MP: Full history saved. [2025-10-08T20:15:45.198861] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MP took 60.0s. Estimated remaining: 2h 17m 38s. Rate: 7.1 symbols/min [2025-10-08T20:15:45.370493] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:45.370724] [DEBUG] [LOCAL ] MPX: No existing data file found in primary storage. [2025-10-08T20:15:45.370774] [WARN ] [MAIN ] MPX: No existing data found, performing full refresh instead. [2025-10-08T20:15:45.370900] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-08T20:15:45.370941] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-08T20:15:45.370984] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-08T20:15:45.371015] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-08T20:15:45.620839] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-08T20:15:45.760630] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:45.819537] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T20:15:46.417588] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-08T20:15:46.657077] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T20:15:47.132985] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T20:15:47.137218] [INFO ] [REMOTE ] MPC: Full fetch complete (75789 records). [2025-10-08T20:15:47.137361] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-08T20:15:47.227698] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-10-08T20:15:47.533343] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-08T20:15:47.533441] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-08T20:15:47.534487] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-08T20:15:47.534559] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-08T20:15:47.536120] [DEBUG] [LOCAL ] MPC: Trimmed 75789 records to 52062 (keeping 200 days of data) [2025-10-08T20:15:47.767105] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T20:15:47.889271] [DEBUG] [LOCAL ] MPC: Primary data saved (52062 records). [2025-10-08T20:15:47.889480] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-08T20:15:47.890451] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPC took 47.4s. Estimated remaining: 2h 17m 25s. Rate: 7.1 symbols/min [2025-10-08T20:15:48.021529] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-08T20:15:48.068158] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:48.108865] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T20:15:48.126833] [DEBUG] [LOCAL ] MQT: Loaded 8668 existing records from primary storage. [2025-10-08T20:15:48.127101] [INFO ] [MAIN ] MQT: Loaded 8668 existing records. [2025-10-08T20:15:48.313069] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:15:48.313329] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-08T20:15:48.313399] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-08T20:15:48.313626] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-08T20:15:48.313723] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-08T20:15:48.683497] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:48.701997] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T20:15:48.817528] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-10-08T20:15:49.536670] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T20:15:49.617560] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-08T20:15:50.417551] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-08T20:15:51.217593] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-08T20:15:51.406106] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T20:15:51.414016] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:15:52.017558] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-08T20:15:52.817574] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-08T20:15:52.923153] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T20:15:53.368958] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T20:15:53.617595] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-08T20:15:53.711152] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T20:15:53.715512] [INFO ] [REMOTE ] MPLX: Full fetch complete (74054 records). [2025-10-08T20:15:53.715731] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-08T20:15:54.125923] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-08T20:15:54.126028] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-08T20:15:54.127036] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-08T20:15:54.127105] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-08T20:15:54.128620] [DEBUG] [LOCAL ] MPLX: Trimmed 74054 records to 50718 (keeping 200 days of data) [2025-10-08T20:15:54.232768] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T20:15:54.420554] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-08T20:15:54.454589] [DEBUG] [LOCAL ] MPLX: Primary data saved (50718 records). [2025-10-08T20:15:54.454784] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-08T20:15:54.455700] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPLX took 37.2s. Estimated remaining: 2h 17m 16s. Rate: 7.1 symbols/min [2025-10-08T20:15:54.623124] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:15:54.642730] [DEBUG] [LOCAL ] MQY: Loaded 16958 existing records from primary storage. [2025-10-08T20:15:54.642999] [INFO ] [MAIN ] MQY: Loaded 16958 existing records. [2025-10-08T20:15:54.816564] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:15:54.816821] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-08T20:15:54.816869] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-08T20:15:54.817053] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-08T20:15:54.817111] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-08T20:15:55.111172] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T20:15:55.195323] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:15:55.217504] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-10-08T20:15:56.017514] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-08T20:15:56.335790] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T20:15:56.518683] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T20:15:56.817552] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-08T20:15:57.617558] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-08T20:15:58.094793] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T20:15:58.417517] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-08T20:15:58.733975] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T20:15:59.217513] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-08T20:15:59.496036] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T20:15:59.565172] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T20:16:00.017587] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-08T20:16:00.570965] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T20:16:00.817567] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-08T20:16:01.617558] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-08T20:16:02.417574] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-08T20:16:02.698552] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T20:16:02.750966] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T20:16:02.996226] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T20:16:03.217547] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-08T20:16:03.881412] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T20:16:04.017508] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-08T20:16:04.817568] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-08T20:16:04.970719] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T20:16:05.617575] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-08T20:16:05.705515] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T20:16:06.324213] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T20:16:06.417584] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-08T20:16:07.217621] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-08T20:16:08.017617] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-08T20:16:08.075955] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T20:16:08.161784] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T20:16:08.817558] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-08T20:16:08.899347] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T20:16:09.528522] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T20:16:09.617613] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-08T20:16:10.421138] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-08T20:16:10.423073] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T20:16:10.939984] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:16:10.940961] [INFO ] [REMOTE ] MPX: Full fetch complete (6644 records). [2025-10-08T20:16:10.941042] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-08T20:16:10.941529] [FATAL] [VALIDATOR ] MPX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:16:10.941624] [FATAL] [MAIN ] MPX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:16:10.941717] [WARN ] [MAIN ] MPX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:16:10.941769] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-08T20:16:10.941840] [DEBUG] [LOCAL ] MPX: No primary data file found to delete. [2025-10-08T20:16:10.941905] [INFO ] [LOCAL ] MPX: Starting deletion of derivative data. [2025-10-08T20:16:10.941971] [DEBUG] [LOCAL ] MPX: No derivative data file found to delete. [2025-10-08T20:16:10.942061] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPX took 25.7s. Estimated remaining: 2h 17m 13s. Rate: 7.1 symbols/min [2025-10-08T20:16:11.116635] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:11.116879] [DEBUG] [LOCAL ] MRC: No existing data file found in primary storage. [2025-10-08T20:16:11.116934] [WARN ] [MAIN ] MRC: No existing data found, performing full refresh instead. [2025-10-08T20:16:11.117053] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-08T20:16:11.117095] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-08T20:16:11.117135] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-08T20:16:11.117166] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-08T20:16:11.222750] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-08T20:16:11.471252] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:12.017554] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-08T20:16:12.374332] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T20:16:12.817572] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-10-08T20:16:13.617529] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-08T20:16:14.147417] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-08T20:16:14.210064] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T20:16:14.311104] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T20:16:14.417574] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-08T20:16:15.076804] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T20:16:15.080508] [INFO ] [REMOTE ] MPW: Full fetch complete (77122 records). [2025-10-08T20:16:15.080702] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-08T20:16:15.081769] [FATAL] [VALIDATOR ] MPW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:16:15.081863] [FATAL] [MAIN ] MPW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:16:15.081907] [WARN ] [MAIN ] MPW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:16:15.081974] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-08T20:16:15.082055] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-10-08T20:16:15.082110] [INFO ] [LOCAL ] MPW: Starting deletion of derivative data. [2025-10-08T20:16:15.082153] [DEBUG] [LOCAL ] MPW: No derivative data file found to delete. [2025-10-08T20:16:15.082224] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPW took 40.5s. Estimated remaining: 2h 17m 1s. Rate: 7.1 symbols/min [2025-10-08T20:16:15.223197] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-08T20:16:15.257506] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:15.257739] [DEBUG] [LOCAL ] MRK: No existing data file found in primary storage. [2025-10-08T20:16:15.257787] [WARN ] [MAIN ] MRK: No existing data found, performing full refresh instead. [2025-10-08T20:16:15.257900] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-08T20:16:15.257942] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-08T20:16:15.257985] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-08T20:16:15.258017] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-08T20:16:15.623107] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:16.017554] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-08T20:16:16.779834] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T20:16:16.817538] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-08T20:16:16.955600] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T20:16:17.617591] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-10-08T20:16:17.855043] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T20:16:18.417573] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-08T20:16:19.217570] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-08T20:16:19.238843] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T20:16:19.901963] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T20:16:19.943804] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:16:19.945022] [INFO ] [REMOTE ] MQT: Full fetch complete (13335 records). [2025-10-08T20:16:19.945114] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-08T20:16:20.022610] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-08T20:16:20.302251] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-08T20:16:20.302330] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-08T20:16:20.302627] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-08T20:16:20.302699] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-08T20:16:20.303180] [DEBUG] [LOCAL ] MQT: Trimmed 13335 records to 8683 (keeping 200 days of data) [2025-10-08T20:16:20.363278] [DEBUG] [LOCAL ] MQT: Primary data saved (8683 records). [2025-10-08T20:16:20.363890] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-08T20:16:20.364123] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 32.5s. Estimated remaining: 2h 16m 51s. Rate: 7.1 symbols/min [2025-10-08T20:16:20.817606] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-08T20:16:21.617596] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-08T20:16:22.285355] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:16:22.413897] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-08T20:16:22.425769] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-08T20:16:22.468425] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T20:16:23.217590] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-08T20:16:23.712155] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T20:16:24.017528] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-08T20:16:24.330483] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:16:24.817601] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-08T20:16:25.509152] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T20:16:25.605409] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:16:25.607285] [INFO ] [REMOTE ] MQY: Full fetch complete (27025 records). [2025-10-08T20:16:25.607366] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-08T20:16:25.622661] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-08T20:16:25.989182] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-08T20:16:25.989277] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-08T20:16:25.989881] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-08T20:16:25.989943] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-08T20:16:25.990604] [DEBUG] [LOCAL ] MQY: Trimmed 27025 records to 16861 (keeping 200 days of data) [2025-10-08T20:16:26.093813] [DEBUG] [LOCAL ] MQY: Primary data saved (16861 records). [2025-10-08T20:16:26.093965] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-08T20:16:26.094049] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 31.6s. Estimated remaining: 2h 16m 40s. Rate: 7.1 symbols/min [2025-10-08T20:16:26.417521] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-08T20:16:27.977619] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:16:27.987281] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-08T20:16:28.105063] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-08T20:16:28.116039] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-08T20:16:29.417793] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T20:16:29.425563] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-08T20:16:30.064176] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T20:16:30.075226] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-08T20:16:31.042601] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T20:16:31.052093] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-08T20:16:32.171030] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T20:16:32.179273] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-08T20:16:32.261148] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-08T20:16:32.273851] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-08T20:16:33.650332] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T20:16:33.660300] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-08T20:16:34.242915] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T20:16:34.245452] [INFO ] [REMOTE ] MRC: Full fetch complete (54507 records). [2025-10-08T20:16:34.245551] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-08T20:16:34.246449] [FATAL] [VALIDATOR ] MRC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:16:34.246745] [FATAL] [MAIN ] MRC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:16:34.246904] [WARN ] [MAIN ] MRC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:16:34.246983] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-08T20:16:34.247048] [DEBUG] [LOCAL ] MRC: No primary data file found to delete. [2025-10-08T20:16:34.247085] [INFO ] [LOCAL ] MRC: Starting deletion of derivative data. [2025-10-08T20:16:34.247125] [DEBUG] [LOCAL ] MRC: No derivative data file found to delete. [2025-10-08T20:16:34.247201] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 23.3s. Estimated remaining: 2h 16m 32s. Rate: 7.1 symbols/min [2025-10-08T20:16:34.448335] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-08T20:16:34.461129] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-08T20:16:36.559910] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-08T20:16:36.571732] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-08T20:16:38.753887] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-08T20:16:38.765602] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-08T20:16:40.832588] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-08T20:16:40.844821] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-08T20:16:43.439930] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-08T20:16:43.452737] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-08T20:16:44.007348] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T20:16:44.011180] [INFO ] [REMOTE ] MRK: Full fetch complete (77467 records). [2025-10-08T20:16:44.011378] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-08T20:16:44.012336] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:16:44.012431] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:16:44.012502] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:16:44.012573] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-08T20:16:44.012704] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-10-08T20:16:44.012755] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-10-08T20:16:44.012797] [DEBUG] [LOCAL ] MRK: No derivative data file found to delete. [2025-10-08T20:16:44.012856] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRK took 28.9s. Estimated remaining: 2h 16m 24s. Rate: 7.1 symbols/min [2025-10-08T20:16:44.543918] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:44.605669] [DEBUG] [LOCAL ] MS: No existing data file found in primary storage. [2025-10-08T20:16:44.641559] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:44.718770] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:44.716410] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:44.719154] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-08T20:16:44.719282] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-08T20:16:44.718932] [WARN ] [MAIN ] MS: No existing data found, performing full refresh instead. [2025-10-08T20:16:44.719495] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-08T20:16:44.719711] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-08T20:16:44.719393] [DEBUG] [LOCAL ] MSB: No existing data file found in primary storage. [2025-10-08T20:16:44.719802] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-08T20:16:44.719958] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-08T20:16:44.720204] [WARN ] [MAIN ] MSB: No existing data found, performing full refresh instead. [2025-10-08T20:16:44.719891] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-08T20:16:44.720398] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-08T20:16:44.720281] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-08T20:16:44.720621] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-08T20:16:44.720899] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-08T20:16:44.720801] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-08T20:16:44.720710] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-08T20:16:44.736917] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-08T20:16:44.752217] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-08T20:16:44.736985] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-08T20:16:44.778030] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-08T20:16:44.778138] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-08T20:16:44.757475] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-08T20:16:44.787322] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-08T20:16:46.132582] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:46.206383] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-10-08T20:16:46.375095] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:46.408419] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-10-08T20:16:46.513713] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:46.514435] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-10-08T20:16:46.610246] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:46.610696] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-10-08T20:16:46.866391] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:16:46.866830] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-10-08T20:16:46.866926] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:16:46.866978] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-08T20:16:46.867038] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:16:46.867109] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-08T20:16:46.867190] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-08T20:16:46.867246] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-08T20:16:46.867305] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-08T20:16:46.867395] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MRP took 2.9s. Estimated remaining: 2h 16m 12s. Rate: 7.1 symbols/min [2025-10-08T20:16:47.038796] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:16:47.039066] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-08T20:16:47.039122] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-08T20:16:47.039240] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-08T20:16:47.039281] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-08T20:16:47.039321] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-08T20:16:47.039352] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-08T20:16:47.237723] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T20:16:47.268020] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-08T20:16:47.427112] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:16:47.427516] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-10-08T20:16:47.528706] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:16:47.532736] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-08T20:16:47.840919] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T20:16:47.841925] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-08T20:16:48.270910] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T20:16:48.272435] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-08T20:16:48.283268] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T20:16:48.287485] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-08T20:16:48.362053] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T20:16:48.365953] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-08T20:16:48.719978] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T20:16:48.731620] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-08T20:16:48.913829] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T20:16:48.915355] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-08T20:16:48.944196] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T20:16:48.947250] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-08T20:16:49.482252] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T20:16:49.483904] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-08T20:16:49.664476] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T20:16:49.665035] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T20:16:49.671885] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-08T20:16:49.893243] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T20:16:50.387634] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:16:50.417506] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-08T20:16:50.522321] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T20:16:51.217612] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-08T20:16:51.469559] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T20:16:51.685675] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T20:16:52.017592] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-08T20:16:52.585372] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:16:52.817521] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-08T20:16:53.232491] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-08T20:16:53.617522] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-08T20:16:54.417585] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-08T20:16:55.217565] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-08T20:16:55.414969] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T20:16:55.685671] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T20:16:55.688476] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-08T20:16:56.017604] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-08T20:16:56.760378] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T20:16:56.817545] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-08T20:16:57.326383] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T20:16:57.617557] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-08T20:16:58.417535] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-08T20:16:58.612956] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:16:59.217527] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-08T20:16:59.271044] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T20:17:00.017595] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-08T20:17:00.817566] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-08T20:17:00.903538] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T20:17:01.190759] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T20:17:01.407438] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T20:17:01.617608] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-08T20:17:02.417598] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-08T20:17:02.684756] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T20:17:03.217564] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-08T20:17:03.392931] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.18 seconds). [2025-10-08T20:17:03.393859] [INFO ] [REMOTE ] MSC: Full fetch complete (2543 records). [2025-10-08T20:17:03.393946] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-08T20:17:03.394404] [FATAL] [VALIDATOR ] MSC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:03.394503] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:03.394556] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:03.394604] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-08T20:17:03.394704] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-08T20:17:03.394770] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-08T20:17:03.394824] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-08T20:17:03.394891] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MSC took 16.5s. Estimated remaining: 2h 16m 9s. Rate: 7.1 symbols/min [2025-10-08T20:17:03.576613] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:03.576842] [DEBUG] [LOCAL ] MSCI: No existing data file found in primary storage. [2025-10-08T20:17:03.576884] [WARN ] [MAIN ] MSCI: No existing data found, performing full refresh instead. [2025-10-08T20:17:03.576994] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-08T20:17:03.577034] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-08T20:17:03.577074] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-08T20:17:03.577291] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-08T20:17:03.958608] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:04.017494] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-10-08T20:17:04.668206] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-08T20:17:04.817598] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-08T20:17:05.188111] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T20:17:05.365522] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T20:17:05.617599] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-08T20:17:05.883124] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-08T20:17:05.884242] [INFO ] [REMOTE ] MSB: Full fetch complete (12922 records). [2025-10-08T20:17:05.884315] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-08T20:17:05.884763] [FATAL] [VALIDATOR ] MSB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:05.884852] [FATAL] [MAIN ] MSB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:05.884896] [WARN ] [MAIN ] MSB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:05.884960] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-08T20:17:05.885030] [DEBUG] [LOCAL ] MSB: No primary data file found to delete. [2025-10-08T20:17:05.885065] [INFO ] [LOCAL ] MSB: Starting deletion of derivative data. [2025-10-08T20:17:05.885104] [DEBUG] [LOCAL ] MSB: No derivative data file found to delete. [2025-10-08T20:17:05.885158] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSB took 21.9s. Estimated remaining: 2h 15m 57s. Rate: 7.1 symbols/min [2025-10-08T20:17:06.052429] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:06.076826] [DEBUG] [LOCAL ] MSD: Loaded 16021 existing records from primary storage. [2025-10-08T20:17:06.077107] [INFO ] [MAIN ] MSD: Loaded 16021 existing records. [2025-10-08T20:17:06.275264] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:17:06.275502] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-08T20:17:06.275551] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-08T20:17:06.275857] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-08T20:17:06.275922] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-08T20:17:06.422734] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-08T20:17:06.675105] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:07.217593] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-08T20:17:07.451438] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T20:17:08.017578] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-10-08T20:17:08.817576] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-08T20:17:08.840973] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T20:17:09.429094] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-08T20:17:09.617534] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-08T20:17:09.921428] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T20:17:10.199780] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T20:17:10.417578] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-08T20:17:11.217513] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-08T20:17:11.580746] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T20:17:12.017601] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-08T20:17:12.623920] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T20:17:12.817524] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-08T20:17:13.090229] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T20:17:13.131781] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:17:13.133370] [INFO ] [REMOTE ] MSA: Full fetch complete (25753 records). [2025-10-08T20:17:13.133448] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-08T20:17:13.134087] [FATAL] [VALIDATOR ] MSA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:13.134174] [FATAL] [MAIN ] MSA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:13.134219] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:13.134292] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-08T20:17:13.134387] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-08T20:17:13.134432] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-08T20:17:13.134474] [DEBUG] [LOCAL ] MSA: No derivative data file found to delete. [2025-10-08T20:17:13.134530] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MSA took 29.1s. Estimated remaining: 2h 15m 47s. Rate: 7.1 symbols/min [2025-10-08T20:17:13.323698] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:13.323896] [DEBUG] [LOCAL ] MSDL: No existing data file found in primary storage. [2025-10-08T20:17:13.323955] [WARN ] [MAIN ] MSDL: No existing data found, performing full refresh instead. [2025-10-08T20:17:13.324069] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-08T20:17:13.324111] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-08T20:17:13.324153] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-08T20:17:13.324185] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-08T20:17:13.622612] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-08T20:17:13.702523] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:14.417546] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-10-08T20:17:15.049509] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T20:17:15.217570] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-08T20:17:15.616960] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T20:17:16.017562] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-08T20:17:16.817592] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-08T20:17:17.018248] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T20:17:17.446847] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T20:17:17.617500] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-08T20:17:17.720045] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T20:17:18.417510] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-08T20:17:18.663928] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T20:17:19.217564] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-08T20:17:20.017528] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-08T20:17:20.548734] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T20:17:20.593918] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-08T20:17:20.817507] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-08T20:17:20.851958] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T20:17:21.617550] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-08T20:17:22.263945] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T20:17:22.417595] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-08T20:17:23.218687] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-08T20:17:23.222353] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T20:17:23.583543] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T20:17:24.017575] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-08T20:17:24.722334] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T20:17:24.723203] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T20:17:24.817539] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-08T20:17:25.617578] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-08T20:17:26.268563] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T20:17:26.417540] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-08T20:17:26.803763] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T20:17:27.217583] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-08T20:17:27.640338] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T20:17:28.017601] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-08T20:17:28.817567] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-08T20:17:29.264761] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T20:17:29.617599] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-08T20:17:29.656463] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T20:17:30.074893] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T20:17:30.417552] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-08T20:17:31.217701] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-08T20:17:31.805824] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-08T20:17:32.017550] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-08T20:17:32.817597] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-08T20:17:33.067563] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-08T20:17:33.617526] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-08T20:17:33.736575] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-08T20:17:33.742905] [INFO ] [REMOTE ] MS: Full fetch complete (77328 records). [2025-10-08T20:17:33.743035] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-08T20:17:33.743986] [FATAL] [VALIDATOR ] MS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:33.744087] [FATAL] [MAIN ] MS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:33.744129] [WARN ] [MAIN ] MS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:33.744167] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-08T20:17:33.744223] [DEBUG] [LOCAL ] MS: No primary data file found to delete. [2025-10-08T20:17:33.744267] [INFO ] [LOCAL ] MS: Starting deletion of derivative data. [2025-10-08T20:17:33.744334] [DEBUG] [LOCAL ] MS: No derivative data file found to delete. [2025-10-08T20:17:33.744394] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MS took 49.7s. Estimated remaining: 2h 15m 47s. Rate: 7.1 symbols/min [2025-10-08T20:17:33.914703] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:33.914910] [DEBUG] [LOCAL ] MSGE: No existing data file found in primary storage. [2025-10-08T20:17:33.914966] [WARN ] [MAIN ] MSGE: No existing data found, performing full refresh instead. [2025-10-08T20:17:33.915079] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-08T20:17:33.915121] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-08T20:17:33.915162] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-08T20:17:33.915194] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-08T20:17:34.248490] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-08T20:17:34.299564] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:34.417545] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-08T20:17:35.024438] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-08T20:17:35.217583] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-08T20:17:35.769152] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-08T20:17:36.017507] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-08T20:17:36.054021] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T20:17:36.308430] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T20:17:36.349377] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:17:36.351556] [INFO ] [REMOTE ] MSCI: Full fetch complete (50183 records). [2025-10-08T20:17:36.351636] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-08T20:17:36.352203] [FATAL] [VALIDATOR ] MSCI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:36.352291] [FATAL] [MAIN ] MSCI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:36.352356] [WARN ] [MAIN ] MSCI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:36.352427] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-08T20:17:36.352489] [DEBUG] [LOCAL ] MSCI: No primary data file found to delete. [2025-10-08T20:17:36.352524] [INFO ] [LOCAL ] MSCI: Starting deletion of derivative data. [2025-10-08T20:17:36.352562] [DEBUG] [LOCAL ] MSCI: No derivative data file found to delete. [2025-10-08T20:17:36.352628] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSCI took 33.0s. Estimated remaining: 2h 15m 35s. Rate: 7.1 symbols/min [2025-10-08T20:17:36.519542] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:36.519743] [DEBUG] [LOCAL ] MSGS: No existing data file found in primary storage. [2025-10-08T20:17:36.519789] [WARN ] [MAIN ] MSGS: No existing data found, performing full refresh instead. [2025-10-08T20:17:36.519897] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-08T20:17:36.519937] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-08T20:17:36.519978] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-08T20:17:36.520009] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-08T20:17:36.832051] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-08T20:17:36.873568] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:37.617565] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-10-08T20:17:37.716661] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T20:17:37.718573] [INFO ] [REMOTE ] MSD: Full fetch complete (22737 records). [2025-10-08T20:17:37.718699] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-08T20:17:38.151505] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-08T20:17:38.151668] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-08T20:17:38.152734] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-08T20:17:38.152858] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-08T20:17:38.154146] [DEBUG] [LOCAL ] MSD: Trimmed 22737 records to 16093 (keeping 200 days of data) [2025-10-08T20:17:38.302630] [DEBUG] [LOCAL ] MSD: Primary data saved (16093 records). [2025-10-08T20:17:38.302835] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-08T20:17:38.302929] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSD took 32.4s. Estimated remaining: 2h 15m 22s. Rate: 7.1 symbols/min [2025-10-08T20:17:38.424468] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T20:17:38.423435] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-10-08T20:17:38.589856] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:38.590146] [DEBUG] [LOCAL ] MSI: No existing data file found in primary storage. [2025-10-08T20:17:38.590219] [WARN ] [MAIN ] MSI: No existing data found, performing full refresh instead. [2025-10-08T20:17:38.590406] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-08T20:17:38.590469] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-08T20:17:38.590541] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-08T20:17:38.590594] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-08T20:17:39.074163] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:39.217561] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-10-08T20:17:39.898014] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T20:17:40.017559] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-08T20:17:40.763063] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T20:17:40.817497] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-08T20:17:40.936326] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T20:17:41.617554] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-08T20:17:41.728926] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T20:17:42.417552] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-08T20:17:43.189958] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T20:17:43.217485] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-08T20:17:44.017636] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-08T20:17:44.140383] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T20:17:44.817571] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-08T20:17:44.950987] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T20:17:45.001834] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T20:17:45.617572] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-08T20:17:46.417566] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-08T20:17:46.596716] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T20:17:46.819424] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T20:17:47.217577] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-08T20:17:47.539317] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:17:47.542504] [INFO ] [REMOTE ] MSDL: Full fetch complete (55021 records). [2025-10-08T20:17:47.542673] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-08T20:17:47.543392] [FATAL] [VALIDATOR ] MSDL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:47.543497] [FATAL] [MAIN ] MSDL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:47.543574] [WARN ] [MAIN ] MSDL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:47.543694] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-08T20:17:47.543786] [DEBUG] [LOCAL ] MSDL: No primary data file found to delete. [2025-10-08T20:17:47.543825] [INFO ] [LOCAL ] MSDL: Starting deletion of derivative data. [2025-10-08T20:17:47.543866] [DEBUG] [LOCAL ] MSDL: No derivative data file found to delete. [2025-10-08T20:17:47.543926] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSDL took 34.4s. Estimated remaining: 2h 15m 14s. Rate: 7.1 symbols/min [2025-10-08T20:17:47.718695] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:47.718992] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-08T20:17:47.719184] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-08T20:17:47.719505] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-08T20:17:47.719665] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-08T20:17:47.719799] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-08T20:17:47.719902] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-08T20:17:48.019927] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-08T20:17:48.148926] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:48.173017] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:17:48.817567] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-08T20:17:49.143472] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T20:17:49.617562] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-08T20:17:50.417516] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-10-08T20:17:50.764827] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:17:50.765154] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-10-08T20:17:50.765265] [FATAL] [REMOTE ] MSIF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:17:50.765356] [FATAL] [MAIN ] MSIF: Failed to fetch primary data. [2025-10-08T20:17:50.765442] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:17:50.765530] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-08T20:17:50.765624] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-08T20:17:50.765705] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-08T20:17:50.765760] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-08T20:17:50.765807] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSIF took 3.2s. Estimated remaining: 2h 15m 2s. Rate: 7.1 symbols/min [2025-10-08T20:17:50.962070] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-08T20:17:50.965197] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:50.965389] [DEBUG] [LOCAL ] MSM: No existing data file found in primary storage. [2025-10-08T20:17:50.973794] [WARN ] [MAIN ] MSM: No existing data found, performing full refresh instead. [2025-10-08T20:17:50.974299] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-08T20:17:50.974620] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-08T20:17:50.974727] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-08T20:17:50.974771] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-08T20:17:51.229918] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-08T20:17:51.363488] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:17:51.364772] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T20:17:52.017624] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-10-08T20:17:52.342099] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T20:17:52.817569] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-08T20:17:53.590986] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T20:17:53.617503] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-08T20:17:53.816007] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:17:54.417536] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-08T20:17:55.217528] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-08T20:17:55.304868] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T20:17:55.651822] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T20:17:56.017555] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-08T20:17:56.119356] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T20:17:56.817550] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-08T20:17:57.617594] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-08T20:17:57.863415] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T20:17:58.001550] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T20:17:58.417617] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-08T20:17:58.943178] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:17:58.945077] [INFO ] [REMOTE ] MSGS: Full fetch complete (23267 records). [2025-10-08T20:17:58.945175] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-08T20:17:58.945775] [FATAL] [VALIDATOR ] MSGS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:17:58.945860] [FATAL] [MAIN ] MSGS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:17:58.945903] [WARN ] [MAIN ] MSGS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:17:58.945942] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-08T20:17:58.945998] [DEBUG] [LOCAL ] MSGS: No primary data file found to delete. [2025-10-08T20:17:58.946077] [INFO ] [LOCAL ] MSGS: Starting deletion of derivative data. [2025-10-08T20:17:58.946128] [DEBUG] [LOCAL ] MSGS: No derivative data file found to delete. [2025-10-08T20:17:58.946196] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGS took 22.6s. Estimated remaining: 2h 14m 54s. Rate: 7.1 symbols/min [2025-10-08T20:17:59.119904] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:17:59.139224] [DEBUG] [LOCAL ] MT: No existing data file found in primary storage. [2025-10-08T20:17:59.139929] [WARN ] [MAIN ] MT: No existing data found, performing full refresh instead. [2025-10-08T20:17:59.140699] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T20:17:59.147670] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-08T20:17:59.148191] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-08T20:17:59.148599] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-08T20:17:59.148676] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-08T20:17:59.222679] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-08T20:17:59.546114] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:00.017579] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-08T20:18:00.817520] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-08T20:18:00.980830] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T20:18:01.622593] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-10-08T20:18:01.636001] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T20:18:01.810713] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T20:18:02.417591] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-08T20:18:03.217517] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-08T20:18:03.438779] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T20:18:04.017598] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-08T20:18:04.102086] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T20:18:04.161284] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T20:18:04.817576] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-08T20:18:05.617625] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-08T20:18:05.799445] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T20:18:06.173140] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T20:18:06.417554] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-08T20:18:06.590783] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T20:18:07.217587] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-08T20:18:07.902585] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T20:18:08.017566] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-08T20:18:08.448359] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T20:18:08.817577] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-08T20:18:09.617588] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-08T20:18:10.040697] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T20:18:10.183684] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T20:18:10.417717] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-08T20:18:11.034463] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T20:18:11.217591] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-08T20:18:12.017542] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-08T20:18:12.352506] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T20:18:12.420786] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T20:18:12.817571] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-08T20:18:13.324053] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:18:13.327157] [INFO ] [REMOTE ] MSGE: Full fetch complete (40057 records). [2025-10-08T20:18:13.327262] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-08T20:18:13.327920] [FATAL] [VALIDATOR ] MSGE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:13.328008] [FATAL] [MAIN ] MSGE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:13.328052] [WARN ] [MAIN ] MSGE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:13.328093] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-08T20:18:13.328151] [DEBUG] [LOCAL ] MSGE: No primary data file found to delete. [2025-10-08T20:18:13.328187] [INFO ] [LOCAL ] MSGE: Starting deletion of derivative data. [2025-10-08T20:18:13.328229] [DEBUG] [LOCAL ] MSGE: No derivative data file found to delete. [2025-10-08T20:18:13.328316] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSGE took 39.6s. Estimated remaining: 2h 14m 49s. Rate: 7.1 symbols/min [2025-10-08T20:18:13.500935] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:13.501312] [DEBUG] [LOCAL ] MTAL: No existing data file found in primary storage. [2025-10-08T20:18:13.501528] [WARN ] [MAIN ] MTAL: No existing data found, performing full refresh instead. [2025-10-08T20:18:13.501800] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-10-08T20:18:13.501872] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-08T20:18:13.501991] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-08T20:18:13.502143] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-10-08T20:18:13.660462] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-08T20:18:13.725220] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T20:18:13.972955] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:14.417548] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-08T20:18:15.217612] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-10-08T20:18:15.664205] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T20:18:15.952415] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T20:18:16.017587] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-08T20:18:16.057301] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T20:18:16.817557] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-08T20:18:17.371023] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T20:18:17.617550] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-10-08T20:18:18.417537] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-08T20:18:18.604368] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T20:18:18.954592] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T20:18:19.217558] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-10-08T20:18:19.485156] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T20:18:20.017582] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-08T20:18:20.420995] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T20:18:20.817557] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-08T20:18:21.548613] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T20:18:21.617550] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-08T20:18:21.885324] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T20:18:22.417561] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-08T20:18:22.797224] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T20:18:22.800675] [INFO ] [REMOTE ] MSI: Full fetch complete (57727 records). [2025-10-08T20:18:22.800820] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-08T20:18:22.801756] [FATAL] [VALIDATOR ] MSI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:22.801857] [FATAL] [MAIN ] MSI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:22.801903] [WARN ] [MAIN ] MSI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:22.801942] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-08T20:18:22.802000] [DEBUG] [LOCAL ] MSI: No primary data file found to delete. [2025-10-08T20:18:22.802082] [INFO ] [LOCAL ] MSI: Starting deletion of derivative data. [2025-10-08T20:18:22.802167] [DEBUG] [LOCAL ] MSI: No derivative data file found to delete. [2025-10-08T20:18:22.802283] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSI took 44.5s. Estimated remaining: 2h 14m 42s. Rate: 7.1 symbols/min [2025-10-08T20:18:23.015670] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:23.015852] [DEBUG] [LOCAL ] MTB: No existing data file found in primary storage. [2025-10-08T20:18:23.015894] [WARN ] [MAIN ] MTB: No existing data found, performing full refresh instead. [2025-10-08T20:18:23.016006] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-08T20:18:23.016047] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-08T20:18:23.016088] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-08T20:18:23.016119] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-08T20:18:23.224262] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-08T20:18:23.387844] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:23.433177] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T20:18:23.711534] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T20:18:23.714776] [INFO ] [REMOTE ] MSM: Full fetch complete (51733 records). [2025-10-08T20:18:23.714928] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-08T20:18:23.715768] [FATAL] [VALIDATOR ] MSM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:23.715887] [FATAL] [MAIN ] MSM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:23.715932] [WARN ] [MAIN ] MSM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:23.715973] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-08T20:18:23.716047] [DEBUG] [LOCAL ] MSM: No primary data file found to delete. [2025-10-08T20:18:23.716102] [INFO ] [LOCAL ] MSM: Starting deletion of derivative data. [2025-10-08T20:18:23.716148] [DEBUG] [LOCAL ] MSM: No derivative data file found to delete. [2025-10-08T20:18:23.716209] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSM took 33.0s. Estimated remaining: 2h 14m 28s. Rate: 7.1 symbols/min [2025-10-08T20:18:23.916250] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:23.916527] [DEBUG] [LOCAL ] MTD: No existing data file found in primary storage. [2025-10-08T20:18:23.916597] [WARN ] [MAIN ] MTD: No existing data found, performing full refresh instead. [2025-10-08T20:18:23.916741] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-08T20:18:23.916787] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-08T20:18:23.916832] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-08T20:18:23.916865] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-08T20:18:24.022682] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-10-08T20:18:24.336108] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:24.817560] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-10-08T20:18:25.622763] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-08T20:18:25.636726] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:18:26.310910] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T20:18:26.417544] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-10-08T20:18:27.183477] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T20:18:27.217537] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-08T20:18:28.003234] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T20:18:28.017506] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-10-08T20:18:28.817518] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-10-08T20:18:29.160713] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T20:18:29.383969] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T20:18:29.496500] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T20:18:29.617571] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-08T20:18:30.417558] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-08T20:18:31.226516] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-10-08T20:18:31.252584] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T20:18:32.017602] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-08T20:18:32.247042] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T20:18:32.649924] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T20:18:32.817536] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-08T20:18:33.071131] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T20:18:33.143769] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:18:33.147547] [INFO ] [REMOTE ] MT: Full fetch complete (73150 records). [2025-10-08T20:18:33.147745] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-08T20:18:33.149376] [FATAL] [VALIDATOR ] MT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:33.149486] [FATAL] [MAIN ] MT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:33.149532] [WARN ] [MAIN ] MT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:33.149618] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-08T20:18:33.149752] [DEBUG] [LOCAL ] MT: No primary data file found to delete. [2025-10-08T20:18:33.149811] [INFO ] [LOCAL ] MT: Starting deletion of derivative data. [2025-10-08T20:18:33.149858] [DEBUG] [LOCAL ] MT: No derivative data file found to delete. [2025-10-08T20:18:33.149932] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MT took 34.2s. Estimated remaining: 2h 14m 20s. Rate: 7.1 symbols/min [2025-10-08T20:18:33.329380] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:33.329584] [DEBUG] [LOCAL ] MTDR: No existing data file found in primary storage. [2025-10-08T20:18:33.329696] [WARN ] [MAIN ] MTDR: No existing data found, performing full refresh instead. [2025-10-08T20:18:33.329788] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-08T20:18:33.329827] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-08T20:18:33.329874] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-08T20:18:33.329939] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-08T20:18:33.620883] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-08T20:18:33.700135] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:34.417550] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-10-08T20:18:34.751828] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T20:18:35.217561] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-10-08T20:18:36.017519] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-08T20:18:36.155238] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T20:18:36.292200] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T20:18:36.817603] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-10-08T20:18:37.617552] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-08T20:18:37.768783] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T20:18:38.137315] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T20:18:38.417527] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-10-08T20:18:38.443497] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T20:18:39.217546] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-08T20:18:40.000976] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T20:18:40.017507] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-10. [2025-10-08T20:18:40.685306] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:18:40.688307] [INFO ] [REMOTE ] MTAL: Full fetch complete (47991 records). [2025-10-08T20:18:40.688401] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-10-08T20:18:40.689140] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:40.689230] [FATAL] [MAIN ] MTAL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:40.689273] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:40.689310] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-10-08T20:18:40.689370] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-10-08T20:18:40.689406] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-10-08T20:18:40.689446] [DEBUG] [LOCAL ] MTAL: No derivative data file found to delete. [2025-10-08T20:18:40.689515] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MTAL took 27.4s. Estimated remaining: 2h 14m 11s. Rate: 7.1 symbols/min [2025-10-08T20:18:40.817775] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-08T20:18:40.867595] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:40.868007] [DEBUG] [LOCAL ] MTG: No existing data file found in primary storage. [2025-10-08T20:18:40.868076] [WARN ] [MAIN ] MTG: No existing data found, performing full refresh instead. [2025-10-08T20:18:40.891599] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-08T20:18:40.894592] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-08T20:18:40.896439] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T20:18:40.895424] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-08T20:18:40.907053] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-08T20:18:41.303918] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:41.617551] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-08T20:18:42.417594] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-08T20:18:42.601043] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T20:18:43.217547] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-08T20:18:43.528338] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T20:18:43.562582] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T20:18:44.017616] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-10-08T20:18:44.817547] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-08T20:18:44.989738] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T20:18:45.617707] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-08T20:18:45.723454] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T20:18:46.314172] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T20:18:46.417525] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-08T20:18:46.746446] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T20:18:47.217752] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-08T20:18:48.017549] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-08T20:18:48.305750] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T20:18:48.817533] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-08T20:18:48.902799] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T20:18:49.000744] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T20:18:49.617547] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-08T20:18:50.401338] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T20:18:50.417503] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-08T20:18:50.502424] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T20:18:50.999844] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T20:18:51.217613] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-08T20:18:52.017580] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-08T20:18:52.817535] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-08T20:18:52.878994] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T20:18:53.002098] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T20:18:53.617566] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-08T20:18:54.233400] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T20:18:54.236533] [INFO ] [REMOTE ] MTB: Full fetch complete (67647 records). [2025-10-08T20:18:54.236681] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-08T20:18:54.237585] [FATAL] [VALIDATOR ] MTB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:54.237701] [FATAL] [MAIN ] MTB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:54.237757] [WARN ] [MAIN ] MTB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:54.237798] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-08T20:18:54.237857] [DEBUG] [LOCAL ] MTB: No primary data file found to delete. [2025-10-08T20:18:54.237896] [INFO ] [LOCAL ] MTB: Starting deletion of derivative data. [2025-10-08T20:18:54.237950] [DEBUG] [LOCAL ] MTB: No derivative data file found to delete. [2025-10-08T20:18:54.238024] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 31.4s. Estimated remaining: 2h 14m 6s. Rate: 7.1 symbols/min [2025-10-08T20:18:54.415121] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:54.415309] [DEBUG] [LOCAL ] MTH: No existing data file found in primary storage. [2025-10-08T20:18:54.415366] [WARN ] [MAIN ] MTH: No existing data found, performing full refresh instead. [2025-10-08T20:18:54.415475] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-08T20:18:54.415515] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-08T20:18:54.415555] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-08T20:18:54.415586] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-08T20:18:54.427216] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-08T20:18:54.781741] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:54.813382] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T20:18:55.217526] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-08T20:18:55.230515] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T20:18:56.017607] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-10-08T20:18:56.817529] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-08T20:18:56.926724] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T20:18:57.390997] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T20:18:57.391283] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:18:57.401454] [INFO ] [REMOTE ] MTD: Full fetch complete (21087 records). [2025-10-08T20:18:57.401601] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-08T20:18:57.402293] [FATAL] [VALIDATOR ] MTD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:18:57.402385] [FATAL] [MAIN ] MTD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:18:57.402429] [WARN ] [MAIN ] MTD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:18:57.402473] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-08T20:18:57.402943] [DEBUG] [LOCAL ] MTD: No primary data file found to delete. [2025-10-08T20:18:57.403192] [INFO ] [LOCAL ] MTD: Starting deletion of derivative data. [2025-10-08T20:18:57.403282] [DEBUG] [LOCAL ] MTD: No derivative data file found to delete. [2025-10-08T20:18:57.403440] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 33.7s. Estimated remaining: 2h 13m 54s. Rate: 7.1 symbols/min [2025-10-08T20:18:57.571269] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:18:57.571457] [DEBUG] [LOCAL ] MTN: No existing data file found in primary storage. [2025-10-08T20:18:57.571494] [WARN ] [MAIN ] MTN: No existing data found, performing full refresh instead. [2025-10-08T20:18:57.571603] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-08T20:18:57.571667] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-08T20:18:57.571734] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-08T20:18:57.571767] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-08T20:18:57.622743] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-08T20:18:57.922451] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:18:58.417591] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-08T20:18:59.217572] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-08T20:18:59.329450] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T20:19:00.017532] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-10-08T20:19:00.370890] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T20:19:00.731469] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T20:19:00.817532] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-08T20:19:01.622786] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-08T20:19:01.638743] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T20:19:02.417706] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-08T20:19:02.567550] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T20:19:03.217530] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-08T20:19:03.496397] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T20:19:03.752954] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T20:19:04.017513] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-08T20:19:04.817519] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-08T20:19:04.888971] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T20:19:05.596046] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T20:19:05.617535] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-08T20:19:06.417608] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-08T20:19:06.478089] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T20:19:07.217515] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-08T20:19:07.374310] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:19:07.804056] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T20:19:08.017540] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-08T20:19:08.817532] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-08T20:19:08.914487] [DEBUG] [REMOTE ] MTH: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-08T20:19:08.914854] [WARN ] [REMOTE ] MTH: No data returned for month 2025-04 [2025-10-08T20:19:08.914945] [FATAL] [REMOTE ] MTH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:19:08.915031] [FATAL] [MAIN ] MTH: Failed to fetch primary data. [2025-10-08T20:19:08.915098] [WARN ] [MAIN ] MTH: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:19:08.915181] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-08T20:19:08.915245] [DEBUG] [LOCAL ] MTH: No primary data file found to delete. [2025-10-08T20:19:08.915279] [INFO ] [LOCAL ] MTH: Starting deletion of derivative data. [2025-10-08T20:19:08.915317] [DEBUG] [LOCAL ] MTH: No derivative data file found to delete. [2025-10-08T20:19:08.915367] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTH took 14.7s. Estimated remaining: 2h 13m 48s. Rate: 7.1 symbols/min [2025-10-08T20:19:09.089672] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:09.090052] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-08T20:19:09.090111] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-08T20:19:09.090452] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-08T20:19:09.090604] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-08T20:19:09.090768] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-08T20:19:09.090819] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-08T20:19:09.281028] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T20:19:09.516490] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:09.583208] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T20:19:09.617514] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-10-08T20:19:10.093935] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T20:19:10.417584] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-08T20:19:11.217574] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-08T20:19:12.017535] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-08T20:19:12.149774] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T20:19:12.679388] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T20:19:12.817575] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-08T20:19:13.237750] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T20:19:13.274316] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-08T20:19:13.617559] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-08T20:19:14.417595] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-08T20:19:14.780560] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T20:19:14.784195] [INFO ] [REMOTE ] MTDR: Full fetch complete (73372 records). [2025-10-08T20:19:14.784299] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-08T20:19:14.785228] [FATAL] [VALIDATOR ] MTDR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:19:14.785322] [FATAL] [MAIN ] MTDR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:19:14.785365] [WARN ] [MAIN ] MTDR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:19:14.785431] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-08T20:19:14.785520] [DEBUG] [LOCAL ] MTDR: No primary data file found to delete. [2025-10-08T20:19:14.785580] [INFO ] [LOCAL ] MTDR: Starting deletion of derivative data. [2025-10-08T20:19:14.785638] [DEBUG] [LOCAL ] MTDR: No derivative data file found to delete. [2025-10-08T20:19:14.785746] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTDR took 41.6s. Estimated remaining: 2h 13m 38s. Rate: 7.1 symbols/min [2025-10-08T20:19:14.964923] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:14.965345] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-08T20:19:14.965401] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-08T20:19:14.965544] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-08T20:19:14.965600] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-08T20:19:14.965667] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-08T20:19:14.965722] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-08T20:19:15.222732] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-08T20:19:15.376171] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:15.403890] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T20:19:16.017575] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-10-08T20:19:16.773429] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T20:19:16.817500] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-08T20:19:17.051498] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T20:19:17.476900] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T20:19:17.617553] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-08T20:19:18.417560] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-08T20:19:19.217579] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-08T20:19:19.438670] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T20:19:19.878301] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T20:19:19.894679] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:19:20.017535] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-08T20:19:20.468304] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-08T20:19:20.817544] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-08T20:19:21.617553] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-08T20:19:22.096371] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T20:19:22.417530] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-08T20:19:22.615698] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T20:19:22.784523] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-08T20:19:23.217576] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-08T20:19:24.009056] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:19:24.017509] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-08T20:19:24.817517] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-08T20:19:24.919996] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T20:19:25.617560] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-08T20:19:26.319736] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T20:19:26.417542] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-08T20:19:26.934487] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T20:19:27.217496] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-08T20:19:27.348797] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T20:19:28.017598] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-08T20:19:28.585000] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T20:19:28.817554] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-08T20:19:29.253498] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T20:19:29.617557] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-08T20:19:29.742750] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T20:19:30.384968] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T20:19:30.417570] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-08T20:19:31.217559] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-08T20:19:31.663221] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T20:19:31.868729] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:19:31.871853] [INFO ] [REMOTE ] MTN: Full fetch complete (56179 records). [2025-10-08T20:19:31.871965] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-08T20:19:31.872590] [FATAL] [VALIDATOR ] MTN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:19:31.872773] [FATAL] [MAIN ] MTN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:19:31.872860] [WARN ] [MAIN ] MTN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:19:31.872954] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-08T20:19:31.873053] [DEBUG] [LOCAL ] MTN: No primary data file found to delete. [2025-10-08T20:19:31.873160] [INFO ] [LOCAL ] MTN: Starting deletion of derivative data. [2025-10-08T20:19:31.873243] [DEBUG] [LOCAL ] MTN: No derivative data file found to delete. [2025-10-08T20:19:31.873347] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTN took 34.5s. Estimated remaining: 2h 13m 35s. Rate: 7.1 symbols/min [2025-10-08T20:19:32.027590] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-08T20:19:32.063347] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:32.063531] [DEBUG] [LOCAL ] MTUS: No existing data file found in primary storage. [2025-10-08T20:19:32.063573] [WARN ] [MAIN ] MTUS: No existing data found, performing full refresh instead. [2025-10-08T20:19:32.063715] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-08T20:19:32.063766] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-08T20:19:32.063808] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-08T20:19:32.063841] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-08T20:19:32.432586] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:32.550384] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T20:19:32.817514] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-08T20:19:33.617567] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-10-08T20:19:33.897068] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:19:34.417573] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-08T20:19:34.790748] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T20:19:34.859077] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:19:34.860082] [INFO ] [REMOTE ] MTR: Full fetch complete (2480 records). [2025-10-08T20:19:34.860156] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-08T20:19:34.860573] [FATAL] [VALIDATOR ] MTR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:19:34.860686] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:19:34.860740] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:19:34.860784] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-08T20:19:34.860861] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-08T20:19:34.860919] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-08T20:19:34.860962] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-08T20:19:34.861023] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTR took 25.9s. Estimated remaining: 2h 13m 23s. Rate: 7.1 symbols/min [2025-10-08T20:19:35.047127] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:35.047750] [DEBUG] [LOCAL ] MTW: No existing data file found in primary storage. [2025-10-08T20:19:35.047875] [WARN ] [MAIN ] MTW: No existing data found, performing full refresh instead. [2025-10-08T20:19:35.048052] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-08T20:19:35.048156] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-08T20:19:35.048225] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-08T20:19:35.048263] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-08T20:19:35.218490] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-08T20:19:35.436087] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:36.017548] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-08T20:19:36.573315] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T20:19:36.817550] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-08T20:19:37.021377] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:19:37.617538] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-10-08T20:19:38.197466] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T20:19:38.417607] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-08T20:19:38.642160] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:19:39.217629] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-08T20:19:39.517411] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T20:19:39.855980] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:19:39.860502] [INFO ] [REMOTE ] MTG: Full fetch complete (73680 records). [2025-10-08T20:19:39.860788] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-08T20:19:39.861968] [FATAL] [VALIDATOR ] MTG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:19:39.862116] [FATAL] [MAIN ] MTG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:19:39.862200] [WARN ] [MAIN ] MTG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:19:39.862268] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-08T20:19:39.862354] [DEBUG] [LOCAL ] MTG: No primary data file found to delete. [2025-10-08T20:19:39.862410] [INFO ] [LOCAL ] MTG: Starting deletion of derivative data. [2025-10-08T20:19:39.862479] [DEBUG] [LOCAL ] MTG: No derivative data file found to delete. [2025-10-08T20:19:39.862584] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTG took 59.2s. Estimated remaining: 2h 13m 12s. Rate: 7.1 symbols/min [2025-10-08T20:19:40.022793] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-08T20:19:40.076973] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:40.077163] [DEBUG] [LOCAL ] MTX: No existing data file found in primary storage. [2025-10-08T20:19:40.077208] [WARN ] [MAIN ] MTX: No existing data found, performing full refresh instead. [2025-10-08T20:19:40.077337] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-08T20:19:40.077392] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-08T20:19:40.077439] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-08T20:19:40.077498] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-08T20:19:40.513553] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:40.817581] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-10-08T20:19:41.033111] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T20:19:41.617506] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-08T20:19:41.683848] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T20:19:42.417586] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-08T20:19:42.928510] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T20:19:43.136857] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T20:19:43.217538] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-08T20:19:44.017556] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-08T20:19:44.452856] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T20:19:44.769868] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T20:19:44.817580] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-08T20:19:45.175429] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T20:19:45.176966] [INFO ] [REMOTE ] MTRN: Full fetch complete (23617 records). [2025-10-08T20:19:45.177069] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-08T20:19:45.177498] [FATAL] [VALIDATOR ] MTRN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:19:45.177559] [FATAL] [MAIN ] MTRN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:19:45.177594] [WARN ] [MAIN ] MTRN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:19:45.177630] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-08T20:19:45.177741] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-08T20:19:45.177797] [INFO ] [LOCAL ] MTRN: Starting deletion of derivative data. [2025-10-08T20:19:45.177856] [DEBUG] [LOCAL ] MTRN: No derivative data file found to delete. [2025-10-08T20:19:45.177940] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTRN took 30.4s. Estimated remaining: 2h 13m 2s. Rate: 7.1 symbols/min [2025-10-08T20:19:45.347147] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:19:45.347336] [DEBUG] [LOCAL ] MTZ: No existing data file found in primary storage. [2025-10-08T20:19:45.347372] [WARN ] [MAIN ] MTZ: No existing data found, performing full refresh instead. [2025-10-08T20:19:45.347481] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-08T20:19:45.347521] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-08T20:19:45.347562] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-08T20:19:45.347593] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-08T20:19:45.623244] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-08T20:19:45.705506] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:19:46.417601] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-08T20:19:46.915517] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T20:19:47.217562] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-08T20:19:47.690708] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T20:19:48.017557] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-10-08T20:19:48.425970] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T20:19:48.817634] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-08T20:19:49.617537] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-08T20:19:49.654550] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T20:19:50.106479] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T20:19:50.417589] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-08T20:19:50.840273] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T20:19:51.217589] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-08T20:19:51.855870] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T20:19:52.017559] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-08T20:19:52.616957] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T20:19:52.817619] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-08T20:19:53.243090] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T20:19:53.617574] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-08T20:19:54.036722] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T20:19:54.417593] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-08T20:19:55.217575] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-08T20:19:55.377459] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T20:19:55.433135] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T20:19:56.017552] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-08T20:19:56.137636] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T20:19:56.817565] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-08T20:19:57.411530] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T20:19:57.617554] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-08T20:19:58.417595] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-08T20:19:59.217598] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-08T20:19:59.578877] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T20:20:00.017570] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-08T20:20:00.471096] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (3.65 seconds). [2025-10-08T20:20:00.656226] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T20:20:00.817589] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-08T20:20:01.606100] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (3.99 seconds). [2025-10-08T20:20:01.617499] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-08T20:20:02.417713] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-08T20:20:02.641622] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-08T20:20:03.058234] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T20:20:03.217531] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-08T20:20:03.613787] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T20:20:03.616321] [INFO ] [REMOTE ] MTW: Full fetch complete (38172 records). [2025-10-08T20:20:03.616408] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-08T20:20:03.617040] [FATAL] [VALIDATOR ] MTW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:20:03.617128] [FATAL] [MAIN ] MTW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:20:03.617179] [WARN ] [MAIN ] MTW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:20:03.617260] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-08T20:20:03.617371] [DEBUG] [LOCAL ] MTW: No primary data file found to delete. [2025-10-08T20:20:03.617483] [INFO ] [LOCAL ] MTW: Starting deletion of derivative data. [2025-10-08T20:20:03.617560] [DEBUG] [LOCAL ] MTW: No derivative data file found to delete. [2025-10-08T20:20:03.617639] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTW took 28.8s. Estimated remaining: 2h 13m 0s. Rate: 7.1 symbols/min [2025-10-08T20:20:03.798160] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:03.812636] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T20:20:03.830283] [DEBUG] [LOCAL ] MUA: Loaded 11831 existing records from primary storage. [2025-10-08T20:20:03.830532] [INFO ] [MAIN ] MUA: Loaded 11831 existing records. [2025-10-08T20:20:04.028947] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:20:04.029048] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-08T20:20:04.046478] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-08T20:20:04.047667] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-08T20:20:04.050370] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (3.23 seconds). [2025-10-08T20:20:04.050438] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-08T20:20:04.050673] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-08T20:20:04.416352] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:04.817557] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-08T20:20:05.041292] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:20:05.617604] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-08T20:20:06.417551] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-08T20:20:06.701711] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T20:20:07.025539] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T20:20:07.024864] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:20:07.033532] [INFO ] [REMOTE ] MTX: Full fetch complete (31092 records). [2025-10-08T20:20:07.033737] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-08T20:20:07.034696] [FATAL] [VALIDATOR ] MTX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:20:07.034802] [FATAL] [MAIN ] MTX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:20:07.034887] [WARN ] [MAIN ] MTX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:20:07.034977] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-08T20:20:07.035077] [DEBUG] [LOCAL ] MTX: No primary data file found to delete. [2025-10-08T20:20:07.035151] [INFO ] [LOCAL ] MTX: Starting deletion of derivative data. [2025-10-08T20:20:07.035227] [DEBUG] [LOCAL ] MTX: No derivative data file found to delete. [2025-10-08T20:20:07.035300] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTX took 27.2s. Estimated remaining: 2h 12m 48s. Rate: 7.1 symbols/min [2025-10-08T20:20:07.231580] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-08T20:20:07.235806] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:07.260939] [DEBUG] [LOCAL ] MUC: Loaded 20533 existing records from primary storage. [2025-10-08T20:20:07.261219] [INFO ] [MAIN ] MUC: Loaded 20533 existing records. [2025-10-08T20:20:07.464429] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:20:07.464683] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-08T20:20:07.464741] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-08T20:20:07.465112] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-08T20:20:07.465185] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-08T20:20:07.853132] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:08.017544] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-08T20:20:08.393551] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T20:20:08.817582] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-08T20:20:09.444449] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T20:20:09.617502] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-08T20:20:10.017909] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T20:20:10.417550] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-10-08T20:20:11.217553] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-10-08T20:20:11.330106] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T20:20:11.645732] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T20:20:12.017575] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-08T20:20:12.264686] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:20:12.334980] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:20:12.336883] [INFO ] [REMOTE ] MTUS: Full fetch complete (41711 records). [2025-10-08T20:20:12.336959] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-08T20:20:12.337514] [FATAL] [VALIDATOR ] MTUS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:20:12.337600] [FATAL] [MAIN ] MTUS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:20:12.337666] [WARN ] [MAIN ] MTUS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:20:12.337727] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-08T20:20:12.337784] [DEBUG] [LOCAL ] MTUS: No primary data file found to delete. [2025-10-08T20:20:12.337817] [INFO ] [LOCAL ] MTUS: Starting deletion of derivative data. [2025-10-08T20:20:12.337855] [DEBUG] [LOCAL ] MTUS: No derivative data file found to delete. [2025-10-08T20:20:12.337908] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTUS took 40.5s. Estimated remaining: 2h 12m 38s. Rate: 7.1 symbols/min [2025-10-08T20:20:12.505637] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:12.518736] [DEBUG] [LOCAL ] MUE: Loaded 11979 existing records from primary storage. [2025-10-08T20:20:12.523943] [INFO ] [MAIN ] MUE: Loaded 11979 existing records. [2025-10-08T20:20:12.697687] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:20:12.697954] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-08T20:20:12.697999] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-08T20:20:12.698349] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-08T20:20:12.698406] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-08T20:20:12.822852] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-08T20:20:13.051193] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:13.617613] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-10-08T20:20:14.417575] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-08T20:20:14.637589] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:20:14.727890] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T20:20:15.217559] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-08T20:20:15.857393] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:20:15.929943] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T20:20:16.017515] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-08T20:20:16.817571] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-08T20:20:17.062456] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T20:20:17.617551] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-08T20:20:18.417521] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-08T20:20:18.536696] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T20:20:18.758145] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T20:20:19.196745] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T20:20:19.217499] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-08T20:20:19.938607] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T20:20:20.017528] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-08T20:20:20.817580] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-08T20:20:20.963338] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:20:21.617572] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-08T20:20:22.185117] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T20:20:22.417565] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-08T20:20:22.656287] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T20:20:23.179606] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:20:23.182767] [INFO ] [REMOTE ] MTZ: Full fetch complete (63096 records). [2025-10-08T20:20:23.182926] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-08T20:20:23.183686] [FATAL] [VALIDATOR ] MTZ: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:20:23.183810] [FATAL] [MAIN ] MTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:20:23.183895] [WARN ] [MAIN ] MTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:20:23.183989] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-08T20:20:23.184079] [DEBUG] [LOCAL ] MTZ: No primary data file found to delete. [2025-10-08T20:20:23.184118] [INFO ] [LOCAL ] MTZ: Starting deletion of derivative data. [2025-10-08T20:20:23.184158] [DEBUG] [LOCAL ] MTZ: No derivative data file found to delete. [2025-10-08T20:20:23.184221] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MTZ took 38.0s. Estimated remaining: 2h 12m 31s. Rate: 7.1 symbols/min [2025-10-08T20:20:23.222740] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-08T20:20:23.369602] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:23.369810] [DEBUG] [LOCAL ] MUFG: No existing data file found in primary storage. [2025-10-08T20:20:23.369853] [WARN ] [MAIN ] MUFG: No existing data found, performing full refresh instead. [2025-10-08T20:20:23.370059] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-08T20:20:23.370127] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-08T20:20:23.370178] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-08T20:20:23.370212] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-08T20:20:23.729189] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:24.017520] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-10-08T20:20:24.025920] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T20:20:24.817616] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-08T20:20:25.583918] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:20:25.617532] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-08T20:20:25.769789] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T20:20:26.417714] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-08T20:20:26.521204] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T20:20:27.217558] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-08T20:20:27.450172] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T20:20:28.017570] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-08T20:20:28.335302] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T20:20:28.818985] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-08T20:20:28.820338] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T20:20:29.617519] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-08T20:20:29.739840] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T20:20:30.236330] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:20:30.417535] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-08T20:20:31.217556] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-08T20:20:31.565838] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T20:20:32.017590] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-08T20:20:32.080210] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T20:20:32.817545] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-08T20:20:32.844621] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T20:20:33.617527] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-08T20:20:34.052803] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:20:34.315980] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:20:34.417510] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-08T20:20:35.217549] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-08T20:20:35.715198] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T20:20:36.017548] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-08T20:20:36.817539] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-08T20:20:36.988556] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T20:20:36.990051] [INFO ] [REMOTE ] MUA: Full fetch complete (18739 records). [2025-10-08T20:20:36.990123] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-08T20:20:37.206009] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T20:20:37.436421] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-08T20:20:37.436518] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-08T20:20:37.437001] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-08T20:20:37.437065] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-08T20:20:37.437794] [DEBUG] [LOCAL ] MUA: Trimmed 18739 records to 11795 (keeping 200 days of data) [2025-10-08T20:20:37.513385] [DEBUG] [LOCAL ] MUA: Primary data saved (11795 records). [2025-10-08T20:20:37.513532] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-08T20:20:37.513618] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MUA took 33.9s. Estimated remaining: 2h 12m 27s. Rate: 7.1 symbols/min [2025-10-08T20:20:37.629681] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-08T20:20:37.709664] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:37.727613] [DEBUG] [LOCAL ] MUJ: Loaded 13668 existing records from primary storage. [2025-10-08T20:20:37.727910] [INFO ] [MAIN ] MUJ: Loaded 13668 existing records. [2025-10-08T20:20:37.867529] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T20:20:37.937576] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:20:37.937873] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-08T20:20:37.937935] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-08T20:20:37.938200] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-08T20:20:37.938259] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-08T20:20:38.308524] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:38.417559] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-10-08T20:20:39.217552] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-08T20:20:40.017724] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-08T20:20:40.371623] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-08T20:20:40.488679] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T20:20:40.743807] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T20:20:40.817563] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-08T20:20:40.847111] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-08T20:20:41.617572] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-08T20:20:42.390825] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T20:20:42.417504] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-08T20:20:42.486636] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T20:20:43.217519] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-08T20:20:43.294450] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T20:20:44.017611] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-08T20:20:44.817687] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-08T20:20:45.122061] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T20:20:45.123940] [INFO ] [REMOTE ] MUC: Full fetch complete (29939 records). [2025-10-08T20:20:45.124025] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-08T20:20:45.488373] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-08T20:20:45.590794] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-08T20:20:45.590889] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-08T20:20:45.591683] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-08T20:20:45.591747] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-08T20:20:45.592596] [DEBUG] [LOCAL ] MUC: Trimmed 29939 records to 20555 (keeping 200 days of data) [2025-10-08T20:20:45.648121] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-08T20:20:45.696576] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T20:20:45.750754] [DEBUG] [LOCAL ] MUC: Primary data saved (20555 records). [2025-10-08T20:20:45.750933] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-08T20:20:45.751076] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 38.7s. Estimated remaining: 2h 12m 18s. Rate: 7.1 symbols/min [2025-10-08T20:20:45.957724] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:45.957908] [DEBUG] [LOCAL ] MUR: No existing data file found in primary storage. [2025-10-08T20:20:45.957947] [WARN ] [MAIN ] MUR: No existing data found, performing full refresh instead. [2025-10-08T20:20:45.958072] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-08T20:20:45.958114] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-08T20:20:45.958157] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-08T20:20:45.958191] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-08T20:20:46.399155] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:46.417582] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-08T20:20:47.217568] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-08T20:20:47.349171] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T20:20:47.746757] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T20:20:48.017502] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-08T20:20:48.084163] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T20:20:48.817624] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-08T20:20:49.617546] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-08T20:20:49.759159] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T20:20:49.888942] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T20:20:50.341827] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T20:20:50.343108] [INFO ] [REMOTE ] MUE: Full fetch complete (15858 records). [2025-10-08T20:20:50.343210] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-08T20:20:50.422690] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-08T20:20:50.706889] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-08T20:20:50.706967] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-08T20:20:50.707328] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-08T20:20:50.707388] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-08T20:20:50.707950] [DEBUG] [LOCAL ] MUE: Trimmed 15858 records to 12015 (keeping 200 days of data) [2025-10-08T20:20:50.784203] [DEBUG] [LOCAL ] MUE: Primary data saved (12015 records). [2025-10-08T20:20:50.784377] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-08T20:20:50.784514] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 38.4s. Estimated remaining: 2h 12m 7s. Rate: 7.1 symbols/min [2025-10-08T20:20:50.956492] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:20:50.956724] [DEBUG] [LOCAL ] MUSA: No existing data file found in primary storage. [2025-10-08T20:20:50.956782] [WARN ] [MAIN ] MUSA: No existing data found, performing full refresh instead. [2025-10-08T20:20:50.956909] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-08T20:20:50.956978] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-08T20:20:50.957029] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-08T20:20:50.957061] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-08T20:20:51.226147] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-08T20:20:51.315826] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:20:52.017559] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-10-08T20:20:52.210244] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T20:20:52.462815] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T20:20:52.817555] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-08T20:20:53.073889] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T20:20:53.617567] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-08T20:20:54.417553] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-10-08T20:20:54.629356] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T20:20:54.692304] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T20:20:55.217609] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-08T20:20:55.942123] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T20:20:56.017527] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-08T20:20:56.318695] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T20:20:56.817568] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-08T20:20:57.617518] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-08T20:20:57.913343] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T20:20:58.093822] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T20:20:58.417535] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-08T20:20:58.660314] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T20:20:59.217562] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-08T20:20:59.674788] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T20:21:00.017554] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-08T20:21:00.229719] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:21:00.817538] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-08T20:21:01.617546] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-08T20:21:01.728514] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T20:21:01.809243] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T20:21:02.326291] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:21:02.329360] [INFO ] [REMOTE ] MUJ: Full fetch complete (20195 records). [2025-10-08T20:21:02.329535] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-08T20:21:02.422812] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-08T20:21:02.792235] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-08T20:21:02.792373] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-08T20:21:02.793102] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-08T20:21:02.793167] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-08T20:21:02.794053] [DEBUG] [LOCAL ] MUJ: Trimmed 20195 records to 13610 (keeping 200 days of data) [2025-10-08T20:21:02.878719] [DEBUG] [LOCAL ] MUJ: Primary data saved (13610 records). [2025-10-08T20:21:02.878920] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-08T20:21:02.879038] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUJ took 25.4s. Estimated remaining: 2h 12m 1s. Rate: 7.1 symbols/min [2025-10-08T20:21:03.050563] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:03.050800] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-08T20:21:03.050855] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-08T20:21:03.050970] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-08T20:21:03.051012] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-08T20:21:03.051057] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-08T20:21:03.051089] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-08T20:21:03.158912] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:21:03.179309] [INFO ] [REMOTE ] MUFG: Full fetch complete (75245 records). [2025-10-08T20:21:03.189726] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-08T20:21:03.220770] [FATAL] [VALIDATOR ] MUFG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:21:03.254385] [FATAL] [MAIN ] MUFG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:21:03.220340] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-08T20:21:03.278758] [WARN ] [MAIN ] MUFG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:21:03.284097] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-08T20:21:03.285262] [DEBUG] [LOCAL ] MUFG: No primary data file found to delete. [2025-10-08T20:21:03.285345] [INFO ] [LOCAL ] MUFG: Starting deletion of derivative data. [2025-10-08T20:21:03.285482] [DEBUG] [LOCAL ] MUFG: No derivative data file found to delete. [2025-10-08T20:21:03.285593] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUFG took 40.1s. Estimated remaining: 2h 11m 48s. Rate: 7.1 symbols/min [2025-10-08T20:21:03.630730] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:03.648869] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:03.649240] [DEBUG] [LOCAL ] MUX: No existing data file found in primary storage. [2025-10-08T20:21:03.649284] [WARN ] [MAIN ] MUX: No existing data found, performing full refresh instead. [2025-10-08T20:21:03.649395] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-08T20:21:03.649436] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-08T20:21:03.649477] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-08T20:21:03.649509] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-08T20:21:04.022932] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-08T20:21:04.028036] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:04.817613] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-10-08T20:21:04.961363] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T20:21:04.995359] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T20:21:05.201221] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-08T20:21:05.617578] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-10-08T20:21:06.417545] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-08T20:21:06.700137] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:21:06.700609] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-08T20:21:06.700765] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:21:06.700878] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-08T20:21:06.700948] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:21:06.701040] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-08T20:21:06.701144] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-08T20:21:06.701190] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-08T20:21:06.701252] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-08T20:21:06.701330] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUSE took 3.8s. Estimated remaining: 2h 11m 36s. Rate: 7.1 symbols/min [2025-10-08T20:21:06.915710] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:06.941146] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:21:06.962917] [DEBUG] [LOCAL ] MVF: Loaded 13069 existing records from primary storage. [2025-10-08T20:21:06.963305] [INFO ] [MAIN ] MVF: Loaded 13069 existing records. [2025-10-08T20:21:07.168117] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:21:07.168472] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-08T20:21:07.168553] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-08T20:21:07.168938] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-08T20:21:07.168996] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-08T20:21:07.222746] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-08T20:21:07.572902] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:08.017567] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-08T20:21:08.721835] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T20:21:08.817544] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-08T20:21:09.467245] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T20:21:09.617556] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-08T20:21:10.417524] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-08T20:21:10.793351] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T20:21:10.806862] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T20:21:11.217566] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-10-08T20:21:11.386854] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T20:21:12.017508] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-08T20:21:12.407262] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T20:21:12.817566] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-08T20:21:13.592134] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T20:21:13.617502] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-08T20:21:13.768904] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T20:21:14.417550] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-08T20:21:15.082536] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T20:21:15.125124] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T20:21:15.217549] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-08T20:21:16.017598] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-08T20:21:16.584993] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T20:21:16.817578] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-08T20:21:17.403019] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T20:21:17.617555] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-08T20:21:17.999336] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T20:21:18.417619] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-08T20:21:19.093137] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T20:21:19.186182] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T20:21:19.217562] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-08T20:21:20.017569] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-08T20:21:20.812919] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T20:21:20.821885] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-08T20:21:20.922866] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T20:21:21.617557] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-08T20:21:22.425209] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-08T20:21:22.428987] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T20:21:23.141560] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T20:21:23.217526] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-08T20:21:23.369630] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T20:21:23.865142] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T20:21:24.017551] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-08T20:21:24.818078] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-08T20:21:25.617564] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-08T20:21:25.849564] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T20:21:26.033180] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T20:21:26.241535] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T20:21:26.417549] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-08T20:21:27.217563] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-08T20:21:28.017603] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-08T20:21:28.157901] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T20:21:28.363581] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T20:21:28.498271] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:21:28.500074] [INFO ] [REMOTE ] MUSA: Full fetch complete (34922 records). [2025-10-08T20:21:28.500199] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-08T20:21:28.500804] [FATAL] [VALIDATOR ] MUSA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:21:28.500890] [FATAL] [MAIN ] MUSA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:21:28.500932] [WARN ] [MAIN ] MUSA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:21:28.500970] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-08T20:21:28.501025] [DEBUG] [LOCAL ] MUSA: No primary data file found to delete. [2025-10-08T20:21:28.501062] [INFO ] [LOCAL ] MUSA: Starting deletion of derivative data. [2025-10-08T20:21:28.501100] [DEBUG] [LOCAL ] MUSA: No derivative data file found to delete. [2025-10-08T20:21:28.501185] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSA took 37.7s. Estimated remaining: 2h 11m 36s. Rate: 7.1 symbols/min [2025-10-08T20:21:28.678575] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:28.678864] [DEBUG] [LOCAL ] MVO: No existing data file found in primary storage. [2025-10-08T20:21:28.678917] [WARN ] [MAIN ] MVO: No existing data found, performing full refresh instead. [2025-10-08T20:21:28.679055] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-08T20:21:28.679115] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-08T20:21:28.679160] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-08T20:21:28.679192] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-08T20:21:28.822742] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-08T20:21:29.039004] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:29.617542] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-08T20:21:30.417584] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-08T20:21:30.854181] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T20:21:30.996944] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T20:21:31.217518] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-08T20:21:31.451628] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T20:21:31.872162] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T20:21:32.017608] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-10-08T20:21:32.817576] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-08T20:21:32.899771] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T20:21:33.404508] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:21:33.408806] [INFO ] [REMOTE ] MUX: Full fetch complete (59528 records). [2025-10-08T20:21:33.408999] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-08T20:21:33.410009] [FATAL] [VALIDATOR ] MUX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:21:33.410119] [FATAL] [MAIN ] MUX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:21:33.410163] [WARN ] [MAIN ] MUX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:21:33.410226] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-08T20:21:33.410335] [DEBUG] [LOCAL ] MUX: No primary data file found to delete. [2025-10-08T20:21:33.410582] [INFO ] [LOCAL ] MUX: Starting deletion of derivative data. [2025-10-08T20:21:33.410625] [DEBUG] [LOCAL ] MUX: No derivative data file found to delete. [2025-10-08T20:21:33.410760] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUX took 30.1s. Estimated remaining: 2h 11m 26s. Rate: 7.1 symbols/min [2025-10-08T20:21:33.620121] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-08T20:21:33.619985] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:33.636627] [DEBUG] [LOCAL ] MVT: Loaded 10279 existing records from primary storage. [2025-10-08T20:21:33.637068] [INFO ] [MAIN ] MVT: Loaded 10279 existing records. [2025-10-08T20:21:33.854415] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:21:33.854631] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-08T20:21:33.854712] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-08T20:21:33.854911] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-08T20:21:33.854967] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-08T20:21:34.258206] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:34.417564] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-10-08T20:21:35.217530] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-08T20:21:35.491563] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T20:21:35.531830] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T20:21:35.860699] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:21:35.862590] [INFO ] [REMOTE ] MVF: Full fetch complete (18803 records). [2025-10-08T20:21:35.862715] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-08T20:21:36.025388] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-08T20:21:36.283069] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-08T20:21:36.283161] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-08T20:21:36.283626] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-08T20:21:36.283705] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-08T20:21:36.284310] [DEBUG] [LOCAL ] MVF: Trimmed 18803 records to 13200 (keeping 200 days of data) [2025-10-08T20:21:36.360952] [DEBUG] [LOCAL ] MVF: Primary data saved (13200 records). [2025-10-08T20:21:36.361104] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-08T20:21:36.361191] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MVF took 29.7s. Estimated remaining: 2h 11m 14s. Rate: 7.1 symbols/min [2025-10-08T20:21:36.530961] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:21:36.531161] [DEBUG] [LOCAL ] MWA: No existing data file found in primary storage. [2025-10-08T20:21:36.531199] [WARN ] [MAIN ] MWA: No existing data found, performing full refresh instead. [2025-10-08T20:21:36.531312] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-08T20:21:36.531357] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-08T20:21:36.531400] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-08T20:21:36.531432] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-08T20:21:36.822877] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-08T20:21:36.911018] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:21:37.009262] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:21:37.617562] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-10-08T20:21:37.861189] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T20:21:38.417602] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-08T20:21:39.217524] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-08T20:21:39.310746] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T20:21:39.318140] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T20:21:39.950115] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T20:21:40.017535] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-08T20:21:40.817534] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-08T20:21:40.928386] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T20:21:41.262377] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:21:41.267131] [INFO ] [REMOTE ] MUR: Full fetch complete (76177 records). [2025-10-08T20:21:41.267340] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-08T20:21:41.268591] [FATAL] [VALIDATOR ] MUR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:21:41.268772] [FATAL] [MAIN ] MUR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:21:41.268860] [WARN ] [MAIN ] MUR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:21:41.268936] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-08T20:21:41.269018] [DEBUG] [LOCAL ] MUR: No primary data file found to delete. [2025-10-08T20:21:41.269074] [INFO ] [LOCAL ] MUR: Starting deletion of derivative data. [2025-10-08T20:21:41.269118] [DEBUG] [LOCAL ] MUR: No derivative data file found to delete. [2025-10-08T20:21:41.269201] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MUR took 55.5s. Estimated remaining: 2h 11m 3s. Rate: 7.1 symbols/min [2025-10-08T20:21:41.617545] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-08T20:21:42.417548] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-08T20:21:43.040479] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T20:21:43.127278] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T20:21:43.217517] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-08T20:21:43.937984] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:21:44.017501] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-08T20:21:44.817569] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-08T20:21:44.901399] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T20:21:45.617571] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-08T20:21:45.711351] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T20:21:46.417535] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-08T20:21:46.518659] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T20:21:47.217619] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-08T20:21:47.828104] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T20:21:48.017550] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-08T20:21:48.195766] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T20:21:48.817590] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-08T20:21:49.355681] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T20:21:49.617513] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-08T20:21:49.902797] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T20:21:50.417574] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-08T20:21:50.503258] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:21:51.217620] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-08T20:21:51.929929] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T20:21:52.017509] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-08T20:21:52.067597] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T20:21:52.817604] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-08T20:21:53.557484] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T20:21:53.575682] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T20:21:53.617514] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-08T20:21:54.417605] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-08T20:21:55.058243] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T20:21:55.217537] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-08T20:21:55.282440] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T20:21:55.466309] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-08T20:21:55.467389] [INFO ] [REMOTE ] MVO: Full fetch complete (14349 records). [2025-10-08T20:21:55.467470] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-08T20:21:55.467978] [FATAL] [VALIDATOR ] MVO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:21:55.468062] [FATAL] [MAIN ] MVO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:21:55.468102] [WARN ] [MAIN ] MVO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:21:55.468164] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-08T20:21:55.468226] [DEBUG] [LOCAL ] MVO: No primary data file found to delete. [2025-10-08T20:21:55.468260] [INFO ] [LOCAL ] MVO: Starting deletion of derivative data. [2025-10-08T20:21:55.468297] [DEBUG] [LOCAL ] MVO: No derivative data file found to delete. [2025-10-08T20:21:55.468351] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVO took 27.0s. Estimated remaining: 2h 10m 58s. Rate: 7.1 symbols/min [2025-10-08T20:21:56.017603] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-08T20:21:56.817558] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-08T20:21:56.863234] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T20:21:57.617597] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-08T20:21:58.291956] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T20:21:58.417729] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-08T20:21:58.566089] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T20:21:59.146119] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:21:59.147270] [INFO ] [REMOTE ] MVT: Full fetch complete (14347 records). [2025-10-08T20:21:59.147342] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-08T20:21:59.222754] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-08T20:21:59.519660] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-08T20:21:59.519756] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-08T20:21:59.520106] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-08T20:21:59.520187] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-08T20:21:59.520829] [DEBUG] [LOCAL ] MVT: Trimmed 14347 records to 10214 (keeping 200 days of data) [2025-10-08T20:21:59.585347] [DEBUG] [LOCAL ] MVT: Primary data saved (10214 records). [2025-10-08T20:21:59.585501] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-08T20:21:59.585599] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVT took 26.2s. Estimated remaining: 2h 10m 47s. Rate: 7.1 symbols/min [2025-10-08T20:22:01.172548] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:22:01.182929] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-08T20:22:02.922116] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T20:22:02.931414] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-08T20:22:03.460228] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:22:03.463244] [INFO ] [REMOTE ] MWA: Full fetch complete (67336 records). [2025-10-08T20:22:03.463367] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-08T20:22:03.464263] [FATAL] [VALIDATOR ] MWA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:22:03.464354] [FATAL] [MAIN ] MWA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:22:03.464396] [WARN ] [MAIN ] MWA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:22:03.464434] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-08T20:22:03.464490] [DEBUG] [LOCAL ] MWA: No primary data file found to delete. [2025-10-08T20:22:03.464524] [INFO ] [LOCAL ] MWA: Starting deletion of derivative data. [2025-10-08T20:22:03.464563] [DEBUG] [LOCAL ] MWA: No derivative data file found to delete. [2025-10-08T20:22:03.464633] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 27.1s. Estimated remaining: 2h 10m 36s. Rate: 7.1 symbols/min [2025-10-08T20:22:04.034265] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:04.109435] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:04.195630] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:04.202194] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:04.204129] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-08T20:22:04.202633] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-08T20:22:04.204392] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-08T20:22:04.204488] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-08T20:22:04.204853] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-08T20:22:04.204947] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-08T20:22:04.205191] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-08T20:22:04.210003] [DEBUG] [LOCAL ] MXF: Loaded 5662 existing records from primary storage. [2025-10-08T20:22:04.205274] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-08T20:22:04.211097] [INFO ] [MAIN ] MXF: Loaded 5662 existing records. [2025-10-08T20:22:04.218718] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-08T20:22:04.250229] [DEBUG] [LOCAL ] MYD: Loaded 13349 existing records from primary storage. [2025-10-08T20:22:04.230028] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-08T20:22:04.276445] [INFO ] [MAIN ] MYD: Loaded 13349 existing records. [2025-10-08T20:22:04.275965] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-08T20:22:04.318588] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-08T20:22:04.926941] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:22:05.014797] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-08T20:22:05.014995] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-08T20:22:05.066195] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:22:05.066292] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-08T20:22:05.087398] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-08T20:22:05.102511] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-08T20:22:05.141382] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-08T20:22:05.219989] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-08T20:22:05.230465] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-08T20:22:05.622706] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:05.664203] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-10-08T20:22:05.640892] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:05.674832] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-10-08T20:22:06.088519] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:06.109316] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-10-08T20:22:06.131580] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:06.131898] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-10-08T20:22:06.325270] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T20:22:06.326495] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-08T20:22:06.827959] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T20:22:06.831251] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T20:22:06.836393] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-08T20:22:06.843619] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-08T20:22:06.846134] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T20:22:06.986745] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T20:22:07.217627] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-08T20:22:07.276121] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T20:22:07.916233] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T20:22:07.999775] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T20:22:08.017515] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-08T20:22:08.430164] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T20:22:08.817563] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-08T20:22:09.617554] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-08T20:22:09.746196] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T20:22:10.358615] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T20:22:10.417554] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-08T20:22:10.972941] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T20:22:11.217549] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-08T20:22:12.017571] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-08T20:22:12.333279] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T20:22:12.817548] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-08T20:22:12.936265] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T20:22:13.617537] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-08T20:22:13.933830] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T20:22:14.068406] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T20:22:14.417789] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-08T20:22:15.217517] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-08T20:22:15.382420] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T20:22:16.017590] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-08T20:22:16.113822] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:22:16.817511] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-08T20:22:16.870064] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T20:22:17.295152] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T20:22:17.617556] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-08T20:22:18.074137] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T20:22:18.417576] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-08T20:22:19.217532] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-08T20:22:19.301488] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T20:22:19.769417] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T20:22:20.017546] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-08T20:22:20.555024] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T20:22:20.817557] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-08T20:22:21.617551] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-08T20:22:22.074236] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T20:22:22.075051] [INFO ] [REMOTE ] MXE: Full fetch complete (2638 records). [2025-10-08T20:22:22.075120] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-08T20:22:22.198455] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T20:22:22.285113] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T20:22:22.285363] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:22:22.285450] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:22:22.285544] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-08T20:22:22.285664] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-08T20:22:22.285765] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-08T20:22:22.285825] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-08T20:22:22.285886] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 18.8s. Estimated remaining: 2h 10m 34s. Rate: 7.1 symbols/min [2025-10-08T20:22:22.425410] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-08T20:22:22.459704] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:22.459861] [DEBUG] [LOCAL ] MYE: No existing data file found in primary storage. [2025-10-08T20:22:22.459899] [WARN ] [MAIN ] MYE: No existing data found, performing full refresh instead. [2025-10-08T20:22:22.460038] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-08T20:22:22.460105] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-08T20:22:22.460155] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-08T20:22:22.460187] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-08T20:22:22.832568] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:23.217554] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-08T20:22:23.299035] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T20:22:23.902073] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T20:22:24.017567] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-08T20:22:24.817557] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-08T20:22:25.026484] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T20:22:25.617552] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-08T20:22:25.984190] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T20:22:26.339403] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:22:26.417550] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-08T20:22:26.993884] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-08T20:22:27.217556] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-08T20:22:27.661333] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-08T20:22:28.017593] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-08T20:22:28.817520] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-08T20:22:28.965900] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T20:22:29.617588] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-08T20:22:29.884280] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T20:22:30.104020] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T20:22:30.105218] [INFO ] [REMOTE ] MXF: Full fetch complete (10101 records). [2025-10-08T20:22:30.105302] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-08T20:22:30.422758] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-08T20:22:30.479557] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-08T20:22:30.479671] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-08T20:22:30.479964] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-08T20:22:30.480006] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-08T20:22:30.480434] [DEBUG] [LOCAL ] MXF: Trimmed 10101 records to 5687 (keeping 200 days of data) [2025-10-08T20:22:30.515712] [DEBUG] [LOCAL ] MXF: Primary data saved (5687 records). [2025-10-08T20:22:30.515807] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-08T20:22:30.515886] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 27.0s. Estimated remaining: 2h 10m 25s. Rate: 7.1 symbols/min [2025-10-08T20:22:30.687736] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:30.708790] [DEBUG] [LOCAL ] MYI: Loaded 19076 existing records from primary storage. [2025-10-08T20:22:30.709148] [INFO ] [MAIN ] MYI: Loaded 19076 existing records. [2025-10-08T20:22:30.889471] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:22:30.889740] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-08T20:22:30.889794] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-08T20:22:30.890018] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-08T20:22:30.890076] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-08T20:22:31.189025] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T20:22:31.231920] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-08T20:22:31.269765] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:32.017521] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-10-08T20:22:32.169139] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T20:22:32.817526] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-10-08T20:22:33.409148] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T20:22:33.617574] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-08T20:22:34.140248] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:22:34.417629] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-08T20:22:34.443612] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T20:22:34.445898] [INFO ] [REMOTE ] MYD: Full fetch complete (20640 records). [2025-10-08T20:22:34.446026] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-08T20:22:34.938743] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-08T20:22:34.938872] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-08T20:22:34.939602] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-08T20:22:34.939693] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-08T20:22:34.940485] [DEBUG] [LOCAL ] MYD: Trimmed 20640 records to 13378 (keeping 200 days of data) [2025-10-08T20:22:35.037167] [DEBUG] [LOCAL ] MYD: Primary data saved (13378 records). [2025-10-08T20:22:35.037349] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-08T20:22:35.037442] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MYD took 31.6s. Estimated remaining: 2h 10m 14s. Rate: 7.1 symbols/min [2025-10-08T20:22:35.220814] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-08T20:22:35.254077] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:35.268279] [DEBUG] [LOCAL ] MYN: Loaded 9982 existing records from primary storage. [2025-10-08T20:22:35.268552] [INFO ] [MAIN ] MYN: Loaded 9982 existing records. [2025-10-08T20:22:35.497502] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T20:22:35.505120] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:22:35.509991] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-08T20:22:35.510444] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-08T20:22:35.510760] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-08T20:22:35.510838] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-08T20:22:35.943671] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:36.017551] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-08T20:22:36.132316] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T20:22:36.817613] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-08T20:22:37.024017] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T20:22:37.617737] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-08T20:22:38.050897] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T20:22:38.417579] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-10-08T20:22:38.454428] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T20:22:39.217535] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-08T20:22:39.333997] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T20:22:40.017526] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-08T20:22:40.264530] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T20:22:40.817566] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-08T20:22:41.018600] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T20:22:41.617545] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-08T20:22:41.732379] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T20:22:42.417586] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-08T20:22:43.148353] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T20:22:43.217533] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-08T20:22:43.639931] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T20:22:44.017552] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-08T20:22:44.706155] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T20:22:44.817505] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-08T20:22:45.132972] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:22:45.617804] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-08T20:22:45.802600] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T20:22:46.417557] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-08T20:22:46.921564] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T20:22:46.979787] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:22:46.981391] [INFO ] [REMOTE ] MX: Full fetch complete (31610 records). [2025-10-08T20:22:46.981470] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-08T20:22:46.982037] [FATAL] [VALIDATOR ] MX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:22:46.982141] [FATAL] [MAIN ] MX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:22:46.982224] [WARN ] [MAIN ] MX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:22:46.982313] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-08T20:22:46.982399] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-08T20:22:46.982438] [INFO ] [LOCAL ] MX: Starting deletion of derivative data. [2025-10-08T20:22:46.982481] [DEBUG] [LOCAL ] MX: No derivative data file found to delete. [2025-10-08T20:22:46.982540] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MX took 43.5s. Estimated remaining: 2h 10m 8s. Rate: 7.1 symbols/min [2025-10-08T20:22:47.150440] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:22:47.150696] [DEBUG] [LOCAL ] NABL: No existing data file found in primary storage. [2025-10-08T20:22:47.150749] [WARN ] [MAIN ] NABL: No existing data found, performing full refresh instead. [2025-10-08T20:22:47.150863] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-08T20:22:47.150904] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-08T20:22:47.150947] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-08T20:22:47.150978] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-08T20:22:47.222635] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-08T20:22:47.509547] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:22:48.017549] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-08T20:22:48.317375] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T20:22:48.817528] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-10-08T20:22:48.891201] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T20:22:49.617594] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-08T20:22:50.373398] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T20:22:50.417501] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-08T20:22:50.563351] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:22:51.217678] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-08T20:22:51.581181] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T20:22:51.907025] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T20:22:52.017581] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-08T20:22:52.817583] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-08T20:22:53.617558] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-08T20:22:54.417578] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-08T20:23:06.425233] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (12.01 seconds). [2025-10-08T20:23:06.428017] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-08T20:23:06.989943] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T20:23:06.993582] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-08T20:23:08.010029] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T20:23:08.014853] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-08T20:23:08.115446] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (14.50 seconds). [2025-10-08T20:23:08.123565] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-08T20:23:08.308042] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (15.49 seconds). [2025-10-08T20:23:08.313904] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-08T20:23:08.329195] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (16.31 seconds). [2025-10-08T20:23:08.334453] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-08T20:23:08.661290] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T20:23:08.664272] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-08T20:23:09.474858] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T20:23:09.477507] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T20:23:09.486375] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-08T20:23:09.486913] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-08T20:23:09.687838] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T20:23:09.698095] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-08T20:23:10.162436] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T20:23:10.166889] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-08T20:23:10.340514] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T20:23:10.346363] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-08T20:23:10.420944] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:23:10.425588] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-08T20:23:10.688984] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:23:10.690339] [INFO ] [REMOTE ] MYN: Full fetch complete (15278 records). [2025-10-08T20:23:10.690428] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-08T20:23:11.079741] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-08T20:23:11.079909] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-08T20:23:11.080322] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-08T20:23:11.080362] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-08T20:23:11.080953] [DEBUG] [LOCAL ] MYN: Trimmed 15278 records to 9882 (keeping 200 days of data) [2025-10-08T20:23:11.145837] [DEBUG] [LOCAL ] MYN: Primary data saved (9882 records). [2025-10-08T20:23:11.145992] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-08T20:23:11.146077] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYN took 36.1s. Estimated remaining: 2h 10m 10s. Rate: 7.1 symbols/min [2025-10-08T20:23:11.342956] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:11.374734] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T20:23:11.401164] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T20:23:11.407770] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-08T20:23:11.409404] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-08T20:23:11.429873] [DEBUG] [LOCAL ] NAC: Loaded 24598 existing records from primary storage. [2025-10-08T20:23:11.430347] [INFO ] [MAIN ] NAC: Loaded 24598 existing records. [2025-10-08T20:23:11.613086] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:23:11.613364] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-08T20:23:11.613411] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-08T20:23:11.613677] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-08T20:23:11.613735] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-08T20:23:11.866490] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T20:23:11.915721] [INFO ] [REMOTE ] MYE: Full fetch complete (36125 records). [2025-10-08T20:23:11.927327] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-08T20:23:11.944559] [FATAL] [VALIDATOR ] MYE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:23:11.982209] [FATAL] [MAIN ] MYE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:23:12.023040] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:12.024346] [WARN ] [MAIN ] MYE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:23:12.025965] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T20:23:12.023687] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-10-08T20:23:12.030524] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-08T20:23:12.031469] [DEBUG] [LOCAL ] MYE: No primary data file found to delete. [2025-10-08T20:23:12.031716] [INFO ] [LOCAL ] MYE: Starting deletion of derivative data. [2025-10-08T20:23:12.032178] [DEBUG] [LOCAL ] MYE: No derivative data file found to delete. [2025-10-08T20:23:12.032409] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 49.7s. Estimated remaining: 2h 9m 57s. Rate: 7.1 symbols/min [2025-10-08T20:23:12.075221] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-08T20:23:12.231099] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:12.271546] [DEBUG] [LOCAL ] NAD: Loaded 33873 existing records from primary storage. [2025-10-08T20:23:12.271865] [INFO ] [MAIN ] NAD: Loaded 33873 existing records. [2025-10-08T20:23:12.448037] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:23:12.448285] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-08T20:23:12.448332] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-08T20:23:12.448999] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-08T20:23:12.449067] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-08T20:23:12.810501] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:12.811096] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-10-08T20:23:12.964447] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:23:12.974054] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-08T20:23:13.320418] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T20:23:13.322222] [INFO ] [REMOTE ] MYI: Full fetch complete (29083 records). [2025-10-08T20:23:13.322296] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-08T20:23:13.731316] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-08T20:23:13.731980] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-08T20:23:13.733410] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T20:23:13.734107] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-08T20:23:13.741073] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-08T20:23:13.741159] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-08T20:23:13.742828] [DEBUG] [LOCAL ] MYI: Trimmed 29083 records to 19085 (keeping 200 days of data) [2025-10-08T20:23:13.873005] [DEBUG] [LOCAL ] MYI: Primary data saved (19085 records). [2025-10-08T20:23:13.873220] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-08T20:23:13.873444] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. MYI took 43.4s. Estimated remaining: 2h 9m 44s. Rate: 7.1 symbols/min [2025-10-08T20:23:14.055165] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:14.085998] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T20:23:14.100135] [DEBUG] [LOCAL ] NAN: Loaded 8456 existing records from primary storage. [2025-10-08T20:23:14.099854] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-08T20:23:14.100457] [INFO ] [MAIN ] NAN: Loaded 8456 existing records. [2025-10-08T20:23:14.296012] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:23:14.296851] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-08T20:23:14.297038] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-08T20:23:14.297564] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-08T20:23:14.297622] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-08T20:23:14.673595] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T20:23:14.697611] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:14.706494] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-10-08T20:23:14.707061] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-08T20:23:14.725594] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:23:14.732080] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-08T20:23:15.659752] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T20:23:15.667819] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-08T20:23:15.677506] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T20:23:15.680957] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-08T20:23:15.694833] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T20:23:15.763273] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T20:23:16.017553] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-08T20:23:16.672591] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T20:23:16.817513] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-08T20:23:17.117541] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T20:23:17.396900] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T20:23:17.617549] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-08T20:23:17.717839] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T20:23:18.417557] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-08T20:23:18.698470] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T20:23:19.217582] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-08T20:23:20.022676] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-08T20:23:20.043585] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T20:23:20.177170] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T20:23:20.817571] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-08T20:23:21.292701] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T20:23:21.617569] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-08T20:23:21.968062] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T20:23:22.417578] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-08T20:23:22.569938] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:23:23.217574] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-08T20:23:23.914009] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T20:23:23.914430] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T20:23:24.017573] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-08T20:23:24.817608] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-08T20:23:25.495062] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T20:23:25.500476] [INFO ] [REMOTE ] NABL: Full fetch complete (56612 records). [2025-10-08T20:23:25.500781] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-08T20:23:25.501720] [FATAL] [VALIDATOR ] NABL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:23:25.501814] [FATAL] [MAIN ] NABL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:23:25.501871] [WARN ] [MAIN ] NABL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:23:25.501918] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-08T20:23:25.502000] [DEBUG] [LOCAL ] NABL: No primary data file found to delete. [2025-10-08T20:23:25.502061] [INFO ] [LOCAL ] NABL: Starting deletion of derivative data. [2025-10-08T20:23:25.502121] [DEBUG] [LOCAL ] NABL: No derivative data file found to delete. [2025-10-08T20:23:25.502192] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. NABL took 38.5s. Estimated remaining: 2h 9m 38s. Rate: 7.1 symbols/min [2025-10-08T20:23:25.628627] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-08T20:23:25.665868] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T20:23:25.746098] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:25.746374] [DEBUG] [LOCAL ] NAT: No existing data file found in primary storage. [2025-10-08T20:23:25.746434] [WARN ] [MAIN ] NAT: No existing data found, performing full refresh instead. [2025-10-08T20:23:25.746558] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-08T20:23:25.746603] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-08T20:23:25.746671] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-08T20:23:25.746729] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-08T20:23:26.209426] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:26.318986] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T20:23:26.417695] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-08T20:23:27.217730] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-08T20:23:27.689866] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T20:23:28.017588] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-10-08T20:23:28.272931] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T20:23:28.817631] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-08T20:23:29.617594] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-08T20:23:29.744850] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T20:23:30.376698] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T20:23:30.407523] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:23:30.417555] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-08T20:23:31.217628] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-08T20:23:31.314116] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T20:23:32.017616] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-08T20:23:32.817540] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-08T20:23:33.157888] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T20:23:33.298464] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T20:23:33.617619] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-08T20:23:34.115783] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T20:23:34.417600] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-08T20:23:34.789103] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T20:23:35.217636] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-08T20:23:36.017584] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-08T20:23:36.049127] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T20:23:36.275932] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T20:23:36.817733] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-08T20:23:37.436164] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T20:23:37.515976] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:23:37.617572] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-08T20:23:38.417688] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-08T20:23:38.832700] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T20:23:38.837975] [INFO ] [REMOTE ] NAD: Full fetch complete (49383 records). [2025-10-08T20:23:38.838147] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-08T20:23:39.218335] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-08T20:23:39.262521] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-08T20:23:39.262687] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-08T20:23:39.264061] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-08T20:23:39.264157] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-08T20:23:39.266139] [DEBUG] [LOCAL ] NAD: Trimmed 49383 records to 33875 (keeping 200 days of data) [2025-10-08T20:23:39.504772] [DEBUG] [LOCAL ] NAD: Primary data saved (33875 records). [2025-10-08T20:23:39.505012] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-08T20:23:39.505168] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAD took 27.5s. Estimated remaining: 2h 9m 33s. Rate: 7.1 symbols/min [2025-10-08T20:23:39.706636] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:39.707196] [DEBUG] [LOCAL ] NATL: No existing data file found in primary storage. [2025-10-08T20:23:39.707252] [WARN ] [MAIN ] NATL: No existing data found, performing full refresh instead. [2025-10-08T20:23:39.707383] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-08T20:23:39.707427] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-08T20:23:39.707468] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-08T20:23:39.707503] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-08T20:23:40.023198] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T20:23:40.020917] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-08T20:23:40.144864] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:40.817545] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-08T20:23:40.817433] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T20:23:40.858453] [INFO ] [REMOTE ] NAN: Full fetch complete (13605 records). [2025-10-08T20:23:40.859127] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-08T20:23:40.864482] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T20:23:41.309694] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-08T20:23:41.309890] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-08T20:23:41.310594] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-08T20:23:41.310670] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-08T20:23:41.311822] [DEBUG] [LOCAL ] NAN: Trimmed 13605 records to 8428 (keeping 200 days of data) [2025-10-08T20:23:41.376298] [DEBUG] [LOCAL ] NAN: Primary data saved (8428 records). [2025-10-08T20:23:41.376513] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-08T20:23:41.376636] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NAN took 27.5s. Estimated remaining: 2h 9m 20s. Rate: 7.1 symbols/min [2025-10-08T20:23:41.573052] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:41.579952] [DEBUG] [LOCAL ] NAZ: Loaded 2646 existing records from primary storage. [2025-10-08T20:23:41.580284] [INFO ] [MAIN ] NAZ: Loaded 2646 existing records. [2025-10-08T20:23:41.622825] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-10-08T20:23:41.787015] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:23:41.787762] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-08T20:23:41.787859] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-08T20:23:41.788046] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-08T20:23:41.788108] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-08T20:23:41.924032] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T20:23:41.978384] [INFO ] [REMOTE ] NAC: Full fetch complete (35863 records). [2025-10-08T20:23:42.040342] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-08T20:23:42.398271] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:42.426042] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-08T20:23:42.675251] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-08T20:23:42.675361] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-08T20:23:42.676299] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-08T20:23:42.676370] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-08T20:23:42.677479] [DEBUG] [LOCAL ] NAC: Trimmed 35863 records to 24576 (keeping 200 days of data) [2025-10-08T20:23:42.847167] [DEBUG] [LOCAL ] NAC: Primary data saved (24576 records). [2025-10-08T20:23:42.847341] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-08T20:23:42.847668] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAC took 31.7s. Estimated remaining: 2h 9m 7s. Rate: 7.1 symbols/min [2025-10-08T20:23:43.031309] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:23:43.044827] [DEBUG] [LOCAL ] NBB: Loaded 9141 existing records from primary storage. [2025-10-08T20:23:43.045101] [INFO ] [MAIN ] NBB: Loaded 9141 existing records. [2025-10-08T20:23:43.215629] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T20:23:43.220968] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-10-08T20:23:43.293128] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:23:43.293375] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-08T20:23:43.293427] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-08T20:23:43.293625] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-08T20:23:43.293727] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-08T20:23:43.712541] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:23:43.944793] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T20:23:44.017577] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-10-08T20:23:44.085992] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T20:23:44.817567] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-08T20:23:44.980965] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T20:23:45.617681] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-08T20:23:46.402853] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T20:23:46.403403] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T20:23:46.418722] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-08T20:23:47.217577] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-08T20:23:47.729190] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T20:23:47.764292] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T20:23:48.017598] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-08T20:23:48.817588] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-08T20:23:49.617587] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-08T20:23:50.417593] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-08T20:23:50.547763] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-08T20:23:51.217549] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-08T20:23:51.272758] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-08T20:23:52.017596] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-08T20:23:52.466986] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T20:23:52.527319] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (2.91 seconds). [2025-10-08T20:23:52.817602] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-08T20:23:53.617608] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-08T20:23:54.318609] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-08T20:23:54.417540] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-08T20:23:54.719937] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T20:23:54.796604] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (3.58 seconds). [2025-10-08T20:23:55.217565] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-08T20:23:55.456121] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T20:23:55.802122] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T20:23:56.017718] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-08T20:23:56.436708] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T20:23:56.608306] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T20:23:56.817538] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-08T20:23:57.617615] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-08T20:23:58.176237] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T20:23:58.417579] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-08T20:23:59.093976] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T20:23:59.217554] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-08T20:23:59.494903] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:23:59.710125] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T20:24:00.017557] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-08T20:24:00.634331] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T20:24:00.817606] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-08T20:24:01.617605] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-08T20:24:02.417547] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-08T20:24:02.734381] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T20:24:02.797376] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T20:24:02.860079] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T20:24:03.217572] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-08T20:24:03.745213] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:24:03.749786] [INFO ] [REMOTE ] NAT: Full fetch complete (71716 records). [2025-10-08T20:24:03.749964] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-08T20:24:03.750924] [FATAL] [VALIDATOR ] NAT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:03.751027] [FATAL] [MAIN ] NAT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:03.751080] [WARN ] [MAIN ] NAT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:03.751129] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-08T20:24:03.751198] [DEBUG] [LOCAL ] NAT: No primary data file found to delete. [2025-10-08T20:24:03.751246] [INFO ] [LOCAL ] NAT: Starting deletion of derivative data. [2025-10-08T20:24:03.751300] [DEBUG] [LOCAL ] NAT: No derivative data file found to delete. [2025-10-08T20:24:03.751393] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAT took 38.2s. Estimated remaining: 2h 9m 7s. Rate: 7.1 symbols/min [2025-10-08T20:24:03.941555] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:03.941825] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-10-08T20:24:03.941878] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-10-08T20:24:03.941994] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-08T20:24:03.942047] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-08T20:24:03.942130] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-08T20:24:03.942175] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-08T20:24:04.022829] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-08T20:24:04.310823] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:04.817603] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-08T20:24:05.440776] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:24:05.617507] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-10-08T20:24:05.728051] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T20:24:06.417520] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-08T20:24:06.486767] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T20:24:07.217551] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-08T20:24:08.019425] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-08T20:24:08.021832] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T20:24:08.191043] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T20:24:08.418433] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T20:24:08.817557] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-08T20:24:09.324319] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T20:24:09.617568] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-08T20:24:10.417557] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-08T20:24:10.868336] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T20:24:10.977473] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:24:10.980024] [INFO ] [REMOTE ] NATL: Full fetch complete (45178 records). [2025-10-08T20:24:10.980179] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-08T20:24:10.980975] [FATAL] [VALIDATOR ] NATL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:10.981097] [FATAL] [MAIN ] NATL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:10.981162] [WARN ] [MAIN ] NATL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:10.981233] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-08T20:24:10.981300] [DEBUG] [LOCAL ] NATL: No primary data file found to delete. [2025-10-08T20:24:10.981336] [INFO ] [LOCAL ] NATL: Starting deletion of derivative data. [2025-10-08T20:24:10.981375] [DEBUG] [LOCAL ] NATL: No derivative data file found to delete. [2025-10-08T20:24:10.981436] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NATL took 31.5s. Estimated remaining: 2h 8m 58s. Rate: 7.1 symbols/min [2025-10-08T20:24:11.221672] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:11.221745] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-08T20:24:11.222008] [DEBUG] [LOCAL ] NBR: No existing data file found in primary storage. [2025-10-08T20:24:11.222096] [WARN ] [MAIN ] NBR: No existing data found, performing full refresh instead. [2025-10-08T20:24:11.223108] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-08T20:24:11.223162] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-08T20:24:11.223207] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-08T20:24:11.223241] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-08T20:24:11.640203] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:12.002452] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T20:24:12.017588] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-08T20:24:12.817563] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-10-08T20:24:13.013499] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T20:24:13.617597] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-08T20:24:14.321510] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:24:14.359752] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T20:24:14.417568] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-08T20:24:15.217620] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-08T20:24:15.635026] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T20:24:16.017561] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-08T20:24:16.216577] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:24:16.614688] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T20:24:16.817698] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-08T20:24:17.617547] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-08T20:24:18.166249] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T20:24:18.167303] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T20:24:18.174393] [INFO ] [REMOTE ] NBB: Full fetch complete (13796 records). [2025-10-08T20:24:18.174783] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-08T20:24:18.425972] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-08T20:24:18.563531] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-08T20:24:18.563679] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-08T20:24:18.564251] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-08T20:24:18.564315] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-08T20:24:18.565308] [DEBUG] [LOCAL ] NBB: Trimmed 13796 records to 9080 (keeping 200 days of data) [2025-10-08T20:24:18.625282] [DEBUG] [LOCAL ] NBB: Primary data saved (9080 records). [2025-10-08T20:24:18.625435] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-08T20:24:18.625557] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NBB took 35.8s. Estimated remaining: 2h 8m 49s. Rate: 7.1 symbols/min [2025-10-08T20:24:18.802305] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:18.802503] [DEBUG] [LOCAL ] NBXG: No existing data file found in primary storage. [2025-10-08T20:24:18.802542] [WARN ] [MAIN ] NBXG: No existing data found, performing full refresh instead. [2025-10-08T20:24:18.802714] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-08T20:24:18.802777] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-08T20:24:18.802847] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-08T20:24:18.802882] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-08T20:24:19.174594] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:19.217600] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-08T20:24:19.627226] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T20:24:20.017551] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-08T20:24:20.659982] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T20:24:20.817629] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-08T20:24:20.975472] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T20:24:21.346551] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:24:21.347491] [INFO ] [REMOTE ] NAZ: Full fetch complete (4326 records). [2025-10-08T20:24:21.347561] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-08T20:24:21.622698] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-08T20:24:21.744680] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-08T20:24:21.744774] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-08T20:24:21.744922] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-08T20:24:21.744961] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-08T20:24:21.745491] [DEBUG] [LOCAL ] NAZ: Trimmed 4326 records to 2649 (keeping 200 days of data) [2025-10-08T20:24:21.766358] [DEBUG] [LOCAL ] NAZ: Primary data saved (2649 records). [2025-10-08T20:24:21.766591] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-08T20:24:21.766786] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NAZ took 40.4s. Estimated remaining: 2h 8m 37s. Rate: 7.1 symbols/min [2025-10-08T20:24:21.971917] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:21.972126] [DEBUG] [LOCAL ] NC: No existing data file found in primary storage. [2025-10-08T20:24:21.972177] [WARN ] [MAIN ] NC: No existing data found, performing full refresh instead. [2025-10-08T20:24:21.972321] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-08T20:24:21.972399] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-08T20:24:21.972463] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-08T20:24:21.972498] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-08T20:24:22.343625] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:22.417544] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-10-08T20:24:22.938396] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T20:24:23.217595] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-08T20:24:23.742114] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:24:24.017568] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-08T20:24:24.187812] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T20:24:24.817689] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-08T20:24:24.910191] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T20:24:25.617566] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-08T20:24:26.324878] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T20:24:26.417508] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-08T20:24:27.195482] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T20:24:27.217558] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-10-08T20:24:27.719242] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T20:24:27.825254] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T20:24:28.017583] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-08T20:24:28.483666] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T20:24:28.817539] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-08T20:24:29.416441] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T20:24:29.617582] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-08T20:24:30.417633] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-08T20:24:31.177388] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:24:31.217511] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-08T20:24:31.689614] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T20:24:32.017613] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-08T20:24:32.488846] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T20:24:32.602524] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T20:24:32.817539] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-08T20:24:33.425339] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T20:24:33.617548] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-08T20:24:34.417588] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-08T20:24:35.005585] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T20:24:35.019633] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:24:35.021870] [INFO ] [REMOTE ] NBHC: Full fetch complete (32384 records). [2025-10-08T20:24:35.021989] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-08T20:24:35.022827] [FATAL] [VALIDATOR ] NBHC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:35.022915] [FATAL] [MAIN ] NBHC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:35.022958] [WARN ] [MAIN ] NBHC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:35.023020] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-08T20:24:35.023111] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-10-08T20:24:35.023166] [INFO ] [LOCAL ] NBHC: Starting deletion of derivative data. [2025-10-08T20:24:35.023257] [DEBUG] [LOCAL ] NBHC: No derivative data file found to delete. [2025-10-08T20:24:35.023357] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBHC took 31.3s. Estimated remaining: 2h 8m 32s. Rate: 7.1 symbols/min [2025-10-08T20:24:35.210639] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:35.218365] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-08T20:24:35.225458] [DEBUG] [LOCAL ] NCA: Loaded 10064 existing records from primary storage. [2025-10-08T20:24:35.225806] [INFO ] [MAIN ] NCA: Loaded 10064 existing records. [2025-10-08T20:24:35.424182] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:24:35.424438] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-08T20:24:35.424485] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-08T20:24:35.424723] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-08T20:24:35.424781] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-08T20:24:35.772743] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:36.017560] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-10-08T20:24:36.706020] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T20:24:36.817581] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-08T20:24:37.177095] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T20:24:37.617599] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-08T20:24:38.067873] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T20:24:38.417581] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-08T20:24:38.866297] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T20:24:38.931480] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:24:38.933788] [INFO ] [REMOTE ] NBR: Full fetch complete (49182 records). [2025-10-08T20:24:38.933900] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-08T20:24:38.934808] [FATAL] [VALIDATOR ] NBR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:38.934912] [FATAL] [MAIN ] NBR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:38.934996] [WARN ] [MAIN ] NBR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:38.935119] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-08T20:24:38.935200] [DEBUG] [LOCAL ] NBR: No primary data file found to delete. [2025-10-08T20:24:38.935239] [INFO ] [LOCAL ] NBR: Starting deletion of derivative data. [2025-10-08T20:24:38.935280] [DEBUG] [LOCAL ] NBR: No derivative data file found to delete. [2025-10-08T20:24:38.935342] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 28.0s. Estimated remaining: 2h 8m 20s. Rate: 7.1 symbols/min [2025-10-08T20:24:39.111476] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:39.111679] [DEBUG] [LOCAL ] NCDL: No existing data file found in primary storage. [2025-10-08T20:24:39.111735] [WARN ] [MAIN ] NCDL: No existing data found, performing full refresh instead. [2025-10-08T20:24:39.112041] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-08T20:24:39.112087] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-08T20:24:39.112168] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-08T20:24:39.112246] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-08T20:24:39.222683] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-08T20:24:39.501714] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:39.938621] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T20:24:40.017601] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-08T20:24:40.817567] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-08T20:24:41.095792] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T20:24:41.266270] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T20:24:41.617577] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-08T20:24:42.103530] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T20:24:42.417631] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-10-08T20:24:43.217578] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-08T20:24:43.820533] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:24:43.830900] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T20:24:44.017634] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-08T20:24:44.817524] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-08T20:24:44.860330] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T20:24:45.354420] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T20:24:45.617543] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-08T20:24:46.331992] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T20:24:46.417541] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-08T20:24:46.940024] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T20:24:47.217569] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-08T20:24:47.471212] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-08T20:24:47.472256] [INFO ] [REMOTE ] NC: Full fetch complete (2719 records). [2025-10-08T20:24:47.472345] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-08T20:24:47.472908] [FATAL] [VALIDATOR ] NC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:47.473010] [FATAL] [MAIN ] NC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:47.473139] [WARN ] [MAIN ] NC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:47.473224] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-08T20:24:47.473310] [DEBUG] [LOCAL ] NC: No primary data file found to delete. [2025-10-08T20:24:47.473387] [INFO ] [LOCAL ] NC: Starting deletion of derivative data. [2025-10-08T20:24:47.473450] [DEBUG] [LOCAL ] NC: No derivative data file found to delete. [2025-10-08T20:24:47.473519] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NC took 25.7s. Estimated remaining: 2h 8m 12s. Rate: 7.1 symbols/min [2025-10-08T20:24:47.662402] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:47.662747] [DEBUG] [LOCAL ] NCLH: No existing data file found in primary storage. [2025-10-08T20:24:47.662819] [WARN ] [MAIN ] NCLH: No existing data found, performing full refresh instead. [2025-10-08T20:24:47.662971] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-08T20:24:47.663032] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-08T20:24:47.663094] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-08T20:24:47.663143] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-08T20:24:48.031377] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-08T20:24:48.037096] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:24:48.817543] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-08T20:24:49.253607] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T20:24:49.617594] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-10-08T20:24:49.742474] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T20:24:50.417577] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-08T20:24:51.217603] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-08T20:24:51.416203] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T20:24:51.512269] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T20:24:52.017624] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-08T20:24:52.748756] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T20:24:52.817623] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-08T20:24:53.617580] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-08T20:24:53.806987] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T20:24:54.417527] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-08T20:24:54.896808] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T20:24:54.987213] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.97 seconds). [2025-10-08T20:24:55.217636] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-08T20:24:56.017522] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-08T20:24:56.163797] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T20:24:56.181090] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T20:24:56.817565] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-08T20:24:57.617560] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-08T20:24:57.789347] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T20:24:58.069820] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T20:24:58.192208] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:24:58.417561] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-08T20:24:58.904518] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T20:24:58.906435] [INFO ] [REMOTE ] NBXG: Full fetch complete (32669 records). [2025-10-08T20:24:58.906509] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-08T20:24:58.907085] [FATAL] [VALIDATOR ] NBXG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:24:58.907169] [FATAL] [MAIN ] NBXG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:24:58.907212] [WARN ] [MAIN ] NBXG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:24:58.907275] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-08T20:24:58.907338] [DEBUG] [LOCAL ] NBXG: No primary data file found to delete. [2025-10-08T20:24:58.907372] [INFO ] [LOCAL ] NBXG: Starting deletion of derivative data. [2025-10-08T20:24:58.907437] [DEBUG] [LOCAL ] NBXG: No derivative data file found to delete. [2025-10-08T20:24:58.907513] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NBXG took 40.3s. Estimated remaining: 2h 8m 5s. Rate: 7.1 symbols/min [2025-10-08T20:24:59.080692] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:24:59.097229] [DEBUG] [LOCAL ] NCV: Loaded 13857 existing records from primary storage. [2025-10-08T20:24:59.097477] [INFO ] [MAIN ] NCV: Loaded 13857 existing records. [2025-10-08T20:24:59.222718] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-08T20:24:59.284825] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:24:59.285053] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-08T20:24:59.285100] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-08T20:24:59.285349] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-08T20:24:59.285409] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-08T20:24:59.658216] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:00.017536] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-10-08T20:25:00.207594] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T20:25:00.817554] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-08T20:25:01.063805] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:25:01.617565] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-08T20:25:01.748424] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:25:02.417560] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-08T20:25:02.747781] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:25:03.217604] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-08T20:25:03.361942] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T20:25:04.017543] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-08T20:25:04.817523] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-08T20:25:05.218316] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T20:25:05.335478] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T20:25:05.482210] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-08T20:25:05.617535] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-08T20:25:06.417545] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-08T20:25:07.217560] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-08T20:25:08.017573] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-08T20:25:08.064756] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T20:25:08.121232] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T20:25:08.186459] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-08T20:25:08.657011] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T20:25:08.817534] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-08T20:25:09.617518] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-08T20:25:09.840744] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T20:25:10.362480] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:25:10.363586] [INFO ] [REMOTE ] NCA: Full fetch complete (15263 records). [2025-10-08T20:25:10.363690] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-08T20:25:10.425131] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-08T20:25:10.730661] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-08T20:25:10.730770] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-08T20:25:10.731136] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-08T20:25:10.731176] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-08T20:25:10.731687] [DEBUG] [LOCAL ] NCA: Trimmed 15263 records to 10027 (keeping 200 days of data) [2025-10-08T20:25:10.794367] [DEBUG] [LOCAL ] NCA: Primary data saved (10027 records). [2025-10-08T20:25:10.794497] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-08T20:25:10.794579] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 35.8s. Estimated remaining: 2h 7m 59s. Rate: 7.1 symbols/min [2025-10-08T20:25:10.962752] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:10.977233] [DEBUG] [LOCAL ] NCZ: Loaded 12108 existing records from primary storage. [2025-10-08T20:25:10.977474] [INFO ] [MAIN ] NCZ: Loaded 12108 existing records. [2025-10-08T20:25:11.155030] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:25:11.155239] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-08T20:25:11.155286] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-08T20:25:11.155528] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-08T20:25:11.155587] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-08T20:25:11.222633] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-08T20:25:11.511315] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:11.700200] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T20:25:12.017550] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-08T20:25:12.817614] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-10-08T20:25:13.228272] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T20:25:13.426893] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T20:25:13.617628] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-08T20:25:13.768196] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T20:25:14.417518] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-08T20:25:14.431740] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T20:25:15.217602] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-08T20:25:16.017637] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-08T20:25:16.116184] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T20:25:16.457476] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T20:25:16.804506] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T20:25:16.817498] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-08T20:25:17.617558] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-08T20:25:17.715177] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T20:25:18.116798] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:25:18.119093] [INFO ] [REMOTE ] NCDL: Full fetch complete (32734 records). [2025-10-08T20:25:18.119172] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-08T20:25:18.119794] [FATAL] [VALIDATOR ] NCDL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:25:18.119889] [FATAL] [MAIN ] NCDL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:25:18.119940] [WARN ] [MAIN ] NCDL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:25:18.119987] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-08T20:25:18.120053] [DEBUG] [LOCAL ] NCDL: No primary data file found to delete. [2025-10-08T20:25:18.120100] [INFO ] [LOCAL ] NCDL: Starting deletion of derivative data. [2025-10-08T20:25:18.120158] [DEBUG] [LOCAL ] NCDL: No derivative data file found to delete. [2025-10-08T20:25:18.120230] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 39.2s. Estimated remaining: 2h 7m 50s. Rate: 7.1 symbols/min [2025-10-08T20:25:18.312505] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:18.312772] [DEBUG] [LOCAL ] NDMO: No existing data file found in primary storage. [2025-10-08T20:25:18.312844] [WARN ] [MAIN ] NDMO: No existing data found, performing full refresh instead. [2025-10-08T20:25:18.312972] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-08T20:25:18.313016] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-08T20:25:18.313070] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-08T20:25:18.313129] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-08T20:25:18.422683] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-08T20:25:18.709250] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:19.217523] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-10-08T20:25:19.609182] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T20:25:20.017558] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-08T20:25:20.234334] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:25:20.817565] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-08T20:25:20.922543] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T20:25:21.617578] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-08T20:25:21.680357] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T20:25:22.417567] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-08T20:25:23.217552] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-08T20:25:23.275344] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T20:25:23.765937] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-08T20:25:24.017559] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-08T20:25:24.362933] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T20:25:24.817554] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-08T20:25:25.617544] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-08T20:25:25.728089] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T20:25:25.730499] [INFO ] [REMOTE ] NCV: Full fetch complete (22479 records). [2025-10-08T20:25:25.730622] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-08T20:25:26.169886] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-08T20:25:26.169974] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-08T20:25:26.170455] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-08T20:25:26.170495] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-08T20:25:26.171233] [DEBUG] [LOCAL ] NCV: Trimmed 22479 records to 13909 (keeping 200 days of data) [2025-10-08T20:25:26.263101] [DEBUG] [LOCAL ] NCV: Primary data saved (13909 records). [2025-10-08T20:25:26.263259] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-08T20:25:26.263348] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCV took 27.4s. Estimated remaining: 2h 7m 41s. Rate: 7.1 symbols/min [2025-10-08T20:25:26.422516] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-08T20:25:26.452351] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:26.461194] [DEBUG] [LOCAL ] NE: No existing data file found in primary storage. [2025-10-08T20:25:26.461477] [WARN ] [MAIN ] NE: No existing data found, performing full refresh instead. [2025-10-08T20:25:26.463092] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T20:25:26.462506] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-08T20:25:26.463271] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-08T20:25:26.466636] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-08T20:25:26.500200] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-08T20:25:26.586008] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-08T20:25:26.872768] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:27.113672] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T20:25:27.217596] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-08T20:25:28.017594] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-08T20:25:28.195882] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T20:25:28.817523] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-10-08T20:25:28.841679] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T20:25:29.617553] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-08T20:25:30.417533] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-08T20:25:30.428437] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T20:25:30.557945] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T20:25:31.217706] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-08T20:25:31.309158] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T20:25:31.808766] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T20:25:32.017596] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-08T20:25:32.817571] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-08T20:25:33.617517] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-08T20:25:33.828559] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T20:25:34.227858] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T20:25:34.264709] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T20:25:34.417511] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-08T20:25:35.217552] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-08T20:25:36.017526] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-08T20:25:36.308223] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T20:25:36.557109] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T20:25:36.730520] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T20:25:36.817498] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-08T20:25:37.550513] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T20:25:37.617501] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-08T20:25:38.249960] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T20:25:38.251718] [INFO ] [REMOTE ] NCZ: Full fetch complete (21265 records). [2025-10-08T20:25:38.251795] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-08T20:25:38.421686] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-08T20:25:38.645302] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-08T20:25:38.645382] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-08T20:25:38.645876] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-08T20:25:38.645939] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-08T20:25:38.646522] [DEBUG] [LOCAL ] NCZ: Trimmed 21265 records to 12196 (keeping 200 days of data) [2025-10-08T20:25:38.723036] [DEBUG] [LOCAL ] NCZ: Primary data saved (12196 records). [2025-10-08T20:25:38.723195] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-08T20:25:38.723288] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCZ took 27.9s. Estimated remaining: 2h 7m 36s. Rate: 7.1 symbols/min [2025-10-08T20:25:38.942385] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:38.984430] [DEBUG] [LOCAL ] NEA: Loaded 35491 existing records from primary storage. [2025-10-08T20:25:38.984743] [INFO ] [MAIN ] NEA: Loaded 35491 existing records. [2025-10-08T20:25:39.172876] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:25:39.173158] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-08T20:25:39.173219] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-08T20:25:39.173488] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-08T20:25:39.173546] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-08T20:25:39.229174] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-08T20:25:39.535739] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:40.017515] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-08T20:25:40.123161] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T20:25:40.273064] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T20:25:40.764194] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T20:25:40.768594] [INFO ] [REMOTE ] NCLH: Full fetch complete (77420 records). [2025-10-08T20:25:40.769003] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-08T20:25:40.771969] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:25:40.772096] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:25:40.772176] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:25:40.772265] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-08T20:25:40.772353] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-10-08T20:25:40.772417] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-10-08T20:25:40.772499] [DEBUG] [LOCAL ] NCLH: No derivative data file found to delete. [2025-10-08T20:25:40.772594] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCLH took 53.3s. Estimated remaining: 2h 7m 23s. Rate: 7.1 symbols/min [2025-10-08T20:25:40.822768] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-10-08T20:25:40.984165] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:40.984409] [DEBUG] [LOCAL ] NEE: No existing data file found in primary storage. [2025-10-08T20:25:40.984464] [WARN ] [MAIN ] NEE: No existing data found, performing full refresh instead. [2025-10-08T20:25:40.984581] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-08T20:25:40.984623] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-08T20:25:40.984707] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-08T20:25:40.984751] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-08T20:25:41.375988] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:41.617572] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-08T20:25:42.197400] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T20:25:42.417515] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-08T20:25:43.217636] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-08T20:25:43.453234] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T20:25:43.570050] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T20:25:43.956999] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T20:25:44.017564] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-08T20:25:44.817577] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-08T20:25:45.183711] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T20:25:45.586139] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T20:25:45.617549] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-10-08T20:25:46.417606] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-08T20:25:47.217611] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-08T20:25:47.410835] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T20:25:47.469063] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T20:25:48.017602] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-08T20:25:48.412590] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T20:25:48.817548] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-08T20:25:49.617509] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-08T20:25:49.739420] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T20:25:50.417543] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-08T20:25:50.768140] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T20:25:51.051357] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T20:25:51.217555] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-08T20:25:52.017582] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-08T20:25:52.255744] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T20:25:52.817567] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-08T20:25:52.876857] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T20:25:53.324433] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-08T20:25:53.617633] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-08T20:25:54.417547] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-08T20:25:54.724374] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:25:54.728265] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T20:25:54.739204] [INFO ] [REMOTE ] NDMO: Full fetch complete (24128 records). [2025-10-08T20:25:54.740263] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-08T20:25:54.741329] [FATAL] [VALIDATOR ] NDMO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:25:54.741713] [FATAL] [MAIN ] NDMO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:25:54.741783] [WARN ] [MAIN ] NDMO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:25:54.741854] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-08T20:25:54.741922] [DEBUG] [LOCAL ] NDMO: No primary data file found to delete. [2025-10-08T20:25:54.741960] [INFO ] [LOCAL ] NDMO: Starting deletion of derivative data. [2025-10-08T20:25:54.742018] [DEBUG] [LOCAL ] NDMO: No derivative data file found to delete. [2025-10-08T20:25:54.742101] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NDMO took 36.6s. Estimated remaining: 2h 7m 18s. Rate: 7.1 symbols/min [2025-10-08T20:25:54.925130] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:25:54.925353] [DEBUG] [LOCAL ] NEM: No existing data file found in primary storage. [2025-10-08T20:25:54.925422] [WARN ] [MAIN ] NEM: No existing data found, performing full refresh instead. [2025-10-08T20:25:54.925563] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-08T20:25:54.925718] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-08T20:25:54.925777] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-08T20:25:54.925812] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-08T20:25:55.222636] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-08T20:25:55.236563] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T20:25:55.333495] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:25:56.017559] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-10-08T20:25:56.817556] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-08T20:25:57.617556] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-08T20:25:58.123220] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-08T20:25:58.417530] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-08T20:25:58.451413] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T20:25:58.700144] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:25:58.881001] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-10-08T20:25:59.217590] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-08T20:26:00.017618] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-08T20:26:00.463031] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T20:26:00.817545] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-08T20:26:01.078631] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-08T20:26:01.617596] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-08T20:26:02.050958] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-08T20:26:02.395914] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T20:26:02.417556] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-08T20:26:02.954715] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:26:02.959795] [INFO ] [REMOTE ] NE: Full fetch complete (75159 records). [2025-10-08T20:26:02.959920] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-08T20:26:02.962368] [FATAL] [VALIDATOR ] NE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:02.962474] [FATAL] [MAIN ] NE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:02.962519] [WARN ] [MAIN ] NE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:02.962559] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-08T20:26:02.962616] [DEBUG] [LOCAL ] NE: No primary data file found to delete. [2025-10-08T20:26:02.962678] [INFO ] [LOCAL ] NE: Starting deletion of derivative data. [2025-10-08T20:26:02.962741] [DEBUG] [LOCAL ] NE: No derivative data file found to delete. [2025-10-08T20:26:02.962818] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NE took 36.7s. Estimated remaining: 2h 7m 10s. Rate: 7.1 symbols/min [2025-10-08T20:26:03.152699] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:03.152912] [DEBUG] [LOCAL ] NET: No existing data file found in primary storage. [2025-10-08T20:26:03.152968] [WARN ] [MAIN ] NET: No existing data found, performing full refresh instead. [2025-10-08T20:26:03.153114] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-08T20:26:03.153192] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-08T20:26:03.153262] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-08T20:26:03.153298] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-08T20:26:03.227202] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-08T20:26:03.520156] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:03.612203] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-08T20:26:04.017559] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-08T20:26:04.420246] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T20:26:04.817554] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-08T20:26:05.617547] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-08T20:26:05.778203] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T20:26:06.417567] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-08T20:26:06.598845] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T20:26:06.601699] [INFO ] [REMOTE ] NEA: Full fetch complete (51678 records). [2025-10-08T20:26:06.601811] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-08T20:26:07.050806] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-08T20:26:07.080898] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-08T20:26:07.081009] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-08T20:26:07.082003] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-08T20:26:07.082072] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-08T20:26:07.083387] [DEBUG] [LOCAL ] NEA: Trimmed 51678 records to 35470 (keeping 200 days of data) [2025-10-08T20:26:07.253612] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-10-08T20:26:07.312712] [DEBUG] [LOCAL ] NEA: Primary data saved (35470 records). [2025-10-08T20:26:07.312875] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-08T20:26:07.314376] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 28.6s. Estimated remaining: 2h 6m 59s. Rate: 7.1 symbols/min [2025-10-08T20:26:07.484175] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:07.484363] [DEBUG] [LOCAL ] NEU: No existing data file found in primary storage. [2025-10-08T20:26:07.484401] [WARN ] [MAIN ] NEU: No existing data found, performing full refresh instead. [2025-10-08T20:26:07.484511] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-08T20:26:07.484552] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-08T20:26:07.484592] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-08T20:26:07.484624] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-08T20:26:07.834122] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:08.017568] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-08T20:26:08.762065] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T20:26:08.817591] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-08T20:26:08.949975] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T20:26:09.617518] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-08T20:26:09.835997] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T20:26:10.417529] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-08T20:26:10.835143] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-08T20:26:11.217594] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-10-08T20:26:11.368634] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T20:26:11.890486] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T20:26:12.017530] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-08T20:26:12.419787] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T20:26:12.733449] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T20:26:12.817526] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-08T20:26:13.617573] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-08T20:26:14.417548] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-08T20:26:15.143409] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-08T20:26:15.217520] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-08T20:26:15.270864] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T20:26:15.545753] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T20:26:15.623033] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T20:26:15.627056] [INFO ] [REMOTE ] NEE: Full fetch complete (77369 records). [2025-10-08T20:26:15.627250] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-08T20:26:15.629708] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:15.629804] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:15.629848] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:15.629889] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-08T20:26:15.629950] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-10-08T20:26:15.629987] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-10-08T20:26:15.630027] [DEBUG] [LOCAL ] NEE: No derivative data file found to delete. [2025-10-08T20:26:15.630100] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEE took 34.9s. Estimated remaining: 2h 6m 50s. Rate: 7.1 symbols/min [2025-10-08T20:26:15.843979] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:15.844156] [DEBUG] [LOCAL ] NEXA: No existing data file found in primary storage. [2025-10-08T20:26:15.844192] [WARN ] [MAIN ] NEXA: No existing data found, performing full refresh instead. [2025-10-08T20:26:15.844306] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-08T20:26:15.844348] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-08T20:26:15.844388] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-08T20:26:15.844418] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-08T20:26:16.025744] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-08T20:26:16.244005] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:16.817546] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-10-08T20:26:16.954295] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T20:26:17.511458] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T20:26:17.617599] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-08T20:26:18.417598] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-08T20:26:19.217526] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-08T20:26:19.235014] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T20:26:19.770502] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T20:26:20.017640] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-08T20:26:20.751300] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T20:26:20.817567] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-08T20:26:21.112696] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T20:26:21.217533] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T20:26:21.617557] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-08T20:26:22.417549] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-08T20:26:23.217690] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-08T20:26:23.313971] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:26:23.651032] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-08T20:26:24.017591] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-08T20:26:24.616737] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T20:26:24.817562] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-08T20:26:25.573906] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T20:26:25.578062] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-08T20:26:25.617537] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-08T20:26:26.110980] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T20:26:26.417558] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-08T20:26:26.920976] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T20:26:27.217615] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-08T20:26:27.616185] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T20:26:28.017578] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-08T20:26:28.817539] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-08T20:26:29.372811] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T20:26:29.617569] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-08T20:26:30.287799] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-08T20:26:30.311270] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T20:26:30.417558] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-08T20:26:31.217554] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-08T20:26:31.821438] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:26:31.822573] [INFO ] [REMOTE ] NEXA: Full fetch complete (7593 records). [2025-10-08T20:26:31.822674] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-08T20:26:31.823094] [FATAL] [VALIDATOR ] NEXA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:31.823195] [FATAL] [MAIN ] NEXA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:31.823272] [WARN ] [MAIN ] NEXA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:31.823371] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-08T20:26:31.823451] [DEBUG] [LOCAL ] NEXA: No primary data file found to delete. [2025-10-08T20:26:31.823489] [INFO ] [LOCAL ] NEXA: Starting deletion of derivative data. [2025-10-08T20:26:31.823529] [DEBUG] [LOCAL ] NEXA: No derivative data file found to delete. [2025-10-08T20:26:31.823585] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEXA took 16.2s. Estimated remaining: 2h 6m 47s. Rate: 7.1 symbols/min [2025-10-08T20:26:31.998618] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:31.998929] [DEBUG] [LOCAL ] NFG: No existing data file found in primary storage. [2025-10-08T20:26:31.998986] [WARN ] [MAIN ] NFG: No existing data found, performing full refresh instead. [2025-10-08T20:26:31.999128] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-08T20:26:31.999198] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-08T20:26:31.999308] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-08T20:26:31.999357] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-08T20:26:32.030047] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-08T20:26:32.420478] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:32.800575] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T20:26:32.817505] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-08T20:26:32.996219] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T20:26:33.617554] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-08T20:26:34.321248] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T20:26:34.417569] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-08T20:26:35.105066] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-08T20:26:35.133935] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T20:26:35.217590] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-10-08T20:26:36.017577] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-08T20:26:36.545287] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T20:26:36.817576] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-08T20:26:37.617596] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-08T20:26:37.752193] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T20:26:38.263497] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-08T20:26:38.417564] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-08T20:26:39.037077] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T20:26:39.217558] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-08T20:26:39.662310] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:26:39.663500] [INFO ] [REMOTE ] NEU: Full fetch complete (10612 records). [2025-10-08T20:26:39.663590] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-08T20:26:39.664089] [FATAL] [VALIDATOR ] NEU: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:39.664171] [FATAL] [MAIN ] NEU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:39.664213] [WARN ] [MAIN ] NEU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:39.664279] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-08T20:26:39.664343] [DEBUG] [LOCAL ] NEU: No primary data file found to delete. [2025-10-08T20:26:39.664377] [INFO ] [LOCAL ] NEU: Starting deletion of derivative data. [2025-10-08T20:26:39.664416] [DEBUG] [LOCAL ] NEU: No derivative data file found to delete. [2025-10-08T20:26:39.664468] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEU took 32.3s. Estimated remaining: 2h 6m 38s. Rate: 7.1 symbols/min [2025-10-08T20:26:39.853880] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:39.880966] [DEBUG] [LOCAL ] NFJ: Loaded 20463 existing records from primary storage. [2025-10-08T20:26:39.881235] [INFO ] [MAIN ] NFJ: Loaded 20463 existing records. [2025-10-08T20:26:40.024398] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-08T20:26:40.067259] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:26:40.067492] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-08T20:26:40.067603] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-08T20:26:40.067941] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-08T20:26:40.068000] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-08T20:26:40.440487] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:40.817579] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-08T20:26:40.903980] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-08T20:26:41.617513] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-08T20:26:41.798611] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T20:26:41.914890] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T20:26:41.918600] [INFO ] [REMOTE ] NEM: Full fetch complete (77359 records). [2025-10-08T20:26:41.918786] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-08T20:26:41.919555] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:41.919719] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:41.919776] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:41.919842] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-08T20:26:41.919909] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-10-08T20:26:41.919949] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-10-08T20:26:41.920033] [DEBUG] [LOCAL ] NEM: No derivative data file found to delete. [2025-10-08T20:26:41.920100] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NEM took 47.2s. Estimated remaining: 2h 6m 26s. Rate: 7.1 symbols/min [2025-10-08T20:26:42.092166] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:42.092349] [DEBUG] [LOCAL ] NGG: No existing data file found in primary storage. [2025-10-08T20:26:42.092386] [WARN ] [MAIN ] NGG: No existing data found, performing full refresh instead. [2025-10-08T20:26:42.092494] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-08T20:26:42.092534] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-08T20:26:42.092574] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-08T20:26:42.092607] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-08T20:26:42.426826] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-08T20:26:42.471397] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:42.500268] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T20:26:43.217578] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-10-08T20:26:44.017514] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-08T20:26:44.173400] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T20:26:44.803698] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-08T20:26:44.817493] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-08T20:26:45.283342] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T20:26:45.617553] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-10-08T20:26:46.417568] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-08T20:26:46.688735] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T20:26:46.915579] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T20:26:47.217562] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-08T20:26:47.824333] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T20:26:48.017565] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-08T20:26:48.063537] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T20:26:48.817627] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-08T20:26:49.277786] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T20:26:49.617556] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-08T20:26:50.417555] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-08T20:26:50.782014] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T20:26:51.006169] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T20:26:51.217634] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-08T20:26:51.544245] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:26:51.547810] [INFO ] [REMOTE ] NET: Full fetch complete (76409 records). [2025-10-08T20:26:51.547984] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-08T20:26:51.549384] [FATAL] [VALIDATOR ] NET: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:26:51.549510] [FATAL] [MAIN ] NET: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:26:51.549563] [WARN ] [MAIN ] NET: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:26:51.549623] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-08T20:26:51.549783] [DEBUG] [LOCAL ] NET: No primary data file found to delete. [2025-10-08T20:26:51.549855] [INFO ] [LOCAL ] NET: Starting deletion of derivative data. [2025-10-08T20:26:51.549966] [DEBUG] [LOCAL ] NET: No derivative data file found to delete. [2025-10-08T20:26:51.550071] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NET took 48.6s. Estimated remaining: 2h 6m 18s. Rate: 7.1 symbols/min [2025-10-08T20:26:51.726337] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:26:51.726698] [DEBUG] [LOCAL ] NGL: No existing data file found in primary storage. [2025-10-08T20:26:51.726773] [WARN ] [MAIN ] NGL: No existing data found, performing full refresh instead. [2025-10-08T20:26:51.726969] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-08T20:26:51.727064] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-08T20:26:51.727240] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-08T20:26:51.727334] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-08T20:26:52.023255] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-08T20:26:52.140029] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:26:52.145919] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T20:26:52.817573] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-08T20:26:53.239266] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T20:26:53.617567] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-10-08T20:26:54.180153] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T20:26:54.417519] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-08T20:26:54.736689] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T20:26:55.217605] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-08T20:26:56.017630] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-08T20:26:56.141839] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T20:26:56.817553] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-08T20:26:57.109360] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T20:26:57.192151] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T20:26:57.617551] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-08T20:26:58.417534] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-08T20:26:58.523045] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T20:26:59.171534] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T20:26:59.217521] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-08T20:26:59.416517] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:27:00.017557] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-08T20:27:00.817600] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-08T20:27:00.907838] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T20:27:01.026719] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T20:27:01.617566] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-08T20:27:02.417553] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-08T20:27:02.649157] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T20:27:02.704352] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T20:27:03.217566] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-08T20:27:03.732803] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T20:27:03.745637] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:27:03.748447] [INFO ] [REMOTE ] NFG: Full fetch complete (56651 records). [2025-10-08T20:27:03.748531] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-08T20:27:03.749160] [FATAL] [VALIDATOR ] NFG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:03.749247] [FATAL] [MAIN ] NFG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:03.749293] [WARN ] [MAIN ] NFG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:03.749370] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-08T20:27:03.749445] [DEBUG] [LOCAL ] NFG: No primary data file found to delete. [2025-10-08T20:27:03.749492] [INFO ] [LOCAL ] NFG: Starting deletion of derivative data. [2025-10-08T20:27:03.749545] [DEBUG] [LOCAL ] NFG: No derivative data file found to delete. [2025-10-08T20:27:03.749617] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NFG took 31.9s. Estimated remaining: 2h 6m 12s. Rate: 7.1 symbols/min [2025-10-08T20:27:03.922729] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:03.922946] [DEBUG] [LOCAL ] NGS: No existing data file found in primary storage. [2025-10-08T20:27:03.923002] [WARN ] [MAIN ] NGS: No existing data found, performing full refresh instead. [2025-10-08T20:27:03.923124] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-08T20:27:03.923191] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-08T20:27:03.923250] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-08T20:27:03.923339] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-08T20:27:04.022734] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-08T20:27:04.293856] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:04.817598] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-08T20:27:05.400195] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T20:27:05.617573] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-10-08T20:27:05.850781] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:27:06.272402] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T20:27:06.417540] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-08T20:27:07.217558] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-08T20:27:07.470199] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T20:27:08.017575] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-08T20:27:08.434022] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T20:27:08.634355] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T20:27:08.817564] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-08T20:27:09.617593] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-08T20:27:09.897910] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T20:27:10.422688] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-08T20:27:10.430115] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T20:27:11.217573] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-08T20:27:12.017530] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-08T20:27:12.057741] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T20:27:12.327586] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T20:27:12.817563] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-08T20:27:13.619219] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-08T20:27:13.625499] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T20:27:13.847516] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T20:27:14.417524] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-08T20:27:14.594457] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T20:27:15.217578] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-08T20:27:16.017562] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-08T20:27:16.132893] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T20:27:16.260797] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T20:27:16.817620] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-08T20:27:17.022397] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T20:27:17.617580] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-08T20:27:18.417570] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-08T20:27:18.506287] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T20:27:19.057509] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T20:27:19.217563] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-08T20:27:19.626133] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T20:27:20.017532] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-08T20:27:20.151877] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:27:20.580164] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:27:20.582036] [INFO ] [REMOTE ] NGL: Full fetch complete (41122 records). [2025-10-08T20:27:20.582139] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-08T20:27:20.582938] [FATAL] [VALIDATOR ] NGL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:20.583029] [FATAL] [MAIN ] NGL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:20.583071] [WARN ] [MAIN ] NGL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:20.583110] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-08T20:27:20.583215] [DEBUG] [LOCAL ] NGL: No primary data file found to delete. [2025-10-08T20:27:20.583293] [INFO ] [LOCAL ] NGL: Starting deletion of derivative data. [2025-10-08T20:27:20.583370] [DEBUG] [LOCAL ] NGL: No derivative data file found to delete. [2025-10-08T20:27:20.583494] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NGL took 29.0s. Estimated remaining: 2h 6m 8s. Rate: 7.1 symbols/min [2025-10-08T20:27:20.766057] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:20.766304] [DEBUG] [LOCAL ] NGVC: No existing data file found in primary storage. [2025-10-08T20:27:20.766361] [WARN ] [MAIN ] NGVC: No existing data found, performing full refresh instead. [2025-10-08T20:27:20.766482] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-08T20:27:20.766526] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-08T20:27:20.766568] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-08T20:27:20.766599] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-08T20:27:20.822811] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-08T20:27:21.135934] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:21.593758] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T20:27:21.617518] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-08T20:27:22.282927] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T20:27:22.417562] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-10-08T20:27:23.217586] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-08T20:27:23.435747] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:27:24.017496] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-08T20:27:24.409788] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T20:27:24.817556] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-08T20:27:25.131071] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T20:27:25.617613] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-08T20:27:25.953183] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-08T20:27:25.954627] [INFO ] [REMOTE ] NGS: Full fetch complete (17119 records). [2025-10-08T20:27:25.954742] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-08T20:27:25.955421] [FATAL] [VALIDATOR ] NGS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:25.955512] [FATAL] [MAIN ] NGS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:25.955774] [WARN ] [MAIN ] NGS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:25.955884] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-08T20:27:25.955989] [DEBUG] [LOCAL ] NGS: No primary data file found to delete. [2025-10-08T20:27:25.956061] [INFO ] [LOCAL ] NGS: Starting deletion of derivative data. [2025-10-08T20:27:25.956313] [DEBUG] [LOCAL ] NGS: No derivative data file found to delete. [2025-10-08T20:27:25.956431] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NGS took 22.2s. Estimated remaining: 2h 5m 58s. Rate: 7.1 symbols/min [2025-10-08T20:27:26.149938] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:26.150736] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-10-08T20:27:26.150840] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-10-08T20:27:26.151085] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-08T20:27:26.151220] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-08T20:27:26.151293] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-08T20:27:26.151332] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-08T20:27:26.422717] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-08T20:27:26.522045] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T20:27:26.619122] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:27.217503] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-08T20:27:27.392445] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T20:27:28.017515] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-08T20:27:28.027140] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T20:27:28.030860] [INFO ] [REMOTE ] NGG: Full fetch complete (66026 records). [2025-10-08T20:27:28.030963] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-08T20:27:28.031637] [FATAL] [VALIDATOR ] NGG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:28.031756] [FATAL] [MAIN ] NGG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:28.031799] [WARN ] [MAIN ] NGG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:28.031841] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-08T20:27:28.031943] [DEBUG] [LOCAL ] NGG: No primary data file found to delete. [2025-10-08T20:27:28.032014] [INFO ] [LOCAL ] NGG: Starting deletion of derivative data. [2025-10-08T20:27:28.032105] [DEBUG] [LOCAL ] NGG: No derivative data file found to delete. [2025-10-08T20:27:28.032258] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGG took 46.1s. Estimated remaining: 2h 5m 46s. Rate: 7.1 symbols/min [2025-10-08T20:27:28.207547] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:28.207759] [DEBUG] [LOCAL ] NHI: No existing data file found in primary storage. [2025-10-08T20:27:28.207803] [WARN ] [MAIN ] NHI: No existing data found, performing full refresh instead. [2025-10-08T20:27:28.207915] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-08T20:27:28.207956] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-08T20:27:28.208011] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-08T20:27:28.208081] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-08T20:27:28.567757] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:28.817539] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-10-08T20:27:29.298097] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T20:27:29.617547] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-08T20:27:29.824022] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T20:27:30.417551] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-10-08T20:27:30.777426] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T20:27:31.217567] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-08T20:27:31.651038] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T20:27:32.017559] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-08T20:27:32.491793] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T20:27:32.817515] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-08T20:27:33.039013] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T20:27:33.041109] [INFO ] [REMOTE ] NFJ: Full fetch complete (30356 records). [2025-10-08T20:27:33.041190] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-08T20:27:33.452931] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-08T20:27:33.453053] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-08T20:27:33.453821] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-08T20:27:33.453888] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-08T20:27:33.454892] [DEBUG] [LOCAL ] NFJ: Trimmed 30356 records to 20463 (keeping 200 days of data) [2025-10-08T20:27:33.591755] [DEBUG] [LOCAL ] NFJ: Primary data saved (20463 records). [2025-10-08T20:27:33.591894] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-08T20:27:33.591978] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NFJ took 53.9s. Estimated remaining: 2h 5m 36s. Rate: 7.1 symbols/min [2025-10-08T20:27:33.617503] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-08T20:27:33.719157] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T20:27:34.417556] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-08T20:27:34.612336] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T20:27:35.217611] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-08T20:27:35.310128] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T20:27:36.017626] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-08T20:27:36.453598] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T20:27:36.817613] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-08T20:27:36.870699] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T20:27:37.617577] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-08T20:27:37.784692] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T20:27:38.417580] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-08T20:27:38.727178] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:27:39.217563] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-08T20:27:39.580825] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T20:27:40.017600] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-08T20:27:40.526981] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T20:27:40.817577] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-08T20:27:41.316152] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T20:27:41.617586] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-08T20:27:42.425928] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-08T20:27:42.430262] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T20:27:42.837716] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T20:27:43.217566] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-08T20:27:43.401337] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T20:27:44.017504] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-08T20:27:44.189084] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T20:27:44.817586] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-08T20:27:45.201022] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T20:27:45.617523] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-08T20:27:45.922443] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T20:27:46.253985] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:27:46.255789] [INFO ] [REMOTE ] NGVC: Full fetch complete (30504 records). [2025-10-08T20:27:46.255864] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-08T20:27:46.256343] [FATAL] [VALIDATOR ] NGVC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:46.256430] [FATAL] [MAIN ] NGVC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:46.256474] [WARN ] [MAIN ] NGVC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:46.256595] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-08T20:27:46.256722] [DEBUG] [LOCAL ] NGVC: No primary data file found to delete. [2025-10-08T20:27:46.256769] [INFO ] [LOCAL ] NGVC: Starting deletion of derivative data. [2025-10-08T20:27:46.256833] [DEBUG] [LOCAL ] NGVC: No derivative data file found to delete. [2025-10-08T20:27:46.256911] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGVC took 25.7s. Estimated remaining: 2h 5m 30s. Rate: 7.1 symbols/min [2025-10-08T20:27:46.417554] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-08T20:27:47.217554] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-08T20:27:47.654141] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T20:27:48.018107] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-08T20:27:48.423537] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T20:27:48.817533] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-08T20:27:48.991108] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T20:27:49.617582] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-08T20:27:49.879535] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T20:27:50.417577] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-08T20:27:50.762932] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T20:27:51.217509] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-08T20:27:51.393029] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T20:27:52.018074] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-08T20:27:52.019769] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T20:27:52.445810] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:27:52.447699] [INFO ] [REMOTE ] NGVT: Full fetch complete (34324 records). [2025-10-08T20:27:52.447777] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-08T20:27:52.448294] [FATAL] [VALIDATOR ] NGVT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:52.448382] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:52.448425] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:52.448463] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-08T20:27:52.448554] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-10-08T20:27:52.448614] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-10-08T20:27:52.448700] [DEBUG] [LOCAL ] NGVT: No derivative data file found to delete. [2025-10-08T20:27:52.448773] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVT took 26.5s. Estimated remaining: 2h 5m 20s. Rate: 7.1 symbols/min [2025-10-08T20:27:52.817600] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-08T20:27:53.269559] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:27:53.271262] [INFO ] [REMOTE ] NHI: Full fetch complete (31275 records). [2025-10-08T20:27:53.271345] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-08T20:27:53.271900] [FATAL] [VALIDATOR ] NHI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:27:53.271987] [FATAL] [MAIN ] NHI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:27:53.272030] [WARN ] [MAIN ] NHI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:27:53.272095] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-08T20:27:53.272159] [DEBUG] [LOCAL ] NHI: No primary data file found to delete. [2025-10-08T20:27:53.272194] [INFO ] [LOCAL ] NHI: Starting deletion of derivative data. [2025-10-08T20:27:53.272235] [DEBUG] [LOCAL ] NHI: No derivative data file found to delete. [2025-10-08T20:27:53.272290] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NHI took 25.2s. Estimated remaining: 2h 5m 7s. Rate: 7.1 symbols/min [2025-10-08T20:27:53.994889] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:53.991135] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:54.029899] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:54.032672] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-10-08T20:27:54.035794] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-10-08T20:27:54.036678] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-08T20:27:54.036940] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-08T20:27:54.060259] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:27:54.060577] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-08T20:27:54.061015] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-08T20:27:54.061102] [DEBUG] [LOCAL ] NIC: No existing data file found in primary storage. [2025-10-08T20:27:54.066532] [WARN ] [MAIN ] NIC: No existing data found, performing full refresh instead. [2025-10-08T20:27:54.073808] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-08T20:27:54.102981] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-08T20:27:54.111575] [DEBUG] [LOCAL ] NIM: Loaded 3982 existing records from primary storage. [2025-10-08T20:27:54.123703] [INFO ] [MAIN ] NIM: Loaded 3982 existing records. [2025-10-08T20:27:54.123347] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-08T20:27:54.177537] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-08T20:27:54.286025] [DEBUG] [LOCAL ] NIE: Loaded 11930 existing records from primary storage. [2025-10-08T20:27:54.307048] [INFO ] [MAIN ] NIE: Loaded 11930 existing records. [2025-10-08T20:27:54.733205] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:27:54.866818] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-08T20:27:54.911359] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-08T20:27:54.967730] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:27:54.967831] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-08T20:27:54.985236] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-08T20:27:54.995745] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-08T20:27:55.022046] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-08T20:27:55.027364] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-08T20:27:55.127577] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-08T20:27:55.231755] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:55.307178] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-10-08T20:27:55.495422] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:55.536912] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-10-08T20:27:55.944683] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:55.951042] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-10-08T20:27:55.950710] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:27:56.017533] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-10-08T20:27:56.479699] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T20:27:56.517749] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T20:27:56.817560] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-08T20:27:56.979362] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-08T20:27:57.230639] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T20:27:57.451335] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T20:27:57.617550] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-08T20:27:58.417556] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-08T20:27:59.217529] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-08T20:27:59.250573] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T20:27:59.448373] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T20:27:59.856458] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:28:00.017574] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-08T20:28:00.758441] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-08T20:28:00.817550] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-08T20:28:01.617546] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-08T20:28:01.707364] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T20:28:02.297080] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:28:02.417695] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-08T20:28:03.217519] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-08T20:28:03.342291] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T20:28:04.017526] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-08T20:28:04.069261] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T20:28:04.817618] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-08T20:28:04.908436] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T20:28:05.617607] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-08T20:28:06.417582] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-08T20:28:06.468374] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T20:28:06.628084] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T20:28:06.926487] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T20:28:07.217600] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-08T20:28:08.017634] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-08T20:28:08.060372] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:28:08.817549] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-08T20:28:08.975819] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T20:28:09.617550] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-08T20:28:09.761776] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T20:28:10.251905] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T20:28:10.417607] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-08T20:28:11.217552] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-08T20:28:11.450983] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T20:28:12.017529] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-08T20:28:12.264152] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T20:28:12.817577] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-08T20:28:13.617596] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-08T20:28:13.940575] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T20:28:14.041809] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T20:28:14.304286] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T20:28:14.417567] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-08T20:28:15.131305] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T20:28:15.217558] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-08T20:28:15.909606] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T20:28:16.017569] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-08T20:28:16.817526] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-08T20:28:17.299593] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:28:17.300876] [INFO ] [REMOTE ] NIC: Full fetch complete (12257 records). [2025-10-08T20:28:17.300960] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-08T20:28:17.301410] [FATAL] [VALIDATOR ] NIC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:28:17.301515] [FATAL] [MAIN ] NIC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:28:17.301588] [WARN ] [MAIN ] NIC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:28:17.301703] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-08T20:28:17.301782] [DEBUG] [LOCAL ] NIC: No primary data file found to delete. [2025-10-08T20:28:17.301831] [INFO ] [LOCAL ] NIC: Starting deletion of derivative data. [2025-10-08T20:28:17.301915] [DEBUG] [LOCAL ] NIC: No derivative data file found to delete. [2025-10-08T20:28:17.301986] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NIC took 24.0s. Estimated remaining: 2h 5m 8s. Rate: 7.1 symbols/min [2025-10-08T20:28:17.482721] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:17.482963] [DEBUG] [LOCAL ] NINE: No existing data file found in primary storage. [2025-10-08T20:28:17.483021] [WARN ] [MAIN ] NINE: No existing data found, performing full refresh instead. [2025-10-08T20:28:17.483172] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-08T20:28:17.483242] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-08T20:28:17.483299] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-08T20:28:17.483334] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-08T20:28:17.631781] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-08T20:28:17.867304] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:18.013586] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T20:28:18.353044] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T20:28:18.417603] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-08T20:28:19.217582] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-08T20:28:19.374182] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T20:28:20.017558] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-10-08T20:28:20.822817] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-08T20:28:20.847113] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T20:28:21.551614] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T20:28:21.617572] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-08T20:28:21.754864] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T20:28:22.417611] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-08T20:28:22.599481] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T20:28:23.217614] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-08T20:28:24.017606] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-08T20:28:24.211042] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T20:28:24.232348] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:28:24.817587] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-08T20:28:25.617520] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-08T20:28:25.936987] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T20:28:26.238277] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T20:28:26.417535] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-08T20:28:26.536316] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T20:28:27.217693] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-08T20:28:27.687875] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:28:27.689386] [INFO ] [REMOTE ] NIM: Full fetch complete (6609 records). [2025-10-08T20:28:27.689520] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-08T20:28:27.884777] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:28:28.022901] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-08T20:28:28.090139] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-08T20:28:28.090227] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-08T20:28:28.090429] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-08T20:28:28.090469] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-08T20:28:28.091026] [DEBUG] [LOCAL ] NIM: Trimmed 6609 records to 3906 (keeping 200 days of data) [2025-10-08T20:28:28.125582] [DEBUG] [LOCAL ] NIM: Primary data saved (3906 records). [2025-10-08T20:28:28.125780] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-08T20:28:28.125901] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIM took 34.8s. Estimated remaining: 2h 5m 1s. Rate: 7.1 symbols/min [2025-10-08T20:28:28.303863] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:28.304123] [DEBUG] [LOCAL ] NIO: No existing data file found in primary storage. [2025-10-08T20:28:28.304197] [WARN ] [MAIN ] NIO: No existing data found, performing full refresh instead. [2025-10-08T20:28:28.304424] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-08T20:28:28.304498] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-08T20:28:28.304573] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-08T20:28:28.304633] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-08T20:28:28.684703] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:28.817518] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-08T20:28:28.960046] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T20:28:28.961854] [INFO ] [REMOTE ] NIE: Full fetch complete (16710 records). [2025-10-08T20:28:28.961930] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-08T20:28:29.349766] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-08T20:28:29.349868] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-08T20:28:29.350690] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-08T20:28:29.350756] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-08T20:28:29.351447] [DEBUG] [LOCAL ] NIE: Trimmed 16710 records to 11989 (keeping 200 days of data) [2025-10-08T20:28:29.438864] [DEBUG] [LOCAL ] NIE: Primary data saved (11989 records). [2025-10-08T20:28:29.439119] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-08T20:28:29.439278] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIE took 36.2s. Estimated remaining: 2h 4m 48s. Rate: 7.1 symbols/min [2025-10-08T20:28:29.620574] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-08T20:28:29.620406] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:29.622377] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-08T20:28:29.622485] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-08T20:28:29.622620] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-08T20:28:29.622720] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-08T20:28:29.622808] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-08T20:28:29.622857] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-08T20:28:29.983849] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:30.417609] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-10-08T20:28:30.797469] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T20:28:31.171775] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T20:28:31.217557] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-08T20:28:32.017565] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-08T20:28:32.511869] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T20:28:32.817560] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-08T20:28:33.528331] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-10-08T20:28:33.617552] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-08T20:28:33.968923] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T20:28:33.997926] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T20:28:34.417569] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-08T20:28:35.017283] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:28:35.021319] [INFO ] [REMOTE ] NI: Full fetch complete (76879 records). [2025-10-08T20:28:35.021463] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-08T20:28:35.022304] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:28:35.022425] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:28:35.022467] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:28:35.022527] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-08T20:28:35.022613] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-10-08T20:28:35.022717] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-10-08T20:28:35.022808] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-10-08T20:28:35.022891] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 41.7s. Estimated remaining: 2h 4m 38s. Rate: 7.1 symbols/min [2025-10-08T20:28:35.205528] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:35.205760] [DEBUG] [LOCAL ] NJR: No existing data file found in primary storage. [2025-10-08T20:28:35.205825] [WARN ] [MAIN ] NJR: No existing data found, performing full refresh instead. [2025-10-08T20:28:35.205966] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-08T20:28:35.206028] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-08T20:28:35.206075] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-08T20:28:35.206112] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-08T20:28:35.222619] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-08T20:28:35.603829] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:35.909027] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-08T20:28:36.017515] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-08T20:28:36.817567] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-10-08T20:28:37.188608] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:28:37.189024] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-10-08T20:28:37.189200] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:28:37.189287] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-08T20:28:37.189354] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:28:37.189425] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-08T20:28:37.189489] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-08T20:28:37.189525] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-08T20:28:37.189582] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-08T20:28:37.189674] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIQ took 7.8s. Estimated remaining: 2h 4m 26s. Rate: 7.1 symbols/min [2025-10-08T20:28:37.339062] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-08T20:28:37.392428] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:37.392880] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-08T20:28:37.392924] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-08T20:28:37.393035] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-08T20:28:37.393075] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-08T20:28:37.393115] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-08T20:28:37.393148] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-08T20:28:37.626610] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-08T20:28:37.744191] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:38.417510] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-10-08T20:28:38.463310] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-08T20:28:38.953408] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T20:28:39.217579] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-08T20:28:40.017555] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-10-08T20:28:40.817580] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-08T20:28:41.161043] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-08T20:28:41.210152] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T20:28:41.617585] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-08T20:28:41.934044] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-08T20:28:41.960561] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T20:28:42.417601] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-08T20:28:43.153636] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T20:28:43.217521] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-08T20:28:44.017523] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-08T20:28:44.534583] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T20:28:44.817583] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-08T20:28:45.032757] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-08T20:28:45.617606] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-08T20:28:46.417546] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-08T20:28:46.495750] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-08T20:28:46.631478] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T20:28:47.217576] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-08T20:28:47.476609] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T20:28:47.816274] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-08T20:28:48.017559] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-08T20:28:48.817554] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-08T20:28:48.924788] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T20:28:49.094077] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T20:28:49.096800] [INFO ] [REMOTE ] NINE: Full fetch complete (43416 records). [2025-10-08T20:28:49.096921] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-08T20:28:49.097754] [FATAL] [VALIDATOR ] NINE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:28:49.097869] [FATAL] [MAIN ] NINE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:28:49.097934] [WARN ] [MAIN ] NINE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:28:49.098015] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-08T20:28:49.098098] [DEBUG] [LOCAL ] NINE: No primary data file found to delete. [2025-10-08T20:28:49.098164] [INFO ] [LOCAL ] NINE: Starting deletion of derivative data. [2025-10-08T20:28:49.098249] [DEBUG] [LOCAL ] NINE: No derivative data file found to delete. [2025-10-08T20:28:49.098331] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NINE took 31.8s. Estimated remaining: 2h 4m 20s. Rate: 7.1 symbols/min [2025-10-08T20:28:49.283489] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:28:49.301759] [DEBUG] [LOCAL ] NKX: Loaded 13597 existing records from primary storage. [2025-10-08T20:28:49.302050] [INFO ] [MAIN ] NKX: Loaded 13597 existing records. [2025-10-08T20:28:49.490173] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:28:49.490453] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-08T20:28:49.490509] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-08T20:28:49.490918] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-08T20:28:49.490979] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-08T20:28:49.632453] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-08T20:28:49.851295] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:28:50.396762] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-08T20:28:50.417500] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-08T20:28:51.217557] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-10-08T20:28:52.017542] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-08T20:28:52.076232] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T20:28:52.355014] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-08T20:28:52.817534] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-08T20:28:53.199916] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-08T20:28:53.272600] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T20:28:53.617540] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-08T20:28:54.417562] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-08T20:28:55.217533] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-08T20:28:55.277408] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-08T20:28:55.291131] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T20:28:55.332274] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T20:28:56.017551] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-08T20:28:56.817549] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-08T20:28:57.617562] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-08T20:28:57.679780] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T20:28:57.922186] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-08T20:28:57.948294] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T20:28:58.417550] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-08T20:28:59.149909] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T20:28:59.217547] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-08T20:28:59.959058] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T20:29:00.017597] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-08T20:29:00.069159] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T20:29:00.817583] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-08T20:29:01.617563] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-08T20:29:02.269057] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T20:29:02.417559] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-08T20:29:02.495749] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T20:29:02.802838] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-08T20:29:03.217515] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-08T20:29:03.370846] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T20:29:04.017558] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-08T20:29:04.817576] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-08T20:29:04.888429] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T20:29:05.617553] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-08T20:29:05.952254] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:29:05.955849] [INFO ] [REMOTE ] NJR: Full fetch complete (54496 records). [2025-10-08T20:29:05.956049] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-08T20:29:05.957008] [FATAL] [VALIDATOR ] NJR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:05.957136] [FATAL] [MAIN ] NJR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:05.957212] [WARN ] [MAIN ] NJR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:05.957332] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-08T20:29:05.957436] [DEBUG] [LOCAL ] NJR: No primary data file found to delete. [2025-10-08T20:29:05.957491] [INFO ] [LOCAL ] NJR: Starting deletion of derivative data. [2025-10-08T20:29:05.957595] [DEBUG] [LOCAL ] NJR: No derivative data file found to delete. [2025-10-08T20:29:05.957784] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NJR took 30.9s. Estimated remaining: 2h 4m 16s. Rate: 7.1 symbols/min [2025-10-08T20:29:06.153095] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:06.153298] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-08T20:29:06.153335] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-08T20:29:06.153449] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-08T20:29:06.153490] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-08T20:29:06.153531] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-08T20:29:06.153562] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-08T20:29:06.427298] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-08T20:29:06.527130] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:06.564320] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-08T20:29:07.217518] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-08T20:29:07.373668] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-08T20:29:07.555423] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T20:29:08.017568] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-08T20:29:08.817570] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-08T20:29:08.839042] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T20:29:09.377221] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-08T20:29:09.617535] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-08T20:29:10.417568] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-10-08T20:29:11.217579] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-08T20:29:11.521426] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-08T20:29:11.538395] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T20:29:11.756293] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T20:29:12.017552] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-08T20:29:12.505964] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T20:29:12.582777] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:29:12.586415] [INFO ] [REMOTE ] NKE: Full fetch complete (76807 records). [2025-10-08T20:29:12.586569] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-08T20:29:12.588847] [FATAL] [VALIDATOR ] NKE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:12.588976] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:12.589019] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:12.589059] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-08T20:29:12.589116] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-08T20:29:12.589150] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-08T20:29:12.589242] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-08T20:29:12.589343] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NKE took 35.4s. Estimated remaining: 2h 4m 7s. Rate: 7.1 symbols/min [2025-10-08T20:29:12.759427] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:12.759622] [DEBUG] [LOCAL ] NLOP: No existing data file found in primary storage. [2025-10-08T20:29:12.759690] [WARN ] [MAIN ] NLOP: No existing data found, performing full refresh instead. [2025-10-08T20:29:12.759806] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-08T20:29:12.759847] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-08T20:29:12.759887] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-08T20:29:12.759919] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-08T20:29:12.822802] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-08T20:29:13.128150] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:13.274517] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:29:13.278160] [INFO ] [REMOTE ] NIO: Full fetch complete (77584 records). [2025-10-08T20:29:13.278327] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-08T20:29:13.279363] [FATAL] [VALIDATOR ] NIO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:13.279486] [FATAL] [MAIN ] NIO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:13.279529] [WARN ] [MAIN ] NIO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:13.279621] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-08T20:29:13.279733] [DEBUG] [LOCAL ] NIO: No primary data file found to delete. [2025-10-08T20:29:13.279776] [INFO ] [LOCAL ] NIO: Starting deletion of derivative data. [2025-10-08T20:29:13.279818] [DEBUG] [LOCAL ] NIO: No derivative data file found to delete. [2025-10-08T20:29:13.279881] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIO took 45.2s. Estimated remaining: 2h 3m 54s. Rate: 7.1 symbols/min [2025-10-08T20:29:13.455423] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:13.455609] [DEBUG] [LOCAL ] NLY: No existing data file found in primary storage. [2025-10-08T20:29:13.455672] [WARN ] [MAIN ] NLY: No existing data found, performing full refresh instead. [2025-10-08T20:29:13.455793] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-08T20:29:13.455835] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-08T20:29:13.455880] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-08T20:29:13.455912] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-08T20:29:13.618685] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-08T20:29:13.828626] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:14.259317] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:29:14.417583] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-10-08T20:29:15.217555] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-08T20:29:16.017569] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-10-08T20:29:16.062513] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T20:29:16.064071] [INFO ] [REMOTE ] NKX: Full fetch complete (19454 records). [2025-10-08T20:29:16.064148] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-08T20:29:16.451826] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-08T20:29:16.451998] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-08T20:29:16.452506] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-08T20:29:16.452589] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-08T20:29:16.453365] [DEBUG] [LOCAL ] NKX: Trimmed 19454 records to 13662 (keeping 200 days of data) [2025-10-08T20:29:16.547785] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-08T20:29:16.581144] [DEBUG] [LOCAL ] NKX: Primary data saved (13662 records). [2025-10-08T20:29:16.581266] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-08T20:29:16.581344] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKX took 27.5s. Estimated remaining: 2h 3m 42s. Rate: 7.1 symbols/min [2025-10-08T20:29:16.766036] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:16.766289] [DEBUG] [LOCAL ] NMAI: No existing data file found in primary storage. [2025-10-08T20:29:16.766340] [WARN ] [MAIN ] NMAI: No existing data found, performing full refresh instead. [2025-10-08T20:29:16.766451] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-08T20:29:16.766493] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-08T20:29:16.766534] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-08T20:29:16.766567] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-08T20:29:16.824369] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-08T20:29:17.065515] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:29:17.150236] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:17.617556] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-08T20:29:18.417534] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-10-08T20:29:18.566127] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T20:29:18.740105] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-08T20:29:19.119115] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T20:29:19.217559] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-08T20:29:20.017523] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-08T20:29:20.085308] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T20:29:20.817720] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-08T20:29:21.378521] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T20:29:21.617553] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-08T20:29:21.929419] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T20:29:22.270504] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T20:29:22.417597] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-08T20:29:23.118472] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T20:29:23.217607] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-08T20:29:24.017563] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-08T20:29:24.070272] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T20:29:24.817559] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-08T20:29:25.516861] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T20:29:25.617577] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-08T20:29:25.780337] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:29:26.417564] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-08T20:29:26.599184] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T20:29:27.217598] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-08T20:29:28.000835] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T20:29:28.017520] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-08T20:29:28.285715] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T20:29:28.817572] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-08T20:29:28.977274] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T20:29:29.617587] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-08T20:29:30.417595] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-08T20:29:30.469219] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T20:29:30.973808] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T20:29:31.170296] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:29:31.217593] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-08T20:29:31.935857] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T20:29:32.017558] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-08T20:29:32.817572] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-08T20:29:32.892254] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T20:29:33.617571] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-08T20:29:33.712189] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T20:29:34.417609] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-08T20:29:34.594339] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T20:29:35.217522] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-08T20:29:35.308550] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T20:29:36.017618] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-08T20:29:36.143404] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:29:36.817589] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-08T20:29:37.504560] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T20:29:37.617510] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-08T20:29:38.143257] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-08T20:29:38.199198] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T20:29:38.417527] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-08T20:29:39.217608] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-08T20:29:39.416422] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T20:29:39.417634] [INFO ] [REMOTE ] NL: Full fetch complete (6768 records). [2025-10-08T20:29:39.417791] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-08T20:29:39.418354] [FATAL] [VALIDATOR ] NL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:39.418441] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:39.418486] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:39.418611] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-08T20:29:39.418746] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-08T20:29:39.418803] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-08T20:29:39.418845] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-08T20:29:39.418950] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NL took 33.5s. Estimated remaining: 2h 3m 42s. Rate: 7.1 symbols/min [2025-10-08T20:29:39.656435] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:39.656629] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-08T20:29:39.656711] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-08T20:29:39.656838] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-08T20:29:39.656898] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-08T20:29:39.656941] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-08T20:29:39.656973] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-08T20:29:40.022760] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-08T20:29:40.065903] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:40.317768] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T20:29:40.817556] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-10-08T20:29:41.138577] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:29:41.139053] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-10-08T20:29:41.139178] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:29:41.139265] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-08T20:29:41.139358] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:29:41.139454] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-08T20:29:41.139556] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-08T20:29:41.139623] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-08T20:29:41.139737] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-08T20:29:41.139846] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NMAX took 1.7s. Estimated remaining: 2h 3m 30s. Rate: 7.1 symbols/min [2025-10-08T20:29:41.325253] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:41.325427] [DEBUG] [LOCAL ] NMCO: No existing data file found in primary storage. [2025-10-08T20:29:41.325464] [WARN ] [MAIN ] NMCO: No existing data found, performing full refresh instead. [2025-10-08T20:29:41.325589] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-08T20:29:41.325638] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-08T20:29:41.325754] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-08T20:29:41.325801] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-08T20:29:41.622727] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-08T20:29:41.683391] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:42.302990] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-08T20:29:42.417505] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-08T20:29:42.751632] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T20:29:43.217570] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-08T20:29:44.017533] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-10-08T20:29:44.157661] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T20:29:44.415147] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T20:29:44.817581] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-08T20:29:45.035342] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:29:45.617540] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-08T20:29:45.729899] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T20:29:46.417589] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-08T20:29:46.836995] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T20:29:47.217580] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-08T20:29:48.017563] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-08T20:29:48.028742] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T20:29:48.400724] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T20:29:48.402110] [INFO ] [REMOTE ] NLOP: Full fetch complete (17697 records). [2025-10-08T20:29:48.402200] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-08T20:29:48.402716] [FATAL] [VALIDATOR ] NLOP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:48.402802] [FATAL] [MAIN ] NLOP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:48.402845] [WARN ] [MAIN ] NLOP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:48.402917] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-08T20:29:48.402987] [DEBUG] [LOCAL ] NLOP: No primary data file found to delete. [2025-10-08T20:29:48.403023] [INFO ] [LOCAL ] NLOP: Starting deletion of derivative data. [2025-10-08T20:29:48.403062] [DEBUG] [LOCAL ] NLOP: No derivative data file found to delete. [2025-10-08T20:29:48.403118] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NLOP took 35.8s. Estimated remaining: 2h 3m 21s. Rate: 7.1 symbols/min [2025-10-08T20:29:48.578736] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:48.578992] [DEBUG] [LOCAL ] NMG: No existing data file found in primary storage. [2025-10-08T20:29:48.579116] [WARN ] [MAIN ] NMG: No existing data found, performing full refresh instead. [2025-10-08T20:29:48.579249] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-08T20:29:48.579373] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-08T20:29:48.579532] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-08T20:29:48.579588] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-08T20:29:48.819021] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-08T20:29:48.868703] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-08T20:29:48.986481] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:49.617538] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-08T20:29:49.656829] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T20:29:50.407176] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:29:50.410794] [INFO ] [REMOTE ] NLY: Full fetch complete (77175 records). [2025-10-08T20:29:50.410915] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-08T20:29:50.411618] [FATAL] [VALIDATOR ] NLY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:29:50.411734] [FATAL] [MAIN ] NLY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:29:50.411805] [WARN ] [MAIN ] NLY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:29:50.411877] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-08T20:29:50.411945] [DEBUG] [LOCAL ] NLY: No primary data file found to delete. [2025-10-08T20:29:50.411980] [INFO ] [LOCAL ] NLY: Starting deletion of derivative data. [2025-10-08T20:29:50.412018] [DEBUG] [LOCAL ] NLY: No derivative data file found to delete. [2025-10-08T20:29:50.412099] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NLY took 37.1s. Estimated remaining: 2h 3m 9s. Rate: 7.1 symbols/min [2025-10-08T20:29:50.422693] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-08T20:29:50.598315] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:29:50.609118] [DEBUG] [LOCAL ] NMI: Loaded 4057 existing records from primary storage. [2025-10-08T20:29:50.609399] [INFO ] [MAIN ] NMI: Loaded 4057 existing records. [2025-10-08T20:29:50.788785] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:29:50.789088] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-08T20:29:50.789159] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-08T20:29:50.789435] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-08T20:29:50.789504] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-08T20:29:51.155371] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:29:51.217496] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-10-08T20:29:51.562345] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T20:29:51.861286] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T20:29:52.017539] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-08T20:29:52.559610] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T20:29:52.817545] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-08T20:29:53.606231] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T20:29:53.617485] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-08T20:29:54.153478] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T20:29:54.417550] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-08T20:29:55.116289] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T20:29:55.217553] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-08T20:29:55.951021] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T20:29:56.017553] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-08T20:29:56.725201] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T20:29:56.817602] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-08T20:29:57.515510] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T20:29:57.617639] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-08T20:29:58.355525] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T20:29:58.417508] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-08T20:29:59.096224] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T20:29:59.217539] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-10-08T20:29:59.940327] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T20:30:00.017540] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-08T20:30:00.817556] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-08T20:30:00.951355] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T20:30:01.617622] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-08T20:30:02.164363] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T20:30:02.417573] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-08T20:30:02.432670] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T20:30:03.217517] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-08T20:30:03.279981] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T20:30:03.991694] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T20:30:04.017503] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-08T20:30:04.817583] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-08T20:30:04.994078] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T20:30:05.267896] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:30:05.269248] [INFO ] [REMOTE ] NMAI: Full fetch complete (19801 records). [2025-10-08T20:30:05.269342] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-08T20:30:05.269908] [FATAL] [VALIDATOR ] NMAI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:30:05.270011] [FATAL] [MAIN ] NMAI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:30:05.270052] [WARN ] [MAIN ] NMAI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:30:05.270102] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-08T20:30:05.270209] [DEBUG] [LOCAL ] NMAI: No primary data file found to delete. [2025-10-08T20:30:05.270263] [INFO ] [LOCAL ] NMAI: Starting deletion of derivative data. [2025-10-08T20:30:05.270309] [DEBUG] [LOCAL ] NMAI: No derivative data file found to delete. [2025-10-08T20:30:05.270364] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMAI took 48.7s. Estimated remaining: 2h 3m 4s. Rate: 7.1 symbols/min [2025-10-08T20:30:05.438477] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:05.438602] [DEBUG] [LOCAL ] NMM: No existing data file found in primary storage. [2025-10-08T20:30:05.438638] [WARN ] [MAIN ] NMM: No existing data found, performing full refresh instead. [2025-10-08T20:30:05.438772] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-08T20:30:05.438813] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-08T20:30:05.438853] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-08T20:30:05.438905] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-08T20:30:05.618573] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-08T20:30:05.799496] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:06.373304] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:30:06.417503] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-08T20:30:07.099492] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T20:30:07.217516] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-08T20:30:07.809267] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:30:07.810145] [INFO ] [REMOTE ] NMI: Full fetch complete (5972 records). [2025-10-08T20:30:07.810214] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-08T20:30:08.022743] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-08T20:30:08.161863] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-08T20:30:08.161949] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-08T20:30:08.162113] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-08T20:30:08.162151] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-08T20:30:08.162527] [DEBUG] [LOCAL ] NMI: Trimmed 5972 records to 4065 (keeping 200 days of data) [2025-10-08T20:30:08.187169] [DEBUG] [LOCAL ] NMI: Primary data saved (4065 records). [2025-10-08T20:30:08.187250] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-08T20:30:08.187336] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NMI took 17.8s. Estimated remaining: 2h 2m 52s. Rate: 7.1 symbols/min [2025-10-08T20:30:08.351662] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:08.351877] [DEBUG] [LOCAL ] NMR: No existing data file found in primary storage. [2025-10-08T20:30:08.351931] [WARN ] [MAIN ] NMR: No existing data found, performing full refresh instead. [2025-10-08T20:30:08.352044] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-08T20:30:08.352087] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-08T20:30:08.352127] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-08T20:30:08.352201] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-08T20:30:08.780177] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:08.817552] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-10-08T20:30:08.861507] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T20:30:09.617556] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-08T20:30:10.198600] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T20:30:10.417502] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-08T20:30:10.636994] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T20:30:11.217558] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-08T20:30:11.880113] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T20:30:11.988094] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T20:30:12.017505] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-08T20:30:12.790886] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T20:30:12.817518] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-08T20:30:13.617688] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-08T20:30:14.300342] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T20:30:14.417523] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-08T20:30:14.699518] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:30:15.217598] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-08T20:30:15.659450] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:30:15.661378] [INFO ] [REMOTE ] NMG: Full fetch complete (13396 records). [2025-10-08T20:30:15.661449] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-08T20:30:15.661926] [FATAL] [VALIDATOR ] NMG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:30:15.662008] [FATAL] [MAIN ] NMG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:30:15.662051] [WARN ] [MAIN ] NMG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:30:15.662112] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-08T20:30:15.662189] [DEBUG] [LOCAL ] NMG: No primary data file found to delete. [2025-10-08T20:30:15.662243] [INFO ] [LOCAL ] NMG: Starting deletion of derivative data. [2025-10-08T20:30:15.662285] [DEBUG] [LOCAL ] NMG: No derivative data file found to delete. [2025-10-08T20:30:15.662339] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMG took 27.3s. Estimated remaining: 2h 2m 43s. Rate: 7.1 symbols/min [2025-10-08T20:30:15.838045] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:15.844670] [DEBUG] [LOCAL ] NMS: Loaded 2824 existing records from primary storage. [2025-10-08T20:30:15.844871] [INFO ] [MAIN ] NMS: Loaded 2824 existing records. [2025-10-08T20:30:16.029216] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-10-08T20:30:16.035979] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:30:16.037131] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-08T20:30:16.037434] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-08T20:30:16.037721] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-08T20:30:16.037879] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-08T20:30:16.169115] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T20:30:16.429467] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:16.817600] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-08T20:30:17.268169] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T20:30:17.617569] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-10-08T20:30:18.221944] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T20:30:18.245634] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T20:30:18.417563] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-08T20:30:18.861166] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-08T20:30:19.217576] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-08T20:30:19.641875] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T20:30:20.017546] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-08T20:30:20.818966] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-08T20:30:20.820916] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T20:30:21.617565] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-08T20:30:21.998552] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T20:30:22.425632] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-08T20:30:22.429862] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T20:30:22.834218] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T20:30:23.217591] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-08T20:30:24.017557] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-08T20:30:24.557188] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-08T20:30:24.728456] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T20:30:24.817532] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-08T20:30:25.617547] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-08T20:30:25.975390] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T20:30:26.417513] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-08T20:30:26.624785] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T20:30:27.217590] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-08T20:30:27.963754] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:30:27.998351] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T20:30:28.017504] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-08T20:30:28.817571] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-08T20:30:29.370974] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T20:30:29.454205] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T20:30:29.617611] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-08T20:30:30.013340] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-08T20:30:30.417551] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-08T20:30:30.979234] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T20:30:31.217565] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-08T20:30:31.833602] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T20:30:32.017555] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-08T20:30:32.540558] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:30:32.541609] [INFO ] [REMOTE ] NMS: Full fetch complete (4023 records). [2025-10-08T20:30:32.541732] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-08T20:30:32.822675] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-08T20:30:32.943781] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-08T20:30:32.943874] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-08T20:30:32.944024] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-08T20:30:32.944071] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-08T20:30:32.944446] [DEBUG] [LOCAL ] NMS: Trimmed 4023 records to 2822 (keeping 200 days of data) [2025-10-08T20:30:32.962750] [DEBUG] [LOCAL ] NMS: Primary data saved (2822 records). [2025-10-08T20:30:32.962841] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-08T20:30:32.962955] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMS took 17.3s. Estimated remaining: 2h 2m 40s. Rate: 7.1 symbols/min [2025-10-08T20:30:33.130571] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:33.136555] [DEBUG] [LOCAL ] NMT: Loaded 2859 existing records from primary storage. [2025-10-08T20:30:33.136751] [INFO ] [MAIN ] NMT: Loaded 2859 existing records. [2025-10-08T20:30:33.312750] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:30:33.312997] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-08T20:30:33.313052] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-08T20:30:33.313283] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-08T20:30:33.313340] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-08T20:30:33.623266] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-08T20:30:33.664356] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:33.949253] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:30:34.417594] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-10-08T20:30:34.985497] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T20:30:35.217077] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T20:30:35.220739] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-08T20:30:35.813971] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T20:30:36.017576] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-08T20:30:36.817521] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-08T20:30:37.098186] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T20:30:37.563892] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:30:37.617578] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-08T20:30:38.417561] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-08T20:30:38.474415] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T20:30:39.210510] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:30:39.217491] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-08T20:30:40.017516] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-08T20:30:40.214184] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:30:40.541159] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T20:30:40.817526] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-08T20:30:41.282132] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T20:30:41.617544] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-08T20:30:42.417540] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-08T20:30:42.689068] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T20:30:42.696476] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T20:30:42.697922] [INFO ] [REMOTE ] NMCO: Full fetch complete (23874 records). [2025-10-08T20:30:42.697998] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-08T20:30:42.698473] [FATAL] [VALIDATOR ] NMCO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:30:42.698559] [FATAL] [MAIN ] NMCO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:30:42.698602] [WARN ] [MAIN ] NMCO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:30:42.698699] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-08T20:30:42.698773] [DEBUG] [LOCAL ] NMCO: No primary data file found to delete. [2025-10-08T20:30:42.698811] [INFO ] [LOCAL ] NMCO: Starting deletion of derivative data. [2025-10-08T20:30:42.698868] [DEBUG] [LOCAL ] NMCO: No derivative data file found to delete. [2025-10-08T20:30:42.698982] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMCO took 1m 2s. Estimated remaining: 2h 2m 32s. Rate: 7.1 symbols/min [2025-10-08T20:30:42.867465] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:42.892207] [DEBUG] [LOCAL ] NMZ: Loaded 21641 existing records from primary storage. [2025-10-08T20:30:42.892471] [INFO ] [MAIN ] NMZ: Loaded 21641 existing records. [2025-10-08T20:30:43.071134] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:30:43.071395] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-08T20:30:43.071442] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-08T20:30:43.071778] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-08T20:30:43.071835] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-08T20:30:43.222313] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-08T20:30:43.430600] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:44.017598] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-10-08T20:30:44.212763] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T20:30:44.817564] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-08T20:30:45.372998] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:30:45.492908] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T20:30:45.617511] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-08T20:30:46.034713] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:30:46.036952] [INFO ] [REMOTE ] NMM: Full fetch complete (21715 records). [2025-10-08T20:30:46.037028] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-08T20:30:46.037504] [FATAL] [VALIDATOR ] NMM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:30:46.037592] [FATAL] [MAIN ] NMM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:30:46.037636] [WARN ] [MAIN ] NMM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:30:46.037731] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-08T20:30:46.037795] [DEBUG] [LOCAL ] NMM: No primary data file found to delete. [2025-10-08T20:30:46.037852] [INFO ] [LOCAL ] NMM: Starting deletion of derivative data. [2025-10-08T20:30:46.037955] [DEBUG] [LOCAL ] NMM: No derivative data file found to delete. [2025-10-08T20:30:46.038021] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMM took 40.8s. Estimated remaining: 2h 2m 21s. Rate: 7.1 symbols/min [2025-10-08T20:30:46.217150] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:46.217341] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-10-08T20:30:46.217377] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-10-08T20:30:46.217487] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-08T20:30:46.217528] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-08T20:30:46.217568] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-08T20:30:46.217599] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-08T20:30:46.427159] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-08T20:30:46.595494] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:47.217546] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-10-08T20:30:47.283164] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T20:30:48.017509] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-08T20:30:48.079799] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T20:30:48.817586] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-08T20:30:49.229469] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T20:30:49.512525] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T20:30:49.617566] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-08T20:30:50.231527] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T20:30:50.417561] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-08T20:30:51.217552] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-08T20:30:51.325451] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T20:30:51.779158] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T20:30:52.017560] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-08T20:30:52.525319] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T20:30:52.817573] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-08T20:30:53.380880] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:30:53.384168] [INFO ] [REMOTE ] NMR: Full fetch complete (50614 records). [2025-10-08T20:30:53.384316] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-08T20:30:53.385070] [FATAL] [VALIDATOR ] NMR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:30:53.385168] [FATAL] [MAIN ] NMR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:30:53.385214] [WARN ] [MAIN ] NMR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:30:53.385256] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-08T20:30:53.385333] [DEBUG] [LOCAL ] NMR: No primary data file found to delete. [2025-10-08T20:30:53.385406] [INFO ] [LOCAL ] NMR: Starting deletion of derivative data. [2025-10-08T20:30:53.385485] [DEBUG] [LOCAL ] NMR: No derivative data file found to delete. [2025-10-08T20:30:53.385587] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMR took 45.2s. Estimated remaining: 2h 2m 12s. Rate: 7.1 symbols/min [2025-10-08T20:30:53.578144] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:53.578424] [DEBUG] [LOCAL ] NNN: No existing data file found in primary storage. [2025-10-08T20:30:53.578464] [WARN ] [MAIN ] NNN: No existing data found, performing full refresh instead. [2025-10-08T20:30:53.578632] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-08T20:30:53.578712] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-08T20:30:53.578772] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-08T20:30:53.578809] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-08T20:30:53.622877] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-08T20:30:53.979540] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:54.417608] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-08T20:30:54.542144] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T20:30:55.065004] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T20:30:55.217606] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-08T20:30:55.691343] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T20:30:56.017584] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-08T20:30:56.517030] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:30:56.517992] [INFO ] [REMOTE ] NMT: Full fetch complete (4083 records). [2025-10-08T20:30:56.518066] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-08T20:30:56.822695] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-10-08T20:30:56.930155] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-08T20:30:56.930235] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-08T20:30:56.930371] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-08T20:30:56.930409] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-08T20:30:56.930811] [DEBUG] [LOCAL ] NMT: Trimmed 4083 records to 2866 (keeping 200 days of data) [2025-10-08T20:30:56.948420] [DEBUG] [LOCAL ] NMT: Primary data saved (2866 records). [2025-10-08T20:30:56.948499] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-08T20:30:56.948577] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMT took 24.0s. Estimated remaining: 2h 2m 1s. Rate: 7.1 symbols/min [2025-10-08T20:30:57.148615] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:30:57.159013] [DEBUG] [LOCAL ] NNY: Loaded 5632 existing records from primary storage. [2025-10-08T20:30:57.159298] [INFO ] [MAIN ] NNY: Loaded 5632 existing records. [2025-10-08T20:30:57.366303] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:30:57.366565] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-08T20:30:57.366616] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-08T20:30:57.366937] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-08T20:30:57.367016] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-08T20:30:57.622729] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-08T20:30:57.788975] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:30:58.356803] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:30:58.417527] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-10-08T20:30:58.442721] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T20:30:59.217613] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-08T20:30:59.334567] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T20:31:00.017568] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-08T20:31:00.817583] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-08T20:31:00.931676] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T20:31:01.281306] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T20:31:01.575798] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T20:31:01.617614] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-08T20:31:02.417556] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-08T20:31:02.473220] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T20:31:03.123287] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-08T20:31:03.217614] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-08T20:31:04.017571] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-08T20:31:04.437677] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T20:31:04.817554] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-08T20:31:05.617537] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-08T20:31:05.703890] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T20:31:05.970372] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T20:31:06.417526] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-08T20:31:06.472288] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T20:31:07.217526] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-08T20:31:07.321357] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T20:31:08.013489] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T20:31:08.017489] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-08T20:31:08.744340] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T20:31:08.817511] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-08T20:31:09.617559] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-08T20:31:10.068287] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T20:31:10.417565] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-08T20:31:10.542491] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T20:31:11.217599] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-08T20:31:12.017544] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-08T20:31:12.233372] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T20:31:12.252921] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T20:31:12.817582] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-08T20:31:13.263357] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T20:31:13.417932] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T20:31:13.617527] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-08T20:31:14.417561] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-08T20:31:14.495784] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T20:31:15.217550] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-08T20:31:15.657550] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T20:31:16.017622] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-08T20:31:16.500905] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T20:31:16.817565] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-08T20:31:17.310905] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T20:31:17.617572] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-08T20:31:17.837959] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T20:31:17.839850] [INFO ] [REMOTE ] NMZ: Full fetch complete (31673 records). [2025-10-08T20:31:17.839925] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-08T20:31:18.212182] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-08T20:31:18.212263] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-08T20:31:18.212915] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-08T20:31:18.212976] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-08T20:31:18.213703] [DEBUG] [LOCAL ] NMZ: Trimmed 31673 records to 21658 (keeping 200 days of data) [2025-10-08T20:31:18.351230] [DEBUG] [LOCAL ] NMZ: Primary data saved (21658 records). [2025-10-08T20:31:18.351398] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-08T20:31:18.351501] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMZ took 35.7s. Estimated remaining: 2h 1m 60s. Rate: 7.1 symbols/min [2025-10-08T20:31:18.427089] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-08T20:31:18.529254] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:18.529499] [DEBUG] [LOCAL ] NOA: No existing data file found in primary storage. [2025-10-08T20:31:18.529556] [WARN ] [MAIN ] NOA: No existing data found, performing full refresh instead. [2025-10-08T20:31:18.529700] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-08T20:31:18.529755] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-08T20:31:18.529800] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-08T20:31:18.529834] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-08T20:31:18.961625] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:19.015751] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:31:19.016892] [INFO ] [REMOTE ] NNI: Full fetch complete (12860 records). [2025-10-08T20:31:19.016962] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-08T20:31:19.017367] [FATAL] [VALIDATOR ] NNI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:31:19.017450] [FATAL] [MAIN ] NNI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:31:19.017524] [WARN ] [MAIN ] NNI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:31:19.017594] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-08T20:31:19.017710] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-10-08T20:31:19.017766] [INFO ] [LOCAL ] NNI: Starting deletion of derivative data. [2025-10-08T20:31:19.017810] [DEBUG] [LOCAL ] NNI: No derivative data file found to delete. [2025-10-08T20:31:19.017865] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNI took 33.0s. Estimated remaining: 2h 1m 47s. Rate: 7.1 symbols/min [2025-10-08T20:31:19.228042] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-10-08T20:31:19.231013] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:19.232042] [DEBUG] [LOCAL ] NOAH: No existing data file found in primary storage. [2025-10-08T20:31:19.232141] [WARN ] [MAIN ] NOAH: No existing data found, performing full refresh instead. [2025-10-08T20:31:19.232616] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-08T20:31:19.232819] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-08T20:31:19.232961] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-08T20:31:19.233015] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-08T20:31:19.481076] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T20:31:19.639831] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:20.017505] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-08T20:31:20.247143] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:31:20.817682] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-08T20:31:21.543468] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T20:31:21.617507] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-08T20:31:21.791938] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T20:31:22.417529] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-08T20:31:22.483824] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T20:31:23.217554] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-08T20:31:24.017518] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-08T20:31:24.309097] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:31:24.311223] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T20:31:24.768876] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T20:31:24.817530] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-08T20:31:25.492179] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T20:31:25.617690] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-08T20:31:26.306516] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T20:31:26.307994] [INFO ] [REMOTE ] NNY: Full fetch complete (8636 records). [2025-10-08T20:31:26.308083] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-08T20:31:26.422814] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-08T20:31:26.689630] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-08T20:31:26.689738] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-08T20:31:26.689952] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-08T20:31:26.689991] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-08T20:31:26.690456] [DEBUG] [LOCAL ] NNY: Trimmed 8636 records to 5633 (keeping 200 days of data) [2025-10-08T20:31:26.741179] [DEBUG] [LOCAL ] NNY: Primary data saved (5633 records). [2025-10-08T20:31:26.741324] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-08T20:31:26.741411] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NNY took 29.8s. Estimated remaining: 2h 1m 38s. Rate: 7.1 symbols/min [2025-10-08T20:31:26.910329] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:26.910522] [DEBUG] [LOCAL ] NOC: No existing data file found in primary storage. [2025-10-08T20:31:26.910560] [WARN ] [MAIN ] NOC: No existing data found, performing full refresh instead. [2025-10-08T20:31:26.910748] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-08T20:31:26.910789] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-08T20:31:26.910830] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-08T20:31:26.910861] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-08T20:31:27.233169] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-08T20:31:27.264410] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:27.399272] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T20:31:28.017541] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-10-08T20:31:28.817511] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-10-08T20:31:28.961381] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T20:31:29.363905] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T20:31:29.617579] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-08T20:31:30.180782] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:31:30.353551] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T20:31:30.417555] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-08T20:31:31.191152] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:31:31.217507] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-08T20:31:32.017543] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-08T20:31:32.404557] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T20:31:32.817559] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-08T20:31:33.617525] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-08T20:31:33.780856] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T20:31:34.232949] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T20:31:34.417572] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-08T20:31:35.217573] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-08T20:31:35.321885] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T20:31:35.551810] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:31:36.017570] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-08T20:31:36.248049] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:31:36.777444] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:31:36.782107] [INFO ] [REMOTE ] NNN: Full fetch complete (69973 records). [2025-10-08T20:31:36.782295] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-08T20:31:36.783302] [FATAL] [VALIDATOR ] NNN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:31:36.783433] [FATAL] [MAIN ] NNN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:31:36.783493] [WARN ] [MAIN ] NNN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:31:36.783564] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-08T20:31:36.783632] [DEBUG] [LOCAL ] NNN: No primary data file found to delete. [2025-10-08T20:31:36.783712] [INFO ] [LOCAL ] NNN: Starting deletion of derivative data. [2025-10-08T20:31:36.783764] [DEBUG] [LOCAL ] NNN: No derivative data file found to delete. [2025-10-08T20:31:36.783827] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNN took 43.4s. Estimated remaining: 2h 1m 30s. Rate: 7.1 symbols/min [2025-10-08T20:31:36.822867] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-08T20:31:36.970562] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:36.970818] [DEBUG] [LOCAL ] NOG: No existing data file found in primary storage. [2025-10-08T20:31:36.970860] [WARN ] [MAIN ] NOG: No existing data found, performing full refresh instead. [2025-10-08T20:31:36.970932] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-08T20:31:36.970967] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-08T20:31:36.971006] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-08T20:31:36.971037] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-08T20:31:37.333027] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:37.617528] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-10-08T20:31:37.926280] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:31:38.417584] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-08T20:31:39.217555] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-08T20:31:39.237614] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T20:31:39.372220] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T20:31:40.017552] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-08T20:31:40.814726] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T20:31:40.823272] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-08T20:31:41.235864] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T20:31:41.469779] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T20:31:41.617552] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-08T20:31:42.417552] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-08T20:31:43.217557] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-08T20:31:43.427972] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T20:31:43.481092] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T20:31:44.017529] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-08T20:31:44.250100] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T20:31:44.817558] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-08T20:31:44.924205] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T20:31:45.617552] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-08T20:31:45.865518] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T20:31:46.417560] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-08T20:31:47.217546] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-08T20:31:47.502143] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T20:31:47.528840] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:31:48.017542] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-08T20:31:48.340828] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:31:48.342533] [INFO ] [REMOTE ] NOAH: Full fetch complete (27966 records). [2025-10-08T20:31:48.342610] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-08T20:31:48.343156] [FATAL] [VALIDATOR ] NOAH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:31:48.343263] [FATAL] [MAIN ] NOAH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:31:48.343306] [WARN ] [MAIN ] NOAH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:31:48.343378] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-08T20:31:48.343439] [DEBUG] [LOCAL ] NOAH: No primary data file found to delete. [2025-10-08T20:31:48.343488] [INFO ] [LOCAL ] NOAH: Starting deletion of derivative data. [2025-10-08T20:31:48.343555] [DEBUG] [LOCAL ] NOAH: No derivative data file found to delete. [2025-10-08T20:31:48.343612] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOAH took 29.3s. Estimated remaining: 2h 1m 24s. Rate: 7.1 symbols/min [2025-10-08T20:31:48.524152] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:48.524355] [DEBUG] [LOCAL ] NOK: No existing data file found in primary storage. [2025-10-08T20:31:48.524403] [WARN ] [MAIN ] NOK: No existing data found, performing full refresh instead. [2025-10-08T20:31:48.524552] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-08T20:31:48.524618] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-08T20:31:48.525151] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-08T20:31:48.525242] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-08T20:31:48.822627] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-08T20:31:48.894331] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:49.018940] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T20:31:49.617548] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-08T20:31:49.818190] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (0.20 seconds). [2025-10-08T20:31:49.819894] [INFO ] [REMOTE ] NOA: Full fetch complete (22139 records). [2025-10-08T20:31:49.820019] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-08T20:31:49.820530] [FATAL] [VALIDATOR ] NOA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:31:49.820626] [FATAL] [MAIN ] NOA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:31:49.820732] [WARN ] [MAIN ] NOA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:31:49.820823] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-08T20:31:49.820905] [DEBUG] [LOCAL ] NOA: No primary data file found to delete. [2025-10-08T20:31:49.820944] [INFO ] [LOCAL ] NOA: Starting deletion of derivative data. [2025-10-08T20:31:49.820985] [DEBUG] [LOCAL ] NOA: No derivative data file found to delete. [2025-10-08T20:31:49.821042] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NOA took 31.5s. Estimated remaining: 2h 1m 11s. Rate: 7.1 symbols/min [2025-10-08T20:31:50.001417] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:31:50.001570] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-08T20:31:50.001664] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-08T20:31:50.001818] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-08T20:31:50.001878] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-08T20:31:50.001924] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-08T20:31:50.001960] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-08T20:31:50.375463] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:31:50.417508] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-10-08T20:31:50.459528] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T20:31:50.982132] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T20:31:51.217574] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-08T20:31:52.017554] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-08T20:31:52.405576] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T20:31:52.731378] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T20:31:52.817555] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-08T20:31:53.617598] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-10-08T20:31:54.354398] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T20:31:54.417612] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-08T20:31:54.869810] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T20:31:55.217577] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-08T20:31:55.475470] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T20:31:56.017615] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-08T20:31:56.474344] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T20:31:56.817582] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-08T20:31:57.043577] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T20:31:57.617566] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-08T20:31:58.417529] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-08T20:31:58.516035] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T20:31:59.217570] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-08T20:31:59.501532] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T20:31:59.759738] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T20:32:00.017555] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-08T20:32:00.540798] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T20:32:00.817594] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-08T20:32:00.966369] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T20:32:01.617600] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-08T20:32:02.417537] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-08T20:32:02.631869] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T20:32:02.941271] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T20:32:03.217613] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-08T20:32:03.979976] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:32:04.017553] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-08T20:32:04.817565] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-08T20:32:05.432619] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-08T20:32:05.466711] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-08T20:32:05.590849] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T20:32:05.617510] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-08T20:32:06.046831] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:32:06.049391] [INFO ] [REMOTE ] NOC: Full fetch complete (61364 records). [2025-10-08T20:32:06.049513] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-08T20:32:06.050256] [FATAL] [VALIDATOR ] NOC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:06.050353] [FATAL] [MAIN ] NOC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:06.050429] [WARN ] [MAIN ] NOC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:06.050522] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-08T20:32:06.050602] [DEBUG] [LOCAL ] NOC: No primary data file found to delete. [2025-10-08T20:32:06.050657] [INFO ] [LOCAL ] NOC: Starting deletion of derivative data. [2025-10-08T20:32:06.050730] [DEBUG] [LOCAL ] NOC: No derivative data file found to delete. [2025-10-08T20:32:06.050790] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOC took 39.3s. Estimated remaining: 2h 1m 7s. Rate: 7.1 symbols/min [2025-10-08T20:32:06.223978] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:06.224181] [DEBUG] [LOCAL ] NOMD: No existing data file found in primary storage. [2025-10-08T20:32:06.224218] [WARN ] [MAIN ] NOMD: No existing data found, performing full refresh instead. [2025-10-08T20:32:06.224392] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-08T20:32:06.224463] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-08T20:32:06.224516] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-08T20:32:06.224548] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-08T20:32:06.422664] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-08T20:32:06.605412] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:07.217576] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-10-08T20:32:08.017565] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-08T20:32:08.169036] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T20:32:08.624456] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T20:32:08.817544] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-08T20:32:09.617587] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-08T20:32:09.904690] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T20:32:10.015783] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T20:32:10.111739] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T20:32:10.417537] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-08T20:32:11.133040] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:32:11.217678] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-08T20:32:12.017563] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-08T20:32:12.817547] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-08T20:32:13.205471] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-08T20:32:13.387067] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T20:32:13.552307] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T20:32:13.617575] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-08T20:32:14.417576] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-08T20:32:15.217587] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-08T20:32:15.249250] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T20:32:16.017511] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-08T20:32:16.206732] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T20:32:16.482942] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T20:32:16.712520] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T20:32:16.817569] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-08T20:32:17.617588] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-08T20:32:18.368329] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T20:32:18.417517] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-08T20:32:18.968227] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T20:32:18.971902] [INFO ] [REMOTE ] NOG: Full fetch complete (73561 records). [2025-10-08T20:32:18.972052] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-08T20:32:18.972881] [FATAL] [VALIDATOR ] NOG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:18.972979] [FATAL] [MAIN ] NOG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:18.973069] [WARN ] [MAIN ] NOG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:18.973142] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-08T20:32:18.973205] [DEBUG] [LOCAL ] NOG: No primary data file found to delete. [2025-10-08T20:32:18.973241] [INFO ] [LOCAL ] NOG: Starting deletion of derivative data. [2025-10-08T20:32:18.973279] [DEBUG] [LOCAL ] NOG: No derivative data file found to delete. [2025-10-08T20:32:18.973352] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOG took 42.2s. Estimated remaining: 2h 1m 2s. Rate: 7.1 symbols/min [2025-10-08T20:32:19.146217] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:19.146416] [DEBUG] [LOCAL ] NOTE: No existing data file found in primary storage. [2025-10-08T20:32:19.146471] [WARN ] [MAIN ] NOTE: No existing data found, performing full refresh instead. [2025-10-08T20:32:19.146591] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-08T20:32:19.146632] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-08T20:32:19.146714] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-08T20:32:19.146754] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-08T20:32:19.222631] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-08T20:32:19.523777] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:19.616895] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T20:32:19.618042] [INFO ] [REMOTE ] NOM: Full fetch complete (1569 records). [2025-10-08T20:32:19.618141] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-08T20:32:19.819638] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-08T20:32:19.820046] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:19.820135] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:19.837475] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-08T20:32:19.851773] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-08T20:32:19.852040] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-08T20:32:19.852499] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-08T20:32:19.854105] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOM took 30.0s. Estimated remaining: 2h 0m 49s. Rate: 7.1 symbols/min [2025-10-08T20:32:19.854005] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T20:32:20.022394] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-10-08T20:32:20.041166] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:20.041298] [DEBUG] [LOCAL ] NOV: No existing data file found in primary storage. [2025-10-08T20:32:20.041526] [WARN ] [MAIN ] NOV: No existing data found, performing full refresh instead. [2025-10-08T20:32:20.041876] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-08T20:32:20.041944] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-08T20:32:20.042772] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-08T20:32:20.042827] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-08T20:32:20.425545] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:20.817567] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-08T20:32:21.617513] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-08T20:32:21.827776] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T20:32:22.417710] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-10-08T20:32:22.585514] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T20:32:23.217561] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-08T20:32:23.736504] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-08T20:32:24.017520] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-08T20:32:24.257492] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T20:32:24.817515] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-08T20:32:25.039942] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-08T20:32:25.617623] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-08T20:32:26.241087] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T20:32:26.284902] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T20:32:26.417576] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-08T20:32:27.174498] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T20:32:27.217566] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-08T20:32:28.017570] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-08T20:32:28.127358] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T20:32:28.730196] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T20:32:28.817628] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-08T20:32:29.448072] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T20:32:29.617551] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-08T20:32:29.983920] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T20:32:30.417561] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-08T20:32:31.217533] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-08T20:32:31.379046] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T20:32:32.026144] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-08T20:32:32.050877] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T20:32:32.817538] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-08T20:32:32.975691] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T20:32:33.617533] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-08T20:32:33.693225] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T20:32:34.266253] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:32:34.270017] [INFO ] [REMOTE ] NOK: Full fetch complete (77248 records). [2025-10-08T20:32:34.270196] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-08T20:32:34.271263] [FATAL] [VALIDATOR ] NOK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:34.271371] [FATAL] [MAIN ] NOK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:34.271418] [WARN ] [MAIN ] NOK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:34.271487] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-08T20:32:34.271554] [DEBUG] [LOCAL ] NOK: No primary data file found to delete. [2025-10-08T20:32:34.271613] [INFO ] [LOCAL ] NOK: Starting deletion of derivative data. [2025-10-08T20:32:34.271725] [DEBUG] [LOCAL ] NOK: No derivative data file found to delete. [2025-10-08T20:32:34.271805] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOK took 45.9s. Estimated remaining: 2h 0m 44s. Rate: 7.1 symbols/min [2025-10-08T20:32:34.423505] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-08T20:32:34.463910] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:34.464371] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-10-08T20:32:34.464428] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-10-08T20:32:34.464760] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-08T20:32:34.464832] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-08T20:32:34.464969] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-08T20:32:34.465032] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-08T20:32:34.693675] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T20:32:34.890318] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:35.217561] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-08T20:32:36.017532] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-08T20:32:36.360503] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-08T20:32:36.365697] [INFO ] [REMOTE ] NOMD: Full fetch complete (59166 records). [2025-10-08T20:32:36.365877] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-08T20:32:36.366787] [FATAL] [VALIDATOR ] NOMD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:36.366914] [FATAL] [MAIN ] NOMD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:36.366975] [WARN ] [MAIN ] NOMD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:36.367060] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-08T20:32:36.367154] [DEBUG] [LOCAL ] NOMD: No primary data file found to delete. [2025-10-08T20:32:36.367210] [INFO ] [LOCAL ] NOMD: Starting deletion of derivative data. [2025-10-08T20:32:36.367273] [DEBUG] [LOCAL ] NOMD: No derivative data file found to delete. [2025-10-08T20:32:36.367354] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOMD took 30.3s. Estimated remaining: 2h 0m 32s. Rate: 7.1 symbols/min [2025-10-08T20:32:36.587942] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:36.588293] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-08T20:32:36.588390] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-08T20:32:36.620712] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-08T20:32:36.620850] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-08T20:32:36.620929] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-08T20:32:36.620971] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-08T20:32:36.629106] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-08T20:32:36.822688] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-08T20:32:37.047349] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:37.327615] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-08T20:32:37.617607] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-10-08T20:32:38.417563] [INFO ] [REMOTE ] NP: Fetching primary data for 2024-12. [2025-10-08T20:32:38.625621] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T20:32:38.700513] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:32:38.700919] [WARN ] [REMOTE ] NP: No data returned for month 2024-12 [2025-10-08T20:32:38.701039] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:32:38.701289] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-08T20:32:38.701355] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:32:38.701427] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-08T20:32:38.701505] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-08T20:32:38.701561] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-08T20:32:38.701606] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-08T20:32:38.701679] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NP took 2.3s. Estimated remaining: 2h 0m 20s. Rate: 7.1 symbols/min [2025-10-08T20:32:38.894256] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:38.894502] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-08T20:32:38.894552] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-08T20:32:38.894702] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-08T20:32:38.894756] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-08T20:32:38.894799] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-08T20:32:38.894832] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-08T20:32:39.222192] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-08T20:32:39.313871] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:39.606344] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-08T20:32:40.017552] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-08T20:32:40.817625] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-08T20:32:40.847464] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T20:32:41.617553] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-08T20:32:42.212327] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-08T20:32:42.305177] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:32:42.417513] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-08T20:32:43.217517] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-08T20:32:43.251713] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T20:32:44.017568] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-10-08T20:32:44.306722] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:32:44.307079] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-10-08T20:32:44.307177] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:32:44.307244] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-08T20:32:44.307323] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:32:44.307470] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-08T20:32:44.307562] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-08T20:32:44.307613] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-08T20:32:44.307713] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-08T20:32:44.307801] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NPB took 5.6s. Estimated remaining: 2h 0m 10s. Rate: 7.1 symbols/min [2025-10-08T20:32:44.489591] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:44.489876] [DEBUG] [LOCAL ] NPCT: No existing data file found in primary storage. [2025-10-08T20:32:44.489957] [WARN ] [MAIN ] NPCT: No existing data found, performing full refresh instead. [2025-10-08T20:32:44.490188] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-08T20:32:44.490247] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-08T20:32:44.490291] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-08T20:32:44.490377] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-08T20:32:44.833314] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-08T20:32:44.879205] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:44.910321] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-08T20:32:44.958381] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T20:32:45.617631] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-08T20:32:46.417543] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-10-08T20:32:47.044246] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-08T20:32:47.098589] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T20:32:47.217532] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-08T20:32:47.891549] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-08T20:32:48.017619] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-08T20:32:48.210797] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T20:32:48.817573] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-08T20:32:49.617589] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-08T20:32:49.634920] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T20:32:50.380017] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-08T20:32:50.417504] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-08T20:32:51.215378] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T20:32:51.219818] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-08T20:32:52.017568] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-08T20:32:52.191585] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T20:32:52.485493] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-08T20:32:52.817571] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-08T20:32:53.617598] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-08T20:32:53.664251] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T20:32:53.712440] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T20:32:54.269602] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:32:54.274755] [INFO ] [REMOTE ] NOV: Full fetch complete (76602 records). [2025-10-08T20:32:54.275001] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-08T20:32:54.276094] [FATAL] [VALIDATOR ] NOV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:54.276215] [FATAL] [MAIN ] NOV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:54.276259] [WARN ] [MAIN ] NOV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:54.276298] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-08T20:32:54.276355] [DEBUG] [LOCAL ] NOV: No primary data file found to delete. [2025-10-08T20:32:54.276389] [INFO ] [LOCAL ] NOV: Starting deletion of derivative data. [2025-10-08T20:32:54.276427] [DEBUG] [LOCAL ] NOV: No derivative data file found to delete. [2025-10-08T20:32:54.276515] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOV took 34.4s. Estimated remaining: 2h 0m 2s. Rate: 7.1 symbols/min [2025-10-08T20:32:54.422627] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-08T20:32:54.496543] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:32:54.497505] [DEBUG] [LOCAL ] NPFD: No existing data file found in primary storage. [2025-10-08T20:32:54.497554] [WARN ] [MAIN ] NPFD: No existing data found, performing full refresh instead. [2025-10-08T20:32:54.497754] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-08T20:32:54.497811] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-08T20:32:54.497869] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-08T20:32:54.497914] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-08T20:32:54.886774] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:32:55.217552] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-10-08T20:32:55.945243] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T20:32:56.013932] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T20:32:56.017471] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-08T20:32:56.817520] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-08T20:32:56.944287] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T20:32:57.332903] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:32:57.335169] [INFO ] [REMOTE ] NOTE: Full fetch complete (62684 records). [2025-10-08T20:32:57.335262] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-08T20:32:57.336350] [FATAL] [VALIDATOR ] NOTE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:32:57.336447] [FATAL] [MAIN ] NOTE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:32:57.336509] [WARN ] [MAIN ] NOTE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:32:57.336562] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-08T20:32:57.336669] [DEBUG] [LOCAL ] NOTE: No primary data file found to delete. [2025-10-08T20:32:57.336730] [INFO ] [LOCAL ] NOTE: Starting deletion of derivative data. [2025-10-08T20:32:57.336774] [DEBUG] [LOCAL ] NOTE: No derivative data file found to delete. [2025-10-08T20:32:57.336833] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NOTE took 38.4s. Estimated remaining: 1h 59m 51s. Rate: 7.1 symbols/min [2025-10-08T20:32:57.617571] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-08T20:32:58.417617] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-08T20:32:58.935936] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T20:32:59.217552] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-08T20:32:59.341707] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T20:32:59.804963] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T20:33:00.017677] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-08T20:33:00.817568] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-08T20:33:01.199716] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T20:33:01.615474] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T20:33:01.620614] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-08T20:33:02.417585] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-08T20:33:03.105964] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T20:33:03.217616] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-08T20:33:03.901327] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-08T20:33:04.019510] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-08T20:33:04.021848] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T20:33:04.817522] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-08T20:33:05.146152] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T20:33:05.565234] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T20:33:05.617577] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-08T20:33:06.151956] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T20:33:06.417559] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-08T20:33:07.217568] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-08T20:33:07.336811] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T20:33:08.017582] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-08T20:33:08.094350] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-08T20:33:08.411233] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T20:33:08.412678] [INFO ] [REMOTE ] NPFD: Full fetch complete (14686 records). [2025-10-08T20:33:08.412770] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-08T20:33:08.413331] [FATAL] [VALIDATOR ] NPFD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:33:08.413430] [FATAL] [MAIN ] NPFD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:33:08.413472] [WARN ] [MAIN ] NPFD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:33:08.413563] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-08T20:33:08.413715] [DEBUG] [LOCAL ] NPFD: No primary data file found to delete. [2025-10-08T20:33:08.413782] [INFO ] [LOCAL ] NPFD: Starting deletion of derivative data. [2025-10-08T20:33:08.413845] [DEBUG] [LOCAL ] NPFD: No derivative data file found to delete. [2025-10-08T20:33:08.413921] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NPFD took 14.1s. Estimated remaining: 1h 59m 44s. Rate: 7.1 symbols/min [2025-10-08T20:33:08.817607] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-08T20:33:09.617575] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-08T20:33:09.797222] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T20:33:10.350023] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T20:33:10.417540] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-08T20:33:11.217546] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-08T20:33:11.425178] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:33:12.017611] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-08T20:33:12.561890] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:33:12.563438] [INFO ] [REMOTE ] NPCT: Full fetch complete (25029 records). [2025-10-08T20:33:12.563511] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-08T20:33:12.563998] [FATAL] [VALIDATOR ] NPCT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:33:12.564082] [FATAL] [MAIN ] NPCT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:33:12.564124] [WARN ] [MAIN ] NPCT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:33:12.564161] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-08T20:33:12.564215] [DEBUG] [LOCAL ] NPCT: No primary data file found to delete. [2025-10-08T20:33:12.564247] [INFO ] [LOCAL ] NPCT: Starting deletion of derivative data. [2025-10-08T20:33:12.564286] [DEBUG] [LOCAL ] NPCT: No derivative data file found to delete. [2025-10-08T20:33:12.564339] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPCT took 28.3s. Estimated remaining: 1h 59m 33s. Rate: 7.1 symbols/min [2025-10-08T20:33:13.146618] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T20:33:13.156624] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-08T20:33:13.798152] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:33:13.801591] [INFO ] [REMOTE ] NOW: Full fetch complete (70346 records). [2025-10-08T20:33:13.801786] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-08T20:33:13.802615] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:33:13.802751] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:33:13.802829] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:33:13.802920] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-08T20:33:13.803005] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-10-08T20:33:13.803042] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-10-08T20:33:13.803080] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-10-08T20:33:13.803139] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NOW took 39.5s. Estimated remaining: 1h 59m 21s. Rate: 7.1 symbols/min [2025-10-08T20:33:14.344499] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:14.384460] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:14.405409] [DEBUG] [LOCAL ] NPK: No existing data file found in primary storage. [2025-10-08T20:33:14.439925] [WARN ] [MAIN ] NPK: No existing data found, performing full refresh instead. [2025-10-08T20:33:14.434772] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-10-08T20:33:14.453248] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-08T20:33:14.507044] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:14.491816] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-08T20:33:14.503884] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-10-08T20:33:14.509424] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-08T20:33:14.510663] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-08T20:33:14.510254] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:14.511035] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-08T20:33:14.511130] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-08T20:33:14.522054] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-08T20:33:14.522155] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-08T20:33:14.531542] [DEBUG] [LOCAL ] NPO: No existing data file found in primary storage. [2025-10-08T20:33:14.577751] [WARN ] [MAIN ] NPO: No existing data found, performing full refresh instead. [2025-10-08T20:33:14.578000] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-08T20:33:14.595881] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-08T20:33:14.623232] [DEBUG] [LOCAL ] NPV: Loaded 5136 existing records from primary storage. [2025-10-08T20:33:14.623377] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-08T20:33:14.644260] [INFO ] [MAIN ] NPV: Loaded 5136 existing records. [2025-10-08T20:33:14.677436] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-08T20:33:15.516319] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:33:15.607469] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-08T20:33:15.655706] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-08T20:33:15.674967] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:15.675036] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-08T20:33:15.700987] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-10-08T20:33:15.724128] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-08T20:33:15.831003] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:15.861472] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:15.897062] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-10-08T20:33:15.903573] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-10-08T20:33:16.196717] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:16.197033] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-10-08T20:33:16.698176] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T20:33:16.739063] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T20:33:16.817515] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-08T20:33:16.859235] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T20:33:16.893999] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T20:33:17.617615] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-08T20:33:17.974608] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T20:33:18.417581] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-08T20:33:18.469309] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T20:33:18.929786] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T20:33:19.217597] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-08T20:33:19.727259] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T20:33:20.017558] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-08T20:33:20.702152] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T20:33:20.817502] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-08T20:33:21.489496] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T20:33:21.617548] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-08T20:33:22.178386] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T20:33:22.417595] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-08T20:33:23.143001] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T20:33:23.217528] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-08T20:33:23.721203] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-08T20:33:24.017560] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-08T20:33:24.817520] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-08T20:33:25.025351] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T20:33:25.617593] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-08T20:33:25.650525] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T20:33:26.417547] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-08T20:33:26.537451] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T20:33:27.217522] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-08T20:33:27.274828] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T20:33:27.721436] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T20:33:28.017539] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-08T20:33:28.817545] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-08T20:33:29.213315] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T20:33:29.589903] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T20:33:29.617525] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-08T20:33:30.340212] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T20:33:30.417556] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-08T20:33:31.217522] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-08T20:33:31.519931] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T20:33:32.017557] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-08T20:33:32.714999] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T20:33:32.817561] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-08T20:33:33.062264] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T20:33:33.617553] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-08T20:33:34.219327] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T20:33:34.259028] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T20:33:34.417528] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-08T20:33:35.217512] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-08T20:33:35.294522] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T20:33:36.005759] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:33:36.017492] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-08T20:33:36.784603] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T20:33:36.817548] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-08T20:33:37.522667] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:33:37.523793] [INFO ] [REMOTE ] NPK: Full fetch complete (10845 records). [2025-10-08T20:33:37.523864] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-08T20:33:37.524428] [FATAL] [VALIDATOR ] NPK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:33:37.524512] [FATAL] [MAIN ] NPK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:33:37.524568] [WARN ] [MAIN ] NPK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:33:37.524684] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-08T20:33:37.524790] [DEBUG] [LOCAL ] NPK: No primary data file found to delete. [2025-10-08T20:33:37.524860] [INFO ] [LOCAL ] NPK: Starting deletion of derivative data. [2025-10-08T20:33:37.524922] [DEBUG] [LOCAL ] NPK: No derivative data file found to delete. [2025-10-08T20:33:37.525008] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPK took 23.7s. Estimated remaining: 1h 59m 21s. Rate: 7.1 symbols/min [2025-10-08T20:33:37.622615] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-08T20:33:37.697209] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:37.697358] [DEBUG] [LOCAL ] NPWR: No existing data file found in primary storage. [2025-10-08T20:33:37.697402] [WARN ] [MAIN ] NPWR: No existing data found, performing full refresh instead. [2025-10-08T20:33:37.697513] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-08T20:33:37.697552] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-08T20:33:37.697592] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-08T20:33:37.697623] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-08T20:33:38.048438] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:38.417570] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-10-08T20:33:39.217548] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-08T20:33:39.276246] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:33:39.752404] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T20:33:40.017502] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-08T20:33:40.123112] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T20:33:40.739193] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T20:33:40.817717] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-08T20:33:41.617576] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-08T20:33:42.340891] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T20:33:42.417632] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-08T20:33:42.443320] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T20:33:43.142590] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T20:33:43.217722] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-08T20:33:43.729677] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:33:43.730905] [INFO ] [REMOTE ] NPV: Full fetch complete (7029 records). [2025-10-08T20:33:43.730993] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-08T20:33:44.022749] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-08T20:33:44.180516] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-08T20:33:44.180687] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-08T20:33:44.180950] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-08T20:33:44.180991] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-08T20:33:44.181522] [DEBUG] [LOCAL ] NPV: Trimmed 7029 records to 5226 (keeping 200 days of data) [2025-10-08T20:33:44.219611] [DEBUG] [LOCAL ] NPV: Primary data saved (5226 records). [2025-10-08T20:33:44.219817] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-08T20:33:44.219955] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPV took 30.4s. Estimated remaining: 1h 59m 11s. Rate: 7.1 symbols/min [2025-10-08T20:33:44.431815] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:44.445904] [DEBUG] [LOCAL ] NQP: Loaded 9263 existing records from primary storage. [2025-10-08T20:33:44.446224] [INFO ] [MAIN ] NQP: Loaded 9263 existing records. [2025-10-08T20:33:44.662998] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:33:44.663312] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-08T20:33:44.663370] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-08T20:33:44.663588] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-08T20:33:44.663683] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-08T20:33:44.837780] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-08T20:33:45.109409] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:45.333990] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T20:33:45.617599] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-10-08T20:33:46.189878] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T20:33:46.417560] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-08T20:33:46.970172] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T20:33:47.217598] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-08T20:33:48.017585] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-08T20:33:48.049286] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T20:33:48.232593] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T20:33:48.555605] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:33:48.557340] [INFO ] [REMOTE ] NPO: Full fetch complete (18153 records). [2025-10-08T20:33:48.557413] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-08T20:33:48.557878] [FATAL] [VALIDATOR ] NPO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:33:48.557969] [FATAL] [MAIN ] NPO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:33:48.558011] [WARN ] [MAIN ] NPO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:33:48.558048] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-08T20:33:48.558104] [DEBUG] [LOCAL ] NPO: No primary data file found to delete. [2025-10-08T20:33:48.558177] [INFO ] [LOCAL ] NPO: Starting deletion of derivative data. [2025-10-08T20:33:48.558239] [DEBUG] [LOCAL ] NPO: No derivative data file found to delete. [2025-10-08T20:33:48.558294] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPO took 34.7s. Estimated remaining: 1h 59m 1s. Rate: 7.1 symbols/min [2025-10-08T20:33:48.746104] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:33:48.746407] [DEBUG] [LOCAL ] NRDY: No existing data file found in primary storage. [2025-10-08T20:33:48.746453] [WARN ] [MAIN ] NRDY: No existing data found, performing full refresh instead. [2025-10-08T20:33:48.746594] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-08T20:33:48.746638] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-08T20:33:48.746747] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-08T20:33:48.746798] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-08T20:33:48.822774] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-08T20:33:49.151034] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:33:49.617540] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-10-08T20:33:49.755361] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T20:33:50.417575] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-08T20:33:51.217517] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-08T20:33:51.726612] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-08T20:33:51.824044] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T20:33:52.017600] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-08T20:33:52.799665] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T20:33:52.817510] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-08T20:33:53.544346] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T20:33:53.617584] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-08T20:33:54.339056] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T20:33:54.419518] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-08T20:33:54.422708] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T20:33:55.217579] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-08T20:33:56.017534] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-08T20:33:56.080956] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T20:33:56.558111] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T20:33:56.817510] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-08T20:33:56.972197] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T20:33:57.617545] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-08T20:33:58.192997] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T20:33:58.417522] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-08T20:33:59.217577] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-08T20:33:59.254446] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T20:34:00.017697] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-08T20:34:00.082240] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T20:34:00.464571] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T20:34:00.817560] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-08T20:34:01.617517] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-08T20:34:01.834376] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T20:34:01.948062] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:34:02.417609] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-08T20:34:02.554935] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T20:34:03.217570] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-08T20:34:03.569455] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-08T20:34:03.572379] [INFO ] [REMOTE ] NPKI: Full fetch complete (55429 records). [2025-10-08T20:34:03.572484] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-08T20:34:03.573123] [FATAL] [VALIDATOR ] NPKI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:34:03.573209] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:34:03.573250] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:34:03.573318] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-08T20:34:03.573381] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-10-08T20:34:03.573415] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-10-08T20:34:03.573453] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-10-08T20:34:03.573511] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPKI took 49.8s. Estimated remaining: 1h 58m 56s. Rate: 7.1 symbols/min [2025-10-08T20:34:03.749973] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:03.750185] [DEBUG] [LOCAL ] NREF: No existing data file found in primary storage. [2025-10-08T20:34:03.750299] [WARN ] [MAIN ] NREF: No existing data found, performing full refresh instead. [2025-10-08T20:34:03.750423] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-08T20:34:03.750599] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-08T20:34:03.750831] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-08T20:34:03.750880] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-08T20:34:03.870744] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T20:34:04.022734] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-08T20:34:04.137697] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:04.817569] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-08T20:34:05.617604] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-08T20:34:05.921937] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-08T20:34:05.993716] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T20:34:06.363183] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T20:34:06.417537] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-08T20:34:07.000742] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T20:34:07.217525] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-08T20:34:08.017690] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-10-08T20:34:08.818381] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T20:34:08.818015] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-08T20:34:08.846846] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T20:34:09.617622] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-08T20:34:10.224402] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T20:34:10.257495] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T20:34:10.417503] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-08T20:34:11.217609] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-08T20:34:11.839093] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T20:34:12.017591] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-08T20:34:12.775194] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T20:34:12.817497] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-08T20:34:13.174076] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T20:34:13.177058] [INFO ] [REMOTE ] NPWR: Full fetch complete (59353 records). [2025-10-08T20:34:13.177154] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-08T20:34:13.177784] [FATAL] [VALIDATOR ] NPWR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:34:13.177886] [FATAL] [MAIN ] NPWR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:34:13.177963] [WARN ] [MAIN ] NPWR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:34:13.178057] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-08T20:34:13.178165] [DEBUG] [LOCAL ] NPWR: No primary data file found to delete. [2025-10-08T20:34:13.178220] [INFO ] [LOCAL ] NPWR: Starting deletion of derivative data. [2025-10-08T20:34:13.178265] [DEBUG] [LOCAL ] NPWR: No derivative data file found to delete. [2025-10-08T20:34:13.178323] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NPWR took 35.7s. Estimated remaining: 1h 58m 48s. Rate: 7.1 symbols/min [2025-10-08T20:34:13.350886] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:13.351051] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-08T20:34:13.351105] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-08T20:34:13.351241] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-08T20:34:13.351298] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-08T20:34:13.351344] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-08T20:34:13.351376] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-08T20:34:13.620373] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-08T20:34:13.756428] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:13.748346] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T20:34:14.343138] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T20:34:14.417517] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-08T20:34:15.217555] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-08T20:34:15.351219] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T20:34:15.585274] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T20:34:15.587778] [INFO ] [REMOTE ] NRDY: Full fetch complete (50876 records). [2025-10-08T20:34:15.587918] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-08T20:34:15.588597] [FATAL] [VALIDATOR ] NRDY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:34:15.588706] [FATAL] [MAIN ] NRDY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:34:15.588754] [WARN ] [MAIN ] NRDY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:34:15.588794] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-08T20:34:15.588850] [DEBUG] [LOCAL ] NRDY: No primary data file found to delete. [2025-10-08T20:34:15.588885] [INFO ] [LOCAL ] NRDY: Starting deletion of derivative data. [2025-10-08T20:34:15.588980] [DEBUG] [LOCAL ] NRDY: No derivative data file found to delete. [2025-10-08T20:34:15.589047] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NRDY took 27.0s. Estimated remaining: 1h 58m 36s. Rate: 7.1 symbols/min [2025-10-08T20:34:15.788046] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:15.788271] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-08T20:34:15.788329] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-08T20:34:15.788443] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-08T20:34:15.788486] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-08T20:34:15.788527] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-08T20:34:15.788559] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-08T20:34:16.027185] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-08T20:34:16.225087] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:16.666800] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T20:34:16.817587] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-08T20:34:17.431396] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T20:34:17.617549] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-08T20:34:18.340913] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:34:18.417553] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-08T20:34:19.165507] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:34:19.217551] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-08T20:34:19.896355] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T20:34:19.897574] [INFO ] [REMOTE ] NQP: Full fetch complete (13311 records). [2025-10-08T20:34:19.897703] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-08T20:34:20.022712] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-10-08T20:34:20.274442] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-08T20:34:20.274540] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-08T20:34:20.274874] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-08T20:34:20.274934] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-08T20:34:20.275417] [DEBUG] [LOCAL ] NQP: Trimmed 13311 records to 9263 (keeping 200 days of data) [2025-10-08T20:34:20.335819] [DEBUG] [LOCAL ] NQP: Primary data saved (9263 records). [2025-10-08T20:34:20.335993] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-08T20:34:20.336086] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NQP took 36.1s. Estimated remaining: 1h 58m 26s. Rate: 7.1 symbols/min [2025-10-08T20:34:20.511545] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:20.533789] [DEBUG] [LOCAL ] NRK: Loaded 20033 existing records from primary storage. [2025-10-08T20:34:20.534076] [INFO ] [MAIN ] NRK: Loaded 20033 existing records. [2025-10-08T20:34:20.713887] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:34:20.714104] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-08T20:34:20.714149] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-08T20:34:20.714487] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-08T20:34:20.714545] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-08T20:34:20.822676] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-10-08T20:34:21.073585] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:21.617858] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-08T20:34:22.061407] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T20:34:22.368124] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T20:34:22.417583] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-08T20:34:22.565631] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T20:34:23.217588] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-08T20:34:23.984369] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T20:34:24.017513] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-10-08T20:34:24.164756] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T20:34:24.817591] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-08T20:34:25.389114] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T20:34:25.617566] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-08T20:34:26.417515] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-08T20:34:26.488494] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:34:26.525187] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T20:34:27.217528] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-08T20:34:27.404554] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T20:34:27.863179] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T20:34:28.017558] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-08T20:34:28.658320] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:34:28.659738] [INFO ] [REMOTE ] NREF: Full fetch complete (10870 records). [2025-10-08T20:34:28.659837] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-08T20:34:28.660457] [FATAL] [VALIDATOR ] NREF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:34:28.660607] [FATAL] [MAIN ] NREF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:34:28.660714] [WARN ] [MAIN ] NREF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:34:28.660810] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-08T20:34:28.660888] [DEBUG] [LOCAL ] NREF: No primary data file found to delete. [2025-10-08T20:34:28.660983] [INFO ] [LOCAL ] NREF: Starting deletion of derivative data. [2025-10-08T20:34:28.661082] [DEBUG] [LOCAL ] NREF: No derivative data file found to delete. [2025-10-08T20:34:28.661182] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NREF took 25.1s. Estimated remaining: 1h 58m 18s. Rate: 7.1 symbols/min [2025-10-08T20:34:28.822065] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-08T20:34:28.846420] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:28.846711] [DEBUG] [LOCAL ] NRP: No existing data file found in primary storage. [2025-10-08T20:34:28.846768] [WARN ] [MAIN ] NRP: No existing data found, performing full refresh instead. [2025-10-08T20:34:28.846908] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-08T20:34:28.846964] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-08T20:34:28.847010] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-08T20:34:28.847042] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-08T20:34:29.218067] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:29.617549] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-08T20:34:29.696087] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T20:34:30.417558] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-08T20:34:31.217544] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-08T20:34:31.613079] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T20:34:31.741220] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T20:34:32.017548] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-08T20:34:32.363595] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T20:34:32.817574] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-08T20:34:33.617608] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-10-08T20:34:34.193591] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T20:34:34.417551] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-08T20:34:34.602081] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T20:34:34.665349] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-08T20:34:35.217557] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-08T20:34:35.423975] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T20:34:36.017545] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-08T20:34:36.669747] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T20:34:36.738942] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T20:34:36.817571] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-08T20:34:37.617528] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-08T20:34:37.922774] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T20:34:38.049720] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T20:34:38.417516] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-08T20:34:39.217563] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-08T20:34:39.515858] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T20:34:40.017556] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-08T20:34:40.508214] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T20:34:40.648262] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T20:34:40.817576] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-08T20:34:41.617570] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-08T20:34:42.213225] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T20:34:42.417593] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-08T20:34:42.539764] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T20:34:43.217617] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-08T20:34:43.761769] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T20:34:44.017568] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-08T20:34:44.817520] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-08T20:34:44.929367] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T20:34:44.971856] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T20:34:45.617561] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-08T20:34:46.117364] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T20:34:46.341936] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T20:34:46.417580] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-08T20:34:47.125855] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:34:47.128697] [INFO ] [REMOTE ] NRK: Full fetch complete (27674 records). [2025-10-08T20:34:47.128945] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-08T20:34:47.222806] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-08T20:34:47.578042] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-08T20:34:47.578359] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-08T20:34:47.579371] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-08T20:34:47.579436] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-08T20:34:47.580183] [DEBUG] [LOCAL ] NRK: Trimmed 27674 records to 20037 (keeping 200 days of data) [2025-10-08T20:34:47.709387] [DEBUG] [LOCAL ] NRK: Primary data saved (20037 records). [2025-10-08T20:34:47.709560] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-08T20:34:47.709705] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRK took 27.4s. Estimated remaining: 1h 58m 15s. Rate: 7.1 symbols/min [2025-10-08T20:34:47.894726] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:47.894953] [DEBUG] [LOCAL ] NRT: No existing data file found in primary storage. [2025-10-08T20:34:47.895003] [WARN ] [MAIN ] NRT: No existing data found, performing full refresh instead. [2025-10-08T20:34:47.895177] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-08T20:34:47.895220] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-08T20:34:47.895262] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-08T20:34:47.895295] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-08T20:34:48.033543] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-08T20:34:48.277896] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:48.817534] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-08T20:34:48.942696] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T20:34:49.540985] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T20:34:49.617556] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-08T20:34:50.094494] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T20:34:50.203541] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-08T20:34:50.417577] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-08T20:34:51.217602] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-10-08T20:34:52.017575] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-08T20:34:52.489745] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-08T20:34:52.521992] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T20:34:52.621322] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:34:52.624565] [INFO ] [REMOTE ] NRGV: Full fetch complete (61887 records). [2025-10-08T20:34:52.624689] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-08T20:34:52.625331] [FATAL] [VALIDATOR ] NRGV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:34:52.625416] [FATAL] [MAIN ] NRGV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:34:52.625464] [WARN ] [MAIN ] NRGV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:34:52.625550] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-08T20:34:52.625628] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-08T20:34:52.625719] [INFO ] [LOCAL ] NRGV: Starting deletion of derivative data. [2025-10-08T20:34:52.625787] [DEBUG] [LOCAL ] NRGV: No derivative data file found to delete. [2025-10-08T20:34:52.625864] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 37.0s. Estimated remaining: 1h 58m 5s. Rate: 7.1 symbols/min [2025-10-08T20:34:52.794153] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:34:52.794339] [DEBUG] [LOCAL ] NRUC: No existing data file found in primary storage. [2025-10-08T20:34:52.794376] [WARN ] [MAIN ] NRUC: No existing data found, performing full refresh instead. [2025-10-08T20:34:52.794484] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-08T20:34:52.794525] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-08T20:34:52.794594] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-08T20:34:52.794692] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-08T20:34:52.823206] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-08T20:34:53.154574] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:34:53.579151] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-08T20:34:53.617545] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-10-08T20:34:54.288614] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T20:34:54.417583] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-08T20:34:55.133074] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:34:55.217579] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-08T20:34:55.775983] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T20:34:56.017608] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-08T20:34:56.817558] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-08T20:34:57.518478] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T20:34:57.617563] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-08T20:34:58.047569] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T20:34:58.067121] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T20:34:58.417586] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-08T20:34:59.063091] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T20:34:59.217526] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-08T20:34:59.705286] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-08T20:35:00.017603] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-08T20:35:00.817546] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-08T20:35:01.588865] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:35:01.617535] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-08T20:35:02.139626] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-08T20:35:02.288591] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T20:35:02.417594] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-08T20:35:03.021535] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T20:35:03.217569] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-08T20:35:03.976559] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T20:35:04.017602] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-08T20:35:04.488823] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T20:35:04.817595] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-08T20:35:05.209875] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T20:35:05.211008] [INFO ] [REMOTE ] NRP: Full fetch complete (6439 records). [2025-10-08T20:35:05.211085] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-08T20:35:05.212689] [FATAL] [VALIDATOR ] NRP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:05.212930] [FATAL] [MAIN ] NRP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:05.213001] [WARN ] [MAIN ] NRP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:05.213080] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-08T20:35:05.213177] [DEBUG] [LOCAL ] NRP: No primary data file found to delete. [2025-10-08T20:35:05.213228] [INFO ] [LOCAL ] NRP: Starting deletion of derivative data. [2025-10-08T20:35:05.213270] [DEBUG] [LOCAL ] NRP: No derivative data file found to delete. [2025-10-08T20:35:05.213360] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRP took 36.6s. Estimated remaining: 1h 57m 58s. Rate: 7.1 symbols/min [2025-10-08T20:35:05.429830] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:05.430010] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-08T20:35:05.430048] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-08T20:35:05.430165] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-08T20:35:05.430207] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-08T20:35:05.430248] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-08T20:35:05.430280] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-08T20:35:05.627367] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-08T20:35:05.792681] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:06.417604] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-08T20:35:07.134238] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-08T20:35:07.217564] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-08T20:35:07.577782] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T20:35:07.917693] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T20:35:08.017578] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-08T20:35:08.533746] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:35:08.538632] [INFO ] [REMOTE ] NRG: Full fetch complete (76213 records). [2025-10-08T20:35:08.538889] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-08T20:35:08.539861] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:08.539985] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:08.540054] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:08.540129] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-08T20:35:08.540198] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-08T20:35:08.540235] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-10-08T20:35:08.540290] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-10-08T20:35:08.540398] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRG took 55.4s. Estimated remaining: 1h 57m 47s. Rate: 7.1 symbols/min [2025-10-08T20:35:08.753318] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:08.753521] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-08T20:35:08.753578] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-08T20:35:08.753748] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-08T20:35:08.753804] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-08T20:35:08.753851] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-08T20:35:08.753901] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-08T20:35:08.822928] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-08T20:35:09.147293] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:09.483332] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T20:35:09.617530] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-08T20:35:10.406134] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T20:35:10.417497] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-10-08T20:35:11.217555] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-08T20:35:11.848584] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T20:35:12.017568] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-08T20:35:12.663483] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T20:35:12.699385] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T20:35:12.817571] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-10-08T20:35:13.617567] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-08T20:35:14.319715] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T20:35:14.412568] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T20:35:14.420396] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-08T20:35:15.217620] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-08T20:35:15.987881] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T20:35:16.017570] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-08T20:35:16.786273] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T20:35:16.817594] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-08T20:35:17.493150] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-08T20:35:17.617505] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-08T20:35:17.693371] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T20:35:18.417561] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-08T20:35:18.425138] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T20:35:18.695423] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T20:35:18.696304] [INFO ] [REMOTE ] NRUC: Full fetch complete (5375 records). [2025-10-08T20:35:18.696393] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-08T20:35:18.696954] [FATAL] [VALIDATOR ] NRUC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:18.697042] [FATAL] [MAIN ] NRUC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:18.697085] [WARN ] [MAIN ] NRUC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:18.697123] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-08T20:35:18.697179] [DEBUG] [LOCAL ] NRUC: No primary data file found to delete. [2025-10-08T20:35:18.697214] [INFO ] [LOCAL ] NRUC: Starting deletion of derivative data. [2025-10-08T20:35:18.697363] [DEBUG] [LOCAL ] NRUC: No derivative data file found to delete. [2025-10-08T20:35:18.697434] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRUC took 26.1s. Estimated remaining: 1h 57m 40s. Rate: 7.1 symbols/min [2025-10-08T20:35:18.903140] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:18.903343] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-08T20:35:18.903388] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-08T20:35:18.903507] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-08T20:35:18.903580] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-08T20:35:18.903696] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-08T20:35:18.903762] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-08T20:35:19.225735] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-08T20:35:19.325857] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:20.017560] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-10-08T20:35:20.817516] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-08T20:35:21.307068] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T20:35:21.617559] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-08T20:35:21.855457] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T20:35:21.942837] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T20:35:22.254297] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T20:35:22.417570] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-08T20:35:22.781531] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T20:35:22.782667] [INFO ] [REMOTE ] NRT: Full fetch complete (7918 records). [2025-10-08T20:35:22.782785] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-08T20:35:22.783234] [FATAL] [VALIDATOR ] NRT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:22.783320] [FATAL] [MAIN ] NRT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:22.783363] [WARN ] [MAIN ] NRT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:22.783426] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-08T20:35:22.783488] [DEBUG] [LOCAL ] NRT: No primary data file found to delete. [2025-10-08T20:35:22.783562] [INFO ] [LOCAL ] NRT: Starting deletion of derivative data. [2025-10-08T20:35:22.783613] [DEBUG] [LOCAL ] NRT: No derivative data file found to delete. [2025-10-08T20:35:22.783719] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRT took 35.1s. Estimated remaining: 1h 57m 29s. Rate: 7.1 symbols/min [2025-10-08T20:35:22.956164] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:22.956358] [DEBUG] [LOCAL ] NTB: No existing data file found in primary storage. [2025-10-08T20:35:22.956394] [WARN ] [MAIN ] NTB: No existing data found, performing full refresh instead. [2025-10-08T20:35:22.956508] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-08T20:35:22.956549] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-08T20:35:22.956589] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-08T20:35:22.956621] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-08T20:35:23.222744] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-08T20:35:23.333857] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:24.017591] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-10-08T20:35:24.407323] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T20:35:24.817577] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-08T20:35:25.210031] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T20:35:25.617595] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-08T20:35:26.417548] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-08T20:35:26.782075] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T20:35:27.221958] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-08T20:35:27.227213] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T20:35:27.576390] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T20:35:28.022700] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-08T20:35:28.032878] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T20:35:28.817577] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-08T20:35:29.617562] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-08T20:35:29.661083] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T20:35:30.326449] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T20:35:30.415628] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T20:35:30.420542] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-08T20:35:31.217560] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-08T20:35:31.912438] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:35:32.017533] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-08T20:35:32.744664] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T20:35:32.817509] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-08T20:35:33.617574] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-08T20:35:33.865534] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T20:35:34.417582] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-08T20:35:34.681380] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T20:35:34.719881] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T20:35:35.217556] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-08T20:35:36.017570] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-08T20:35:36.395312] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T20:35:36.558257] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T20:35:36.817517] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-08T20:35:37.089283] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T20:35:37.617599] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-08T20:35:38.417535] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-08T20:35:38.645462] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T20:35:38.757715] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T20:35:39.217591] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-08T20:35:39.948403] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:35:39.953406] [INFO ] [REMOTE ] NSC: Full fetch complete (70502 records). [2025-10-08T20:35:39.953678] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-08T20:35:39.954912] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:39.955036] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:39.955101] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:39.955168] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-08T20:35:39.955262] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-08T20:35:39.955325] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-10-08T20:35:39.955397] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-10-08T20:35:39.955490] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSC took 31.4s. Estimated remaining: 1h 57m 25s. Rate: 7.1 symbols/min [2025-10-08T20:35:40.018010] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-08T20:35:40.200071] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:40.200377] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-08T20:35:40.200467] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-08T20:35:40.200675] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-08T20:35:40.200860] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-08T20:35:40.200951] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-08T20:35:40.201088] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-08T20:35:40.474161] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-08T20:35:40.640082] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:40.817514] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-10-08T20:35:41.365638] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T20:35:41.455499] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T20:35:41.617547] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-08T20:35:42.417567] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-08T20:35:43.086678] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T20:35:43.227932] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-08T20:35:43.252266] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T20:35:43.798514] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T20:35:44.017563] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-08T20:35:44.817523] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-08T20:35:45.126371] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T20:35:45.300225] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-08T20:35:45.617577] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-08T20:35:46.417580] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-08T20:35:47.217528] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-08T20:35:47.358293] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T20:35:47.406969] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T20:35:48.017580] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-08T20:35:48.062229] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:35:48.816072] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T20:35:48.817848] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-08T20:35:49.617595] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-08T20:35:50.057231] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:35:50.417576] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-08T20:35:50.915973] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:35:50.918993] [INFO ] [REMOTE ] NSA: Full fetch complete (61858 records). [2025-10-08T20:35:50.919096] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-08T20:35:50.919712] [FATAL] [VALIDATOR ] NSA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:50.919800] [FATAL] [MAIN ] NSA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:50.919842] [WARN ] [MAIN ] NSA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:50.919903] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-08T20:35:50.919965] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-08T20:35:50.919998] [INFO ] [LOCAL ] NSA: Starting deletion of derivative data. [2025-10-08T20:35:50.920036] [DEBUG] [LOCAL ] NSA: No derivative data file found to delete. [2025-10-08T20:35:50.920125] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSA took 45.7s. Estimated remaining: 1h 57m 18s. Rate: 7.1 symbols/min [2025-10-08T20:35:51.091369] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:51.097883] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-08T20:35:51.109297] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-08T20:35:51.110058] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-08T20:35:51.110832] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:35:51.110142] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-08T20:35:51.117628] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-08T20:35:51.117834] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-08T20:35:51.222628] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-08T20:35:51.503663] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:51.755729] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T20:35:52.017623] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-08T20:35:52.817558] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-08T20:35:53.617503] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-08T20:35:54.022576] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T20:35:54.417590] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-10-08T20:35:54.815142] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-08T20:35:54.871779] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T20:35:55.217565] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-08T20:35:56.017557] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-08T20:35:56.364446] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T20:35:56.673602] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T20:35:56.817579] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-08T20:35:57.276515] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T20:35:57.373596] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:35:57.375576] [INFO ] [REMOTE ] NTB: Full fetch complete (30471 records). [2025-10-08T20:35:57.375708] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-08T20:35:57.377550] [FATAL] [VALIDATOR ] NTB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:35:57.377678] [FATAL] [MAIN ] NTB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:35:57.377752] [WARN ] [MAIN ] NTB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:35:57.377832] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-08T20:35:57.377942] [DEBUG] [LOCAL ] NTB: No primary data file found to delete. [2025-10-08T20:35:57.378011] [INFO ] [LOCAL ] NTB: Starting deletion of derivative data. [2025-10-08T20:35:57.378060] [DEBUG] [LOCAL ] NTB: No derivative data file found to delete. [2025-10-08T20:35:57.378120] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NTB took 34.6s. Estimated remaining: 1h 57m 9s. Rate: 7.1 symbols/min [2025-10-08T20:35:57.590401] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:35:57.590724] [DEBUG] [LOCAL ] NTST: No existing data file found in primary storage. [2025-10-08T20:35:57.590787] [WARN ] [MAIN ] NTST: No existing data found, performing full refresh instead. [2025-10-08T20:35:57.590978] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-08T20:35:57.591064] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-08T20:35:57.591155] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-08T20:35:57.591292] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-08T20:35:57.622874] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-08T20:35:58.024760] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:35:58.417564] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-08T20:35:59.003910] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-08T20:35:59.217549] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-08T20:35:59.728868] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T20:35:59.730421] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-08T20:36:00.017577] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-08T20:36:00.562434] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:36:00.563141] [INFO ] [REMOTE ] NTEST: Full fetch complete (1994 records). [2025-10-08T20:36:00.563211] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-08T20:36:00.739293] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-08T20:36:00.739494] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:00.739567] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:00.739638] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-08T20:36:00.739741] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-08T20:36:00.739781] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-08T20:36:00.739823] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-08T20:36:00.739881] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTEST took 20.8s. Estimated remaining: 1h 56m 58s. Rate: 7.1 symbols/min [2025-10-08T20:36:00.822799] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-08T20:36:00.913037] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:00.913182] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-08T20:36:00.913221] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-08T20:36:00.913330] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-08T20:36:00.913372] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-08T20:36:00.913413] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-08T20:36:00.913449] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-08T20:36:01.280595] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:01.617548] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-10-08T20:36:02.404821] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T20:36:02.417504] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-08T20:36:03.217600] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-10-08T20:36:04.017534] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-08T20:36:04.065984] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T20:36:04.817605] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-08T20:36:04.933917] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T20:36:05.370074] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T20:36:05.622734] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-08T20:36:05.643814] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (4.03 seconds). [2025-10-08T20:36:06.417577] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-08T20:36:06.613795] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T20:36:07.075930] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T20:36:07.078741] [INFO ] [REMOTE ] NSP: Full fetch complete (49502 records). [2025-10-08T20:36:07.078849] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-08T20:36:07.079547] [FATAL] [VALIDATOR ] NSP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:36:07.079672] [FATAL] [MAIN ] NSP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:07.079752] [WARN ] [MAIN ] NSP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:07.079854] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-08T20:36:07.079938] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-08T20:36:07.079975] [INFO ] [LOCAL ] NSP: Starting deletion of derivative data. [2025-10-08T20:36:07.080014] [DEBUG] [LOCAL ] NSP: No derivative data file found to delete. [2025-10-08T20:36:07.080082] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NSP took 48.4s. Estimated remaining: 1h 56m 48s. Rate: 7.1 symbols/min [2025-10-08T20:36:07.226155] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-08T20:36:07.254260] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:07.254473] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-08T20:36:07.254530] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-08T20:36:07.254664] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-08T20:36:07.254725] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-08T20:36:07.254774] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-08T20:36:07.254823] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-08T20:36:07.645819] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:08.017552] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-08T20:36:08.054963] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-08T20:36:08.817579] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-08T20:36:09.617546] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-10-08T20:36:09.714742] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-08T20:36:09.956274] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T20:36:10.025525] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T20:36:10.417587] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-08T20:36:11.217543] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-08T20:36:11.255231] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T20:36:12.017523] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-08T20:36:12.432518] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-08T20:36:12.817605] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-08T20:36:13.266899] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T20:36:13.617515] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-08T20:36:14.321797] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-08T20:36:14.417544] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-08T20:36:14.894105] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T20:36:15.217581] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-08T20:36:16.017570] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-08T20:36:16.562584] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-08T20:36:16.791960] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-10-08T20:36:16.817498] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-08T20:36:16.928638] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T20:36:17.313198] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T20:36:17.617552] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-08T20:36:18.417557] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-08T20:36:18.873885] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T20:36:19.217635] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-08T20:36:19.447271] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T20:36:20.017573] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-08T20:36:20.461620] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T20:36:20.517480] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T20:36:20.765146] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T20:36:20.768588] [INFO ] [REMOTE ] NTR: Full fetch complete (75929 records). [2025-10-08T20:36:20.768734] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-08T20:36:20.771171] [FATAL] [VALIDATOR ] NTR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:36:20.771265] [FATAL] [MAIN ] NTR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:20.771307] [WARN ] [MAIN ] NTR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:20.771372] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-08T20:36:20.771457] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-08T20:36:20.771511] [INFO ] [LOCAL ] NTR: Starting deletion of derivative data. [2025-10-08T20:36:20.771566] [DEBUG] [LOCAL ] NTR: No derivative data file found to delete. [2025-10-08T20:36:20.771677] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTR took 29.9s. Estimated remaining: 1h 56m 42s. Rate: 7.1 symbols/min [2025-10-08T20:36:20.824467] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-08T20:36:20.959827] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:20.960314] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-08T20:36:20.960378] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-08T20:36:20.960518] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-08T20:36:20.960576] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-08T20:36:20.960624] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-08T20:36:20.960707] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-08T20:36:21.345513] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:21.617558] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-08T20:36:22.417514] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-10-08T20:36:22.976169] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T20:36:23.217537] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-08T20:36:24.017579] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-08T20:36:24.076722] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-08T20:36:24.422809] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T20:36:24.817586] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-08T20:36:25.138417] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T20:36:25.335058] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T20:36:25.617563] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-08T20:36:26.417601] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-08T20:36:27.116419] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-08T20:36:27.217537] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-08T20:36:27.579512] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T20:36:28.019921] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-08T20:36:28.024770] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T20:36:28.817510] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-08T20:36:28.865125] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T20:36:29.617547] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-08T20:36:29.782556] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T20:36:30.417534] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-08T20:36:30.530256] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T20:36:31.217504] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-08T20:36:31.558942] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T20:36:32.017709] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-08T20:36:32.769808] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T20:36:32.817549] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-08T20:36:32.999300] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-08T20:36:33.256497] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T20:36:33.617587] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-08T20:36:34.417573] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-08T20:36:34.705405] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T20:36:35.069852] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:36:35.073007] [INFO ] [REMOTE ] NTST: Full fetch complete (61068 records). [2025-10-08T20:36:35.073115] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-08T20:36:35.073871] [FATAL] [VALIDATOR ] NTST: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:36:35.073960] [FATAL] [MAIN ] NTST: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:35.074004] [WARN ] [MAIN ] NTST: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:35.074049] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-08T20:36:35.074109] [DEBUG] [LOCAL ] NTST: No primary data file found to delete. [2025-10-08T20:36:35.074201] [INFO ] [LOCAL ] NTST: Starting deletion of derivative data. [2025-10-08T20:36:35.074265] [DEBUG] [LOCAL ] NTST: No derivative data file found to delete. [2025-10-08T20:36:35.074337] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTST took 37.7s. Estimated remaining: 1h 56m 37s. Rate: 7.1 symbols/min [2025-10-08T20:36:35.238123] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-08T20:36:35.256917] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:35.297202] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T20:36:35.314096] [DEBUG] [LOCAL ] NUV: Loaded 23675 existing records from primary storage. [2025-10-08T20:36:35.314602] [INFO ] [MAIN ] NUV: Loaded 23675 existing records. [2025-10-08T20:36:35.494850] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:36:35.495078] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-08T20:36:35.495132] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-08T20:36:35.495567] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-08T20:36:35.495624] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-08T20:36:35.847868] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:36.017533] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-08T20:36:36.817595] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-08T20:36:37.344514] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T20:36:37.617599] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-10-08T20:36:38.388946] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T20:36:38.417593] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-08T20:36:38.452471] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-08T20:36:39.217513] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-08T20:36:39.381101] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T20:36:40.017604] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-08T20:36:40.458537] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T20:36:40.817583] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-08T20:36:41.392319] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T20:36:41.617518] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-08T20:36:41.713402] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-08T20:36:41.778721] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T20:36:41.782582] [INFO ] [REMOTE ] NUE: Full fetch complete (74437 records). [2025-10-08T20:36:41.782786] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-08T20:36:41.784960] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:36:41.785103] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:41.785179] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:41.785266] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-08T20:36:41.785351] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-08T20:36:41.785398] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-08T20:36:41.785450] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-08T20:36:41.785550] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NUE took 34.7s. Estimated remaining: 1h 56m 28s. Rate: 7.1 symbols/min [2025-10-08T20:36:41.979319] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:41.979516] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-08T20:36:41.979553] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-08T20:36:41.979687] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-08T20:36:41.979740] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-08T20:36:41.979782] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-08T20:36:41.979813] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-08T20:36:42.329711] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:42.417556] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-08T20:36:42.854523] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T20:36:43.176159] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:36:43.179835] [INFO ] [REMOTE ] NU: Full fetch complete (77490 records). [2025-10-08T20:36:43.179976] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-08T20:36:43.180943] [FATAL] [VALIDATOR ] NU: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:36:43.181035] [FATAL] [MAIN ] NU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:36:43.181078] [WARN ] [MAIN ] NU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:36:43.181116] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-08T20:36:43.181197] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-08T20:36:43.181247] [INFO ] [LOCAL ] NU: Starting deletion of derivative data. [2025-10-08T20:36:43.181290] [DEBUG] [LOCAL ] NU: No derivative data file found to delete. [2025-10-08T20:36:43.181352] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NU took 42.4s. Estimated remaining: 1h 56m 16s. Rate: 7.1 symbols/min [2025-10-08T20:36:43.222713] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-08T20:36:43.361533] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:36:43.372269] [DEBUG] [LOCAL ] NUW: Loaded 7179 existing records from primary storage. [2025-10-08T20:36:43.372543] [INFO ] [MAIN ] NUW: Loaded 7179 existing records. [2025-10-08T20:36:43.573670] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:36:43.573916] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-08T20:36:43.573967] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-08T20:36:43.574202] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-08T20:36:43.574273] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-08T20:36:44.015065] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:36:44.017501] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-10-08T20:36:44.717438] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:36:44.779912] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T20:36:44.817550] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-08T20:36:45.581688] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T20:36:45.617487] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-08T20:36:46.258249] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T20:36:46.417523] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-08T20:36:47.217510] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-10-08T20:36:47.612671] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T20:36:48.017580] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-08T20:36:48.749327] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:36:48.817521] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-08T20:36:48.880326] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T20:36:49.617545] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-08T20:36:50.212738] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T20:36:50.419316] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-08T20:36:50.431535] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T20:36:51.217606] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-08T20:36:51.632950] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T20:36:52.017605] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-08T20:36:52.817535] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-08T20:36:52.858426] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T20:36:52.887538] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T20:36:53.617556] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-08T20:36:54.062091] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:36:54.417583] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-08T20:36:54.460730] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:36:55.217537] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-08T20:36:55.408449] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T20:36:55.768072] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T20:36:56.017542] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-08T20:36:56.665490] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-08T20:36:56.817551] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-08T20:36:57.617539] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-08T20:36:58.417507] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-08T20:36:58.551939] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T20:36:58.737717] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T20:36:58.902671] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T20:36:59.217600] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-08T20:37:00.017565] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-08T20:37:00.817535] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-08T20:37:00.851426] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T20:37:01.289850] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T20:37:01.617716] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-08T20:37:01.762452] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T20:37:02.149961] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T20:37:02.151162] [INFO ] [REMOTE ] NUW: Full fetch complete (11343 records). [2025-10-08T20:37:02.151243] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-08T20:37:02.426373] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-08T20:37:02.607757] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-08T20:37:02.607891] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-08T20:37:02.608480] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-08T20:37:02.608551] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-08T20:37:02.609371] [DEBUG] [LOCAL ] NUW: Trimmed 11343 records to 7156 (keeping 200 days of data) [2025-10-08T20:37:02.661968] [DEBUG] [LOCAL ] NUW: Primary data saved (7156 records). [2025-10-08T20:37:02.662114] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-08T20:37:02.662226] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUW took 19.5s. Estimated remaining: 1h 56m 13s. Rate: 7.1 symbols/min [2025-10-08T20:37:02.832296] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:02.865705] [DEBUG] [LOCAL ] NVG: Loaded 27429 existing records from primary storage. [2025-10-08T20:37:02.865988] [INFO ] [MAIN ] NVG: Loaded 27429 existing records. [2025-10-08T20:37:03.043345] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:37:03.043593] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-08T20:37:03.043665] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-08T20:37:03.044032] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-08T20:37:03.044091] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-08T20:37:03.219374] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-08T20:37:03.401822] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:04.017520] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-10-08T20:37:04.246768] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T20:37:04.817576] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-08T20:37:04.923277] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T20:37:05.513272] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T20:37:05.617555] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-08T20:37:05.651077] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T20:37:06.417574] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-08T20:37:06.756440] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T20:37:06.867470] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:37:06.870423] [INFO ] [REMOTE ] NUS: Full fetch complete (53603 records). [2025-10-08T20:37:06.870532] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-08T20:37:06.871265] [FATAL] [VALIDATOR ] NUS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:37:06.871368] [FATAL] [MAIN ] NUS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:37:06.871411] [WARN ] [MAIN ] NUS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:37:06.871450] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-08T20:37:06.871530] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-08T20:37:06.871688] [INFO ] [LOCAL ] NUS: Starting deletion of derivative data. [2025-10-08T20:37:06.871768] [DEBUG] [LOCAL ] NUS: No derivative data file found to delete. [2025-10-08T20:37:06.871849] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUS took 46.1s. Estimated remaining: 1h 56m 2s. Rate: 7.1 symbols/min [2025-10-08T20:37:07.041188] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:07.041407] [DEBUG] [LOCAL ] NVGS: No existing data file found in primary storage. [2025-10-08T20:37:07.041444] [WARN ] [MAIN ] NVGS: No existing data found, performing full refresh instead. [2025-10-08T20:37:07.041563] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-08T20:37:07.041605] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-08T20:37:07.041706] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-08T20:37:07.041764] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-08T20:37:07.222622] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-08T20:37:07.404221] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:08.017558] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-08T20:37:08.630386] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T20:37:08.817550] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-08T20:37:08.860297] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T20:37:09.617562] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-08T20:37:10.417520] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-10-08T20:37:10.661857] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T20:37:10.699659] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T20:37:10.702311] [INFO ] [REMOTE ] NUV: Full fetch complete (34404 records). [2025-10-08T20:37:10.702397] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-08T20:37:11.156547] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-08T20:37:11.156680] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-08T20:37:11.157574] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-08T20:37:11.157663] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-08T20:37:11.158572] [DEBUG] [LOCAL ] NUV: Trimmed 34404 records to 23707 (keeping 200 days of data) [2025-10-08T20:37:11.221698] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-08T20:37:11.331546] [DEBUG] [LOCAL ] NUV: Primary data saved (23707 records). [2025-10-08T20:37:11.331749] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-08T20:37:11.331887] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUV took 36.3s. Estimated remaining: 1h 55m 52s. Rate: 7.1 symbols/min [2025-10-08T20:37:11.613018] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:11.627436] [DEBUG] [LOCAL ] NVO: No existing data file found in primary storage. [2025-10-08T20:37:11.629128] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:37:11.629219] [WARN ] [MAIN ] NVO: No existing data found, performing full refresh instead. [2025-10-08T20:37:11.635785] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-08T20:37:11.635889] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-08T20:37:11.635971] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-08T20:37:11.636022] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-08T20:37:12.013434] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:12.017518] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-10-08T20:37:12.545137] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T20:37:12.817565] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-08T20:37:13.617554] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-08T20:37:13.900808] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T20:37:14.417522] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-08T20:37:14.730611] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-08T20:37:15.217547] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-08T20:37:15.238075] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T20:37:15.662060] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T20:37:16.017556] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-08T20:37:16.817560] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-08T20:37:17.261995] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T20:37:17.594857] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-08T20:37:17.617502] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-08T20:37:17.724347] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T20:37:18.417554] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-08T20:37:18.746857] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T20:37:19.217564] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-08T20:37:19.728509] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-08T20:37:20.017561] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-08T20:37:20.817607] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-08T20:37:21.335326] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T20:37:21.408259] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-08T20:37:21.617563] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-08T20:37:22.417569] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-08T20:37:23.193093] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T20:37:23.217490] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-08T20:37:23.306796] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-08T20:37:24.017555] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-08T20:37:24.411519] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T20:37:24.454627] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:37:24.817594] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-08T20:37:25.006416] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T20:37:25.617559] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-08T20:37:25.997990] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T20:37:26.417550] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-08T20:37:27.217555] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-08T20:37:27.730391] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T20:37:27.800816] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-08T20:37:28.017555] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-08T20:37:28.126231] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T20:37:28.817610] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-08T20:37:29.527559] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:37:29.532150] [INFO ] [REMOTE ] NUVB: Full fetch complete (72534 records). [2025-10-08T20:37:29.532285] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-08T20:37:29.533226] [FATAL] [VALIDATOR ] NUVB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:37:29.533373] [FATAL] [MAIN ] NUVB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:37:29.533416] [WARN ] [MAIN ] NUVB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:37:29.533457] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-08T20:37:29.533514] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-08T20:37:29.533550] [INFO ] [LOCAL ] NUVB: Starting deletion of derivative data. [2025-10-08T20:37:29.533590] [DEBUG] [LOCAL ] NUVB: No derivative data file found to delete. [2025-10-08T20:37:29.533672] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUVB took 47.7s. Estimated remaining: 1h 55m 49s. Rate: 7.1 symbols/min [2025-10-08T20:37:29.622745] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-08T20:37:29.731048] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:29.731199] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-08T20:37:29.731235] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-08T20:37:29.731382] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-08T20:37:29.731450] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-08T20:37:29.731502] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-08T20:37:29.731535] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-08T20:37:30.056576] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:37:30.097213] [INFO ] [REMOTE ] NVGS: Full fetch complete (41391 records). [2025-10-08T20:37:30.117395] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:30.117826] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-08T20:37:30.118446] [FATAL] [VALIDATOR ] NVGS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:37:30.118528] [FATAL] [MAIN ] NVGS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:37:30.118596] [WARN ] [MAIN ] NVGS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:37:30.118693] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-08T20:37:30.118768] [DEBUG] [LOCAL ] NVGS: No primary data file found to delete. [2025-10-08T20:37:30.118822] [INFO ] [LOCAL ] NVGS: Starting deletion of derivative data. [2025-10-08T20:37:30.118947] [DEBUG] [LOCAL ] NVGS: No derivative data file found to delete. [2025-10-08T20:37:30.119052] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVGS took 23.2s. Estimated remaining: 1h 55m 36s. Rate: 7.1 symbols/min [2025-10-08T20:37:30.296618] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:30.296853] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-08T20:37:30.296925] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-08T20:37:30.297198] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-08T20:37:30.297271] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-08T20:37:30.297466] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-08T20:37:30.297535] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-08T20:37:30.420128] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-10-08T20:37:30.663755] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:30.718144] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-08T20:37:31.217585] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-08T20:37:31.719748] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T20:37:32.017681] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-10-08T20:37:32.645865] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:37:32.817544] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-08T20:37:33.197955] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T20:37:33.617561] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-08T20:37:33.906359] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T20:37:33.908727] [INFO ] [REMOTE ] NVG: Full fetch complete (40408 records). [2025-10-08T20:37:33.908841] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-08T20:37:34.284928] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-08T20:37:34.285013] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-08T20:37:34.285744] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-08T20:37:34.285808] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-08T20:37:34.286732] [DEBUG] [LOCAL ] NVG: Trimmed 40408 records to 27460 (keeping 200 days of data) [2025-10-08T20:37:34.432789] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-08T20:37:34.459772] [DEBUG] [LOCAL ] NVG: Primary data saved (27460 records). [2025-10-08T20:37:34.459903] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-08T20:37:34.459997] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVG took 31.8s. Estimated remaining: 1h 55m 26s. Rate: 7.1 symbols/min [2025-10-08T20:37:34.635792] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:34.637006] [DEBUG] [LOCAL ] NVS: No existing data file found in primary storage. [2025-10-08T20:37:34.637061] [WARN ] [MAIN ] NVS: No existing data found, performing full refresh instead. [2025-10-08T20:37:34.637266] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-08T20:37:34.637321] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-08T20:37:34.637367] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-08T20:37:34.637404] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-08T20:37:34.994552] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:35.217554] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-08T20:37:35.449709] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T20:37:36.017576] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-08T20:37:36.192886] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-08T20:37:36.580188] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T20:37:36.817564] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-10-08T20:37:37.170185] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T20:37:37.617567] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-08T20:37:38.417579] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-08T20:37:38.679439] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T20:37:39.217589] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-08T20:37:39.826612] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T20:37:40.022763] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-08T20:37:40.056300] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-08T20:37:40.153433] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T20:37:40.817639] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-08T20:37:41.527917] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T20:37:41.617533] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-08T20:37:42.417619] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-08T20:37:43.217509] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-08T20:37:43.244388] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T20:37:43.282046] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-08T20:37:43.843765] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T20:37:44.017538] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-08T20:37:44.132409] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T20:37:44.817705] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-08T20:37:45.617536] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-08T20:37:46.417702] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-08T20:37:46.742080] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T20:37:46.859379] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-08T20:37:47.082342] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T20:37:47.221213] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-08T20:37:47.223555] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T20:37:48.017541] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-08T20:37:48.760781] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T20:37:48.817567] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-08T20:37:49.617571] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-08T20:37:49.964594] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T20:37:50.014316] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T20:37:50.417628] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-08T20:37:51.217529] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-08T20:37:51.839029] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T20:37:52.017519] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-08T20:37:52.582475] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.96 seconds). [2025-10-08T20:37:52.670032] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T20:37:52.817626] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-08T20:37:53.617512] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-08T20:37:53.668140] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:37:54.417557] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-08T20:37:55.007095] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T20:37:55.217580] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-08T20:37:55.742514] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-10-08T20:37:55.874881] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T20:37:56.017533] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-08T20:37:56.317961] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T20:37:56.322406] [INFO ] [REMOTE ] NVO: Full fetch complete (77566 records). [2025-10-08T20:37:56.322544] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-08T20:37:56.323576] [FATAL] [VALIDATOR ] NVO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:37:56.323697] [FATAL] [MAIN ] NVO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:37:56.323748] [WARN ] [MAIN ] NVO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:37:56.323789] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-08T20:37:56.323846] [DEBUG] [LOCAL ] NVO: No primary data file found to delete. [2025-10-08T20:37:56.323879] [INFO ] [LOCAL ] NVO: Starting deletion of derivative data. [2025-10-08T20:37:56.323918] [DEBUG] [LOCAL ] NVO: No derivative data file found to delete. [2025-10-08T20:37:56.324007] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVO took 45.0s. Estimated remaining: 1h 55m 24s. Rate: 7.1 symbols/min [2025-10-08T20:37:56.490985] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:56.491147] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-08T20:37:56.491184] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-08T20:37:56.491295] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-08T20:37:56.491336] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-08T20:37:56.491379] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-08T20:37:56.491410] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-08T20:37:56.819617] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-08T20:37:56.844747] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:37:56.957484] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T20:37:57.617508] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-08T20:37:57.836725] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T20:37:58.417601] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-08T20:37:59.217519] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-08T20:37:59.318046] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T20:37:59.453622] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T20:37:59.646137] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:37:59.649083] [INFO ] [REMOTE ] NVRI: Full fetch complete (55521 records). [2025-10-08T20:37:59.649194] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-08T20:37:59.649808] [FATAL] [VALIDATOR ] NVRI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:37:59.649913] [FATAL] [MAIN ] NVRI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:37:59.649958] [WARN ] [MAIN ] NVRI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:37:59.650023] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-08T20:37:59.650100] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-08T20:37:59.650141] [INFO ] [LOCAL ] NVRI: Starting deletion of derivative data. [2025-10-08T20:37:59.650182] [DEBUG] [LOCAL ] NVRI: No derivative data file found to delete. [2025-10-08T20:37:59.650237] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVRI took 29.5s. Estimated remaining: 1h 55m 13s. Rate: 7.1 symbols/min [2025-10-08T20:37:59.822748] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:37:59.822934] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-08T20:37:59.822972] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-08T20:37:59.823086] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-08T20:37:59.823133] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-08T20:37:59.823175] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-08T20:37:59.823206] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-08T20:38:00.022719] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-08T20:38:00.188603] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:00.494310] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:38:00.496024] [INFO ] [REMOTE ] NVR: Full fetch complete (28936 records). [2025-10-08T20:38:00.496098] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-08T20:38:00.496534] [FATAL] [VALIDATOR ] NVR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:00.496615] [FATAL] [MAIN ] NVR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:00.496690] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:00.496761] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-08T20:38:00.496824] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-08T20:38:00.496863] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-08T20:38:00.496901] [DEBUG] [LOCAL ] NVR: No derivative data file found to delete. [2025-10-08T20:38:00.496956] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVR took 31.0s. Estimated remaining: 1h 55m 1s. Rate: 7.1 symbols/min [2025-10-08T20:38:00.669617] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:00.669844] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-08T20:38:00.669887] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-08T20:38:00.670009] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-08T20:38:00.670050] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-08T20:38:00.670090] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-08T20:38:00.670121] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-08T20:38:00.822636] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-10-08T20:38:01.058974] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:01.617608] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-10-08T20:38:02.417582] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-08T20:38:02.821137] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T20:38:03.217507] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-10-08T20:38:03.363710] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T20:38:04.017531] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-08T20:38:04.430294] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T20:38:04.817709] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-08T20:38:04.986164] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T20:38:05.568152] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T20:38:05.617506] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-08T20:38:06.417597] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-08T20:38:06.563800] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T20:38:07.217565] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-08T20:38:07.387499] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T20:38:08.017525] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-08T20:38:08.090543] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:38:08.817566] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-08T20:38:08.926297] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T20:38:09.617519] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-08T20:38:09.814595] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T20:38:10.417532] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-08T20:38:10.549957] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T20:38:11.217558] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-08T20:38:11.248893] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T20:38:11.290077] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T20:38:11.294024] [INFO ] [REMOTE ] NVS: Full fetch complete (74446 records). [2025-10-08T20:38:11.294242] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-08T20:38:11.295501] [FATAL] [VALIDATOR ] NVS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:11.295686] [FATAL] [MAIN ] NVS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:11.295762] [WARN ] [MAIN ] NVS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:11.295839] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-08T20:38:11.295909] [DEBUG] [LOCAL ] NVS: No primary data file found to delete. [2025-10-08T20:38:11.295945] [INFO ] [LOCAL ] NVS: Starting deletion of derivative data. [2025-10-08T20:38:11.295987] [DEBUG] [LOCAL ] NVS: No derivative data file found to delete. [2025-10-08T20:38:11.296066] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVS took 36.8s. Estimated remaining: 1h 54m 53s. Rate: 7.1 symbols/min [2025-10-08T20:38:11.472700] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:11.472902] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-08T20:38:11.472940] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-08T20:38:11.473053] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-08T20:38:11.473117] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-08T20:38:11.473160] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-08T20:38:11.473191] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-08T20:38:11.825406] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:12.017556] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-08T20:38:12.817610] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-10-08T20:38:12.991798] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:38:13.624082] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-08T20:38:13.630204] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T20:38:14.072856] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T20:38:14.417569] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-08T20:38:15.217526] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-08T20:38:15.306345] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T20:38:16.017565] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-08T20:38:16.063611] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T20:38:16.817579] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-08T20:38:17.115222] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T20:38:17.172202] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T20:38:17.617565] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-08T20:38:17.720341] [DEBUG] [REMOTE ] NWG: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T20:38:17.720731] [WARN ] [REMOTE ] NWG: No data returned for month 2025-05 [2025-10-08T20:38:17.720832] [FATAL] [REMOTE ] NWG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:38:17.720938] [FATAL] [MAIN ] NWG: Failed to fetch primary data. [2025-10-08T20:38:17.721010] [WARN ] [MAIN ] NWG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:38:17.721084] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-08T20:38:17.721165] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-08T20:38:17.721219] [INFO ] [LOCAL ] NWG: Starting deletion of derivative data. [2025-10-08T20:38:17.721265] [DEBUG] [LOCAL ] NWG: No derivative data file found to delete. [2025-10-08T20:38:17.721335] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NWG took 17.2s. Estimated remaining: 1h 54m 44s. Rate: 7.1 symbols/min [2025-10-08T20:38:17.918838] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:17.919062] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-08T20:38:17.919116] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-08T20:38:17.919240] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-08T20:38:17.919284] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-08T20:38:17.919326] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-08T20:38:17.919360] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-08T20:38:18.309197] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:18.343337] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T20:38:18.417546] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-08T20:38:19.217563] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-10-08T20:38:20.017576] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-08T20:38:20.269526] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T20:38:20.691702] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T20:38:20.817549] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-08T20:38:20.900452] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T20:38:21.617550] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-08T20:38:22.210307] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T20:38:22.417597] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-08T20:38:23.011136] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T20:38:23.217540] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-08T20:38:23.580008] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T20:38:24.017571] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-08T20:38:24.804583] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T20:38:24.817491] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-08T20:38:25.302451] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T20:38:25.617532] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-08T20:38:26.417521] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-08T20:38:26.790794] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T20:38:27.149505] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T20:38:27.217540] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-08T20:38:27.728611] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T20:38:28.017553] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-08T20:38:28.655443] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T20:38:28.817525] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-08T20:38:29.179041] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T20:38:29.617538] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-08T20:38:30.417530] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-08T20:38:30.831964] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T20:38:31.176701] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T20:38:31.217558] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-08T20:38:32.017598] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-08T20:38:32.168237] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T20:38:32.817709] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-08T20:38:33.044621] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T20:38:33.106261] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T20:38:33.617549] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-08T20:38:34.417563] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-08T20:38:34.447744] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T20:38:35.060024] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T20:38:35.217560] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-08T20:38:35.984432] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T20:38:36.017578] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-08T20:38:36.334876] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:38:36.338234] [INFO ] [REMOTE ] NVT: Full fetch complete (74182 records). [2025-10-08T20:38:36.338351] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-08T20:38:36.340473] [FATAL] [VALIDATOR ] NVT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:36.340565] [FATAL] [MAIN ] NVT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:36.340608] [WARN ] [MAIN ] NVT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:36.340668] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-08T20:38:36.340749] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-08T20:38:36.340786] [INFO ] [LOCAL ] NVT: Starting deletion of derivative data. [2025-10-08T20:38:36.340873] [DEBUG] [LOCAL ] NVT: No derivative data file found to delete. [2025-10-08T20:38:36.340956] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVT took 36.7s. Estimated remaining: 1h 54m 41s. Rate: 7.1 symbols/min [2025-10-08T20:38:36.516681] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:36.523800] [DEBUG] [LOCAL ] NXC: Loaded 4130 existing records from primary storage. [2025-10-08T20:38:36.523997] [INFO ] [MAIN ] NXC: Loaded 4130 existing records. [2025-10-08T20:38:36.710245] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:38:36.710606] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-08T20:38:36.710734] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-08T20:38:36.716778] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-08T20:38:36.726851] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-08T20:38:36.733573] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T20:38:36.822597] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-08T20:38:37.120552] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:37.617542] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-10-08T20:38:38.184434] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T20:38:38.289570] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T20:38:38.417537] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-08T20:38:39.217631] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-08T20:38:39.401419] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T20:38:40.017555] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-08T20:38:40.770068] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T20:38:40.817502] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-08T20:38:40.994065] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T20:38:41.617530] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-08T20:38:42.120369] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:38:42.123840] [INFO ] [REMOTE ] NVST: Full fetch complete (73738 records). [2025-10-08T20:38:42.123959] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-08T20:38:42.124941] [FATAL] [VALIDATOR ] NVST: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:42.125077] [FATAL] [MAIN ] NVST: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:42.125155] [WARN ] [MAIN ] NVST: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:42.125256] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-08T20:38:42.125382] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-08T20:38:42.125484] [INFO ] [LOCAL ] NVST: Starting deletion of derivative data. [2025-10-08T20:38:42.125560] [DEBUG] [LOCAL ] NVST: No derivative data file found to delete. [2025-10-08T20:38:42.125667] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NVST took 45.8s. Estimated remaining: 1h 54m 31s. Rate: 7.1 symbols/min [2025-10-08T20:38:42.296627] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:42.297104] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-08T20:38:42.297264] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-08T20:38:42.297465] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-08T20:38:42.303685] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-08T20:38:42.303837] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-08T20:38:42.314273] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-08T20:38:42.398115] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T20:38:42.420672] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-08T20:38:42.691789] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:43.113630] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T20:38:43.217602] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-08T20:38:43.684505] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:38:43.686679] [INFO ] [REMOTE ] NWN: Full fetch complete (37211 records). [2025-10-08T20:38:43.686797] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-08T20:38:43.687398] [FATAL] [VALIDATOR ] NWN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:43.687494] [FATAL] [MAIN ] NWN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:43.687537] [WARN ] [MAIN ] NWN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:43.687579] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-08T20:38:43.687667] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-08T20:38:43.687734] [INFO ] [LOCAL ] NWN: Starting deletion of derivative data. [2025-10-08T20:38:43.687783] [DEBUG] [LOCAL ] NWN: No derivative data file found to delete. [2025-10-08T20:38:43.687848] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NWN took 32.4s. Estimated remaining: 1h 54m 19s. Rate: 7.1 symbols/min [2025-10-08T20:38:44.017568] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-08T20:38:44.817631] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-08T20:38:45.353475] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T20:38:45.617540] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-10-08T20:38:45.705695] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T20:38:45.899885] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:38:45.900251] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-10-08T20:38:45.900364] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:38:45.900453] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-08T20:38:45.900537] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:38:45.900630] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-08T20:38:45.900749] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-08T20:38:45.900794] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-08T20:38:45.900836] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-08T20:38:45.900884] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NXDR took 3.8s. Estimated remaining: 1h 54m 7s. Rate: 7.1 symbols/min [2025-10-08T20:38:46.417707] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-08T20:38:47.003622] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T20:38:47.217603] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-08T20:38:47.964969] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T20:38:48.017517] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-08T20:38:48.592946] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T20:38:48.817572] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-08T20:38:49.541770] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T20:38:49.617530] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-08T20:38:50.317967] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T20:38:50.417580] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-08T20:38:51.029037] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T20:38:51.217589] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-08T20:38:51.965428] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T20:38:52.017609] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-08T20:38:52.514438] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T20:38:52.515283] [INFO ] [REMOTE ] NXC: Full fetch complete (5885 records). [2025-10-08T20:38:52.515355] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-08T20:38:52.822761] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-08T20:38:52.897173] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-08T20:38:52.897256] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-08T20:38:52.897478] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-08T20:38:52.897537] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-08T20:38:52.897976] [DEBUG] [LOCAL ] NXC: Trimmed 5885 records to 4129 (keeping 200 days of data) [2025-10-08T20:38:52.924211] [DEBUG] [LOCAL ] NXC: Primary data saved (4129 records). [2025-10-08T20:38:52.924288] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-08T20:38:52.924381] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NXC took 16.6s. Estimated remaining: 1h 53m 58s. Rate: 7.1 symbols/min [2025-10-08T20:38:53.437789] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T20:38:53.440277] [INFO ] [REMOTE ] NX: Full fetch complete (47937 records). [2025-10-08T20:38:53.440373] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-08T20:38:53.441009] [FATAL] [VALIDATOR ] NX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:38:53.441132] [FATAL] [MAIN ] NX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:38:53.441187] [WARN ] [MAIN ] NX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:38:53.441259] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-08T20:38:53.441325] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-08T20:38:53.441361] [INFO ] [LOCAL ] NX: Starting deletion of derivative data. [2025-10-08T20:38:53.441400] [DEBUG] [LOCAL ] NX: No derivative data file found to delete. [2025-10-08T20:38:53.441455] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NX took 35.7s. Estimated remaining: 1h 53m 46s. Rate: 7.1 symbols/min [2025-10-08T20:38:54.135589] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:54.157276] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:54.156410] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:54.158058] [DEBUG] [LOCAL ] NXDT: No existing data file found in primary storage. [2025-10-08T20:38:54.158203] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-08T20:38:54.158162] [WARN ] [MAIN ] NXDT: No existing data found, performing full refresh instead. [2025-10-08T20:38:54.158274] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-08T20:38:54.158441] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-08T20:38:54.158578] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-08T20:38:54.158661] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-08T20:38:54.132365] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:38:54.158760] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-08T20:38:54.158964] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-08T20:38:54.179898] [DEBUG] [LOCAL ] NXG: No existing data file found in primary storage. [2025-10-08T20:38:54.158876] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-08T20:38:54.193871] [WARN ] [MAIN ] NXG: No existing data found, performing full refresh instead. [2025-10-08T20:38:54.221735] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-08T20:38:54.262732] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-08T20:38:54.266932] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-08T20:38:54.267023] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-08T20:38:54.272689] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-08T20:38:54.272824] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-08T20:38:54.429228] [DEBUG] [LOCAL ] NXJ: Loaded 14999 existing records from primary storage. [2025-10-08T20:38:54.499372] [INFO ] [MAIN ] NXJ: Loaded 14999 existing records. [2025-10-08T20:38:55.236820] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:38:55.324752] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-08T20:38:55.347763] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-08T20:38:55.422772] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-08T20:38:55.404794] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:55.433194] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-10-08T20:38:55.475863] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:55.498402] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-08T20:38:55.501216] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-10-08T20:38:55.516109] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:55.560864] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-10-08T20:38:55.861552] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:38:56.017494] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-10-08T20:38:56.428805] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T20:38:56.453958] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:38:56.817605] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-08T20:38:57.183281] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T20:38:57.329359] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T20:38:57.364497] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T20:38:57.617517] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-08T20:38:58.417591] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-08T20:38:59.217543] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-08T20:38:59.233204] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T20:38:59.349818] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T20:38:59.701580] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T20:39:00.017557] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-08T20:39:00.700989] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:39:00.817571] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-08T20:39:01.617569] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-08T20:39:01.764848] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:39:02.417527] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-08T20:39:02.799176] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T20:39:03.217546] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-08T20:39:03.425167] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T20:39:04.017618] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-08T20:39:04.751173] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T20:39:04.817521] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-08T20:39:04.854297] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T20:39:05.617609] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-08T20:39:06.417515] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-08T20:39:06.542314] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T20:39:06.590152] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:39:07.217574] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-08T20:39:07.404171] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T20:39:08.017567] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-08T20:39:08.467599] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T20:39:08.817535] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-08T20:39:09.176900] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T20:39:09.617560] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-08T20:39:09.821180] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T20:39:10.417519] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-08T20:39:10.565017] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-08T20:39:11.217557] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-08T20:39:11.653400] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T20:39:11.943839] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T20:39:12.017573] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-08T20:39:12.817542] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-08T20:39:13.186883] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T20:39:13.617551] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-08T20:39:13.758513] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T20:39:14.417540] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-08T20:39:14.507016] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T20:39:15.217582] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-08T20:39:15.344978] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:39:16.017569] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-08T20:39:16.217139] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:39:16.809611] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:39:16.817483] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-08T20:39:17.617542] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-08T20:39:17.802941] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T20:39:18.417635] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-08T20:39:19.114039] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:39:19.217510] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-08T20:39:19.516388] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T20:39:19.518040] [INFO ] [REMOTE ] NXG: Full fetch complete (14364 records). [2025-10-08T20:39:19.518127] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-08T20:39:19.518987] [FATAL] [VALIDATOR ] NXG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:39:19.519147] [FATAL] [MAIN ] NXG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:39:19.519297] [WARN ] [MAIN ] NXG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:39:19.519394] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-08T20:39:19.519516] [DEBUG] [LOCAL ] NXG: No primary data file found to delete. [2025-10-08T20:39:19.519580] [INFO ] [LOCAL ] NXG: Starting deletion of derivative data. [2025-10-08T20:39:19.519674] [DEBUG] [LOCAL ] NXG: No derivative data file found to delete. [2025-10-08T20:39:19.519801] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 26.1s. Estimated remaining: 1h 53m 46s. Rate: 7.1 symbols/min [2025-10-08T20:39:19.771518] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:19.766496] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-08T20:39:19.789474] [DEBUG] [LOCAL ] NXN: Loaded 2320 existing records from primary storage. [2025-10-08T20:39:19.789748] [INFO ] [MAIN ] NXN: Loaded 2320 existing records. [2025-10-08T20:39:19.993063] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:39:19.993341] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-08T20:39:19.993399] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-08T20:39:19.993708] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-08T20:39:19.993767] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-08T20:39:20.022672] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-08T20:39:20.340686] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:20.814684] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T20:39:20.818271] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-08T20:39:21.617528] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-08T20:39:21.980497] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T20:39:22.417554] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-08T20:39:23.105325] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T20:39:23.217516] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-08T20:39:23.519323] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T20:39:23.940259] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T20:39:23.941743] [INFO ] [REMOTE ] NXJ: Full fetch complete (20762 records). [2025-10-08T20:39:23.941822] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-08T20:39:24.022687] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-08T20:39:24.319065] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-08T20:39:24.319174] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-08T20:39:24.319717] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-08T20:39:24.319778] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-08T20:39:24.320696] [DEBUG] [LOCAL ] NXJ: Trimmed 20762 records to 15003 (keeping 200 days of data) [2025-10-08T20:39:24.420352] [DEBUG] [LOCAL ] NXJ: Primary data saved (15003 records). [2025-10-08T20:39:24.420511] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-08T20:39:24.420598] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXJ took 31.0s. Estimated remaining: 1h 53m 36s. Rate: 7.1 symbols/min [2025-10-08T20:39:24.601469] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:24.617691] [DEBUG] [LOCAL ] NXP: Loaded 12442 existing records from primary storage. [2025-10-08T20:39:24.617954] [INFO ] [MAIN ] NXP: Loaded 12442 existing records. [2025-10-08T20:39:24.839635] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-08T20:39:24.848534] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:39:24.849890] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-08T20:39:24.849968] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-08T20:39:24.850266] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-08T20:39:24.850337] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-08T20:39:25.137035] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:39:25.436569] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:25.617605] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-10-08T20:39:26.308777] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T20:39:26.417557] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-08T20:39:26.868759] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T20:39:27.091979] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T20:39:27.217568] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-08T20:39:28.017590] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-08T20:39:28.817539] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-08T20:39:28.952116] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T20:39:29.075973] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T20:39:29.240147] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:39:29.241759] [INFO ] [REMOTE ] NXDT: Full fetch complete (24818 records). [2025-10-08T20:39:29.241890] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-08T20:39:29.242478] [FATAL] [VALIDATOR ] NXDT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:39:29.242576] [FATAL] [MAIN ] NXDT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:39:29.242686] [WARN ] [MAIN ] NXDT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:39:29.242780] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-08T20:39:29.242894] [DEBUG] [LOCAL ] NXDT: No primary data file found to delete. [2025-10-08T20:39:29.242943] [INFO ] [LOCAL ] NXDT: Starting deletion of derivative data. [2025-10-08T20:39:29.242986] [DEBUG] [LOCAL ] NXDT: No derivative data file found to delete. [2025-10-08T20:39:29.243044] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXDT took 35.8s. Estimated remaining: 1h 53m 26s. Rate: 7.1 symbols/min [2025-10-08T20:39:29.414377] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:29.414587] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-08T20:39:29.414637] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-08T20:39:29.414820] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-08T20:39:29.414898] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-08T20:39:29.414959] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-08T20:39:29.414993] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-08T20:39:29.622616] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-08T20:39:29.769875] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:30.417555] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-08T20:39:31.217517] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-10-08T20:39:31.381303] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T20:39:31.686702] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T20:39:32.017508] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-08T20:39:32.057807] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T20:39:32.817558] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-08T20:39:33.082124] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T20:39:33.456105] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T20:39:33.459691] [INFO ] [REMOTE ] NXE: Full fetch complete (76352 records). [2025-10-08T20:39:33.459790] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-08T20:39:33.460575] [FATAL] [VALIDATOR ] NXE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:39:33.460689] [FATAL] [MAIN ] NXE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:39:33.460740] [WARN ] [MAIN ] NXE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:39:33.460807] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-08T20:39:33.460871] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-08T20:39:33.460906] [INFO ] [LOCAL ] NXE: Starting deletion of derivative data. [2025-10-08T20:39:33.460943] [DEBUG] [LOCAL ] NXE: No derivative data file found to delete. [2025-10-08T20:39:33.460999] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXE took 40.0s. Estimated remaining: 1h 53m 15s. Rate: 7.1 symbols/min [2025-10-08T20:39:33.617785] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-08T20:39:33.634937] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:33.635624] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-08T20:39:33.635701] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-08T20:39:33.635810] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-08T20:39:33.635852] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-08T20:39:33.635895] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-08T20:39:33.635925] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-08T20:39:33.986237] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:34.417515] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-10-08T20:39:34.669066] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T20:39:35.134251] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T20:39:35.217580] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-08T20:39:35.713994] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T20:39:36.017584] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-10-08T20:39:36.471924] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-08T20:39:36.817584] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-08T20:39:37.395088] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T20:39:37.617567] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-08T20:39:38.417621] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-08T20:39:38.693444] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-08T20:39:38.919398] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T20:39:39.217578] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-08T20:39:39.791748] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T20:39:40.017553] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-08T20:39:40.456136] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T20:39:40.817632] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-08T20:39:41.278023] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T20:39:41.617553] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-08T20:39:42.417537] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-08T20:39:42.510379] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T20:39:43.217523] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-08T20:39:44.017611] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-08T20:39:44.123245] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T20:39:44.280033] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T20:39:44.680599] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T20:39:44.817562] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-08T20:39:45.617512] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-08T20:39:45.781476] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T20:39:46.073297] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T20:39:46.417581] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-08T20:39:47.217577] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-08T20:39:47.534393] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T20:39:48.017529] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-08T20:39:48.389206] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T20:39:48.462259] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T20:39:48.817535] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-08T20:39:49.359493] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T20:39:49.617536] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-08T20:39:50.417562] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-08T20:39:50.523735] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T20:39:51.019151] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T20:39:51.217563] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-08T20:39:52.017525] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-08T20:39:52.369690] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T20:39:52.485511] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T20:39:52.817581] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-08T20:39:53.617529] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-08T20:39:53.750775] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:39:54.043228] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T20:39:54.417577] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-08T20:39:55.217513] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-08T20:39:55.404083] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T20:39:55.621188] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T20:39:55.622153] [INFO ] [REMOTE ] NXN: Full fetch complete (3593 records). [2025-10-08T20:39:55.622228] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-08T20:39:56.022690] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-08T20:39:56.065316] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-08T20:39:56.065400] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-08T20:39:56.065576] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-08T20:39:56.065616] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-08T20:39:56.066134] [DEBUG] [LOCAL ] NXN: Trimmed 3593 records to 2310 (keeping 200 days of data) [2025-10-08T20:39:56.082818] [DEBUG] [LOCAL ] NXN: Primary data saved (2310 records). [2025-10-08T20:39:56.082921] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-08T20:39:56.083006] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXN took 36.6s. Estimated remaining: 1h 53m 14s. Rate: 7.1 symbols/min [2025-10-08T20:39:56.264894] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:56.265127] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-08T20:39:56.265183] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-08T20:39:56.265296] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-08T20:39:56.265338] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-08T20:39:56.265378] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-08T20:39:56.265409] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-08T20:39:56.637995] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:56.817565] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-10-08T20:39:57.264993] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T20:39:57.617565] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-08T20:39:58.338590] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T20:39:58.417574] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-08T20:39:58.960097] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:39:58.961826] [INFO ] [REMOTE ] NXRT: Full fetch complete (25540 records). [2025-10-08T20:39:58.961905] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-08T20:39:58.962351] [FATAL] [VALIDATOR ] NXRT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:39:58.962433] [FATAL] [MAIN ] NXRT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:39:58.962475] [WARN ] [MAIN ] NXRT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:39:58.962537] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-08T20:39:58.962600] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-08T20:39:58.962635] [INFO ] [LOCAL ] NXRT: Starting deletion of derivative data. [2025-10-08T20:39:58.962718] [DEBUG] [LOCAL ] NXRT: No derivative data file found to delete. [2025-10-08T20:39:58.962782] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXRT took 29.7s. Estimated remaining: 1h 53m 3s. Rate: 7.1 symbols/min [2025-10-08T20:39:59.072731] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T20:39:59.150588] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:39:59.182999] [DEBUG] [LOCAL ] NZF: Loaded 29073 existing records from primary storage. [2025-10-08T20:39:59.183275] [INFO ] [MAIN ] NZF: Loaded 29073 existing records. [2025-10-08T20:39:59.222618] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-08T20:39:59.403456] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:39:59.403753] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-08T20:39:59.403816] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-08T20:39:59.404114] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-08T20:39:59.404180] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-08T20:39:59.793556] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:39:59.788846] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:40:00.017542] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-10-08T20:40:00.817561] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-08T20:40:01.540261] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T20:40:01.617573] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-08T20:40:01.682308] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T20:40:01.683863] [INFO ] [REMOTE ] NXP: Full fetch complete (16915 records). [2025-10-08T20:40:01.683934] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-08T20:40:02.068513] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-08T20:40:02.068621] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-08T20:40:02.069166] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-08T20:40:02.069228] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-08T20:40:02.069943] [DEBUG] [LOCAL ] NXP: Trimmed 16915 records to 12465 (keeping 200 days of data) [2025-10-08T20:40:02.111956] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T20:40:02.156581] [DEBUG] [LOCAL ] NXP: Primary data saved (12465 records). [2025-10-08T20:40:02.156838] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-08T20:40:02.156935] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXP took 37.7s. Estimated remaining: 1h 52m 52s. Rate: 7.1 symbols/min [2025-10-08T20:40:02.349162] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:02.349366] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-08T20:40:02.349405] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-08T20:40:02.349525] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-08T20:40:02.349567] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-08T20:40:02.349609] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-08T20:40:02.349664] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-08T20:40:02.422731] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-08T20:40:02.734609] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:03.217567] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-10-08T20:40:04.017614] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-08T20:40:04.321760] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T20:40:04.817575] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-08T20:40:05.617557] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-08T20:40:05.901565] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-08T20:40:06.132328] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T20:40:06.170294] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-08T20:40:06.417584] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-08T20:40:07.217545] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-08T20:40:08.019801] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-08T20:40:08.025374] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (3.21 seconds). [2025-10-08T20:40:08.558857] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T20:40:08.779899] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T20:40:08.817513] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-08T20:40:09.617517] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-08T20:40:10.097105] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (3.68 seconds). [2025-10-08T20:40:10.174826] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T20:40:10.176511] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T20:40:10.417569] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-08T20:40:11.217562] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-08T20:40:12.017563] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-08T20:40:12.236024] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-08T20:40:12.236783] [INFO ] [REMOTE ] NYC: Full fetch complete (1883 records). [2025-10-08T20:40:12.236857] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-08T20:40:12.237250] [FATAL] [VALIDATOR ] NYC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:40:12.237376] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:40:12.237419] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:40:12.237457] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-08T20:40:12.237515] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-08T20:40:12.237581] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-08T20:40:12.237669] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-08T20:40:12.237780] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NYC took 38.8s. Estimated remaining: 1h 52m 44s. Rate: 7.1 symbols/min [2025-10-08T20:40:12.415556] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:12.415856] [DEBUG] [LOCAL ] OBDC: No existing data file found in primary storage. [2025-10-08T20:40:12.415907] [WARN ] [MAIN ] OBDC: No existing data found, performing full refresh instead. [2025-10-08T20:40:12.416028] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-08T20:40:12.416091] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-08T20:40:12.416180] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-08T20:40:12.416252] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-08T20:40:12.780601] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:12.817496] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-10-08T20:40:12.985541] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-08T20:40:13.529151] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-08T20:40:13.617507] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-08T20:40:14.417550] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-08T20:40:14.795702] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T20:40:15.217562] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-08T20:40:15.263394] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T20:40:16.017533] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-08T20:40:16.087843] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T20:40:16.817636] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-08T20:40:17.031351] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T20:40:17.619144] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-08T20:40:17.738213] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-08T20:40:18.417564] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-08T20:40:18.824272] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T20:40:19.217552] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-08T20:40:19.722155] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-10-08T20:40:20.017543] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-08T20:40:20.421377] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-08T20:40:20.783272] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T20:40:20.817519] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-08T20:40:21.499123] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T20:40:21.617532] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-08T20:40:22.417525] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-08T20:40:22.613447] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T20:40:23.217554] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-08T20:40:23.388159] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:40:24.017556] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-08T20:40:24.774877] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:40:24.817501] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-08T20:40:24.851529] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-08T20:40:25.617563] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-08T20:40:25.681060] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T20:40:26.171034] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T20:40:26.417553] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-08T20:40:27.217573] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-08T20:40:27.840389] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-08T20:40:27.897619] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T20:40:28.017555] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-08T20:40:28.744858] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T20:40:28.817538] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-08T20:40:29.617587] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-08T20:40:30.152900] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T20:40:30.417562] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-08T20:40:30.536061] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T20:40:30.618717] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T20:40:30.621433] [INFO ] [REMOTE ] NZF: Full fetch complete (43013 records). [2025-10-08T20:40:30.621561] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-08T20:40:31.001891] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-08T20:40:31.001980] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-08T20:40:31.002941] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-08T20:40:31.003007] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-08T20:40:31.003970] [DEBUG] [LOCAL ] NZF: Trimmed 43013 records to 29053 (keeping 200 days of data) [2025-10-08T20:40:31.184723] [DEBUG] [LOCAL ] NZF: Primary data saved (29053 records). [2025-10-08T20:40:31.184887] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-08T20:40:31.184987] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NZF took 32.2s. Estimated remaining: 1h 52m 41s. Rate: 7.1 symbols/min [2025-10-08T20:40:31.227525] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-08T20:40:31.356417] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:31.356550] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-10-08T20:40:31.356587] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-10-08T20:40:31.356734] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-08T20:40:31.356780] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-08T20:40:31.356821] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-08T20:40:31.356854] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-08T20:40:31.725242] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:32.017557] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-08T20:40:32.332501] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T20:40:32.817578] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-10-08T20:40:33.617515] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-08T20:40:33.755307] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-08T20:40:33.808736] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T20:40:33.964255] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T20:40:34.417553] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-08T20:40:35.198513] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T20:40:35.217503] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-08T20:40:35.597915] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T20:40:35.642459] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:40:35.645631] [INFO ] [REMOTE ] NYT: Full fetch complete (71747 records). [2025-10-08T20:40:35.645779] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-08T20:40:35.646461] [FATAL] [VALIDATOR ] NYT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:40:35.646558] [FATAL] [MAIN ] NYT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:40:35.646601] [WARN ] [MAIN ] NYT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:40:35.646702] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-08T20:40:35.646785] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-08T20:40:35.646823] [INFO ] [LOCAL ] NYT: Starting deletion of derivative data. [2025-10-08T20:40:35.646863] [DEBUG] [LOCAL ] NYT: No derivative data file found to delete. [2025-10-08T20:40:35.646921] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NYT took 39.6s. Estimated remaining: 1h 52m 31s. Rate: 7.1 symbols/min [2025-10-08T20:40:35.823568] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:35.823810] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-08T20:40:35.823866] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-08T20:40:35.823979] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-08T20:40:35.824020] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-08T20:40:35.824060] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-08T20:40:35.824090] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-08T20:40:36.022779] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-08T20:40:36.184868] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:36.817576] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-08T20:40:37.617529] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-08T20:40:37.793813] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T20:40:37.804610] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T20:40:38.417563] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-08T20:40:39.217584] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-08T20:40:40.017520] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-10-08T20:40:40.127946] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T20:40:40.153828] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T20:40:40.194221] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-08T20:40:40.817606] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-08T20:40:41.617590] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-08T20:40:41.869604] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T20:40:42.127040] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-08T20:40:42.417555] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-08T20:40:43.217574] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-08T20:40:43.772000] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T20:40:43.886329] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:40:43.890989] [INFO ] [REMOTE ] OBDC: Full fetch complete (74683 records). [2025-10-08T20:40:43.891113] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-08T20:40:43.891973] [FATAL] [VALIDATOR ] OBDC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:40:43.892068] [FATAL] [MAIN ] OBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:40:43.892112] [WARN ] [MAIN ] OBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:40:43.892179] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-08T20:40:43.892244] [DEBUG] [LOCAL ] OBDC: No primary data file found to delete. [2025-10-08T20:40:43.892279] [INFO ] [LOCAL ] OBDC: Starting deletion of derivative data. [2025-10-08T20:40:43.892335] [DEBUG] [LOCAL ] OBDC: No derivative data file found to delete. [2025-10-08T20:40:43.892418] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBDC took 31.7s. Estimated remaining: 1h 52m 22s. Rate: 7.1 symbols/min [2025-10-08T20:40:44.036256] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-08T20:40:44.074475] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:44.074821] [DEBUG] [LOCAL ] OCFT: No existing data file found in primary storage. [2025-10-08T20:40:44.074924] [WARN ] [MAIN ] OCFT: No existing data found, performing full refresh instead. [2025-10-08T20:40:44.075398] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-08T20:40:44.075631] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-08T20:40:44.075865] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-08T20:40:44.075989] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-08T20:40:44.275110] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-08T20:40:44.499518] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:44.817572] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-08T20:40:45.383448] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:40:45.387175] [INFO ] [REMOTE ] O: Full fetch complete (77169 records). [2025-10-08T20:40:45.387311] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-08T20:40:45.389549] [FATAL] [VALIDATOR ] O: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:40:45.389673] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:40:45.389753] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:40:45.389841] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-08T20:40:45.389926] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-08T20:40:45.389978] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-08T20:40:45.390054] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-08T20:40:45.390145] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 43.2s. Estimated remaining: 1h 52m 10s. Rate: 7.1 symbols/min [2025-10-08T20:40:45.568250] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:40:45.568533] [DEBUG] [LOCAL ] ODC: No existing data file found in primary storage. [2025-10-08T20:40:45.568706] [WARN ] [MAIN ] ODC: No existing data found, performing full refresh instead. [2025-10-08T20:40:45.568883] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-08T20:40:45.569192] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-08T20:40:45.569277] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-08T20:40:45.569327] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-08T20:40:45.623689] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-08T20:40:45.789351] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T20:40:45.981041] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:40:46.417521] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-10-08T20:40:46.452829] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T20:40:47.063748] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-08T20:40:47.217573] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-08T20:40:47.942342] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T20:40:48.017615] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-08T20:40:48.710102] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T20:40:48.817521] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-08T20:40:49.404596] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T20:40:49.617571] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-10-08T20:40:50.417611] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-08T20:40:50.503513] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T20:40:51.217525] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-08T20:40:51.281912] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T20:40:52.017580] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-08T20:40:52.675228] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T20:40:52.817571] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-08T20:40:53.124103] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T20:40:53.577514] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T20:40:53.617558] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-08T20:40:54.417545] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-08T20:40:55.217537] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-08T20:40:55.476891] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T20:40:55.586383] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T20:40:55.814252] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T20:40:56.017520] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-08T20:40:56.800822] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-08T20:40:56.817499] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-08T20:40:57.531869] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T20:40:57.617528] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-08T20:40:58.416634] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T20:40:58.420227] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-08T20:40:59.217606] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-08T20:41:00.017522] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-08T20:41:00.249785] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T20:41:00.443123] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-08T20:41:00.669790] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T20:41:00.817537] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-08T20:41:01.617561] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-08T20:41:01.797846] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T20:41:02.273373] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T20:41:02.274499] [INFO ] [REMOTE ] ODC: Full fetch complete (10859 records). [2025-10-08T20:41:02.274605] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-08T20:41:02.275139] [FATAL] [VALIDATOR ] ODC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:02.275237] [FATAL] [MAIN ] ODC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:02.275312] [WARN ] [MAIN ] ODC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:02.275403] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-08T20:41:02.275482] [DEBUG] [LOCAL ] ODC: No primary data file found to delete. [2025-10-08T20:41:02.275534] [INFO ] [LOCAL ] ODC: Starting deletion of derivative data. [2025-10-08T20:41:02.275586] [DEBUG] [LOCAL ] ODC: No derivative data file found to delete. [2025-10-08T20:41:02.275712] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. ODC took 16.9s. Estimated remaining: 1h 52m 6s. Rate: 7.1 symbols/min [2025-10-08T20:41:02.422732] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-08T20:41:02.456151] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:02.456355] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-08T20:41:02.456400] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-08T20:41:02.456540] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-08T20:41:02.456606] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-08T20:41:02.456681] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-08T20:41:02.456734] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-08T20:41:02.811768] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:03.217543] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-10-08T20:41:03.646233] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T20:41:04.017509] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-08T20:41:04.305965] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T20:41:04.817574] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-08T20:41:05.617515] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-08T20:41:05.884154] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T20:41:05.885322] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T20:41:06.393636] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T20:41:06.417524] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-08T20:41:07.217571] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-08T20:41:07.548478] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:41:07.550564] [INFO ] [REMOTE ] OBK: Full fetch complete (23702 records). [2025-10-08T20:41:07.550691] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-08T20:41:07.551378] [FATAL] [VALIDATOR ] OBK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:07.551478] [FATAL] [MAIN ] OBK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:07.551531] [WARN ] [MAIN ] OBK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:07.551610] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-08T20:41:07.551722] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-10-08T20:41:07.551780] [INFO ] [LOCAL ] OBK: Starting deletion of derivative data. [2025-10-08T20:41:07.551835] [DEBUG] [LOCAL ] OBK: No derivative data file found to delete. [2025-10-08T20:41:07.551908] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OBK took 36.4s. Estimated remaining: 1h 51m 56s. Rate: 7.1 symbols/min [2025-10-08T20:41:07.751097] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:07.751287] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-10-08T20:41:07.751330] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-10-08T20:41:07.751448] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-08T20:41:07.751540] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-08T20:41:07.751604] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-08T20:41:07.751639] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-08T20:41:08.026523] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-08T20:41:08.188997] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:08.217122] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T20:41:08.817523] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-08T20:41:08.973736] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T20:41:09.617611] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-10-08T20:41:10.306541] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T20:41:10.417568] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-08T20:41:10.735297] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T20:41:11.217554] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-08T20:41:11.505926] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:41:12.017531] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-08T20:41:12.241486] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T20:41:12.817580] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-08T20:41:13.251266] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T20:41:13.617544] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-08T20:41:13.655911] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:41:14.417542] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-08T20:41:14.750466] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T20:41:15.217550] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-08T20:41:15.909952] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T20:41:16.017519] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-08T20:41:16.407779] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T20:41:16.817615] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-08T20:41:17.292534] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T20:41:17.568119] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T20:41:17.617522] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-08T20:41:18.076708] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T20:41:18.417550] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-08T20:41:19.114905] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T20:41:19.217550] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-08T20:41:19.990681] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T20:41:20.017569] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-08T20:41:20.817604] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-08T20:41:21.617569] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-08T20:41:21.684426] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T20:41:21.907333] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-08T20:41:21.908201] [INFO ] [REMOTE ] OCFT: Full fetch complete (11611 records). [2025-10-08T20:41:21.908286] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-08T20:41:21.908811] [FATAL] [VALIDATOR ] OCFT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:21.908895] [FATAL] [MAIN ] OCFT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:21.908974] [WARN ] [MAIN ] OCFT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:21.909036] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-08T20:41:21.909102] [DEBUG] [LOCAL ] OCFT: No primary data file found to delete. [2025-10-08T20:41:21.909138] [INFO ] [LOCAL ] OCFT: Starting deletion of derivative data. [2025-10-08T20:41:21.909176] [DEBUG] [LOCAL ] OCFT: No derivative data file found to delete. [2025-10-08T20:41:21.909227] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OCFT took 38.0s. Estimated remaining: 1h 51m 51s. Rate: 7.1 symbols/min [2025-10-08T20:41:22.076882] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:22.077055] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-08T20:41:22.077091] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-08T20:41:22.077202] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-08T20:41:22.077243] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-08T20:41:22.077282] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-08T20:41:22.077313] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-08T20:41:22.424150] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-08T20:41:22.447768] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:22.600515] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T20:41:23.217578] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-08T20:41:23.613663] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T20:41:23.617584] [INFO ] [REMOTE ] OC: Full fetch complete (63853 records). [2025-10-08T20:41:23.617726] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-08T20:41:23.618380] [FATAL] [VALIDATOR ] OC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:23.618488] [FATAL] [MAIN ] OC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:23.618532] [WARN ] [MAIN ] OC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:23.618570] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-08T20:41:23.618662] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-08T20:41:23.618723] [INFO ] [LOCAL ] OC: Starting deletion of derivative data. [2025-10-08T20:41:23.618770] [DEBUG] [LOCAL ] OC: No derivative data file found to delete. [2025-10-08T20:41:23.618842] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. OC took 48.0s. Estimated remaining: 1h 51m 39s. Rate: 7.1 symbols/min [2025-10-08T20:41:23.842115] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:23.842319] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-08T20:41:23.842389] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-08T20:41:23.842676] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-08T20:41:23.842819] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-08T20:41:23.842901] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-08T20:41:23.843014] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-08T20:41:24.001220] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T20:41:24.019160] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-10-08T20:41:24.330530] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:24.817565] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-10-08T20:41:25.207844] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T20:41:25.617798] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-08T20:41:26.138343] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:41:26.417534] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-08T20:41:26.738092] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T20:41:27.217610] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-08T20:41:27.756898] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T20:41:28.017573] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-08T20:41:28.718135] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T20:41:28.817559] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-08T20:41:28.856834] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:41:29.617546] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-08T20:41:30.267507] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T20:41:30.417558] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-08T20:41:30.732690] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T20:41:31.217570] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-08T20:41:31.715029] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T20:41:32.017602] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-08T20:41:32.375187] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T20:41:32.817581] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-08T20:41:33.055231] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T20:41:33.617582] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-08T20:41:34.309698] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T20:41:34.417589] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-08T20:41:35.171395] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T20:41:35.217495] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-08T20:41:36.017531] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-08T20:41:36.296452] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T20:41:36.296206] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T20:41:36.310142] [INFO ] [REMOTE ] OEC: Full fetch complete (52606 records). [2025-10-08T20:41:36.310300] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-08T20:41:36.310931] [FATAL] [VALIDATOR ] OEC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:36.311040] [FATAL] [MAIN ] OEC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:36.311117] [WARN ] [MAIN ] OEC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:36.311273] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-08T20:41:36.311384] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-10-08T20:41:36.311439] [INFO ] [LOCAL ] OEC: Starting deletion of derivative data. [2025-10-08T20:41:36.311482] [DEBUG] [LOCAL ] OEC: No derivative data file found to delete. [2025-10-08T20:41:36.311550] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 28.8s. Estimated remaining: 1h 51m 33s. Rate: 7.1 symbols/min [2025-10-08T20:41:36.489200] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:36.489514] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-08T20:41:36.489617] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-08T20:41:36.490001] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-08T20:41:36.490104] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-08T20:41:36.490240] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-08T20:41:36.490414] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-08T20:41:36.698370] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T20:41:36.817843] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-08T20:41:36.899775] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:37.617555] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-08T20:41:38.328719] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:41:38.331668] [INFO ] [REMOTE ] ODV: Full fetch complete (33595 records). [2025-10-08T20:41:38.331752] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-08T20:41:38.332293] [FATAL] [VALIDATOR ] ODV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:38.332380] [FATAL] [MAIN ] ODV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:38.332422] [WARN ] [MAIN ] ODV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:38.332461] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-08T20:41:38.332517] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-08T20:41:38.332551] [INFO ] [LOCAL ] ODV: Starting deletion of derivative data. [2025-10-08T20:41:38.332589] [DEBUG] [LOCAL ] ODV: No derivative data file found to delete. [2025-10-08T20:41:38.332676] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. ODV took 36.1s. Estimated remaining: 1h 51m 21s. Rate: 7.1 symbols/min [2025-10-08T20:41:38.430619] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-10-08T20:41:38.477057] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T20:41:38.560973] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:38.561148] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-08T20:41:38.561187] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-08T20:41:38.561300] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-08T20:41:38.561342] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-08T20:41:38.561383] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-08T20:41:38.561414] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-08T20:41:38.927860] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:39.217537] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-10-08T20:41:40.017507] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-08T20:41:40.440042] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T20:41:40.573435] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:41:40.817531] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-08T20:41:41.443219] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T20:41:41.617543] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-08T20:41:42.407731] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T20:41:42.418076] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-08T20:41:43.041820] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T20:41:43.217600] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-08T20:41:43.430226] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T20:41:44.017620] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-08T20:41:44.700690] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T20:41:44.817555] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-08T20:41:45.617544] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-08T20:41:45.833381] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T20:41:45.858569] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T20:41:46.417614] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-08T20:41:47.217553] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-08T20:41:47.478914] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T20:41:48.017613] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-08T20:41:48.160878] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T20:41:48.174457] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T20:41:48.817631] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-08T20:41:49.618485] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-08T20:41:49.621842] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T20:41:49.646341] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T20:41:50.417564] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-08T20:41:51.001512] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T20:41:51.217604] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-08T20:41:51.738925] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T20:41:52.017612] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-08T20:41:52.817531] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-08T20:41:53.132530] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T20:41:53.525935] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T20:41:53.617516] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-08T20:41:53.709821] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:41:54.417556] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-08T20:41:55.217585] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-08T20:41:55.688886] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:41:55.691297] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-08T20:41:55.705281] [INFO ] [REMOTE ] OFG: Full fetch complete (33876 records). [2025-10-08T20:41:55.706110] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-08T20:41:55.707753] [FATAL] [VALIDATOR ] OFG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:41:55.707847] [FATAL] [MAIN ] OFG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:41:55.707899] [WARN ] [MAIN ] OFG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:41:55.707976] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-08T20:41:55.708056] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-08T20:41:55.708096] [INFO ] [LOCAL ] OFG: Starting deletion of derivative data. [2025-10-08T20:41:55.708153] [DEBUG] [LOCAL ] OFG: No derivative data file found to delete. [2025-10-08T20:41:55.708260] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OFG took 33.8s. Estimated remaining: 1h 51m 17s. Rate: 7.1 symbols/min [2025-10-08T20:41:55.888579] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:41:55.889000] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-08T20:41:55.889207] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-08T20:41:55.889409] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-08T20:41:55.889474] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-08T20:41:55.889561] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-08T20:41:55.889675] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-08T20:41:56.017557] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-08T20:41:56.085991] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T20:41:56.309439] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:41:56.817590] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-10-08T20:41:57.617570] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-08T20:41:57.884109] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T20:41:58.422735] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-08T20:41:58.445985] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T20:41:58.695475] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:41:59.217550] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-08T20:41:59.868858] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T20:42:00.017531] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-08T20:42:00.817522] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-08T20:42:01.099796] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T20:42:01.617539] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-08T20:42:01.802477] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T20:42:02.020325] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T20:42:02.417576] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-08T20:42:03.217567] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-08T20:42:03.629834] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-08T20:42:03.821098] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:42:03.825212] [INFO ] [REMOTE ] OGE: Full fetch complete (66441 records). [2025-10-08T20:42:03.825386] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-08T20:42:03.826248] [FATAL] [VALIDATOR ] OGE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:03.826342] [FATAL] [MAIN ] OGE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:03.826385] [WARN ] [MAIN ] OGE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:03.826423] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-08T20:42:03.826494] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-08T20:42:03.826549] [INFO ] [LOCAL ] OGE: Starting deletion of derivative data. [2025-10-08T20:42:03.826592] [DEBUG] [LOCAL ] OGE: No derivative data file found to delete. [2025-10-08T20:42:03.826674] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGE took 40.2s. Estimated remaining: 1h 51m 8s. Rate: 7.1 symbols/min [2025-10-08T20:42:04.005575] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:04.005847] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-08T20:42:04.005906] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-08T20:42:04.006142] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-08T20:42:04.006292] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-08T20:42:04.006440] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-08T20:42:04.006597] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-08T20:42:04.036092] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-08T20:42:04.214399] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T20:42:04.407504] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:04.817549] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-10-08T20:42:05.617514] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-08T20:42:06.014744] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T20:42:06.417606] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-08T20:42:06.609239] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T20:42:07.089978] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T20:42:07.217537] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-08T20:42:08.017534] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-08T20:42:08.284949] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T20:42:08.457254] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T20:42:08.817597] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-08T20:42:09.617494] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-08T20:42:09.785303] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T20:42:10.417550] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-08T20:42:10.492216] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T20:42:11.107740] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T20:42:11.217504] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-08T20:42:11.525667] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:42:11.527910] [INFO ] [REMOTE ] OGS: Full fetch complete (47761 records). [2025-10-08T20:42:11.527989] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-08T20:42:11.528771] [FATAL] [VALIDATOR ] OGS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:11.528858] [FATAL] [MAIN ] OGS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:11.528899] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:11.528979] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-08T20:42:11.529094] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-08T20:42:11.529149] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-08T20:42:11.529192] [DEBUG] [LOCAL ] OGS: No derivative data file found to delete. [2025-10-08T20:42:11.529278] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGS took 33.2s. Estimated remaining: 1h 50m 60s. Rate: 7.1 symbols/min [2025-10-08T20:42:11.698172] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:11.715528] [DEBUG] [LOCAL ] OIA: Loaded 13604 existing records from primary storage. [2025-10-08T20:42:11.715799] [INFO ] [MAIN ] OIA: Loaded 13604 existing records. [2025-10-08T20:42:11.890717] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:42:11.890916] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-08T20:42:11.890961] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-08T20:42:11.891266] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-08T20:42:11.891322] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-08T20:42:12.030199] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-08T20:42:12.257056] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:12.464952] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T20:42:12.817603] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-08T20:42:13.617514] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-10-08T20:42:13.952292] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T20:42:14.417538] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-08T20:42:14.735812] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-08T20:42:15.027413] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T20:42:15.217562] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-08T20:42:16.017567] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-08T20:42:16.238738] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T20:42:16.817531] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-08T20:42:17.072172] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T20:42:17.286053] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:42:17.289555] [INFO ] [REMOTE ] OGN: Full fetch complete (76407 records). [2025-10-08T20:42:17.289707] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-08T20:42:17.290544] [FATAL] [VALIDATOR ] OGN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:17.290679] [FATAL] [MAIN ] OGN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:17.290757] [WARN ] [MAIN ] OGN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:17.290854] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-08T20:42:17.290984] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-08T20:42:17.291036] [INFO ] [LOCAL ] OGN: Starting deletion of derivative data. [2025-10-08T20:42:17.291079] [DEBUG] [LOCAL ] OGN: No derivative data file found to delete. [2025-10-08T20:42:17.291152] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGN took 41.0s. Estimated remaining: 1h 50m 50s. Rate: 7.1 symbols/min [2025-10-08T20:42:17.463324] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:17.463663] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-08T20:42:17.463768] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-08T20:42:17.463941] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-08T20:42:17.464071] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-08T20:42:17.464139] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-08T20:42:17.464176] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-08T20:42:17.622880] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-08T20:42:17.884723] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:17.923928] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T20:42:18.417637] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-08T20:42:19.217533] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-10-08T20:42:19.416449] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:42:19.585869] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T20:42:20.017559] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-08T20:42:20.817570] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-08T20:42:20.899720] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T20:42:21.490326] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T20:42:21.617527] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-08T20:42:21.786608] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T20:42:22.417591] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-08T20:42:23.217578] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-08T20:42:23.373039] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T20:42:23.620235] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T20:42:24.017541] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-08T20:42:24.098841] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T20:42:24.817591] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-08T20:42:25.387426] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T20:42:25.409051] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-08T20:42:25.617520] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-08T20:42:26.417581] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-08T20:42:27.217583] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-08T20:42:27.437670] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T20:42:28.017534] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-08T20:42:28.108415] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T20:42:28.280782] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T20:42:28.817608] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-08T20:42:29.509005] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T20:42:29.617540] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-08T20:42:30.417625] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-08T20:42:30.549177] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T20:42:31.107445] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T20:42:31.217509] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-08T20:42:31.337890] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T20:42:32.017621] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-08T20:42:32.491353] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:42:32.496171] [INFO ] [REMOTE ] OHI: Full fetch complete (74759 records). [2025-10-08T20:42:32.496336] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-08T20:42:32.497486] [FATAL] [VALIDATOR ] OHI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:32.497586] [FATAL] [MAIN ] OHI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:32.497631] [WARN ] [MAIN ] OHI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:32.497716] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-08T20:42:32.497782] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-08T20:42:32.497819] [INFO ] [LOCAL ] OHI: Starting deletion of derivative data. [2025-10-08T20:42:32.497859] [DEBUG] [LOCAL ] OHI: No derivative data file found to delete. [2025-10-08T20:42:32.497922] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OHI took 36.8s. Estimated remaining: 1h 50m 45s. Rate: 7.1 symbols/min [2025-10-08T20:42:32.689820] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:32.690037] [DEBUG] [LOCAL ] OIS: No existing data file found in primary storage. [2025-10-08T20:42:32.690091] [WARN ] [MAIN ] OIS: No existing data found, performing full refresh instead. [2025-10-08T20:42:32.690405] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-08T20:42:32.690453] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-08T20:42:32.690537] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-08T20:42:32.690588] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-08T20:42:32.822638] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-08T20:42:33.093270] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:33.122403] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T20:42:33.617546] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-08T20:42:34.364123] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T20:42:34.417555] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-08T20:42:34.609399] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-08T20:42:34.810491] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T20:42:34.813873] [INFO ] [REMOTE ] OI: Full fetch complete (67801 records). [2025-10-08T20:42:34.813996] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-08T20:42:34.814636] [FATAL] [VALIDATOR ] OI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:34.814797] [FATAL] [MAIN ] OI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:34.814866] [WARN ] [MAIN ] OI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:34.814937] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-08T20:42:34.815001] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-08T20:42:34.815036] [INFO ] [LOCAL ] OI: Starting deletion of derivative data. [2025-10-08T20:42:34.815074] [DEBUG] [LOCAL ] OI: No derivative data file found to delete. [2025-10-08T20:42:34.815147] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OI took 31.0s. Estimated remaining: 1h 50m 33s. Rate: 7.1 symbols/min [2025-10-08T20:42:34.989586] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:34.989821] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-08T20:42:34.989872] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-08T20:42:34.989993] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-08T20:42:34.990034] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-08T20:42:34.990076] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-08T20:42:34.990118] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-08T20:42:35.225162] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-08T20:42:35.359162] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:36.017620] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-08T20:42:36.498075] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T20:42:36.817564] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-08T20:42:37.388916] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T20:42:37.617566] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-10-08T20:42:37.862243] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T20:42:38.417536] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-08T20:42:39.017556] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:42:39.020144] [INFO ] [REMOTE ] OIA: Full fetch complete (20913 records). [2025-10-08T20:42:39.020360] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-08T20:42:39.223094] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-08T20:42:39.464143] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-08T20:42:39.473778] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-08T20:42:39.479860] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-08T20:42:39.479998] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-08T20:42:39.495193] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T20:42:39.495692] [DEBUG] [LOCAL ] OIA: Trimmed 20913 records to 13570 (keeping 200 days of data) [2025-10-08T20:42:39.592226] [DEBUG] [LOCAL ] OIA: Primary data saved (13570 records). [2025-10-08T20:42:39.592406] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-08T20:42:39.592510] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIA took 28.1s. Estimated remaining: 1h 50m 23s. Rate: 7.1 symbols/min [2025-10-08T20:42:39.775856] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:39.776043] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-08T20:42:39.776079] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-08T20:42:39.776250] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-08T20:42:39.776298] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-08T20:42:39.776340] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-08T20:42:39.776371] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-08T20:42:40.022795] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-10-08T20:42:40.166277] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:40.787604] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T20:42:40.817559] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-08T20:42:41.617520] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-10-08T20:42:41.794925] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T20:42:42.214679] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T20:42:42.417556] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-08T20:42:43.217587] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-08T20:42:43.604619] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T20:42:43.955948] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-08T20:42:44.017597] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-08T20:42:44.817539] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-08T20:42:44.937007] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T20:42:45.078995] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T20:42:45.617603] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-08T20:42:46.417614] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-08T20:42:47.217575] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-08T20:42:47.479719] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T20:42:47.607299] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-08T20:42:47.704875] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T20:42:48.017602] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-08T20:42:48.509266] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T20:42:48.817535] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-08T20:42:49.617598] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-08T20:42:50.419136] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-08T20:42:50.424309] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-08T20:42:50.475863] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T20:42:50.738406] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:42:50.741290] [INFO ] [REMOTE ] OII: Full fetch complete (61528 records). [2025-10-08T20:42:50.741382] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-08T20:42:50.742325] [FATAL] [VALIDATOR ] OII: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:42:50.742420] [FATAL] [MAIN ] OII: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:42:50.742464] [WARN ] [MAIN ] OII: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:42:50.742736] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-08T20:42:50.742803] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-08T20:42:50.742860] [INFO ] [LOCAL ] OII: Starting deletion of derivative data. [2025-10-08T20:42:50.742901] [DEBUG] [LOCAL ] OII: No derivative data file found to delete. [2025-10-08T20:42:50.742955] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OII took 33.5s. Estimated remaining: 1h 50m 16s. Rate: 7.1 symbols/min [2025-10-08T20:42:50.911855] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:42:50.912003] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-08T20:42:50.912039] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-08T20:42:50.912146] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-08T20:42:50.912186] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-08T20:42:50.912226] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-08T20:42:50.912256] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-08T20:42:51.223436] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-08T20:42:51.277512] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:42:51.370001] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T20:42:52.017599] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-10-08T20:42:52.819512] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-08T20:42:52.822019] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T20:42:53.617537] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-08T20:42:53.854812] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T20:42:54.373177] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T20:42:54.417506] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-08T20:42:55.006762] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T20:42:55.217585] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-08T20:42:56.017628] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-08T20:42:56.512168] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T20:42:56.817548] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-08T20:42:57.623433] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-08T20:42:57.628817] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-08T20:42:57.707242] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T20:42:58.417613] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-08T20:42:58.611152] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T20:42:59.046752] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T20:42:59.217554] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-08T20:43:00.017529] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-08T20:43:00.817618] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-08T20:43:00.890375] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T20:43:00.987594] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-08T20:43:01.576407] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T20:43:01.617543] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-08T20:43:02.417714] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-08T20:43:02.751346] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T20:43:03.045147] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:43:03.217546] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-08T20:43:04.017579] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-08T20:43:04.081619] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T20:43:04.084706] [INFO ] [REMOTE ] OIS: Full fetch complete (56860 records). [2025-10-08T20:43:04.084827] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-08T20:43:04.085576] [FATAL] [VALIDATOR ] OIS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:04.085734] [FATAL] [MAIN ] OIS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:04.085777] [WARN ] [MAIN ] OIS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:04.085839] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-08T20:43:04.085911] [DEBUG] [LOCAL ] OIS: No primary data file found to delete. [2025-10-08T20:43:04.085945] [INFO ] [LOCAL ] OIS: Starting deletion of derivative data. [2025-10-08T20:43:04.085984] [DEBUG] [LOCAL ] OIS: No derivative data file found to delete. [2025-10-08T20:43:04.086044] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OIS took 31.6s. Estimated remaining: 1h 50m 10s. Rate: 7.1 symbols/min [2025-10-08T20:43:04.255064] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:04.255251] [DEBUG] [LOCAL ] OLP: No existing data file found in primary storage. [2025-10-08T20:43:04.255292] [WARN ] [MAIN ] OLP: No existing data found, performing full refresh instead. [2025-10-08T20:43:04.255415] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-08T20:43:04.255459] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-08T20:43:04.255502] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-08T20:43:04.255536] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-08T20:43:04.604750] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:04.817490] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-10-08T20:43:05.368835] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-10-08T20:43:05.617574] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-08T20:43:05.807078] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T20:43:05.828109] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T20:43:06.417562] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-08T20:43:07.099693] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T20:43:07.217544] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-08T20:43:08.003594] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-08T20:43:08.017479] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-08T20:43:08.158803] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T20:43:08.817561] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-08T20:43:09.617523] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-08T20:43:09.802411] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-08T20:43:10.417608] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-08T20:43:10.791527] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-08T20:43:11.217578] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-08T20:43:11.383440] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T20:43:11.596205] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T20:43:12.017585] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-08T20:43:12.817541] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-08T20:43:12.885040] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T20:43:13.289493] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-08T20:43:13.617583] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-08T20:43:14.417620] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-08T20:43:15.217589] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-08T20:43:15.323307] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T20:43:15.329286] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T20:43:15.385005] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-08T20:43:16.017577] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-08T20:43:16.817508] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-08T20:43:16.906235] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T20:43:17.390078] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-08T20:43:17.541432] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T20:43:17.617572] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-08T20:43:18.417564] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-08T20:43:19.217525] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-08T20:43:19.439098] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T20:43:19.757716] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T20:43:19.761800] [INFO ] [REMOTE ] OKE: Full fetch complete (77108 records). [2025-10-08T20:43:19.761949] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-08T20:43:19.762939] [FATAL] [VALIDATOR ] OKE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:19.763046] [FATAL] [MAIN ] OKE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:19.763092] [WARN ] [MAIN ] OKE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:19.763158] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-08T20:43:19.763231] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-08T20:43:19.763278] [INFO ] [LOCAL ] OKE: Starting deletion of derivative data. [2025-10-08T20:43:19.763347] [DEBUG] [LOCAL ] OKE: No derivative data file found to delete. [2025-10-08T20:43:19.763450] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKE took 44.9s. Estimated remaining: 1h 50m 5s. Rate: 7.1 symbols/min [2025-10-08T20:43:19.963039] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:19.963283] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-08T20:43:19.963363] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-08T20:43:19.963512] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-08T20:43:19.963582] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-08T20:43:19.963636] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-08T20:43:19.963724] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-08T20:43:20.028136] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-08T20:43:20.420600] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:20.817567] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-10-08T20:43:21.032464] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T20:43:21.073026] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-08T20:43:21.617544] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-08T20:43:22.347188] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:43:22.417520] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-08T20:43:23.217528] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-08T20:43:23.668852] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T20:43:23.680985] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T20:43:23.685569] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-10-08T20:43:23.685766] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-08T20:43:23.686867] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:23.686978] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:23.687051] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:23.687121] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-08T20:43:23.687185] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-08T20:43:23.687225] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-08T20:43:23.687309] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-08T20:43:23.687379] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OKLO took 44.1s. Estimated remaining: 1h 49m 55s. Rate: 7.1 symbols/min [2025-10-08T20:43:23.855407] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:23.855597] [DEBUG] [LOCAL ] OMF: No existing data file found in primary storage. [2025-10-08T20:43:23.855673] [WARN ] [MAIN ] OMF: No existing data found, performing full refresh instead. [2025-10-08T20:43:23.855786] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-08T20:43:23.855827] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-08T20:43:23.855868] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-08T20:43:23.855899] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-08T20:43:24.021802] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-08T20:43:24.219476] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:24.253429] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T20:43:24.817562] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-08T20:43:25.617520] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-10-08T20:43:26.065611] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T20:43:26.417584] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-08T20:43:26.629177] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T20:43:26.906221] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T20:43:27.217561] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-08T20:43:28.017535] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-08T20:43:28.071545] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T20:43:28.689298] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T20:43:28.817490] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-08T20:43:29.617527] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-08T20:43:29.688434] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:43:30.417715] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-08T20:43:30.772821] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T20:43:30.776363] [INFO ] [REMOTE ] OLN: Full fetch complete (74269 records). [2025-10-08T20:43:30.776508] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-08T20:43:30.777451] [FATAL] [VALIDATOR ] OLN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:30.777552] [FATAL] [MAIN ] OLN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:30.777617] [WARN ] [MAIN ] OLN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:30.777702] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-08T20:43:30.777775] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-08T20:43:30.777812] [INFO ] [LOCAL ] OLN: Starting deletion of derivative data. [2025-10-08T20:43:30.777852] [DEBUG] [LOCAL ] OLN: No derivative data file found to delete. [2025-10-08T20:43:30.777913] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLN took 40.0s. Estimated remaining: 1h 49m 45s. Rate: 7.1 symbols/min [2025-10-08T20:43:30.962196] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:30.971254] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T20:43:30.974515] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-08T20:43:30.974601] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-08T20:43:30.974792] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-08T20:43:30.974980] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-08T20:43:30.975071] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-08T20:43:30.975116] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-08T20:43:31.191215] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T20:43:31.223957] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-08T20:43:31.387159] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:31.733521] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:43:31.734983] [INFO ] [REMOTE ] OLP: Full fetch complete (14069 records). [2025-10-08T20:43:31.735054] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-08T20:43:31.735465] [FATAL] [VALIDATOR ] OLP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:31.735549] [FATAL] [MAIN ] OLP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:31.735591] [WARN ] [MAIN ] OLP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:31.735627] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-08T20:43:31.735722] [DEBUG] [LOCAL ] OLP: No primary data file found to delete. [2025-10-08T20:43:31.735768] [INFO ] [LOCAL ] OLP: Starting deletion of derivative data. [2025-10-08T20:43:31.735827] [DEBUG] [LOCAL ] OLP: No derivative data file found to delete. [2025-10-08T20:43:31.735882] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OLP took 27.6s. Estimated remaining: 1h 49m 33s. Rate: 7.1 symbols/min [2025-10-08T20:43:31.903821] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:31.903997] [DEBUG] [LOCAL ] ONIT: No existing data file found in primary storage. [2025-10-08T20:43:31.904034] [WARN ] [MAIN ] ONIT: No existing data found, performing full refresh instead. [2025-10-08T20:43:31.904147] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-08T20:43:31.904190] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-08T20:43:31.904234] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-08T20:43:31.904298] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-08T20:43:32.022773] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-08T20:43:32.264678] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:32.817531] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-10-08T20:43:33.446083] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T20:43:33.617677] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-10-08T20:43:33.900589] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T20:43:34.417625] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-08T20:43:35.219966] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-08T20:43:35.225361] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:43:36.021682] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-08T20:43:36.030892] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T20:43:36.817581] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-08T20:43:36.893533] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T20:43:37.430217] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T20:43:37.617619] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-08T20:43:38.273075] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T20:43:38.417497] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-08T20:43:39.217572] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-08T20:43:39.735726] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T20:43:39.836789] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T20:43:40.017507] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-08T20:43:40.112919] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T20:43:40.817557] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-08T20:43:41.588401] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T20:43:41.617531] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-08T20:43:42.120723] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-08T20:43:42.417592] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-08T20:43:42.551768] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T20:43:43.009180] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T20:43:43.217541] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-08T20:43:44.017575] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-08T20:43:44.556385] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T20:43:44.817532] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-08T20:43:45.492408] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T20:43:45.617565] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-08T20:43:46.162555] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T20:43:46.213771] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T20:43:46.417595] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-08T20:43:47.217591] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-08T20:43:47.648020] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:43:47.653634] [INFO ] [REMOTE ] OMC: Full fetch complete (76606 records). [2025-10-08T20:43:47.653908] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-08T20:43:47.655281] [FATAL] [VALIDATOR ] OMC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:43:47.655448] [FATAL] [MAIN ] OMC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:43:47.655541] [WARN ] [MAIN ] OMC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:43:47.655666] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-08T20:43:47.655785] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-08T20:43:47.655865] [INFO ] [LOCAL ] OMC: Starting deletion of derivative data. [2025-10-08T20:43:47.655960] [DEBUG] [LOCAL ] OMC: No derivative data file found to delete. [2025-10-08T20:43:47.656092] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. OMC took 27.9s. Estimated remaining: 1h 49m 29s. Rate: 7.1 symbols/min [2025-10-08T20:43:47.873725] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:43:47.873990] [DEBUG] [LOCAL ] ONL: No existing data file found in primary storage. [2025-10-08T20:43:47.874130] [WARN ] [MAIN ] ONL: No existing data found, performing full refresh instead. [2025-10-08T20:43:47.874322] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-08T20:43:47.874398] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-08T20:43:47.874531] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-08T20:43:47.874626] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-08T20:43:48.019252] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-08T20:43:48.292319] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T20:43:48.320699] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:43:48.817575] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-10-08T20:43:49.617515] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-08T20:43:49.745446] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T20:43:50.216509] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:43:50.417565] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-08T20:43:50.909381] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T20:43:51.217629] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-08T20:43:51.733577] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T20:43:52.017573] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-08T20:43:52.817528] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-08T20:43:52.953344] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T20:43:53.016428] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T20:43:53.617616] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-08T20:43:53.740778] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T20:43:54.417585] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-08T20:43:55.225576] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-08T20:43:55.229527] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T20:43:55.245218] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T20:43:56.017566] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-08T20:43:56.817547] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-08T20:43:56.967319] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T20:43:57.617600] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-08T20:43:57.689094] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T20:43:57.692314] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T20:43:58.417554] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-08T20:43:59.179397] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T20:43:59.217505] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-08T20:43:59.836352] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T20:44:00.017517] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-08T20:44:00.479579] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T20:44:00.789063] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T20:44:00.817534] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-08T20:44:01.558024] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T20:44:01.617509] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-08T20:44:02.417599] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-08T20:44:02.475483] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T20:44:03.217624] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-08T20:44:03.910548] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T20:44:03.929837] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:44:03.933788] [INFO ] [REMOTE ] OMF: Full fetch complete (66812 records). [2025-10-08T20:44:03.933945] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-08T20:44:03.934928] [FATAL] [VALIDATOR ] OMF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:03.935019] [FATAL] [MAIN ] OMF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:03.935064] [WARN ] [MAIN ] OMF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:03.935109] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-08T20:44:03.935214] [DEBUG] [LOCAL ] OMF: No primary data file found to delete. [2025-10-08T20:44:03.935291] [INFO ] [LOCAL ] OMF: Starting deletion of derivative data. [2025-10-08T20:44:03.935365] [DEBUG] [LOCAL ] OMF: No derivative data file found to delete. [2025-10-08T20:44:03.935487] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMF took 40.2s. Estimated remaining: 1h 49m 24s. Rate: 7.1 symbols/min [2025-10-08T20:44:04.022661] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-08T20:44:04.151680] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:04.151862] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-08T20:44:04.151901] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-08T20:44:04.152038] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-08T20:44:04.152105] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-08T20:44:04.152158] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-08T20:44:04.152191] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-08T20:44:04.564160] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:04.817561] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-08T20:44:05.147470] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:44:05.148528] [INFO ] [REMOTE ] ONIT: Full fetch complete (11046 records). [2025-10-08T20:44:05.148605] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-08T20:44:05.149192] [FATAL] [VALIDATOR ] ONIT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:05.149291] [FATAL] [MAIN ] ONIT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:05.149342] [WARN ] [MAIN ] ONIT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:05.149417] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-08T20:44:05.149494] [DEBUG] [LOCAL ] ONIT: No primary data file found to delete. [2025-10-08T20:44:05.149538] [INFO ] [LOCAL ] ONIT: Starting deletion of derivative data. [2025-10-08T20:44:05.149588] [DEBUG] [LOCAL ] ONIT: No derivative data file found to delete. [2025-10-08T20:44:05.149683] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. ONIT took 33.4s. Estimated remaining: 1h 49m 12s. Rate: 7.1 symbols/min [2025-10-08T20:44:05.352977] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:05.353188] [DEBUG] [LOCAL ] ONTF: No existing data file found in primary storage. [2025-10-08T20:44:05.353232] [WARN ] [MAIN ] ONTF: No existing data found, performing full refresh instead. [2025-10-08T20:44:05.353341] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-08T20:44:05.353381] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-08T20:44:05.353422] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-08T20:44:05.353452] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-08T20:44:05.622723] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-10-08T20:44:05.811170] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:05.805793] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T20:44:06.417564] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-10-08T20:44:07.217565] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-08T20:44:07.581535] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T20:44:07.763037] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-08T20:44:08.017558] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-08T20:44:08.812988] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T20:44:08.823968] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-08T20:44:09.617533] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-08T20:44:09.757412] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:44:10.220989] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T20:44:10.417524] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-08T20:44:10.567302] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T20:44:11.217566] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-08T20:44:11.479290] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T20:44:12.017514] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-08T20:44:12.306128] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:44:12.817604] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-08T20:44:13.617588] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-08T20:44:14.093864] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T20:44:14.118552] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T20:44:14.397338] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T20:44:14.417551] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-08T20:44:15.217547] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-08T20:44:15.284839] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T20:44:15.598300] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T20:44:15.601693] [INFO ] [REMOTE ] OMI: Full fetch complete (64527 records). [2025-10-08T20:44:15.601859] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-08T20:44:15.602618] [FATAL] [VALIDATOR ] OMI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:15.602756] [FATAL] [MAIN ] OMI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:15.602800] [WARN ] [MAIN ] OMI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:15.602839] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-08T20:44:15.602897] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-08T20:44:15.602933] [INFO ] [LOCAL ] OMI: Starting deletion of derivative data. [2025-10-08T20:44:15.602971] [DEBUG] [LOCAL ] OMI: No derivative data file found to delete. [2025-10-08T20:44:15.603027] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. OMI took 44.8s. Estimated remaining: 1h 49m 5s. Rate: 7.1 symbols/min [2025-10-08T20:44:15.773306] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:15.773479] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-08T20:44:15.773517] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-08T20:44:15.773631] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-08T20:44:15.773709] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-08T20:44:15.773802] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-08T20:44:15.773842] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-08T20:44:16.022954] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-08T20:44:16.141832] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:16.817691] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-10-08T20:44:17.617576] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-08T20:44:18.136727] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:44:18.138701] [INFO ] [REMOTE ] ONL: Full fetch complete (42821 records). [2025-10-08T20:44:18.138816] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-08T20:44:18.139568] [FATAL] [VALIDATOR ] ONL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:18.139707] [FATAL] [MAIN ] ONL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:18.139768] [WARN ] [MAIN ] ONL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:18.139832] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-08T20:44:18.139897] [DEBUG] [LOCAL ] ONL: No primary data file found to delete. [2025-10-08T20:44:18.139936] [INFO ] [LOCAL ] ONL: Starting deletion of derivative data. [2025-10-08T20:44:18.140003] [DEBUG] [LOCAL ] ONL: No derivative data file found to delete. [2025-10-08T20:44:18.140099] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONL took 30.5s. Estimated remaining: 1h 48m 53s. Rate: 7.1 symbols/min [2025-10-08T20:44:18.331720] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:18.331997] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-10-08T20:44:18.332169] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-10-08T20:44:18.332852] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-08T20:44:18.332977] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-08T20:44:18.333396] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-08T20:44:18.333570] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-08T20:44:18.419988] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-08T20:44:18.606569] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-08T20:44:18.756204] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T20:44:18.790545] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:19.217519] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-08T20:44:19.394547] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T20:44:20.017614] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-08T20:44:20.817561] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-08T20:44:21.551446] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T20:44:21.583874] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T20:44:21.617494] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-08T20:44:22.108486] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T20:44:22.417546] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-10-08T20:44:23.217505] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-08T20:44:23.258565] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T20:44:23.771494] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-08T20:44:24.022932] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-08T20:44:24.033080] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T20:44:24.817595] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-08T20:44:25.409705] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T20:44:25.617587] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-08T20:44:26.417575] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-08T20:44:26.630734] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T20:44:26.883131] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T20:44:27.217532] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-08T20:44:27.488211] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T20:44:28.017580] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-08T20:44:28.817579] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-08T20:44:28.907524] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T20:44:29.617550] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-08T20:44:30.179133] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-08T20:44:30.205932] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T20:44:30.417562] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-08T20:44:30.739474] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:44:30.741290] [INFO ] [REMOTE ] ONTF: Full fetch complete (31271 records). [2025-10-08T20:44:30.741369] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-08T20:44:30.742239] [FATAL] [VALIDATOR ] ONTF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:30.742369] [FATAL] [MAIN ] ONTF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:30.742448] [WARN ] [MAIN ] ONTF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:30.742560] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-08T20:44:30.742694] [DEBUG] [LOCAL ] ONTF: No primary data file found to delete. [2025-10-08T20:44:30.742750] [INFO ] [LOCAL ] ONTF: Starting deletion of derivative data. [2025-10-08T20:44:30.742797] [DEBUG] [LOCAL ] ONTF: No derivative data file found to delete. [2025-10-08T20:44:30.742854] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONTF took 25.6s. Estimated remaining: 1h 48m 47s. Rate: 7.1 symbols/min [2025-10-08T20:44:31.015559] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T20:44:31.217587] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-08T20:44:32.017588] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-08T20:44:32.305055] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:44:32.817561] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-08T20:44:33.617568] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-08T20:44:33.822631] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T20:44:34.417616] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-08T20:44:34.662693] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T20:44:34.801701] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T20:44:35.217560] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-08T20:44:36.017709] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-08T20:44:36.171905] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T20:44:36.817566] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-08T20:44:36.993065] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T20:44:37.617581] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-08T20:44:38.354932] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:44:38.358415] [INFO ] [REMOTE ] ONON: Full fetch complete (77200 records). [2025-10-08T20:44:38.358528] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-08T20:44:38.360802] [FATAL] [VALIDATOR ] ONON: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:38.360915] [FATAL] [MAIN ] ONON: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:38.360991] [WARN ] [MAIN ] ONON: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:38.361089] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-08T20:44:38.361169] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-08T20:44:38.361205] [INFO ] [LOCAL ] ONON: Starting deletion of derivative data. [2025-10-08T20:44:38.361243] [DEBUG] [LOCAL ] ONON: No derivative data file found to delete. [2025-10-08T20:44:38.361323] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONON took 34.4s. Estimated remaining: 1h 48m 38s. Rate: 7.1 symbols/min [2025-10-08T20:44:38.654901] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T20:44:38.665617] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-08T20:44:39.634897] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (3.62 seconds). [2025-10-08T20:44:39.639418] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-08T20:44:40.300534] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T20:44:40.312010] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-08T20:44:40.816858] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T20:44:40.821050] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-08T20:44:41.902067] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T20:44:41.907155] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-08T20:44:42.078050] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T20:44:42.417525] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-08T20:44:42.646386] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-08T20:44:42.651271] [INFO ] [REMOTE ] ONTO: Full fetch complete (66028 records). [2025-10-08T20:44:42.651465] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-08T20:44:42.652442] [FATAL] [VALIDATOR ] ONTO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:42.652562] [FATAL] [MAIN ] ONTO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:42.652628] [WARN ] [MAIN ] ONTO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:42.652746] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-08T20:44:42.652838] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-08T20:44:42.652898] [INFO ] [LOCAL ] ONTO: Starting deletion of derivative data. [2025-10-08T20:44:42.652967] [DEBUG] [LOCAL ] ONTO: No derivative data file found to delete. [2025-10-08T20:44:42.653077] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONTO took 27.0s. Estimated remaining: 1h 48m 28s. Rate: 7.1 symbols/min [2025-10-08T20:44:42.731508] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T20:44:43.217552] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-08T20:44:44.312696] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T20:44:44.319436] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-08T20:44:45.412810] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T20:44:45.417553] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-08T20:44:45.690835] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-08T20:44:45.692348] [INFO ] [REMOTE ] OOMA: Full fetch complete (25628 records). [2025-10-08T20:44:45.692418] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-08T20:44:45.692948] [FATAL] [VALIDATOR ] OOMA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:44:45.693036] [FATAL] [MAIN ] OOMA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:44:45.693080] [WARN ] [MAIN ] OOMA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:44:45.693147] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-08T20:44:45.693210] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-10-08T20:44:45.693246] [INFO ] [LOCAL ] OOMA: Starting deletion of derivative data. [2025-10-08T20:44:45.693286] [DEBUG] [LOCAL ] OOMA: No derivative data file found to delete. [2025-10-08T20:44:45.693359] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. OOMA took 27.6s. Estimated remaining: 1h 48m 17s. Rate: 7.1 symbols/min [2025-10-08T20:44:46.400226] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:46.372071] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:46.408418] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-08T20:44:46.356380] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:46.409913] [DEBUG] [LOCAL ] OPAD: No existing data file found in primary storage. [2025-10-08T20:44:46.410907] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-08T20:44:46.429496] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:44:46.411094] [WARN ] [MAIN ] OPAD: No existing data found, performing full refresh instead. [2025-10-08T20:44:46.426218] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-08T20:44:46.430270] [DEBUG] [LOCAL ] OPFI: No existing data file found in primary storage. [2025-10-08T20:44:46.430513] [WARN ] [MAIN ] OPFI: No existing data found, performing full refresh instead. [2025-10-08T20:44:46.430421] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-08T20:44:46.431082] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-08T20:44:46.430956] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-08T20:44:46.431029] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-08T20:44:46.431294] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-08T20:44:46.431364] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-08T20:44:46.431663] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-08T20:44:46.431469] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-08T20:44:46.431746] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-08T20:44:46.437186] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-08T20:44:46.437293] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-08T20:44:46.852493] [DEBUG] [LOCAL ] OPP: Loaded 11698 existing records from primary storage. [2025-10-08T20:44:46.969133] [INFO ] [MAIN ] OPP: Loaded 11698 existing records. [2025-10-08T20:44:47.586877] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:47.630787] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-10-08T20:44:47.690926] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:44:47.710580] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:47.730480] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-08T20:44:47.760337] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-10-08T20:44:47.730615] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-08T20:44:47.814080] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:47.815514] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-08T20:44:47.815857] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-10-08T20:44:47.816926] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-08T20:44:48.205960] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:44:48.206342] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-10-08T20:44:48.543231] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T20:44:48.630844] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T20:44:48.817629] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-08T20:44:49.356092] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T20:44:49.376634] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T20:44:49.527179] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T20:44:49.617554] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-08T20:44:50.328703] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T20:44:50.417554] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-08T20:44:50.980346] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T20:44:51.217614] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-08T20:44:51.786138] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T20:44:52.017625] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-08T20:44:52.817541] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-08T20:44:53.129279] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:44:53.617562] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-08T20:44:53.788793] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T20:44:54.417579] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-08T20:44:54.550421] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T20:44:54.921077] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T20:44:55.217571] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-08T20:44:56.017598] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-08T20:44:56.817523] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-08T20:44:56.941139] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T20:44:57.166849] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T20:44:57.395561] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T20:44:57.617570] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-08T20:44:58.417532] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-08T20:44:58.569303] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-08T20:44:59.217580] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-08T20:44:59.360065] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T20:44:59.773204] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T20:45:00.017561] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-08T20:45:00.730507] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T20:45:00.817551] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-08T20:45:01.544194] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T20:45:01.617558] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-08T20:45:02.385486] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T20:45:02.417498] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-08T20:45:03.217517] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-08T20:45:03.343442] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T20:45:04.017558] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-08T20:45:04.817572] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-08T20:45:05.280852] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T20:45:05.417828] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T20:45:05.470750] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T20:45:05.617569] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-08T20:45:06.353206] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T20:45:06.417543] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-08T20:45:07.217558] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-08T20:45:08.017555] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-08T20:45:08.112743] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T20:45:08.372463] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T20:45:08.620141] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T20:45:08.817587] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-08T20:45:09.617520] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-08T20:45:10.406054] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T20:45:10.417509] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-08T20:45:10.607839] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T20:45:11.217515] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-08T20:45:11.430691] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:45:12.017587] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-08T20:45:12.817612] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-08T20:45:13.003614] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T20:45:13.006757] [INFO ] [REMOTE ] OPP: Full fetch complete (17572 records). [2025-10-08T20:45:13.007061] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-08T20:45:13.116079] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T20:45:13.128585] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T20:45:13.147673] [INFO ] [REMOTE ] OPY: Full fetch complete (10076 records). [2025-10-08T20:45:13.177215] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-08T20:45:13.189013] [FATAL] [VALIDATOR ] OPY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:45:13.205389] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:45:13.242006] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:45:13.255538] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-08T20:45:13.330879] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-08T20:45:13.365539] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-08T20:45:13.390207] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-08T20:45:13.393198] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPY took 27.7s. Estimated remaining: 1h 48m 17s. Rate: 7.1 symbols/min [2025-10-08T20:45:13.627939] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-08T20:45:13.627630] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-08T20:45:13.665109] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:13.663309] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-08T20:45:13.665397] [DEBUG] [LOCAL ] OR: No existing data file found in primary storage. [2025-10-08T20:45:13.665497] [WARN ] [MAIN ] OR: No existing data found, performing full refresh instead. [2025-10-08T20:45:13.666157] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-08T20:45:13.666260] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-08T20:45:13.666486] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-08T20:45:13.666902] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-08T20:45:13.667265] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-08T20:45:13.667336] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-08T20:45:13.667455] [DEBUG] [LOCAL ] OPP: Trimmed 17572 records to 11993 (keeping 200 days of data) [2025-10-08T20:45:14.109154] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:14.111528] [DEBUG] [LOCAL ] OPP: Primary data saved (11993 records). [2025-10-08T20:45:14.112086] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-08T20:45:14.112200] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPP took 28.4s. Estimated remaining: 1h 48m 5s. Rate: 7.1 symbols/min [2025-10-08T20:45:14.279797] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:14.280062] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-08T20:45:14.280117] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-08T20:45:14.280226] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-08T20:45:14.280267] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-08T20:45:14.280308] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-08T20:45:14.280340] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-08T20:45:14.426132] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-10-08T20:45:14.632995] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:15.191239] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T20:45:15.217500] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-08T20:45:15.872371] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T20:45:16.017557] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-08T20:45:16.817633] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-08T20:45:17.013922] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T20:45:17.379119] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T20:45:17.617587] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-08T20:45:18.319799] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T20:45:18.417506] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-08T20:45:19.217580] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-10-08T20:45:19.307207] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T20:45:20.017564] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-08T20:45:20.185344] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T20:45:20.616569] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:45:20.817605] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-08T20:45:21.620464] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-08T20:45:21.626309] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T20:45:22.072196] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T20:45:22.417576] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-08T20:45:23.217518] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-08T20:45:23.283336] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T20:45:23.747788] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T20:45:24.017600] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-08T20:45:24.817568] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-08T20:45:25.115195] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T20:45:25.617568] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-08T20:45:26.417517] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-08T20:45:26.836904] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-08T20:45:26.872178] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-08T20:45:26.929916] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T20:45:27.217556] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-08T20:45:27.624125] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T20:45:27.627578] [INFO ] [REMOTE ] OPFI: Full fetch complete (67846 records). [2025-10-08T20:45:27.627723] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-08T20:45:27.628502] [FATAL] [VALIDATOR ] OPFI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:45:27.628591] [FATAL] [MAIN ] OPFI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:45:27.628635] [WARN ] [MAIN ] OPFI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:45:27.628718] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-08T20:45:27.628782] [DEBUG] [LOCAL ] OPFI: No primary data file found to delete. [2025-10-08T20:45:27.628818] [INFO ] [LOCAL ] OPFI: Starting deletion of derivative data. [2025-10-08T20:45:27.628977] [DEBUG] [LOCAL ] OPFI: No derivative data file found to delete. [2025-10-08T20:45:27.629058] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPFI took 41.9s. Estimated remaining: 1h 47m 59s. Rate: 7.1 symbols/min [2025-10-08T20:45:27.807701] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:27.807900] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-08T20:45:27.808038] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-08T20:45:27.808228] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-08T20:45:27.808353] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-08T20:45:27.808453] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-08T20:45:27.808625] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-08T20:45:27.902024] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T20:45:28.023310] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-08T20:45:28.202084] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:28.593969] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:45:28.597096] [INFO ] [REMOTE ] OPAD: Full fetch complete (25954 records). [2025-10-08T20:45:28.597171] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-08T20:45:28.597684] [FATAL] [VALIDATOR ] OPAD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:45:28.597768] [FATAL] [MAIN ] OPAD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:45:28.597809] [WARN ] [MAIN ] OPAD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:45:28.597871] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-08T20:45:28.597933] [DEBUG] [LOCAL ] OPAD: No primary data file found to delete. [2025-10-08T20:45:28.597968] [INFO ] [LOCAL ] OPAD: Starting deletion of derivative data. [2025-10-08T20:45:28.598006] [DEBUG] [LOCAL ] OPAD: No derivative data file found to delete. [2025-10-08T20:45:28.598059] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPAD took 42.9s. Estimated remaining: 1h 47m 47s. Rate: 7.1 symbols/min [2025-10-08T20:45:28.764860] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:28.765078] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-08T20:45:28.765133] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-08T20:45:28.765245] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-08T20:45:28.765286] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-08T20:45:28.765327] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-08T20:45:28.765358] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-08T20:45:28.826111] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-08T20:45:29.142602] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:29.617589] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-10-08T20:45:30.417525] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-08T20:45:30.448295] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T20:45:31.217601] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-08T20:45:31.887567] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T20:45:32.001579] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-08T20:45:32.017501] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-08T20:45:32.738266] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T20:45:32.817627] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-08T20:45:33.617570] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-10-08T20:45:34.308889] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T20:45:34.417565] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-08T20:45:34.543910] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-08T20:45:35.217518] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-08T20:45:35.696760] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-08T20:45:35.791741] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T20:45:36.017556] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-08T20:45:36.817543] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-08T20:45:37.409887] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T20:45:37.617579] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-08T20:45:37.935927] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-08T20:45:38.417573] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-08T20:45:38.674219] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T20:45:39.217619] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-08T20:45:39.250860] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T20:45:40.017535] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-08T20:45:40.817567] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-08T20:45:41.079942] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-08T20:45:41.283918] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-08T20:45:41.519070] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T20:45:41.617557] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-08T20:45:42.309576] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T20:45:42.417742] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-08T20:45:43.217608] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-08T20:45:44.017557] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-08T20:45:44.291272] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-08T20:45:44.393010] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T20:45:44.487312] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T20:45:44.490286] [INFO ] [REMOTE ] ORA: Full fetch complete (48830 records). [2025-10-08T20:45:44.490393] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-08T20:45:44.491110] [FATAL] [VALIDATOR ] ORA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:45:44.491205] [FATAL] [MAIN ] ORA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:45:44.491249] [WARN ] [MAIN ] ORA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:45:44.491289] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-08T20:45:44.491373] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-08T20:45:44.491475] [INFO ] [LOCAL ] ORA: Starting deletion of derivative data. [2025-10-08T20:45:44.491541] [DEBUG] [LOCAL ] ORA: No derivative data file found to delete. [2025-10-08T20:45:44.491607] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 30.4s. Estimated remaining: 1h 47m 42s. Rate: 7.1 symbols/min [2025-10-08T20:45:44.669205] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:44.669904] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-08T20:45:44.669959] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-08T20:45:44.670072] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-08T20:45:44.670114] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-08T20:45:44.670154] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-08T20:45:44.670185] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-08T20:45:44.820198] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-08T20:45:45.034635] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:45.078003] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T20:45:45.584556] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:45:45.588037] [INFO ] [REMOTE ] OR: Full fetch complete (65390 records). [2025-10-08T20:45:45.588157] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-08T20:45:45.588831] [FATAL] [VALIDATOR ] OR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:45:45.588921] [FATAL] [MAIN ] OR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:45:45.589000] [WARN ] [MAIN ] OR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:45:45.589071] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-08T20:45:45.589135] [DEBUG] [LOCAL ] OR: No primary data file found to delete. [2025-10-08T20:45:45.589169] [INFO ] [LOCAL ] OR: Starting deletion of derivative data. [2025-10-08T20:45:45.589207] [DEBUG] [LOCAL ] OR: No derivative data file found to delete. [2025-10-08T20:45:45.589263] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. OR took 32.2s. Estimated remaining: 1h 47m 30s. Rate: 7.1 symbols/min [2025-10-08T20:45:45.620343] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-10-08T20:45:45.770628] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:45:45.770867] [DEBUG] [LOCAL ] ORN: No existing data file found in primary storage. [2025-10-08T20:45:45.770913] [WARN ] [MAIN ] ORN: No existing data found, performing full refresh instead. [2025-10-08T20:45:45.771032] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-08T20:45:45.771075] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-08T20:45:45.771117] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-08T20:45:45.771148] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-08T20:45:46.165772] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:45:46.417548] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-10-08T20:45:47.217562] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-08T20:45:47.480341] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T20:45:47.643956] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T20:45:48.017578] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-08T20:45:48.817572] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-08T20:45:49.617598] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-08T20:45:49.803925] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-08T20:45:50.167798] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T20:45:50.252760] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T20:45:50.417554] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-08T20:45:51.217513] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-08T20:45:51.333624] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T20:45:52.017537] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-08T20:45:52.272926] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T20:45:52.323984] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:45:52.817607] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-08T20:45:53.433427] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T20:45:53.617563] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-08T20:45:54.417520] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-08T20:45:54.878224] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T20:45:55.091016] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T20:45:55.217586] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-08T20:45:56.017583] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-08T20:45:56.817525] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-08T20:45:56.875479] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T20:45:56.929565] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-08T20:45:56.983860] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:45:57.617569] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-08T20:45:58.417833] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-08T20:45:58.928222] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-08T20:45:59.217576] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-08T20:45:59.600512] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T20:46:00.017590] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-08T20:46:00.817609] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-08T20:46:01.495352] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T20:46:01.622697] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-08T20:46:01.644537] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-08T20:46:01.730584] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-10-08T20:46:02.417508] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-08T20:46:02.578071] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T20:46:02.967975] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T20:46:03.217561] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-08T20:46:04.017530] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-08T20:46:04.688360] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-08T20:46:04.740605] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T20:46:04.817628] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-08T20:46:05.430346] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:46:05.433872] [INFO ] [REMOTE ] ORC: Full fetch complete (75019 records). [2025-10-08T20:46:05.434012] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-08T20:46:05.434954] [FATAL] [VALIDATOR ] ORC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:05.435087] [FATAL] [MAIN ] ORC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:05.435131] [WARN ] [MAIN ] ORC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:05.435171] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-08T20:46:05.435229] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-08T20:46:05.435263] [INFO ] [LOCAL ] ORC: Starting deletion of derivative data. [2025-10-08T20:46:05.435301] [DEBUG] [LOCAL ] ORC: No derivative data file found to delete. [2025-10-08T20:46:05.435358] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 37.8s. Estimated remaining: 1h 47m 27s. Rate: 7.1 symbols/min [2025-10-08T20:46:05.608138] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:05.608350] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-08T20:46:05.608405] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-08T20:46:05.608528] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-08T20:46:05.608572] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-08T20:46:05.608688] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-08T20:46:05.608738] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-08T20:46:05.622748] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-08T20:46:05.978961] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:06.417558] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-10-08T20:46:06.842178] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-08T20:46:06.912143] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T20:46:07.217580] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-08T20:46:08.022731] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-08T20:46:08.054076] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T20:46:08.817541] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-08T20:46:08.966411] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T20:46:09.617583] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-08T20:46:10.417503] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-08T20:46:10.473816] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-08T20:46:10.749789] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T20:46:11.145605] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T20:46:11.217510] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-08T20:46:11.614784] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-08T20:46:12.017552] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-08T20:46:12.719378] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T20:46:12.817514] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-08T20:46:13.617564] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-08T20:46:14.099349] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T20:46:14.352331] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:46:14.355855] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-10-08T20:46:14.355970] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-08T20:46:14.356841] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:14.356954] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:14.356998] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:14.357080] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-08T20:46:14.357186] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-08T20:46:14.357261] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-08T20:46:14.357347] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-08T20:46:14.357446] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORCL took 45.8s. Estimated remaining: 1h 47m 19s. Rate: 7.1 symbols/min [2025-10-08T20:46:14.431446] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-08T20:46:14.530257] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:14.530820] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-08T20:46:14.530981] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-08T20:46:14.531151] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-08T20:46:14.531215] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-08T20:46:14.531295] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-08T20:46:14.531344] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-08T20:46:14.834200] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T20:46:14.925214] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:15.217488] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-08T20:46:15.651410] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:46:15.654687] [INFO ] [REMOTE ] ORI: Full fetch complete (69907 records). [2025-10-08T20:46:15.654779] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-08T20:46:15.655391] [FATAL] [VALIDATOR ] ORI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:15.655478] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:15.655521] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:15.655558] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-08T20:46:15.655614] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-08T20:46:15.655705] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-08T20:46:15.655774] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-08T20:46:15.655832] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORI took 31.2s. Estimated remaining: 1h 47m 7s. Rate: 7.1 symbols/min [2025-10-08T20:46:15.821249] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:15.821428] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-08T20:46:15.821478] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-08T20:46:15.821583] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-08T20:46:15.821623] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-08T20:46:15.821705] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-08T20:46:15.821753] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-08T20:46:16.027021] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-10-08T20:46:16.177863] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:16.397585] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T20:46:16.817557] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-10-08T20:46:17.128188] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:46:17.128526] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-10-08T20:46:17.128620] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:46:17.128703] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-08T20:46:17.128772] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:46:17.128859] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-08T20:46:17.128932] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-08T20:46:17.129029] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-08T20:46:17.129090] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-08T20:46:17.129142] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. OTF took 1.5s. Estimated remaining: 1h 46m 56s. Rate: 7.1 symbols/min [2025-10-08T20:46:17.327863] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:17.328063] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-08T20:46:17.328100] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-08T20:46:17.328215] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-08T20:46:17.328283] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-08T20:46:17.328356] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-08T20:46:17.328401] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-08T20:46:17.622681] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-08T20:46:17.749001] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:17.846899] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T20:46:18.084519] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T20:46:18.086716] [INFO ] [REMOTE ] ORN: Full fetch complete (45101 records). [2025-10-08T20:46:18.086806] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-08T20:46:18.087487] [FATAL] [VALIDATOR ] ORN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:18.087578] [FATAL] [MAIN ] ORN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:18.087622] [WARN ] [MAIN ] ORN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:18.087728] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-08T20:46:18.087845] [DEBUG] [LOCAL ] ORN: No primary data file found to delete. [2025-10-08T20:46:18.087891] [INFO ] [LOCAL ] ORN: Starting deletion of derivative data. [2025-10-08T20:46:18.087933] [DEBUG] [LOCAL ] ORN: No derivative data file found to delete. [2025-10-08T20:46:18.087990] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. ORN took 32.5s. Estimated remaining: 1h 46m 44s. Rate: 7.1 symbols/min [2025-10-08T20:46:18.254148] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:18.254362] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-08T20:46:18.254400] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-08T20:46:18.254515] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-08T20:46:18.254558] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-08T20:46:18.254599] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-08T20:46:18.254632] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-08T20:46:18.422672] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-10-08T20:46:18.609374] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:19.217537] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-10-08T20:46:20.017519] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-08T20:46:20.078744] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T20:46:20.492377] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T20:46:20.817561] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-08T20:46:21.617557] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-08T20:46:21.741719] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T20:46:22.016817] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T20:46:22.417563] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-08T20:46:23.217528] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-08T20:46:23.460055] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T20:46:24.017534] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-08T20:46:24.150250] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T20:46:24.817557] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-08T20:46:25.261848] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T20:46:25.298916] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T20:46:25.617539] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-08T20:46:26.417511] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-08T20:46:26.600802] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T20:46:27.217514] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-08T20:46:27.264002] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T20:46:27.873664] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T20:46:28.017577] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-08T20:46:28.817521] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-08T20:46:28.917201] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T20:46:29.617601] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-08T20:46:30.250758] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-08T20:46:30.417549] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-08T20:46:30.827762] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T20:46:31.217525] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-08T20:46:31.461987] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T20:46:32.017572] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-08T20:46:32.553180] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T20:46:32.748387] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T20:46:32.817557] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-08T20:46:33.207908] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T20:46:33.617607] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-08T20:46:34.417562] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-08T20:46:34.576176] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T20:46:35.217689] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-08T20:46:36.017542] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-08T20:46:36.253997] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T20:46:36.349539] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-08T20:46:36.817514] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-08T20:46:36.918384] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T20:46:37.617540] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-08T20:46:37.777419] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T20:46:38.417515] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-08T20:46:38.495587] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T20:46:39.217527] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-08T20:46:39.331109] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T20:46:39.778908] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T20:46:40.017702] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-08T20:46:40.817573] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-08T20:46:41.617529] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-08T20:46:41.769622] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-08T20:46:41.832141] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T20:46:42.243290] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T20:46:42.417622] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-08T20:46:42.632279] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-10-08T20:46:42.635695] [INFO ] [REMOTE ] OUT: Full fetch complete (68666 records). [2025-10-08T20:46:42.635857] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-08T20:46:42.636668] [FATAL] [VALIDATOR ] OUT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:42.636771] [FATAL] [MAIN ] OUT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:42.636813] [WARN ] [MAIN ] OUT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:42.636852] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-08T20:46:42.636911] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-08T20:46:42.636981] [INFO ] [LOCAL ] OUT: Starting deletion of derivative data. [2025-10-08T20:46:42.637043] [DEBUG] [LOCAL ] OUT: No derivative data file found to delete. [2025-10-08T20:46:42.637103] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OUT took 24.5s. Estimated remaining: 1h 46m 43s. Rate: 7.1 symbols/min [2025-10-08T20:46:42.813995] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:42.814198] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-08T20:46:42.814264] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-08T20:46:42.814419] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-08T20:46:42.814475] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-08T20:46:42.814523] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-08T20:46:42.814555] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-08T20:46:43.181782] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:43.217678] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-08T20:46:43.220455] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T20:46:44.017560] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-08T20:46:44.584930] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:46:44.588924] [INFO ] [REMOTE ] OSCR: Full fetch complete (77142 records). [2025-10-08T20:46:44.589134] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-08T20:46:44.590154] [FATAL] [VALIDATOR ] OSCR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:44.590269] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:44.590312] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:44.590377] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-08T20:46:44.590443] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-08T20:46:44.590480] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-10-08T20:46:44.590520] [DEBUG] [LOCAL ] OSCR: No derivative data file found to delete. [2025-10-08T20:46:44.590581] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSCR took 39.2s. Estimated remaining: 1h 46m 31s. Rate: 7.1 symbols/min [2025-10-08T20:46:44.787343] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:44.787535] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-08T20:46:44.787880] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-08T20:46:44.788079] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-08T20:46:44.788207] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-08T20:46:44.788266] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-08T20:46:44.788302] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-08T20:46:44.821994] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-08T20:46:45.172469] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:46:45.213868] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:45.617613] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-10-08T20:46:46.417574] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-10-08T20:46:46.750410] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T20:46:47.001596] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T20:46:47.217531] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-08T20:46:48.017567] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-08T20:46:48.257845] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T20:46:48.817542] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-08T20:46:49.076621] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T20:46:49.617583] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-08T20:46:49.729166] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T20:46:50.417521] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-08T20:46:50.724965] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T20:46:51.217567] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-08T20:46:51.453272] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T20:46:51.890011] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:46:52.017503] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-08T20:46:52.817815] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-08T20:46:52.820602] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T20:46:53.617597] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-08T20:46:53.661301] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T20:46:54.422985] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-08T20:46:54.427987] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T20:46:54.825981] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T20:46:54.829440] [INFO ] [REMOTE ] OTIS: Full fetch complete (75584 records). [2025-10-08T20:46:54.829575] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-08T20:46:54.830513] [FATAL] [VALIDATOR ] OTIS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:54.830606] [FATAL] [MAIN ] OTIS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:54.830686] [WARN ] [MAIN ] OTIS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:54.830771] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-08T20:46:54.830838] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-08T20:46:54.830873] [INFO ] [LOCAL ] OTIS: Starting deletion of derivative data. [2025-10-08T20:46:54.830912] [DEBUG] [LOCAL ] OTIS: No derivative data file found to delete. [2025-10-08T20:46:54.830983] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OTIS took 37.7s. Estimated remaining: 1h 46m 24s. Rate: 7.1 symbols/min [2025-10-08T20:46:55.007873] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:55.008099] [DEBUG] [LOCAL ] OWLT: No existing data file found in primary storage. [2025-10-08T20:46:55.008323] [WARN ] [MAIN ] OWLT: No existing data found, performing full refresh instead. [2025-10-08T20:46:55.008516] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-08T20:46:55.008816] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-08T20:46:55.008893] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-08T20:46:55.008932] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-08T20:46:55.224174] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-08T20:46:55.388511] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:55.423696] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T20:46:55.661988] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T20:46:55.665011] [INFO ] [REMOTE ] OSK: Full fetch complete (60978 records). [2025-10-08T20:46:55.665136] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-08T20:46:55.665906] [FATAL] [VALIDATOR ] OSK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:46:55.666014] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:46:55.666090] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:46:55.666177] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-08T20:46:55.666257] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-08T20:46:55.666293] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-08T20:46:55.666332] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-08T20:46:55.666391] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OSK took 41.3s. Estimated remaining: 1h 46m 12s. Rate: 7.1 symbols/min [2025-10-08T20:46:55.836504] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:46:55.836725] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-08T20:46:55.836781] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-08T20:46:55.836923] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-08T20:46:55.836990] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-08T20:46:55.837044] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-08T20:46:55.837078] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-08T20:46:56.022823] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-08T20:46:56.187233] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:46:56.817554] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-10-08T20:46:57.481160] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T20:46:57.617515] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-08T20:46:58.059333] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T20:46:58.301735] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T20:46:58.417524] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-08T20:46:58.951578] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T20:46:59.217542] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-08T20:47:00.003666] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T20:47:00.017514] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-08T20:47:00.817554] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-10-08T20:47:01.617531] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-08T20:47:01.986280] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T20:47:02.418863] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-08T20:47:02.414752] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T20:47:02.420330] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T20:47:03.217560] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-08T20:47:03.847254] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-08T20:47:03.990625] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T20:47:04.017537] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-08T20:47:04.817584] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-08T20:47:05.203694] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T20:47:05.617597] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-08T20:47:06.041754] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T20:47:06.417621] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-08T20:47:07.217530] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-08T20:47:07.368507] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T20:47:07.626563] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T20:47:08.017599] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-08T20:47:08.508208] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T20:47:08.739794] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T20:47:08.817541] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-08T20:47:09.617556] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-08T20:47:09.726264] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T20:47:10.417602] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-08T20:47:11.217530] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-08T20:47:11.479701] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T20:47:11.557940] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T20:47:12.017573] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-08T20:47:12.817522] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-08T20:47:13.327998] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:47:13.340107] [INFO ] [REMOTE ] OWLT: Full fetch complete (11675 records). [2025-10-08T20:47:13.345444] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-08T20:47:13.359678] [FATAL] [VALIDATOR ] OWLT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:13.361933] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-08T20:47:13.362051] [FATAL] [MAIN ] OWLT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:13.373347] [WARN ] [MAIN ] OWLT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:13.373470] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-08T20:47:13.373597] [DEBUG] [LOCAL ] OWLT: No primary data file found to delete. [2025-10-08T20:47:13.374131] [INFO ] [LOCAL ] OWLT: Starting deletion of derivative data. [2025-10-08T20:47:13.374226] [DEBUG] [LOCAL ] OWLT: No derivative data file found to delete. [2025-10-08T20:47:13.374324] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OWLT took 18.5s. Estimated remaining: 1h 46m 8s. Rate: 7.1 symbols/min [2025-10-08T20:47:13.573248] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:13.573470] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-08T20:47:13.573543] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-08T20:47:13.573745] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-08T20:47:13.573808] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-08T20:47:13.573853] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-08T20:47:13.573885] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-08T20:47:13.618195] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-08T20:47:13.950588] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:14.130325] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-08T20:47:14.417570] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-10-08T20:47:14.833610] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T20:47:15.217611] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-08T20:47:16.017708] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-08T20:47:16.606800] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T20:47:16.817608] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-08T20:47:17.082746] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-08T20:47:17.429893] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:47:17.433954] [INFO ] [REMOTE ] OWL: Full fetch complete (77140 records). [2025-10-08T20:47:17.434143] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-08T20:47:17.436464] [FATAL] [VALIDATOR ] OWL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:17.436563] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:17.436608] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:17.436711] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-08T20:47:17.436785] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-08T20:47:17.436821] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-10-08T20:47:17.436859] [DEBUG] [LOCAL ] OWL: No derivative data file found to delete. [2025-10-08T20:47:17.436921] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWL took 32.8s. Estimated remaining: 1h 45m 57s. Rate: 7.1 symbols/min [2025-10-08T20:47:17.617058] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:17.617301] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-08T20:47:17.617354] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-08T20:47:17.617466] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-08T20:47:17.617681] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-08T20:47:17.617568] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-08T20:47:17.617982] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-08T20:47:17.619107] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-08T20:47:17.979667] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:18.014616] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T20:47:18.417595] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-08T20:47:19.217557] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-10-08T20:47:19.882384] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-08T20:47:20.017516] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-08T20:47:20.087963] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T20:47:20.817530] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-08T20:47:21.148477] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T20:47:21.617606] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-08T20:47:22.417537] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-08T20:47:22.570941] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-08T20:47:22.931321] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-08T20:47:23.217541] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-08T20:47:23.619566] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-08T20:47:23.744356] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T20:47:24.017623] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-08T20:47:24.822688] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-08T20:47:24.840521] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T20:47:25.617526] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-08T20:47:26.366707] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-08T20:47:26.417520] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-08T20:47:26.712394] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T20:47:27.217589] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-08T20:47:27.569850] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T20:47:28.017543] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-08T20:47:28.563047] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T20:47:28.578991] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:47:28.582552] [INFO ] [REMOTE ] OVV: Full fetch complete (76937 records). [2025-10-08T20:47:28.582682] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-08T20:47:28.583920] [FATAL] [VALIDATOR ] OVV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:28.584031] [FATAL] [MAIN ] OVV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:28.584074] [WARN ] [MAIN ] OVV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:28.584113] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-08T20:47:28.584205] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-08T20:47:28.584301] [INFO ] [LOCAL ] OVV: Starting deletion of derivative data. [2025-10-08T20:47:28.584359] [DEBUG] [LOCAL ] OVV: No derivative data file found to delete. [2025-10-08T20:47:28.584432] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OVV took 45.9s. Estimated remaining: 1h 45m 50s. Rate: 7.1 symbols/min [2025-10-08T20:47:28.759004] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:28.759191] [DEBUG] [LOCAL ] PAC: No existing data file found in primary storage. [2025-10-08T20:47:28.759230] [WARN ] [MAIN ] PAC: No existing data found, performing full refresh instead. [2025-10-08T20:47:28.759340] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-08T20:47:28.759382] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-08T20:47:28.759423] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-08T20:47:28.759502] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-08T20:47:28.822728] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-08T20:47:29.129706] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:29.162483] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-08T20:47:29.617543] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-08T20:47:30.190013] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T20:47:30.417588] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-08T20:47:31.217517] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-08T20:47:31.761397] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T20:47:31.796504] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T20:47:32.017551] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-08T20:47:32.817598] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-10-08T20:47:33.617614] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-08T20:47:33.665082] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T20:47:33.827792] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-08T20:47:33.948098] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T20:47:33.950486] [INFO ] [REMOTE ] OXM: Full fetch complete (45781 records). [2025-10-08T20:47:33.950607] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-08T20:47:33.951293] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:33.951391] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:33.951433] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:33.951491] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-08T20:47:33.951571] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-08T20:47:33.951607] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-10-08T20:47:33.951674] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-10-08T20:47:33.951765] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OXM took 38.3s. Estimated remaining: 1h 45m 40s. Rate: 7.1 symbols/min [2025-10-08T20:47:34.121778] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:34.121988] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-10-08T20:47:34.122105] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-10-08T20:47:34.122251] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-08T20:47:34.122351] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-08T20:47:34.122426] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-08T20:47:34.122487] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-08T20:47:34.308473] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-08T20:47:34.422666] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-08T20:47:34.540286] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:35.217558] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-08T20:47:36.017579] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-10-08T20:47:36.739064] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T20:47:36.817504] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-08T20:47:37.303065] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T20:47:37.617971] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-08T20:47:37.617900] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-08T20:47:38.417518] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-08T20:47:38.751301] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T20:47:38.795114] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T20:47:39.046379] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T20:47:39.217560] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-08T20:47:40.017536] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-08T20:47:40.817588] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-08T20:47:41.209777] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T20:47:41.492942] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:47:41.617546] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-08T20:47:42.417559] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-08T20:47:42.757915] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-08T20:47:43.068211] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T20:47:43.217571] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-08T20:47:43.758068] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-08T20:47:44.017593] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-08T20:47:44.817537] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-08T20:47:44.887930] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T20:47:45.469976] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-08T20:47:45.617547] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-08T20:47:45.763584] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T20:47:46.417572] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-08T20:47:47.217585] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-08T20:47:47.843067] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T20:47:47.909016] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-08T20:47:48.017539] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-08T20:47:48.817566] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-08T20:47:49.542925] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T20:47:49.617554] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-08T20:47:49.731840] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-08T20:47:49.754158] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T20:47:50.417551] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-08T20:47:50.952841] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T20:47:51.101204] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T20:47:51.217555] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-08T20:47:52.017529] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-08T20:47:52.164510] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T20:47:52.817553] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-08T20:47:53.060209] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T20:47:53.185304] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T20:47:53.188835] [INFO ] [REMOTE ] OXY: Full fetch complete (77180 records). [2025-10-08T20:47:53.188984] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-08T20:47:53.190057] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:53.190143] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:53.190210] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:53.190281] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-08T20:47:53.190346] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-08T20:47:53.190381] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-08T20:47:53.190420] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-08T20:47:53.190492] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXY took 39.8s. Estimated remaining: 1h 45m 37s. Rate: 7.1 symbols/min [2025-10-08T20:47:53.360597] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:53.360794] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-10-08T20:47:53.360838] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-10-08T20:47:53.360955] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-08T20:47:53.360996] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-08T20:47:53.361038] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-08T20:47:53.361069] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-08T20:47:53.622677] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-08T20:47:53.731756] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:54.364686] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:47:54.369356] [INFO ] [REMOTE ] PAAS: Full fetch complete (77023 records). [2025-10-08T20:47:54.369504] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-08T20:47:54.370551] [FATAL] [VALIDATOR ] PAAS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:47:54.370668] [FATAL] [MAIN ] PAAS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:47:54.370735] [WARN ] [MAIN ] PAAS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:47:54.370806] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-08T20:47:54.370872] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-08T20:47:54.370907] [INFO ] [LOCAL ] PAAS: Starting deletion of derivative data. [2025-10-08T20:47:54.370945] [DEBUG] [LOCAL ] PAAS: No derivative data file found to delete. [2025-10-08T20:47:54.371003] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAAS took 36.9s. Estimated remaining: 1h 45m 25s. Rate: 7.1 symbols/min [2025-10-08T20:47:54.424299] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-08T20:47:54.555402] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:47:54.555631] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-08T20:47:54.555735] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-08T20:47:54.555856] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-08T20:47:54.555899] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-08T20:47:54.555941] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-08T20:47:54.555974] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-08T20:47:54.910778] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:47:55.217560] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-10-08T20:47:55.975274] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T20:47:56.017551] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-08T20:47:56.228577] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T20:47:56.817561] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-08T20:47:57.548827] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T20:47:57.570521] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T20:47:57.617570] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-08T20:47:58.175269] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T20:47:58.417553] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-08T20:47:59.217555] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-08T20:47:59.961540] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T20:48:00.017518] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-08T20:48:00.268159] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T20:48:00.817557] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-08T20:48:00.845391] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T20:48:00.847939] [INFO ] [REMOTE ] PACK: Full fetch complete (44284 records). [2025-10-08T20:48:00.848015] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-08T20:48:00.848796] [FATAL] [VALIDATOR ] PACK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:48:00.848901] [FATAL] [MAIN ] PACK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:48:00.848942] [WARN ] [MAIN ] PACK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:48:00.849172] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-08T20:48:00.849267] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-10-08T20:48:00.849324] [INFO ] [LOCAL ] PACK: Starting deletion of derivative data. [2025-10-08T20:48:00.849366] [DEBUG] [LOCAL ] PACK: No derivative data file found to delete. [2025-10-08T20:48:00.849433] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PACK took 26.9s. Estimated remaining: 1h 45m 16s. Rate: 7.1 symbols/min [2025-10-08T20:48:01.017803] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:01.017940] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-08T20:48:01.018000] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-08T20:48:01.018108] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-08T20:48:01.018152] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-08T20:48:01.018193] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-08T20:48:01.018242] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-08T20:48:01.265419] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:48:01.289200] [INFO ] [REMOTE ] PAC: Full fetch complete (16446 records). [2025-10-08T20:48:01.299542] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-08T20:48:01.316040] [FATAL] [VALIDATOR ] PAC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:48:01.344636] [FATAL] [MAIN ] PAC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:48:01.388877] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:01.389021] [WARN ] [MAIN ] PAC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:48:01.389202] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-08T20:48:01.389605] [DEBUG] [LOCAL ] PAC: No primary data file found to delete. [2025-10-08T20:48:01.389715] [INFO ] [LOCAL ] PAC: Starting deletion of derivative data. [2025-10-08T20:48:01.389774] [DEBUG] [LOCAL ] PAC: No derivative data file found to delete. [2025-10-08T20:48:01.389879] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAC took 32.8s. Estimated remaining: 1h 45m 4s. Rate: 7.1 symbols/min [2025-10-08T20:48:01.561687] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:01.569035] [DEBUG] [LOCAL ] PAI: Loaded 2663 existing records from primary storage. [2025-10-08T20:48:01.569269] [INFO ] [MAIN ] PAI: Loaded 2663 existing records. [2025-10-08T20:48:01.622736] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-10-08T20:48:01.758230] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:48:01.758570] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-08T20:48:01.758671] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-08T20:48:01.759264] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-08T20:48:01.759351] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-08T20:48:02.125077] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:02.417599] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-10-08T20:48:03.217604] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-08T20:48:03.307042] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T20:48:04.017549] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-08T20:48:04.113582] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T20:48:04.464213] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T20:48:04.817578] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-08T20:48:05.335731] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T20:48:05.617577] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-08T20:48:05.878478] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T20:48:06.417595] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-08T20:48:07.217534] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-10-08T20:48:07.527460] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T20:48:07.571092] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T20:48:07.991820] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T20:48:08.017496] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-08T20:48:08.646816] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T20:48:08.817548] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-08T20:48:09.617552] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-08T20:48:10.066507] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T20:48:10.066310] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T20:48:10.417568] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-08T20:48:11.189147] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T20:48:11.217531] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-08T20:48:12.017556] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-08T20:48:12.234481] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T20:48:12.446629] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T20:48:12.817556] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-08T20:48:13.617618] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-08T20:48:14.056802] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T20:48:14.160471] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T20:48:14.417591] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-08T20:48:15.217592] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-08T20:48:15.632765] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T20:48:16.017583] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-08T20:48:16.501092] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T20:48:16.817532] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-08T20:48:17.003757] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T20:48:17.312275] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T20:48:17.617569] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-08T20:48:18.417571] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-08T20:48:18.984348] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T20:48:19.217551] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-08T20:48:20.017527] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-08T20:48:20.105713] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T20:48:20.699553] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T20:48:20.817688] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-08T20:48:21.274417] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T20:48:21.617564] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-08T20:48:21.926802] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T20:48:22.417544] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-08T20:48:22.854376] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T20:48:23.217554] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-08T20:48:23.309338] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T20:48:24.017534] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-08T20:48:24.327559] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:48:24.817703] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-08T20:48:25.135670] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T20:48:25.137403] [INFO ] [REMOTE ] PAG: Full fetch complete (30260 records). [2025-10-08T20:48:25.137494] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-08T20:48:25.138028] [FATAL] [VALIDATOR ] PAG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:48:25.138122] [FATAL] [MAIN ] PAG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:48:25.138169] [WARN ] [MAIN ] PAG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:48:25.138235] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-08T20:48:25.138309] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-08T20:48:25.138348] [INFO ] [LOCAL ] PAG: Starting deletion of derivative data. [2025-10-08T20:48:25.138388] [DEBUG] [LOCAL ] PAG: No derivative data file found to delete. [2025-10-08T20:48:25.138457] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PAG took 30.8s. Estimated remaining: 1h 45m 2s. Rate: 7.1 symbols/min [2025-10-08T20:48:25.310216] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:25.310440] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-08T20:48:25.310496] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-08T20:48:25.310617] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-08T20:48:25.310692] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-08T20:48:25.310753] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-08T20:48:25.310787] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-08T20:48:25.637816] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-08T20:48:25.681846] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:25.713237] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T20:48:26.417606] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-08T20:48:26.900686] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T20:48:27.217621] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-10-08T20:48:27.459498] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:48:27.459834] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-10-08T20:48:27.459947] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:48:27.460040] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-08T20:48:27.460121] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:48:27.460209] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-08T20:48:27.460287] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-08T20:48:27.460325] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-08T20:48:27.460383] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-08T20:48:27.460454] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PAII took 2.3s. Estimated remaining: 1h 44m 51s. Rate: 7.1 symbols/min [2025-10-08T20:48:27.633128] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:27.662011] [DEBUG] [LOCAL ] PAM: Loaded 28079 existing records from primary storage. [2025-10-08T20:48:27.662349] [INFO ] [MAIN ] PAM: Loaded 28079 existing records. [2025-10-08T20:48:27.839960] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:48:27.840248] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-08T20:48:27.840300] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-08T20:48:27.840565] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-08T20:48:27.840622] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-08T20:48:28.028567] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-08T20:48:28.210124] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:28.244798] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T20:48:28.684905] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-08T20:48:28.817546] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-08T20:48:29.617547] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-10-08T20:48:30.417508] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-08T20:48:30.740484] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T20:48:31.150738] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:48:31.217624] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-08T20:48:31.524445] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T20:48:32.017544] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-08T20:48:32.798387] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T20:48:32.817512] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-08T20:48:33.617701] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-08T20:48:34.286878] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T20:48:34.314415] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T20:48:34.417497] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-08T20:48:35.073682] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T20:48:35.217537] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-08T20:48:36.023687] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-08T20:48:36.046844] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T20:48:36.531409] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T20:48:36.817576] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-08T20:48:37.352666] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T20:48:37.474244] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T20:48:37.477000] [INFO ] [REMOTE ] PACS: Full fetch complete (50474 records). [2025-10-08T20:48:37.477103] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-08T20:48:37.477730] [FATAL] [VALIDATOR ] PACS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:48:37.477821] [FATAL] [MAIN ] PACS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:48:37.477863] [WARN ] [MAIN ] PACS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:48:37.477901] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-08T20:48:37.478044] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-10-08T20:48:37.478098] [INFO ] [LOCAL ] PACS: Starting deletion of derivative data. [2025-10-08T20:48:37.478140] [DEBUG] [LOCAL ] PACS: No derivative data file found to delete. [2025-10-08T20:48:37.478198] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PACS took 44.3s. Estimated remaining: 1h 44m 43s. Rate: 7.1 symbols/min [2025-10-08T20:48:37.622629] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-08T20:48:37.647596] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:37.647838] [DEBUG] [LOCAL ] PAR: No existing data file found in primary storage. [2025-10-08T20:48:37.647952] [WARN ] [MAIN ] PAR: No existing data found, performing full refresh instead. [2025-10-08T20:48:37.648064] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-08T20:48:37.648106] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-08T20:48:37.648150] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-08T20:48:37.648184] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-08T20:48:37.998435] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:38.183623] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T20:48:38.187068] [INFO ] [REMOTE ] PAGS: Full fetch complete (75928 records). [2025-10-08T20:48:38.187169] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-08T20:48:38.187987] [FATAL] [VALIDATOR ] PAGS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:48:38.188075] [FATAL] [MAIN ] PAGS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:48:38.188117] [WARN ] [MAIN ] PAGS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:48:38.188183] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-08T20:48:38.188246] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-08T20:48:38.188283] [INFO ] [LOCAL ] PAGS: Starting deletion of derivative data. [2025-10-08T20:48:38.188322] [DEBUG] [LOCAL ] PAGS: No derivative data file found to delete. [2025-10-08T20:48:38.188379] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAGS took 37.3s. Estimated remaining: 1h 44m 31s. Rate: 7.1 symbols/min [2025-10-08T20:48:38.353428] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:38.353592] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-08T20:48:38.353667] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-08T20:48:38.353780] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-08T20:48:38.353829] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-08T20:48:38.353869] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-08T20:48:38.353915] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-08T20:48:38.422741] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-08T20:48:38.709870] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:39.217562] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-08T20:48:39.948173] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T20:48:39.950483] [INFO ] [REMOTE ] PAI: Full fetch complete (4038 records). [2025-10-08T20:48:39.950388] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T20:48:39.956878] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-08T20:48:40.022751] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-10-08T20:48:40.356091] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-08T20:48:40.356189] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-08T20:48:40.356360] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-08T20:48:40.356399] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-08T20:48:40.356848] [DEBUG] [LOCAL ] PAI: Trimmed 4038 records to 2658 (keeping 200 days of data) [2025-10-08T20:48:40.374672] [DEBUG] [LOCAL ] PAI: Primary data saved (2658 records). [2025-10-08T20:48:40.374754] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-08T20:48:40.374832] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAI took 39.0s. Estimated remaining: 1h 44m 20s. Rate: 7.1 symbols/min [2025-10-08T20:48:40.547497] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:40.547707] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-08T20:48:40.547761] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-08T20:48:40.547873] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-08T20:48:40.547916] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-08T20:48:40.547958] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-08T20:48:40.547991] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-08T20:48:40.825268] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-08T20:48:40.921523] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:41.471953] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T20:48:41.617549] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-10-08T20:48:42.138545] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T20:48:42.417536] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-08T20:48:43.217566] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-10-08T20:48:43.694038] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T20:48:43.885707] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-08T20:48:44.017561] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-08T20:48:44.523054] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T20:48:44.817604] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-08T20:48:45.617568] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-08T20:48:46.421758] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-08T20:48:46.429164] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-08T20:48:46.477094] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T20:48:46.601151] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-08T20:48:47.217544] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-08T20:48:47.716539] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T20:48:48.017559] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-08T20:48:48.690496] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T20:48:48.817559] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-08T20:48:49.352180] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T20:48:49.617638] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-08T20:48:50.351730] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T20:48:50.417505] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-08T20:48:51.217571] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-08T20:48:51.308197] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T20:48:51.608266] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T20:48:52.017565] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-08T20:48:52.216478] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T20:48:52.219099] [INFO ] [REMOTE ] PAM: Full fetch complete (41898 records). [2025-10-08T20:48:52.219180] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-08T20:48:52.612836] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-08T20:48:52.612989] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-08T20:48:52.613761] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-08T20:48:52.613834] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-08T20:48:52.614778] [DEBUG] [LOCAL ] PAM: Trimmed 41898 records to 28118 (keeping 200 days of data) [2025-10-08T20:48:52.792229] [DEBUG] [LOCAL ] PAM: Primary data saved (28118 records). [2025-10-08T20:48:52.792379] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-08T20:48:52.792464] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAM took 25.3s. Estimated remaining: 1h 44m 13s. Rate: 7.1 symbols/min [2025-10-08T20:48:52.822843] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-08T20:48:52.964055] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:48:52.964230] [DEBUG] [LOCAL ] PAXS: No existing data file found in primary storage. [2025-10-08T20:48:52.964267] [WARN ] [MAIN ] PAXS: No existing data found, performing full refresh instead. [2025-10-08T20:48:52.964438] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-08T20:48:52.964478] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-08T20:48:52.964519] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-08T20:48:52.964550] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-08T20:48:53.354948] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:48:53.534002] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T20:48:53.617551] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-08T20:48:54.417573] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-08T20:48:54.578997] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:48:54.650138] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:48:55.217587] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-08T20:48:56.017517] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-08T20:48:56.464485] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T20:48:56.750794] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-08T20:48:56.817513] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-08T20:48:57.474376] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T20:48:57.617600] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-10-08T20:48:58.159795] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T20:48:58.417573] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-08T20:48:58.863880] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T20:48:59.217613] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-08T20:48:59.670958] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T20:49:00.017596] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-08T20:49:00.427110] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T20:49:00.817588] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-08T20:49:01.617597] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-08T20:49:02.417529] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-08T20:49:02.571731] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T20:49:02.595446] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T20:49:02.731167] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-08T20:49:03.217558] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-08T20:49:03.696523] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T20:49:04.017510] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-08T20:49:04.384465] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T20:49:04.817631] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-08T20:49:05.617557] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-08T20:49:05.877845] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T20:49:06.073193] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T20:49:06.417555] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-08T20:49:06.988727] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T20:49:07.217606] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-08T20:49:08.017722] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-08T20:49:08.825403] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-08T20:49:08.846798] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-08T20:49:08.986516] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-08T20:49:09.045898] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:49:09.617566] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-08T20:49:09.709487] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T20:49:09.712372] [INFO ] [REMOTE ] PAR: Full fetch complete (48078 records). [2025-10-08T20:49:09.712456] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-08T20:49:09.713162] [FATAL] [VALIDATOR ] PAR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:09.713253] [FATAL] [MAIN ] PAR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:09.713298] [WARN ] [MAIN ] PAR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:09.713336] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-08T20:49:09.713391] [DEBUG] [LOCAL ] PAR: No primary data file found to delete. [2025-10-08T20:49:09.713426] [INFO ] [LOCAL ] PAR: Starting deletion of derivative data. [2025-10-08T20:49:09.713465] [DEBUG] [LOCAL ] PAR: No derivative data file found to delete. [2025-10-08T20:49:09.713522] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 32.2s. Estimated remaining: 1h 44m 9s. Rate: 7.1 symbols/min [2025-10-08T20:49:09.883499] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:09.883768] [DEBUG] [LOCAL ] PAY: No existing data file found in primary storage. [2025-10-08T20:49:09.883820] [WARN ] [MAIN ] PAY: No existing data found, performing full refresh instead. [2025-10-08T20:49:09.883950] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-08T20:49:09.883993] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-08T20:49:09.884034] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-08T20:49:09.884069] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-08T20:49:10.230049] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:10.417514] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-08T20:49:10.756451] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T20:49:11.217543] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-10-08T20:49:12.017554] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-08T20:49:12.644857] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-08T20:49:12.688045] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T20:49:12.817504] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-08T20:49:13.479958] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T20:49:13.617577] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-08T20:49:14.149045] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T20:49:14.417547] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-08T20:49:14.555485] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T20:49:15.217590] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-08T20:49:16.017630] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-08T20:49:16.210870] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T20:49:16.831979] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-08T20:49:16.835373] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-08T20:49:17.315783] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T20:49:17.617586] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-08T20:49:17.969265] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T20:49:18.417566] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-08T20:49:18.838405] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:49:18.840084] [INFO ] [REMOTE ] PAXS: Full fetch complete (30433 records). [2025-10-08T20:49:18.840163] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-08T20:49:18.840712] [FATAL] [VALIDATOR ] PAXS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:18.840799] [FATAL] [MAIN ] PAXS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:18.840842] [WARN ] [MAIN ] PAXS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:18.840879] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-08T20:49:18.840968] [DEBUG] [LOCAL ] PAXS: No primary data file found to delete. [2025-10-08T20:49:18.841048] [INFO ] [LOCAL ] PAXS: Starting deletion of derivative data. [2025-10-08T20:49:18.841256] [DEBUG] [LOCAL ] PAXS: No derivative data file found to delete. [2025-10-08T20:49:18.841380] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PAXS took 26.0s. Estimated remaining: 1h 44m 1s. Rate: 7.1 symbols/min [2025-10-08T20:49:19.024010] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:19.024231] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-08T20:49:19.024275] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-08T20:49:19.024389] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-08T20:49:19.024431] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-08T20:49:19.024471] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-08T20:49:19.024502] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-08T20:49:19.225672] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-08T20:49:19.393072] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:19.879954] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-08T20:49:20.017548] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-08T20:49:20.817589] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-08T20:49:20.925329] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T20:49:21.617701] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-08T20:49:22.244946] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:49:22.341160] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-08T20:49:22.417574] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-08T20:49:23.071310] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:49:23.074981] [INFO ] [REMOTE ] PATH: Full fetch complete (77374 records). [2025-10-08T20:49:23.075144] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-08T20:49:23.075957] [FATAL] [VALIDATOR ] PATH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:23.076053] [FATAL] [MAIN ] PATH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:23.076095] [WARN ] [MAIN ] PATH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:23.076133] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-08T20:49:23.076198] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-08T20:49:23.076271] [INFO ] [LOCAL ] PATH: Starting deletion of derivative data. [2025-10-08T20:49:23.076337] [DEBUG] [LOCAL ] PATH: No derivative data file found to delete. [2025-10-08T20:49:23.076433] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PATH took 42.7s. Estimated remaining: 1h 43m 50s. Rate: 7.1 symbols/min [2025-10-08T20:49:23.226545] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-08T20:49:23.294110] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T20:49:23.297800] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:23.304832] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-08T20:49:23.304910] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-08T20:49:23.305694] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-08T20:49:23.305784] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-08T20:49:23.305836] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-08T20:49:23.305870] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-08T20:49:23.666989] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:23.964141] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:49:23.967518] [INFO ] [REMOTE ] PARR: Full fetch complete (68682 records). [2025-10-08T20:49:23.967695] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-08T20:49:23.968544] [FATAL] [VALIDATOR ] PARR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:23.968682] [FATAL] [MAIN ] PARR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:23.968741] [WARN ] [MAIN ] PARR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:23.968782] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-08T20:49:23.968856] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-08T20:49:23.968910] [INFO ] [LOCAL ] PARR: Starting deletion of derivative data. [2025-10-08T20:49:23.968971] [DEBUG] [LOCAL ] PARR: No derivative data file found to delete. [2025-10-08T20:49:23.969059] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PARR took 45.8s. Estimated remaining: 1h 43m 39s. Rate: 7.1 symbols/min [2025-10-08T20:49:24.022981] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-10-08T20:49:24.141893] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:24.142077] [DEBUG] [LOCAL ] PBA: No existing data file found in primary storage. [2025-10-08T20:49:24.142113] [WARN ] [MAIN ] PBA: No existing data found, performing full refresh instead. [2025-10-08T20:49:24.142223] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-08T20:49:24.142265] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-08T20:49:24.142304] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-08T20:49:24.142339] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-08T20:49:24.490960] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:24.817624] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-10-08T20:49:25.617584] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-08T20:49:25.753893] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T20:49:26.387964] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T20:49:26.417590] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-08T20:49:26.804772] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T20:49:27.217604] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-10-08T20:49:27.728684] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T20:49:28.017554] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-08T20:49:28.817609] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-08T20:49:28.971851] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T20:49:29.590581] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T20:49:29.617492] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-08T20:49:30.056808] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T20:49:30.417606] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-08T20:49:31.217525] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-08T20:49:31.242757] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T20:49:31.876190] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T20:49:32.017589] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-08T20:49:32.817560] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-08T20:49:32.850224] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T20:49:33.617574] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-08T20:49:33.646208] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T20:49:34.427160] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-08T20:49:34.431990] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T20:49:35.217586] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-08T20:49:35.306538] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T20:49:36.017577] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-08T20:49:36.068037] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T20:49:36.269303] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T20:49:36.817601] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-08T20:49:37.395001] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T20:49:37.617583] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-08T20:49:38.408634] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T20:49:38.417587] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-08T20:49:39.079241] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T20:49:39.217579] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-08T20:49:39.921333] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T20:49:40.017566] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-08T20:49:40.529206] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T20:49:40.817572] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-08T20:49:41.617575] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-08T20:49:41.952459] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T20:49:42.280051] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T20:49:42.417548] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-08T20:49:43.048680] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:49:43.217555] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-08T20:49:43.685377] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T20:49:44.017623] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-08T20:49:44.481173] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T20:49:44.817548] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-08T20:49:45.459777] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T20:49:45.617550] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-08T20:49:46.168041] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T20:49:46.417564] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-08T20:49:47.217539] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-08T20:49:47.274533] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T20:49:47.648205] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T20:49:48.017578] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-08T20:49:48.817596] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-08T20:49:48.962558] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T20:49:49.549777] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T20:49:49.617574] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-08T20:49:49.904767] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-08T20:49:49.909085] [INFO ] [REMOTE ] PAY: Full fetch complete (53296 records). [2025-10-08T20:49:49.909284] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-08T20:49:49.910411] [FATAL] [VALIDATOR ] PAY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:49.910528] [FATAL] [MAIN ] PAY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:49.910592] [WARN ] [MAIN ] PAY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:49.910703] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-08T20:49:49.910800] [DEBUG] [LOCAL ] PAY: No primary data file found to delete. [2025-10-08T20:49:49.910858] [INFO ] [LOCAL ] PAY: Starting deletion of derivative data. [2025-10-08T20:49:49.910926] [DEBUG] [LOCAL ] PAY: No derivative data file found to delete. [2025-10-08T20:49:49.911027] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAY took 40.2s. Estimated remaining: 1h 43m 38s. Rate: 7.1 symbols/min [2025-10-08T20:49:50.108278] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:50.108494] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-08T20:49:50.108533] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-08T20:49:50.108708] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-08T20:49:50.108781] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-08T20:49:50.108841] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-08T20:49:50.108875] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-08T20:49:50.420924] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-08T20:49:50.707730] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:50.738259] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T20:49:51.217690] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-08T20:49:51.891751] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:49:51.894998] [INFO ] [REMOTE ] PB: Full fetch complete (58703 records). [2025-10-08T20:49:51.895192] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-08T20:49:51.895963] [FATAL] [VALIDATOR ] PB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:51.896055] [FATAL] [MAIN ] PB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:51.896100] [WARN ] [MAIN ] PB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:51.896139] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-08T20:49:51.896197] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-08T20:49:51.896231] [INFO ] [LOCAL ] PB: Starting deletion of derivative data. [2025-10-08T20:49:51.896269] [DEBUG] [LOCAL ] PB: No derivative data file found to delete. [2025-10-08T20:49:51.896339] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PB took 28.8s. Estimated remaining: 1h 43m 27s. Rate: 7.1 symbols/min [2025-10-08T20:49:52.023098] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-10-08T20:49:52.088440] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:52.089074] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-08T20:49:52.089206] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-08T20:49:52.089454] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-08T20:49:52.089533] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-08T20:49:52.089641] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-08T20:49:52.089799] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-08T20:49:52.423921] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T20:49:52.518548] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:52.817572] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-08T20:49:53.129706] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:49:53.132883] [INFO ] [REMOTE ] PAYC: Full fetch complete (52748 records). [2025-10-08T20:49:53.133019] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-08T20:49:53.133753] [FATAL] [VALIDATOR ] PAYC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:53.133845] [FATAL] [MAIN ] PAYC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:53.133889] [WARN ] [MAIN ] PAYC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:53.133929] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-08T20:49:53.133992] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-08T20:49:53.134025] [INFO ] [LOCAL ] PAYC: Starting deletion of derivative data. [2025-10-08T20:49:53.134063] [DEBUG] [LOCAL ] PAYC: No derivative data file found to delete. [2025-10-08T20:49:53.134165] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PAYC took 34.3s. Estimated remaining: 1h 43m 15s. Rate: 7.1 symbols/min [2025-10-08T20:49:53.316783] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:49:53.317081] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-08T20:49:53.317122] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-08T20:49:53.317260] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-08T20:49:53.317304] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-08T20:49:53.317347] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-08T20:49:53.317381] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-08T20:49:53.622867] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-08T20:49:53.743883] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:49:53.962980] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T20:49:54.417605] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-10-08T20:49:55.217575] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-08T20:49:55.444083] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T20:49:55.587916] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T20:49:56.017570] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-08T20:49:56.817589] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-10-08T20:49:57.164374] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T20:49:57.617556] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-08T20:49:57.815441] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T20:49:58.417538] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-08T20:49:58.547191] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T20:49:58.622988] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T20:49:58.923947] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T20:49:58.927289] [INFO ] [REMOTE ] PBA: Full fetch complete (71044 records). [2025-10-08T20:49:58.927413] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-08T20:49:58.928261] [FATAL] [VALIDATOR ] PBA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:49:58.928351] [FATAL] [MAIN ] PBA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:49:58.928394] [WARN ] [MAIN ] PBA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:49:58.928433] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-08T20:49:58.928491] [DEBUG] [LOCAL ] PBA: No primary data file found to delete. [2025-10-08T20:49:58.928524] [INFO ] [LOCAL ] PBA: Starting deletion of derivative data. [2025-10-08T20:49:58.928562] [DEBUG] [LOCAL ] PBA: No derivative data file found to delete. [2025-10-08T20:49:58.928619] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 35.0s. Estimated remaining: 1h 43m 5s. Rate: 7.1 symbols/min [2025-10-08T20:49:59.217567] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-08T20:50:00.017559] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-08T20:50:00.759598] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T20:50:00.817605] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-08T20:50:01.617626] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-08T20:50:01.859598] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T20:50:02.293148] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T20:50:02.417594] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-08T20:50:03.217578] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-08T20:50:03.581958] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T20:50:04.017558] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-08T20:50:04.330627] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T20:50:04.543555] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T20:50:04.817609] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-08T20:50:05.617548] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-08T20:50:05.716386] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T20:50:06.060525] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T20:50:06.417565] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-08T20:50:07.217588] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-08T20:50:07.268596] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T20:50:07.521110] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T20:50:08.017545] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-08T20:50:08.817602] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-08T20:50:09.220078] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T20:50:09.617602] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-08T20:50:09.766702] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T20:50:09.915525] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T20:50:10.417602] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-08T20:50:11.217571] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-08T20:50:11.700671] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T20:50:11.733540] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T20:50:12.017628] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-08T20:50:12.817569] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-08T20:50:12.940563] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T20:50:13.617570] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-08T20:50:14.127405] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-08T20:50:14.417580] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-08T20:50:14.504968] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T20:50:15.217589] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-08T20:50:15.394737] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T20:50:15.980896] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T20:50:16.017516] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-08T20:50:16.817545] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-08T20:50:16.944138] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T20:50:17.617513] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-08T20:50:17.824584] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T20:50:18.097042] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:50:18.099473] [INFO ] [REMOTE ] PBH: Full fetch complete (43570 records). [2025-10-08T20:50:18.099566] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-08T20:50:18.100287] [FATAL] [VALIDATOR ] PBH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:50:18.100373] [FATAL] [MAIN ] PBH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:50:18.100416] [WARN ] [MAIN ] PBH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:50:18.100453] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-08T20:50:18.100507] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-08T20:50:18.100543] [INFO ] [LOCAL ] PBH: Starting deletion of derivative data. [2025-10-08T20:50:18.100581] [DEBUG] [LOCAL ] PBH: No derivative data file found to delete. [2025-10-08T20:50:18.100674] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 26.2s. Estimated remaining: 1h 43m 2s. Rate: 7.1 symbols/min [2025-10-08T20:50:18.417528] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-08T20:50:18.903025] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-08T20:50:19.034094] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T20:50:19.037767] [INFO ] [REMOTE ] PBF: Full fetch complete (76244 records). [2025-10-08T20:50:19.037910] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-08T20:50:19.038788] [FATAL] [VALIDATOR ] PBF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:50:19.038978] [FATAL] [MAIN ] PBF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:50:19.043325] [WARN ] [MAIN ] PBF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:50:19.043479] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-08T20:50:19.043602] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-08T20:50:19.043693] [INFO ] [LOCAL ] PBF: Starting deletion of derivative data. [2025-10-08T20:50:19.043756] [DEBUG] [LOCAL ] PBF: No derivative data file found to delete. [2025-10-08T20:50:19.043902] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBF took 29.1s. Estimated remaining: 1h 42m 50s. Rate: 7.1 symbols/min [2025-10-08T20:50:19.217710] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-08T20:50:21.003283] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T20:50:21.014957] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-08T20:50:22.997390] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T20:50:23.008184] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-08T20:50:23.778751] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T20:50:23.782097] [INFO ] [REMOTE ] PBI: Full fetch complete (71803 records). [2025-10-08T20:50:23.782238] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-08T20:50:23.783463] [FATAL] [VALIDATOR ] PBI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:50:23.783597] [FATAL] [MAIN ] PBI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:50:23.783696] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:50:23.783804] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-08T20:50:23.783915] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-08T20:50:23.783970] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-08T20:50:23.784012] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-08T20:50:23.784072] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBI took 30.6s. Estimated remaining: 1h 42m 40s. Rate: 7.1 symbols/min [2025-10-08T20:50:24.381527] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:24.462037] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:24.495486] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:24.525687] [DEBUG] [LOCAL ] PBR: No existing data file found in primary storage. [2025-10-08T20:50:24.530751] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:24.531136] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-08T20:50:24.529825] [WARN ] [MAIN ] PBR: No existing data found, performing full refresh instead. [2025-10-08T20:50:24.531234] [DEBUG] [LOCAL ] PBT: No existing data file found in primary storage. [2025-10-08T20:50:24.531637] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-08T20:50:24.531526] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-08T20:50:24.531763] [WARN ] [MAIN ] PBT: No existing data found, performing full refresh instead. [2025-10-08T20:50:24.532489] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-08T20:50:24.532348] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-08T20:50:24.532586] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-08T20:50:24.535181] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-08T20:50:24.535317] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-08T20:50:24.532696] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-08T20:50:24.535615] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-08T20:50:24.535542] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-08T20:50:24.565248] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-08T20:50:24.565359] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-08T20:50:24.607263] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-08T20:50:24.696941] [DEBUG] [LOCAL ] PCF: Loaded 8969 existing records from primary storage. [2025-10-08T20:50:24.762061] [INFO ] [MAIN ] PCF: Loaded 8969 existing records. [2025-10-08T20:50:25.678070] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:50:25.785082] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-08T20:50:25.792936] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-08T20:50:25.884985] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-08T20:50:25.892480] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:25.914342] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-08T20:50:25.938725] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:25.983595] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-10-08T20:50:25.962860] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-10-08T20:50:26.028115] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:26.068388] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-10-08T20:50:26.379067] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:26.379408] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-10-08T20:50:27.159605] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T20:50:27.164497] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-08T20:50:27.505211] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T20:50:27.509222] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-08T20:50:27.978720] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T20:50:27.992460] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T20:50:27.999495] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-08T20:50:28.004052] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-08T20:50:28.408584] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-08T20:50:28.419480] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-08T20:50:28.443412] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T20:50:28.688312] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:50:28.817598] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-08T20:50:29.617563] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-08T20:50:29.780523] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T20:50:29.820489] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T20:50:30.160592] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:50:30.417531] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-08T20:50:30.573051] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T20:50:31.217560] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-08T20:50:31.961091] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T20:50:32.017624] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-08T20:50:32.301733] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-08T20:50:32.569134] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T20:50:32.817555] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-08T20:50:33.617588] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-08T20:50:33.653680] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T20:50:34.417564] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-08T20:50:35.217714] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-08T20:50:35.267253] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T20:50:35.501437] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T20:50:36.017548] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-08T20:50:36.817578] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-08T20:50:37.231946] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-08T20:50:37.469712] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T20:50:37.617569] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-08T20:50:38.181578] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T20:50:38.365699] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T20:50:38.417555] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-08T20:50:39.217549] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-08T20:50:40.017583] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-08T20:50:40.739548] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T20:50:40.817495] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-08T20:50:41.130262] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-08T20:50:41.617606] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-08T20:50:42.041065] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T20:50:42.353170] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-08T20:50:42.417630] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-08T20:50:43.081926] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T20:50:43.217808] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-08T20:50:43.513570] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T20:50:44.014084] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T20:50:44.017579] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-08T20:50:44.817589] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-08T20:50:45.355272] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T20:50:45.389110] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:50:45.390611] [INFO ] [REMOTE ] PCF: Full fetch complete (13930 records). [2025-10-08T20:50:45.390721] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-08T20:50:45.624803] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-08T20:50:45.816443] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-08T20:50:45.816554] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-08T20:50:45.816946] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-08T20:50:45.817010] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-08T20:50:45.817843] [DEBUG] [LOCAL ] PCF: Trimmed 13930 records to 9021 (keeping 200 days of data) [2025-10-08T20:50:45.874391] [DEBUG] [LOCAL ] PCF: Primary data saved (9021 records). [2025-10-08T20:50:45.874562] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-08T20:50:45.874690] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 22.1s. Estimated remaining: 1h 42m 38s. Rate: 7.1 symbols/min [2025-10-08T20:50:46.046329] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:46.055437] [DEBUG] [LOCAL ] PCM: Loaded 6722 existing records from primary storage. [2025-10-08T20:50:46.055631] [INFO ] [MAIN ] PCM: Loaded 6722 existing records. [2025-10-08T20:50:46.232697] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:50:46.232915] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-08T20:50:46.232961] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-08T20:50:46.233191] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-08T20:50:46.233249] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-08T20:50:46.422889] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-08T20:50:46.601197] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:47.217582] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-10-08T20:50:47.894013] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T20:50:47.902782] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-08T20:50:48.017588] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-08T20:50:48.436586] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T20:50:48.817541] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-08T20:50:48.975892] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T20:50:49.617571] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-08T20:50:50.417546] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-08T20:50:50.535450] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T20:50:50.947122] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-08T20:50:51.217685] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-08T20:50:52.017580] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-08T20:50:52.547069] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T20:50:52.826316] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-08T20:50:52.847982] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-08T20:50:53.210873] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T20:50:53.212508] [INFO ] [REMOTE ] PBT: Full fetch complete (25100 records). [2025-10-08T20:50:53.212587] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-08T20:50:53.213308] [FATAL] [VALIDATOR ] PBT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:50:53.213429] [FATAL] [MAIN ] PBT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:50:53.213485] [WARN ] [MAIN ] PBT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:50:53.213570] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-08T20:50:53.213678] [DEBUG] [LOCAL ] PBT: No primary data file found to delete. [2025-10-08T20:50:53.213744] [INFO ] [LOCAL ] PBT: Starting deletion of derivative data. [2025-10-08T20:50:53.213803] [DEBUG] [LOCAL ] PBT: No derivative data file found to delete. [2025-10-08T20:50:53.213896] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PBT took 29.4s. Estimated remaining: 1h 42m 29s. Rate: 7.1 symbols/min [2025-10-08T20:50:53.407600] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:53.437153] [DEBUG] [LOCAL ] PCN: Loaded 24648 existing records from primary storage. [2025-10-08T20:50:53.437462] [INFO ] [MAIN ] PCN: Loaded 24648 existing records. [2025-10-08T20:50:53.623444] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-08T20:50:53.629403] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:50:53.630603] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-08T20:50:53.630746] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-08T20:50:53.631167] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-08T20:50:53.631336] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-08T20:50:54.047728] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:54.082684] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T20:50:54.417571] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-10-08T20:50:55.217517] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-08T20:50:55.450684] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T20:50:55.657701] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-08T20:50:55.960704] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T20:50:55.965190] [INFO ] [REMOTE ] PCG: Full fetch complete (77348 records). [2025-10-08T20:50:55.965347] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-08T20:50:55.966211] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:50:55.966320] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:50:55.966386] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:50:55.966471] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-08T20:50:55.966560] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-08T20:50:55.966618] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-10-08T20:50:55.966701] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-10-08T20:50:55.966796] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PCG took 32.2s. Estimated remaining: 1h 42m 18s. Rate: 7.1 symbols/min [2025-10-08T20:50:56.022633] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-08T20:50:56.166350] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:50:56.166581] [DEBUG] [LOCAL ] PCOR: No existing data file found in primary storage. [2025-10-08T20:50:56.166727] [WARN ] [MAIN ] PCOR: No existing data found, performing full refresh instead. [2025-10-08T20:50:56.166876] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-08T20:50:56.166951] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-08T20:50:56.167014] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-08T20:50:56.167050] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-08T20:50:56.516254] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:50:56.817600] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-08T20:50:57.617558] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-10-08T20:50:57.968405] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T20:50:58.144307] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T20:50:58.417573] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-08T20:50:59.217539] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-08T20:50:59.370602] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T20:50:59.629744] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T20:51:00.017572] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-08T20:51:00.817526] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-08T20:51:00.869064] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T20:51:01.169319] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:51:01.617543] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-08T20:51:01.685435] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T20:51:02.417608] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-08T20:51:03.216833] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T20:51:03.219180] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-08T20:51:03.248523] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T20:51:04.017554] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-08T20:51:04.578762] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T20:51:04.817515] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-08T20:51:05.372514] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-08T20:51:05.617626] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-08T20:51:05.998349] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T20:51:06.187570] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T20:51:06.417556] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-08T20:51:07.217589] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-08T20:51:08.017604] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-08T20:51:08.122232] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T20:51:08.140876] [INFO ] [REMOTE ] PBR: Full fetch complete (77385 records). [2025-10-08T20:51:08.154226] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-08T20:51:08.156192] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T20:51:08.165984] [FATAL] [VALIDATOR ] PBR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:51:08.166491] [FATAL] [MAIN ] PBR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:51:08.166933] [WARN ] [MAIN ] PBR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:51:08.167013] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-08T20:51:08.167115] [DEBUG] [LOCAL ] PBR: No primary data file found to delete. [2025-10-08T20:51:08.167174] [INFO ] [LOCAL ] PBR: Starting deletion of derivative data. [2025-10-08T20:51:08.167220] [DEBUG] [LOCAL ] PBR: No derivative data file found to delete. [2025-10-08T20:51:08.167284] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PBR took 44.4s. Estimated remaining: 1h 42m 11s. Rate: 7.1 symbols/min [2025-10-08T20:51:08.339479] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:08.354454] [DEBUG] [LOCAL ] PCQ: Loaded 12109 existing records from primary storage. [2025-10-08T20:51:08.354747] [INFO ] [MAIN ] PCQ: Loaded 12109 existing records. [2025-10-08T20:51:08.529682] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:51:08.529930] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-08T20:51:08.529977] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-08T20:51:08.530230] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-08T20:51:08.530289] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-08T20:51:08.818600] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-08T20:51:08.911321] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:09.476372] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T20:51:09.617518] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-10-08T20:51:09.810091] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T20:51:10.417585] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-08T20:51:10.823092] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:51:11.217563] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-08T20:51:12.017551] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-08T20:51:12.188203] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T20:51:12.220871] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T20:51:12.817581] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-08T20:51:12.933676] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T20:51:13.389128] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T20:51:13.617564] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-08T20:51:14.289362] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T20:51:14.417605] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-08T20:51:15.217525] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-08T20:51:15.256151] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T20:51:15.889247] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:51:15.890922] [INFO ] [REMOTE ] PCM: Full fetch complete (10417 records). [2025-10-08T20:51:15.891016] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-08T20:51:16.022685] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-08T20:51:16.285713] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-08T20:51:16.285821] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-08T20:51:16.286143] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-08T20:51:16.286201] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-08T20:51:16.286682] [DEBUG] [LOCAL ] PCM: Trimmed 10417 records to 6743 (keeping 200 days of data) [2025-10-08T20:51:16.326721] [DEBUG] [LOCAL ] PCM: Primary data saved (6743 records). [2025-10-08T20:51:16.326845] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-08T20:51:16.326926] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PCM took 30.5s. Estimated remaining: 1h 42m 2s. Rate: 7.1 symbols/min [2025-10-08T20:51:16.500850] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:16.501023] [DEBUG] [LOCAL ] PD: No existing data file found in primary storage. [2025-10-08T20:51:16.501062] [WARN ] [MAIN ] PD: No existing data found, performing full refresh instead. [2025-10-08T20:51:16.501191] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-08T20:51:16.501242] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-08T20:51:16.501294] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-08T20:51:16.501326] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-08T20:51:16.824137] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-08T20:51:16.866140] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:17.358765] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T20:51:17.617524] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-08T20:51:17.774997] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:51:18.417537] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-10-08T20:51:19.217572] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-08T20:51:19.311917] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T20:51:20.017616] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-08T20:51:20.245946] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T20:51:20.303996] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T20:51:20.817604] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-08T20:51:21.196123] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T20:51:21.617556] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-08T20:51:22.417731] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-08T20:51:22.451821] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T20:51:23.217542] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-08T20:51:23.244826] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T20:51:23.443207] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T20:51:24.017588] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-08T20:51:24.559712] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T20:51:24.817585] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-08T20:51:25.418603] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T20:51:25.617549] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-08T20:51:25.921045] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T20:51:25.923318] [INFO ] [REMOTE ] PCN: Full fetch complete (34208 records). [2025-10-08T20:51:25.923399] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-08T20:51:26.299379] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-08T20:51:26.299541] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-08T20:51:26.300268] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-08T20:51:26.300332] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-08T20:51:26.301351] [DEBUG] [LOCAL ] PCN: Trimmed 34208 records to 24722 (keeping 200 days of data) [2025-10-08T20:51:26.418556] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-08T20:51:26.481684] [DEBUG] [LOCAL ] PCN: Primary data saved (24722 records). [2025-10-08T20:51:26.481870] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-08T20:51:26.481981] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCN took 33.3s. Estimated remaining: 1h 41m 55s. Rate: 7.1 symbols/min [2025-10-08T20:51:26.663976] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:26.664182] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-08T20:51:26.664222] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-08T20:51:26.664336] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-08T20:51:26.664378] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-08T20:51:26.664420] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-08T20:51:26.664455] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-08T20:51:27.036106] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:27.084914] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:51:27.217568] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-08T20:51:27.787737] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T20:51:27.815194] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T20:51:28.017559] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-08T20:51:28.817561] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-08T20:51:29.442471] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T20:51:29.617601] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-08T20:51:29.838116] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T20:51:30.417539] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-08T20:51:31.217581] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-10-08T20:51:31.451604] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T20:51:31.539409] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-08T20:51:32.017514] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-08T20:51:32.118869] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T20:51:32.817596] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-08T20:51:33.617592] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-08T20:51:33.774567] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T20:51:33.913430] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-08T20:51:33.946602] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-08T20:51:34.417608] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-08T20:51:35.217554] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-08T20:51:35.536898] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:51:36.017586] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-08T20:51:36.636282] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T20:51:36.721416] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T20:51:36.817566] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-08T20:51:37.336903] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T20:51:37.617555] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-08T20:51:38.190142] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T20:51:38.417554] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-08T20:51:38.831040] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-08T20:51:39.217533] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-08T20:51:39.602460] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T20:51:40.017591] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-08T20:51:40.466199] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T20:51:40.817549] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-08T20:51:41.617553] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-08T20:51:42.340795] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T20:51:42.342483] [INFO ] [REMOTE ] PCQ: Full fetch complete (17210 records). [2025-10-08T20:51:42.342564] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-08T20:51:42.420299] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-08T20:51:42.747398] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T20:51:42.747615] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-08T20:51:42.758146] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-08T20:51:42.758918] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-08T20:51:42.759338] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-08T20:51:42.760671] [DEBUG] [LOCAL ] PCQ: Trimmed 17210 records to 12096 (keeping 200 days of data) [2025-10-08T20:51:42.832813] [DEBUG] [LOCAL ] PCQ: Primary data saved (12096 records). [2025-10-08T20:51:42.832959] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-08T20:51:42.833048] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCQ took 34.7s. Estimated remaining: 1h 41m 50s. Rate: 7.1 symbols/min [2025-10-08T20:51:42.908115] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-08T20:51:43.010444] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:43.061809] [DEBUG] [LOCAL ] PDI: Loaded 50078 existing records from primary storage. [2025-10-08T20:51:43.062205] [INFO ] [MAIN ] PDI: Loaded 50078 existing records. [2025-10-08T20:51:43.218344] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-08T20:51:43.243476] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:51:43.243977] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-08T20:51:43.244028] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-08T20:51:43.244371] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-08T20:51:43.244430] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-08T20:51:43.613261] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:44.017550] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-10-08T20:51:44.817540] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-08T20:51:45.171946] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T20:51:45.178529] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T20:51:45.617511] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-08T20:51:45.886356] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-08T20:51:45.887096] [INFO ] [REMOTE ] PDCC: Full fetch complete (1332 records). [2025-10-08T20:51:45.887182] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-08T20:51:45.887638] [FATAL] [VALIDATOR ] PDCC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:51:45.887755] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:51:45.887800] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:51:45.887845] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-08T20:51:45.887977] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-08T20:51:45.888065] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-08T20:51:45.888156] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-08T20:51:45.888246] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PDCC took 19.4s. Estimated remaining: 1h 41m 39s. Rate: 7.1 symbols/min [2025-10-08T20:51:46.064290] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T20:51:46.134082] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:46.134284] [DEBUG] [LOCAL ] PDM: No existing data file found in primary storage. [2025-10-08T20:51:46.134329] [WARN ] [MAIN ] PDM: No existing data found, performing full refresh instead. [2025-10-08T20:51:46.134445] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-08T20:51:46.134486] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-08T20:51:46.134527] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-08T20:51:46.134559] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-08T20:51:46.422849] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-08T20:51:46.556882] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:46.887279] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T20:51:46.891043] [INFO ] [REMOTE ] PCOR: Full fetch complete (69129 records). [2025-10-08T20:51:46.891213] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-08T20:51:46.892073] [FATAL] [VALIDATOR ] PCOR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:51:46.892171] [FATAL] [MAIN ] PCOR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:51:46.892217] [WARN ] [MAIN ] PCOR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:51:46.892260] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-08T20:51:46.892327] [DEBUG] [LOCAL ] PCOR: No primary data file found to delete. [2025-10-08T20:51:46.892365] [INFO ] [LOCAL ] PCOR: Starting deletion of derivative data. [2025-10-08T20:51:46.892407] [DEBUG] [LOCAL ] PCOR: No derivative data file found to delete. [2025-10-08T20:51:46.892475] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PCOR took 50.9s. Estimated remaining: 1h 41m 27s. Rate: 7.1 symbols/min [2025-10-08T20:51:47.080633] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:51:47.129433] [DEBUG] [LOCAL ] PDO: Loaded 31297 existing records from primary storage. [2025-10-08T20:51:47.129869] [INFO ] [MAIN ] PDO: Loaded 31297 existing records. [2025-10-08T20:51:47.222784] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-10-08T20:51:47.335886] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:51:47.336169] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-08T20:51:47.336220] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-08T20:51:47.336548] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-08T20:51:47.336608] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-08T20:51:47.791485] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:51:48.017580] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-08T20:51:48.749120] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T20:51:48.817501] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-08T20:51:49.609195] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T20:51:49.619050] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-10-08T20:51:50.214466] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T20:51:50.417559] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-08T20:51:51.222703] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-08T20:51:51.237569] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T20:51:52.017601] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-08T20:51:52.586424] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T20:51:52.817613] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-08T20:51:53.617518] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-08T20:51:53.706214] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-08T20:51:53.758260] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T20:51:54.417562] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-08T20:51:54.739133] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T20:51:55.147317] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T20:51:55.217504] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-08T20:51:55.968382] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T20:51:56.017530] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-08T20:51:56.596803] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T20:51:56.817718] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-08T20:51:57.448088] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T20:51:57.617521] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-08T20:51:58.305770] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T20:51:58.417557] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-08T20:51:59.217529] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-08T20:51:59.396290] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T20:51:59.991873] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T20:52:00.017488] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-08T20:52:00.817524] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-08T20:52:01.053125] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T20:52:01.240573] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:52:01.244054] [INFO ] [REMOTE ] PD: Full fetch complete (67598 records). [2025-10-08T20:52:01.244237] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-08T20:52:01.245039] [FATAL] [VALIDATOR ] PD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:52:01.245147] [FATAL] [MAIN ] PD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:52:01.245224] [WARN ] [MAIN ] PD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:52:01.245320] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-08T20:52:01.245407] [DEBUG] [LOCAL ] PD: No primary data file found to delete. [2025-10-08T20:52:01.245447] [INFO ] [LOCAL ] PD: Starting deletion of derivative data. [2025-10-08T20:52:01.245485] [DEBUG] [LOCAL ] PD: No derivative data file found to delete. [2025-10-08T20:52:01.245547] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PD took 44.9s. Estimated remaining: 1h 41m 21s. Rate: 7.1 symbols/min [2025-10-08T20:52:01.423484] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:01.423684] [DEBUG] [LOCAL ] PDS: No existing data file found in primary storage. [2025-10-08T20:52:01.423741] [WARN ] [MAIN ] PDS: No existing data found, performing full refresh instead. [2025-10-08T20:52:01.423887] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-08T20:52:01.423953] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-08T20:52:01.424006] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-08T20:52:01.424041] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-08T20:52:01.628351] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-08T20:52:01.680948] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T20:52:01.837097] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:02.417706] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-10-08T20:52:03.217691] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-08T20:52:03.777568] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T20:52:04.017542] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-08T20:52:04.817532] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-08T20:52:04.941003] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T20:52:05.013162] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T20:52:05.045985] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (3.42 seconds). [2025-10-08T20:52:05.617617] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-08T20:52:06.174406] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T20:52:06.376398] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T20:52:06.417522] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-08T20:52:07.217635] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-08T20:52:07.686349] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T20:52:08.017580] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-08T20:52:08.662907] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T20:52:08.817742] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-08T20:52:09.575697] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T20:52:09.617553] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-08T20:52:10.035460] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T20:52:10.417574] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-08T20:52:11.217519] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-08T20:52:11.320182] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T20:52:12.017592] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-08T20:52:12.553721] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-08T20:52:12.717728] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T20:52:12.817543] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-08T20:52:13.447322] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T20:52:13.617583] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-08T20:52:13.861165] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T20:52:14.417596] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-08T20:52:15.217538] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-08T20:52:15.499973] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-08T20:52:15.568156] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T20:52:15.993713] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T20:52:16.017517] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-08T20:52:16.817609] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-08T20:52:17.147135] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T20:52:17.617578] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-08T20:52:18.286782] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T20:52:18.417518] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-08T20:52:18.693557] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T20:52:19.217507] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-08T20:52:19.522682] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T20:52:19.525784] [INFO ] [REMOTE ] PDO: Full fetch complete (47349 records). [2025-10-08T20:52:19.525909] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-08T20:52:19.924783] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-08T20:52:19.924875] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-08T20:52:19.925692] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-08T20:52:19.925755] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-08T20:52:19.927380] [DEBUG] [LOCAL ] PDO: Trimmed 47349 records to 31294 (keeping 200 days of data) [2025-10-08T20:52:20.027691] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-08T20:52:20.134449] [DEBUG] [LOCAL ] PDO: Primary data saved (31294 records). [2025-10-08T20:52:20.134601] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-08T20:52:20.134717] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDO took 33.2s. Estimated remaining: 1h 41m 18s. Rate: 7.1 symbols/min [2025-10-08T20:52:20.301288] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:20.321945] [DEBUG] [LOCAL ] PDT: Loaded 17417 existing records from primary storage. [2025-10-08T20:52:20.322207] [INFO ] [MAIN ] PDT: Loaded 17417 existing records. [2025-10-08T20:52:20.503245] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:52:20.503475] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-08T20:52:20.503522] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-08T20:52:20.503806] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-08T20:52:20.503864] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-08T20:52:20.609426] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T20:52:20.651584] [INFO ] [REMOTE ] PDM: Full fetch complete (56975 records). [2025-10-08T20:52:20.671924] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-08T20:52:20.690195] [FATAL] [VALIDATOR ] PDM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:52:20.724251] [FATAL] [MAIN ] PDM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:52:20.768304] [WARN ] [MAIN ] PDM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:52:20.791772] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-08T20:52:20.795792] [DEBUG] [LOCAL ] PDM: No primary data file found to delete. [2025-10-08T20:52:20.796337] [INFO ] [LOCAL ] PDM: Starting deletion of derivative data. [2025-10-08T20:52:20.801771] [DEBUG] [LOCAL ] PDM: No derivative data file found to delete. [2025-10-08T20:52:20.812097] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDM took 34.9s. Estimated remaining: 1h 41m 6s. Rate: 7.1 symbols/min [2025-10-08T20:52:20.828495] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-08T20:52:20.962067] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:21.066925] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:21.067149] [DEBUG] [LOCAL ] PDX: No existing data file found in primary storage. [2025-10-08T20:52:21.067207] [WARN ] [MAIN ] PDX: No existing data found, performing full refresh instead. [2025-10-08T20:52:21.067319] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-08T20:52:21.067388] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-08T20:52:21.067450] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-08T20:52:21.067494] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-08T20:52:21.405948] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-08T20:52:21.472484] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:21.617536] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-10-08T20:52:21.950248] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:52:22.417605] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-10-08T20:52:22.896550] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T20:52:23.217512] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-08T20:52:23.611264] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T20:52:24.017568] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-08T20:52:24.817521] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-08T20:52:25.168582] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:52:25.346015] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T20:52:25.486545] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T20:52:25.617600] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-08T20:52:26.417589] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-08T20:52:26.667436] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T20:52:27.217561] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-08T20:52:28.017540] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-08T20:52:28.273994] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T20:52:28.309357] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-08T20:52:28.324182] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:52:28.325606] [INFO ] [REMOTE ] PDS: Full fetch complete (25445 records). [2025-10-08T20:52:28.325764] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-08T20:52:28.326354] [FATAL] [VALIDATOR ] PDS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:52:28.326440] [FATAL] [MAIN ] PDS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:52:28.326482] [WARN ] [MAIN ] PDS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:52:28.326521] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-08T20:52:28.326735] [DEBUG] [LOCAL ] PDS: No primary data file found to delete. [2025-10-08T20:52:28.326787] [INFO ] [LOCAL ] PDS: Starting deletion of derivative data. [2025-10-08T20:52:28.326844] [DEBUG] [LOCAL ] PDS: No derivative data file found to delete. [2025-10-08T20:52:28.326937] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDS took 27.1s. Estimated remaining: 1h 40m 57s. Rate: 7.1 symbols/min [2025-10-08T20:52:28.504900] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:28.505155] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-08T20:52:28.505225] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-08T20:52:28.505379] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-08T20:52:28.505436] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-08T20:52:28.505542] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-08T20:52:28.505592] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-08T20:52:28.825249] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-08T20:52:28.868703] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:29.617592] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-08T20:52:30.417574] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-08T20:52:30.675186] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T20:52:30.679280] [INFO ] [REMOTE ] PDI: Full fetch complete (72980 records). [2025-10-08T20:52:30.679422] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-08T20:52:30.823861] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T20:52:31.111121] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-08T20:52:31.111216] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-08T20:52:31.112213] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-08T20:52:31.112280] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-08T20:52:31.114205] [DEBUG] [LOCAL ] PDI: Trimmed 72980 records to 50091 (keeping 200 days of data) [2025-10-08T20:52:31.218727] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-08T20:52:31.440477] [DEBUG] [LOCAL ] PDI: Primary data saved (50091 records). [2025-10-08T20:52:31.440662] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-08T20:52:31.440815] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDI took 48.6s. Estimated remaining: 1h 40m 46s. Rate: 7.1 symbols/min [2025-10-08T20:52:31.567881] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T20:52:31.630025] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:31.630206] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-08T20:52:31.630242] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-08T20:52:31.630353] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-08T20:52:31.630392] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-08T20:52:31.630433] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-08T20:52:31.630463] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-08T20:52:31.982708] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:32.017560] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-10-08T20:52:32.227523] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T20:52:32.817616] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-08T20:52:33.617571] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-08T20:52:34.152001] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-08T20:52:34.173946] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T20:52:34.417527] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-08T20:52:34.451369] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T20:52:35.217557] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-10-08T20:52:35.595402] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T20:52:36.017610] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-08T20:52:36.756840] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T20:52:36.817537] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-08T20:52:36.933823] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T20:52:37.617548] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-08T20:52:38.417514] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-08T20:52:38.558229] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:52:38.648569] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T20:52:39.129416] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-08T20:52:39.217621] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-08T20:52:40.017518] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-08T20:52:40.302085] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T20:52:40.817523] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-08T20:52:41.067784] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T20:52:41.617557] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-08T20:52:42.417565] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-08T20:52:42.720028] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T20:52:42.742071] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:52:43.217590] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-08T20:52:44.017621] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-08T20:52:44.144814] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T20:52:44.817567] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-08T20:52:44.985289] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T20:52:44.987343] [INFO ] [REMOTE ] PDT: Full fetch complete (25292 records). [2025-10-08T20:52:44.987435] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-08T20:52:45.294288] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T20:52:45.395853] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-08T20:52:45.395938] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-08T20:52:45.396482] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-08T20:52:45.396520] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-08T20:52:45.397213] [DEBUG] [LOCAL ] PDT: Trimmed 25292 records to 17424 (keeping 200 days of data) [2025-10-08T20:52:45.501854] [DEBUG] [LOCAL ] PDT: Primary data saved (17424 records). [2025-10-08T20:52:45.501997] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-08T20:52:45.502093] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 25.4s. Estimated remaining: 1h 40m 40s. Rate: 7.1 symbols/min [2025-10-08T20:52:45.622665] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-08T20:52:45.678915] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:45.679086] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-08T20:52:45.679129] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-08T20:52:45.679322] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-08T20:52:45.679431] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-08T20:52:45.679498] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-08T20:52:45.679532] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-08T20:52:46.032552] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:46.417503] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-08T20:52:46.602760] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T20:52:46.642346] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T20:52:47.217544] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-08T20:52:48.017511] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-08T20:52:48.093360] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T20:52:48.817554] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-08T20:52:48.909547] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:52:48.964128] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T20:52:49.617588] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-08T20:52:50.110556] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T20:52:50.111829] [INFO ] [REMOTE ] PDX: Full fetch complete (23905 records). [2025-10-08T20:52:50.111904] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-08T20:52:50.112381] [FATAL] [VALIDATOR ] PDX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:52:50.112482] [FATAL] [MAIN ] PDX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:52:50.112603] [WARN ] [MAIN ] PDX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:52:50.112717] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-08T20:52:50.112792] [DEBUG] [LOCAL ] PDX: No primary data file found to delete. [2025-10-08T20:52:50.112828] [INFO ] [LOCAL ] PDX: Starting deletion of derivative data. [2025-10-08T20:52:50.112869] [DEBUG] [LOCAL ] PDX: No derivative data file found to delete. [2025-10-08T20:52:50.112928] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 29.3s. Estimated remaining: 1h 40m 30s. Rate: 7.1 symbols/min [2025-10-08T20:52:50.287830] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:52:50.304435] [DEBUG] [LOCAL ] PEO: Loaded 11173 existing records from primary storage. [2025-10-08T20:52:50.304732] [INFO ] [MAIN ] PEO: Loaded 11173 existing records. [2025-10-08T20:52:50.424712] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-08T20:52:50.498264] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:52:50.498859] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-08T20:52:50.499036] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-08T20:52:50.499348] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-08T20:52:50.499422] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-08T20:52:50.840377] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T20:52:50.917794] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:52:51.217627] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-08T20:52:52.015995] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T20:52:52.026048] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-10-08T20:52:52.817581] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-08T20:52:53.120936] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-08T20:52:53.343590] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T20:52:53.617597] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-08T20:52:54.417567] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-10-08T20:52:54.487035] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T20:52:55.217606] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-08T20:52:55.365753] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T20:52:55.428584] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T20:52:56.017576] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-08T20:52:56.399975] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T20:52:56.817624] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-08T20:52:57.617569] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-08T20:52:57.924885] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T20:52:57.993537] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T20:52:58.417523] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-08T20:52:58.639907] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T20:52:59.217549] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-08T20:53:00.017615] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-08T20:53:00.177061] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T20:53:00.377825] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T20:53:00.817543] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-08T20:53:01.369613] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T20:53:01.384178] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T20:53:01.617609] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-08T20:53:02.417575] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-08T20:53:03.217523] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-08T20:53:03.567148] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T20:53:03.568810] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T20:53:04.017559] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-08T20:53:04.817584] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-08T20:53:04.942488] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T20:53:05.078845] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T20:53:05.617615] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-08T20:53:06.374591] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T20:53:06.417498] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-08T20:53:07.217542] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-08T20:53:07.552337] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-08T20:53:07.675846] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T20:53:07.773386] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T20:53:08.017630] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-08T20:53:08.612294] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:53:08.615813] [INFO ] [REMOTE ] PEG: Full fetch complete (76328 records). [2025-10-08T20:53:08.615929] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-08T20:53:08.616891] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:08.617009] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:08.617074] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:08.617146] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-08T20:53:08.617212] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-08T20:53:08.617248] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-10-08T20:53:08.617288] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-10-08T20:53:08.617367] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEG took 37.2s. Estimated remaining: 1h 40m 26s. Rate: 7.1 symbols/min [2025-10-08T20:53:08.799935] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:08.800133] [DEBUG] [LOCAL ] PERF: No existing data file found in primary storage. [2025-10-08T20:53:08.800171] [WARN ] [MAIN ] PERF: No existing data found, performing full refresh instead. [2025-10-08T20:53:08.800286] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-08T20:53:08.800328] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-08T20:53:08.800370] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-08T20:53:08.800425] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-08T20:53:08.822719] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-08T20:53:09.166805] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:09.617592] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-08T20:53:09.923100] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T20:53:10.417577] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-08T20:53:10.617620] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T20:53:11.217519] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-08T20:53:11.482329] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T20:53:12.017596] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-08T20:53:12.402479] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T20:53:12.817526] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-08T20:53:12.854435] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T20:53:13.617557] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-10-08T20:53:14.176199] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T20:53:14.417576] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-08T20:53:14.841281] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T20:53:15.217723] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-08T20:53:16.017594] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-08T20:53:16.228466] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T20:53:16.337294] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T20:53:16.799360] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T20:53:16.800782] [INFO ] [REMOTE ] PEO: Full fetch complete (16272 records). [2025-10-08T20:53:16.800857] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-08T20:53:16.823588] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-08T20:53:17.186059] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-08T20:53:17.186140] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-08T20:53:17.186541] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-08T20:53:17.186607] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-08T20:53:17.187177] [DEBUG] [LOCAL ] PEO: Trimmed 16272 records to 11184 (keeping 200 days of data) [2025-10-08T20:53:17.259282] [DEBUG] [LOCAL ] PEO: Primary data saved (11184 records). [2025-10-08T20:53:17.259432] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-08T20:53:17.259520] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEO took 27.1s. Estimated remaining: 1h 40m 18s. Rate: 7.1 symbols/min [2025-10-08T20:53:17.428098] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:53:17.458881] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:17.459365] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-08T20:53:17.459109] [INFO ] [REMOTE ] PEN: Full fetch complete (43986 records). [2025-10-08T20:53:17.459635] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-08T20:53:17.459537] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-08T20:53:17.460103] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-08T20:53:17.460619] [FATAL] [VALIDATOR ] PEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:17.460936] [FATAL] [MAIN ] PEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:17.460879] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-08T20:53:17.461023] [WARN ] [MAIN ] PEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:17.461140] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-08T20:53:17.461235] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-08T20:53:17.461338] [INFO ] [LOCAL ] PEN: Starting deletion of derivative data. [2025-10-08T20:53:17.461450] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-08T20:53:17.461533] [DEBUG] [LOCAL ] PEN: No derivative data file found to delete. [2025-10-08T20:53:17.461633] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-08T20:53:17.528155] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEN took 32.0s. Estimated remaining: 1h 40m 6s. Rate: 7.1 symbols/min [2025-10-08T20:53:17.618701] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-08T20:53:17.945503] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:18.047917] [DEBUG] [LOCAL ] PFD: Loaded 5325 existing records from primary storage. [2025-10-08T20:53:18.047574] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:18.048577] [INFO ] [MAIN ] PFD: Loaded 5325 existing records. [2025-10-08T20:53:18.232341] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:53:18.232561] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-08T20:53:18.232609] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-08T20:53:18.232877] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-08T20:53:18.232935] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-08T20:53:18.425965] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-10-08T20:53:18.601590] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:18.611171] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T20:53:18.614794] [INFO ] [REMOTE ] PEB: Full fetch complete (72600 records). [2025-10-08T20:53:18.614979] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-08T20:53:18.615760] [FATAL] [VALIDATOR ] PEB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:18.615844] [FATAL] [MAIN ] PEB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:18.615908] [WARN ] [MAIN ] PEB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:18.615977] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-08T20:53:18.616040] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-08T20:53:18.616075] [INFO ] [LOCAL ] PEB: Starting deletion of derivative data. [2025-10-08T20:53:18.616112] [DEBUG] [LOCAL ] PEB: No derivative data file found to delete. [2025-10-08T20:53:18.616191] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEB took 50.3s. Estimated remaining: 1h 39m 54s. Rate: 7.1 symbols/min [2025-10-08T20:53:18.785161] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:18.785384] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-08T20:53:18.785440] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-08T20:53:18.785589] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-08T20:53:18.785637] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-08T20:53:18.785756] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-08T20:53:18.785802] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-08T20:53:18.829315] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:53:18.854128] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-10-08T20:53:18.871711] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:53:18.896855] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-08T20:53:18.899464] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:53:18.899578] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-08T20:53:18.899737] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-08T20:53:18.905545] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-08T20:53:18.910767] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-08T20:53:18.910892] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PEW took 1.7s. Estimated remaining: 1h 39m 42s. Rate: 7.1 symbols/min [2025-10-08T20:53:19.217612] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-10-08T20:53:19.288828] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:19.333025] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-08T20:53:19.341293] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-08T20:53:19.361053] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:19.361490] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-08T20:53:19.361550] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-08T20:53:19.361599] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-08T20:53:19.361631] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-08T20:53:19.726321] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:19.997555] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T20:53:20.017503] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-10-08T20:53:20.817546] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-08T20:53:21.536675] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T20:53:21.617597] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-08T20:53:22.417518] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-08T20:53:22.455458] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T20:53:22.673942] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-08T20:53:23.217506] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-10-08T20:53:23.589691] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T20:53:24.017567] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-08T20:53:24.613897] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:53:24.817517] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-08T20:53:25.107566] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:53:25.617609] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-08T20:53:26.417614] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-08T20:53:26.518939] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T20:53:26.968869] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-08T20:53:27.217565] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-08T20:53:27.324026] [DEBUG] [REMOTE ] PFD: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-08T20:53:27.324423] [WARN ] [REMOTE ] PFD: No data returned for month 2025-04 [2025-10-08T20:53:27.324541] [FATAL] [REMOTE ] PFD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:53:27.324676] [FATAL] [MAIN ] PFD: Failed to fetch primary data. [2025-10-08T20:53:27.324764] [WARN ] [MAIN ] PFD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:53:27.324855] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-08T20:53:27.324940] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-08T20:53:27.324994] [INFO ] [LOCAL ] PFD: Starting deletion of derivative data. [2025-10-08T20:53:27.325333] [DEBUG] [LOCAL ] PFD: Deleted derivative data file. [2025-10-08T20:53:27.325444] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 9.8s. Estimated remaining: 1h 39m 34s. Rate: 7.1 symbols/min [2025-10-08T20:53:27.520808] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:27.521013] [DEBUG] [LOCAL ] PFH: No existing data file found in primary storage. [2025-10-08T20:53:27.521051] [WARN ] [MAIN ] PFH: No existing data found, performing full refresh instead. [2025-10-08T20:53:27.521165] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-08T20:53:27.521206] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-08T20:53:27.521252] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-08T20:53:27.521284] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-08T20:53:27.872607] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:28.017558] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-10-08T20:53:28.817542] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-08T20:53:28.931162] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T20:53:29.157187] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.74 seconds). [2025-10-08T20:53:29.617550] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-08T20:53:30.119872] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T20:53:30.417567] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-08T20:53:31.049533] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T20:53:31.217609] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-08T20:53:31.911919] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T20:53:32.017512] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-08T20:53:32.086632] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-08T20:53:32.578306] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T20:53:32.817547] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-08T20:53:33.617570] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-08T20:53:34.402131] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T20:53:34.417483] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-08T20:53:34.619362] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T20:53:35.217571] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-08T20:53:35.887963] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T20:53:35.937440] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T20:53:36.017574] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-08T20:53:36.817571] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-08T20:53:37.549665] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T20:53:37.617547] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-08T20:53:38.417580] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-08T20:53:38.841710] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T20:53:39.217594] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-08T20:53:39.566014] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (3.55 seconds). [2025-10-08T20:53:39.594774] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T20:53:39.893193] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T20:53:40.017595] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-08T20:53:40.818079] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-08T20:53:40.820352] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T20:53:41.617578] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-08T20:53:42.417587] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-08T20:53:42.615015] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T20:53:42.802569] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T20:53:43.217507] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-08T20:53:43.524126] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T20:53:44.017550] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-08T20:53:44.817549] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-08T20:53:45.069774] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T20:53:45.363240] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T20:53:45.617619] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-08T20:53:46.417541] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-08T20:53:46.936361] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T20:53:47.217574] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-08T20:53:47.313502] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T20:53:47.645048] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:53:47.671272] [INFO ] [REMOTE ] PFH: Full fetch complete (10176 records). [2025-10-08T20:53:47.674356] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-08T20:53:47.675150] [FATAL] [VALIDATOR ] PFH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:47.675880] [FATAL] [MAIN ] PFH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:47.675978] [WARN ] [MAIN ] PFH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:47.677759] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-08T20:53:47.677583] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-08T20:53:47.689260] [DEBUG] [LOCAL ] PFH: No primary data file found to delete. [2025-10-08T20:53:47.689516] [INFO ] [LOCAL ] PFH: Starting deletion of derivative data. [2025-10-08T20:53:47.689955] [DEBUG] [LOCAL ] PFH: No derivative data file found to delete. [2025-10-08T20:53:47.690087] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PFH took 20.4s. Estimated remaining: 1h 39m 30s. Rate: 7.1 symbols/min [2025-10-08T20:53:47.864350] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:47.881117] [DEBUG] [LOCAL ] PFL: Loaded 13896 existing records from primary storage. [2025-10-08T20:53:47.881384] [INFO ] [MAIN ] PFL: Loaded 13896 existing records. [2025-10-08T20:53:48.025215] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-08T20:53:48.067776] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:53:48.068172] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-08T20:53:48.068221] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-08T20:53:48.068455] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-08T20:53:48.068512] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-08T20:53:48.437262] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:48.817614] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-08T20:53:49.617582] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-10-08T20:53:50.417586] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-08T20:53:50.551208] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T20:53:50.852949] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T20:53:51.023999] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-10-08T20:53:51.217509] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-08T20:53:51.293359] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T20:53:52.017576] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-08T20:53:52.033204] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T20:53:52.817530] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-08T20:53:52.960334] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T20:53:53.617583] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-08T20:53:54.304285] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T20:53:54.306245] [INFO ] [REMOTE ] PERF: Full fetch complete (21912 records). [2025-10-08T20:53:54.306328] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-08T20:53:54.306884] [FATAL] [VALIDATOR ] PERF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:54.306969] [FATAL] [MAIN ] PERF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:54.307200] [WARN ] [MAIN ] PERF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:54.307236] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-08T20:53:54.307308] [DEBUG] [LOCAL ] PERF: No primary data file found to delete. [2025-10-08T20:53:54.307364] [INFO ] [LOCAL ] PERF: Starting deletion of derivative data. [2025-10-08T20:53:54.307405] [DEBUG] [LOCAL ] PERF: No derivative data file found to delete. [2025-10-08T20:53:54.307516] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PERF took 45.7s. Estimated remaining: 1h 39m 21s. Rate: 7.1 symbols/min [2025-10-08T20:53:54.422698] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-08T20:53:54.515082] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:54.515265] [DEBUG] [LOCAL ] PFLT: No existing data file found in primary storage. [2025-10-08T20:53:54.515313] [WARN ] [MAIN ] PFLT: No existing data found, performing full refresh instead. [2025-10-08T20:53:54.515428] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-08T20:53:54.515471] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-08T20:53:54.515512] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-08T20:53:54.515544] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-08T20:53:55.002993] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:55.039949] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T20:53:55.217546] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-10-08T20:53:55.520069] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T20:53:56.017581] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-08T20:53:56.715095] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T20:53:56.817576] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-08T20:53:56.842953] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T20:53:57.617581] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-08T20:53:58.048494] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T20:53:58.052764] [INFO ] [REMOTE ] PFGC: Full fetch complete (67105 records). [2025-10-08T20:53:58.052996] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-08T20:53:58.053989] [FATAL] [VALIDATOR ] PFGC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:53:58.054104] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:53:58.054149] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:53:58.054194] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-08T20:53:58.054292] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-08T20:53:58.054354] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-10-08T20:53:58.054399] [DEBUG] [LOCAL ] PFGC: No derivative data file found to delete. [2025-10-08T20:53:58.054469] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFGC took 39.1s. Estimated remaining: 1h 39m 11s. Rate: 7.1 symbols/min [2025-10-08T20:53:58.233957] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:53:58.258091] [DEBUG] [LOCAL ] PFN: Loaded 22048 existing records from primary storage. [2025-10-08T20:53:58.258464] [INFO ] [MAIN ] PFN: Loaded 22048 existing records. [2025-10-08T20:53:58.422884] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-08T20:53:58.461994] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:53:58.462332] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-08T20:53:58.462382] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-08T20:53:58.462610] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-08T20:53:58.462740] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-08T20:53:58.888812] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:53:59.217572] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-08T20:53:59.576981] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-08T20:54:00.017597] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-08T20:54:00.329040] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T20:54:00.349976] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:54:00.817579] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-08T20:54:01.617563] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-10-08T20:54:02.417615] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-08T20:54:03.078460] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-08T20:54:03.127389] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T20:54:03.217527] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-08T20:54:03.894443] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.88 seconds). [2025-10-08T20:54:03.895458] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T20:54:04.017531] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-08T20:54:04.815312] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T20:54:04.824180] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-08T20:54:05.617599] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-08T20:54:05.981949] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T20:54:06.417566] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-08T20:54:06.708423] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-08T20:54:07.113322] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T20:54:07.217503] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-08T20:54:07.698055] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T20:54:08.017564] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-08T20:54:08.146274] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T20:54:08.817592] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-08T20:54:09.523536] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T20:54:09.617513] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-08T20:54:09.702620] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T20:54:10.417609] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-08T20:54:11.225029] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-08T20:54:11.246525] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T20:54:11.331362] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T20:54:12.017560] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-08T20:54:12.817583] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-08T20:54:13.607187] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T20:54:13.617503] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-08T20:54:13.755389] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T20:54:13.786605] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T20:54:14.417558] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-08T20:54:15.146793] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T20:54:15.217510] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-08T20:54:15.542113] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T20:54:16.017553] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-08T20:54:16.817529] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-08T20:54:16.864155] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T20:54:16.912892] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T20:54:16.916553] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-10-08T20:54:16.916701] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-08T20:54:16.917519] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:54:16.917626] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:54:16.917735] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:54:16.917837] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-08T20:54:16.917919] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-08T20:54:16.917955] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-10-08T20:54:16.917994] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-10-08T20:54:16.918054] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFE took 58.3s. Estimated remaining: 1h 39m 7s. Rate: 7.1 symbols/min [2025-10-08T20:54:17.083744] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:17.091972] [DEBUG] [LOCAL ] PFO: Loaded 6045 existing records from primary storage. [2025-10-08T20:54:17.092171] [INFO ] [MAIN ] PFO: Loaded 6045 existing records. [2025-10-08T20:54:17.267518] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:54:17.267809] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-08T20:54:17.267862] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-08T20:54:17.268106] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-08T20:54:17.268163] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-08T20:54:17.625761] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-08T20:54:17.648636] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:17.660588] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T20:54:18.417514] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-10-08T20:54:18.734362] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T20:54:19.217509] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-08T20:54:19.289765] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T20:54:20.017539] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-08T20:54:20.488385] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T20:54:20.715218] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T20:54:20.718507] [INFO ] [REMOTE ] PFLT: Full fetch complete (63530 records). [2025-10-08T20:54:20.718609] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-08T20:54:20.719684] [FATAL] [VALIDATOR ] PFLT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:54:20.719783] [FATAL] [MAIN ] PFLT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:54:20.719827] [WARN ] [MAIN ] PFLT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:54:20.719866] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-08T20:54:20.719923] [DEBUG] [LOCAL ] PFLT: No primary data file found to delete. [2025-10-08T20:54:20.719966] [INFO ] [LOCAL ] PFLT: Starting deletion of derivative data. [2025-10-08T20:54:20.720033] [DEBUG] [LOCAL ] PFLT: No derivative data file found to delete. [2025-10-08T20:54:20.720093] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFLT took 26.4s. Estimated remaining: 1h 38m 56s. Rate: 7.1 symbols/min [2025-10-08T20:54:20.822731] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-08T20:54:20.896198] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:20.896354] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-08T20:54:20.896389] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-08T20:54:20.896572] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-08T20:54:20.896625] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-08T20:54:20.896746] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-08T20:54:20.896802] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-08T20:54:21.243154] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:21.290484] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T20:54:21.617597] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-10-08T20:54:22.417555] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-08T20:54:22.791365] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T20:54:23.217592] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-08T20:54:23.472007] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T20:54:24.017548] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-08T20:54:24.031843] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T20:54:24.817560] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-08T20:54:24.892146] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T20:54:24.894201] [INFO ] [REMOTE ] PFL: Full fetch complete (20304 records). [2025-10-08T20:54:24.894292] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-08T20:54:25.342098] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-08T20:54:25.342190] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-08T20:54:25.342797] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-08T20:54:25.342860] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-08T20:54:25.343545] [DEBUG] [LOCAL ] PFL: Trimmed 20304 records to 13952 (keeping 200 days of data) [2025-10-08T20:54:25.443263] [DEBUG] [LOCAL ] PFL: Primary data saved (13952 records). [2025-10-08T20:54:25.443456] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-08T20:54:25.443565] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFL took 37.8s. Estimated remaining: 1h 38m 46s. Rate: 7.1 symbols/min [2025-10-08T20:54:25.622953] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-08T20:54:25.644723] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:25.644913] [DEBUG] [LOCAL ] PFSI: No existing data file found in primary storage. [2025-10-08T20:54:25.644953] [WARN ] [MAIN ] PFSI: No existing data found, performing full refresh instead. [2025-10-08T20:54:25.645096] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-08T20:54:25.645155] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-08T20:54:25.645201] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-08T20:54:25.645235] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-08T20:54:26.041730] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T20:54:26.062984] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:26.417549] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-10-08T20:54:26.885808] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T20:54:27.217592] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-08T20:54:27.631681] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:54:27.871189] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T20:54:28.017562] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-08T20:54:28.817625] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-08T20:54:29.560694] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T20:54:29.617587] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-08T20:54:30.059705] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T20:54:30.343987] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T20:54:30.417547] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-08T20:54:31.217566] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-08T20:54:31.786252] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T20:54:31.992915] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T20:54:31.996576] [INFO ] [REMOTE ] PFN: Full fetch complete (31096 records). [2025-10-08T20:54:31.996757] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-08T20:54:32.027096] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-08T20:54:32.376429] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-08T20:54:32.376508] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-08T20:54:32.377159] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-08T20:54:32.377221] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-08T20:54:32.377979] [DEBUG] [LOCAL ] PFN: Trimmed 31096 records to 22096 (keeping 200 days of data) [2025-10-08T20:54:32.524078] [DEBUG] [LOCAL ] PFN: Primary data saved (22096 records). [2025-10-08T20:54:32.524280] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-08T20:54:32.524390] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFN took 34.5s. Estimated remaining: 1h 38m 37s. Rate: 7.1 symbols/min [2025-10-08T20:54:32.692481] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:32.692665] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-08T20:54:32.692725] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-08T20:54:32.692849] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-08T20:54:32.692889] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-08T20:54:32.692930] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-08T20:54:32.692982] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-08T20:54:32.830497] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-08T20:54:33.050467] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:33.411882] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T20:54:33.617636] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-08T20:54:34.417595] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-10-08T20:54:35.119797] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-08T20:54:35.217526] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-08T20:54:35.247499] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T20:54:36.017561] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-08T20:54:36.584843] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-08T20:54:36.817579] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-08T20:54:36.970006] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T20:54:37.255929] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T20:54:37.617571] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-08T20:54:38.417623] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-08T20:54:38.676427] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T20:54:38.952205] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T20:54:38.954577] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-08T20:54:39.217581] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-08T20:54:40.017586] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-08T20:54:40.403521] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T20:54:40.579856] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T20:54:40.817538] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-08T20:54:41.617581] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-08T20:54:42.350723] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T20:54:42.417619] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-08T20:54:42.722246] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T20:54:43.201166] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T20:54:43.217537] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-08T20:54:44.017608] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-08T20:54:44.107971] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T20:54:44.817549] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-08T20:54:45.474805] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T20:54:45.617565] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-08T20:54:46.417560] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-08T20:54:47.024888] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:54:47.026048] [INFO ] [REMOTE ] PFO: Full fetch complete (7869 records). [2025-10-08T20:54:47.026203] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-08T20:54:47.181892] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-08T20:54:47.229678] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-08T20:54:47.470569] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-08T20:54:47.470724] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-08T20:54:47.471086] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-08T20:54:47.471166] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-08T20:54:47.471962] [DEBUG] [LOCAL ] PFO: Trimmed 7869 records to 6048 (keeping 200 days of data) [2025-10-08T20:54:47.500850] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-08T20:54:47.547006] [DEBUG] [LOCAL ] PFO: Primary data saved (6048 records). [2025-10-08T20:54:47.547156] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-08T20:54:47.547260] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFO took 30.6s. Estimated remaining: 1h 38m 32s. Rate: 7.1 symbols/min [2025-10-08T20:54:47.713626] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:47.722362] [DEBUG] [LOCAL ] PGP: Loaded 5630 existing records from primary storage. [2025-10-08T20:54:47.722601] [INFO ] [MAIN ] PGP: Loaded 5630 existing records. [2025-10-08T20:54:47.896038] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:54:47.896256] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-08T20:54:47.896304] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-08T20:54:47.896536] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-08T20:54:47.896594] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-08T20:54:48.032103] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-08T20:54:48.260236] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:48.275411] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T20:54:48.817548] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-10-08T20:54:49.530593] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T20:54:49.617600] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-08T20:54:50.328521] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T20:54:50.417525] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-08T20:54:50.484948] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-08T20:54:51.217563] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-08T20:54:51.976554] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T20:54:52.017504] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-08T20:54:52.817580] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-08T20:54:53.351049] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T20:54:53.364426] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T20:54:53.617522] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-08T20:54:53.658814] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-08T20:54:54.417555] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-08T20:54:55.096038] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T20:54:55.217547] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-08T20:54:55.886001] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T20:54:55.948841] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T20:54:56.017519] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-08T20:54:56.511719] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T20:54:56.514034] [INFO ] [REMOTE ] PFSI: Full fetch complete (41129 records). [2025-10-08T20:54:56.514136] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-08T20:54:56.514671] [FATAL] [VALIDATOR ] PFSI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:54:56.514755] [FATAL] [MAIN ] PFSI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:54:56.514798] [WARN ] [MAIN ] PFSI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:54:56.514836] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-08T20:54:56.514892] [DEBUG] [LOCAL ] PFSI: No primary data file found to delete. [2025-10-08T20:54:56.514926] [INFO ] [LOCAL ] PFSI: Starting deletion of derivative data. [2025-10-08T20:54:56.514971] [DEBUG] [LOCAL ] PFSI: No derivative data file found to delete. [2025-10-08T20:54:56.515027] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFSI took 31.1s. Estimated remaining: 1h 38m 24s. Rate: 7.1 symbols/min [2025-10-08T20:54:56.694285] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:54:56.694552] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-08T20:54:56.694633] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-08T20:54:56.694799] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-08T20:54:56.694859] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-08T20:54:56.694942] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-08T20:54:56.694999] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-08T20:54:56.822678] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-08T20:54:57.070889] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:54:57.617533] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-08T20:54:57.654787] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T20:54:58.417622] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-08T20:54:59.091573] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T20:54:59.217544] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-08T20:54:59.549904] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T20:54:59.946558] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T20:55:00.017558] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-08T20:55:00.730723] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T20:55:00.817517] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-08T20:55:01.617589] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-08T20:55:02.417616] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-08T20:55:03.156560] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T20:55:03.159963] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T20:55:03.217569] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-08T20:55:03.405513] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-08T20:55:03.779084] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T20:55:04.017562] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-10-08T20:55:04.817565] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-08T20:55:05.414975] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:55:05.417839] [INFO ] [REMOTE ] PFS: Full fetch complete (51519 records). [2025-10-08T20:55:05.417921] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-08T20:55:05.418517] [FATAL] [VALIDATOR ] PFS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:55:05.418606] [FATAL] [MAIN ] PFS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:55:05.418679] [WARN ] [MAIN ] PFS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:55:05.418736] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-08T20:55:05.418812] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-08T20:55:05.418849] [INFO ] [LOCAL ] PFS: Starting deletion of derivative data. [2025-10-08T20:55:05.418888] [DEBUG] [LOCAL ] PFS: No derivative data file found to delete. [2025-10-08T20:55:05.418942] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PFS took 44.7s. Estimated remaining: 1h 38m 15s. Rate: 7.1 symbols/min [2025-10-08T20:55:05.594638] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:55:05.594928] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-08T20:55:05.595052] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-08T20:55:05.595352] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-08T20:55:05.595421] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-08T20:55:05.595638] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-08T20:55:05.595782] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-08T20:55:05.632052] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-08T20:55:05.982203] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T20:55:06.016413] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:55:06.306812] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:55:06.307931] [INFO ] [REMOTE ] PGP: Full fetch complete (7947 records). [2025-10-08T20:55:06.308015] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-08T20:55:06.422688] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-08T20:55:06.671796] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-08T20:55:06.671896] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-08T20:55:06.672136] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-08T20:55:06.672197] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-08T20:55:06.672596] [DEBUG] [LOCAL ] PGP: Trimmed 7947 records to 5659 (keeping 200 days of data) [2025-10-08T20:55:06.705579] [DEBUG] [LOCAL ] PGP: Primary data saved (5659 records). [2025-10-08T20:55:06.705688] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-08T20:55:06.705788] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PGP took 19.2s. Estimated remaining: 1h 38m 4s. Rate: 7.1 symbols/min [2025-10-08T20:55:06.871444] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:55:06.879466] [DEBUG] [LOCAL ] PGZ: Loaded 5481 existing records from primary storage. [2025-10-08T20:55:06.879674] [INFO ] [MAIN ] PGZ: Loaded 5481 existing records. [2025-10-08T20:55:07.053506] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:55:07.053800] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-08T20:55:07.053857] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-08T20:55:07.054239] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-08T20:55:07.054295] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-08T20:55:07.223054] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-08T20:55:07.417453] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:55:08.017517] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-10-08T20:55:08.819169] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-10-08T20:55:08.841213] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T20:55:08.846436] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-08T20:55:09.297780] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-08T20:55:09.617558] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-08T20:55:10.365263] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-08T20:55:10.417509] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-08T20:55:11.217563] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-08T20:55:11.964939] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-08T20:55:11.998958] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T20:55:12.017491] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-08T20:55:12.192950] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:55:12.817537] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-08T20:55:13.562191] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T20:55:13.617506] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-08T20:55:14.417578] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-08T20:55:14.766840] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T20:55:15.136188] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T20:55:15.217502] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-08T20:55:15.263910] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T20:55:16.017600] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-08T20:55:16.619171] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:55:16.622910] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-10-08T20:55:16.623078] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-08T20:55:16.624098] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:55:16.624226] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:55:16.624268] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:55:16.624317] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-08T20:55:16.624435] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-08T20:55:16.624490] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-10-08T20:55:16.624532] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-10-08T20:55:16.624591] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 44.1s. Estimated remaining: 1h 37m 56s. Rate: 7.1 symbols/min [2025-10-08T20:55:16.804660] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:55:16.804882] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-08T20:55:16.804937] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-08T20:55:16.805050] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-08T20:55:16.805093] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-08T20:55:16.805136] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-08T20:55:16.805168] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-08T20:55:16.826152] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-08T20:55:17.192917] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T20:55:17.246952] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:55:17.617555] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-10-08T20:55:18.417508] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-08T20:55:18.969327] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T20:55:19.220614] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-08T20:55:19.226076] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:55:19.732119] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T20:55:20.017553] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-08T20:55:20.817596] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-08T20:55:21.458811] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T20:55:21.617632] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-08T20:55:21.745799] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T20:55:22.077201] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T20:55:22.417589] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-08T20:55:23.217583] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-08T20:55:23.573106] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T20:55:23.927887] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T20:55:23.944243] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T20:55:24.017603] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-08T20:55:24.817602] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-08T20:55:25.620973] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-08T20:55:25.625503] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T20:55:26.294842] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T20:55:26.417518] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-08T20:55:26.779887] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T20:55:27.217586] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-08T20:55:28.017577] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-08T20:55:28.299466] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T20:55:28.762917] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T20:55:28.817500] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-08T20:55:29.039764] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T20:55:29.592586] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T20:55:29.617504] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-08T20:55:30.417561] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-08T20:55:30.504853] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T20:55:31.217627] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-08T20:55:31.974045] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T20:55:32.017528] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-08T20:55:32.452233] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T20:55:32.699178] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T20:55:32.817565] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-08T20:55:33.617604] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-08T20:55:34.249114] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T20:55:34.250286] [INFO ] [REMOTE ] PGZ: Full fetch complete (8879 records). [2025-10-08T20:55:34.250358] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-08T20:55:34.427183] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-08T20:55:34.686615] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-08T20:55:34.686734] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-08T20:55:34.686972] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-08T20:55:34.687040] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-08T20:55:34.687701] [DEBUG] [LOCAL ] PGZ: Trimmed 8879 records to 5471 (keeping 200 days of data) [2025-10-08T20:55:34.720528] [DEBUG] [LOCAL ] PGZ: Primary data saved (5471 records). [2025-10-08T20:55:34.720623] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-08T20:55:34.720766] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGZ took 28.0s. Estimated remaining: 1h 37m 52s. Rate: 7.1 symbols/min [2025-10-08T20:55:34.904586] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:55:34.933067] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T20:55:34.949964] [DEBUG] [LOCAL ] PHD: Loaded 10759 existing records from primary storage. [2025-10-08T20:55:34.950227] [INFO ] [MAIN ] PHD: Loaded 10759 existing records. [2025-10-08T20:55:35.137243] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:55:35.137464] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-10-08T20:55:35.137512] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-10-08T20:55:35.137765] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-10-08T20:55:35.137825] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-10-08T20:55:35.222703] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-08T20:55:35.498764] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:55:36.017572] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-08T20:55:36.582331] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T20:55:36.817523] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-10-08T20:55:36.938105] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T20:55:37.362802] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T20:55:37.379269] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T20:55:37.617570] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-10-08T20:55:38.376730] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T20:55:38.417543] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-10-08T20:55:39.186450] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T20:55:39.217502] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-10-08T20:55:39.991625] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T20:55:40.017524] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-08T20:55:40.817569] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-10-08T20:55:41.617523] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-08T20:55:41.774993] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T20:55:41.819086] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T20:55:42.417579] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-08T20:55:43.088610] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:55:43.091861] [INFO ] [REMOTE ] PGRE: Full fetch complete (63840 records). [2025-10-08T20:55:43.091968] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-08T20:55:43.092706] [FATAL] [VALIDATOR ] PGRE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:55:43.092796] [FATAL] [MAIN ] PGRE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:55:43.092839] [WARN ] [MAIN ] PGRE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:55:43.092902] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-08T20:55:43.092967] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-08T20:55:43.093003] [INFO ] [LOCAL ] PGRE: Starting deletion of derivative data. [2025-10-08T20:55:43.093041] [DEBUG] [LOCAL ] PGRE: No derivative data file found to delete. [2025-10-08T20:55:43.093269] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGRE took 37.7s. Estimated remaining: 1h 37m 43s. Rate: 7.1 symbols/min [2025-10-08T20:55:43.221755] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-10-08T20:55:43.277000] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:55:43.277638] [DEBUG] [LOCAL ] PHG: No existing data file found in primary storage. [2025-10-08T20:55:43.277788] [WARN ] [MAIN ] PHG: No existing data found, performing full refresh instead. [2025-10-08T20:55:43.277964] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-08T20:55:43.278080] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-08T20:55:43.278212] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-08T20:55:43.278262] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-08T20:55:43.442821] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T20:55:43.666704] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:55:44.017591] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-08T20:55:44.424414] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T20:55:44.817529] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-10-08T20:55:44.881310] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T20:55:44.884790] [INFO ] [REMOTE ] PGR: Full fetch complete (76143 records). [2025-10-08T20:55:44.884911] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-08T20:55:44.886950] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:55:44.887070] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:55:44.887145] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:55:44.887217] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-08T20:55:44.887296] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-08T20:55:44.887352] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-10-08T20:55:44.887396] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-10-08T20:55:44.887468] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGR took 48.4s. Estimated remaining: 1h 37m 32s. Rate: 7.1 symbols/min [2025-10-08T20:55:45.617578] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-08T20:55:45.655869] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T20:55:46.417583] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-10-08T20:55:47.217574] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-10-08T20:55:47.252426] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T20:55:48.017509] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-08T20:55:48.072748] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T20:55:48.177493] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T20:55:48.817555] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-10-08T20:55:49.461606] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T20:55:49.617557] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-08T20:55:49.635002] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T20:55:50.417607] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-10-08T20:55:51.108109] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T20:55:51.217554] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-08T20:55:51.536762] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-08T20:55:51.941073] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T20:55:51.943266] [INFO ] [REMOTE ] PH: Full fetch complete (55676 records). [2025-10-08T20:55:51.943386] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-08T20:55:51.944132] [FATAL] [VALIDATOR ] PH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:55:51.944227] [FATAL] [MAIN ] PH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:55:51.944268] [WARN ] [MAIN ] PH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:55:51.944307] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-08T20:55:51.944363] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-08T20:55:51.944397] [INFO ] [LOCAL ] PH: Starting deletion of derivative data. [2025-10-08T20:55:51.944439] [DEBUG] [LOCAL ] PH: No derivative data file found to delete. [2025-10-08T20:55:51.944497] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PH took 35.3s. Estimated remaining: 1h 37m 23s. Rate: 7.1 symbols/min [2025-10-08T20:55:52.017635] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-08T20:55:52.817607] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-10. [2025-10-08T20:55:53.804726] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T20:55:53.806388] [INFO ] [REMOTE ] PHD: Full fetch complete (14977 records). [2025-10-08T20:55:53.806479] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-10-08T20:55:54.221933] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-10-08T20:55:54.210959] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-08T20:55:54.222093] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-10-08T20:55:54.230828] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-10-08T20:55:54.231405] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-10-08T20:55:54.231945] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-08T20:55:54.233479] [DEBUG] [LOCAL ] PHD: Trimmed 14977 records to 10753 (keeping 200 days of data) [2025-10-08T20:55:54.319556] [DEBUG] [LOCAL ] PHD: Primary data saved (10753 records). [2025-10-08T20:55:54.319747] [INFO ] [MAIN ] PHD: Full history saved. [2025-10-08T20:55:54.319848] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PHD took 19.6s. Estimated remaining: 1h 37m 12s. Rate: 7.1 symbols/min [2025-10-08T20:55:55.922862] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T20:55:55.931797] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-08T20:55:57.668131] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T20:55:57.677887] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-08T20:55:59.535608] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T20:55:59.545615] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-08T20:56:01.514400] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T20:56:01.525085] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-08T20:56:03.311349] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T20:56:03.320955] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-08T20:56:05.471375] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T20:56:05.482552] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-08T20:56:07.280889] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-08T20:56:07.292079] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-08T20:56:08.974086] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T20:56:08.983909] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-08T20:56:09.468823] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:56:09.471713] [INFO ] [REMOTE ] PHG: Full fetch complete (65298 records). [2025-10-08T20:56:09.471836] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-08T20:56:09.472598] [FATAL] [VALIDATOR ] PHG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:56:09.472774] [FATAL] [MAIN ] PHG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:56:09.472846] [WARN ] [MAIN ] PHG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:56:09.472921] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-08T20:56:09.472986] [DEBUG] [LOCAL ] PHG: No primary data file found to delete. [2025-10-08T20:56:09.473023] [INFO ] [LOCAL ] PHG: Starting deletion of derivative data. [2025-10-08T20:56:09.473065] [DEBUG] [LOCAL ] PHG: No derivative data file found to delete. [2025-10-08T20:56:09.473146] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHG took 26.4s. Estimated remaining: 1h 37m 6s. Rate: 7.1 symbols/min [2025-10-08T20:56:10.091703] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:10.196503] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:10.192613] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:10.197629] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-08T20:56:10.213724] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-08T20:56:10.215213] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:10.193140] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-08T20:56:10.216080] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-08T20:56:10.216197] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-08T20:56:10.215955] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-10-08T20:56:10.215906] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-08T20:56:10.216370] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-10-08T20:56:10.216633] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-08T20:56:10.216764] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-08T20:56:10.216843] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-08T20:56:10.217073] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-08T20:56:10.222529] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-08T20:56:10.222933] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-08T20:56:10.229229] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-08T20:56:10.260031] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-08T20:56:10.284125] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-08T20:56:10.331727] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-08T20:56:10.529813] [DEBUG] [LOCAL ] PHK: Loaded 26549 existing records from primary storage. [2025-10-08T20:56:10.631552] [INFO ] [MAIN ] PHK: Loaded 26549 existing records. [2025-10-08T20:56:11.535495] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:11.514892] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:56:11.541074] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-10-08T20:56:11.561348] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-08T20:56:11.561673] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-08T20:56:11.556129] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:11.581556] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-08T20:56:11.581804] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-08T20:56:11.576351] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-10-08T20:56:11.633539] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:11.714711] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-10-08T20:56:11.980572] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:11.980961] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-10-08T20:56:12.750233] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T20:56:12.754984] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-08T20:56:13.267084] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T20:56:13.275074] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-08T20:56:13.353978] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T20:56:13.359979] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-08T20:56:13.386464] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T20:56:13.389512] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-08T20:56:13.635494] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T20:56:13.647023] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-08T20:56:14.351476] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T20:56:14.354482] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-08T20:56:14.373333] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T20:56:14.380606] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-08T20:56:14.410735] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T20:56:14.418551] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-08T20:56:15.419782] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T20:56:15.424639] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-08T20:56:15.546133] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T20:56:15.560162] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-08T20:56:15.656553] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T20:56:15.662974] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-08T20:56:15.972044] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T20:56:15.980422] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-08T20:56:16.334958] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T20:56:16.339559] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-08T20:56:16.653113] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T20:56:16.659697] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-08T20:56:17.356116] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T20:56:17.366274] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-08T20:56:17.380952] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T20:56:17.384530] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-08T20:56:17.458460] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T20:56:17.467020] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-08T20:56:17.848466] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T20:56:17.855310] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-08T20:56:18.006568] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-08T20:56:18.417555] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-08T20:56:19.091986] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T20:56:19.148423] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T20:56:19.217500] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-08T20:56:19.270753] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T20:56:19.291165] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T20:56:20.017545] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-08T20:56:20.309402] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T20:56:20.817551] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-08T20:56:21.032452] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T20:56:21.617552] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-08T20:56:22.417531] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-08T20:56:22.819712] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T20:56:22.872850] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T20:56:23.217512] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-08T20:56:23.603454] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T20:56:24.017553] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-08T20:56:24.761597] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T20:56:24.817498] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-08T20:56:25.591473] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T20:56:25.617502] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-08T20:56:25.775690] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T20:56:26.417568] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-08T20:56:27.217595] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-08T20:56:27.360008] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T20:56:27.546557] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T20:56:28.017531] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-08T20:56:28.465759] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:56:28.467829] [INFO ] [REMOTE ] PHI: Full fetch complete (20864 records). [2025-10-08T20:56:28.467956] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-08T20:56:28.468622] [FATAL] [VALIDATOR ] PHI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:56:28.486074] [FATAL] [MAIN ] PHI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:56:28.486197] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:56:28.486279] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-08T20:56:28.486569] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-10-08T20:56:28.487540] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T20:56:28.486984] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-10-08T20:56:28.494932] [DEBUG] [LOCAL ] PHI: No derivative data file found to delete. [2025-10-08T20:56:28.495456] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHI took 19.0s. Estimated remaining: 1h 37m 2s. Rate: 7.1 symbols/min [2025-10-08T20:56:28.671346] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:28.671543] [DEBUG] [LOCAL ] PHR: No existing data file found in primary storage. [2025-10-08T20:56:28.671580] [WARN ] [MAIN ] PHR: No existing data found, performing full refresh instead. [2025-10-08T20:56:28.671718] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-08T20:56:28.671766] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-08T20:56:28.671807] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-08T20:56:28.671838] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-08T20:56:28.826138] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-08T20:56:29.040098] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:29.617614] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-08T20:56:30.333348] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T20:56:30.417569] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-08T20:56:31.217525] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-10-08T20:56:31.295884] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T20:56:31.347745] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T20:56:31.350899] [INFO ] [REMOTE ] PHK: Full fetch complete (39481 records). [2025-10-08T20:56:31.351011] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-08T20:56:31.788332] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-08T20:56:31.788418] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-08T20:56:31.789561] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-08T20:56:31.789627] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-08T20:56:31.790594] [DEBUG] [LOCAL ] PHK: Trimmed 39481 records to 26593 (keeping 200 days of data) [2025-10-08T20:56:31.972855] [DEBUG] [LOCAL ] PHK: Primary data saved (26593 records). [2025-10-08T20:56:31.973073] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-08T20:56:31.973221] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHK took 22.5s. Estimated remaining: 1h 36m 52s. Rate: 7.1 symbols/min [2025-10-08T20:56:32.025569] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-08T20:56:32.173687] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:32.173893] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-08T20:56:32.173930] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-08T20:56:32.174041] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-08T20:56:32.174082] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-08T20:56:32.174122] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-08T20:56:32.174153] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-08T20:56:32.531506] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:32.821782] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-10-08T20:56:32.826798] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T20:56:33.466014] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T20:56:33.617585] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-08T20:56:34.251186] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T20:56:34.417594] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-08T20:56:35.217600] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-08T20:56:35.567774] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T20:56:35.889539] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T20:56:36.017584] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-08T20:56:36.502529] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T20:56:36.505437] [INFO ] [REMOTE ] PHIN: Full fetch complete (47656 records). [2025-10-08T20:56:36.505545] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-08T20:56:36.507299] [FATAL] [VALIDATOR ] PHIN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:56:36.507504] [FATAL] [MAIN ] PHIN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:56:36.507575] [WARN ] [MAIN ] PHIN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:56:36.507680] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-08T20:56:36.507767] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-08T20:56:36.507805] [INFO ] [LOCAL ] PHIN: Starting deletion of derivative data. [2025-10-08T20:56:36.507845] [DEBUG] [LOCAL ] PHIN: No derivative data file found to delete. [2025-10-08T20:56:36.507915] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHIN took 27.0s. Estimated remaining: 1h 36m 42s. Rate: 7.1 symbols/min [2025-10-08T20:56:36.699121] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:36.705535] [DEBUG] [LOCAL ] PIM: Loaded 4797 existing records from primary storage. [2025-10-08T20:56:36.705764] [INFO ] [MAIN ] PIM: Loaded 4797 existing records. [2025-10-08T20:56:36.817600] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-08T20:56:36.922829] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:56:36.923210] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-08T20:56:36.923333] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-08T20:56:36.923752] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-08T20:56:36.923834] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-08T20:56:37.100536] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T20:56:37.372424] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:37.617561] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-08T20:56:38.417792] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-10-08T20:56:38.423939] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T20:56:39.180182] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T20:56:39.217547] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-08T20:56:39.426189] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T20:56:39.645406] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T20:56:40.017569] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-08T20:56:40.626055] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T20:56:40.817530] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-08T20:56:41.617515] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-08T20:56:41.630568] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T20:56:42.294537] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T20:56:42.297982] [INFO ] [REMOTE ] PHM: Full fetch complete (74543 records). [2025-10-08T20:56:42.298130] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-08T20:56:42.299075] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:56:42.299212] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:56:42.299255] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:56:42.299348] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-08T20:56:42.299431] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-08T20:56:42.299467] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-10-08T20:56:42.299506] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-10-08T20:56:42.299565] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHM took 32.8s. Estimated remaining: 1h 36m 32s. Rate: 7.1 symbols/min [2025-10-08T20:56:42.422670] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-08T20:56:42.472017] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:42.472357] [DEBUG] [LOCAL ] PINE: No existing data file found in primary storage. [2025-10-08T20:56:42.473028] [WARN ] [MAIN ] PINE: No existing data found, performing full refresh instead. [2025-10-08T20:56:42.473141] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-08T20:56:42.473183] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-08T20:56:42.473224] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-08T20:56:42.473260] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-08T20:56:42.820700] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:43.217573] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-10-08T20:56:43.957338] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T20:56:44.017518] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-08T20:56:44.257739] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T20:56:44.817552] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-08T20:56:45.409144] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T20:56:45.470420] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T20:56:45.617575] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-08T20:56:46.409552] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T20:56:46.417498] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-08T20:56:47.061019] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T20:56:47.217571] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-08T20:56:47.909174] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T20:56:48.017574] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-08T20:56:48.817570] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-08T20:56:49.098261] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T20:56:49.266396] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T20:56:49.617532] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-08T20:56:50.417529] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-08T20:56:50.477348] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T20:56:51.217548] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-08T20:56:51.849522] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T20:56:52.017572] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-08T20:56:52.817637] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-08T20:56:53.134003] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T20:56:53.626010] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-08T20:56:53.629533] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T20:56:53.813044] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T20:56:54.219936] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:56:54.220830] [INFO ] [REMOTE ] PIM: Full fetch complete (6488 records). [2025-10-08T20:56:54.220901] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-08T20:56:54.424626] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-08T20:56:54.589314] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-08T20:56:54.589396] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-08T20:56:54.589578] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-08T20:56:54.589616] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-08T20:56:54.590048] [DEBUG] [LOCAL ] PIM: Trimmed 6488 records to 4802 (keeping 200 days of data) [2025-10-08T20:56:54.623983] [DEBUG] [LOCAL ] PIM: Primary data saved (4802 records). [2025-10-08T20:56:54.624140] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-08T20:56:54.624276] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PIM took 18.1s. Estimated remaining: 1h 36m 26s. Rate: 7.1 symbols/min [2025-10-08T20:56:54.793638] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:56:54.793842] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-08T20:56:54.793879] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-08T20:56:54.794015] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-08T20:56:54.794056] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-08T20:56:54.794137] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-08T20:56:54.794190] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-08T20:56:55.188725] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:56:55.217498] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-10-08T20:56:56.017617] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-08T20:56:56.580584] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T20:56:56.817528] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-08T20:56:57.417741] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T20:56:57.617572] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-08T20:56:58.107725] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-10-08T20:56:58.417500] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-08T20:56:58.701100] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-08T20:56:58.916577] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T20:56:59.217562] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-08T20:57:00.017563] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-08T20:57:00.157409] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:57:00.717738] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T20:57:00.817510] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-08T20:57:00.891230] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T20:57:01.617574] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-08T20:57:02.410116] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T20:57:02.417499] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-08T20:57:02.712744] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T20:57:03.217569] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-08T20:57:03.530568] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T20:57:04.017601] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-08T20:57:04.817536] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-08T20:57:04.976980] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T20:57:05.417660] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T20:57:05.617521] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-08T20:57:06.426828] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-08T20:57:06.433129] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T20:57:06.545767] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T20:57:07.217598] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-08T20:57:08.017590] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-08T20:57:08.645429] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-08T20:57:08.822673] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-08T20:57:08.836207] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T20:57:09.617520] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-08T20:57:09.641001] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T20:57:10.019806] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T20:57:10.417546] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-08T20:57:10.863338] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T20:57:10.864876] [INFO ] [REMOTE ] PINE: Full fetch complete (21019 records). [2025-10-08T20:57:10.864949] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-08T20:57:10.865452] [FATAL] [VALIDATOR ] PINE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:10.865537] [FATAL] [MAIN ] PINE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:10.865597] [WARN ] [MAIN ] PINE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:10.865707] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-08T20:57:10.865789] [DEBUG] [LOCAL ] PINE: No primary data file found to delete. [2025-10-08T20:57:10.865858] [INFO ] [LOCAL ] PINE: Starting deletion of derivative data. [2025-10-08T20:57:10.865924] [DEBUG] [LOCAL ] PINE: No derivative data file found to delete. [2025-10-08T20:57:10.865999] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PINE took 28.6s. Estimated remaining: 1h 36m 20s. Rate: 7.1 symbols/min [2025-10-08T20:57:11.053701] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:11.053898] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-08T20:57:11.053936] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-08T20:57:11.054050] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-08T20:57:11.054091] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-08T20:57:11.054133] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-08T20:57:11.054165] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-08T20:57:11.223338] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-08T20:57:11.419220] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:11.796905] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T20:57:12.017568] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-08T20:57:12.817589] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-08T20:57:13.141288] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T20:57:13.617632] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-08T20:57:14.019077] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-08T20:57:14.251103] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T20:57:14.417631] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-08T20:57:15.217564] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-10-08T20:57:15.360106] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T20:57:15.959046] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T20:57:16.017576] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-08T20:57:16.606080] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-08T20:57:16.773980] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T20:57:16.817604] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-08T20:57:17.617555] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-08T20:57:18.417534] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-08T20:57:18.651225] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T20:57:18.678138] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T20:57:19.217550] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-08T20:57:20.017552] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-08T20:57:20.167886] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T20:57:20.563416] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T20:57:20.683355] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:57:20.687243] [INFO ] [REMOTE ] PII: Full fetch complete (70877 records). [2025-10-08T20:57:20.687395] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-08T20:57:20.688280] [FATAL] [VALIDATOR ] PII: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:20.688374] [FATAL] [MAIN ] PII: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:20.688461] [WARN ] [MAIN ] PII: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:20.688545] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-08T20:57:20.688621] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-08T20:57:20.688700] [INFO ] [LOCAL ] PII: Starting deletion of derivative data. [2025-10-08T20:57:20.688761] [DEBUG] [LOCAL ] PII: No derivative data file found to delete. [2025-10-08T20:57:20.688829] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PII took 48.7s. Estimated remaining: 1h 36m 12s. Rate: 7.1 symbols/min [2025-10-08T20:57:20.822665] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-08T20:57:20.871898] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:20.872079] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-08T20:57:20.872196] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-08T20:57:20.872323] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-08T20:57:20.872366] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-08T20:57:20.872407] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-08T20:57:20.872570] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-08T20:57:21.279604] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:21.617566] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-10-08T20:57:21.953334] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T20:57:22.417588] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-08T20:57:22.915823] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T20:57:23.217575] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-08T20:57:23.843222] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T20:57:23.846533] [INFO ] [REMOTE ] PHR: Full fetch complete (52464 records). [2025-10-08T20:57:23.846634] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-08T20:57:23.847313] [FATAL] [VALIDATOR ] PHR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:23.847406] [FATAL] [MAIN ] PHR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:23.847451] [WARN ] [MAIN ] PHR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:23.847493] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-08T20:57:23.847559] [DEBUG] [LOCAL ] PHR: No primary data file found to delete. [2025-10-08T20:57:23.847597] [INFO ] [LOCAL ] PHR: Starting deletion of derivative data. [2025-10-08T20:57:23.847639] [DEBUG] [LOCAL ] PHR: No derivative data file found to delete. [2025-10-08T20:57:23.847957] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PHR took 55.4s. Estimated remaining: 1h 36m 2s. Rate: 7.1 symbols/min [2025-10-08T20:57:24.039456] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-08T20:57:24.044163] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:24.045961] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-08T20:57:24.046117] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-08T20:57:24.046340] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-08T20:57:24.046604] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-08T20:57:24.046706] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-08T20:57:24.046773] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-08T20:57:24.416207] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:24.456123] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T20:57:24.817536] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-10-08T20:57:25.265946] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T20:57:25.617558] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-08T20:57:26.417572] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-08T20:57:26.850054] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T20:57:27.217561] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-08T20:57:27.490892] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-08T20:57:27.524141] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T20:57:28.017594] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-08T20:57:28.301874] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T20:57:28.817550] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-08T20:57:29.617544] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-08T20:57:29.930120] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T20:57:29.975006] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T20:57:30.417559] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-08T20:57:30.491373] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T20:57:31.217562] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-08T20:57:31.807209] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T20:57:31.811575] [INFO ] [REMOTE ] PINS: Full fetch complete (77350 records). [2025-10-08T20:57:31.811823] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-08T20:57:31.812874] [FATAL] [VALIDATOR ] PINS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:31.812977] [FATAL] [MAIN ] PINS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:31.813023] [WARN ] [MAIN ] PINS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:31.813069] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-08T20:57:31.813136] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-08T20:57:31.813182] [INFO ] [LOCAL ] PINS: Starting deletion of derivative data. [2025-10-08T20:57:31.813227] [DEBUG] [LOCAL ] PINS: No derivative data file found to delete. [2025-10-08T20:57:31.813295] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINS took 37.2s. Estimated remaining: 1h 35m 53s. Rate: 7.1 symbols/min [2025-10-08T20:57:32.033917] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-08T20:57:32.039870] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:32.041682] [DEBUG] [LOCAL ] PKE: No existing data file found in primary storage. [2025-10-08T20:57:32.041861] [WARN ] [MAIN ] PKE: No existing data found, performing full refresh instead. [2025-10-08T20:57:32.042094] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-08T20:57:32.042151] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-08T20:57:32.042196] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-08T20:57:32.042232] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-08T20:57:32.458431] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:32.461444] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T20:57:32.817549] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-08T20:57:32.868874] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T20:57:33.617605] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-08T20:57:34.133044] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T20:57:34.134685] [INFO ] [REMOTE ] PIPR: Full fetch complete (20472 records). [2025-10-08T20:57:34.134766] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-08T20:57:34.135230] [FATAL] [VALIDATOR ] PIPR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:34.135373] [FATAL] [MAIN ] PIPR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:34.135442] [WARN ] [MAIN ] PIPR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:34.135513] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-08T20:57:34.135575] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-08T20:57:34.135610] [INFO ] [LOCAL ] PIPR: Starting deletion of derivative data. [2025-10-08T20:57:34.135675] [DEBUG] [LOCAL ] PIPR: No derivative data file found to delete. [2025-10-08T20:57:34.135751] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 23.3s. Estimated remaining: 1h 35m 42s. Rate: 7.1 symbols/min [2025-10-08T20:57:34.340222] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:34.340429] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-08T20:57:34.340595] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-08T20:57:34.340835] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-08T20:57:34.340991] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-08T20:57:34.341074] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-08T20:57:34.341246] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-08T20:57:34.426825] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-08T20:57:34.690551] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T20:57:34.760726] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:35.217563] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-10-08T20:57:36.020412] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-08T20:57:36.022826] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T20:57:36.817518] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-08T20:57:36.962010] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T20:57:37.617529] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-08T20:57:38.088419] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T20:57:38.254914] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T20:57:38.417563] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-08T20:57:39.217635] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-10-08T20:57:39.391086] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T20:57:40.017544] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-08T20:57:40.199905] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T20:57:40.238472] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T20:57:40.817609] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-08T20:57:41.359477] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T20:57:41.617560] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-08T20:57:42.329381] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T20:57:42.409842] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T20:57:42.417489] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-08T20:57:43.217549] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-08T20:57:43.870195] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T20:57:44.017496] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-08T20:57:44.817531] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-08T20:57:44.921600] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T20:57:45.038462] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T20:57:45.617582] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-08T20:57:45.997328] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T20:57:46.417602] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-08T20:57:47.217576] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-08T20:57:47.320364] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T20:57:47.368288] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T20:57:48.017613] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-08T20:57:48.189452] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T20:57:48.723929] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T20:57:48.817606] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-08T20:57:49.617606] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-08T20:57:50.417723] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-08T20:57:50.786624] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T20:57:50.860236] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T20:57:51.113246] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T20:57:51.217527] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-08T20:57:52.017554] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-08T20:57:52.431718] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T20:57:52.817601] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-08T20:57:53.617559] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-08T20:57:53.749505] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T20:57:54.382345] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T20:57:54.417505] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-08T20:57:54.644229] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T20:57:55.217518] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-08T20:57:55.447743] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T20:57:56.017601] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-08T20:57:56.585222] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:57:56.587205] [INFO ] [REMOTE ] PJT: Full fetch complete (31888 records). [2025-10-08T20:57:56.587309] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-08T20:57:56.588027] [FATAL] [VALIDATOR ] PJT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:57:56.588133] [FATAL] [MAIN ] PJT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:57:56.588202] [WARN ] [MAIN ] PJT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:57:56.588251] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-08T20:57:56.588307] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-08T20:57:56.588340] [INFO ] [LOCAL ] PJT: Starting deletion of derivative data. [2025-10-08T20:57:56.588450] [DEBUG] [LOCAL ] PJT: No derivative data file found to delete. [2025-10-08T20:57:56.588565] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PJT took 35.9s. Estimated remaining: 1h 35m 39s. Rate: 7.1 symbols/min [2025-10-08T20:57:56.763229] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:57:56.763406] [DEBUG] [LOCAL ] PKST: No existing data file found in primary storage. [2025-10-08T20:57:56.763442] [WARN ] [MAIN ] PKST: No existing data found, performing full refresh instead. [2025-10-08T20:57:56.763552] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-08T20:57:56.763593] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-08T20:57:56.763633] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-08T20:57:56.763704] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-08T20:57:56.824436] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-08T20:57:57.137610] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:57:57.170809] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T20:57:57.617563] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-10-08T20:57:58.417599] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-08T20:57:59.138272] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-08T20:57:59.207280] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T20:57:59.217490] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-08T20:57:59.762260] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T20:58:00.017505] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-08T20:58:00.201053] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T20:58:00.776239] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T20:58:00.779942] [INFO ] [REMOTE ] PK: Full fetch complete (76008 records). [2025-10-08T20:58:00.780141] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-08T20:58:00.781266] [FATAL] [VALIDATOR ] PK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:00.781454] [FATAL] [MAIN ] PK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:00.781553] [WARN ] [MAIN ] PK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:00.781671] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-08T20:58:00.781761] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-08T20:58:00.781801] [INFO ] [LOCAL ] PK: Starting deletion of derivative data. [2025-10-08T20:58:00.781840] [DEBUG] [LOCAL ] PK: No derivative data file found to delete. [2025-10-08T20:58:00.781918] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PK took 36.9s. Estimated remaining: 1h 35m 29s. Rate: 7.1 symbols/min [2025-10-08T20:58:00.822695] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-08T20:58:00.957523] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:00.957813] [DEBUG] [LOCAL ] PKX: No existing data file found in primary storage. [2025-10-08T20:58:00.957870] [WARN ] [MAIN ] PKX: No existing data found, performing full refresh instead. [2025-10-08T20:58:00.957950] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-08T20:58:00.957987] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-08T20:58:00.958028] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-08T20:58:00.958095] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-08T20:58:01.322961] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:01.617594] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-08T20:58:02.417551] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-08T20:58:02.677841] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T20:58:02.700026] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T20:58:03.217520] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-08T20:58:03.267674] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T20:58:03.638223] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T20:58:03.639949] [INFO ] [REMOTE ] PKE: Full fetch complete (17504 records). [2025-10-08T20:58:03.640019] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-08T20:58:03.640522] [FATAL] [VALIDATOR ] PKE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:03.640608] [FATAL] [MAIN ] PKE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:03.640681] [WARN ] [MAIN ] PKE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:03.640736] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-08T20:58:03.640793] [DEBUG] [LOCAL ] PKE: No primary data file found to delete. [2025-10-08T20:58:03.640826] [INFO ] [LOCAL ] PKE: Starting deletion of derivative data. [2025-10-08T20:58:03.640863] [DEBUG] [LOCAL ] PKE: No derivative data file found to delete. [2025-10-08T20:58:03.640937] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PKE took 31.8s. Estimated remaining: 1h 35m 19s. Rate: 7.1 symbols/min [2025-10-08T20:58:03.806240] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:03.806433] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-08T20:58:03.806471] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-08T20:58:03.806585] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-08T20:58:03.806625] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-08T20:58:03.806703] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-08T20:58:03.806746] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-08T20:58:04.022749] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-10-08T20:58:04.169553] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:04.817537] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-08T20:58:05.617540] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-10-08T20:58:05.720934] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T20:58:05.808590] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T20:58:06.417588] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-08T20:58:07.217604] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-08T20:58:07.685914] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T20:58:08.000499] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-08T20:58:08.017490] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-08T20:58:08.162058] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T20:58:08.817615] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-08T20:58:09.617611] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-08T20:58:10.193475] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-08T20:58:10.424041] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-08T20:58:10.425543] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T20:58:11.216137] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T20:58:11.219009] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-08T20:58:11.247350] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T20:58:12.017523] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-08T20:58:12.817535] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-08T20:58:13.400506] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T20:58:13.624283] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-08T20:58:13.638767] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T20:58:14.417573] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-08T20:58:14.727899] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T20:58:14.735133] [INFO ] [REMOTE ] PKG: Full fetch complete (57382 records). [2025-10-08T20:58:14.735393] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-08T20:58:14.736864] [FATAL] [VALIDATOR ] PKG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:14.737044] [FATAL] [MAIN ] PKG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:14.737121] [WARN ] [MAIN ] PKG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:14.738239] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-08T20:58:14.738399] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-08T20:58:14.738469] [INFO ] [LOCAL ] PKG: Starting deletion of derivative data. [2025-10-08T20:58:14.738528] [DEBUG] [LOCAL ] PKG: No derivative data file found to delete. [2025-10-08T20:58:14.738620] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKG took 40.6s. Estimated remaining: 1h 35m 11s. Rate: 7.1 symbols/min [2025-10-08T20:58:15.019673] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:15.020411] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-08T20:58:15.043887] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-08T20:58:15.064311] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-08T20:58:15.064836] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-08T20:58:15.068227] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T20:58:15.065501] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-08T20:58:15.083566] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-08T20:58:15.232944] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-08T20:58:15.457691] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T20:58:15.623627] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:16.017579] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-08T20:58:16.713010] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T20:58:16.817572] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-08T20:58:17.419784] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T20:58:17.617554] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-10-08T20:58:18.417543] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-08T20:58:19.211933] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-08T20:58:19.222509] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-08T20:58:19.707270] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T20:58:19.888523] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-08T20:58:19.941011] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-08T20:58:20.017550] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-08T20:58:20.817571] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-08T20:58:21.617718] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-08T20:58:21.899123] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T20:58:22.185263] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T20:58:22.417575] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-08T20:58:23.217573] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-08T20:58:23.360315] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T20:58:23.556054] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T20:58:24.017564] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-08T20:58:24.817547] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-08T20:58:25.579957] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-08T20:58:25.617521] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-08T20:58:26.057576] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T20:58:26.172208] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T20:58:26.417597] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-08T20:58:27.217537] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-08T20:58:27.232225] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T20:58:27.738053] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-08T20:58:28.017758] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-08T20:58:28.817556] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-08T20:58:28.926077] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T20:58:28.927866] [INFO ] [REMOTE ] PKX: Full fetch complete (36309 records). [2025-10-08T20:58:28.927968] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-08T20:58:28.928763] [FATAL] [VALIDATOR ] PKX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:28.928884] [FATAL] [MAIN ] PKX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:28.928936] [WARN ] [MAIN ] PKX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:28.928978] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-08T20:58:28.929079] [DEBUG] [LOCAL ] PKX: No primary data file found to delete. [2025-10-08T20:58:28.929120] [INFO ] [LOCAL ] PKX: Starting deletion of derivative data. [2025-10-08T20:58:28.929177] [DEBUG] [LOCAL ] PKX: No derivative data file found to delete. [2025-10-08T20:58:28.929285] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKX took 28.1s. Estimated remaining: 1h 35m 5s. Rate: 7.1 symbols/min [2025-10-08T20:58:29.134858] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:29.135155] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-08T20:58:29.135213] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-08T20:58:29.135328] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-08T20:58:29.135369] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-08T20:58:29.135411] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-08T20:58:29.135443] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-08T20:58:29.523509] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:29.617596] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-08T20:58:29.870062] [DEBUG] [REMOTE ] PKST: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T20:58:29.870463] [WARN ] [REMOTE ] PKST: No data returned for month 2025-09 [2025-10-08T20:58:29.870582] [FATAL] [REMOTE ] PKST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:58:29.870718] [FATAL] [MAIN ] PKST: Failed to fetch primary data. [2025-10-08T20:58:29.870803] [WARN ] [MAIN ] PKST: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:58:29.870890] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-08T20:58:29.870977] [DEBUG] [LOCAL ] PKST: No primary data file found to delete. [2025-10-08T20:58:29.871031] [INFO ] [LOCAL ] PKST: Starting deletion of derivative data. [2025-10-08T20:58:29.871105] [DEBUG] [LOCAL ] PKST: No derivative data file found to delete. [2025-10-08T20:58:29.871204] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKST took 33.3s. Estimated remaining: 1h 34m 54s. Rate: 7.1 symbols/min [2025-10-08T20:58:30.034819] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-08T20:58:30.108108] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:30.108283] [DEBUG] [LOCAL ] PLOW: No existing data file found in primary storage. [2025-10-08T20:58:30.108320] [WARN ] [MAIN ] PLOW: No existing data found, performing full refresh instead. [2025-10-08T20:58:30.108434] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-08T20:58:30.108481] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-08T20:58:30.108521] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-08T20:58:30.108552] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-08T20:58:30.422898] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-08T20:58:30.512516] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:31.217606] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-10-08T20:58:31.414791] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-08T20:58:32.017523] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-08T20:58:32.574787] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T20:58:32.619589] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:58:32.817544] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-08T20:58:33.617538] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-08T20:58:34.417539] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-10-08T20:58:34.547529] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-08T20:58:34.811340] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-08T20:58:35.090162] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T20:58:35.126701] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T20:58:35.217515] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-08T20:58:36.017554] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-08T20:58:36.745395] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T20:58:36.817510] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-08T20:58:37.617558] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-08T20:58:38.101923] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-08T20:58:38.417580] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-08T20:58:38.713832] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T20:58:38.764714] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T20:58:39.217526] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-08T20:58:40.017576] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-08T20:58:40.640102] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-08T20:58:40.708072] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T20:58:40.817557] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-08T20:58:41.617585] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-08T20:58:42.417686] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-08T20:58:43.067080] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-08T20:58:43.088911] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T20:58:43.217510] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-08T20:58:43.277208] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-10-08T20:58:44.017539] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-08T20:58:44.375069] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T20:58:44.657000] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-08T20:58:44.686145] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:58:44.689762] [INFO ] [REMOTE ] PL: Full fetch complete (76581 records). [2025-10-08T20:58:44.689872] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-08T20:58:44.690973] [FATAL] [VALIDATOR ] PL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:44.691065] [FATAL] [MAIN ] PL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:44.691107] [WARN ] [MAIN ] PL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:44.691144] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-08T20:58:44.691254] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-08T20:58:44.691311] [INFO ] [LOCAL ] PL: Starting deletion of derivative data. [2025-10-08T20:58:44.691367] [DEBUG] [LOCAL ] PL: No derivative data file found to delete. [2025-10-08T20:58:44.691489] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PL took 41.1s. Estimated remaining: 1h 34m 48s. Rate: 7.1 symbols/min [2025-10-08T20:58:44.833022] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-08T20:58:44.866762] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:44.866976] [DEBUG] [LOCAL ] PLYM: No existing data file found in primary storage. [2025-10-08T20:58:44.867028] [WARN ] [MAIN ] PLYM: No existing data found, performing full refresh instead. [2025-10-08T20:58:44.867136] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-08T20:58:44.867178] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-08T20:58:44.867220] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-08T20:58:44.867251] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-08T20:58:45.225860] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:45.617531] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-10-08T20:58:46.417561] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-08T20:58:47.217573] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-08T20:58:47.806817] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-08T20:58:48.022736] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-08T20:58:48.036272] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (3.20 seconds). [2025-10-08T20:58:48.426781] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T20:58:48.534742] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-08T20:58:48.817569] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-08T20:58:48.908048] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T20:58:49.617616] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-08T20:58:50.417559] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-08T20:58:50.485180] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T20:58:50.539117] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T20:58:51.217570] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-08T20:58:51.979143] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T20:58:52.017497] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-08T20:58:52.817572] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-08T20:58:53.100944] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T20:58:53.240589] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T20:58:53.617606] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-08T20:58:54.285919] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T20:58:54.289740] [INFO ] [REMOTE ] PLD: Full fetch complete (76981 records). [2025-10-08T20:58:54.289874] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-08T20:58:54.290816] [FATAL] [VALIDATOR ] PLD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:58:54.290911] [FATAL] [MAIN ] PLD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:58:54.290977] [WARN ] [MAIN ] PLD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:58:54.291050] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-08T20:58:54.291116] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-08T20:58:54.291152] [INFO ] [LOCAL ] PLD: Starting deletion of derivative data. [2025-10-08T20:58:54.291192] [DEBUG] [LOCAL ] PLD: No derivative data file found to delete. [2025-10-08T20:58:54.291256] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PLD took 39.6s. Estimated remaining: 1h 34m 40s. Rate: 7.1 symbols/min [2025-10-08T20:58:54.422621] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-08T20:58:54.489341] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:58:54.489558] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-08T20:58:54.489611] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-08T20:58:54.489778] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-08T20:58:54.489834] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-08T20:58:54.489878] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-08T20:58:54.489912] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-08T20:58:54.865869] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:58:55.217511] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-10-08T20:58:55.250781] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-08T20:58:55.462168] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T20:58:56.017631] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-08T20:58:56.817573] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-08T20:58:57.335257] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T20:58:57.617615] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-08T20:58:57.684941] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T20:58:58.225986] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T20:58:58.417570] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-08T20:58:58.715192] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T20:58:59.217557] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-08T20:59:00.008540] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T20:59:00.010141] [INFO ] [REMOTE ] PLOW: Full fetch complete (28454 records). [2025-10-08T20:59:00.010248] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-08T20:59:00.010829] [FATAL] [VALIDATOR ] PLOW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:59:00.010919] [FATAL] [MAIN ] PLOW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:59:00.010965] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:59:00.011003] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-08T20:59:00.011060] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-08T20:59:00.011094] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-08T20:59:00.011133] [DEBUG] [LOCAL ] PLOW: No derivative data file found to delete. [2025-10-08T20:59:00.011222] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLOW took 30.1s. Estimated remaining: 1h 34m 30s. Rate: 7.1 symbols/min [2025-10-08T20:59:00.022719] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-08T20:59:00.194754] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:00.216820] [DEBUG] [LOCAL ] PML: Loaded 21482 existing records from primary storage. [2025-10-08T20:59:00.217148] [INFO ] [MAIN ] PML: Loaded 21482 existing records. [2025-10-08T20:59:00.404151] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:59:00.404385] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-08T20:59:00.404457] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-08T20:59:00.405324] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-08T20:59:00.405399] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-08T20:59:00.764218] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:00.817561] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-10-08T20:59:00.948814] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-08T20:59:01.617585] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-08T20:59:01.818522] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T20:59:02.193420] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T20:59:02.417598] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-08T20:59:03.217510] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-08T20:59:03.483202] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T20:59:04.017607] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-08T20:59:04.741008] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-08T20:59:04.797840] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T20:59:04.817522] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-08T20:59:05.617696] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-08T20:59:06.081404] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T20:59:06.219237] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T20:59:06.225828] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-08T20:59:06.244175] [INFO ] [REMOTE ] PLNT: Full fetch complete (70113 records). [2025-10-08T20:59:06.244488] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-08T20:59:06.246120] [FATAL] [VALIDATOR ] PLNT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:59:06.246308] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:59:06.246382] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:59:06.246490] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-08T20:59:06.246629] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-08T20:59:06.246725] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-10-08T20:59:06.246780] [DEBUG] [LOCAL ] PLNT: No derivative data file found to delete. [2025-10-08T20:59:06.246919] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLNT took 37.3s. Estimated remaining: 1h 34m 21s. Rate: 7.1 symbols/min [2025-10-08T20:59:06.425126] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-08T20:59:06.454770] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:06.468188] [DEBUG] [LOCAL ] PMM: Loaded 10674 existing records from primary storage. [2025-10-08T20:59:06.468457] [INFO ] [MAIN ] PMM: Loaded 10674 existing records. [2025-10-08T20:59:06.650876] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:59:06.651118] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-08T20:59:06.651169] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-08T20:59:06.651551] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-08T20:59:06.651672] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-08T20:59:07.091187] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:07.217684] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-10-08T20:59:08.017707] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-08T20:59:08.612898] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T20:59:08.817542] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-08T20:59:09.444014] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-08T20:59:09.599311] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T20:59:09.619801] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-08T20:59:09.623723] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T20:59:10.417519] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-08T20:59:10.705092] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T20:59:11.217562] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-08T20:59:11.662313] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T20:59:12.017585] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-08T20:59:12.364967] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T20:59:12.817520] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-08T20:59:13.617553] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-08T20:59:14.298319] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T20:59:14.324021] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T20:59:14.417514] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-08T20:59:14.737880] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T20:59:15.217552] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-08T20:59:15.815711] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T20:59:16.017560] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-08T20:59:16.728343] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T20:59:16.731468] [INFO ] [REMOTE ] PLYM: Full fetch complete (46882 records). [2025-10-08T20:59:16.731622] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-08T20:59:16.732397] [FATAL] [VALIDATOR ] PLYM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:59:16.732502] [FATAL] [MAIN ] PLYM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:59:16.732547] [WARN ] [MAIN ] PLYM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:59:16.732592] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-08T20:59:16.732747] [DEBUG] [LOCAL ] PLYM: No primary data file found to delete. [2025-10-08T20:59:16.732813] [INFO ] [LOCAL ] PLYM: Starting deletion of derivative data. [2025-10-08T20:59:16.732878] [DEBUG] [LOCAL ] PLYM: No derivative data file found to delete. [2025-10-08T20:59:16.732979] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLYM took 32.0s. Estimated remaining: 1h 34m 13s. Rate: 7.1 symbols/min [2025-10-08T20:59:16.820308] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-08T20:59:16.929205] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:16.943174] [DEBUG] [LOCAL ] PMO: Loaded 10089 existing records from primary storage. [2025-10-08T20:59:16.943489] [INFO ] [MAIN ] PMO: Loaded 10089 existing records. [2025-10-08T20:59:17.161780] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T20:59:17.211236] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:59:17.211962] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-08T20:59:17.212554] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-08T20:59:17.213049] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-08T20:59:17.213108] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-08T20:59:17.611591] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:17.614119] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T20:59:17.619005] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-10-08T20:59:18.417631] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-08T20:59:18.852216] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T20:59:19.217558] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-08T20:59:19.451384] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T20:59:20.017544] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-08T20:59:20.817550] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-08T20:59:21.116517] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T20:59:21.507514] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T20:59:21.617501] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-08T20:59:21.822215] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T20:59:22.417605] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-08T20:59:23.095803] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T20:59:23.217562] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-08T20:59:23.723322] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T20:59:23.759464] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T20:59:24.017613] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-08T20:59:24.817510] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-08T20:59:24.889938] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T20:59:25.617574] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-08T20:59:26.417546] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-08T20:59:27.217521] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-08T20:59:27.277623] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T20:59:27.481546] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T20:59:27.770234] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-08T20:59:27.907044] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T20:59:28.017536] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-08T20:59:28.817503] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-08T20:59:28.898261] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T20:59:29.431098] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T20:59:29.434562] [INFO ] [REMOTE ] PM: Full fetch complete (77324 records). [2025-10-08T20:59:29.434721] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-08T20:59:29.435535] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:59:29.435627] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:59:29.435716] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:59:29.435802] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-08T20:59:29.435901] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-08T20:59:29.435950] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-10-08T20:59:29.436006] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-10-08T20:59:29.436085] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PM took 35.1s. Estimated remaining: 1h 34m 7s. Rate: 7.1 symbols/min [2025-10-08T20:59:29.605961] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:29.606134] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-08T20:59:29.606172] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-08T20:59:29.606281] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-08T20:59:29.606323] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-08T20:59:29.606376] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-08T20:59:29.606452] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-08T20:59:29.626715] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-08T20:59:29.968342] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:30.417570] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-10-08T20:59:30.922163] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T20:59:31.217609] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-08T20:59:31.905410] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T20:59:32.017587] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-08T20:59:32.065369] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-08T20:59:32.066799] [INFO ] [REMOTE ] PMM: Full fetch complete (17991 records). [2025-10-08T20:59:32.066904] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-08T20:59:32.445702] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-08T20:59:32.445800] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-08T20:59:32.446335] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-08T20:59:32.446377] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-08T20:59:32.447029] [DEBUG] [LOCAL ] PMM: Trimmed 17991 records to 10630 (keeping 200 days of data) [2025-10-08T20:59:32.512388] [DEBUG] [LOCAL ] PMM: Primary data saved (10630 records). [2025-10-08T20:59:32.512552] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-08T20:59:32.512664] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PMM took 26.3s. Estimated remaining: 1h 33m 56s. Rate: 7.1 symbols/min [2025-10-08T20:59:32.688267] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:32.688447] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-08T20:59:32.688484] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-08T20:59:32.688599] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-08T20:59:32.688665] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-08T20:59:32.688814] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-08T20:59:32.688864] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-08T20:59:32.822702] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-08T20:59:33.096459] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:33.617574] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-08T20:59:33.640808] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T20:59:34.296026] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T20:59:34.417559] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-08T20:59:35.142580] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T20:59:35.217511] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-08T20:59:35.288742] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T20:59:36.017542] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-10-08T20:59:36.437854] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-08T20:59:36.597451] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T20:59:36.817610] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-08T20:59:37.225021] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-08T20:59:37.617551] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-08T20:59:38.098510] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T20:59:38.417570] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-08T20:59:39.217591] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-08T20:59:39.598609] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-08T20:59:39.882432] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T20:59:40.017531] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-08T20:59:40.817682] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-08T20:59:41.579987] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T20:59:41.617561] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-08T20:59:42.117255] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T20:59:42.175026] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T20:59:42.417576] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-08T20:59:43.217553] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-08T20:59:43.635789] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T20:59:44.017523] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-08T20:59:44.244853] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T20:59:44.817601] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-08T20:59:45.143007] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T20:59:45.145189] [INFO ] [REMOTE ] PML: Full fetch complete (29825 records). [2025-10-08T20:59:45.145270] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-08T20:59:45.527866] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-08T20:59:45.527944] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-08T20:59:45.528538] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-08T20:59:45.528598] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-08T20:59:45.529432] [DEBUG] [LOCAL ] PML: Trimmed 29825 records to 21571 (keeping 200 days of data) [2025-10-08T20:59:45.617817] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-08T20:59:45.664218] [DEBUG] [LOCAL ] PML: Primary data saved (21571 records). [2025-10-08T20:59:45.664351] [INFO ] [MAIN ] PML: Full history saved. [2025-10-08T20:59:45.664433] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PML took 45.7s. Estimated remaining: 1h 33m 50s. Rate: 7.1 symbols/min [2025-10-08T20:59:45.881280] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:45.881945] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-08T20:59:45.881997] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-08T20:59:45.882263] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-08T20:59:45.882344] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-08T20:59:45.882446] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-08T20:59:45.882525] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-08T20:59:46.247228] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:46.396234] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T20:59:46.417507] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-10-08T20:59:46.605738] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T20:59:46.718385] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:59:46.718836] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-10-08T20:59:46.718911] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:59:46.718953] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-08T20:59:46.718985] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:59:46.719075] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-08T20:59:46.719135] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-08T20:59:46.719175] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-08T20:59:46.719216] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-08T20:59:46.719265] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMTV took 1.1s. Estimated remaining: 1h 33m 38s. Rate: 7.1 symbols/min [2025-10-08T20:59:46.895150] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:46.895353] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-08T20:59:46.895390] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-08T20:59:46.895505] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-08T20:59:46.895546] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-08T20:59:46.895588] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-08T20:59:46.895620] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-08T20:59:47.232282] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-08T20:59:47.276349] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:48.017529] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-10-08T20:59:48.206184] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T20:59:48.280936] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T20:59:48.281215] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-10-08T20:59:48.281317] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T20:59:48.281366] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-08T20:59:48.281401] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T20:59:48.281437] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-08T20:59:48.281491] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-08T20:59:48.281525] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-08T20:59:48.281562] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-08T20:59:48.281607] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMTW took 1.6s. Estimated remaining: 1h 33m 27s. Rate: 7.1 symbols/min [2025-10-08T20:59:48.455797] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:48.455993] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-08T20:59:48.456049] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-08T20:59:48.456161] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-08T20:59:48.456214] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-08T20:59:48.456265] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-08T20:59:48.456306] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-08T20:59:48.821041] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-08T20:59:48.824210] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:49.617587] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-08T20:59:50.417526] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-10-08T20:59:50.457545] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T20:59:50.487701] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T20:59:51.217573] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-08T20:59:52.017530] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-08T20:59:52.297400] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-08T20:59:52.328937] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T20:59:52.817562] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-08T20:59:53.464186] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T20:59:53.465564] [INFO ] [REMOTE ] PMO: Full fetch complete (16701 records). [2025-10-08T20:59:53.465706] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-08T20:59:53.617555] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-08T20:59:53.940502] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-08T20:59:53.940672] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-08T20:59:53.941128] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-08T20:59:53.941233] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-08T20:59:53.946083] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T20:59:53.946337] [DEBUG] [LOCAL ] PMO: Trimmed 16701 records to 10057 (keeping 200 days of data) [2025-10-08T20:59:54.005756] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-08T20:59:54.027028] [DEBUG] [LOCAL ] PMO: Primary data saved (10057 records). [2025-10-08T20:59:54.027179] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-08T20:59:54.027287] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMO took 37.3s. Estimated remaining: 1h 33m 18s. Rate: 7.1 symbols/min [2025-10-08T20:59:54.201636] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:54.211666] [DEBUG] [LOCAL ] PNI: Loaded 6798 existing records from primary storage. [2025-10-08T20:59:54.211925] [INFO ] [MAIN ] PNI: Loaded 6798 existing records. [2025-10-08T20:59:54.390821] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T20:59:54.391121] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-08T20:59:54.391183] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-08T20:59:54.391736] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-08T20:59:54.391797] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-08T20:59:54.422683] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-08T20:59:54.755683] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T20:59:55.217540] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-08T20:59:56.017575] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-10-08T20:59:56.357462] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T20:59:56.432043] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-08T20:59:56.538052] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-08T20:59:56.817550] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-08T20:59:57.241661] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-08T20:59:57.617561] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-08T20:59:58.417575] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-08T20:59:59.148545] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T20:59:59.217566] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-08T20:59:59.790125] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T20:59:59.794122] [INFO ] [REMOTE ] PMT: Full fetch complete (58296 records). [2025-10-08T20:59:59.794273] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-08T20:59:59.795120] [FATAL] [VALIDATOR ] PMT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T20:59:59.795221] [FATAL] [MAIN ] PMT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T20:59:59.795264] [WARN ] [MAIN ] PMT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T20:59:59.795332] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-08T20:59:59.795396] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-08T20:59:59.795435] [INFO ] [LOCAL ] PMT: Starting deletion of derivative data. [2025-10-08T20:59:59.795474] [DEBUG] [LOCAL ] PMT: No derivative data file found to delete. [2025-10-08T20:59:59.795545] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMT took 30.4s. Estimated remaining: 1h 33m 8s. Rate: 7.1 symbols/min [2025-10-08T20:59:59.969490] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T20:59:59.969770] [DEBUG] [LOCAL ] PNNT: No existing data file found in primary storage. [2025-10-08T20:59:59.969908] [WARN ] [MAIN ] PNNT: No existing data found, performing full refresh instead. [2025-10-08T20:59:59.970027] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-08T20:59:59.970071] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-08T20:59:59.970114] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-08T20:59:59.970147] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-08T21:00:00.026544] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-08T21:00:00.348921] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:00.377553] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T21:00:00.597572] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T21:00:00.817564] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-10-08T21:00:01.617580] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-08T21:00:02.357728] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T21:00:02.417638] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-08T21:00:03.217563] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-08T21:00:03.850335] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-08T21:00:03.891101] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T21:00:04.017559] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-08T21:00:04.045696] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:00:04.817560] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-08T21:00:05.617588] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-08T21:00:05.961079] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-08T21:00:06.417539] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-08T21:00:06.730248] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-08T21:00:07.217546] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-08T21:00:07.549866] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T21:00:07.550799] [INFO ] [REMOTE ] PMTU: Full fetch complete (1202 records). [2025-10-08T21:00:07.550872] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-08T21:00:07.551344] [FATAL] [VALIDATOR ] PMTU: Data is stale - most recent date (2025-10-06) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:00:07.551431] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:00:07.551473] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:00:07.551512] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-08T21:00:07.551565] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-08T21:00:07.551598] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-08T21:00:07.551672] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-08T21:00:07.551784] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTU took 35.0s. Estimated remaining: 1h 32m 59s. Rate: 7.1 symbols/min [2025-10-08T21:00:07.678520] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T21:00:07.763307] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:07.763554] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-08T21:00:07.763612] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-08T21:00:07.763803] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-08T21:00:07.763857] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-08T21:00:07.763942] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-08T21:00:07.764025] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-08T21:00:08.022687] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-08T21:00:08.185778] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:08.581208] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-10-08T21:00:08.817571] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-08T21:00:09.436414] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T21:00:09.560323] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T21:00:09.617549] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-08T21:00:10.417588] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-08T21:00:10.500850] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T21:00:11.217558] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-08T21:00:12.017520] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-10-08T21:00:12.084622] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T21:00:12.360474] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T21:00:12.817534] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-08T21:00:13.617546] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-08T21:00:14.120388] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T21:00:14.417550] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-08T21:00:14.573476] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T21:00:14.682278] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-08T21:00:15.217565] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-08T21:00:15.711715] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-08T21:00:16.017594] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-08T21:00:16.650919] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T21:00:16.817554] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-08T21:00:17.617524] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-08T21:00:17.862559] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T21:00:18.088717] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T21:00:18.262961] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:00:18.417569] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-08T21:00:19.217562] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-08T21:00:20.017531] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-08T21:00:20.298379] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T21:00:20.817612] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-08T21:00:21.073243] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T21:00:21.580211] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T21:00:21.617566] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-08T21:00:22.038859] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T21:00:22.417585] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-08T21:00:23.217572] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-08T21:00:23.350104] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:00:23.533918] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T21:00:24.017564] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-08T21:00:24.816144] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T21:00:24.818748] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-08T21:00:24.877871] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T21:00:25.337231] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:00:25.341407] [INFO ] [REMOTE ] PNC: Full fetch complete (75014 records). [2025-10-08T21:00:25.341629] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-08T21:00:25.342800] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:00:25.342902] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:00:25.342947] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:00:25.342999] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-08T21:00:25.343098] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-08T21:00:25.343142] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-10-08T21:00:25.343183] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-10-08T21:00:25.343262] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PNC took 37.1s. Estimated remaining: 1h 32m 55s. Rate: 7.1 symbols/min [2025-10-08T21:00:25.528397] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:25.528717] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-08T21:00:25.528774] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-08T21:00:25.528904] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-08T21:00:25.528950] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-08T21:00:25.529013] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-08T21:00:25.529072] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-08T21:00:25.622768] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-08T21:00:25.950049] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:26.417611] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-08T21:00:27.048764] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T21:00:27.049718] [INFO ] [REMOTE ] PNI: Full fetch complete (9689 records). [2025-10-08T21:00:27.049789] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-08T21:00:27.228310] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-08T21:00:27.429436] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-08T21:00:27.429677] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-08T21:00:27.430006] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-08T21:00:27.430084] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-08T21:00:27.430762] [DEBUG] [LOCAL ] PNI: Trimmed 9689 records to 6770 (keeping 200 days of data) [2025-10-08T21:00:27.471130] [DEBUG] [LOCAL ] PNI: Primary data saved (6770 records). [2025-10-08T21:00:27.471398] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-08T21:00:27.471518] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 33.4s. Estimated remaining: 1h 32m 44s. Rate: 7.1 symbols/min [2025-10-08T21:00:27.591788] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T21:00:27.681300] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:27.681460] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-08T21:00:27.681497] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-08T21:00:27.681609] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-08T21:00:27.681676] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-08T21:00:27.681739] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-08T21:00:27.681772] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-08T21:00:28.037516] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-10-08T21:00:28.043604] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:28.831196] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-08T21:00:28.834178] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:00:29.617568] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-10-08T21:00:29.812183] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T21:00:30.417574] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-08T21:00:30.947585] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T21:00:31.217568] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-08T21:00:32.017699] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-08T21:00:32.106281] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-08T21:00:32.123111] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T21:00:32.126014] [INFO ] [REMOTE ] PNNT: Full fetch complete (47367 records). [2025-10-08T21:00:32.126125] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-08T21:00:32.126904] [FATAL] [VALIDATOR ] PNNT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:00:32.126991] [FATAL] [MAIN ] PNNT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:00:32.127034] [WARN ] [MAIN ] PNNT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:00:32.127072] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-08T21:00:32.127128] [DEBUG] [LOCAL ] PNNT: No primary data file found to delete. [2025-10-08T21:00:32.127162] [INFO ] [LOCAL ] PNNT: Starting deletion of derivative data. [2025-10-08T21:00:32.127207] [DEBUG] [LOCAL ] PNNT: No derivative data file found to delete. [2025-10-08T21:00:32.127299] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNNT took 32.3s. Estimated remaining: 1h 32m 34s. Rate: 7.1 symbols/min [2025-10-08T21:00:32.300897] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:32.301136] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-08T21:00:32.301178] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-08T21:00:32.301255] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-08T21:00:32.301291] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-08T21:00:32.301331] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-08T21:00:32.301400] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-08T21:00:32.672266] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:32.698449] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-08T21:00:32.817506] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-10-08T21:00:33.447578] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T21:00:33.617568] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-08T21:00:34.417496] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-08T21:00:35.079168] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-08T21:00:35.217617] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-08T21:00:35.779969] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-08T21:00:36.010166] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T21:00:36.018053] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-08T21:00:36.817537] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-08T21:00:36.885909] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:00:37.617575] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-08T21:00:37.970997] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T21:00:38.417546] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-08T21:00:38.741207] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T21:00:39.223953] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-08T21:00:39.230422] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:00:39.971588] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T21:00:40.017555] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-08T21:00:40.817567] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-08T21:00:41.617597] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-08T21:00:41.690115] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-08T21:00:42.070030] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T21:00:42.417507] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-08T21:00:42.672853] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T21:00:43.147378] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T21:00:43.217518] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-08T21:00:43.774126] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T21:00:44.017610] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-08T21:00:44.817515] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-08T21:00:45.067473] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:00:45.617520] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-08T21:00:45.704684] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T21:00:46.417531] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-08T21:00:46.780326] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T21:00:46.824629] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T21:00:46.828315] [INFO ] [REMOTE ] PNR: Full fetch complete (68773 records). [2025-10-08T21:00:46.828477] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-08T21:00:46.829478] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:00:46.829605] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:00:46.829683] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:00:46.829763] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-08T21:00:46.829882] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-08T21:00:46.829940] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-10-08T21:00:46.829984] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-10-08T21:00:46.830046] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNR took 39.3s. Estimated remaining: 1h 32m 28s. Rate: 7.1 symbols/min [2025-10-08T21:00:47.012906] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:47.013093] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-08T21:00:47.013130] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-08T21:00:47.013246] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-08T21:00:47.013288] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-08T21:00:47.013331] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-08T21:00:47.013363] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-08T21:00:47.222677] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-08T21:00:47.421241] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:47.423254] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T21:00:48.017567] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-08T21:00:48.817590] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-08T21:00:49.097448] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:00:49.617537] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-08T21:00:49.808165] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T21:00:50.271623] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T21:00:50.417533] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-08T21:00:51.217504] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-08T21:00:51.405229] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T21:00:52.017577] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-08T21:00:52.271358] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T21:00:52.526394] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T21:00:52.817612] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-08T21:00:53.617585] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-08T21:00:53.829569] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T21:00:54.191735] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T21:00:54.417600] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-08T21:00:54.748598] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T21:00:55.217675] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-10-08T21:00:56.017625] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-08T21:00:56.199879] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:00:56.817694] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-08T21:00:57.155320] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-08T21:00:57.158414] [INFO ] [REMOTE ] POST: Full fetch complete (55275 records). [2025-10-08T21:00:57.158904] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-08T21:00:57.161035] [FATAL] [VALIDATOR ] POST: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:00:57.161205] [FATAL] [MAIN ] POST: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:00:57.161250] [WARN ] [MAIN ] POST: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:00:57.161325] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-08T21:00:57.161398] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-08T21:00:57.161437] [INFO ] [LOCAL ] POST: Starting deletion of derivative data. [2025-10-08T21:00:57.161477] [DEBUG] [LOCAL ] POST: No derivative data file found to delete. [2025-10-08T21:00:57.161560] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. POST took 25.0s. Estimated remaining: 1h 32m 20s. Rate: 7.1 symbols/min [2025-10-08T21:00:57.346761] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:00:57.347066] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-08T21:00:57.347168] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-08T21:00:57.347338] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-08T21:00:57.347415] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-08T21:00:57.347498] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-08T21:00:57.347561] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-08T21:00:57.625441] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-08T21:00:57.692319] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T21:00:57.779422] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:00:57.926636] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T21:00:58.417577] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-08T21:00:59.217580] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-08T21:00:59.456732] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:01:00.013306] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T21:01:00.022692] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-08T21:01:00.619023] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:01:00.622856] [INFO ] [REMOTE ] PNW: Full fetch complete (65705 records). [2025-10-08T21:01:00.623096] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-08T21:01:00.624079] [FATAL] [VALIDATOR ] PNW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:01:00.624183] [FATAL] [MAIN ] PNW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:01:00.624228] [WARN ] [MAIN ] PNW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:01:00.624272] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-08T21:01:00.624339] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-08T21:01:00.624384] [INFO ] [LOCAL ] PNW: Starting deletion of derivative data. [2025-10-08T21:01:00.624876] [DEBUG] [LOCAL ] PNW: No derivative data file found to delete. [2025-10-08T21:01:00.625149] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 35.3s. Estimated remaining: 1h 32m 10s. Rate: 7.1 symbols/min [2025-10-08T21:01:00.816335] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:00.817540] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-10-08T21:01:00.837114] [DEBUG] [LOCAL ] PPT: Loaded 20071 existing records from primary storage. [2025-10-08T21:01:00.837514] [INFO ] [MAIN ] PPT: Loaded 20071 existing records. [2025-10-08T21:01:01.026853] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:01:01.027190] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-08T21:01:01.027300] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-08T21:01:01.028062] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-08T21:01:01.028133] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-08T21:01:01.205479] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T21:01:01.432997] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:01.617680] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-10-08T21:01:02.428975] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-08T21:01:02.436586] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T21:01:02.840515] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T21:01:03.217627] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-08T21:01:04.017564] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-08T21:01:04.817589] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-08T21:01:05.089173] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-08T21:01:05.570694] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-08T21:01:05.595837] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T21:01:05.617545] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-08T21:01:06.430784] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-08T21:01:06.434539] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T21:01:07.217506] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-08T21:01:07.315203] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T21:01:07.399371] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T21:01:07.852728] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:01:07.856871] [INFO ] [REMOTE ] POR: Full fetch complete (68230 records). [2025-10-08T21:01:07.857070] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-08T21:01:07.858326] [FATAL] [VALIDATOR ] POR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:01:07.858456] [FATAL] [MAIN ] POR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:01:07.858506] [WARN ] [MAIN ] POR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:01:07.858580] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-08T21:01:07.858703] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-08T21:01:07.858773] [INFO ] [LOCAL ] POR: Starting deletion of derivative data. [2025-10-08T21:01:07.858888] [DEBUG] [LOCAL ] POR: No derivative data file found to delete. [2025-10-08T21:01:07.859029] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POR took 40.4s. Estimated remaining: 1h 32m 1s. Rate: 7.1 symbols/min [2025-10-08T21:01:08.022795] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-08T21:01:08.125446] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:08.125765] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-08T21:01:08.125830] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-08T21:01:08.125943] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-08T21:01:08.125999] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-08T21:01:08.126062] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-08T21:01:08.126112] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-08T21:01:08.706169] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:08.817604] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-08T21:01:09.617576] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-08T21:01:10.017285] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T21:01:10.417561] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-10-08T21:01:10.899576] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T21:01:10.936362] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T21:01:11.217559] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-08T21:01:12.017612] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-08T21:01:12.483634] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-08T21:01:12.659916] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:01:12.817575] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-08T21:01:13.617561] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-08T21:01:13.918422] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T21:01:14.012803] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T21:01:14.417547] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-08T21:01:15.217567] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-08T21:01:15.390124] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T21:01:16.017549] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-08T21:01:16.817600] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-08T21:01:17.373516] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-10-08T21:01:17.618556] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-08T21:01:17.623857] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-08T21:01:17.694958] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T21:01:18.073674] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T21:01:18.417698] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-08T21:01:19.217527] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-08T21:01:19.407468] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T21:01:19.431446] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T21:01:20.017552] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-08T21:01:20.817520] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-08T21:01:20.958007] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T21:01:21.230101] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T21:01:21.617575] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-08T21:01:22.417531] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-08T21:01:22.855794] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-08T21:01:22.876383] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T21:01:23.217597] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-08T21:01:24.017535] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-08T21:01:24.241492] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T21:01:24.408324] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T21:01:24.817550] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-08T21:01:25.508172] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T21:01:25.512075] [INFO ] [REMOTE ] PPT: Full fetch complete (28991 records). [2025-10-08T21:01:25.512352] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-08T21:01:25.626461] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-08T21:01:26.002610] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-08T21:01:26.002782] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-08T21:01:26.003449] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-08T21:01:26.003528] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-08T21:01:26.004513] [DEBUG] [LOCAL ] PPT: Trimmed 28991 records to 19997 (keeping 200 days of data) [2025-10-08T21:01:26.130968] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-08T21:01:26.171410] [DEBUG] [LOCAL ] PPT: Primary data saved (19997 records). [2025-10-08T21:01:26.171560] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-08T21:01:26.171678] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. PPT took 25.5s. Estimated remaining: 1h 31m 56s. Rate: 7.1 symbols/min [2025-10-08T21:01:26.417572] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-08T21:01:27.217951] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-08T21:01:27.217876] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T21:01:28.017535] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-08T21:01:28.403116] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-08T21:01:28.817538] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-08T21:01:29.177452] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-08T21:01:29.617589] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-08T21:01:29.980024] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T21:01:30.123401] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:01:30.129414] [INFO ] [REMOTE ] PPG: Full fetch complete (73413 records). [2025-10-08T21:01:30.129728] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-08T21:01:30.132408] [FATAL] [VALIDATOR ] PPG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:01:30.132676] [FATAL] [MAIN ] PPG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:01:30.132750] [WARN ] [MAIN ] PPG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:01:30.132903] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-08T21:01:30.132995] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-08T21:01:30.133058] [INFO ] [LOCAL ] PPG: Starting deletion of derivative data. [2025-10-08T21:01:30.133156] [DEBUG] [LOCAL ] PPG: No derivative data file found to delete. [2025-10-08T21:01:30.133292] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPG took 43.3s. Estimated remaining: 1h 31m 46s. Rate: 7.1 symbols/min [2025-10-08T21:01:30.417530] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-08T21:01:30.908780] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T21:01:31.217578] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-08T21:01:32.027713] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T21:01:32.039708] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-08T21:01:33.265364] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T21:01:33.276898] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-08T21:01:33.899863] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T21:01:33.911394] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-08T21:01:34.558796] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T21:01:34.562692] [INFO ] [REMOTE ] PPL: Full fetch complete (77025 records). [2025-10-08T21:01:34.562851] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-08T21:01:34.563737] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:01:34.563830] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:01:34.563872] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:01:34.563909] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-08T21:01:34.564005] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-08T21:01:34.564059] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-10-08T21:01:34.564102] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-10-08T21:01:34.564170] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPL took 37.4s. Estimated remaining: 1h 31m 36s. Rate: 7.1 symbols/min [2025-10-08T21:01:34.854623] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T21:01:34.869067] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-08T21:01:36.856705] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T21:01:36.868154] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-08T21:01:37.465837] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:01:37.469307] [INFO ] [REMOTE ] PR: Full fetch complete (77208 records). [2025-10-08T21:01:37.469417] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-08T21:01:37.470273] [FATAL] [VALIDATOR ] PR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:01:37.470364] [FATAL] [MAIN ] PR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:01:37.470408] [WARN ] [MAIN ] PR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:01:37.470445] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-08T21:01:37.470503] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-08T21:01:37.470537] [INFO ] [LOCAL ] PR: Starting deletion of derivative data. [2025-10-08T21:01:37.470576] [DEBUG] [LOCAL ] PR: No derivative data file found to delete. [2025-10-08T21:01:37.470712] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PR took 29.6s. Estimated remaining: 1h 31m 26s. Rate: 7.1 symbols/min [2025-10-08T21:01:38.082736] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:38.159350] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:38.186491] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:38.189606] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-08T21:01:38.188201] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:38.189823] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-08T21:01:38.189910] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-08T21:01:38.190437] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-08T21:01:38.192719] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-08T21:01:38.192955] [DEBUG] [LOCAL ] PRCS: Loaded 2749 existing records from primary storage. [2025-10-08T21:01:38.193318] [INFO ] [MAIN ] PRCS: Loaded 2749 existing records. [2025-10-08T21:01:38.193396] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-08T21:01:38.193148] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-08T21:01:38.198880] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-08T21:01:38.204596] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-08T21:01:38.233158] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-08T21:01:38.233263] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-08T21:01:38.204689] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-08T21:01:38.238952] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-08T21:01:38.239242] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-08T21:01:38.239196] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-08T21:01:38.278011] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-08T21:01:38.405155] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-08T21:01:38.430337] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-08T21:01:38.706237] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:01:38.758178] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-08T21:01:38.840534] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-08T21:01:38.993406] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-08T21:01:39.077411] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-08T21:01:39.410279] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:39.455910] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-10-08T21:01:39.627788] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:39.668586] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:39.669225] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-10-08T21:01:39.682076] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-10-08T21:01:39.932452] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:39.932836] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-10-08T21:01:40.272115] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-08T21:01:40.273142] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-08T21:01:40.635726] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T21:01:40.636952] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-08T21:01:40.888441] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T21:01:40.893178] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-08T21:01:41.012746] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T21:01:41.059227] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-08T21:01:41.161615] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T21:01:41.617596] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-08T21:01:42.112913] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T21:01:42.417585] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-08T21:01:42.887713] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T21:01:43.019400] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T21:01:43.217594] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-08T21:01:43.905549] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T21:01:44.017559] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-08T21:01:44.584068] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T21:01:44.817599] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-08T21:01:45.617532] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-08T21:01:46.417635] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-08T21:01:46.453168] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T21:01:46.571295] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T21:01:47.217565] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-08T21:01:47.787459] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-08T21:01:48.017569] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-08T21:01:48.817557] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-08T21:01:48.908373] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T21:01:49.260133] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T21:01:49.332890] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T21:01:49.617541] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-08T21:01:50.167722] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T21:01:50.417548] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-08T21:01:51.022729] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T21:01:51.217518] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-08T21:01:51.676860] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T21:01:52.017557] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-08T21:01:52.817522] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-08T21:01:53.331442] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:01:53.332484] [INFO ] [REMOTE ] PRCS: Full fetch complete (3852 records). [2025-10-08T21:01:53.332566] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-08T21:01:53.622787] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-08T21:01:53.751594] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-08T21:01:53.751746] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-08T21:01:53.751986] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-08T21:01:53.752063] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-08T21:01:53.752689] [DEBUG] [LOCAL ] PRCS: Trimmed 3852 records to 2741 (keeping 200 days of data) [2025-10-08T21:01:53.755700] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T21:01:53.782666] [DEBUG] [LOCAL ] PRCS: Primary data saved (2741 records). [2025-10-08T21:01:53.783252] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-08T21:01:53.783354] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 16.3s. Estimated remaining: 1h 31m 20s. Rate: 7.1 symbols/min [2025-10-08T21:01:53.958253] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:01:53.958497] [DEBUG] [LOCAL ] PRH: No existing data file found in primary storage. [2025-10-08T21:01:53.958554] [WARN ] [MAIN ] PRH: No existing data found, performing full refresh instead. [2025-10-08T21:01:53.958701] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-08T21:01:53.958755] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-08T21:01:53.958798] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-08T21:01:53.958831] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-08T21:01:54.309743] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:01:54.417508] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-10-08T21:01:55.164707] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T21:01:55.217538] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-08T21:01:55.323466] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T21:01:55.894550] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T21:01:56.017557] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-08T21:01:56.817523] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-08T21:01:56.882073] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T21:01:57.617561] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-08T21:01:58.130316] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T21:01:58.417570] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-08T21:01:59.077578] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T21:01:59.217550] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-08T21:01:59.429351] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T21:02:00.017562] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-08T21:02:00.695453] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T21:02:00.817779] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-08T21:02:01.209227] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:02:01.617557] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-08T21:02:01.943531] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T21:02:02.417561] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-08T21:02:02.642270] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T21:02:03.217547] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-08T21:02:04.017578] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-08T21:02:04.175932] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T21:02:04.817585] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-08T21:02:04.888073] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T21:02:05.374551] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T21:02:05.521097] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:02:05.617534] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-08T21:02:06.417543] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-08T21:02:06.514065] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T21:02:07.217562] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-08T21:02:07.899525] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:02:08.017518] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-08T21:02:08.028789] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T21:02:08.817568] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-08T21:02:09.617568] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-08T21:02:09.779353] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T21:02:10.193250] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T21:02:10.417607] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-08T21:02:11.060410] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T21:02:11.182117] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:02:11.217503] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-08T21:02:11.988087] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T21:02:12.017510] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-08T21:02:12.431413] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T21:02:12.817600] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-08T21:02:13.195907] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:02:13.196813] [INFO ] [REMOTE ] PRH: Full fetch complete (7484 records). [2025-10-08T21:02:13.196883] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-08T21:02:13.197286] [FATAL] [VALIDATOR ] PRH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:13.197371] [FATAL] [MAIN ] PRH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:13.197412] [WARN ] [MAIN ] PRH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:13.197450] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-08T21:02:13.197503] [DEBUG] [LOCAL ] PRH: No primary data file found to delete. [2025-10-08T21:02:13.197537] [INFO ] [LOCAL ] PRH: Starting deletion of derivative data. [2025-10-08T21:02:13.197576] [DEBUG] [LOCAL ] PRH: No derivative data file found to delete. [2025-10-08T21:02:13.197627] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRH took 19.4s. Estimated remaining: 1h 31m 16s. Rate: 7.1 symbols/min [2025-10-08T21:02:13.366362] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:13.366579] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-08T21:02:13.366616] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-08T21:02:13.366750] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-08T21:02:13.366791] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-08T21:02:13.366831] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-08T21:02:13.366862] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-08T21:02:13.622751] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-08T21:02:13.721987] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:14.417706] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-10-08T21:02:14.981719] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T21:02:15.223903] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-08T21:02:15.225480] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T21:02:15.440679] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-10-08T21:02:15.443216] [INFO ] [REMOTE ] PRG: Full fetch complete (44197 records). [2025-10-08T21:02:15.443306] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-08T21:02:15.443941] [FATAL] [VALIDATOR ] PRG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:15.444051] [FATAL] [MAIN ] PRG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:15.444093] [WARN ] [MAIN ] PRG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:15.444155] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-08T21:02:15.444218] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-08T21:02:15.444254] [INFO ] [LOCAL ] PRG: Starting deletion of derivative data. [2025-10-08T21:02:15.444293] [DEBUG] [LOCAL ] PRG: No derivative data file found to delete. [2025-10-08T21:02:15.444349] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRG took 38.0s. Estimated remaining: 1h 31m 5s. Rate: 7.1 symbols/min [2025-10-08T21:02:15.609522] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:15.609675] [DEBUG] [LOCAL ] PRIM: No existing data file found in primary storage. [2025-10-08T21:02:15.609732] [WARN ] [MAIN ] PRIM: No existing data found, performing full refresh instead. [2025-10-08T21:02:15.609840] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-08T21:02:15.609882] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-08T21:02:15.609922] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-08T21:02:15.609954] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-08T21:02:15.978607] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:16.017546] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-10-08T21:02:16.817615] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-08T21:02:17.617542] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-08T21:02:17.933362] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T21:02:17.936265] [INFO ] [REMOTE ] PRA: Full fetch complete (43946 records). [2025-10-08T21:02:17.936423] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-08T21:02:17.937271] [FATAL] [VALIDATOR ] PRA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:17.937400] [FATAL] [MAIN ] PRA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:17.937477] [WARN ] [MAIN ] PRA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:17.937554] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-08T21:02:17.937629] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-08T21:02:17.937716] [INFO ] [LOCAL ] PRA: Starting deletion of derivative data. [2025-10-08T21:02:17.937768] [DEBUG] [LOCAL ] PRA: No derivative data file found to delete. [2025-10-08T21:02:17.937839] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PRA took 40.5s. Estimated remaining: 1h 30m 55s. Rate: 7.1 symbols/min [2025-10-08T21:02:18.122220] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:18.122511] [DEBUG] [LOCAL ] PRKS: No existing data file found in primary storage. [2025-10-08T21:02:18.122551] [WARN ] [MAIN ] PRKS: No existing data found, performing full refresh instead. [2025-10-08T21:02:18.122711] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-08T21:02:18.122766] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-08T21:02:18.122809] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-08T21:02:18.122845] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-08T21:02:18.423466] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-08T21:02:18.486100] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:18.671962] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-08T21:02:19.217597] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-08T21:02:19.978616] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-08T21:02:19.978975] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T21:02:20.017504] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-08T21:02:20.605264] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T21:02:20.817525] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-10-08T21:02:21.139247] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:02:21.617604] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-08T21:02:22.294839] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T21:02:22.417567] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-08T21:02:23.217577] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-08T21:02:23.353217] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:02:23.962399] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T21:02:24.017506] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-08T21:02:24.796249] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T21:02:24.817516] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-08T21:02:25.238916] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T21:02:25.617562] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-08T21:02:26.417566] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-08T21:02:26.577287] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T21:02:27.217564] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-08T21:02:27.451362] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T21:02:27.714585] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T21:02:28.017556] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-08T21:02:28.817575] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-08T21:02:28.872256] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T21:02:29.119852] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T21:02:29.617581] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-08T21:02:30.417508] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-08T21:02:30.789094] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T21:02:31.217527] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-08T21:02:31.323807] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T21:02:32.017601] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-08T21:02:32.573477] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-08T21:02:32.763700] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T21:02:32.817519] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-08T21:02:33.617533] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-08T21:02:33.879598] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:02:34.260708] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T21:02:34.417687] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-08T21:02:34.707278] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T21:02:34.982572] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T21:02:34.986398] [INFO ] [REMOTE ] PRGO: Full fetch complete (68230 records). [2025-10-08T21:02:34.986554] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-08T21:02:34.987422] [FATAL] [VALIDATOR ] PRGO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:34.987520] [FATAL] [MAIN ] PRGO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:34.987565] [WARN ] [MAIN ] PRGO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:34.987606] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-08T21:02:34.987697] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-08T21:02:34.987768] [INFO ] [LOCAL ] PRGO: Starting deletion of derivative data. [2025-10-08T21:02:34.987838] [DEBUG] [LOCAL ] PRGO: No derivative data file found to delete. [2025-10-08T21:02:34.987915] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRGO took 57.5s. Estimated remaining: 1h 30m 49s. Rate: 7.1 symbols/min [2025-10-08T21:02:35.196748] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:35.196973] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-08T21:02:35.197012] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-08T21:02:35.197143] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-08T21:02:35.197188] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-08T21:02:35.197257] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-08T21:02:35.197307] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-08T21:02:35.226246] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-08T21:02:35.570163] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:36.017567] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-10-08T21:02:36.524869] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T21:02:36.817551] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-08T21:02:37.022990] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T21:02:37.617564] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-08T21:02:38.325581] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:02:38.417556] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-08T21:02:38.952597] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T21:02:39.217686] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-08T21:02:40.017205] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T21:02:40.026426] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-08T21:02:40.062735] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T21:02:40.763792] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T21:02:40.817557] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-08T21:02:41.617603] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-08T21:02:42.417521] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-08T21:02:42.562851] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T21:02:42.610995] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T21:02:43.217561] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-08T21:02:44.017548] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-08T21:02:44.524635] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:02:44.526195] [INFO ] [REMOTE ] PRI: Full fetch complete (25515 records). [2025-10-08T21:02:44.526266] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-08T21:02:44.526881] [FATAL] [VALIDATOR ] PRI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:44.527036] [FATAL] [MAIN ] PRI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:44.527235] [WARN ] [MAIN ] PRI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:44.527377] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-08T21:02:44.527507] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-08T21:02:44.527634] [INFO ] [LOCAL ] PRI: Starting deletion of derivative data. [2025-10-08T21:02:44.527774] [DEBUG] [LOCAL ] PRI: No derivative data file found to delete. [2025-10-08T21:02:44.527868] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRI took 31.3s. Estimated remaining: 1h 30m 41s. Rate: 7.1 symbols/min [2025-10-08T21:02:44.734534] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-08T21:02:44.755735] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:44.756092] [DEBUG] [LOCAL ] PRM: No existing data file found in primary storage. [2025-10-08T21:02:44.756197] [WARN ] [MAIN ] PRM: No existing data found, performing full refresh instead. [2025-10-08T21:02:44.766075] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-08T21:02:44.766828] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-08T21:02:44.766967] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-08T21:02:44.767064] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-08T21:02:44.820357] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-08T21:02:45.083488] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T21:02:45.234599] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:45.617562] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-08T21:02:46.417549] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-08T21:02:46.734672] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T21:02:46.792612] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:02:46.871058] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T21:02:46.874849] [INFO ] [REMOTE ] PRKS: Full fetch complete (61210 records). [2025-10-08T21:02:46.874993] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-08T21:02:46.875859] [FATAL] [VALIDATOR ] PRKS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:46.875958] [FATAL] [MAIN ] PRKS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:46.876029] [WARN ] [MAIN ] PRKS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:46.876126] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-08T21:02:46.876219] [DEBUG] [LOCAL ] PRKS: No primary data file found to delete. [2025-10-08T21:02:46.876270] [INFO ] [LOCAL ] PRKS: Starting deletion of derivative data. [2025-10-08T21:02:46.876333] [DEBUG] [LOCAL ] PRKS: No derivative data file found to delete. [2025-10-08T21:02:46.876450] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRKS took 28.9s. Estimated remaining: 1h 30m 31s. Rate: 7.1 symbols/min [2025-10-08T21:02:47.047987] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:47.048189] [DEBUG] [LOCAL ] PRMB: No existing data file found in primary storage. [2025-10-08T21:02:47.048227] [WARN ] [MAIN ] PRMB: No existing data found, performing full refresh instead. [2025-10-08T21:02:47.048345] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-08T21:02:47.048386] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-08T21:02:47.048440] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-08T21:02:47.048506] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-08T21:02:47.218802] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-08T21:02:47.414002] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:48.017560] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-08T21:02:48.817542] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-10-08T21:02:48.884538] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T21:02:49.195425] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T21:02:49.617612] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-08T21:02:50.300203] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:02:50.306031] [INFO ] [REMOTE ] PRIM: Full fetch complete (63219 records). [2025-10-08T21:02:50.306138] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-08T21:02:50.306930] [FATAL] [VALIDATOR ] PRIM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:02:50.307024] [FATAL] [MAIN ] PRIM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:02:50.307104] [WARN ] [MAIN ] PRIM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:02:50.307178] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-08T21:02:50.307242] [DEBUG] [LOCAL ] PRIM: No primary data file found to delete. [2025-10-08T21:02:50.307276] [INFO ] [LOCAL ] PRIM: Starting deletion of derivative data. [2025-10-08T21:02:50.307318] [DEBUG] [LOCAL ] PRIM: No derivative data file found to delete. [2025-10-08T21:02:50.307374] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 34.9s. Estimated remaining: 1h 30m 20s. Rate: 7.1 symbols/min [2025-10-08T21:02:50.422781] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-10-08T21:02:50.484122] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:02:50.484403] [DEBUG] [LOCAL ] PRO: No existing data file found in primary storage. [2025-10-08T21:02:50.484483] [WARN ] [MAIN ] PRO: No existing data found, performing full refresh instead. [2025-10-08T21:02:50.484939] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-08T21:02:50.485081] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-08T21:02:50.485227] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-08T21:02:50.485279] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-08T21:02:50.859568] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:02:50.888545] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-08T21:02:51.217566] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-08T21:02:52.017602] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-08T21:02:52.515970] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T21:02:52.817613] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-08T21:02:52.906263] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T21:02:53.617572] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-10-08T21:02:53.853767] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T21:02:54.028836] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:02:54.417573] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-08T21:02:54.791503] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T21:02:55.217552] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-08T21:02:56.017512] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-08T21:02:56.057792] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T21:02:56.278405] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T21:02:56.817576] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-08T21:02:57.556170] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T21:02:57.617554] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-08T21:02:58.043998] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T21:02:58.417557] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-08T21:02:59.217537] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-08T21:02:59.379785] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T21:02:59.785860] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T21:03:00.017551] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-08T21:03:00.087548] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T21:03:00.817549] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-08T21:03:01.467137] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T21:03:01.617584] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-08T21:03:01.965300] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T21:03:02.417602] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-08T21:03:03.217561] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-08T21:03:03.274124] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T21:03:03.983663] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T21:03:04.017541] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-08T21:03:04.817618] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-08T21:03:05.335546] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-08T21:03:05.604678] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T21:03:05.617496] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-08T21:03:05.827985] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T21:03:06.417600] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-08T21:03:07.217589] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-08T21:03:07.717096] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T21:03:07.794823] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-08T21:03:08.017626] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-08T21:03:08.436302] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:03:08.437871] [INFO ] [REMOTE ] PRLB: Full fetch complete (30362 records). [2025-10-08T21:03:08.437976] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-08T21:03:08.438962] [FATAL] [VALIDATOR ] PRLB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:03:08.439270] [FATAL] [MAIN ] PRLB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:08.439316] [WARN ] [MAIN ] PRLB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:08.439383] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-08T21:03:08.439449] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-08T21:03:08.439487] [INFO ] [LOCAL ] PRLB: Starting deletion of derivative data. [2025-10-08T21:03:08.439526] [DEBUG] [LOCAL ] PRLB: No derivative data file found to delete. [2025-10-08T21:03:08.439598] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRLB took 33.5s. Estimated remaining: 1h 30m 15s. Rate: 7.1 symbols/min [2025-10-08T21:03:08.617567] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:08.617817] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-08T21:03:08.617897] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-08T21:03:08.618221] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-08T21:03:08.618305] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-08T21:03:08.618370] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-08T21:03:08.618501] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-08T21:03:08.867714] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-08T21:03:08.968808] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:03:09.105119] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:09.617595] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-10-08T21:03:09.957359] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:03:09.957724] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-10-08T21:03:09.957814] [FATAL] [REMOTE ] PRSU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:03:09.957866] [FATAL] [MAIN ] PRSU: Failed to fetch primary data. [2025-10-08T21:03:09.957902] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:03:09.957938] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-08T21:03:09.957993] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-08T21:03:09.958027] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-10-08T21:03:09.958063] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-10-08T21:03:09.958300] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRSU took 1.5s. Estimated remaining: 1h 30m 4s. Rate: 7.1 symbols/min [2025-10-08T21:03:10.132666] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:10.132880] [DEBUG] [LOCAL ] PRT: No existing data file found in primary storage. [2025-10-08T21:03:10.132919] [WARN ] [MAIN ] PRT: No existing data found, performing full refresh instead. [2025-10-08T21:03:10.133034] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-08T21:03:10.133074] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-08T21:03:10.133115] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-08T21:03:10.133148] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-08T21:03:10.419746] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-08T21:03:10.507710] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:10.651371] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T21:03:11.217608] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-08T21:03:12.017620] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-08T21:03:12.817723] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-10-08T21:03:12.983940] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T21:03:13.132620] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-10-08T21:03:13.600960] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T21:03:13.617525] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-08T21:03:13.758422] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T21:03:14.417570] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-08T21:03:15.217702] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-08T21:03:15.427406] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T21:03:16.017528] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-08T21:03:16.256469] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T21:03:16.297874] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T21:03:16.817578] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-08T21:03:17.617574] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-08T21:03:17.709150] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T21:03:17.800690] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:03:18.417582] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-08T21:03:18.846257] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:03:18.850419] [INFO ] [REMOTE ] PRM: Full fetch complete (64232 records). [2025-10-08T21:03:18.850611] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-08T21:03:18.851512] [FATAL] [VALIDATOR ] PRM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:03:18.851609] [FATAL] [MAIN ] PRM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:18.851689] [WARN ] [MAIN ] PRM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:18.851750] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-08T21:03:18.851816] [DEBUG] [LOCAL ] PRM: No primary data file found to delete. [2025-10-08T21:03:18.851854] [INFO ] [LOCAL ] PRM: Starting deletion of derivative data. [2025-10-08T21:03:18.851896] [DEBUG] [LOCAL ] PRM: No derivative data file found to delete. [2025-10-08T21:03:18.851962] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRM took 34.3s. Estimated remaining: 1h 29m 56s. Rate: 7.1 symbols/min [2025-10-08T21:03:19.052612] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:19.053223] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-08T21:03:19.053349] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-08T21:03:19.053539] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-08T21:03:19.053624] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-08T21:03:19.053825] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-08T21:03:19.053880] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-08T21:03:19.217783] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-08T21:03:19.523407] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:19.527386] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-08T21:03:20.017560] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-10-08T21:03:20.817589] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-08T21:03:21.617733] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-08T21:03:21.884085] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-08T21:03:21.951875] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T21:03:22.417707] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-08T21:03:22.448014] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T21:03:22.490525] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T21:03:23.217585] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-08T21:03:23.922685] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T21:03:24.017506] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-08T21:03:24.223581] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T21:03:24.817582] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-08T21:03:25.617565] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-08T21:03:26.071455] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:03:26.364801] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-08T21:03:26.417582] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-08T21:03:27.199087] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T21:03:27.202273] [INFO ] [REMOTE ] PRO: Full fetch complete (52304 records). [2025-10-08T21:03:27.202374] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-08T21:03:27.203408] [FATAL] [VALIDATOR ] PRO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:03:27.203506] [FATAL] [MAIN ] PRO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:27.203547] [WARN ] [MAIN ] PRO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:27.203585] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-08T21:03:27.203682] [DEBUG] [LOCAL ] PRO: No primary data file found to delete. [2025-10-08T21:03:27.203750] [INFO ] [LOCAL ] PRO: Starting deletion of derivative data. [2025-10-08T21:03:27.203827] [DEBUG] [LOCAL ] PRO: No derivative data file found to delete. [2025-10-08T21:03:27.203913] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRO took 36.9s. Estimated remaining: 1h 29m 48s. Rate: 7.1 symbols/min [2025-10-08T21:03:27.226504] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-08T21:03:27.394393] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:27.394685] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-08T21:03:27.394740] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-08T21:03:27.394901] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-08T21:03:27.394963] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-08T21:03:27.395030] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-08T21:03:27.395065] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-08T21:03:27.781744] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:27.826978] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-08T21:03:28.017682] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-10-08T21:03:28.817584] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-08T21:03:28.905856] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T21:03:29.617847] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-08T21:03:29.768035] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-08T21:03:30.162311] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T21:03:30.417600] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-08T21:03:30.828024] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-08T21:03:30.872766] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T21:03:31.217559] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-08T21:03:31.635860] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T21:03:32.017576] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-08T21:03:32.516198] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T21:03:32.817533] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-08T21:03:33.617698] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-08T21:03:34.326322] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:03:34.330150] [INFO ] [REMOTE ] PRMB: Full fetch complete (75693 records). [2025-10-08T21:03:34.330328] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-08T21:03:34.331205] [FATAL] [VALIDATOR ] PRMB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:03:34.331315] [FATAL] [MAIN ] PRMB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:34.331361] [WARN ] [MAIN ] PRMB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:34.331452] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-08T21:03:34.331534] [DEBUG] [LOCAL ] PRMB: No primary data file found to delete. [2025-10-08T21:03:34.331582] [INFO ] [LOCAL ] PRMB: Starting deletion of derivative data. [2025-10-08T21:03:34.331638] [DEBUG] [LOCAL ] PRMB: No derivative data file found to delete. [2025-10-08T21:03:34.331805] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRMB took 47.5s. Estimated remaining: 1h 29m 39s. Rate: 7.1 symbols/min [2025-10-08T21:03:34.422687] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-08T21:03:34.526849] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:34.527265] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-08T21:03:34.527330] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-08T21:03:34.527708] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-08T21:03:34.527789] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-08T21:03:34.527926] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-08T21:03:34.527983] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-08T21:03:34.928662] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:34.969330] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-08T21:03:34.967343] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T21:03:35.217545] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-08T21:03:35.954326] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T21:03:36.017519] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-08T21:03:36.817580] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-08T21:03:37.521408] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-08T21:03:37.617545] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-08T21:03:37.859242] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T21:03:38.417565] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-08T21:03:38.628353] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T21:03:38.790574] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-08T21:03:39.217552] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-10-08T21:03:40.017563] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-08T21:03:40.740802] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T21:03:40.817499] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-08T21:03:41.617552] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-08T21:03:41.800173] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T21:03:42.042468] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-08T21:03:42.417518] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-08T21:03:42.572007] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T21:03:42.761228] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T21:03:43.217576] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-08T21:03:43.574488] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T21:03:43.575609] [INFO ] [REMOTE ] PRT: Full fetch complete (8881 records). [2025-10-08T21:03:43.575733] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-08T21:03:43.576252] [FATAL] [VALIDATOR ] PRT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:03:43.576349] [FATAL] [MAIN ] PRT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:43.576420] [WARN ] [MAIN ] PRT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:43.576502] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-08T21:03:43.576604] [DEBUG] [LOCAL ] PRT: No primary data file found to delete. [2025-10-08T21:03:43.576688] [INFO ] [LOCAL ] PRT: Starting deletion of derivative data. [2025-10-08T21:03:43.576758] [DEBUG] [LOCAL ] PRT: No derivative data file found to delete. [2025-10-08T21:03:43.576838] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRT took 33.6s. Estimated remaining: 1h 29m 31s. Rate: 7.1 symbols/min [2025-10-08T21:03:43.763118] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:43.763359] [DEBUG] [LOCAL ] PSBD: No existing data file found in primary storage. [2025-10-08T21:03:43.763415] [WARN ] [MAIN ] PSBD: No existing data found, performing full refresh instead. [2025-10-08T21:03:43.763535] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-08T21:03:43.763576] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-08T21:03:43.763617] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-08T21:03:43.763674] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-08T21:03:44.022728] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-08T21:03:44.126233] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:44.532861] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T21:03:44.817596] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-08T21:03:45.617568] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-08T21:03:46.145901] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-08T21:03:46.400694] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T21:03:46.417505] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-08T21:03:46.791854] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:03:46.792704] [INFO ] [REMOTE ] PRVS: Full fetch complete (1269 records). [2025-10-08T21:03:46.792775] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-08T21:03:46.975467] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-08T21:03:46.975712] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:03:46.975769] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:03:46.975821] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-08T21:03:46.975958] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-08T21:03:46.976016] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-08T21:03:46.976076] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-08T21:03:46.976204] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRVS took 19.8s. Estimated remaining: 1h 29m 20s. Rate: 7.1 symbols/min [2025-10-08T21:03:47.148103] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:03:47.158903] [DEBUG] [LOCAL ] PSF: Loaded 6979 existing records from primary storage. [2025-10-08T21:03:47.159187] [INFO ] [MAIN ] PSF: Loaded 6979 existing records. [2025-10-08T21:03:47.222740] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-08T21:03:47.346056] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:03:47.346275] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-08T21:03:47.346324] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-08T21:03:47.346731] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-08T21:03:47.346796] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-08T21:03:47.716963] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:03:48.017546] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-10-08T21:03:48.817598] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-10-08T21:03:48.847923] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T21:03:49.196917] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-08T21:03:49.617612] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-08T21:03:49.672766] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T21:03:50.417623] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-08T21:03:51.209360] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T21:03:51.221004] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-08T21:03:52.017581] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-08T21:03:52.124555] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T21:03:52.182248] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T21:03:52.817584] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-08T21:03:53.297421] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T21:03:53.617574] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-08T21:03:53.892176] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T21:03:54.417594] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-08T21:03:55.109995] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T21:03:55.217551] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-08T21:03:55.592156] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T21:03:56.017818] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-08T21:03:56.019150] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T21:03:56.609562] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T21:03:56.817579] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-08T21:03:57.361789] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T21:03:57.617573] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-08T21:03:58.350112] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T21:03:58.417575] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-08T21:03:59.217575] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-08T21:03:59.916307] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T21:03:59.943278] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T21:04:00.017537] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-08T21:04:00.817590] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-08T21:04:00.847901] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T21:04:01.617560] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-08T21:04:02.417612] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-08T21:04:02.560555] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T21:04:02.982792] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-08T21:04:03.186282] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T21:04:03.217706] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-08T21:04:04.005408] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T21:04:04.017490] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-08T21:04:04.672354] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T21:04:04.817639] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-08T21:04:05.311873] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T21:04:05.315871] [INFO ] [REMOTE ] PRU: Full fetch complete (73826 records). [2025-10-08T21:04:05.316033] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-08T21:04:05.317775] [FATAL] [VALIDATOR ] PRU: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:05.317887] [FATAL] [MAIN ] PRU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:05.317954] [WARN ] [MAIN ] PRU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:05.318042] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-08T21:04:05.318124] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-08T21:04:05.318199] [INFO ] [LOCAL ] PRU: Starting deletion of derivative data. [2025-10-08T21:04:05.318267] [DEBUG] [LOCAL ] PRU: No derivative data file found to delete. [2025-10-08T21:04:05.318350] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRU took 46.5s. Estimated remaining: 1h 29m 16s. Rate: 7.1 symbols/min [2025-10-08T21:04:05.496081] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:05.496297] [DEBUG] [LOCAL ] PSFE: No existing data file found in primary storage. [2025-10-08T21:04:05.496341] [WARN ] [MAIN ] PSFE: No existing data found, performing full refresh instead. [2025-10-08T21:04:05.496463] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-08T21:04:05.496534] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-08T21:04:05.496603] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-08T21:04:05.496693] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-08T21:04:05.622668] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-08T21:04:05.877362] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:06.417562] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-08T21:04:07.217577] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-08T21:04:07.664454] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:04:07.930953] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-08T21:04:07.960713] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T21:04:08.017560] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-08T21:04:08.588840] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T21:04:08.590219] [INFO ] [REMOTE ] PSBD: Full fetch complete (9765 records). [2025-10-08T21:04:08.590288] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-08T21:04:08.590767] [FATAL] [VALIDATOR ] PSBD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:08.590848] [FATAL] [MAIN ] PSBD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:08.590890] [WARN ] [MAIN ] PSBD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:08.590927] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-08T21:04:08.590996] [DEBUG] [LOCAL ] PSBD: No primary data file found to delete. [2025-10-08T21:04:08.591050] [INFO ] [LOCAL ] PSBD: Starting deletion of derivative data. [2025-10-08T21:04:08.591107] [DEBUG] [LOCAL ] PSBD: No derivative data file found to delete. [2025-10-08T21:04:08.591193] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PSBD took 25.0s. Estimated remaining: 1h 29m 5s. Rate: 7.1 symbols/min [2025-10-08T21:04:08.758132] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:08.758341] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-08T21:04:08.758383] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-08T21:04:08.758493] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-08T21:04:08.758534] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-08T21:04:08.758574] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-08T21:04:08.758606] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-08T21:04:08.822779] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-08T21:04:09.123625] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:09.618404] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-10-08T21:04:09.621896] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T21:04:10.417577] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-08T21:04:10.936819] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T21:04:11.217743] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-10-08T21:04:11.575140] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T21:04:12.017698] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-08T21:04:12.817535] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-08T21:04:13.060434] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T21:04:13.541822] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T21:04:13.617540] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-08T21:04:13.671090] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T21:04:14.417535] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-08T21:04:14.489308] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T21:04:15.217608] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-08T21:04:15.889965] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T21:04:15.891318] [INFO ] [REMOTE ] PSF: Full fetch complete (9835 records). [2025-10-08T21:04:15.891434] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-08T21:04:16.019287] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-08T21:04:16.273317] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-08T21:04:16.273441] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-08T21:04:16.273841] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-08T21:04:16.273915] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-08T21:04:16.274779] [DEBUG] [LOCAL ] PSF: Trimmed 9835 records to 6974 (keeping 200 days of data) [2025-10-08T21:04:16.345227] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T21:04:16.370925] [DEBUG] [LOCAL ] PSF: Primary data saved (6974 records). [2025-10-08T21:04:16.371102] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-08T21:04:16.371198] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSF took 29.4s. Estimated remaining: 1h 28m 57s. Rate: 7.1 symbols/min [2025-10-08T21:04:16.550758] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:16.550945] [DEBUG] [LOCAL ] PSO: No existing data file found in primary storage. [2025-10-08T21:04:16.550983] [WARN ] [MAIN ] PSO: No existing data found, performing full refresh instead. [2025-10-08T21:04:16.551097] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-08T21:04:16.551138] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-08T21:04:16.551178] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-08T21:04:16.551209] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-08T21:04:16.822919] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-08T21:04:16.926271] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:17.091215] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T21:04:17.617601] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-10-08T21:04:18.417581] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-08T21:04:18.490453] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:04:18.758964] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-08T21:04:18.780985] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T21:04:18.779900] [INFO ] [REMOTE ] PSA: Full fetch complete (58992 records). [2025-10-08T21:04:18.787846] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-08T21:04:18.788794] [FATAL] [VALIDATOR ] PSA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:18.788889] [FATAL] [MAIN ] PSA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:18.788933] [WARN ] [MAIN ] PSA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:18.788972] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-08T21:04:18.789105] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-08T21:04:18.789166] [INFO ] [LOCAL ] PSA: Starting deletion of derivative data. [2025-10-08T21:04:18.789210] [DEBUG] [LOCAL ] PSA: No derivative data file found to delete. [2025-10-08T21:04:18.789320] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 44.5s. Estimated remaining: 1h 28m 46s. Rate: 7.1 symbols/min [2025-10-08T21:04:18.964109] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:18.964312] [DEBUG] [LOCAL ] PSQH: No existing data file found in primary storage. [2025-10-08T21:04:18.964349] [WARN ] [MAIN ] PSQH: No existing data found, performing full refresh instead. [2025-10-08T21:04:18.964466] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-08T21:04:18.964508] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-08T21:04:18.964547] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-08T21:04:18.964578] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-08T21:04:19.222716] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-08T21:04:19.344369] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:20.017602] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-10-08T21:04:20.817681] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-08T21:04:21.435603] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-08T21:04:21.617569] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-08T21:04:21.966450] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T21:04:22.022108] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T21:04:22.417607] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-08T21:04:22.752628] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T21:04:23.217571] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-08T21:04:23.925519] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T21:04:24.017589] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-08T21:04:24.828472] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-08T21:04:24.833079] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T21:04:25.617690] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-08T21:04:25.784348] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T21:04:25.938195] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T21:04:26.417570] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-08T21:04:26.965146] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:04:27.217577] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-08T21:04:27.741316] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T21:04:28.017568] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-08T21:04:28.695590] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T21:04:28.817551] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-08T21:04:29.366345] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T21:04:29.617576] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-08T21:04:30.417569] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-08T21:04:30.626152] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T21:04:31.217636] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-08T21:04:31.724811] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-08T21:04:32.017542] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-08T21:04:32.294460] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T21:04:32.495397] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-08T21:04:32.817630] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-08T21:04:32.926376] [DEBUG] [REMOTE ] PSFE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-08T21:04:32.926834] [WARN ] [REMOTE ] PSFE: No data returned for month 2025-08 [2025-10-08T21:04:32.926963] [FATAL] [REMOTE ] PSFE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:04:32.927078] [FATAL] [MAIN ] PSFE: Failed to fetch primary data. [2025-10-08T21:04:32.927168] [WARN ] [MAIN ] PSFE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:04:32.927264] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-08T21:04:32.927379] [DEBUG] [LOCAL ] PSFE: No primary data file found to delete. [2025-10-08T21:04:32.927455] [INFO ] [LOCAL ] PSFE: Starting deletion of derivative data. [2025-10-08T21:04:32.927523] [DEBUG] [LOCAL ] PSFE: No derivative data file found to delete. [2025-10-08T21:04:32.927623] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 27.6s. Estimated remaining: 1h 28m 40s. Rate: 7.1 symbols/min [2025-10-08T21:04:33.114051] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:33.114275] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-08T21:04:33.114332] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-08T21:04:33.114471] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-08T21:04:33.114541] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-08T21:04:33.114599] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-08T21:04:33.114634] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-08T21:04:33.496681] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:33.617564] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-08T21:04:33.754731] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T21:04:34.417601] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-10-08T21:04:35.217514] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-08T21:04:35.293416] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T21:04:36.017622] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-08T21:04:36.572947] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T21:04:36.817567] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-08T21:04:37.061978] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T21:04:37.237176] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T21:04:37.617560] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-08T21:04:38.417561] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-08T21:04:38.822196] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T21:04:38.868658] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-08T21:04:39.217570] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-08T21:04:40.017565] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-08T21:04:40.119277] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T21:04:40.600975] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T21:04:40.817563] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-08T21:04:41.617614] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-08T21:04:42.417574] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-08T21:04:42.557214] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-08T21:04:43.024234] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T21:04:43.125058] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T21:04:43.217533] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-08T21:04:44.017529] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-08T21:04:44.108501] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T21:04:44.724577] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:04:44.727397] [INFO ] [REMOTE ] PSQH: Full fetch complete (53158 records). [2025-10-08T21:04:44.727497] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-08T21:04:44.728325] [FATAL] [VALIDATOR ] PSQH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:44.728419] [FATAL] [MAIN ] PSQH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:44.728462] [WARN ] [MAIN ] PSQH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:44.728530] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-08T21:04:44.728596] [DEBUG] [LOCAL ] PSQH: No primary data file found to delete. [2025-10-08T21:04:44.728633] [INFO ] [LOCAL ] PSQH: Starting deletion of derivative data. [2025-10-08T21:04:44.728718] [DEBUG] [LOCAL ] PSQH: No derivative data file found to delete. [2025-10-08T21:04:44.728784] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSQH took 25.9s. Estimated remaining: 1h 28m 32s. Rate: 7.1 symbols/min [2025-10-08T21:04:44.822623] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-08T21:04:44.967695] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:44.967976] [DEBUG] [LOCAL ] PSTL: No existing data file found in primary storage. [2025-10-08T21:04:44.968200] [WARN ] [MAIN ] PSTL: No existing data found, performing full refresh instead. [2025-10-08T21:04:44.968353] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-08T21:04:44.968396] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-08T21:04:44.968439] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-08T21:04:44.968473] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-08T21:04:45.363588] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:45.394824] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T21:04:45.617556] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-10-08T21:04:46.310278] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T21:04:46.417554] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-08T21:04:46.552948] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T21:04:47.217562] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-08T21:04:48.024523] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-08T21:04:48.042364] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T21:04:48.421404] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T21:04:48.817548] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-08T21:04:49.617543] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-08T21:04:49.781043] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T21:04:50.398706] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T21:04:50.417550] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-08T21:04:51.217546] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-08T21:04:51.270454] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T21:04:51.651235] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:04:51.654234] [INFO ] [REMOTE ] PSN: Full fetch complete (66769 records). [2025-10-08T21:04:51.654331] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-08T21:04:51.654966] [FATAL] [VALIDATOR ] PSN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:51.655089] [FATAL] [MAIN ] PSN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:51.655131] [WARN ] [MAIN ] PSN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:51.655168] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-08T21:04:51.655224] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-08T21:04:51.655258] [INFO ] [LOCAL ] PSN: Starting deletion of derivative data. [2025-10-08T21:04:51.655316] [DEBUG] [LOCAL ] PSN: No derivative data file found to delete. [2025-10-08T21:04:51.655399] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSN took 43.1s. Estimated remaining: 1h 28m 23s. Rate: 7.1 symbols/min [2025-10-08T21:04:51.825332] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:51.825499] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-08T21:04:51.825537] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-08T21:04:51.825671] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-08T21:04:51.825729] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-08T21:04:51.825773] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-08T21:04:51.825806] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-08T21:04:52.028445] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-08T21:04:52.188869] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:52.320711] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T21:04:52.817561] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-08T21:04:53.410426] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T21:04:53.617625] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-10-08T21:04:54.210277] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T21:04:54.417568] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-08T21:04:55.217852] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-08T21:04:55.571716] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T21:04:55.724799] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T21:04:56.017618] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-08T21:04:56.423510] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T21:04:56.817580] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-08T21:04:57.515631] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:04:57.617557] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-08T21:04:58.125550] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:04:58.128385] [INFO ] [REMOTE ] PSO: Full fetch complete (51782 records). [2025-10-08T21:04:58.128538] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-08T21:04:58.129385] [FATAL] [VALIDATOR ] PSO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:04:58.129504] [FATAL] [MAIN ] PSO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:04:58.129547] [WARN ] [MAIN ] PSO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:04:58.129585] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-08T21:04:58.129665] [DEBUG] [LOCAL ] PSO: No primary data file found to delete. [2025-10-08T21:04:58.129736] [INFO ] [LOCAL ] PSO: Starting deletion of derivative data. [2025-10-08T21:04:58.129806] [DEBUG] [LOCAL ] PSO: No derivative data file found to delete. [2025-10-08T21:04:58.129869] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSO took 41.8s. Estimated remaining: 1h 28m 14s. Rate: 7.1 symbols/min [2025-10-08T21:04:58.312978] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:04:58.313174] [DEBUG] [LOCAL ] PTA: No existing data file found in primary storage. [2025-10-08T21:04:58.313264] [WARN ] [MAIN ] PTA: No existing data found, performing full refresh instead. [2025-10-08T21:04:58.313382] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-08T21:04:58.313438] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-08T21:04:58.313483] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-08T21:04:58.314345] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-08T21:04:58.419236] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-08T21:04:58.692239] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:04:58.745318] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T21:04:59.217561] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-08T21:04:59.720431] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T21:05:00.017682] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-08T21:05:00.817605] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-08T21:05:01.619948] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-10-08T21:05:01.625733] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-08T21:05:02.246375] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T21:05:02.381873] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-08T21:05:02.417540] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-08T21:05:02.996547] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T21:05:03.217561] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-08T21:05:04.017523] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-08T21:05:04.356918] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T21:05:04.817589] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-08T21:05:05.215505] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-08T21:05:05.216397] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T21:05:05.617600] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-08T21:05:06.266522] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T21:05:06.417501] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-08T21:05:06.913806] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T21:05:07.135360] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T21:05:07.217530] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-08T21:05:08.017567] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-08T21:05:08.284281] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T21:05:08.818861] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-08T21:05:08.821417] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T21:05:09.617584] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-08T21:05:09.861703] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T21:05:10.397972] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T21:05:10.417489] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-08T21:05:11.217582] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-08T21:05:11.731135] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T21:05:12.017603] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-08T21:05:12.782310] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T21:05:12.784242] [INFO ] [REMOTE ] PSTL: Full fetch complete (29598 records). [2025-10-08T21:05:12.784329] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-08T21:05:12.785037] [FATAL] [VALIDATOR ] PSTL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:12.785151] [FATAL] [MAIN ] PSTL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:12.785227] [WARN ] [MAIN ] PSTL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:12.785321] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-08T21:05:12.785417] [DEBUG] [LOCAL ] PSTL: No primary data file found to delete. [2025-10-08T21:05:12.785472] [INFO ] [LOCAL ] PSTL: Starting deletion of derivative data. [2025-10-08T21:05:12.785518] [DEBUG] [LOCAL ] PSTL: No derivative data file found to delete. [2025-10-08T21:05:12.785623] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSTL took 28.1s. Estimated remaining: 1h 28m 8s. Rate: 7.1 symbols/min [2025-10-08T21:05:12.822744] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-08T21:05:12.972541] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:13.016304] [DEBUG] [LOCAL ] PTY: Loaded 37381 existing records from primary storage. [2025-10-08T21:05:13.016630] [INFO ] [MAIN ] PTY: Loaded 37381 existing records. [2025-10-08T21:05:13.209512] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:05:13.209834] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-08T21:05:13.210206] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-08T21:05:13.210631] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-08T21:05:13.210741] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-08T21:05:13.595843] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:13.623357] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-08T21:05:13.637663] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-08T21:05:13.867295] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T21:05:14.417566] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-08T21:05:15.217542] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-10-08T21:05:15.556544] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T21:05:15.804835] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-08T21:05:16.017565] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-08T21:05:16.741703] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T21:05:16.817550] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-08T21:05:17.617537] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-08T21:05:17.664169] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T21:05:18.361255] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:05:18.417548] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-08T21:05:18.450734] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:05:19.217571] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-08T21:05:20.017574] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-08T21:05:20.505489] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T21:05:20.715481] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T21:05:20.817499] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-08T21:05:20.903213] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T21:05:21.234595] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:05:21.236309] [INFO ] [REMOTE ] PTA: Full fetch complete (22859 records). [2025-10-08T21:05:21.236410] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-08T21:05:21.236954] [FATAL] [VALIDATOR ] PTA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:21.237043] [FATAL] [MAIN ] PTA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:21.237087] [WARN ] [MAIN ] PTA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:21.237159] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-08T21:05:21.237222] [DEBUG] [LOCAL ] PTA: No primary data file found to delete. [2025-10-08T21:05:21.237258] [INFO ] [LOCAL ] PTA: Starting deletion of derivative data. [2025-10-08T21:05:21.237297] [DEBUG] [LOCAL ] PTA: No derivative data file found to delete. [2025-10-08T21:05:21.237353] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PTA took 23.1s. Estimated remaining: 1h 27m 60s. Rate: 7.1 symbols/min [2025-10-08T21:05:21.408212] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:21.408407] [DEBUG] [LOCAL ] PUK: No existing data file found in primary storage. [2025-10-08T21:05:21.408446] [WARN ] [MAIN ] PUK: No existing data found, performing full refresh instead. [2025-10-08T21:05:21.408561] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-08T21:05:21.408603] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-08T21:05:21.408679] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-08T21:05:21.408736] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-08T21:05:21.622768] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-08T21:05:21.843373] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:22.281146] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T21:05:22.285287] [INFO ] [REMOTE ] PSTG: Full fetch complete (76173 records). [2025-10-08T21:05:22.285439] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-08T21:05:22.286431] [FATAL] [VALIDATOR ] PSTG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:22.286527] [FATAL] [MAIN ] PSTG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:22.286572] [WARN ] [MAIN ] PSTG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:22.286611] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-08T21:05:22.286703] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-08T21:05:22.286760] [INFO ] [LOCAL ] PSTG: Starting deletion of derivative data. [2025-10-08T21:05:22.286804] [DEBUG] [LOCAL ] PSTG: No derivative data file found to delete. [2025-10-08T21:05:22.286863] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTG took 49.4s. Estimated remaining: 1h 27m 49s. Rate: 7.1 symbols/min [2025-10-08T21:05:22.422742] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-10-08T21:05:22.491524] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:22.491797] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-08T21:05:22.491842] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-08T21:05:22.491951] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-08T21:05:22.491992] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-08T21:05:22.492033] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-08T21:05:22.492065] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-08T21:05:22.845077] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:23.217576] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-08T21:05:24.017566] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-08T21:05:24.817539] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-10-08T21:05:24.860357] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-08T21:05:25.176825] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-08T21:05:25.316383] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T21:05:25.617550] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-08T21:05:26.417555] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-08T21:05:26.672976] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T21:05:26.736203] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:05:27.217627] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-08T21:05:28.017566] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-08T21:05:28.105397] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T21:05:28.791725] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:05:28.817501] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-08T21:05:29.617523] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-08T21:05:29.866050] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-08T21:05:30.417528] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-08T21:05:30.517625] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T21:05:31.110890] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T21:05:31.217545] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-08T21:05:31.575442] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T21:05:31.578971] [INFO ] [REMOTE ] PSX: Full fetch complete (76655 records). [2025-10-08T21:05:31.579196] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-08T21:05:31.580429] [FATAL] [VALIDATOR ] PSX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:31.580524] [FATAL] [MAIN ] PSX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:31.580569] [WARN ] [MAIN ] PSX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:31.580609] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-08T21:05:31.580695] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-08T21:05:31.580779] [INFO ] [LOCAL ] PSX: Starting deletion of derivative data. [2025-10-08T21:05:31.580866] [DEBUG] [LOCAL ] PSX: No derivative data file found to delete. [2025-10-08T21:05:31.580938] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 39.9s. Estimated remaining: 1h 27m 41s. Rate: 7.1 symbols/min [2025-10-08T21:05:31.761278] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:31.761502] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-08T21:05:31.761586] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-08T21:05:31.761929] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-08T21:05:31.762045] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-08T21:05:31.762184] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-08T21:05:31.762337] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-08T21:05:31.963944] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T21:05:32.025235] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-08T21:05:32.178077] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:32.817606] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-08T21:05:33.552397] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T21:05:33.617589] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-08T21:05:34.189943] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T21:05:34.417552] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-10-08T21:05:35.217573] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-08T21:05:35.390413] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T21:05:35.835319] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T21:05:36.017566] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-08T21:05:36.804086] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T21:05:36.818571] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-08T21:05:37.617539] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-08T21:05:37.773372] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T21:05:38.308537] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T21:05:38.417588] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-08T21:05:39.229215] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-08T21:05:39.235720] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T21:05:39.684465] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T21:05:40.017567] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-08T21:05:40.767776] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T21:05:40.817580] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-08T21:05:41.623151] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-08T21:05:41.628197] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:05:42.417550] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-08T21:05:42.463806] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T21:05:43.217552] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-08T21:05:43.283091] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T21:05:43.429096] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T21:05:43.432359] [INFO ] [REMOTE ] PTY: Full fetch complete (53924 records). [2025-10-08T21:05:43.432477] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-08T21:05:43.821921] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-08T21:05:43.822033] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-08T21:05:43.822921] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-08T21:05:43.822984] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-08T21:05:43.824125] [DEBUG] [LOCAL ] PTY: Trimmed 53924 records to 37470 (keeping 200 days of data) [2025-10-08T21:05:44.035596] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-08T21:05:44.070198] [DEBUG] [LOCAL ] PTY: Primary data saved (37470 records). [2025-10-08T21:05:44.070326] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-08T21:05:44.070421] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTY took 31.3s. Estimated remaining: 1h 27m 34s. Rate: 7.1 symbols/min [2025-10-08T21:05:44.241305] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:44.241503] [DEBUG] [LOCAL ] PVL: No existing data file found in primary storage. [2025-10-08T21:05:44.241540] [WARN ] [MAIN ] PVL: No existing data found, performing full refresh instead. [2025-10-08T21:05:44.241682] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-08T21:05:44.241735] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-08T21:05:44.241778] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-08T21:05:44.241810] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-08T21:05:44.598415] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:44.817586] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-08T21:05:45.168965] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-08T21:05:45.617570] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-08T21:05:45.709150] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T21:05:46.417523] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-08T21:05:46.599299] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T21:05:46.772494] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T21:05:47.217546] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-08T21:05:47.827739] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T21:05:48.017701] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-08T21:05:48.817598] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-08T21:05:48.884503] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:05:49.617572] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-08T21:05:49.821133] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:05:50.417539] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-10-08T21:05:50.808181] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T21:05:51.217520] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-08T21:05:51.297579] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T21:05:51.488520] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T21:05:52.017527] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-08T21:05:52.817530] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-08T21:05:52.927716] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T21:05:53.332245] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T21:05:53.617521] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-08T21:05:53.782536] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:05:54.417578] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-08T21:05:54.997610] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T21:05:55.217523] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-08T21:05:55.487088] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T21:05:56.017593] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-08T21:05:56.817535] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-08T21:05:57.362409] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T21:05:57.454570] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T21:05:57.541880] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T21:05:57.548188] [INFO ] [REMOTE ] PUMP: Full fetch complete (71326 records). [2025-10-08T21:05:57.548495] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-08T21:05:57.551167] [FATAL] [VALIDATOR ] PUMP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:57.551392] [FATAL] [MAIN ] PUMP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:57.551438] [WARN ] [MAIN ] PUMP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:57.551508] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-08T21:05:57.551600] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-08T21:05:57.551686] [INFO ] [LOCAL ] PUMP: Starting deletion of derivative data. [2025-10-08T21:05:57.551773] [DEBUG] [LOCAL ] PUMP: No derivative data file found to delete. [2025-10-08T21:05:57.551876] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PUMP took 35.3s. Estimated remaining: 1h 27m 27s. Rate: 7.1 symbols/min [2025-10-08T21:05:57.622851] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-08T21:05:57.735741] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:05:57.736003] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-08T21:05:57.736058] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-08T21:05:57.736176] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-08T21:05:57.736224] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-08T21:05:57.736265] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-08T21:05:57.736299] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-08T21:05:58.103611] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:05:58.388941] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T21:05:58.417623] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-08T21:05:59.217716] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-08T21:05:59.850000] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T21:05:59.853137] [INFO ] [REMOTE ] PUK: Full fetch complete (64899 records). [2025-10-08T21:05:59.853308] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-08T21:05:59.854327] [FATAL] [VALIDATOR ] PUK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:05:59.854468] [FATAL] [MAIN ] PUK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:05:59.854517] [WARN ] [MAIN ] PUK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:05:59.854622] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-08T21:05:59.854783] [DEBUG] [LOCAL ] PUK: No primary data file found to delete. [2025-10-08T21:05:59.854850] [INFO ] [LOCAL ] PUK: Starting deletion of derivative data. [2025-10-08T21:05:59.854911] [DEBUG] [LOCAL ] PUK: No derivative data file found to delete. [2025-10-08T21:05:59.855009] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUK took 38.6s. Estimated remaining: 1h 27m 16s. Rate: 7.1 symbols/min [2025-10-08T21:06:00.030876] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-08T21:06:00.035962] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:00.037999] [DEBUG] [LOCAL ] PX: No existing data file found in primary storage. [2025-10-08T21:06:00.038066] [WARN ] [MAIN ] PX: No existing data found, performing full refresh instead. [2025-10-08T21:06:00.038208] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-08T21:06:00.038253] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-08T21:06:00.038295] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-08T21:06:00.038328] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-08T21:06:00.409996] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:00.817609] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-10-08T21:06:00.896520] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T21:06:01.240278] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T21:06:01.617589] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-08T21:06:02.417616] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-08T21:06:02.465728] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:06:02.867843] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T21:06:03.217529] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-08T21:06:03.505553] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T21:06:03.891859] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T21:06:04.017557] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-10-08T21:06:04.817597] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-08T21:06:05.617606] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-08T21:06:05.841663] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T21:06:06.417606] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-08T21:06:06.647912] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:06:06.933165] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-08T21:06:07.217506] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-08T21:06:07.296225] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:06:07.873211] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T21:06:07.877329] [INFO ] [REMOTE ] PVH: Full fetch complete (70569 records). [2025-10-08T21:06:07.877457] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-08T21:06:07.878306] [FATAL] [VALIDATOR ] PVH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:06:07.878399] [FATAL] [MAIN ] PVH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:06:07.878442] [WARN ] [MAIN ] PVH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:06:07.878482] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-08T21:06:07.878538] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-08T21:06:07.878576] [INFO ] [LOCAL ] PVH: Starting deletion of derivative data. [2025-10-08T21:06:07.878618] [DEBUG] [LOCAL ] PVH: No derivative data file found to delete. [2025-10-08T21:06:07.878728] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVH took 36.3s. Estimated remaining: 1h 27m 8s. Rate: 7.1 symbols/min [2025-10-08T21:06:08.025057] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-08T21:06:08.052116] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:08.052269] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-08T21:06:08.052313] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-08T21:06:08.052421] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-08T21:06:08.052462] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-08T21:06:08.052504] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-08T21:06:08.052537] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-08T21:06:08.422535] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:08.815402] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T21:06:08.817493] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-08T21:06:09.597342] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T21:06:09.617498] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-08T21:06:10.054764] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T21:06:10.055892] [INFO ] [REMOTE ] PVL: Full fetch complete (7280 records). [2025-10-08T21:06:10.055970] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-08T21:06:10.056516] [FATAL] [VALIDATOR ] PVL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:06:10.056670] [FATAL] [MAIN ] PVL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:06:10.056741] [WARN ] [MAIN ] PVL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:06:10.056814] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-08T21:06:10.056888] [DEBUG] [LOCAL ] PVL: No primary data file found to delete. [2025-10-08T21:06:10.056944] [INFO ] [LOCAL ] PVL: Starting deletion of derivative data. [2025-10-08T21:06:10.056988] [DEBUG] [LOCAL ] PVL: No derivative data file found to delete. [2025-10-08T21:06:10.057054] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVL took 26.0s. Estimated remaining: 1h 26m 57s. Rate: 7.1 symbols/min [2025-10-08T21:06:10.235740] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:10.235933] [DEBUG] [LOCAL ] QD: No existing data file found in primary storage. [2025-10-08T21:06:10.235970] [WARN ] [MAIN ] QD: No existing data found, performing full refresh instead. [2025-10-08T21:06:10.236084] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-08T21:06:10.236129] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-08T21:06:10.236173] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-08T21:06:10.236205] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-08T21:06:10.422726] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-08T21:06:10.598052] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:11.217588] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-08T21:06:12.017568] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-10-08T21:06:12.428070] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-08T21:06:12.504571] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T21:06:12.817551] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-08T21:06:13.617567] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-08T21:06:14.417633] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-10-08T21:06:14.626510] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-08T21:06:14.730935] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T21:06:15.115305] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T21:06:15.217516] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-08T21:06:15.551172] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:06:16.017575] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-08T21:06:16.817545] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-08T21:06:16.874462] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T21:06:17.143357] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T21:06:17.617558] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-08T21:06:18.417589] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-08T21:06:18.990102] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T21:06:19.031062] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:06:19.217527] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-08T21:06:19.780137] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T21:06:20.017617] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-08T21:06:20.749126] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T21:06:20.817604] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-08T21:06:21.133300] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T21:06:21.617610] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-08T21:06:22.417552] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-08T21:06:23.037967] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T21:06:23.222689] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-08T21:06:23.238481] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-08T21:06:24.017555] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-08T21:06:24.172553] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T21:06:24.290049] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T21:06:24.817572] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-08T21:06:25.374852] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T21:06:25.617517] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-08T21:06:26.417555] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-08T21:06:26.615127] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T21:06:26.660895] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T21:06:27.217617] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-08T21:06:28.017568] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-08T21:06:28.727192] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-08T21:06:28.817510] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-08T21:06:29.109707] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:06:29.246859] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T21:06:29.617576] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-08T21:06:30.417556] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-08T21:06:31.217578] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-08T21:06:31.504138] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T21:06:31.576304] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T21:06:31.708007] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-08T21:06:32.017592] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-08T21:06:32.175761] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T21:06:32.817515] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-08T21:06:33.062886] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T21:06:33.471295] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T21:06:33.473426] [INFO ] [REMOTE ] PX: Full fetch complete (50168 records). [2025-10-08T21:06:33.473519] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-08T21:06:33.474463] [FATAL] [VALIDATOR ] PX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:06:33.474573] [FATAL] [MAIN ] PX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:06:33.474677] [WARN ] [MAIN ] PX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:06:33.474772] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-08T21:06:33.474920] [DEBUG] [LOCAL ] PX: No primary data file found to delete. [2025-10-08T21:06:33.474979] [INFO ] [LOCAL ] PX: Starting deletion of derivative data. [2025-10-08T21:06:33.475038] [DEBUG] [LOCAL ] PX: No derivative data file found to delete. [2025-10-08T21:06:33.475138] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PX took 33.6s. Estimated remaining: 1h 26m 54s. Rate: 7.1 symbols/min [2025-10-08T21:06:33.617688] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-08T21:06:33.653184] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:33.653457] [DEBUG] [LOCAL ] QGEN: No existing data file found in primary storage. [2025-10-08T21:06:33.653525] [WARN ] [MAIN ] QGEN: No existing data found, performing full refresh instead. [2025-10-08T21:06:33.653717] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-08T21:06:33.653775] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-08T21:06:33.653820] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-08T21:06:33.653861] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-08T21:06:34.008373] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:34.417532] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-10-08T21:06:35.217514] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-08T21:06:35.486194] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T21:06:35.666720] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T21:06:36.017544] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-08T21:06:36.564730] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T21:06:36.565562] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T21:06:36.576528] [INFO ] [REMOTE ] PWR: Full fetch complete (68485 records). [2025-10-08T21:06:36.576697] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-08T21:06:36.577531] [FATAL] [VALIDATOR ] PWR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:06:36.577635] [FATAL] [MAIN ] PWR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:06:36.577723] [WARN ] [MAIN ] PWR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:06:36.577795] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-08T21:06:36.577866] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-08T21:06:36.577935] [INFO ] [LOCAL ] PWR: Starting deletion of derivative data. [2025-10-08T21:06:36.578012] [DEBUG] [LOCAL ] PWR: No derivative data file found to delete. [2025-10-08T21:06:36.578118] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PWR took 39.0s. Estimated remaining: 1h 26m 44s. Rate: 7.1 symbols/min [2025-10-08T21:06:36.780338] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:36.780535] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-08T21:06:36.780592] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-08T21:06:36.780730] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-08T21:06:36.780777] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-08T21:06:36.780821] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-08T21:06:36.780855] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-08T21:06:36.822723] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-08T21:06:37.151867] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:37.617544] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-08T21:06:38.207435] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T21:06:38.417540] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-10-08T21:06:39.217551] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-08T21:06:39.497545] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T21:06:39.708411] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T21:06:39.710829] [INFO ] [REMOTE ] QD: Full fetch complete (39944 records). [2025-10-08T21:06:39.710989] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-08T21:06:39.711619] [FATAL] [VALIDATOR ] QD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:06:39.711728] [FATAL] [MAIN ] QD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:06:39.711772] [WARN ] [MAIN ] QD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:06:39.711811] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-08T21:06:39.711868] [DEBUG] [LOCAL ] QD: No primary data file found to delete. [2025-10-08T21:06:39.711903] [INFO ] [LOCAL ] QD: Starting deletion of derivative data. [2025-10-08T21:06:39.711941] [DEBUG] [LOCAL ] QD: No derivative data file found to delete. [2025-10-08T21:06:39.711999] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. QD took 29.7s. Estimated remaining: 1h 26m 33s. Rate: 7.1 symbols/min [2025-10-08T21:06:39.957931] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:06:39.958212] [DEBUG] [LOCAL ] QSR: No existing data file found in primary storage. [2025-10-08T21:06:39.958265] [WARN ] [MAIN ] QSR: No existing data found, performing full refresh instead. [2025-10-08T21:06:39.958402] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-08T21:06:39.958451] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-08T21:06:39.958497] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-08T21:06:39.958534] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-08T21:06:40.022880] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-08T21:06:40.494451] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:06:40.817566] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-10-08T21:06:40.918987] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-08T21:06:41.617555] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-08T21:06:41.875515] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T21:06:42.407559] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T21:06:42.417631] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-08T21:06:43.217558] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-08T21:06:44.017548] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-08T21:06:44.299144] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T21:06:44.671079] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (3.05 seconds). [2025-10-08T21:06:44.817535] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-08T21:06:45.619083] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-08T21:06:45.625413] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-08T21:06:45.887097] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T21:06:46.417530] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-08T21:06:46.543785] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T21:06:47.217551] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-08T21:06:48.017619] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-08T21:06:48.589292] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-08T21:06:48.655782] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-08T21:06:48.817537] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-08T21:06:49.011359] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T21:06:49.558786] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:06:49.617502] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-08T21:06:50.417590] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-08T21:06:51.139141] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T21:06:51.217610] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-08T21:06:51.350835] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-08T21:06:52.017594] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-08T21:06:52.758103] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-08T21:06:52.817517] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-08T21:06:52.884840] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T21:06:53.617544] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-08T21:06:54.417556] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-08T21:06:54.775272] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-08T21:06:54.847907] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-08T21:06:55.183579] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T21:06:55.217535] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-08T21:06:56.017599] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-08T21:06:56.371815] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T21:06:56.817518] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-08T21:06:57.081055] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T21:06:57.617595] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-08T21:06:58.315800] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-08T21:06:58.417523] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-08T21:06:59.217614] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-08T21:06:59.525834] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T21:06:59.710011] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-08T21:07:00.017709] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-08T21:07:00.781925] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T21:07:00.823451] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-08T21:07:00.829151] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-08T21:07:01.506270] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:07:01.511470] [INFO ] [REMOTE ] QGEN: Full fetch complete (69867 records). [2025-10-08T21:07:01.511620] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-08T21:07:01.512785] [FATAL] [VALIDATOR ] QGEN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:01.512898] [FATAL] [MAIN ] QGEN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:01.512973] [WARN ] [MAIN ] QGEN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:01.513059] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-08T21:07:01.513182] [DEBUG] [LOCAL ] QGEN: No primary data file found to delete. [2025-10-08T21:07:01.513252] [INFO ] [LOCAL ] QGEN: Starting deletion of derivative data. [2025-10-08T21:07:01.513313] [DEBUG] [LOCAL ] QGEN: No derivative data file found to delete. [2025-10-08T21:07:01.513397] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QGEN took 28.0s. Estimated remaining: 1h 26m 30s. Rate: 7.1 symbols/min [2025-10-08T21:07:01.622751] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-08T21:07:01.752521] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:01.752721] [DEBUG] [LOCAL ] QTWO: No existing data file found in primary storage. [2025-10-08T21:07:01.752771] [WARN ] [MAIN ] QTWO: No existing data found, performing full refresh instead. [2025-10-08T21:07:01.752881] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-08T21:07:01.752944] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-08T21:07:01.753020] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-08T21:07:01.753066] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-08T21:07:02.102377] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:02.417629] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-08T21:07:02.803508] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-08T21:07:03.217619] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-08T21:07:03.941236] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T21:07:03.945475] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-08T21:07:03.945690] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-08T21:07:03.946502] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:03.946602] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:03.946681] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:03.946772] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-08T21:07:03.946865] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-08T21:07:03.946935] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-08T21:07:03.947002] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-08T21:07:03.947090] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QBTS took 56.1s. Estimated remaining: 1h 26m 19s. Rate: 7.1 symbols/min [2025-10-08T21:07:03.984685] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T21:07:04.017584] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-10-08T21:07:04.737811] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-10-08T21:07:04.817531] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-08T21:07:05.280204] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T21:07:05.617592] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-08T21:07:06.417612] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-08T21:07:06.918422] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T21:07:07.092367] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-08T21:07:07.217607] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-08T21:07:08.017577] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-08T21:07:08.382387] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T21:07:08.747462] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T21:07:08.817552] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-08T21:07:09.617617] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-08T21:07:10.590448] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T21:07:10.599933] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-08T21:07:10.711135] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-08T21:07:11.217604] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-08T21:07:11.438442] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T21:07:11.863120] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T21:07:11.883081] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T21:07:11.887412] [INFO ] [REMOTE ] QS: Full fetch complete (77496 records). [2025-10-08T21:07:11.887614] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-08T21:07:11.888889] [FATAL] [VALIDATOR ] QS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:11.888996] [FATAL] [MAIN ] QS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:11.889094] [WARN ] [MAIN ] QS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:11.889187] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-08T21:07:11.889539] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-08T21:07:11.890000] [INFO ] [LOCAL ] QS: Starting deletion of derivative data. [2025-10-08T21:07:11.890083] [DEBUG] [LOCAL ] QS: No derivative data file found to delete. [2025-10-08T21:07:11.890204] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QS took 35.3s. Estimated remaining: 1h 26m 10s. Rate: 7.1 symbols/min [2025-10-08T21:07:12.017602] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-08T21:07:12.817700] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-08T21:07:13.855967] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T21:07:13.864821] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-08T21:07:14.520019] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T21:07:14.531388] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-08T21:07:15.208860] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:07:15.212324] [INFO ] [REMOTE ] QSR: Full fetch complete (75474 records). [2025-10-08T21:07:15.212437] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-08T21:07:15.213130] [FATAL] [VALIDATOR ] QSR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:15.213219] [FATAL] [MAIN ] QSR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:15.213261] [WARN ] [MAIN ] QSR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:15.213370] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-08T21:07:15.213460] [DEBUG] [LOCAL ] QSR: No primary data file found to delete. [2025-10-08T21:07:15.213515] [INFO ] [LOCAL ] QSR: Starting deletion of derivative data. [2025-10-08T21:07:15.213573] [DEBUG] [LOCAL ] QSR: No derivative data file found to delete. [2025-10-08T21:07:15.213674] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 35.5s. Estimated remaining: 1h 26m 0s. Rate: 7.1 symbols/min [2025-10-08T21:07:15.399836] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:07:15.407330] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-08T21:07:16.659621] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T21:07:16.667921] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-08T21:07:18.336473] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T21:07:18.345863] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-08T21:07:20.118068] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T21:07:20.128403] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-08T21:07:20.893715] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T21:07:20.897370] [INFO ] [REMOTE ] QTWO: Full fetch complete (57334 records). [2025-10-08T21:07:20.897473] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-08T21:07:20.898235] [FATAL] [VALIDATOR ] QTWO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:20.898384] [FATAL] [MAIN ] QTWO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:20.898428] [WARN ] [MAIN ] QTWO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:20.898465] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-08T21:07:20.898524] [DEBUG] [LOCAL ] QTWO: No primary data file found to delete. [2025-10-08T21:07:20.898559] [INFO ] [LOCAL ] QTWO: Starting deletion of derivative data. [2025-10-08T21:07:20.898599] [DEBUG] [LOCAL ] QTWO: No derivative data file found to delete. [2025-10-08T21:07:20.898674] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QTWO took 19.4s. Estimated remaining: 1h 25m 51s. Rate: 7.1 symbols/min [2025-10-08T21:07:21.488296] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:21.566169] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-08T21:07:21.639167] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:21.638209] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:21.650127] [DEBUG] [LOCAL ] QUAD: No existing data file found in primary storage. [2025-10-08T21:07:21.649693] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-08T21:07:21.650014] [DEBUG] [LOCAL ] QVCD: No existing data file found in primary storage. [2025-10-08T21:07:21.672281] [WARN ] [MAIN ] QVCD: No existing data found, performing full refresh instead. [2025-10-08T21:07:21.672339] [WARN ] [MAIN ] QUAD: No existing data found, performing full refresh instead. [2025-10-08T21:07:21.672186] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-08T21:07:21.680009] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-08T21:07:21.701290] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:21.701615] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-08T21:07:21.701777] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-08T21:07:21.701524] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-08T21:07:21.702117] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-08T21:07:21.701994] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-08T21:07:21.702072] [DEBUG] [LOCAL ] QVCC: No existing data file found in primary storage. [2025-10-08T21:07:21.702353] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-08T21:07:21.702266] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-08T21:07:21.702411] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-08T21:07:21.707903] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-08T21:07:21.702555] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-08T21:07:21.707801] [WARN ] [MAIN ] QVCC: No existing data found, performing full refresh instead. [2025-10-08T21:07:21.805248] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-08T21:07:21.832675] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-08T21:07:21.915292] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-08T21:07:21.988784] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-08T21:07:22.944795] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:23.034037] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-10-08T21:07:23.111832] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:23.145240] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:23.151286] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-10-08T21:07:23.151031] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-10-08T21:07:23.255666] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:23.256103] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-10-08T21:07:23.828106] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T21:07:23.831127] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-08T21:07:23.901527] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T21:07:23.903119] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-08T21:07:24.406290] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T21:07:24.408181] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-08T21:07:24.497971] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T21:07:24.499489] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-08T21:07:24.603177] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T21:07:24.711084] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T21:07:24.817512] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-08T21:07:24.915047] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T21:07:24.989712] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T21:07:25.617529] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-08T21:07:26.417548] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-08T21:07:26.629751] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T21:07:26.647854] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T21:07:27.217623] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-08T21:07:27.619832] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T21:07:28.017592] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-08T21:07:28.817557] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-08T21:07:28.955251] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:07:28.990358] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-08T21:07:29.617546] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-08T21:07:30.154747] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T21:07:30.328519] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T21:07:30.417568] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-08T21:07:30.941751] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T21:07:31.217563] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-08T21:07:32.017540] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-08T21:07:32.817543] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-08T21:07:33.041508] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T21:07:33.268613] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T21:07:33.515974] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T21:07:33.617568] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-08T21:07:34.155478] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T21:07:34.417557] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-08T21:07:35.217547] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-08T21:07:35.779252] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T21:07:36.017556] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-08T21:07:36.114009] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T21:07:36.817587] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-08T21:07:37.374484] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T21:07:37.410715] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T21:07:37.617563] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-08T21:07:38.417550] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-08T21:07:38.912086] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T21:07:39.217543] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-08T21:07:39.680628] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T21:07:40.017515] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-08T21:07:40.100412] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T21:07:40.817519] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-08T21:07:40.997721] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T21:07:41.354170] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T21:07:41.617565] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-08T21:07:42.326257] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T21:07:42.417558] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-08T21:07:43.174889] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T21:07:43.217498] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-08T21:07:43.833415] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T21:07:44.017555] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-08T21:07:44.817524] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-08T21:07:45.221165] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T21:07:45.222858] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T21:07:45.225700] [INFO ] [REMOTE ] QVCC: Full fetch complete (11948 records). [2025-10-08T21:07:45.228836] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-08T21:07:45.230141] [FATAL] [VALIDATOR ] QVCC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:45.230249] [FATAL] [MAIN ] QVCC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:45.230339] [WARN ] [MAIN ] QVCC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:45.230442] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-08T21:07:45.230545] [DEBUG] [LOCAL ] QVCC: No primary data file found to delete. [2025-10-08T21:07:45.230608] [INFO ] [LOCAL ] QVCC: Starting deletion of derivative data. [2025-10-08T21:07:45.230736] [DEBUG] [LOCAL ] QVCC: No derivative data file found to delete. [2025-10-08T21:07:45.230843] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QVCC took 24.3s. Estimated remaining: 1h 25m 48s. Rate: 7.1 symbols/min [2025-10-08T21:07:45.409345] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:45.409533] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-08T21:07:45.409570] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-08T21:07:45.409715] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-08T21:07:45.409766] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-08T21:07:45.409840] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-08T21:07:45.409898] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-08T21:07:45.622845] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-08T21:07:45.774974] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:46.417556] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-08T21:07:46.734735] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T21:07:46.735589] [INFO ] [REMOTE ] QVCD: Full fetch complete (6167 records). [2025-10-08T21:07:46.735693] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-08T21:07:46.736081] [FATAL] [VALIDATOR ] QVCD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:46.736163] [FATAL] [MAIN ] QVCD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:46.736205] [WARN ] [MAIN ] QVCD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:46.736242] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-08T21:07:46.736297] [DEBUG] [LOCAL ] QVCD: No primary data file found to delete. [2025-10-08T21:07:46.736330] [INFO ] [LOCAL ] QVCD: Starting deletion of derivative data. [2025-10-08T21:07:46.736368] [DEBUG] [LOCAL ] QVCD: No derivative data file found to delete. [2025-10-08T21:07:46.736461] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QVCD took 25.8s. Estimated remaining: 1h 25m 37s. Rate: 7.1 symbols/min [2025-10-08T21:07:46.909966] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:46.932624] [DEBUG] [LOCAL ] RA: Loaded 21836 existing records from primary storage. [2025-10-08T21:07:46.932957] [INFO ] [MAIN ] RA: Loaded 21836 existing records. [2025-10-08T21:07:47.110229] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:07:47.110473] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-08T21:07:47.110535] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-08T21:07:47.111360] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-08T21:07:47.111422] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-08T21:07:47.222781] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-10-08T21:07:47.469383] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:47.741391] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-08T21:07:48.017582] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-10-08T21:07:48.166059] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T21:07:48.817579] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-08T21:07:49.021819] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T21:07:49.617563] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-08T21:07:50.213844] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T21:07:50.417558] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-08T21:07:51.217562] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-08T21:07:51.550150] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T21:07:51.774454] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T21:07:52.017538] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-08T21:07:52.491428] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T21:07:52.817604] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-08T21:07:53.223863] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:07:53.518215] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T21:07:53.617594] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-08T21:07:54.417555] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-08T21:07:55.217569] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-08T21:07:55.643009] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:07:55.644898] [INFO ] [REMOTE ] QUAD: Full fetch complete (34241 records). [2025-10-08T21:07:55.644979] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-08T21:07:55.645540] [FATAL] [VALIDATOR ] QUAD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:07:55.645638] [FATAL] [MAIN ] QUAD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:07:55.645723] [WARN ] [MAIN ] QUAD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:07:55.645793] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-08T21:07:55.645858] [DEBUG] [LOCAL ] QUAD: No primary data file found to delete. [2025-10-08T21:07:55.645907] [INFO ] [LOCAL ] QUAD: Starting deletion of derivative data. [2025-10-08T21:07:55.646013] [DEBUG] [LOCAL ] QUAD: No derivative data file found to delete. [2025-10-08T21:07:55.646085] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QUAD took 34.7s. Estimated remaining: 1h 25m 29s. Rate: 7.1 symbols/min [2025-10-08T21:07:55.823472] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:07:55.824292] [DEBUG] [LOCAL ] RACE: No existing data file found in primary storage. [2025-10-08T21:07:55.824432] [WARN ] [MAIN ] RACE: No existing data found, performing full refresh instead. [2025-10-08T21:07:55.824849] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-08T21:07:55.825030] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-08T21:07:55.825385] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-08T21:07:55.825489] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-08T21:07:55.951733] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T21:07:56.020496] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-08T21:07:56.062033] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T21:07:56.284180] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:07:56.817542] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-08T21:07:57.291601] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T21:07:57.617560] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-08T21:07:58.208788] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-08T21:07:58.417508] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-10-08T21:07:58.800624] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T21:07:59.217579] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-08T21:07:59.637008] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T21:08:00.017516] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-08T21:08:00.420595] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T21:08:00.817548] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-08T21:08:01.227463] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:08:01.617519] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-08T21:08:01.658337] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T21:08:02.417623] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-08T21:08:03.217529] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-08T21:08:03.251204] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T21:08:03.850421] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T21:08:04.017542] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-08T21:08:04.817568] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-08T21:08:05.191613] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-08T21:08:05.617565] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-08T21:08:05.678823] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T21:08:05.845243] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T21:08:06.417616] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-08T21:08:06.536149] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-08T21:08:07.217565] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-08T21:08:07.904176] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T21:08:08.017524] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-08T21:08:08.700598] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T21:08:08.817501] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-08T21:08:09.617629] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-08T21:08:09.994908] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T21:08:10.206891] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-08T21:08:10.417514] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-08T21:08:10.802469] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T21:08:11.217601] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-08T21:08:11.813708] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T21:08:12.017531] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-08T21:08:12.817511] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-08T21:08:13.070452] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:08:13.210563] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T21:08:13.274220] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T21:08:13.278830] [INFO ] [REMOTE ] QXO: Full fetch complete (75407 records). [2025-10-08T21:08:13.278964] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-08T21:08:13.279951] [FATAL] [VALIDATOR ] QXO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:13.280065] [FATAL] [MAIN ] QXO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:13.280142] [WARN ] [MAIN ] QXO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:13.280238] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-08T21:08:13.280319] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-08T21:08:13.280357] [INFO ] [LOCAL ] QXO: Starting deletion of derivative data. [2025-10-08T21:08:13.280397] [DEBUG] [LOCAL ] QXO: No derivative data file found to delete. [2025-10-08T21:08:13.280468] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QXO took 52.4s. Estimated remaining: 1h 25m 24s. Rate: 7.1 symbols/min [2025-10-08T21:08:13.455150] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:13.455366] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-08T21:08:13.455434] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-08T21:08:13.455626] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-08T21:08:13.455719] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-08T21:08:13.455784] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-08T21:08:13.455818] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-08T21:08:13.625597] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-08T21:08:13.836509] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:14.417579] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-08T21:08:14.804277] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T21:08:14.807761] [INFO ] [REMOTE ] RA: Full fetch complete (31871 records). [2025-10-08T21:08:14.807898] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-08T21:08:15.175371] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-08T21:08:15.175473] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-08T21:08:15.176221] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-08T21:08:15.176289] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-08T21:08:15.177302] [DEBUG] [LOCAL ] RA: Trimmed 31871 records to 21855 (keeping 200 days of data) [2025-10-08T21:08:15.234239] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-10-08T21:08:15.321740] [DEBUG] [LOCAL ] RA: Primary data saved (21855 records). [2025-10-08T21:08:15.321880] [INFO ] [MAIN ] RA: Full history saved. [2025-10-08T21:08:15.321977] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. RA took 28.6s. Estimated remaining: 1h 25m 13s. Rate: 7.1 symbols/min [2025-10-08T21:08:15.493841] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:15.494047] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-08T21:08:15.494090] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-08T21:08:15.494245] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-08T21:08:15.494313] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-08T21:08:15.494364] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-08T21:08:15.494397] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-08T21:08:15.843416] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:16.017518] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-08T21:08:16.171936] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:08:16.545573] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:08:16.548793] [INFO ] [REMOTE ] R: Full fetch complete (42132 records). [2025-10-08T21:08:16.548950] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-08T21:08:16.549860] [FATAL] [VALIDATOR ] R: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:16.549972] [FATAL] [MAIN ] R: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:16.550062] [WARN ] [MAIN ] R: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:16.550166] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-08T21:08:16.550277] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-08T21:08:16.550357] [INFO ] [LOCAL ] R: Starting deletion of derivative data. [2025-10-08T21:08:16.550448] [DEBUG] [LOCAL ] R: No derivative data file found to delete. [2025-10-08T21:08:16.550544] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. R took 31.3s. Estimated remaining: 1h 25m 2s. Rate: 7.1 symbols/min [2025-10-08T21:08:16.736336] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:16.736566] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-08T21:08:16.736680] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-08T21:08:16.736976] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-08T21:08:16.737095] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-08T21:08:16.788119] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-08T21:08:16.789917] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:08:16.790056] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-08T21:08:16.822484] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-08T21:08:17.159395] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:17.617557] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-10-08T21:08:18.417557] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-10-08T21:08:18.491570] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T21:08:18.510516] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T21:08:19.217604] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-08T21:08:20.019512] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-08T21:08:20.022598] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T21:08:20.040031] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T21:08:20.817558] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-08T21:08:21.425120] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T21:08:21.617554] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-08T21:08:22.278560] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T21:08:22.417552] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-08T21:08:23.217567] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-08T21:08:23.328550] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T21:08:23.664545] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T21:08:24.017598] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-08T21:08:24.752945] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T21:08:24.817538] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-08T21:08:25.194011] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:08:25.617554] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-08T21:08:26.406211] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T21:08:26.422610] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-08T21:08:26.423809] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T21:08:27.217558] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-08T21:08:28.017587] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-08T21:08:28.181284] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T21:08:28.567129] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:08:28.752363] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T21:08:28.754974] [INFO ] [REMOTE ] RACE: Full fetch complete (47496 records). [2025-10-08T21:08:28.755093] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-08T21:08:28.755975] [FATAL] [VALIDATOR ] RACE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:28.756076] [FATAL] [MAIN ] RACE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:28.756153] [WARN ] [MAIN ] RACE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:28.756241] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-08T21:08:28.756334] [DEBUG] [LOCAL ] RACE: No primary data file found to delete. [2025-10-08T21:08:28.756378] [INFO ] [LOCAL ] RACE: Starting deletion of derivative data. [2025-10-08T21:08:28.756419] [DEBUG] [LOCAL ] RACE: No derivative data file found to delete. [2025-10-08T21:08:28.756534] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. RACE took 33.1s. Estimated remaining: 1h 24m 55s. Rate: 7.1 symbols/min [2025-10-08T21:08:28.822741] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-08T21:08:28.941251] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:28.941459] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-08T21:08:28.941515] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-08T21:08:28.941631] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-08T21:08:28.941722] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-08T21:08:28.941793] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-08T21:08:28.941863] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-08T21:08:29.310236] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:29.617569] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-08T21:08:30.417604] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-10-08T21:08:30.585203] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T21:08:30.623677] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:08:31.217556] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-08T21:08:32.017568] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-08T21:08:32.691547] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T21:08:32.817554] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-08T21:08:32.891165] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-08T21:08:33.617524] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-08T21:08:33.648723] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T21:08:34.417580] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-08T21:08:34.534746] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T21:08:35.217533] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-08T21:08:35.915047] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T21:08:35.969888] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-08T21:08:36.017516] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-08T21:08:36.817522] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-08T21:08:36.947420] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:08:37.617556] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-08T21:08:38.084936] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T21:08:38.302153] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-08T21:08:38.417510] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-08T21:08:39.217575] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-08T21:08:39.367759] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T21:08:39.756259] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T21:08:40.017582] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-08T21:08:40.817601] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-08T21:08:41.339821] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-08T21:08:41.617703] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-08T21:08:41.698987] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T21:08:41.716106] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T21:08:42.417604] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-08T21:08:43.083421] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T21:08:43.217571] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-08T21:08:44.017568] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-08T21:08:44.492965] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T21:08:44.496508] [INFO ] [REMOTE ] RBA: Full fetch complete (65577 records). [2025-10-08T21:08:44.496629] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-08T21:08:44.497448] [FATAL] [VALIDATOR ] RBA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:44.497542] [FATAL] [MAIN ] RBA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:44.497585] [WARN ] [MAIN ] RBA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:44.497623] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-08T21:08:44.497717] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-08T21:08:44.497763] [INFO ] [LOCAL ] RBA: Starting deletion of derivative data. [2025-10-08T21:08:44.497804] [DEBUG] [LOCAL ] RBA: No derivative data file found to delete. [2025-10-08T21:08:44.497860] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. RBA took 29.2s. Estimated remaining: 1h 24m 49s. Rate: 7.1 symbols/min [2025-10-08T21:08:44.671406] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:44.671835] [DEBUG] [LOCAL ] RBOT: No existing data file found in primary storage. [2025-10-08T21:08:44.672137] [WARN ] [MAIN ] RBOT: No existing data found, performing full refresh instead. [2025-10-08T21:08:44.672326] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-08T21:08:44.672507] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-08T21:08:44.673105] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-08T21:08:44.673158] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-08T21:08:44.785676] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T21:08:44.835395] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-08T21:08:44.917670] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-08T21:08:45.191410] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:45.617564] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-08T21:08:45.968122] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T21:08:46.417606] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-10-08T21:08:47.030106] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T21:08:47.119088] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T21:08:47.217520] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-08T21:08:48.017728] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-08T21:08:48.069705] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T21:08:48.817528] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-08T21:08:49.033690] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T21:08:49.617592] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-08T21:08:50.415626] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T21:08:50.418135] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-08T21:08:50.420190] [INFO ] [REMOTE ] RAMP: Full fetch complete (53475 records). [2025-10-08T21:08:50.420307] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-08T21:08:50.421049] [FATAL] [VALIDATOR ] RAMP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:50.421140] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:50.421184] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:50.421270] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-08T21:08:50.421457] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-08T21:08:50.421503] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-10-08T21:08:50.421543] [DEBUG] [LOCAL ] RAMP: No derivative data file found to delete. [2025-10-08T21:08:50.421601] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 37.1s. Estimated remaining: 1h 24m 40s. Rate: 7.1 symbols/min [2025-10-08T21:08:50.608442] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:50.608756] [DEBUG] [LOCAL ] RBRK: No existing data file found in primary storage. [2025-10-08T21:08:50.608820] [WARN ] [MAIN ] RBRK: No existing data found, performing full refresh instead. [2025-10-08T21:08:50.608988] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-08T21:08:50.609063] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-08T21:08:50.609129] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-08T21:08:50.609163] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-08T21:08:50.994416] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:51.217550] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-10-08T21:08:51.265298] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-08T21:08:51.328387] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T21:08:52.017570] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-08T21:08:52.817509] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-08T21:08:52.858299] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T21:08:53.257474] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-08T21:08:53.617578] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-08T21:08:54.417590] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-08T21:08:55.171683] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-08T21:08:55.217487] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-08T21:08:55.401026] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T21:08:55.528841] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T21:08:56.017607] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-08T21:08:56.817561] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-08T21:08:57.078042] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-08T21:08:57.079727] [INFO ] [REMOTE ] RBC: Full fetch complete (21627 records). [2025-10-08T21:08:57.079803] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-08T21:08:57.080290] [FATAL] [VALIDATOR ] RBC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:08:57.080377] [FATAL] [MAIN ] RBC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:08:57.080420] [WARN ] [MAIN ] RBC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:08:57.080459] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-08T21:08:57.080517] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-08T21:08:57.080552] [INFO ] [LOCAL ] RBC: Starting deletion of derivative data. [2025-10-08T21:08:57.080592] [DEBUG] [LOCAL ] RBC: No derivative data file found to delete. [2025-10-08T21:08:57.080702] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBC took 40.5s. Estimated remaining: 1h 24m 31s. Rate: 7.1 symbols/min [2025-10-08T21:08:57.251923] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:08:57.252126] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-08T21:08:57.252172] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-08T21:08:57.252286] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-08T21:08:57.252327] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-08T21:08:57.252367] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-08T21:08:57.252398] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-08T21:08:57.621722] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:08:57.622254] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-10-08T21:08:57.669683] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-08T21:08:57.936004] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T21:08:58.417574] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-08T21:08:59.217512] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-08T21:08:59.313673] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:08:59.924753] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T21:09:00.017556] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-08T21:09:00.493090] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T21:09:00.817564] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-08T21:09:01.489507] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T21:09:01.617597] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-08T21:09:02.417525] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-08T21:09:02.834984] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T21:09:03.217559] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-08T21:09:03.840934] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T21:09:03.884535] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T21:09:04.017708] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-08T21:09:04.154712] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T21:09:04.817611] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-08T21:09:05.617565] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-08T21:09:06.129043] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-08T21:09:06.144322] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-08T21:09:06.417551] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-08T21:09:07.102533] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T21:09:07.173599] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-08T21:09:07.217510] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-08T21:09:07.855563] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:09:07.859224] [INFO ] [REMOTE ] RBLX: Full fetch complete (77394 records). [2025-10-08T21:09:07.859337] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-08T21:09:07.860319] [FATAL] [VALIDATOR ] RBLX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:09:07.860438] [FATAL] [MAIN ] RBLX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:09:07.860510] [WARN ] [MAIN ] RBLX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:09:07.860616] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-08T21:09:07.860758] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-08T21:09:07.860813] [INFO ] [LOCAL ] RBLX: Starting deletion of derivative data. [2025-10-08T21:09:07.860856] [DEBUG] [LOCAL ] RBLX: No derivative data file found to delete. [2025-10-08T21:09:07.860914] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBLX took 39.1s. Estimated remaining: 1h 24m 23s. Rate: 7.1 symbols/min [2025-10-08T21:09:08.037422] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-08T21:09:08.046384] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:09:08.047561] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-08T21:09:08.047622] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-08T21:09:08.047789] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-08T21:09:08.047855] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-08T21:09:08.047934] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-08T21:09:08.048007] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-08T21:09:08.441093] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:09:08.817615] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-10-08T21:09:08.870576] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T21:09:09.363300] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-08T21:09:09.617570] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-08T21:09:10.417630] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-08T21:09:11.217596] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-08T21:09:11.565603] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T21:09:11.781574] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-08T21:09:11.802775] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T21:09:12.017599] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-08T21:09:12.817558] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-08T21:09:13.617550] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-08T21:09:13.667301] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T21:09:14.214410] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T21:09:14.232720] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T21:09:14.417576] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-08T21:09:15.217588] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-08T21:09:16.017545] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-08T21:09:16.518879] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T21:09:16.588588] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T21:09:16.590164] [INFO ] [REMOTE ] RBOT: Full fetch complete (8809 records). [2025-10-08T21:09:16.590239] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-08T21:09:16.590666] [FATAL] [VALIDATOR ] RBOT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:09:16.590753] [FATAL] [MAIN ] RBOT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:09:16.590796] [WARN ] [MAIN ] RBOT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:09:16.590833] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-08T21:09:16.590888] [DEBUG] [LOCAL ] RBOT: No primary data file found to delete. [2025-10-08T21:09:16.590922] [INFO ] [LOCAL ] RBOT: Starting deletion of derivative data. [2025-10-08T21:09:16.590960] [DEBUG] [LOCAL ] RBOT: No derivative data file found to delete. [2025-10-08T21:09:16.591013] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 32.1s. Estimated remaining: 1h 24m 15s. Rate: 7.1 symbols/min [2025-10-08T21:09:16.765411] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:09:16.765709] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-10-08T21:09:16.765805] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-10-08T21:09:16.766099] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-08T21:09:16.766233] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-08T21:09:16.766377] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-08T21:09:16.766434] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-08T21:09:16.833245] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-08T21:09:17.132302] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T21:09:17.173525] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:09:17.617562] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-08T21:09:18.408102] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T21:09:18.417592] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-08T21:09:19.227808] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-08T21:09:19.253108] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T21:09:19.262666] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-08T21:09:20.017548] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-08T21:09:20.610415] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T21:09:20.614015] [INFO ] [REMOTE ] RBRK: Full fetch complete (76143 records). [2025-10-08T21:09:20.614118] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-08T21:09:20.614955] [FATAL] [VALIDATOR ] RBRK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:09:20.615051] [FATAL] [MAIN ] RBRK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:09:20.615136] [WARN ] [MAIN ] RBRK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:09:20.615207] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-08T21:09:20.615271] [DEBUG] [LOCAL ] RBRK: No primary data file found to delete. [2025-10-08T21:09:20.615306] [INFO ] [LOCAL ] RBRK: Starting deletion of derivative data. [2025-10-08T21:09:20.615345] [DEBUG] [LOCAL ] RBRK: No derivative data file found to delete. [2025-10-08T21:09:20.615402] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBRK took 30.2s. Estimated remaining: 1h 24m 5s. Rate: 7.1 symbols/min [2025-10-08T21:09:20.795721] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:09:20.796034] [DEBUG] [LOCAL ] RCI: No existing data file found in primary storage. [2025-10-08T21:09:20.796213] [WARN ] [MAIN ] RCI: No existing data found, performing full refresh instead. [2025-10-08T21:09:20.796338] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-08T21:09:20.796382] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-08T21:09:20.796428] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-08T21:09:20.796461] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-08T21:09:20.826766] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-10-08T21:09:21.198196] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:09:21.200505] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T21:09:21.617560] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-10-08T21:09:21.679329] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:09:22.417569] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-08T21:09:23.222777] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-08T21:09:23.245800] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T21:09:23.252635] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T21:09:23.885108] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T21:09:24.017623] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-08T21:09:24.547866] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T21:09:24.817699] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-08T21:09:25.617606] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-08T21:09:26.104349] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T21:09:26.417511] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-08T21:09:26.492283] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:09:26.820346] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-08T21:09:27.217579] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-08T21:09:28.017588] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-08T21:09:28.428088] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T21:09:28.822738] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-08T21:09:28.834603] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T21:09:29.617533] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-08T21:09:30.269224] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:09:30.417535] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-08T21:09:31.217574] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-08T21:09:31.369281] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T21:09:31.582622] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-08T21:09:31.826065] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T21:09:32.017561] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-08T21:09:32.817587] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-08T21:09:33.188569] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:09:33.189399] [INFO ] [REMOTE ] RCB: Full fetch complete (3747 records). [2025-10-08T21:09:33.189471] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-08T21:09:33.190024] [FATAL] [VALIDATOR ] RCB: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:09:33.190113] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:09:33.190154] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:09:33.190192] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-08T21:09:33.190260] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-08T21:09:33.190314] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-08T21:09:33.190370] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-08T21:09:33.190457] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RCB took 25.3s. Estimated remaining: 1h 23m 58s. Rate: 7.1 symbols/min [2025-10-08T21:09:33.407817] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:09:33.408085] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-08T21:09:33.408159] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-08T21:09:33.408317] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-08T21:09:33.408379] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-08T21:09:33.408449] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-08T21:09:33.408505] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-08T21:09:33.624498] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-08T21:09:33.982711] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:09:34.019771] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T21:09:34.275435] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T21:09:34.417543] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-08T21:09:35.072089] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T21:09:35.217516] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-08T21:09:36.017549] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-08T21:09:36.817624] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-08T21:09:36.824873] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T21:09:37.617604] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-10-08T21:09:38.417555] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-08T21:09:38.613077] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:09:39.217588] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-08T21:09:39.384983] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T21:09:40.017592] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-08T21:09:40.774094] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T21:09:40.817495] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-08T21:09:40.972524] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T21:09:41.617571] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-08T21:09:42.343480] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T21:09:42.417510] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-08T21:09:42.521807] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T21:09:43.169485] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T21:09:43.172812] [INFO ] [REMOTE ] RC: Full fetch complete (70547 records). [2025-10-08T21:09:43.172933] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-08T21:09:43.173722] [FATAL] [VALIDATOR ] RC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:09:43.173814] [FATAL] [MAIN ] RC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:09:43.173857] [WARN ] [MAIN ] RC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:09:43.173895] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-08T21:09:43.173953] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-08T21:09:43.173988] [INFO ] [LOCAL ] RC: Starting deletion of derivative data. [2025-10-08T21:09:43.174028] [DEBUG] [LOCAL ] RC: No derivative data file found to delete. [2025-10-08T21:09:43.174092] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RC took 46.1s. Estimated remaining: 1h 23m 50s. Rate: 7.1 symbols/min [2025-10-08T21:09:43.240550] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-08T21:09:43.362569] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:09:43.376437] [DEBUG] [LOCAL ] RCS: Loaded 11963 existing records from primary storage. [2025-10-08T21:09:43.376712] [INFO ] [MAIN ] RCS: Loaded 11963 existing records. [2025-10-08T21:09:43.554078] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:09:43.554294] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-08T21:09:43.554343] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-08T21:09:43.554874] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-08T21:09:43.554937] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-08T21:09:43.909149] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:09:44.017538] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-10-08T21:09:45.088221] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T21:09:45.092169] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-08T21:09:45.470356] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-08T21:09:45.617505] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-08T21:09:46.259625] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T21:09:46.417557] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-08T21:09:47.570885] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T21:09:47.582897] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-08T21:09:47.601755] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:09:48.017528] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-08T21:09:49.003542] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T21:09:49.006889] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-08T21:09:49.360730] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-08T21:09:49.617622] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-08T21:09:51.804412] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T21:09:51.815464] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-08T21:10:14.510872] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (36.09 seconds). [2025-10-08T21:10:14.512431] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-08T21:10:14.671907] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (25.67 seconds). [2025-10-08T21:10:14.675312] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-08T21:10:15.151556] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-08T21:10:15.153177] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-08T21:10:15.390179] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T21:10:15.393442] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-08T21:10:15.451407] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (40.23 seconds). [2025-10-08T21:10:15.461467] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-08T21:10:15.785998] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T21:10:15.787625] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-08T21:10:15.833401] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (24.02 seconds). [2025-10-08T21:10:15.845028] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-08T21:10:16.364743] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T21:10:16.368734] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-08T21:10:16.487952] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T21:10:16.489667] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-08T21:10:16.871998] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:10:16.872793] [INFO ] [REMOTE ] RCD: Full fetch complete (6974 records). [2025-10-08T21:10:16.872864] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-08T21:10:16.873330] [FATAL] [VALIDATOR ] RCD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:16.873415] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:16.873459] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:16.873497] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-08T21:10:16.873551] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-10-08T21:10:16.873586] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-10-08T21:10:16.873626] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-10-08T21:10:16.873714] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RCD took 1m 0s. Estimated remaining: 1h 23m 50s. Rate: 7.1 symbols/min [2025-10-08T21:10:17.045789] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:17.046033] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-08T21:10:17.046099] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-08T21:10:17.046312] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-08T21:10:17.046377] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-08T21:10:17.046470] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-08T21:10:17.046524] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-08T21:10:17.334149] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T21:10:17.375564] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-08T21:10:17.356151] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:10:17.447350] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-08T21:10:17.480532] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:17.480941] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-10-08T21:10:17.561516] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T21:10:17.572465] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-08T21:10:18.222448] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T21:10:18.225999] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-08T21:10:18.422053] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T21:10:18.433142] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-08T21:10:18.828032] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T21:10:18.836873] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-08T21:10:18.845939] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T21:10:18.849711] [INFO ] [REMOTE ] RCL: Full fetch complete (75005 records). [2025-10-08T21:10:18.849832] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-08T21:10:18.850694] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:18.850815] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:18.850873] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:18.850941] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-08T21:10:18.851006] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-08T21:10:18.851123] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-08T21:10:18.851173] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-08T21:10:18.851234] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCL took 45.7s. Estimated remaining: 1h 23m 39s. Rate: 7.1 symbols/min [2025-10-08T21:10:18.975364] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T21:10:19.019566] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-08T21:10:19.046144] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:19.046332] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-08T21:10:19.047168] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-08T21:10:19.047304] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-08T21:10:19.047347] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-08T21:10:19.047390] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-08T21:10:19.047425] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-08T21:10:19.446429] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:19.441168] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T21:10:19.456928] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-10-08T21:10:19.458612] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-08T21:10:19.858577] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T21:10:19.860726] [INFO ] [REMOTE ] RCS: Full fetch complete (19246 records). [2025-10-08T21:10:19.860817] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-08T21:10:20.237345] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-08T21:10:20.237450] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-08T21:10:20.238034] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-08T21:10:20.238110] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-08T21:10:20.239010] [DEBUG] [LOCAL ] RCS: Trimmed 19246 records to 12029 (keeping 200 days of data) [2025-10-08T21:10:20.311339] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T21:10:20.321192] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-08T21:10:20.341789] [DEBUG] [LOCAL ] RCS: Primary data saved (12029 records). [2025-10-08T21:10:20.341950] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-08T21:10:20.342043] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCS took 37.2s. Estimated remaining: 1h 23m 28s. Rate: 7.1 symbols/min [2025-10-08T21:10:20.509786] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:20.510020] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-08T21:10:20.510816] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-08T21:10:20.510937] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-08T21:10:20.510978] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-08T21:10:20.511019] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-08T21:10:20.511050] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-08T21:10:20.874661] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:20.875434] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-10-08T21:10:20.903638] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T21:10:20.914508] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-08T21:10:21.099956] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T21:10:21.109159] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-08T21:10:21.717469] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-08T21:10:21.730320] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-08T21:10:22.253914] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T21:10:22.267047] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-08T21:10:22.375163] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T21:10:22.385744] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-08T21:10:22.764205] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:10:22.767702] [INFO ] [REMOTE ] RCI: Full fetch complete (70143 records). [2025-10-08T21:10:22.767829] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-08T21:10:22.768610] [FATAL] [VALIDATOR ] RCI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:22.768767] [FATAL] [MAIN ] RCI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:22.768823] [WARN ] [MAIN ] RCI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:22.768890] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-08T21:10:22.768968] [DEBUG] [LOCAL ] RCI: No primary data file found to delete. [2025-10-08T21:10:22.769022] [INFO ] [LOCAL ] RCI: Starting deletion of derivative data. [2025-10-08T21:10:22.769113] [DEBUG] [LOCAL ] RCI: No derivative data file found to delete. [2025-10-08T21:10:22.769183] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCI took 1m 2s. Estimated remaining: 1h 23m 18s. Rate: 7.1 symbols/min [2025-10-08T21:10:22.926731] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T21:10:22.960461] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-08T21:10:22.983209] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:22.983374] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-08T21:10:22.983429] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-08T21:10:22.983540] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-08T21:10:22.983581] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-08T21:10:22.983621] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-08T21:10:22.983688] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-08T21:10:23.373737] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:23.374105] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-10-08T21:10:23.918713] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-08T21:10:23.929521] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-08T21:10:24.058001] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T21:10:24.067946] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-08T21:10:24.633858] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:10:24.644077] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-08T21:10:25.041418] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T21:10:25.051156] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-08T21:10:25.843442] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T21:10:25.859254] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-08T21:10:26.027304] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-08T21:10:26.041428] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-08T21:10:26.078693] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T21:10:26.089569] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-08T21:10:26.844944] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T21:10:26.855059] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-08T21:10:27.243048] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T21:10:27.253663] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-08T21:10:27.314038] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T21:10:27.323111] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-08T21:10:28.418795] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-08T21:10:28.430318] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-08T21:10:28.665899] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T21:10:28.677062] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-08T21:10:28.817403] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T21:10:28.827928] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-08T21:10:28.914803] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T21:10:28.926090] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-08T21:10:29.965179] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T21:10:29.974261] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-08T21:10:30.501479] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T21:10:30.512560] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-08T21:10:30.615484] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T21:10:30.628613] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-08T21:10:30.679808] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-08T21:10:30.691998] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-08T21:10:31.585159] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:10:31.594726] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-08T21:10:32.220957] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T21:10:32.230909] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-08T21:10:32.266046] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T21:10:32.269269] [INFO ] [REMOTE ] RCUS: Full fetch complete (59859 records). [2025-10-08T21:10:32.269394] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-08T21:10:32.270137] [FATAL] [VALIDATOR ] RCUS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:32.270251] [FATAL] [MAIN ] RCUS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:32.270300] [WARN ] [MAIN ] RCUS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:32.270372] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-08T21:10:32.270441] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-08T21:10:32.270478] [INFO ] [LOCAL ] RCUS: Starting deletion of derivative data. [2025-10-08T21:10:32.270517] [DEBUG] [LOCAL ] RCUS: No derivative data file found to delete. [2025-10-08T21:10:32.270579] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCUS took 15.4s. Estimated remaining: 1h 23m 10s. Rate: 7.1 symbols/min [2025-10-08T21:10:32.452737] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:32.453011] [DEBUG] [LOCAL ] RDY: No existing data file found in primary storage. [2025-10-08T21:10:32.453083] [WARN ] [MAIN ] RDY: No existing data found, performing full refresh instead. [2025-10-08T21:10:32.453270] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-08T21:10:32.453317] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-08T21:10:32.453359] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-08T21:10:32.453393] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-08T21:10:32.848860] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:32.865777] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-10-08T21:10:32.871951] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T21:10:32.883457] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-08T21:10:33.084461] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T21:10:33.095569] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-08T21:10:33.631314] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T21:10:33.642221] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-08T21:10:34.630203] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T21:10:34.640029] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-08T21:10:34.861563] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T21:10:34.870517] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-08T21:10:35.108016] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-08T21:10:35.119291] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-08T21:10:35.227939] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-08T21:10:35.239839] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-08T21:10:36.356482] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T21:10:36.366810] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-08T21:10:36.451169] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T21:10:36.817559] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-08T21:10:37.312868] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T21:10:37.330886] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:10:37.334538] [INFO ] [REMOTE ] RDN: Full fetch complete (65762 records). [2025-10-08T21:10:37.334702] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-08T21:10:37.335332] [FATAL] [VALIDATOR ] RDN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:37.335421] [FATAL] [MAIN ] RDN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:37.335464] [WARN ] [MAIN ] RDN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:37.335531] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-08T21:10:37.335619] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-08T21:10:37.335700] [INFO ] [LOCAL ] RDN: Starting deletion of derivative data. [2025-10-08T21:10:37.335756] [DEBUG] [LOCAL ] RDN: No derivative data file found to delete. [2025-10-08T21:10:37.335816] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RDN took 17.0s. Estimated remaining: 1h 23m 0s. Rate: 7.1 symbols/min [2025-10-08T21:10:37.526661] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:37.527074] [DEBUG] [LOCAL ] RELX: No existing data file found in primary storage. [2025-10-08T21:10:37.527181] [WARN ] [MAIN ] RELX: No existing data found, performing full refresh instead. [2025-10-08T21:10:37.527374] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-08T21:10:37.527428] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-08T21:10:37.527578] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-08T21:10:37.527659] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-08T21:10:37.633229] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-08T21:10:37.950049] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:37.956249] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-08T21:10:38.115684] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T21:10:38.417557] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-10-08T21:10:39.217574] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-08T21:10:39.933737] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-08T21:10:40.017534] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-08T21:10:40.064286] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:10:40.817605] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-08T21:10:40.947846] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:10:41.617580] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-08T21:10:42.426163] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-08T21:10:42.448324] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-08T21:10:43.217512] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-08T21:10:43.610804] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-08T21:10:43.684245] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T21:10:44.022794] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-08T21:10:44.042278] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T21:10:44.817637] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-08T21:10:45.617553] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-08T21:10:45.671828] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-08T21:10:45.981078] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-08T21:10:46.417583] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-08T21:10:46.446864] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T21:10:47.217572] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-08T21:10:48.017555] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-08T21:10:48.065178] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T21:10:48.401901] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-08T21:10:48.589982] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:10:48.763533] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T21:10:48.767394] [INFO ] [REMOTE ] RDW: Full fetch complete (74730 records). [2025-10-08T21:10:48.767607] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-08T21:10:48.769099] [FATAL] [VALIDATOR ] RDW: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:48.769298] [FATAL] [MAIN ] RDW: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:48.769368] [WARN ] [MAIN ] RDW: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:48.769415] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-08T21:10:48.769475] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-08T21:10:48.769511] [INFO ] [LOCAL ] RDW: Starting deletion of derivative data. [2025-10-08T21:10:48.769551] [DEBUG] [LOCAL ] RDW: No derivative data file found to delete. [2025-10-08T21:10:48.769617] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDW took 26.0s. Estimated remaining: 1h 22m 53s. Rate: 7.1 symbols/min [2025-10-08T21:10:48.822703] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-08T21:10:48.979025] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:48.979276] [DEBUG] [LOCAL ] RERE: No existing data file found in primary storage. [2025-10-08T21:10:48.979319] [WARN ] [MAIN ] RERE: No existing data found, performing full refresh instead. [2025-10-08T21:10:48.979438] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-08T21:10:48.979479] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-08T21:10:48.979533] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-08T21:10:48.979599] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-08T21:10:49.405750] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:49.617623] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-10-08T21:10:50.417521] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-08T21:10:50.832253] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T21:10:51.217558] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-08T21:10:51.305461] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:10:51.983355] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T21:10:51.987134] [INFO ] [REMOTE ] RDDT: Full fetch complete (77496 records). [2025-10-08T21:10:51.987273] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-08T21:10:51.988104] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:10:51.988215] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:10:51.988258] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:10:51.988300] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-08T21:10:51.988358] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-08T21:10:51.988393] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-10-08T21:10:51.988434] [DEBUG] [LOCAL ] RDDT: No derivative data file found to delete. [2025-10-08T21:10:51.988493] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDDT took 33.1s. Estimated remaining: 1h 22m 43s. Rate: 7.1 symbols/min [2025-10-08T21:10:52.022604] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-08T21:10:52.170224] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:10:52.170494] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-08T21:10:52.170566] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-08T21:10:52.170716] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-08T21:10:52.170838] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-08T21:10:52.170903] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-08T21:10:52.170939] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-08T21:10:52.372286] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T21:10:52.569272] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:10:52.817549] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-10-08T21:10:53.617552] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-08T21:10:53.962826] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T21:10:54.417544] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-08T21:10:54.526756] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T21:10:54.643211] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T21:10:55.217547] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-08T21:10:55.871312] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T21:10:56.017523] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-08T21:10:56.306556] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T21:10:56.817550] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-08T21:10:57.617588] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-08T21:10:57.815121] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:10:58.417609] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-08T21:10:58.574438] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T21:10:58.679945] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T21:10:59.217582] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-08T21:11:00.017562] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-08T21:11:00.101182] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T21:11:00.817512] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-08T21:11:01.084479] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T21:11:01.617586] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-08T21:11:01.680880] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:11:02.019319] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T21:11:02.417584] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-08T21:11:03.174781] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T21:11:03.217521] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-08T21:11:04.017589] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-08T21:11:04.306694] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-08T21:11:04.523033] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:11:04.526237] [INFO ] [REMOTE ] RDY: Full fetch complete (68463 records). [2025-10-08T21:11:04.526358] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-08T21:11:04.527083] [FATAL] [VALIDATOR ] RDY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:04.527177] [FATAL] [MAIN ] RDY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:04.527219] [WARN ] [MAIN ] RDY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:04.527256] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-08T21:11:04.527313] [DEBUG] [LOCAL ] RDY: No primary data file found to delete. [2025-10-08T21:11:04.527357] [INFO ] [LOCAL ] RDY: Starting deletion of derivative data. [2025-10-08T21:11:04.527424] [DEBUG] [LOCAL ] RDY: No derivative data file found to delete. [2025-10-08T21:11:04.527484] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDY took 32.3s. Estimated remaining: 1h 22m 36s. Rate: 7.1 symbols/min [2025-10-08T21:11:04.706597] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:04.706882] [DEBUG] [LOCAL ] REVG: No existing data file found in primary storage. [2025-10-08T21:11:04.707039] [WARN ] [MAIN ] REVG: No existing data found, performing full refresh instead. [2025-10-08T21:11:04.725836] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T21:11:04.725189] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-08T21:11:04.725981] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-08T21:11:04.733161] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-08T21:11:04.733238] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-08T21:11:04.823012] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-08T21:11:05.105612] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:05.425269] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:11:05.428584] [INFO ] [REMOTE ] RELX: Full fetch complete (67352 records). [2025-10-08T21:11:05.428710] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-08T21:11:05.429363] [FATAL] [VALIDATOR ] RELX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:05.429493] [FATAL] [MAIN ] RELX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:05.429535] [WARN ] [MAIN ] RELX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:05.429573] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-08T21:11:05.429661] [DEBUG] [LOCAL ] RELX: No primary data file found to delete. [2025-10-08T21:11:05.429720] [INFO ] [LOCAL ] RELX: Starting deletion of derivative data. [2025-10-08T21:11:05.429765] [DEBUG] [LOCAL ] RELX: No derivative data file found to delete. [2025-10-08T21:11:05.429823] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RELX took 28.1s. Estimated remaining: 1h 22m 25s. Rate: 7.1 symbols/min [2025-10-08T21:11:05.603361] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:05.603556] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-08T21:11:05.603597] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-08T21:11:05.603756] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-08T21:11:05.603808] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-08T21:11:05.603860] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-08T21:11:05.603903] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-08T21:11:05.622618] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-08T21:11:05.979366] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:06.417521] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-10-08T21:11:06.571352] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T21:11:07.217520] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-10-08T21:11:07.545157] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:11:08.017606] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-08T21:11:08.772535] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:11:08.817539] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-08T21:11:09.617504] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-08T21:11:09.884526] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:11:09.927779] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T21:11:10.417564] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-08T21:11:11.217536] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-08T21:11:11.271925] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:11:11.683156] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T21:11:12.017587] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-08T21:11:12.817594] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-08T21:11:13.085924] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T21:11:13.176559] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-08T21:11:13.617537] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-08T21:11:14.261805] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T21:11:14.417545] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-08T21:11:15.217574] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-08T21:11:15.348565] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T21:11:15.933492] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:11:16.017574] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-08T21:11:16.704899] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T21:11:16.817503] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-08T21:11:17.055487] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T21:11:17.617538] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-08T21:11:18.138555] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T21:11:18.417515] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-08T21:11:18.435348] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T21:11:19.217552] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-08T21:11:20.017566] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-08T21:11:20.173918] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T21:11:20.817505] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-08T21:11:20.845384] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:11:21.055867] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T21:11:21.462468] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:11:21.465476] [INFO ] [REMOTE ] RERE: Full fetch complete (57191 records). [2025-10-08T21:11:21.465673] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-08T21:11:21.466695] [FATAL] [VALIDATOR ] RERE: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:21.466808] [FATAL] [MAIN ] RERE: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:21.466873] [WARN ] [MAIN ] RERE: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:21.466963] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-08T21:11:21.467058] [DEBUG] [LOCAL ] RERE: No primary data file found to delete. [2025-10-08T21:11:21.467118] [INFO ] [LOCAL ] RERE: Starting deletion of derivative data. [2025-10-08T21:11:21.467187] [DEBUG] [LOCAL ] RERE: No derivative data file found to delete. [2025-10-08T21:11:21.467291] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RERE took 32.7s. Estimated remaining: 1h 22m 19s. Rate: 7.1 symbols/min [2025-10-08T21:11:21.632823] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-08T21:11:21.638800] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:21.639078] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-08T21:11:21.639135] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-08T21:11:21.639271] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-08T21:11:21.639318] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-08T21:11:21.639361] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-08T21:11:21.639393] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-08T21:11:22.073715] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:22.417552] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-08T21:11:22.521201] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T21:11:23.217578] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-10-08T21:11:24.017559] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-08T21:11:24.306456] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T21:11:24.627028] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T21:11:24.817547] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-08T21:11:25.003152] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T21:11:25.617553] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-08T21:11:26.310010] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T21:11:26.417564] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-08T21:11:27.109245] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T21:11:27.217555] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-08T21:11:27.832870] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T21:11:28.017562] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-08T21:11:28.768095] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T21:11:28.817564] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-08T21:11:28.969546] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T21:11:29.617564] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-08T21:11:29.738350] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T21:11:30.417561] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-08T21:11:30.886748] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T21:11:30.890767] [INFO ] [REMOTE ] RES: Full fetch complete (68433 records). [2025-10-08T21:11:30.890940] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-08T21:11:30.891968] [FATAL] [VALIDATOR ] RES: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:30.892086] [FATAL] [MAIN ] RES: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:30.892129] [WARN ] [MAIN ] RES: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:30.892168] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-08T21:11:30.892251] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-08T21:11:30.892297] [INFO ] [LOCAL ] RES: Starting deletion of derivative data. [2025-10-08T21:11:30.892364] [DEBUG] [LOCAL ] RES: No derivative data file found to delete. [2025-10-08T21:11:30.892488] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RES took 38.9s. Estimated remaining: 1h 22m 11s. Rate: 7.1 symbols/min [2025-10-08T21:11:31.062417] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:31.062622] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-08T21:11:31.062705] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-08T21:11:31.062821] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-08T21:11:31.062862] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-08T21:11:31.062906] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-08T21:11:31.062937] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-08T21:11:31.242839] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-08T21:11:31.464853] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:31.496172] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-08T21:11:32.017596] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-08T21:11:32.817517] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-08T21:11:32.910149] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T21:11:33.617526] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-08T21:11:33.647704] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-08T21:11:33.745048] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T21:11:34.417699] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-10-08T21:11:35.217555] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-08T21:11:35.350498] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:11:35.752252] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T21:11:36.017573] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-08T21:11:36.402936] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T21:11:36.405602] [INFO ] [REMOTE ] REVG: Full fetch complete (57739 records). [2025-10-08T21:11:36.405733] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-08T21:11:36.406326] [FATAL] [VALIDATOR ] REVG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:36.406420] [FATAL] [MAIN ] REVG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:36.406463] [WARN ] [MAIN ] REVG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:36.406501] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-08T21:11:36.406600] [DEBUG] [LOCAL ] REVG: No primary data file found to delete. [2025-10-08T21:11:36.406660] [INFO ] [LOCAL ] REVG: Starting deletion of derivative data. [2025-10-08T21:11:36.406731] [DEBUG] [LOCAL ] REVG: No derivative data file found to delete. [2025-10-08T21:11:36.406792] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. REVG took 31.9s. Estimated remaining: 1h 22m 1s. Rate: 7.1 symbols/min [2025-10-08T21:11:36.579061] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:36.579276] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-08T21:11:36.579319] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-08T21:11:36.579444] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-08T21:11:36.579519] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-08T21:11:36.579565] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-08T21:11:36.579597] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-08T21:11:36.832819] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-08T21:11:36.954892] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:37.103262] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T21:11:37.617553] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-10-08T21:11:38.417588] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-08T21:11:38.472722] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T21:11:38.682438] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-08T21:11:38.684324] [INFO ] [REMOTE ] REX: Full fetch complete (20963 records). [2025-10-08T21:11:38.684453] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-08T21:11:38.685086] [FATAL] [VALIDATOR ] REX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:11:38.685188] [FATAL] [MAIN ] REX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:11:38.685233] [WARN ] [MAIN ] REX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:11:38.685300] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-08T21:11:38.685393] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-08T21:11:38.685457] [INFO ] [LOCAL ] REX: Starting deletion of derivative data. [2025-10-08T21:11:38.685516] [DEBUG] [LOCAL ] REX: No derivative data file found to delete. [2025-10-08T21:11:38.685595] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REX took 33.3s. Estimated remaining: 1h 21m 51s. Rate: 7.1 symbols/min [2025-10-08T21:11:38.859488] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:11:38.872249] [DEBUG] [LOCAL ] RFI: Loaded 10474 existing records from primary storage. [2025-10-08T21:11:38.872503] [INFO ] [MAIN ] RFI: Loaded 10474 existing records. [2025-10-08T21:11:39.055975] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:11:39.056264] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-08T21:11:39.056491] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-08T21:11:39.057114] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-08T21:11:39.057288] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-08T21:11:39.219058] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-08T21:11:39.402620] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T21:11:39.493843] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:11:40.017555] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-10-08T21:11:40.817617] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-08T21:11:40.890423] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T21:11:40.946999] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T21:11:41.617554] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-08T21:11:42.417695] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-08T21:11:42.540313] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T21:11:42.798252] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T21:11:43.217586] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-08T21:11:43.767868] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T21:11:44.017589] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-08T21:11:44.756148] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T21:11:44.817568] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-08T21:11:45.520813] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T21:11:45.617555] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-08T21:11:46.388356] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T21:11:46.417515] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-08T21:11:46.630006] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T21:11:47.217561] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-08T21:11:48.017585] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-08T21:11:48.164474] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T21:11:48.202607] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T21:11:48.817580] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-08T21:11:49.617532] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-08T21:11:49.726818] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T21:11:50.019350] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T21:11:50.417600] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-08T21:11:50.873237] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T21:11:51.217565] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-08T21:11:51.272824] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T21:11:52.017580] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-08T21:11:52.817527] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-08T21:11:53.016401] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-08T21:11:53.318875] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T21:11:53.357828] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T21:11:53.617578] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-08T21:11:54.417621] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-08T21:11:55.217519] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-08T21:11:55.390562] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T21:11:55.646514] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T21:11:56.017573] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-08T21:11:56.599681] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T21:11:56.817566] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-08T21:11:57.617597] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-08T21:11:57.685540] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:11:58.417545] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-08T21:11:58.453515] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:11:58.649869] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T21:11:59.217538] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-08T21:12:00.008729] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T21:12:00.017489] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-08T21:12:00.549073] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T21:12:00.711831] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T21:12:00.713057] [INFO ] [REMOTE ] RFI: Full fetch complete (15602 records). [2025-10-08T21:12:00.713144] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-08T21:12:00.822745] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-08T21:12:01.093302] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-08T21:12:01.093406] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-08T21:12:01.093842] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-08T21:12:01.093910] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-08T21:12:01.094702] [DEBUG] [LOCAL ] RFI: Trimmed 15602 records to 10472 (keeping 200 days of data) [2025-10-08T21:12:01.163291] [DEBUG] [LOCAL ] RFI: Primary data saved (10472 records). [2025-10-08T21:12:01.163451] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-08T21:12:01.163556] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. RFI took 22.5s. Estimated remaining: 1h 21m 47s. Rate: 7.1 symbols/min [2025-10-08T21:12:01.357420] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:01.357691] [DEBUG] [LOCAL ] RFL: No existing data file found in primary storage. [2025-10-08T21:12:01.357748] [WARN ] [MAIN ] RFL: No existing data found, performing full refresh instead. [2025-10-08T21:12:01.357864] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-08T21:12:01.357908] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-08T21:12:01.357950] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-08T21:12:01.357983] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-08T21:12:01.622747] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-08T21:12:01.738922] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:02.417516] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-10-08T21:12:02.723990] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-08T21:12:02.908524] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T21:12:03.189195] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T21:12:03.217503] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-08T21:12:04.002813] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T21:12:04.006175] [INFO ] [REMOTE ] REZI: Full fetch complete (65700 records). [2025-10-08T21:12:04.006340] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-08T21:12:04.007124] [FATAL] [VALIDATOR ] REZI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:04.007225] [FATAL] [MAIN ] REZI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:04.007267] [WARN ] [MAIN ] REZI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:04.007332] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-08T21:12:04.007398] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-08T21:12:04.007433] [INFO ] [LOCAL ] REZI: Starting deletion of derivative data. [2025-10-08T21:12:04.007471] [DEBUG] [LOCAL ] REZI: No derivative data file found to delete. [2025-10-08T21:12:04.007592] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REZI took 33.1s. Estimated remaining: 1h 21m 37s. Rate: 7.1 symbols/min [2025-10-08T21:12:04.022685] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-08T21:12:04.195553] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:04.195773] [DEBUG] [LOCAL ] RFM: No existing data file found in primary storage. [2025-10-08T21:12:04.195823] [WARN ] [MAIN ] RFM: No existing data found, performing full refresh instead. [2025-10-08T21:12:04.195952] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-08T21:12:04.196006] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-08T21:12:04.196049] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-08T21:12:04.196082] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-08T21:12:04.557137] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:04.817590] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-10-08T21:12:05.572346] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T21:12:05.617521] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-08T21:12:05.934770] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T21:12:06.304865] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T21:12:06.417564] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-08T21:12:07.217581] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-08T21:12:07.852982] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T21:12:08.017521] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-08T21:12:08.150750] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:12:08.708327] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-08T21:12:08.817533] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-08T21:12:09.617518] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-08T21:12:09.656249] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T21:12:10.040171] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T21:12:10.417550] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-08T21:12:11.217555] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-08T21:12:11.782123] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T21:12:12.017576] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-08T21:12:12.629960] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-08T21:12:12.677594] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T21:12:12.817587] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-08T21:12:13.440928] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:12:13.444442] [INFO ] [REMOTE ] REXR: Full fetch complete (74797 records). [2025-10-08T21:12:13.444562] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-08T21:12:13.445443] [FATAL] [VALIDATOR ] REXR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:13.445536] [FATAL] [MAIN ] REXR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:13.445578] [WARN ] [MAIN ] REXR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:13.445702] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-08T21:12:13.445781] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-08T21:12:13.445822] [INFO ] [LOCAL ] REXR: Starting deletion of derivative data. [2025-10-08T21:12:13.445861] [DEBUG] [LOCAL ] REXR: No derivative data file found to delete. [2025-10-08T21:12:13.445931] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REXR took 52.0s. Estimated remaining: 1h 21m 28s. Rate: 7.1 symbols/min [2025-10-08T21:12:13.624421] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-08T21:12:13.624202] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:13.625425] [DEBUG] [LOCAL ] RFMZ: No existing data file found in primary storage. [2025-10-08T21:12:13.626412] [WARN ] [MAIN ] RFMZ: No existing data found, performing full refresh instead. [2025-10-08T21:12:13.626618] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-08T21:12:13.626698] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-08T21:12:13.626755] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-08T21:12:13.626788] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-08T21:12:13.992325] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:14.363775] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T21:12:14.417549] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-08T21:12:15.058801] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T21:12:15.217573] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-08T21:12:16.017525] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-08T21:12:16.045691] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T21:12:16.817569] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-08T21:12:17.520528] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T21:12:17.617519] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-10-08T21:12:17.812298] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T21:12:18.289384] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-08T21:12:18.417565] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-08T21:12:19.217562] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-08T21:12:19.337383] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T21:12:19.713550] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T21:12:20.017579] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-08T21:12:20.461988] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T21:12:20.817584] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-08T21:12:21.617576] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-08T21:12:22.417601] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-08T21:12:22.685338] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T21:12:22.721557] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T21:12:23.217546] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-08T21:12:23.265435] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T21:12:23.812605] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T21:12:24.017555] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-08T21:12:24.754507] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T21:12:24.817515] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-08T21:12:25.501009] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T21:12:25.617562] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-08T21:12:26.173058] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T21:12:26.179474] [INFO ] [REMOTE ] RF: Full fetch complete (77237 records). [2025-10-08T21:12:26.180164] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-08T21:12:26.183255] [FATAL] [VALIDATOR ] RF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:26.183530] [FATAL] [MAIN ] RF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:26.183612] [WARN ] [MAIN ] RF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:26.183745] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-08T21:12:26.183851] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-08T21:12:26.183904] [INFO ] [LOCAL ] RF: Starting deletion of derivative data. [2025-10-08T21:12:26.183959] [DEBUG] [LOCAL ] RF: No derivative data file found to delete. [2025-10-08T21:12:26.184081] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RF took 49.8s. Estimated remaining: 1h 21m 21s. Rate: 7.1 symbols/min [2025-10-08T21:12:26.429499] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-08T21:12:26.444797] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:26.445114] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-08T21:12:26.445164] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-08T21:12:26.445309] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-08T21:12:26.445357] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-08T21:12:26.445403] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-08T21:12:26.445441] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-08T21:12:26.801785] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:12:26.848586] [INFO ] [REMOTE ] RFM: Full fetch complete (5843 records). [2025-10-08T21:12:26.859912] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-08T21:12:26.885393] [FATAL] [VALIDATOR ] RFM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:26.891562] [FATAL] [MAIN ] RFM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:26.926998] [WARN ] [MAIN ] RFM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:26.956038] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-08T21:12:26.970239] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:26.970802] [DEBUG] [LOCAL ] RFM: No primary data file found to delete. [2025-10-08T21:12:26.970878] [INFO ] [LOCAL ] RFM: Starting deletion of derivative data. [2025-10-08T21:12:26.970938] [DEBUG] [LOCAL ] RFM: No derivative data file found to delete. [2025-10-08T21:12:26.971015] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFM took 23.0s. Estimated remaining: 1h 21m 10s. Rate: 7.1 symbols/min [2025-10-08T21:12:27.162486] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:27.162734] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-08T21:12:27.162825] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-08T21:12:27.162951] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-08T21:12:27.163005] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-08T21:12:27.163047] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-08T21:12:27.163079] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-08T21:12:27.217577] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-10-08T21:12:27.517589] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:28.017707] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-10-08T21:12:28.609414] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T21:12:28.817574] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-08T21:12:29.247788] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T21:12:29.617562] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-08T21:12:30.336455] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T21:12:30.359598] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T21:12:30.417517] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-08T21:12:31.217560] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-08T21:12:32.017535] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-08T21:12:32.043207] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T21:12:32.113497] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T21:12:32.817534] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-08T21:12:32.875773] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T21:12:33.494525] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T21:12:33.617630] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-08T21:12:34.417623] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-08T21:12:34.446684] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T21:12:35.217574] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-08T21:12:35.949578] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T21:12:35.951437] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T21:12:36.017512] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-08T21:12:36.681146] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T21:12:36.817560] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-08T21:12:37.617562] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-08T21:12:38.072587] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-08T21:12:38.386442] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T21:12:38.417542] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-08T21:12:38.850361] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:12:38.851529] [INFO ] [REMOTE ] RFL: Full fetch complete (13064 records). [2025-10-08T21:12:38.851600] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-08T21:12:38.852073] [FATAL] [VALIDATOR ] RFL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:38.852156] [FATAL] [MAIN ] RFL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:38.852240] [WARN ] [MAIN ] RFL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:38.852327] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-08T21:12:38.852399] [DEBUG] [LOCAL ] RFL: No primary data file found to delete. [2025-10-08T21:12:38.852435] [INFO ] [LOCAL ] RFL: Starting deletion of derivative data. [2025-10-08T21:12:38.852473] [DEBUG] [LOCAL ] RFL: No derivative data file found to delete. [2025-10-08T21:12:38.852539] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFL took 37.7s. Estimated remaining: 1h 21m 3s. Rate: 7.1 symbols/min [2025-10-08T21:12:39.033161] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:39.039302] [DEBUG] [LOCAL ] RGT: Loaded 2723 existing records from primary storage. [2025-10-08T21:12:39.039542] [INFO ] [MAIN ] RGT: Loaded 2723 existing records. [2025-10-08T21:12:39.218821] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-08T21:12:39.232991] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:12:39.234218] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-08T21:12:39.234384] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-08T21:12:39.234762] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-08T21:12:39.234926] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-08T21:12:39.596504] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:40.017552] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-10-08T21:12:40.462941] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T21:12:40.703095] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T21:12:40.817532] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-08T21:12:41.617576] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-08T21:12:42.097918] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T21:12:42.417520] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-08T21:12:42.497078] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T21:12:43.217570] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-08T21:12:43.671411] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T21:12:44.018136] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-08T21:12:44.408140] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T21:12:44.817559] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-08T21:12:45.245559] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T21:12:45.617574] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-08T21:12:45.913769] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T21:12:46.417610] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-08T21:12:46.777512] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T21:12:46.907497] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T21:12:47.217561] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-08T21:12:48.017559] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-08T21:12:48.522751] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-08T21:12:48.537263] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T21:12:48.817607] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-08T21:12:49.020929] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (0.20 seconds). [2025-10-08T21:12:49.023810] [INFO ] [REMOTE ] RGA: Full fetch complete (45242 records). [2025-10-08T21:12:49.023923] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-08T21:12:49.024751] [FATAL] [VALIDATOR ] RGA: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:49.024842] [FATAL] [MAIN ] RGA: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:49.024890] [WARN ] [MAIN ] RGA: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:49.024934] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-08T21:12:49.025002] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-08T21:12:49.025040] [INFO ] [LOCAL ] RGA: Starting deletion of derivative data. [2025-10-08T21:12:49.025080] [DEBUG] [LOCAL ] RGA: No derivative data file found to delete. [2025-10-08T21:12:49.025213] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RGA took 22.8s. Estimated remaining: 1h 20m 55s. Rate: 7.1 symbols/min [2025-10-08T21:12:49.217340] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:12:49.217636] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-08T21:12:49.217719] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-08T21:12:49.217851] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-08T21:12:49.217896] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-08T21:12:49.217938] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-08T21:12:49.217971] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-08T21:12:49.599681] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:12:49.617600] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-08T21:12:50.335387] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T21:12:50.417522] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-08T21:12:51.095800] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-08T21:12:51.217542] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-08T21:12:51.804046] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T21:12:52.017601] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-08T21:12:52.817572] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-08T21:12:53.345593] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T21:12:53.414442] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T21:12:53.617591] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-08T21:12:53.938261] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T21:12:53.939400] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12425 records). [2025-10-08T21:12:53.939476] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-08T21:12:53.939932] [FATAL] [VALIDATOR ] RFMZ: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:12:53.940014] [FATAL] [MAIN ] RFMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:12:53.940057] [WARN ] [MAIN ] RFMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:12:53.940141] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-08T21:12:53.940217] [DEBUG] [LOCAL ] RFMZ: No primary data file found to delete. [2025-10-08T21:12:53.940251] [INFO ] [LOCAL ] RFMZ: Starting deletion of derivative data. [2025-10-08T21:12:53.940288] [DEBUG] [LOCAL ] RFMZ: No derivative data file found to delete. [2025-10-08T21:12:53.940342] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RFMZ took 40.5s. Estimated remaining: 1h 20m 46s. Rate: 7.1 symbols/min [2025-10-08T21:12:54.417570] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-10-08T21:12:55.217517] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-08T21:12:56.017538] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-08T21:12:56.133197] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T21:12:56.504157] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T21:12:56.730575] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-08T21:12:56.817551] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-08T21:12:57.326392] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T21:12:57.617609] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-08T21:12:58.417551] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-08T21:12:58.845973] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T21:12:58.859970] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T21:12:59.217602] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-08T21:13:00.017616] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-08T21:13:00.817576] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-08T21:13:01.055107] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T21:13:01.211459] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T21:13:01.266393] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T21:13:01.267173] [INFO ] [REMOTE ] RGT: Full fetch complete (4088 records). [2025-10-08T21:13:01.267242] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-08T21:13:01.630008] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-08T21:13:01.654213] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-08T21:13:01.654310] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-08T21:13:01.654535] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-08T21:13:01.654601] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-08T21:13:01.655079] [DEBUG] [LOCAL ] RGT: Trimmed 4088 records to 2713 (keeping 200 days of data) [2025-10-08T21:13:01.672997] [DEBUG] [LOCAL ] RGT: Primary data saved (2713 records). [2025-10-08T21:13:01.673083] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-08T21:13:01.673158] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RGT took 22.8s. Estimated remaining: 1h 20m 37s. Rate: 7.1 symbols/min [2025-10-08T21:13:02.417574] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-08T21:13:02.939852] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T21:13:03.217578] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-08T21:13:03.710425] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T21:13:03.815314] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:13:03.817101] [INFO ] [REMOTE ] RGR: Full fetch complete (28734 records). [2025-10-08T21:13:03.817173] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-08T21:13:03.817675] [FATAL] [VALIDATOR ] RGR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:03.817798] [FATAL] [MAIN ] RGR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:03.817851] [WARN ] [MAIN ] RGR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:03.817898] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-08T21:13:03.817954] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-08T21:13:03.817987] [INFO ] [LOCAL ] RGR: Starting deletion of derivative data. [2025-10-08T21:13:03.818024] [DEBUG] [LOCAL ] RGR: No derivative data file found to delete. [2025-10-08T21:13:03.818077] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGR took 36.8s. Estimated remaining: 1h 20m 27s. Rate: 7.1 symbols/min [2025-10-08T21:13:04.017608] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-08T21:13:05.882939] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T21:13:05.894013] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-08T21:13:08.065307] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T21:13:08.076934] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-08T21:13:09.722949] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T21:13:09.734415] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-08T21:13:11.743905] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-08T21:13:11.754677] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-08T21:13:13.799563] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T21:13:13.810334] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-08T21:13:15.836500] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T21:13:15.850554] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-08T21:13:17.832289] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T21:13:17.842520] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-08T21:13:18.367891] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:13:18.371140] [INFO ] [REMOTE ] RH: Full fetch complete (65308 records). [2025-10-08T21:13:18.371247] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-08T21:13:18.371964] [FATAL] [VALIDATOR ] RH: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:18.372063] [FATAL] [MAIN ] RH: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:18.372140] [WARN ] [MAIN ] RH: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:18.372238] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-08T21:13:18.372317] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-08T21:13:18.372351] [INFO ] [LOCAL ] RH: Starting deletion of derivative data. [2025-10-08T21:13:18.372390] [DEBUG] [LOCAL ] RH: No derivative data file found to delete. [2025-10-08T21:13:18.372457] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RH took 29.3s. Estimated remaining: 1h 20m 20s. Rate: 7.1 symbols/min [2025-10-08T21:13:19.012731] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:19.097390] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:19.135147] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-08T21:13:19.135294] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-08T21:13:19.135436] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-08T21:13:19.156569] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-08T21:13:19.177181] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-08T21:13:19.177336] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-08T21:13:19.177064] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-08T21:13:19.176809] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:19.177519] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-08T21:13:19.169545] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:19.183226] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-08T21:13:19.188685] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-08T21:13:19.194104] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-08T21:13:19.194411] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-08T21:13:19.199823] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-08T21:13:19.183087] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-08T21:13:19.210723] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-08T21:13:19.211014] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-08T21:13:19.205323] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-08T21:13:19.211227] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-08T21:13:19.211446] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-08T21:13:19.229574] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-08T21:13:19.244038] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-08T21:13:19.244210] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-08T21:13:19.254966] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-08T21:13:19.276743] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-08T21:13:20.777044] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:20.823515] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-10-08T21:13:20.918202] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:20.948332] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:21.007134] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-10-08T21:13:21.018852] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:21.019232] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-10-08T21:13:21.020573] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-10-08T21:13:21.371506] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:13:21.371868] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-10-08T21:13:21.371958] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:13:21.372009] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-08T21:13:21.372067] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:13:21.372139] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-08T21:13:21.372223] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-08T21:13:21.372258] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-08T21:13:21.372296] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-08T21:13:21.372341] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RHLD took 3.0s. Estimated remaining: 1h 20m 10s. Rate: 7.1 symbols/min [2025-10-08T21:13:21.538539] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:21.538724] [DEBUG] [LOCAL ] RIO: No existing data file found in primary storage. [2025-10-08T21:13:21.538772] [WARN ] [MAIN ] RIO: No existing data found, performing full refresh instead. [2025-10-08T21:13:21.538881] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-08T21:13:21.538922] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-08T21:13:21.538963] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-08T21:13:21.538994] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-08T21:13:21.890025] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:21.890335] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-10-08T21:13:22.620224] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T21:13:22.628280] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-08T21:13:22.692807] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:13:22.701932] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-08T21:13:22.732977] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T21:13:22.743780] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-08T21:13:23.808983] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T21:13:23.819913] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-08T21:13:24.106953] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T21:13:24.114558] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-08T21:13:24.197301] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T21:13:24.206245] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-08T21:13:24.503225] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T21:13:24.513991] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-08T21:13:25.291845] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:13:25.299224] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-08T21:13:25.844413] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T21:13:25.853698] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-08T21:13:26.079210] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-08T21:13:26.089986] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-08T21:13:26.362994] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T21:13:26.373320] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-08T21:13:26.733295] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T21:13:26.743358] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-08T21:13:27.399452] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T21:13:27.409846] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-08T21:13:27.832185] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:13:27.842262] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-08T21:13:28.343010] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T21:13:28.355196] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-08T21:13:28.528433] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T21:13:28.538279] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-08T21:13:29.307976] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T21:13:29.318966] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-08T21:13:29.845351] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-08T21:13:29.855400] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-08T21:13:29.974340] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:13:29.985604] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-08T21:13:30.096743] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-08T21:13:30.107770] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-08T21:13:30.677280] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T21:13:30.687142] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-08T21:13:31.191241] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T21:13:31.217496] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-08T21:13:31.988271] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T21:13:32.019938] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-08T21:13:32.040087] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T21:13:32.080609] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T21:13:32.378180] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T21:13:32.817553] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-08T21:13:33.617527] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-08T21:13:34.055311] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T21:13:34.417560] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-08T21:13:34.683261] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T21:13:34.784395] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T21:13:35.217551] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-08T21:13:36.017635] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-08T21:13:36.561398] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T21:13:36.822736] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-08T21:13:36.827449] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:13:37.617569] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-08T21:13:37.743767] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:13:38.417573] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-08T21:13:38.516069] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T21:13:38.518920] [INFO ] [REMOTE ] RHP: Full fetch complete (57762 records). [2025-10-08T21:13:38.519015] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-08T21:13:38.519798] [FATAL] [VALIDATOR ] RHP: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:38.519981] [FATAL] [MAIN ] RHP: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:38.520052] [WARN ] [MAIN ] RHP: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:38.520122] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-08T21:13:38.520190] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-08T21:13:38.520226] [INFO ] [LOCAL ] RHP: Starting deletion of derivative data. [2025-10-08T21:13:38.520284] [DEBUG] [LOCAL ] RHP: No derivative data file found to delete. [2025-10-08T21:13:38.520364] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RHP took 20.1s. Estimated remaining: 1h 20m 4s. Rate: 7.1 symbols/min [2025-10-08T21:13:38.698307] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:38.698540] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-08T21:13:38.698609] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-08T21:13:38.698812] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-08T21:13:38.698855] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-08T21:13:38.698897] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-08T21:13:38.698930] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-08T21:13:39.111190] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:39.113498] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-08T21:13:39.217550] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-10-08T21:13:40.017565] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-08T21:13:40.167836] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T21:13:40.817537] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-08T21:13:41.214372] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T21:13:41.617585] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-08T21:13:42.049947] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T21:13:42.417571] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-08T21:13:42.843148] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T21:13:43.217511] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-08T21:13:43.488605] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T21:13:44.017550] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-08T21:13:44.189581] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:13:44.817520] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-08T21:13:45.229543] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T21:13:45.617629] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-08T21:13:45.977126] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T21:13:46.417606] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-08T21:13:46.672416] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T21:13:47.217625] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-08T21:13:47.598149] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:13:47.618112] [INFO ] [REMOTE ] RIO: Full fetch complete (76970 records). [2025-10-08T21:13:47.631115] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-08T21:13:47.633059] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T21:13:47.644161] [FATAL] [VALIDATOR ] RIO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:47.644799] [FATAL] [MAIN ] RIO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:47.645047] [WARN ] [MAIN ] RIO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:47.645328] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-08T21:13:47.645436] [DEBUG] [LOCAL ] RIO: No primary data file found to delete. [2025-10-08T21:13:47.645539] [INFO ] [LOCAL ] RIO: Starting deletion of derivative data. [2025-10-08T21:13:47.646204] [DEBUG] [LOCAL ] RIO: No derivative data file found to delete. [2025-10-08T21:13:47.646283] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RIO took 26.3s. Estimated remaining: 1h 19m 56s. Rate: 7.1 symbols/min [2025-10-08T21:13:47.828010] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:47.842336] [DEBUG] [LOCAL ] RIV: Loaded 12477 existing records from primary storage. [2025-10-08T21:13:47.842698] [INFO ] [MAIN ] RIV: Loaded 12477 existing records. [2025-10-08T21:13:48.026274] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-08T21:13:48.032693] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:13:48.033043] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-08T21:13:48.033905] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-08T21:13:48.034997] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-08T21:13:48.035064] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-08T21:13:48.185822] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T21:13:48.454094] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:48.644786] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:13:48.649501] [INFO ] [REMOTE ] RHI: Full fetch complete (69747 records). [2025-10-08T21:13:48.649638] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-08T21:13:48.650580] [FATAL] [VALIDATOR ] RHI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:48.650714] [FATAL] [MAIN ] RHI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:48.650777] [WARN ] [MAIN ] RHI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:48.650855] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-08T21:13:48.650932] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-08T21:13:48.650977] [INFO ] [LOCAL ] RHI: Starting deletion of derivative data. [2025-10-08T21:13:48.651028] [DEBUG] [LOCAL ] RHI: No derivative data file found to delete. [2025-10-08T21:13:48.651100] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHI took 30.3s. Estimated remaining: 1h 19m 45s. Rate: 7.1 symbols/min [2025-10-08T21:13:48.823125] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:48.823203] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-10-08T21:13:48.823528] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-08T21:13:48.824381] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-08T21:13:48.824525] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-08T21:13:48.824636] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-08T21:13:48.824752] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-08T21:13:48.824798] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-08T21:13:49.187556] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:49.617577] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-08T21:13:49.841194] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T21:13:50.417549] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-08T21:13:51.217574] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-08T21:13:51.398722] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T21:13:51.678689] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T21:13:51.839198] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:13:51.843265] [INFO ] [REMOTE ] RIG: Full fetch complete (77316 records). [2025-10-08T21:13:51.843415] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-08T21:13:51.844222] [FATAL] [VALIDATOR ] RIG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:13:51.844326] [FATAL] [MAIN ] RIG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:13:51.844370] [WARN ] [MAIN ] RIG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:13:51.844412] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-08T21:13:51.844496] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-08T21:13:51.844554] [INFO ] [LOCAL ] RIG: Starting deletion of derivative data. [2025-10-08T21:13:51.844599] [DEBUG] [LOCAL ] RIG: No derivative data file found to delete. [2025-10-08T21:13:51.844689] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIG took 33.5s. Estimated remaining: 1h 19m 35s. Rate: 7.1 symbols/min [2025-10-08T21:13:52.041018] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-08T21:13:52.044191] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:13:52.044384] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-08T21:13:52.044455] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-08T21:13:52.045406] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-08T21:13:52.045488] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-08T21:13:52.045541] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-08T21:13:52.045575] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-08T21:13:52.396145] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:13:52.817541] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-10-08T21:13:53.617583] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-10-08T21:13:54.144424] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-08T21:13:54.417565] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-08T21:13:54.465141] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:13:55.029957] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T21:13:55.217531] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-08T21:13:55.410208] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T21:13:56.017536] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-08T21:13:56.067579] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T21:13:56.817574] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-08T21:13:57.617561] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-08T21:13:58.001863] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T21:13:58.417606] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-08T21:13:58.465538] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:13:59.146917] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:13:59.217501] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-08T21:13:59.293132] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T21:14:00.017537] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-08T21:14:00.817524] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-08T21:14:01.238303] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-08T21:14:01.617521] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-08T21:14:01.841709] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T21:14:02.417586] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-08T21:14:02.442955] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T21:14:02.824107] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T21:14:03.217700] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-08T21:14:04.017519] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-08T21:14:04.180634] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T21:14:04.555785] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-08T21:14:04.817511] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-08T21:14:04.921126] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T21:14:05.617552] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-08T21:14:06.417514] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-08T21:14:06.590069] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T21:14:07.217531] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-08T21:14:07.424410] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T21:14:07.459221] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T21:14:08.017548] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-08T21:14:08.817548] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-08T21:14:09.195475] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T21:14:09.625782] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-08T21:14:09.649186] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T21:14:10.417524] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-08T21:14:10.670064] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-08T21:14:10.927143] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-08T21:14:10.996447] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T21:14:11.000154] [INFO ] [REMOTE ] RITM: Full fetch complete (76220 records). [2025-10-08T21:14:11.000374] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-08T21:14:11.001346] [FATAL] [VALIDATOR ] RITM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:11.001535] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:11.001592] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:11.001675] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-08T21:14:11.001791] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-08T21:14:11.001860] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-10-08T21:14:11.001935] [DEBUG] [LOCAL ] RITM: No derivative data file found to delete. [2025-10-08T21:14:11.002046] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RITM took 32.5s. Estimated remaining: 1h 19m 30s. Rate: 7.1 symbols/min [2025-10-08T21:14:11.177603] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:11.177819] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-08T21:14:11.177863] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-08T21:14:11.177977] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-08T21:14:11.178019] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-08T21:14:11.178059] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-08T21:14:11.178089] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-08T21:14:11.222681] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-08T21:14:11.559670] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:12.017680] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-10-08T21:14:12.817560] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-08T21:14:13.016842] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T21:14:13.617529] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-08T21:14:13.707787] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:14:14.417544] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-08T21:14:14.695794] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T21:14:15.217573] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-08T21:14:15.309505] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T21:14:16.017525] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-08T21:14:16.122845] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T21:14:16.200731] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T21:14:16.817588] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-08T21:14:17.498735] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:14:17.500375] [INFO ] [REMOTE ] RIV: Full fetch complete (17735 records). [2025-10-08T21:14:17.500445] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-08T21:14:17.622729] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-08T21:14:17.865682] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-08T21:14:17.865772] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-08T21:14:17.866154] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-08T21:14:17.866191] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-08T21:14:17.866914] [DEBUG] [LOCAL ] RIV: Trimmed 17735 records to 12476 (keeping 200 days of data) [2025-10-08T21:14:17.943092] [DEBUG] [LOCAL ] RIV: Primary data saved (12476 records). [2025-10-08T21:14:17.943225] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-08T21:14:17.943305] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RIV took 30.3s. Estimated remaining: 1h 19m 21s. Rate: 7.1 symbols/min [2025-10-08T21:14:18.120298] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:18.120506] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-08T21:14:18.120576] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-08T21:14:18.120863] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-08T21:14:18.121153] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-08T21:14:18.121248] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-08T21:14:18.136972] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-08T21:14:18.215141] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T21:14:18.422782] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-08T21:14:18.521792] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:19.038878] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T21:14:19.217544] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-08T21:14:20.017518] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-08T21:14:20.238919] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T21:14:20.817529] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-08T21:14:21.076087] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T21:14:21.319093] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T21:14:21.617553] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-08T21:14:22.108490] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-08T21:14:22.417572] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-10-08T21:14:23.217503] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-08T21:14:23.484519] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-08T21:14:23.527477] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T21:14:24.017541] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-08T21:14:24.817559] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-08T21:14:24.997250] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T21:14:25.058141] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T21:14:25.617561] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-08T21:14:26.417622] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-08T21:14:26.786766] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:14:26.790505] [INFO ] [REMOTE ] RJF: Full fetch complete (68007 records). [2025-10-08T21:14:26.790599] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-08T21:14:26.791491] [FATAL] [VALIDATOR ] RJF: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:26.791592] [FATAL] [MAIN ] RJF: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:26.791635] [WARN ] [MAIN ] RJF: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:26.791726] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-08T21:14:26.791790] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-08T21:14:26.791876] [INFO ] [LOCAL ] RJF: Starting deletion of derivative data. [2025-10-08T21:14:26.791944] [DEBUG] [LOCAL ] RJF: No derivative data file found to delete. [2025-10-08T21:14:26.792007] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 38.1s. Estimated remaining: 1h 19m 13s. Rate: 7.1 symbols/min [2025-10-08T21:14:26.970564] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:26.970968] [DEBUG] [LOCAL ] RLJ: No existing data file found in primary storage. [2025-10-08T21:14:26.971043] [WARN ] [MAIN ] RLJ: No existing data found, performing full refresh instead. [2025-10-08T21:14:26.971189] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-08T21:14:26.971408] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-08T21:14:26.971509] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-08T21:14:26.971561] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-08T21:14:27.262040] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-08T21:14:27.352937] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-08T21:14:27.511737] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:27.541343] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T21:14:28.017610] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-10-08T21:14:28.817597] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-08T21:14:28.896128] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T21:14:29.370087] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T21:14:29.617555] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-08T21:14:30.275458] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T21:14:30.417521] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-08T21:14:31.217537] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-08T21:14:31.272066] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:14:31.740779] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T21:14:31.795859] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T21:14:31.799569] [INFO ] [REMOTE ] RKT: Full fetch complete (77048 records). [2025-10-08T21:14:31.799724] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-08T21:14:31.800567] [FATAL] [VALIDATOR ] RKT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:31.800681] [FATAL] [MAIN ] RKT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:31.800749] [WARN ] [MAIN ] RKT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:31.800821] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-08T21:14:31.800885] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-08T21:14:31.800924] [INFO ] [LOCAL ] RKT: Starting deletion of derivative data. [2025-10-08T21:14:31.800964] [DEBUG] [LOCAL ] RKT: No derivative data file found to delete. [2025-10-08T21:14:31.801021] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RKT took 40.0s. Estimated remaining: 1h 19m 3s. Rate: 7.1 symbols/min [2025-10-08T21:14:31.968261] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:31.968446] [DEBUG] [LOCAL ] RLTY: No existing data file found in primary storage. [2025-10-08T21:14:31.968481] [WARN ] [MAIN ] RLTY: No existing data found, performing full refresh instead. [2025-10-08T21:14:31.968615] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-08T21:14:31.968686] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-08T21:14:31.968745] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-08T21:14:31.968777] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-08T21:14:32.023293] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-08T21:14:32.371549] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:32.817615] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-10-08T21:14:33.524380] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T21:14:33.584007] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T21:14:33.617533] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-08T21:14:34.417568] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-08T21:14:34.513317] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T21:14:35.217588] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-08T21:14:35.724528] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T21:14:36.017534] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-08T21:14:36.817629] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-08T21:14:36.853118] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:14:37.453715] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:14:37.486256] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T21:14:37.617537] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-08T21:14:38.417553] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-08T21:14:39.151921] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T21:14:39.217574] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-08T21:14:39.923476] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T21:14:40.017548] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-08T21:14:40.827344] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-08T21:14:40.831171] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T21:14:40.895303] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T21:14:41.617623] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-08T21:14:42.417552] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-08T21:14:42.664346] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T21:14:43.218413] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-08T21:14:43.231296] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T21:14:43.293943] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T21:14:43.783455] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T21:14:43.786225] [INFO ] [REMOTE ] RL: Full fetch complete (59703 records). [2025-10-08T21:14:43.786397] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-08T21:14:43.787168] [FATAL] [VALIDATOR ] RL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:43.787276] [FATAL] [MAIN ] RL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:43.787337] [WARN ] [MAIN ] RL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:43.787432] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-08T21:14:43.787532] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-08T21:14:43.787580] [INFO ] [LOCAL ] RL: Starting deletion of derivative data. [2025-10-08T21:14:43.787622] [DEBUG] [LOCAL ] RL: No derivative data file found to delete. [2025-10-08T21:14:43.787748] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RL took 32.8s. Estimated remaining: 1h 18m 56s. Rate: 7.1 symbols/min [2025-10-08T21:14:43.966718] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:43.966907] [DEBUG] [LOCAL ] RLX: No existing data file found in primary storage. [2025-10-08T21:14:43.966969] [WARN ] [MAIN ] RLX: No existing data found, performing full refresh instead. [2025-10-08T21:14:43.967096] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-08T21:14:43.967163] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-08T21:14:43.967255] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-08T21:14:43.967331] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-08T21:14:44.022763] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-08T21:14:44.335403] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:44.817596] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-10-08T21:14:45.477303] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:14:45.617583] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-08T21:14:46.375938] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:14:46.417501] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-08T21:14:46.754756] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T21:14:47.217606] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-08T21:14:47.894020] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T21:14:48.017550] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-08T21:14:48.097312] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:14:48.817721] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-08T21:14:49.622714] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-08T21:14:49.636294] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T21:14:49.654264] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T21:14:50.417570] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-08T21:14:51.217530] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-08T21:14:51.415676] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T21:14:51.449276] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T21:14:52.017545] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-08T21:14:52.660319] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T21:14:52.755064] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T21:14:52.817545] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-08T21:14:53.617615] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-08T21:14:54.417567] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-08T21:14:54.953576] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T21:14:55.071289] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T21:14:55.217557] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-08T21:14:55.351926] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-08T21:14:56.017558] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-08T21:14:56.390931] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:14:56.392984] [INFO ] [REMOTE ] RLTY: Full fetch complete (17473 records). [2025-10-08T21:14:56.393090] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-08T21:14:56.393848] [FATAL] [VALIDATOR ] RLTY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:56.393959] [FATAL] [MAIN ] RLTY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:56.394040] [WARN ] [MAIN ] RLTY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:56.394129] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-08T21:14:56.394226] [DEBUG] [LOCAL ] RLTY: No primary data file found to delete. [2025-10-08T21:14:56.394291] [INFO ] [LOCAL ] RLTY: Starting deletion of derivative data. [2025-10-08T21:14:56.394355] [DEBUG] [LOCAL ] RLTY: No derivative data file found to delete. [2025-10-08T21:14:56.394448] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RLTY took 24.6s. Estimated remaining: 1h 18m 49s. Rate: 7.1 symbols/min [2025-10-08T21:14:56.593468] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:56.593634] [DEBUG] [LOCAL ] RM: No existing data file found in primary storage. [2025-10-08T21:14:56.593709] [WARN ] [MAIN ] RM: No existing data found, performing full refresh instead. [2025-10-08T21:14:56.593821] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-08T21:14:56.593862] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-08T21:14:56.593903] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-08T21:14:56.593934] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-08T21:14:56.825367] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-08T21:14:56.961789] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:14:56.990570] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T21:14:57.617559] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-10-08T21:14:58.275476] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T21:14:58.336198] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T21:14:58.417565] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-08T21:14:59.204400] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T21:14:59.207334] [INFO ] [REMOTE ] RLI: Full fetch complete (47503 records). [2025-10-08T21:14:59.207437] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-08T21:14:59.208092] [FATAL] [VALIDATOR ] RLI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:14:59.208180] [FATAL] [MAIN ] RLI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:14:59.208223] [WARN ] [MAIN ] RLI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:14:59.208288] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-08T21:14:59.208354] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-08T21:14:59.208393] [INFO ] [LOCAL ] RLI: Starting deletion of derivative data. [2025-10-08T21:14:59.208486] [DEBUG] [LOCAL ] RLI: No derivative data file found to delete. [2025-10-08T21:14:59.208576] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RLI took 41.3s. Estimated remaining: 1h 18m 39s. Rate: 7.1 symbols/min [2025-10-08T21:14:59.222680] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-08T21:14:59.387271] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:14:59.387471] [DEBUG] [LOCAL ] RMAX: No existing data file found in primary storage. [2025-10-08T21:14:59.387510] [WARN ] [MAIN ] RMAX: No existing data found, performing full refresh instead. [2025-10-08T21:14:59.387631] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-08T21:14:59.387720] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-08T21:14:59.387784] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-08T21:14:59.387848] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-08T21:14:59.757868] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:00.017520] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-10-08T21:15:00.172953] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T21:15:00.817515] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-08T21:15:01.125763] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T21:15:01.617601] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-08T21:15:02.417520] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-08T21:15:02.565721] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:15:03.217555] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-08T21:15:03.383776] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T21:15:03.572434] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T21:15:03.812801] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T21:15:04.017536] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-08T21:15:04.817598] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-08T21:15:05.617520] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-08T21:15:05.847629] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:15:05.891469] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:15:06.417547] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-08T21:15:06.978766] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T21:15:06.983957] [INFO ] [REMOTE ] RLJ: Full fetch complete (68946 records). [2025-10-08T21:15:06.984405] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-08T21:15:06.986423] [FATAL] [VALIDATOR ] RLJ: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:06.986566] [FATAL] [MAIN ] RLJ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:06.986611] [WARN ] [MAIN ] RLJ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:06.986710] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-08T21:15:06.986786] [DEBUG] [LOCAL ] RLJ: No primary data file found to delete. [2025-10-08T21:15:06.986824] [INFO ] [LOCAL ] RLJ: Starting deletion of derivative data. [2025-10-08T21:15:06.986862] [DEBUG] [LOCAL ] RLJ: No derivative data file found to delete. [2025-10-08T21:15:06.986955] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 40.2s. Estimated remaining: 1h 18m 30s. Rate: 7.1 symbols/min [2025-10-08T21:15:07.162720] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:07.163008] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-08T21:15:07.163119] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-08T21:15:07.163261] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-08T21:15:07.163357] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-08T21:15:07.163569] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-08T21:15:07.163725] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-08T21:15:07.225831] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-08T21:15:07.383516] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T21:15:07.589767] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:08.017531] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-08T21:15:08.479402] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T21:15:08.817557] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-08T21:15:09.021385] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T21:15:09.617521] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-08T21:15:09.823542] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:15:10.215773] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T21:15:10.417555] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-10-08T21:15:11.217576] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-08T21:15:12.017509] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-08T21:15:12.187574] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T21:15:12.195499] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T21:15:12.817568] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-08T21:15:13.045301] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T21:15:13.425771] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T21:15:13.617581] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-08T21:15:14.417547] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-08T21:15:15.217565] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-08T21:15:15.293318] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:15:15.653992] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T21:15:16.017561] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-08T21:15:16.043190] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T21:15:16.817564] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-08T21:15:17.612434] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T21:15:17.617485] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-08T21:15:17.686320] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T21:15:18.417517] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-08T21:15:18.563013] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T21:15:19.217538] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-08T21:15:19.361564] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T21:15:20.017629] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-08T21:15:20.817554] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-08T21:15:21.079311] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-08T21:15:21.353707] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T21:15:21.617634] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-08T21:15:22.417580] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-08T21:15:22.621174] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T21:15:22.828258] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T21:15:22.829269] [INFO ] [REMOTE ] RM: Full fetch complete (11510 records). [2025-10-08T21:15:22.829359] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-08T21:15:22.829844] [FATAL] [VALIDATOR ] RM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:22.829928] [FATAL] [MAIN ] RM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:22.829975] [WARN ] [MAIN ] RM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:22.830012] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-08T21:15:22.830066] [DEBUG] [LOCAL ] RM: No primary data file found to delete. [2025-10-08T21:15:22.830098] [INFO ] [LOCAL ] RM: Starting deletion of derivative data. [2025-10-08T21:15:22.830136] [DEBUG] [LOCAL ] RM: No derivative data file found to delete. [2025-10-08T21:15:22.830194] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RM took 26.4s. Estimated remaining: 1h 18m 24s. Rate: 7.1 symbols/min [2025-10-08T21:15:23.006130] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:23.006394] [DEBUG] [LOCAL ] RMI: No existing data file found in primary storage. [2025-10-08T21:15:23.006462] [WARN ] [MAIN ] RMI: No existing data found, performing full refresh instead. [2025-10-08T21:15:23.006718] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-08T21:15:23.006773] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-08T21:15:23.006817] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-08T21:15:23.006848] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-08T21:15:23.222677] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-08T21:15:23.441306] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:23.446757] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:15:24.017554] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-08T21:15:24.417367] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T21:15:24.420745] [INFO ] [REMOTE ] RLX: Full fetch complete (69767 records). [2025-10-08T21:15:24.420885] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-08T21:15:24.421614] [FATAL] [VALIDATOR ] RLX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:24.421766] [FATAL] [MAIN ] RLX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:24.421843] [WARN ] [MAIN ] RLX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:24.421945] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-08T21:15:24.422025] [DEBUG] [LOCAL ] RLX: No primary data file found to delete. [2025-10-08T21:15:24.422062] [INFO ] [LOCAL ] RLX: Starting deletion of derivative data. [2025-10-08T21:15:24.422176] [DEBUG] [LOCAL ] RLX: No derivative data file found to delete. [2025-10-08T21:15:24.422260] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLX took 40.6s. Estimated remaining: 1h 18m 13s. Rate: 7.1 symbols/min [2025-10-08T21:15:24.593351] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:24.593555] [DEBUG] [LOCAL ] RMM: No existing data file found in primary storage. [2025-10-08T21:15:24.593682] [WARN ] [MAIN ] RMM: No existing data found, performing full refresh instead. [2025-10-08T21:15:24.593813] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-08T21:15:24.593886] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-08T21:15:24.593973] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-08T21:15:24.594043] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-08T21:15:24.822766] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-08T21:15:24.974510] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:25.151189] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T21:15:25.617634] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-08T21:15:25.788195] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T21:15:26.417558] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-10-08T21:15:27.074126] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T21:15:27.217590] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-08T21:15:27.284402] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:15:27.715820] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T21:15:27.717767] [INFO ] [REMOTE ] RMAX: Full fetch complete (29849 records). [2025-10-08T21:15:27.717838] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-08T21:15:27.718281] [FATAL] [VALIDATOR ] RMAX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:27.718401] [FATAL] [MAIN ] RMAX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:27.718476] [WARN ] [MAIN ] RMAX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:27.718750] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-08T21:15:27.718836] [DEBUG] [LOCAL ] RMAX: No primary data file found to delete. [2025-10-08T21:15:27.718892] [INFO ] [LOCAL ] RMAX: Starting deletion of derivative data. [2025-10-08T21:15:27.718960] [DEBUG] [LOCAL ] RMAX: No derivative data file found to delete. [2025-10-08T21:15:27.719041] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMAX took 28.5s. Estimated remaining: 1h 18m 3s. Rate: 7.1 symbols/min [2025-10-08T21:15:27.886801] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:27.886991] [DEBUG] [LOCAL ] RMMZ: No existing data file found in primary storage. [2025-10-08T21:15:27.887030] [WARN ] [MAIN ] RMMZ: No existing data found, performing full refresh instead. [2025-10-08T21:15:27.887142] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-08T21:15:27.887184] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-08T21:15:27.887226] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-08T21:15:27.887260] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-08T21:15:28.030325] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-08T21:15:28.248703] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:28.566512] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-08T21:15:28.817571] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-10-08T21:15:29.452425] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-08T21:15:29.617615] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-08T21:15:30.352505] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T21:15:30.417549] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-08T21:15:30.910530] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T21:15:31.217557] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-08T21:15:32.017557] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-08T21:15:32.713825] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T21:15:32.757716] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:15:32.817522] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-08T21:15:33.617595] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-10-08T21:15:34.417583] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-08T21:15:34.520726] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T21:15:34.593352] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T21:15:34.814165] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T21:15:35.217612] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-08T21:15:35.698510] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T21:15:36.017569] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-08T21:15:36.629753] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T21:15:36.817591] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-08T21:15:37.456445] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T21:15:37.617569] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-08T21:15:38.339909] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T21:15:38.417597] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-08T21:15:39.217565] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-08T21:15:40.017555] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-08T21:15:40.145273] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T21:15:40.173717] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T21:15:40.567059] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T21:15:40.817557] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-08T21:15:41.478231] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T21:15:41.617553] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-08T21:15:42.417566] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-08T21:15:42.967975] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T21:15:43.217553] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-08T21:15:43.320390] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T21:15:44.017590] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-08T21:15:44.201530] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-08T21:15:44.721975] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T21:15:44.817576] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-08T21:15:45.485229] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T21:15:45.617546] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-08T21:15:46.168816] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-08T21:15:46.417592] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-08T21:15:47.158603] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T21:15:47.217503] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-08T21:15:47.892545] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T21:15:48.017551] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-08T21:15:48.668937] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T21:15:48.817558] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-08T21:15:49.553276] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T21:15:49.617545] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-08T21:15:50.048913] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:15:50.049908] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6993 records). [2025-10-08T21:15:50.049978] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-08T21:15:50.050370] [FATAL] [VALIDATOR ] RMMZ: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:50.050466] [FATAL] [MAIN ] RMMZ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:50.050508] [WARN ] [MAIN ] RMMZ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:50.050558] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-08T21:15:50.050680] [DEBUG] [LOCAL ] RMMZ: No primary data file found to delete. [2025-10-08T21:15:50.050757] [INFO ] [LOCAL ] RMMZ: Starting deletion of derivative data. [2025-10-08T21:15:50.050815] [DEBUG] [LOCAL ] RMMZ: No derivative data file found to delete. [2025-10-08T21:15:50.050869] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMMZ took 22.3s. Estimated remaining: 1h 17m 59s. Rate: 7.1 symbols/min [2025-10-08T21:15:50.224783] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:50.243637] [DEBUG] [LOCAL ] RMT: Loaded 17377 existing records from primary storage. [2025-10-08T21:15:50.243916] [INFO ] [MAIN ] RMT: Loaded 17377 existing records. [2025-10-08T21:15:50.419923] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:15:50.420049] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-08T21:15:50.421318] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-08T21:15:50.421378] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-08T21:15:50.422146] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-08T21:15:50.422215] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-08T21:15:50.782741] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:51.217548] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-08T21:15:51.228503] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T21:15:51.231867] [INFO ] [REMOTE ] RMD: Full fetch complete (60864 records). [2025-10-08T21:15:51.232007] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-08T21:15:51.232817] [FATAL] [VALIDATOR ] RMD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:15:51.232904] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:15:51.232948] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:15:51.233015] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-08T21:15:51.233111] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-08T21:15:51.233160] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-10-08T21:15:51.233214] [DEBUG] [LOCAL ] RMD: No derivative data file found to delete. [2025-10-08T21:15:51.233314] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMD took 44.2s. Estimated remaining: 1h 17m 48s. Rate: 7.1 symbols/min [2025-10-08T21:15:51.414830] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:15:51.415121] [DEBUG] [LOCAL ] RNG: No existing data file found in primary storage. [2025-10-08T21:15:51.415179] [WARN ] [MAIN ] RNG: No existing data found, performing full refresh instead. [2025-10-08T21:15:51.415294] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-08T21:15:51.415338] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-08T21:15:51.415381] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-08T21:15:51.415414] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-08T21:15:51.779677] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:15:52.017585] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-08T21:15:52.059988] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T21:15:52.716619] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T21:15:52.817605] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-08T21:15:53.617520] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-10-08T21:15:53.823719] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T21:15:54.417566] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-10-08T21:15:55.217525] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-08T21:15:55.403244] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T21:15:55.547849] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:15:55.880812] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T21:15:56.017565] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-08T21:15:56.817577] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-08T21:15:56.848842] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:15:57.617581] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-08T21:15:57.887938] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-08T21:15:58.417569] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-08T21:15:59.217562] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-08T21:15:59.290681] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:15:59.534250] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T21:15:59.931772] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T21:16:00.017595] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-08T21:16:00.817557] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-08T21:16:00.989987] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T21:16:01.617571] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-08T21:16:01.941901] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T21:16:01.943144] [INFO ] [REMOTE ] RMM: Full fetch complete (14959 records). [2025-10-08T21:16:01.943244] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-08T21:16:01.943914] [FATAL] [VALIDATOR ] RMM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:16:01.944018] [FATAL] [MAIN ] RMM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:16:01.944091] [WARN ] [MAIN ] RMM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:16:01.944298] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-08T21:16:01.944387] [DEBUG] [LOCAL ] RMM: No primary data file found to delete. [2025-10-08T21:16:01.944441] [INFO ] [LOCAL ] RMM: Starting deletion of derivative data. [2025-10-08T21:16:01.944496] [DEBUG] [LOCAL ] RMM: No derivative data file found to delete. [2025-10-08T21:16:01.944588] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMM took 37.5s. Estimated remaining: 1h 17m 41s. Rate: 7.1 symbols/min [2025-10-08T21:16:02.126473] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:02.126719] [DEBUG] [LOCAL ] RNGR: No existing data file found in primary storage. [2025-10-08T21:16:02.126777] [WARN ] [MAIN ] RNGR: No existing data found, performing full refresh instead. [2025-10-08T21:16:02.126935] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-08T21:16:02.127013] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-08T21:16:02.127085] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-08T21:16:02.127119] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-08T21:16:02.422675] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-08T21:16:02.510272] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:02.597817] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T21:16:03.217630] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-10-08T21:16:03.858859] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:16:04.017544] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-08T21:16:04.285484] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T21:16:04.817613] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-08T21:16:05.074832] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-08T21:16:05.075611] [INFO ] [REMOTE ] RMI: Full fetch complete (6171 records). [2025-10-08T21:16:05.075706] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-08T21:16:05.076084] [FATAL] [VALIDATOR ] RMI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:16:05.076165] [FATAL] [MAIN ] RMI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:16:05.076207] [WARN ] [MAIN ] RMI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:16:05.076245] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-08T21:16:05.076299] [DEBUG] [LOCAL ] RMI: No primary data file found to delete. [2025-10-08T21:16:05.076333] [INFO ] [LOCAL ] RMI: Starting deletion of derivative data. [2025-10-08T21:16:05.076426] [DEBUG] [LOCAL ] RMI: No derivative data file found to delete. [2025-10-08T21:16:05.076496] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMI took 42.2s. Estimated remaining: 1h 17m 31s. Rate: 7.1 symbols/min [2025-10-08T21:16:05.242708] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:05.260847] [DEBUG] [LOCAL ] RNP: Loaded 16007 existing records from primary storage. [2025-10-08T21:16:05.261106] [INFO ] [MAIN ] RNP: Loaded 16007 existing records. [2025-10-08T21:16:05.451535] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:16:05.451782] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-08T21:16:05.451833] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-08T21:16:05.452385] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-08T21:16:05.452446] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-08T21:16:05.618098] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-08T21:16:05.834098] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:05.864026] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T21:16:06.417581] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-10-08T21:16:06.703589] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T21:16:07.217505] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-08T21:16:07.609481] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T21:16:08.017558] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-08T21:16:08.315422] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T21:16:08.817516] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-08T21:16:08.947265] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T21:16:09.617558] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-08T21:16:10.422674] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-08T21:16:10.436714] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:16:10.720733] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T21:16:11.217506] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-08T21:16:11.522308] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T21:16:12.017555] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-08T21:16:12.458691] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T21:16:12.817566] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-08T21:16:13.072569] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T21:16:13.617527] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-08T21:16:13.982633] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T21:16:14.417621] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-08T21:16:14.677070] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T21:16:15.217576] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-08T21:16:15.260630] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T21:16:16.020324] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T21:16:16.018986] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-08T21:16:16.817606] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-08T21:16:17.265957] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:16:17.617571] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-08T21:16:17.637980] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T21:16:18.417635] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-08T21:16:18.879358] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T21:16:19.217541] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-08T21:16:19.520995] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T21:16:19.959508] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T21:16:20.017599] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-08T21:16:20.817549] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-08T21:16:21.083316] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T21:16:21.617574] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-08T21:16:21.935939] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T21:16:22.417518] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-08T21:16:22.430259] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T21:16:23.217582] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-08T21:16:23.566542] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T21:16:24.017564] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-08T21:16:24.423090] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T21:16:24.677158] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T21:16:24.679261] [INFO ] [REMOTE ] RNP: Full fetch complete (23794 records). [2025-10-08T21:16:24.679333] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-08T21:16:24.827398] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-08T21:16:25.108154] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-08T21:16:25.108275] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-08T21:16:25.108922] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-08T21:16:25.108999] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-08T21:16:25.110024] [DEBUG] [LOCAL ] RNP: Trimmed 23794 records to 16068 (keeping 200 days of data) [2025-10-08T21:16:25.216078] [DEBUG] [LOCAL ] RNP: Primary data saved (16068 records). [2025-10-08T21:16:25.216245] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-08T21:16:25.216355] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RNP took 20.1s. Estimated remaining: 1h 17m 26s. Rate: 7.1 symbols/min [2025-10-08T21:16:25.409155] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:25.409377] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-08T21:16:25.409455] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-08T21:16:25.409585] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-08T21:16:25.409631] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-08T21:16:25.409721] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-08T21:16:25.409765] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-08T21:16:25.623218] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-08T21:16:25.827867] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:25.850130] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T21:16:26.417561] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-10-08T21:16:26.565163] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T21:16:27.217621] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-08T21:16:27.700582] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T21:16:28.017541] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-08T21:16:28.331902] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T21:16:28.817577] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-08T21:16:29.617550] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-08T21:16:29.720696] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T21:16:29.800143] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T21:16:29.802003] [INFO ] [REMOTE ] RMT: Full fetch complete (25408 records). [2025-10-08T21:16:29.802075] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-08T21:16:30.178372] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-08T21:16:30.178468] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-08T21:16:30.179090] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-08T21:16:30.179165] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-08T21:16:30.180079] [DEBUG] [LOCAL ] RMT: Trimmed 25408 records to 17357 (keeping 200 days of data) [2025-10-08T21:16:30.293443] [DEBUG] [LOCAL ] RMT: Primary data saved (17357 records). [2025-10-08T21:16:30.293605] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-08T21:16:30.293731] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RMT took 40.2s. Estimated remaining: 1h 17m 16s. Rate: 7.1 symbols/min [2025-10-08T21:16:30.422728] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-08T21:16:30.473404] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:30.473521] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-08T21:16:30.473561] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-08T21:16:30.473694] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-08T21:16:30.473752] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-08T21:16:30.473797] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-08T21:16:30.473831] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-08T21:16:30.839050] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:31.217595] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-10-08T21:16:31.338401] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T21:16:32.017602] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-08T21:16:32.244374] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T21:16:32.323934] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T21:16:32.817579] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-08T21:16:33.623133] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-08T21:16:33.640129] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T21:16:34.063943] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T21:16:34.076292] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T21:16:34.077964] [INFO ] [REMOTE ] RNGR: Full fetch complete (28065 records). [2025-10-08T21:16:34.078040] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-08T21:16:34.078526] [FATAL] [VALIDATOR ] RNGR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:16:34.078609] [FATAL] [MAIN ] RNGR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:16:34.078678] [WARN ] [MAIN ] RNGR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:16:34.078750] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-08T21:16:34.078813] [DEBUG] [LOCAL ] RNGR: No primary data file found to delete. [2025-10-08T21:16:34.078848] [INFO ] [LOCAL ] RNGR: Starting deletion of derivative data. [2025-10-08T21:16:34.078915] [DEBUG] [LOCAL ] RNGR: No derivative data file found to delete. [2025-10-08T21:16:34.078992] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNGR took 32.1s. Estimated remaining: 1h 17m 6s. Rate: 7.1 symbols/min [2025-10-08T21:16:34.253214] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:34.253402] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-08T21:16:34.253440] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-08T21:16:34.253553] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-08T21:16:34.253594] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-08T21:16:34.253636] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-08T21:16:34.253761] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-08T21:16:34.431259] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-08T21:16:34.615287] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:35.217601] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-10-08T21:16:35.987917] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T21:16:36.017577] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-08T21:16:36.043381] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T21:16:36.817586] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-08T21:16:37.501365] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T21:16:37.617566] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-08T21:16:38.417533] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-08T21:16:38.633769] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T21:16:39.217563] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-08T21:16:39.343369] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:16:39.966229] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T21:16:40.017497] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-08T21:16:40.654910] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-08T21:16:40.784548] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-08T21:16:40.817565] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-08T21:16:41.617555] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-08T21:16:42.382592] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T21:16:42.417504] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-08T21:16:42.609469] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T21:16:43.217574] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-08T21:16:43.894978] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:16:44.017566] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-08T21:16:44.760357] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:16:44.817544] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-08T21:16:45.630391] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-08T21:16:45.649914] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:16:45.984493] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:16:46.417547] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-08T21:16:46.892295] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T21:16:47.217556] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-08T21:16:48.017511] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-08T21:16:48.113299] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T21:16:48.817523] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-08T21:16:49.371976] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-08T21:16:49.584469] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T21:16:49.617499] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-08T21:16:50.275199] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T21:16:50.417527] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-08T21:16:50.637581] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T21:16:51.217579] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-08T21:16:51.959861] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T21:16:52.017515] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-08T21:16:52.483995] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T21:16:52.817582] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-08T21:16:53.523062] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T21:16:53.617539] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-08T21:16:53.869359] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T21:16:54.417696] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-08T21:16:54.726227] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T21:16:54.944333] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:16:54.946738] [INFO ] [REMOTE ] RNR: Full fetch complete (50794 records). [2025-10-08T21:16:54.946896] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-08T21:16:54.947472] [FATAL] [VALIDATOR ] RNR: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:16:54.947557] [FATAL] [MAIN ] RNR: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:16:54.947599] [WARN ] [MAIN ] RNR: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:16:54.947636] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-08T21:16:54.947737] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-08T21:16:54.947775] [INFO ] [LOCAL ] RNR: Starting deletion of derivative data. [2025-10-08T21:16:54.947823] [DEBUG] [LOCAL ] RNR: No derivative data file found to delete. [2025-10-08T21:16:54.947919] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNR took 29.7s. Estimated remaining: 1h 17m 2s. Rate: 7.1 symbols/min [2025-10-08T21:16:55.117793] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:55.118017] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-08T21:16:55.118070] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-08T21:16:55.118179] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-08T21:16:55.118222] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-08T21:16:55.118263] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-08T21:16:55.118294] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-08T21:16:55.222756] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-08T21:16:55.472624] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:56.017542] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-10-08T21:16:56.817623] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-08T21:16:56.974451] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T21:16:57.617573] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-08T21:16:57.722440] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T21:16:57.799560] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:16:58.194944] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T21:16:58.198404] [INFO ] [REMOTE ] RNG: Full fetch complete (69061 records). [2025-10-08T21:16:58.198577] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-08T21:16:58.199539] [FATAL] [VALIDATOR ] RNG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:16:58.199687] [FATAL] [MAIN ] RNG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:16:58.199766] [WARN ] [MAIN ] RNG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:16:58.199857] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-08T21:16:58.199937] [DEBUG] [LOCAL ] RNG: No primary data file found to delete. [2025-10-08T21:16:58.199977] [INFO ] [LOCAL ] RNG: Starting deletion of derivative data. [2025-10-08T21:16:58.200019] [DEBUG] [LOCAL ] RNG: No derivative data file found to delete. [2025-10-08T21:16:58.200083] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNG took 1m 7s. Estimated remaining: 1h 16m 52s. Rate: 7.1 symbols/min [2025-10-08T21:16:58.368743] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:16:58.368974] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-08T21:16:58.369053] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-08T21:16:58.369207] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-08T21:16:58.369288] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-08T21:16:58.369353] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-08T21:16:58.369389] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-08T21:16:58.422750] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-08T21:16:58.831500] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:16:59.217557] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-10-08T21:17:00.017600] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-08T21:17:00.187386] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T21:17:00.540444] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:17:00.543017] [INFO ] [REMOTE ] RNST: Full fetch complete (52883 records). [2025-10-08T21:17:00.543111] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-08T21:17:00.543888] [FATAL] [VALIDATOR ] RNST: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:00.543985] [FATAL] [MAIN ] RNST: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:00.544027] [WARN ] [MAIN ] RNST: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:00.544065] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-08T21:17:00.544147] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-08T21:17:00.544203] [INFO ] [LOCAL ] RNST: Starting deletion of derivative data. [2025-10-08T21:17:00.544247] [DEBUG] [LOCAL ] RNST: No derivative data file found to delete. [2025-10-08T21:17:00.544304] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNST took 30.3s. Estimated remaining: 1h 16m 41s. Rate: 7.1 symbols/min [2025-10-08T21:17:00.712157] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:00.712367] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-08T21:17:00.712405] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-08T21:17:00.712526] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-08T21:17:00.712566] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-08T21:17:00.712607] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-08T21:17:00.712637] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-08T21:17:00.822825] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-08T21:17:01.095306] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:01.174332] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T21:17:01.617567] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-08T21:17:02.062823] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T21:17:02.417585] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-08T21:17:03.217556] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-10-08T21:17:03.450321] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T21:17:03.834448] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T21:17:04.017557] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-08T21:17:04.817730] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-08T21:17:04.875262] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T21:17:05.617564] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-08T21:17:06.135204] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-08T21:17:06.417686] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-08T21:17:06.576507] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T21:17:07.005482] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T21:17:07.007183] [INFO ] [REMOTE ] ROG: Full fetch complete (30910 records). [2025-10-08T21:17:07.007253] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-08T21:17:07.007836] [FATAL] [VALIDATOR ] ROG: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:07.007926] [FATAL] [MAIN ] ROG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:07.007967] [WARN ] [MAIN ] ROG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:07.008007] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-08T21:17:07.008065] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-08T21:17:07.008123] [INFO ] [LOCAL ] ROG: Starting deletion of derivative data. [2025-10-08T21:17:07.008193] [DEBUG] [LOCAL ] ROG: No derivative data file found to delete. [2025-10-08T21:17:07.008263] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 32.9s. Estimated remaining: 1h 16m 32s. Rate: 7.1 symbols/min [2025-10-08T21:17:07.178689] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:07.178864] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-10-08T21:17:07.178901] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-10-08T21:17:07.179013] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-08T21:17:07.179109] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-08T21:17:07.179181] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-08T21:17:07.179245] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-08T21:17:07.221745] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-08T21:17:07.320823] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T21:17:07.566174] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:08.017549] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-08T21:17:08.817567] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-10-08T21:17:08.891797] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T21:17:09.534053] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:17:09.617544] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-08T21:17:09.887922] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T21:17:10.417562] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-08T21:17:11.217583] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-08T21:17:11.668922] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T21:17:12.017599] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-08T21:17:12.381173] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T21:17:12.567953] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T21:17:12.817569] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-08T21:17:13.560686] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:17:13.617512] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-08T21:17:13.928791] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T21:17:14.417584] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-08T21:17:15.186167] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T21:17:15.217511] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-08T21:17:15.891294] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T21:17:16.017535] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-08T21:17:16.817527] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-08T21:17:17.071285] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-08T21:17:17.260129] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T21:17:17.617574] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-08T21:17:18.238795] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T21:17:18.417593] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-08T21:17:19.217562] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-08T21:17:19.358132] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T21:17:19.801082] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T21:17:20.017567] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-08T21:17:20.115533] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T21:17:20.817617] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-08T21:17:21.595433] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T21:17:21.617528] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-08T21:17:22.058729] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T21:17:22.417578] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-08T21:17:23.093933] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:17:23.105762] [INFO ] [REMOTE ] ROK: Full fetch complete (62488 records). [2025-10-08T21:17:23.117987] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-08T21:17:23.123306] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T21:17:23.121902] [FATAL] [VALIDATOR ] ROK: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:23.132673] [FATAL] [MAIN ] ROK: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:23.133128] [WARN ] [MAIN ] ROK: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:23.133560] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-08T21:17:23.133672] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-08T21:17:23.133732] [INFO ] [LOCAL ] ROK: Starting deletion of derivative data. [2025-10-08T21:17:23.133781] [DEBUG] [LOCAL ] ROK: No derivative data file found to delete. [2025-10-08T21:17:23.133847] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROK took 28.2s. Estimated remaining: 1h 16m 26s. Rate: 7.1 symbols/min [2025-10-08T21:17:23.222768] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-08T21:17:23.311169] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:23.343712] [DEBUG] [LOCAL ] RQI: Loaded 29076 existing records from primary storage. [2025-10-08T21:17:23.343991] [INFO ] [MAIN ] RQI: Loaded 29076 existing records. [2025-10-08T21:17:23.525877] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:17:23.526113] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-08T21:17:23.526159] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-08T21:17:23.526418] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-08T21:17:23.526475] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-08T21:17:23.879698] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:24.017589] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-10-08T21:17:24.427811] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T21:17:24.817601] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-08T21:17:25.433298] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T21:17:25.617568] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-08T21:17:26.417513] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-08T21:17:26.446847] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T21:17:27.109806] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T21:17:27.217567] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-08T21:17:27.788960] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T21:17:28.017573] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-08T21:17:28.817509] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-08T21:17:28.913516] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T21:17:29.381530] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T21:17:29.571205] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T21:17:29.617585] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-08T21:17:30.417638] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-08T21:17:31.095537] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T21:17:31.217615] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-08T21:17:31.544515] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T21:17:32.017623] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-08T21:17:32.817527] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-08T21:17:32.999393] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-08T21:17:33.044363] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T21:17:33.617622] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-08T21:17:34.417589] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-08T21:17:34.609243] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T21:17:34.955723] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T21:17:34.957303] [INFO ] [REMOTE ] RPT: Full fetch complete (28402 records). [2025-10-08T21:17:34.957374] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-08T21:17:34.957894] [FATAL] [VALIDATOR ] RPT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:34.958144] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:34.958187] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:34.958225] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-08T21:17:34.958280] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-10-08T21:17:34.958315] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-10-08T21:17:34.958354] [DEBUG] [LOCAL ] RPT: No derivative data file found to delete. [2025-10-08T21:17:34.958407] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. RPT took 28.0s. Estimated remaining: 1h 16m 19s. Rate: 7.1 symbols/min [2025-10-08T21:17:35.131072] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:35.131266] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-08T21:17:35.131316] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-08T21:17:35.131429] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-08T21:17:35.131473] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-08T21:17:35.131514] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-08T21:17:35.131545] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-08T21:17:35.221443] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-08T21:17:35.490627] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:35.512573] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-08T21:17:36.017592] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-10-08T21:17:36.817514] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-08T21:17:37.154507] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T21:17:37.617567] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-08T21:17:37.674528] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T21:17:38.137488] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:17:38.140881] [INFO ] [REMOTE ] ROL: Full fetch complete (72522 records). [2025-10-08T21:17:38.140997] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-08T21:17:38.141835] [FATAL] [VALIDATOR ] ROL: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:38.141951] [FATAL] [MAIN ] ROL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:38.141993] [WARN ] [MAIN ] ROL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:38.142056] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-08T21:17:38.142119] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-08T21:17:38.142154] [INFO ] [LOCAL ] ROL: Starting deletion of derivative data. [2025-10-08T21:17:38.142191] [DEBUG] [LOCAL ] ROL: No derivative data file found to delete. [2025-10-08T21:17:38.142249] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 39.9s. Estimated remaining: 1h 16m 9s. Rate: 7.1 symbols/min [2025-10-08T21:17:38.313194] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:38.313368] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-08T21:17:38.313405] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-08T21:17:38.313515] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-08T21:17:38.313557] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-08T21:17:38.313598] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-08T21:17:38.313629] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-08T21:17:38.419259] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-08T21:17:38.693611] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:38.715402] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T21:17:39.217550] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-08T21:17:39.898227] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:17:40.017551] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-08T21:17:40.120721] [DEBUG] [REMOTE ] RQI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-08T21:17:40.121029] [WARN ] [REMOTE ] RQI: No data returned for month 2025-05 [2025-10-08T21:17:40.121119] [FATAL] [REMOTE ] RQI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:17:40.121200] [FATAL] [MAIN ] RQI: Failed to fetch primary data. [2025-10-08T21:17:40.121236] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:17:40.121274] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-08T21:17:40.121327] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-10-08T21:17:40.121369] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-10-08T21:17:40.121762] [DEBUG] [LOCAL ] RQI: Deleted derivative data file. [2025-10-08T21:17:40.121849] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RQI took 17.0s. Estimated remaining: 1h 15m 58s. Rate: 7.1 symbols/min [2025-10-08T21:17:40.294921] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:40.295122] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-08T21:17:40.295165] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-08T21:17:40.295281] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-08T21:17:40.295322] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-08T21:17:40.295366] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-08T21:17:40.295399] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-08T21:17:40.665403] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:40.771249] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T21:17:40.817508] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-08T21:17:41.617582] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-08T21:17:42.333506] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T21:17:42.336597] [INFO ] [REMOTE ] RPM: Full fetch complete (59166 records). [2025-10-08T21:17:42.336728] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-08T21:17:42.337503] [FATAL] [VALIDATOR ] RPM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:17:42.337596] [FATAL] [MAIN ] RPM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:17:42.337637] [WARN ] [MAIN ] RPM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:17:42.337722] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-08T21:17:42.337782] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-08T21:17:42.337834] [INFO ] [LOCAL ] RPM: Starting deletion of derivative data. [2025-10-08T21:17:42.337901] [DEBUG] [LOCAL ] RPM: No derivative data file found to delete. [2025-10-08T21:17:42.337961] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RPM took 41.8s. Estimated remaining: 1h 15m 48s. Rate: 7.1 symbols/min [2025-10-08T21:17:42.419699] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-10-08T21:17:42.530249] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:17:42.539514] [DEBUG] [LOCAL ] RSF: Loaded 4310 existing records from primary storage. [2025-10-08T21:17:42.539939] [INFO ] [MAIN ] RSF: Loaded 4310 existing records. [2025-10-08T21:17:42.727790] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:17:42.728263] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-08T21:17:42.728361] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-08T21:17:42.754737] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-08T21:17:42.755097] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-08T21:17:42.756190] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T21:17:43.136621] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:17:43.217510] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-10-08T21:17:43.776012] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T21:17:43.817518] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T21:17:44.017551] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-08T21:17:44.714242] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T21:17:44.817581] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-08T21:17:45.436631] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T21:17:45.617532] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-10-08T21:17:46.417594] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-08T21:17:46.989065] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T21:17:47.010554] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T21:17:47.217560] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-08T21:17:48.017605] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-08T21:17:48.817510] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-08T21:17:48.856390] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T21:17:49.617504] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-08T21:17:49.867542] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T21:17:50.147325] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T21:17:50.417538] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-08T21:17:51.193074] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T21:17:51.217505] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-08T21:17:52.017509] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-08T21:17:52.546683] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T21:17:52.676903] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T21:17:52.817559] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-08T21:17:53.605179] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T21:17:53.617499] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-08T21:17:54.336393] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:17:54.417555] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-08T21:17:55.115606] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T21:17:55.217550] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-08T21:17:55.883176] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-08T21:17:56.017555] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-08T21:17:56.289672] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T21:17:56.817593] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-08T21:17:57.508591] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T21:17:57.617759] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-08T21:17:57.733174] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T21:17:58.386545] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T21:17:58.417506] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-08T21:17:59.178148] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:17:59.217495] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-08T21:17:59.778149] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T21:18:00.017560] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-08T21:18:00.817552] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-08T21:18:01.617554] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-08T21:18:01.765574] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:18:01.822798] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T21:18:02.087933] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T21:18:02.417586] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-08T21:18:03.217565] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-08T21:18:03.765479] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:18:04.017540] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-08T21:18:04.817528] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-08T21:18:04.866291] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T21:18:05.368225] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T21:18:05.617553] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-08T21:18:06.148403] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T21:18:06.417560] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-08T21:18:07.217691] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-08T21:18:07.409138] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T21:18:07.614085] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T21:18:08.017577] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-08T21:18:08.817530] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-08T21:18:08.960981] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T21:18:09.250526] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T21:18:09.299671] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T21:18:09.300624] [INFO ] [REMOTE ] RSF: Full fetch complete (5670 records). [2025-10-08T21:18:09.300766] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-08T21:18:09.622675] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-08T21:18:09.712299] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-08T21:18:09.712397] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-08T21:18:09.712676] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-08T21:18:09.712742] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-08T21:18:09.713325] [DEBUG] [LOCAL ] RSF: Trimmed 5670 records to 4306 (keeping 200 days of data) [2025-10-08T21:18:09.742066] [DEBUG] [LOCAL ] RSF: Primary data saved (4306 records). [2025-10-08T21:18:09.742240] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-08T21:18:09.742359] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RSF took 27.4s. Estimated remaining: 1h 15m 45s. Rate: 7.1 symbols/min [2025-10-08T21:18:09.928713] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:09.928859] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-08T21:18:09.928914] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-08T21:18:09.929046] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-08T21:18:09.929104] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-08T21:18:09.929149] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-08T21:18:09.929182] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-08T21:18:10.276948] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:10.417562] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-08T21:18:11.217575] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-08T21:18:11.391403] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:18:12.017545] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-10-08T21:18:12.203551] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T21:18:12.559786] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T21:18:12.817577] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-08T21:18:13.444033] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T21:18:13.447518] [INFO ] [REMOTE ] RRX: Full fetch complete (58136 records). [2025-10-08T21:18:13.447626] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-08T21:18:13.448330] [FATAL] [VALIDATOR ] RRX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:13.448436] [FATAL] [MAIN ] RRX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:13.448508] [WARN ] [MAIN ] RRX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:13.448607] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-08T21:18:13.448717] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-08T21:18:13.448767] [INFO ] [LOCAL ] RRX: Starting deletion of derivative data. [2025-10-08T21:18:13.448810] [DEBUG] [LOCAL ] RRX: No derivative data file found to delete. [2025-10-08T21:18:13.448869] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRX took 35.3s. Estimated remaining: 1h 15m 35s. Rate: 7.1 symbols/min [2025-10-08T21:18:13.627513] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:13.623873] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-08T21:18:13.627965] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-08T21:18:13.628797] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-08T21:18:13.628962] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-08T21:18:13.629050] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-08T21:18:13.629119] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-08T21:18:13.629157] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-08T21:18:13.965907] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T21:18:14.039293] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:14.417549] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-10-08T21:18:15.217577] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-08T21:18:15.452502] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:18:15.919591] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T21:18:16.017536] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-08T21:18:16.817564] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-08T21:18:16.985249] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T21:18:17.380516] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T21:18:17.382346] [INFO ] [REMOTE ] RS: Full fetch complete (38912 records). [2025-10-08T21:18:17.382422] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-08T21:18:17.383119] [FATAL] [VALIDATOR ] RS: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:17.383206] [FATAL] [MAIN ] RS: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:17.383248] [WARN ] [MAIN ] RS: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:17.383312] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-08T21:18:17.383375] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-08T21:18:17.383409] [INFO ] [LOCAL ] RS: Starting deletion of derivative data. [2025-10-08T21:18:17.383448] [DEBUG] [LOCAL ] RS: No derivative data file found to delete. [2025-10-08T21:18:17.383500] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RS took 37.3s. Estimated remaining: 1h 15m 26s. Rate: 7.1 symbols/min [2025-10-08T21:18:17.558106] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:17.558389] [DEBUG] [LOCAL ] RSKD: No existing data file found in primary storage. [2025-10-08T21:18:17.558498] [WARN ] [MAIN ] RSKD: No existing data found, performing full refresh instead. [2025-10-08T21:18:17.558737] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-08T21:18:17.558863] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-08T21:18:17.558970] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-08T21:18:17.559078] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-08T21:18:17.627963] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-08T21:18:17.888635] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T21:18:17.961073] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:18.417544] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-08T21:18:18.948495] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:18:18.953404] [INFO ] [REMOTE ] RRC: Full fetch complete (76059 records). [2025-10-08T21:18:18.953563] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-08T21:18:18.954533] [FATAL] [VALIDATOR ] RRC: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:18.954669] [FATAL] [MAIN ] RRC: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:18.954749] [WARN ] [MAIN ] RRC: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:18.954843] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-08T21:18:18.954924] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-08T21:18:18.954963] [INFO ] [LOCAL ] RRC: Starting deletion of derivative data. [2025-10-08T21:18:18.955005] [DEBUG] [LOCAL ] RRC: No derivative data file found to delete. [2025-10-08T21:18:18.955098] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RRC took 44.0s. Estimated remaining: 1h 15m 15s. Rate: 7.1 symbols/min [2025-10-08T21:18:19.145105] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:19.145301] [DEBUG] [LOCAL ] RTO: No existing data file found in primary storage. [2025-10-08T21:18:19.145364] [WARN ] [MAIN ] RTO: No existing data found, performing full refresh instead. [2025-10-08T21:18:19.145499] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-08T21:18:19.145581] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-08T21:18:19.145634] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-08T21:18:19.145710] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-08T21:18:19.222737] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-10-08T21:18:19.564470] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:19.576586] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-08T21:18:20.017579] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-08T21:18:20.785982] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:18:20.817594] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-08T21:18:21.583434] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:18:21.617499] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-08T21:18:22.314857] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T21:18:22.417520] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-08T21:18:23.217558] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-10-08T21:18:23.615398] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T21:18:24.017589] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-08T21:18:24.087229] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T21:18:24.493535] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T21:18:24.817559] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-08T21:18:25.617548] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-08T21:18:25.877037] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:18:26.417526] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-08T21:18:26.521535] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T21:18:26.568875] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T21:18:27.217588] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-08T21:18:28.017514] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-08T21:18:28.123725] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T21:18:28.760932] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T21:18:28.817488] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-08T21:18:29.382617] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:18:29.617575] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-08T21:18:30.367562] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T21:18:30.417513] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-08T21:18:30.745608] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T21:18:31.217537] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-08T21:18:32.017620] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-08T21:18:32.019902] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T21:18:32.817611] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-08T21:18:33.227605] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T21:18:33.603795] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T21:18:33.617552] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-08T21:18:34.100068] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T21:18:34.417545] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-08T21:18:34.666873] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T21:18:35.217572] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-08T21:18:35.529716] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T21:18:36.017564] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-08T21:18:36.098535] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T21:18:36.817610] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-08T21:18:37.470877] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T21:18:37.617548] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-08T21:18:38.417525] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-08T21:18:38.484532] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:18:38.928460] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T21:18:39.217582] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-08T21:18:39.823416] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T21:18:40.017611] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-08T21:18:40.817518] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-08T21:18:40.919342] [DEBUG] [REMOTE ] RSG: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T21:18:40.919862] [WARN ] [REMOTE ] RSG: No data returned for month 2025-10 [2025-10-08T21:18:40.920132] [FATAL] [REMOTE ] RSG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:18:40.921757] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T21:18:40.920549] [FATAL] [MAIN ] RSG: Failed to fetch primary data. [2025-10-08T21:18:40.921942] [WARN ] [MAIN ] RSG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:18:40.930218] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-08T21:18:40.930499] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-08T21:18:40.930996] [INFO ] [LOCAL ] RSG: Starting deletion of derivative data. [2025-10-08T21:18:40.931065] [DEBUG] [LOCAL ] RSG: No derivative data file found to delete. [2025-10-08T21:18:40.931127] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSG took 31.2s. Estimated remaining: 1h 15m 11s. Rate: 7.1 symbols/min [2025-10-08T21:18:41.316192] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T21:18:41.617557] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-08T21:18:42.417561] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-08T21:18:43.212107] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T21:18:43.220625] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-08T21:18:43.882750] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T21:18:44.017565] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-08T21:18:44.817837] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-08T21:18:45.124684] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T21:18:45.128618] [INFO ] [REMOTE ] RTO: Full fetch complete (58356 records). [2025-10-08T21:18:45.128882] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-08T21:18:45.130000] [FATAL] [VALIDATOR ] RTO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:45.130108] [FATAL] [MAIN ] RTO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:45.130177] [WARN ] [MAIN ] RTO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:45.130252] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-08T21:18:45.130339] [DEBUG] [LOCAL ] RTO: No primary data file found to delete. [2025-10-08T21:18:45.130396] [INFO ] [LOCAL ] RTO: Starting deletion of derivative data. [2025-10-08T21:18:45.130441] [DEBUG] [LOCAL ] RTO: No derivative data file found to delete. [2025-10-08T21:18:45.130516] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RTO took 26.2s. Estimated remaining: 1h 15m 1s. Rate: 7.1 symbols/min [2025-10-08T21:18:45.271699] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-08T21:18:45.307484] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-08T21:18:45.617583] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-08T21:18:46.417760] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-08T21:18:47.048108] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T21:18:47.050551] [INFO ] [REMOTE ] RSKD: Full fetch complete (48062 records). [2025-10-08T21:18:47.050682] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-08T21:18:47.052387] [FATAL] [VALIDATOR ] RSKD: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:47.052500] [FATAL] [MAIN ] RSKD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:47.052588] [WARN ] [MAIN ] RSKD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:47.052703] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-08T21:18:47.052777] [DEBUG] [LOCAL ] RSKD: No primary data file found to delete. [2025-10-08T21:18:47.052812] [INFO ] [LOCAL ] RSKD: Starting deletion of derivative data. [2025-10-08T21:18:47.052852] [DEBUG] [LOCAL ] RSKD: No derivative data file found to delete. [2025-10-08T21:18:47.052922] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 29.7s. Estimated remaining: 1h 14m 51s. Rate: 7.1 symbols/min [2025-10-08T21:18:47.082847] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T21:18:47.217558] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-08T21:18:48.960382] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T21:18:48.973833] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-08T21:18:50.664744] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T21:18:50.676707] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-08T21:18:52.181411] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:18:52.193616] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-08T21:18:52.728052] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:18:52.731736] [INFO ] [REMOTE ] RSI: Full fetch complete (69149 records). [2025-10-08T21:18:52.731970] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-08T21:18:52.733188] [FATAL] [VALIDATOR ] RSI: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:18:52.733320] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:18:52.733363] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:18:52.733400] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-08T21:18:52.733473] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-08T21:18:52.733527] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-10-08T21:18:52.733569] [DEBUG] [LOCAL ] RSI: No derivative data file found to delete. [2025-10-08T21:18:52.733640] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RSI took 39.3s. Estimated remaining: 1h 14m 41s. Rate: 7.1 symbols/min [2025-10-08T21:18:53.369341] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:53.450974] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-08T21:18:53.502202] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:53.519727] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-08T21:18:53.552224] [DEBUG] [LOCAL ] RVLV: No existing data file found in primary storage. [2025-10-08T21:18:53.555358] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-08T21:18:53.552070] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:53.573592] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-08T21:18:53.573888] [WARN ] [MAIN ] RVLV: No existing data found, performing full refresh instead. [2025-10-08T21:18:53.574257] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-08T21:18:53.578874] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-08T21:18:53.579064] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-08T21:18:53.579697] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-08T21:18:53.585027] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-08T21:18:53.595345] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:18:53.573810] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-08T21:18:53.595428] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-08T21:18:53.628319] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-08T21:18:53.644006] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-08T21:18:53.681055] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-08T21:18:53.694103] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-08T21:18:53.699431] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-08T21:18:54.119575] [DEBUG] [LOCAL ] RVT: Loaded 26409 existing records from primary storage. [2025-10-08T21:18:54.259464] [INFO ] [MAIN ] RVT: Loaded 26409 existing records. [2025-10-08T21:18:54.822466] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:54.871753] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:54.866542] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-10-08T21:18:54.884819] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-10-08T21:18:54.946845] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:54.972839] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-10-08T21:18:55.005730] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:18:55.005905] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-08T21:18:55.005953] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-08T21:18:55.006254] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-08T21:18:55.006314] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-08T21:18:55.358713] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:18:55.359025] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-10-08T21:18:56.591336] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T21:18:56.600370] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-08T21:18:56.687835] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T21:18:56.698929] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-08T21:18:56.989559] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T21:18:56.996427] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-08T21:18:57.043269] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-08T21:18:57.054557] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-08T21:18:57.968495] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T21:18:57.977632] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-08T21:18:58.102955] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T21:18:58.113325] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-08T21:18:58.138047] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-08T21:18:58.417547] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-08T21:18:58.697136] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T21:18:59.109503] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T21:18:59.217551] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-08T21:18:59.444395] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T21:19:00.017574] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-08T21:19:00.118491] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T21:19:00.403875] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-08T21:19:00.817555] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-08T21:19:01.617581] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-08T21:19:01.767832] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T21:19:02.417561] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-08T21:19:02.648237] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T21:19:03.202298] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T21:19:03.217505] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-08T21:19:04.017593] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-08T21:19:04.645704] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-08T21:19:04.698388] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:19:04.817544] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-08T21:19:05.617602] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-08T21:19:06.074615] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-08T21:19:06.417876] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-08T21:19:06.661927] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T21:19:06.726863] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-08T21:19:07.217566] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-08T21:19:08.017520] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-08T21:19:08.178051] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T21:19:08.460342] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T21:19:08.817566] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-08T21:19:09.617552] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-08T21:19:10.126477] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T21:19:10.309765] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-08T21:19:10.417507] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-08T21:19:11.217524] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-08T21:19:11.357900] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T21:19:12.017615] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-08T21:19:12.794753] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-08T21:19:12.817526] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-08T21:19:12.991521] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T21:19:13.221950] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-08T21:19:13.617605] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-08T21:19:14.417521] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-08T21:19:14.813436] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T21:19:15.118528] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-08T21:19:15.217507] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-08T21:19:15.903733] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T21:19:16.017584] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-08T21:19:16.817526] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-08T21:19:16.858635] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-08T21:19:17.617532] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-08T21:19:17.696514] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-08T21:19:18.352049] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T21:19:18.417516] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-08T21:19:18.866368] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T21:19:19.217602] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-08T21:19:20.017579] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-08T21:19:20.172856] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T21:19:20.817536] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-08T21:19:20.934838] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T21:19:20.936919] [INFO ] [REMOTE ] RVT: Full fetch complete (39269 records). [2025-10-08T21:19:20.936993] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-08T21:19:21.330410] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-08T21:19:21.330636] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-08T21:19:21.331922] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-08T21:19:21.331985] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-08T21:19:21.332974] [DEBUG] [LOCAL ] RVT: Trimmed 39269 records to 26433 (keeping 200 days of data) [2025-10-08T21:19:21.458464] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-08T21:19:21.539345] [DEBUG] [LOCAL ] RVT: Primary data saved (26433 records). [2025-10-08T21:19:21.539488] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-08T21:19:21.539629] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVT took 28.8s. Estimated remaining: 1h 14m 39s. Rate: 7.1 symbols/min [2025-10-08T21:19:21.622662] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-08T21:19:21.717296] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:21.717428] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-08T21:19:21.717464] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-08T21:19:21.717575] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-08T21:19:21.717667] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-08T21:19:21.717755] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-08T21:19:21.717824] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-08T21:19:22.081494] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:22.417539] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-10-08T21:19:22.520163] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T21:19:23.217596] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-08T21:19:23.469465] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T21:19:23.715897] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T21:19:23.883199] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T21:19:24.017614] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-08T21:19:24.549228] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T21:19:24.553355] [INFO ] [REMOTE ] RVLV: Full fetch complete (68510 records). [2025-10-08T21:19:24.553553] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-08T21:19:24.554547] [FATAL] [VALIDATOR ] RVLV: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:19:24.554713] [FATAL] [MAIN ] RVLV: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:19:24.554794] [WARN ] [MAIN ] RVLV: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:19:24.554880] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-08T21:19:24.554993] [DEBUG] [LOCAL ] RVLV: No primary data file found to delete. [2025-10-08T21:19:24.555060] [INFO ] [LOCAL ] RVLV: Starting deletion of derivative data. [2025-10-08T21:19:24.555135] [DEBUG] [LOCAL ] RVLV: No derivative data file found to delete. [2025-10-08T21:19:24.555237] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVLV took 31.8s. Estimated remaining: 1h 14m 29s. Rate: 7.1 symbols/min [2025-10-08T21:19:24.736287] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:24.736471] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-08T21:19:24.736510] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-08T21:19:24.736707] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-08T21:19:24.736780] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-08T21:19:24.736844] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-08T21:19:24.736884] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-08T21:19:24.822729] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-08T21:19:25.116354] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:25.617579] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-08T21:19:26.345037] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T21:19:26.348782] [INFO ] [REMOTE ] RTX: Full fetch complete (77342 records). [2025-10-08T21:19:26.348935] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-08T21:19:26.349855] [FATAL] [VALIDATOR ] RTX: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:19:26.349949] [FATAL] [MAIN ] RTX: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:19:26.349991] [WARN ] [MAIN ] RTX: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:19:26.350060] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-08T21:19:26.350124] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-08T21:19:26.350159] [INFO ] [LOCAL ] RTX: Starting deletion of derivative data. [2025-10-08T21:19:26.350197] [DEBUG] [LOCAL ] RTX: No derivative data file found to delete. [2025-10-08T21:19:26.350274] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RTX took 33.6s. Estimated remaining: 1h 14m 18s. Rate: 7.1 symbols/min [2025-10-08T21:19:26.420579] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-10-08T21:19:26.554515] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:26.551140] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T21:19:26.562902] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-08T21:19:26.562982] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-08T21:19:26.563122] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-08T21:19:26.563183] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-08T21:19:26.563229] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-08T21:19:26.563261] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-08T21:19:26.930905] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:26.979010] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T21:19:27.217608] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-10-08T21:19:27.642409] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-08T21:19:28.017582] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-08T21:19:28.540636] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:19:28.545801] [INFO ] [REMOTE ] RVTY: Full fetch complete (66669 records). [2025-10-08T21:19:28.546063] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-08T21:19:28.548801] [FATAL] [VALIDATOR ] RVTY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:19:28.549024] [FATAL] [MAIN ] RVTY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:19:28.549317] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:19:28.549380] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-08T21:19:28.549471] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-08T21:19:28.549547] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-08T21:19:28.549619] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-08T21:19:28.549768] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RVTY took 35.8s. Estimated remaining: 1h 14m 8s. Rate: 7.1 symbols/min [2025-10-08T21:19:28.748895] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:28.749161] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-08T21:19:28.749210] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-08T21:19:28.749324] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-08T21:19:28.749367] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-08T21:19:28.749410] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-08T21:19:28.749442] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-08T21:19:28.823416] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-08T21:19:29.104199] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:29.425475] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T21:19:29.617602] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-08T21:19:30.108243] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T21:19:30.417606] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-10-08T21:19:30.731960] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:19:30.732400] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-10-08T21:19:30.732515] [FATAL] [REMOTE ] RWTP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:19:30.732563] [FATAL] [MAIN ] RWTP: Failed to fetch primary data. [2025-10-08T21:19:30.732598] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:19:30.732638] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-08T21:19:30.732761] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-08T21:19:30.732808] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-08T21:19:30.732849] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-08T21:19:30.732902] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWTP took 2.2s. Estimated remaining: 1h 13m 58s. Rate: 7.1 symbols/min [2025-10-08T21:19:30.924718] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:30.983440] [DEBUG] [LOCAL ] RXO: Loaded 48034 existing records from primary storage. [2025-10-08T21:19:30.983889] [INFO ] [MAIN ] RXO: Loaded 48034 existing records. [2025-10-08T21:19:31.179247] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:19:31.179544] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-08T21:19:31.179696] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-08T21:19:31.180049] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-08T21:19:31.180108] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-08T21:19:31.222756] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-08T21:19:31.580803] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:32.017628] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-10-08T21:19:32.113754] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T21:19:32.817569] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-08T21:19:33.379822] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T21:19:33.617503] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-08T21:19:33.721679] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T21:19:34.417557] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-08T21:19:34.853432] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T21:19:35.217590] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-08T21:19:35.729935] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T21:19:36.017571] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-08T21:19:36.065456] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:19:36.576826] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T21:19:36.817542] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-08T21:19:37.617551] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-08T21:19:38.406330] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T21:19:38.417495] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-08T21:19:39.190045] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:19:39.217521] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-08T21:19:39.667062] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T21:19:39.711265] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T21:19:40.017597] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-08T21:19:40.494843] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T21:19:40.817564] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-08T21:19:41.617557] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-08T21:19:42.309969] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T21:19:42.417559] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-08T21:19:42.915761] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-08T21:19:42.987505] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T21:19:43.217608] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-08T21:19:43.743564] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T21:19:44.017564] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-08T21:19:44.510603] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T21:19:44.817547] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-08T21:19:45.257860] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T21:19:45.617576] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-08T21:19:45.979263] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T21:19:45.980220] [INFO ] [REMOTE ] RWTN: Full fetch complete (3134 records). [2025-10-08T21:19:45.980294] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-08T21:19:45.980801] [FATAL] [VALIDATOR ] RWTN: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:19:45.980894] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:19:45.980936] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:19:45.980976] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-08T21:19:45.981037] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-08T21:19:45.981072] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-08T21:19:45.981109] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-08T21:19:45.981166] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTN took 21.4s. Estimated remaining: 1h 13m 52s. Rate: 7.1 symbols/min [2025-10-08T21:19:46.190245] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:19:46.241670] [DEBUG] [LOCAL ] RY: Loaded 47824 existing records from primary storage. [2025-10-08T21:19:46.242035] [INFO ] [MAIN ] RY: Loaded 47824 existing records. [2025-10-08T21:19:46.414662] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:19:46.414911] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-08T21:19:46.414958] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-08T21:19:46.416158] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-08T21:19:46.416219] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-08T21:19:46.426992] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-08T21:19:46.773393] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:19:47.217581] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-10-08T21:19:48.017547] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-08T21:19:48.164805] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T21:19:48.817572] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-08T21:19:48.887623] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T21:19:49.489714] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T21:19:49.617576] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-08T21:19:50.331686] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:19:50.417494] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-08T21:19:51.217574] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-08T21:19:51.299427] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:19:52.008684] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T21:19:52.017719] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-08T21:19:52.571873] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T21:19:52.817515] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-08T21:19:52.915996] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T21:19:53.617549] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-08T21:19:54.417545] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-08T21:19:54.497173] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T21:19:55.148198] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T21:19:55.217547] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-08T21:19:56.017543] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-08T21:19:56.069707] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T21:19:56.817550] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-08T21:19:57.001520] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T21:19:57.428030] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T21:19:57.617554] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-08T21:19:58.417582] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-08T21:19:58.550179] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:19:58.937413] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T21:19:59.217554] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-08T21:19:59.918736] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T21:20:00.017526] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-08T21:20:00.273283] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T21:20:00.817599] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-08T21:20:01.617538] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-08T21:20:01.816695] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T21:20:02.234143] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:20:02.236961] [INFO ] [REMOTE ] RWT: Full fetch complete (58292 records). [2025-10-08T21:20:02.237073] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-08T21:20:02.237717] [FATAL] [VALIDATOR ] RWT: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:20:02.237828] [FATAL] [MAIN ] RWT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:20:02.237899] [WARN ] [MAIN ] RWT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:20:02.237985] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-08T21:20:02.238106] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-08T21:20:02.238166] [INFO ] [LOCAL ] RWT: Starting deletion of derivative data. [2025-10-08T21:20:02.238213] [DEBUG] [LOCAL ] RWT: No derivative data file found to delete. [2025-10-08T21:20:02.238271] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWT took 40.7s. Estimated remaining: 1h 13m 45s. Rate: 7.1 symbols/min [2025-10-08T21:20:02.424181] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-08T21:20:02.427939] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:02.464452] [DEBUG] [LOCAL ] RYAM: Loaded 35091 existing records from primary storage. [2025-10-08T21:20:02.464816] [INFO ] [MAIN ] RYAM: Loaded 35091 existing records. [2025-10-08T21:20:02.650958] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:02.651369] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-08T21:20:02.651498] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-08T21:20:02.651865] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-08T21:20:02.651987] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-08T21:20:03.056355] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:03.058425] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T21:20:03.078178] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T21:20:03.217571] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-08T21:20:03.944700] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T21:20:03.949611] [INFO ] [REMOTE ] RXO: Full fetch complete (68109 records). [2025-10-08T21:20:03.949807] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-08T21:20:03.950715] [FATAL] [VALIDATOR ] RXO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:20:03.950822] [FATAL] [MAIN ] RXO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:20:03.950865] [WARN ] [MAIN ] RXO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:20:03.950905] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-08T21:20:03.951016] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-08T21:20:03.951085] [INFO ] [LOCAL ] RXO: Starting deletion of derivative data. [2025-10-08T21:20:03.951479] [DEBUG] [LOCAL ] RXO: Deleted derivative data file. [2025-10-08T21:20:03.951608] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RXO took 33.2s. Estimated remaining: 1h 13m 35s. Rate: 7.1 symbols/min [2025-10-08T21:20:04.022806] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-08T21:20:04.156596] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:04.197974] [DEBUG] [LOCAL ] RYAN: Loaded 44622 existing records from primary storage. [2025-10-08T21:20:04.198302] [INFO ] [MAIN ] RYAN: Loaded 44622 existing records. [2025-10-08T21:20:04.381302] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:04.381493] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-08T21:20:04.381539] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-08T21:20:04.382379] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-08T21:20:04.382438] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-08T21:20:04.735151] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:04.817505] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-10-08T21:20:04.831193] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T21:20:05.617564] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-08T21:20:06.292095] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-08T21:20:06.357294] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T21:20:06.417543] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-08T21:20:07.217611] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-10-08T21:20:07.692336] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T21:20:08.017594] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-08T21:20:08.817573] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-08T21:20:09.085246] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T21:20:09.193530] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:20:09.194477] [INFO ] [REMOTE ] RWTO: Full fetch complete (4818 records). [2025-10-08T21:20:09.194551] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-08T21:20:09.194968] [FATAL] [VALIDATOR ] RWTO: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:20:09.195051] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:20:09.195093] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:20:09.195130] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-08T21:20:09.195186] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-08T21:20:09.195221] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-08T21:20:09.195259] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-08T21:20:09.195312] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RWTO took 42.8s. Estimated remaining: 1h 13m 26s. Rate: 7.1 symbols/min [2025-10-08T21:20:09.369205] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:09.390732] [DEBUG] [LOCAL ] RYI: Loaded 21623 existing records from primary storage. [2025-10-08T21:20:09.391041] [INFO ] [MAIN ] RYI: Loaded 21623 existing records. [2025-10-08T21:20:09.571927] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:09.572184] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-08T21:20:09.572233] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-08T21:20:09.572903] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-08T21:20:09.572977] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-08T21:20:09.634451] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-08T21:20:09.951508] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:09.979023] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T21:20:10.417560] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-08T21:20:11.166202] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T21:20:11.217514] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-08T21:20:12.017608] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-08T21:20:12.535887] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T21:20:12.817516] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-08T21:20:12.886036] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T21:20:13.617628] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-08T21:20:14.270921] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-08T21:20:14.417588] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-10-08T21:20:15.019053] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-08T21:20:15.166306] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T21:20:15.217544] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-08T21:20:15.679389] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-08T21:20:16.017637] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-08T21:20:16.827234] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-08T21:20:16.829772] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T21:20:17.284378] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T21:20:17.617591] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-08T21:20:18.417528] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-08T21:20:18.610293] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:20:18.724375] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T21:20:19.217593] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-08T21:20:19.736196] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:20:19.739587] [INFO ] [REMOTE ] RY: Full fetch complete (68594 records). [2025-10-08T21:20:19.739750] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-08T21:20:19.740549] [FATAL] [VALIDATOR ] RY: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:20:19.740701] [FATAL] [MAIN ] RY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:20:19.740750] [WARN ] [MAIN ] RY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:20:19.740789] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-08T21:20:19.740845] [DEBUG] [LOCAL ] RY: No primary data file found to delete. [2025-10-08T21:20:19.740880] [INFO ] [LOCAL ] RY: Starting deletion of derivative data. [2025-10-08T21:20:19.741198] [DEBUG] [LOCAL ] RY: Deleted derivative data file. [2025-10-08T21:20:19.742345] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RY took 33.8s. Estimated remaining: 1h 13m 18s. Rate: 7.1 symbols/min [2025-10-08T21:20:19.944799] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:19.947122] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T21:20:20.001184] [DEBUG] [LOCAL ] RYN: Loaded 45524 existing records from primary storage. [2025-10-08T21:20:20.001567] [INFO ] [MAIN ] RYN: Loaded 45524 existing records. [2025-10-08T21:20:20.022736] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-08T21:20:20.186542] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:20.186809] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-08T21:20:20.186860] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-08T21:20:20.187972] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-08T21:20:20.188039] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-08T21:20:20.543718] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:20.817618] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-08T21:20:21.617516] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-08T21:20:21.657598] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T21:20:22.046050] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T21:20:22.417572] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-08T21:20:23.217498] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-08T21:20:23.311078] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T21:20:23.599808] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T21:20:24.017702] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-10-08T21:20:24.822742] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-08T21:20:24.834982] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:20:25.177537] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T21:20:25.617552] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-08T21:20:26.314016] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:20:26.417564] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-08T21:20:26.945102] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T21:20:27.217561] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-08T21:20:28.017553] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-08T21:20:28.045619] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:20:28.817523] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-08T21:20:28.914453] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T21:20:29.249462] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T21:20:29.610107] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T21:20:29.612628] [INFO ] [REMOTE ] RYAM: Full fetch complete (48860 records). [2025-10-08T21:20:29.612783] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-08T21:20:29.613563] [FATAL] [VALIDATOR ] RYAM: Data is stale - most recent date (2025-10-07) is before last completed trading day (2025-10-08). Symbol may be delisted or halted. [2025-10-08T21:20:29.613678] [FATAL] [MAIN ] RYAM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:20:29.613733] [WARN ] [MAIN ] RYAM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:20:29.613798] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-08T21:20:29.613862] [DEBUG] [LOCAL ] RYAM: No primary data file found to delete. [2025-10-08T21:20:29.613907] [INFO ] [LOCAL ] RYAM: Starting deletion of derivative data. [2025-10-08T21:20:29.614095] [DEBUG] [LOCAL ] RYAM: Deleted derivative data file. [2025-10-08T21:20:29.614191] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAM took 27.4s. Estimated remaining: 1h 13m 10s. Rate: 7.1 symbols/min [2025-10-08T21:20:29.624555] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-08T21:20:29.815153] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:29.822585] [DEBUG] [LOCAL ] RZB: Loaded 6054 existing records from primary storage. [2025-10-08T21:20:29.822834] [INFO ] [MAIN ] RZB: Loaded 6054 existing records. [2025-10-08T21:20:30.003340] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:30.004778] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-08T21:20:30.004838] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-08T21:20:30.005546] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-08T21:20:30.005841] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-08T21:20:30.353789] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:30.417504] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-10-08T21:20:31.222684] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-08T21:20:31.241036] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T21:20:31.304434] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T21:20:32.017582] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-08T21:20:32.450587] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T21:20:32.817623] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-08T21:20:33.617557] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-08T21:20:33.785015] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T21:20:33.883161] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T21:20:34.417587] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-08T21:20:35.217545] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-08T21:20:35.287464] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T21:20:35.328095] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T21:20:36.017553] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-08T21:20:36.540166] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T21:20:36.817521] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-08T21:20:36.977602] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T21:20:37.617560] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-08T21:20:38.417577] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-08T21:20:38.659865] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T21:20:39.165943] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T21:20:39.222703] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-08T21:20:39.239731] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:20:40.017572] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-08T21:20:40.717921] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-08T21:20:40.817542] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-08T21:20:40.928166] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T21:20:41.617611] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-08T21:20:42.295276] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T21:20:42.417581] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-08T21:20:43.217529] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-08T21:20:43.278055] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:20:43.526287] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T21:20:43.596529] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T21:20:44.017555] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-08T21:20:44.817556] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-08T21:20:45.412274] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T21:20:45.417119] [INFO ] [REMOTE ] RYAN: Full fetch complete (64205 records). [2025-10-08T21:20:45.417395] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-08T21:20:45.632507] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-08T21:20:45.822427] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-08T21:20:45.905488] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-08T21:20:45.905600] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-08T21:20:45.906596] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-08T21:20:45.906747] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-08T21:20:45.908860] [DEBUG] [LOCAL ] RYAN: Trimmed 64205 records to 44657 (keeping 200 days of data) [2025-10-08T21:20:46.180596] [DEBUG] [LOCAL ] RYAN: Primary data saved (44657 records). [2025-10-08T21:20:46.180762] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-08T21:20:46.180856] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAN took 42.2s. Estimated remaining: 1h 13m 4s. Rate: 7.1 symbols/min [2025-10-08T21:20:46.346538] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:46.355160] [DEBUG] [LOCAL ] RZC: Loaded 6766 existing records from primary storage. [2025-10-08T21:20:46.355355] [INFO ] [MAIN ] RZC: Loaded 6766 existing records. [2025-10-08T21:20:46.422845] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-08T21:20:46.555937] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:46.556247] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-08T21:20:46.556312] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-08T21:20:46.556610] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-08T21:20:46.556723] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-08T21:20:46.886436] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T21:20:46.964493] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:46.966155] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T21:20:47.217553] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-10-08T21:20:47.907809] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-08T21:20:48.017559] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-08T21:20:48.681587] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T21:20:48.817599] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-08T21:20:49.617562] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-08T21:20:50.290596] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-08T21:20:50.324094] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:20:50.417542] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-08T21:20:51.217567] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-08T21:20:51.886481] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T21:20:51.888685] [INFO ] [REMOTE ] RYI: Full fetch complete (32253 records). [2025-10-08T21:20:51.888811] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-08T21:20:52.022698] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-08T21:20:52.304021] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T21:20:52.379525] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-08T21:20:52.379621] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-08T21:20:52.380514] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-08T21:20:52.380576] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-08T21:20:52.381852] [DEBUG] [LOCAL ] RYI: Trimmed 32253 records to 21603 (keeping 200 days of data) [2025-10-08T21:20:52.524432] [DEBUG] [LOCAL ] RYI: Primary data saved (21603 records). [2025-10-08T21:20:52.524567] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-08T21:20:52.524691] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RYI took 43.3s. Estimated remaining: 1h 12m 55s. Rate: 7.1 symbols/min [2025-10-08T21:20:52.698917] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:20:52.723301] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T21:20:52.766297] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-08T21:20:52.766687] [INFO ] [MAIN ] S: Loaded 53532 existing records. [2025-10-08T21:20:52.822743] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-08T21:20:53.000902] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:20:53.001176] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-08T21:20:53.001226] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-08T21:20:53.002393] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-08T21:20:53.002458] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-08T21:20:53.546287] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:20:53.617586] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-08T21:20:53.630033] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T21:20:54.417579] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-08T21:20:55.019491] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T21:20:55.227465] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-08T21:20:55.233165] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:20:55.869621] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T21:20:56.017585] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-08T21:20:56.713067] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T21:20:56.817513] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-08T21:20:57.538590] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T21:20:57.617569] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-08T21:20:58.300421] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T21:20:58.417496] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-10-08T21:20:59.217568] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-08T21:20:59.634451] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:20:59.635431] [INFO ] [REMOTE ] RZC: Full fetch complete (9747 records). [2025-10-08T21:20:59.635506] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-08T21:20:59.988568] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-08T21:20:59.988636] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-08T21:20:59.988873] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-08T21:20:59.988914] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-08T21:20:59.989365] [DEBUG] [LOCAL ] RZC: Trimmed 9747 records to 6781 (keeping 200 days of data) [2025-10-08T21:21:00.022692] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-08T21:21:00.035930] [DEBUG] [LOCAL ] RZC: Primary data saved (6781 records). [2025-10-08T21:21:00.035998] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-08T21:21:00.036070] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RZC took 13.9s. Estimated remaining: 1h 12m 46s. Rate: 7.1 symbols/min [2025-10-08T21:21:00.209005] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:00.251570] [DEBUG] [LOCAL ] SA: Loaded 43765 existing records from primary storage. [2025-10-08T21:21:00.251931] [INFO ] [MAIN ] SA: Loaded 43765 existing records. [2025-10-08T21:21:00.430544] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:00.430751] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-08T21:21:00.430801] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-08T21:21:00.431563] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-08T21:21:00.431621] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-08T21:21:00.790181] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:00.819337] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-10-08T21:21:00.822023] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-08T21:21:01.455293] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T21:21:01.617556] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-08T21:21:02.020507] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T21:21:02.251946] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T21:21:02.417601] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-08T21:21:03.009566] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T21:21:03.217636] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-08T21:21:04.017609] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-08T21:21:04.438860] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:21:04.439808] [INFO ] [REMOTE ] RZB: Full fetch complete (8559 records). [2025-10-08T21:21:04.439893] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-08T21:21:04.818987] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-08T21:21:04.818765] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-08T21:21:04.819174] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-08T21:21:04.820281] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-08T21:21:04.820346] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-08T21:21:04.820995] [DEBUG] [LOCAL ] RZB: Trimmed 8559 records to 6038 (keeping 200 days of data) [2025-10-08T21:21:04.866503] [DEBUG] [LOCAL ] RZB: Primary data saved (6038 records). [2025-10-08T21:21:04.866694] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-08T21:21:04.866814] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RZB took 35.3s. Estimated remaining: 1h 12m 36s. Rate: 7.1 symbols/min [2025-10-08T21:21:05.060145] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:05.071294] [DEBUG] [LOCAL ] SABA: Loaded 9275 existing records from primary storage. [2025-10-08T21:21:05.071525] [INFO ] [MAIN ] SABA: Loaded 9275 existing records. [2025-10-08T21:21:05.263163] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:05.263526] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-08T21:21:05.263690] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-08T21:21:05.264079] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-08T21:21:05.264158] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-08T21:21:05.413573] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-08T21:21:05.622633] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-08T21:21:05.681258] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:06.298023] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T21:21:06.417504] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-10-08T21:21:07.217520] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-08T21:21:07.281260] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T21:21:07.582694] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T21:21:08.017618] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-08T21:21:08.700619] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T21:21:08.817552] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-08T21:21:09.617573] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-08T21:21:09.676863] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T21:21:10.306055] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T21:21:10.309531] [INFO ] [REMOTE ] RYN: Full fetch complete (65053 records). [2025-10-08T21:21:10.309676] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-08T21:21:10.422703] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-08T21:21:10.716804] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T21:21:10.738176] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-08T21:21:10.738278] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-08T21:21:10.739287] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-08T21:21:10.739353] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-08T21:21:10.740794] [DEBUG] [LOCAL ] RYN: Trimmed 65053 records to 45442 (keeping 200 days of data) [2025-10-08T21:21:11.028364] [DEBUG] [LOCAL ] RYN: Primary data saved (45442 records). [2025-10-08T21:21:11.028515] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-08T21:21:11.029542] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RYN took 51.3s. Estimated remaining: 1h 12m 27s. Rate: 7.1 symbols/min [2025-10-08T21:21:11.225938] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-08T21:21:11.231693] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:11.277722] [DEBUG] [LOCAL ] SAFE: Loaded 30290 existing records from primary storage. [2025-10-08T21:21:11.278303] [INFO ] [MAIN ] SAFE: Loaded 30290 existing records. [2025-10-08T21:21:11.460010] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:11.460419] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-08T21:21:11.460493] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-08T21:21:11.461401] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-08T21:21:11.461466] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-08T21:21:11.844603] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:12.017583] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-10-08T21:21:12.658427] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-08T21:21:12.817530] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-08T21:21:12.846700] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T21:21:13.152236] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:21:13.617604] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-08T21:21:14.417513] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-08T21:21:14.699823] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T21:21:14.922686] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-08T21:21:15.217533] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-08T21:21:15.740901] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T21:21:16.017608] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-08T21:21:16.817545] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-08T21:21:17.239731] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-08T21:21:17.616865] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T21:21:17.616059] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T21:21:17.625859] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-08T21:21:18.417574] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-08T21:21:19.177707] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T21:21:19.217520] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-08T21:21:19.524582] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-08T21:21:19.929611] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T21:21:20.017601] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-08T21:21:20.817534] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-08T21:21:21.569393] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T21:21:21.617516] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-08T21:21:22.417574] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-08T21:21:22.700131] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T21:21:23.181515] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T21:21:23.217604] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-08T21:21:23.735373] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T21:21:24.017698] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-08T21:21:24.501220] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T21:21:24.817576] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-08T21:21:25.617621] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-08T21:21:26.019847] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T21:21:26.417628] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-08T21:21:26.503024] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T21:21:26.533166] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T21:21:27.217563] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-08T21:21:28.017585] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-08T21:21:28.269151] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-08T21:21:28.273607] [INFO ] [REMOTE ] S: Full fetch complete (77546 records). [2025-10-08T21:21:28.273839] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-08T21:21:28.677775] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T21:21:28.722713] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-08T21:21:28.723018] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-08T21:21:28.724316] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-08T21:21:28.724566] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-08T21:21:28.724501] [INFO ] [REMOTE ] SA: Full fetch complete (62763 records). [2025-10-08T21:21:28.724747] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-08T21:21:28.831080] [DEBUG] [LOCAL ] S: Trimmed 77546 records to 53532 (keeping 200 days of data) [2025-10-08T21:21:28.827155] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-08T21:21:29.269334] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-08T21:21:29.269541] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-08T21:21:29.271346] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-08T21:21:29.271479] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-08T21:21:29.277138] [DEBUG] [LOCAL ] SA: Trimmed 62763 records to 43887 (keeping 200 days of data) [2025-10-08T21:21:29.401384] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T21:21:29.602444] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T21:21:29.633746] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-08T21:21:29.667957] [DEBUG] [LOCAL ] S: Primary data saved (53532 records). [2025-10-08T21:21:29.668890] [INFO ] [MAIN ] S: Full history saved. [2025-10-08T21:21:29.669049] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. S took 37.1s. Estimated remaining: 1h 12m 22s. Rate: 7.1 symbols/min [2025-10-08T21:21:29.859610] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:30.017948] [DEBUG] [LOCAL ] SA: Primary data saved (43887 records). [2025-10-08T21:21:30.017548] [DEBUG] [LOCAL ] SAH: Loaded 21676 existing records from primary storage. [2025-10-08T21:21:30.018100] [INFO ] [MAIN ] SA: Full history saved. [2025-10-08T21:21:30.018220] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SA took 30.0s. Estimated remaining: 1h 12m 11s. Rate: 7.1 symbols/min [2025-10-08T21:21:30.049769] [INFO ] [MAIN ] SAH: Loaded 21676 existing records. [2025-10-08T21:21:30.341525] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:30.352181] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-08T21:21:30.352335] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-08T21:21:30.352603] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-08T21:21:30.352720] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-08T21:21:30.352824] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-08T21:21:30.352937] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-08T21:21:30.420807] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-08T21:21:30.478064] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:30.494278] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-08T21:21:30.494499] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-08T21:21:30.522548] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-08T21:21:30.535062] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T21:21:30.535678] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-08T21:21:31.071691] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:31.186783] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:31.217508] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-10-08T21:21:31.756303] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T21:21:32.017617] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-08T21:21:32.055832] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T21:21:32.817566] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-10-08T21:21:33.180300] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T21:21:33.183215] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:21:33.617568] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-08T21:21:33.919384] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-08T21:21:34.417560] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-08T21:21:34.751087] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-08T21:21:35.217576] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-08T21:21:36.017550] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-08T21:21:36.339919] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-08T21:21:36.558967] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T21:21:36.817611] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-08T21:21:37.576471] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:21:37.617565] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-08T21:21:37.855285] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-08T21:21:38.417546] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-08T21:21:38.791412] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-08T21:21:39.217555] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-08T21:21:40.017635] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-08T21:21:40.513346] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T21:21:40.637332] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T21:21:40.817573] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-08T21:21:41.617553] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-08T21:21:42.049071] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T21:21:42.423884] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-08T21:21:42.426545] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T21:21:43.217560] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-08T21:21:43.467961] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T21:21:43.470314] [INFO ] [REMOTE ] SAFE: Full fetch complete (44936 records). [2025-10-08T21:21:43.470392] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-08T21:21:43.836362] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-08T21:21:43.836446] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-08T21:21:43.837217] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-08T21:21:43.837279] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-08T21:21:43.838232] [DEBUG] [LOCAL ] SAFE: Trimmed 44936 records to 30306 (keeping 200 days of data) [2025-10-08T21:21:44.018006] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-08T21:21:44.040403] [DEBUG] [LOCAL ] SAFE: Primary data saved (30306 records). [2025-10-08T21:21:44.040519] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-08T21:21:44.040616] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SAFE took 33.0s. Estimated remaining: 1h 12m 4s. Rate: 7.1 symbols/min [2025-10-08T21:21:44.219950] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:44.233613] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T21:21:44.259095] [DEBUG] [LOCAL ] SAM: Loaded 21368 existing records from primary storage. [2025-10-08T21:21:44.259378] [INFO ] [MAIN ] SAM: Loaded 21368 existing records. [2025-10-08T21:21:44.438092] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:44.438325] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-08T21:21:44.438371] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-08T21:21:44.438914] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-08T21:21:44.438974] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-08T21:21:44.792580] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:44.817490] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-10-08T21:21:44.890704] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T21:21:45.557038] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T21:21:45.617597] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-08T21:21:46.183027] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T21:21:46.184358] [INFO ] [REMOTE ] SABA: Full fetch complete (15307 records). [2025-10-08T21:21:46.184431] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-08T21:21:46.426101] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-08T21:21:46.584462] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-08T21:21:46.584559] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-08T21:21:46.584951] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-08T21:21:46.585010] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-08T21:21:46.585491] [DEBUG] [LOCAL ] SABA: Trimmed 15307 records to 9280 (keeping 200 days of data) [2025-10-08T21:21:46.640254] [DEBUG] [LOCAL ] SABA: Primary data saved (9280 records). [2025-10-08T21:21:46.640388] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-08T21:21:46.640483] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. SABA took 41.8s. Estimated remaining: 1h 11m 54s. Rate: 7.1 symbols/min [2025-10-08T21:21:46.807508] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:46.809463] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T21:21:46.863544] [DEBUG] [LOCAL ] SAN: Loaded 52981 existing records from primary storage. [2025-10-08T21:21:46.863958] [INFO ] [MAIN ] SAN: Loaded 52981 existing records. [2025-10-08T21:21:47.035996] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:47.036209] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-08T21:21:47.036256] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-08T21:21:47.037249] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-08T21:21:47.037309] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-08T21:21:47.222745] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-08T21:21:47.386233] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:48.017523] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-10-08T21:21:48.528486] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-08T21:21:48.817546] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-08T21:21:49.621453] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-08T21:21:49.627616] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T21:21:49.929783] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-08T21:21:49.959579] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T21:21:50.417616] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-08T21:21:50.753115] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-08T21:21:51.217553] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-08T21:21:52.017595] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-08T21:21:52.582329] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T21:21:52.817576] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-08T21:21:53.128638] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-08T21:21:53.617529] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-08T21:21:53.858718] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T21:21:54.417520] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-08T21:21:54.709939] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T21:21:55.217572] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-08T21:21:55.556839] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T21:21:56.017562] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-08T21:21:56.253659] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.24 seconds). [2025-10-08T21:21:56.254335] [INFO ] [REMOTE ] SAJ: Full fetch complete (924 records). [2025-10-08T21:21:56.254403] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-08T21:21:56.436732] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-08T21:21:56.436937] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:21:56.437013] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:21:56.437101] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-08T21:21:56.437167] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-08T21:21:56.437203] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-08T21:21:56.437260] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-08T21:21:56.437343] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAJ took 26.4s. Estimated remaining: 1h 11m 46s. Rate: 7.1 symbols/min [2025-10-08T21:21:56.652205] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:21:56.706339] [DEBUG] [LOCAL ] SAND: Loaded 51804 existing records from primary storage. [2025-10-08T21:21:56.706720] [INFO ] [MAIN ] SAND: Loaded 51804 existing records. [2025-10-08T21:21:56.831901] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-08T21:21:56.901541] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:21:56.925043] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-10-08T21:21:56.928411] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-10-08T21:21:56.930836] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T21:21:56.930894] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-10-08T21:21:56.934580] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-10-08T21:21:57.321781] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:21:57.617565] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-08T21:21:58.070094] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T21:21:58.417590] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-10-08T21:21:59.217517] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-08T21:21:59.613895] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T21:21:59.690363] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T21:22:00.025605] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-08T21:22:00.029286] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T21:22:00.802341] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T21:22:00.817516] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-08T21:22:01.617629] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-10-08T21:22:02.040104] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T21:22:02.417619] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-08T21:22:03.192015] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T21:22:03.217538] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-10-08T21:22:03.407906] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-08T21:22:04.017590] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-08T21:22:04.743381] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T21:22:04.817615] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-08T21:22:05.637148] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-10-08T21:22:05.650622] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T21:22:05.685910] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T21:22:06.417633] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-08T21:22:07.217535] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-08T21:22:07.506088] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T21:22:07.557139] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T21:22:08.017587] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-08T21:22:08.817543] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-10-08T21:22:09.013080] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T21:22:09.392269] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T21:22:09.617578] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-08T21:22:10.417558] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-08T21:22:10.513459] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T21:22:11.217523] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-10-08T21:22:11.257094] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T21:22:11.447848] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T21:22:12.017626] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-08T21:22:12.802569] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T21:22:12.817492] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-10-08T21:22:13.559613] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T21:22:13.617539] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-08T21:22:14.417591] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-08T21:22:14.640954] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T21:22:15.173112] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T21:22:15.217535] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-08T21:22:15.299603] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T21:22:16.017548] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-08T21:22:16.367924] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T21:22:16.788132] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-08T21:22:16.789892] [INFO ] [REMOTE ] SAH: Full fetch complete (30626 records). [2025-10-08T21:22:16.789985] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-08T21:22:16.822729] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-08T21:22:17.165992] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-08T21:22:17.166078] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-08T21:22:17.166757] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-08T21:22:17.166818] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-08T21:22:17.167581] [DEBUG] [LOCAL ] SAH: Trimmed 30626 records to 21601 (keeping 200 days of data) [2025-10-08T21:22:17.300610] [DEBUG] [LOCAL ] SAH: Primary data saved (21601 records). [2025-10-08T21:22:17.300770] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-08T21:22:17.300856] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 47.6s. Estimated remaining: 1h 11m 41s. Rate: 7.1 symbols/min [2025-10-08T21:22:17.470444] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:17.516034] [DEBUG] [LOCAL ] SAP: Loaded 49931 existing records from primary storage. [2025-10-08T21:22:17.516394] [INFO ] [MAIN ] SAP: Loaded 49931 existing records. [2025-10-08T21:22:17.622719] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-10-08T21:22:17.692965] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:22:17.693156] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-08T21:22:17.693202] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-08T21:22:17.694226] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-08T21:22:17.694285] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-08T21:22:18.042845] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:18.417529] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-10-08T21:22:18.535212] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T21:22:19.217602] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-08T21:22:19.583953] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T21:22:20.017556] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-08T21:22:20.196396] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:22:20.817566] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-10-08T21:22:20.862058] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T21:22:20.872081] [INFO ] [REMOTE ] SAN: Full fetch complete (76294 records). [2025-10-08T21:22:20.872909] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-08T21:22:20.872993] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-08T21:22:20.919925] [INFO ] [REMOTE ] SAM: Full fetch complete (30919 records). [2025-10-08T21:22:20.941809] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-08T21:22:21.621138] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-08T21:22:21.653069] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-08T21:22:21.664262] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-08T21:22:21.677281] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-08T21:22:21.687797] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-08T21:22:21.777718] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-08T21:22:21.777915] [DEBUG] [LOCAL ] SAN: Trimmed 76294 records to 52980 (keeping 200 days of data) [2025-10-08T21:22:21.778069] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-08T21:22:21.778445] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-08T21:22:21.778530] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-08T21:22:21.780103] [DEBUG] [LOCAL ] SAM: Trimmed 30919 records to 21350 (keeping 200 days of data) [2025-10-08T21:22:22.039446] [DEBUG] [LOCAL ] SAM: Primary data saved (21350 records). [2025-10-08T21:22:22.040449] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-08T21:22:22.040840] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAM took 38.0s. Estimated remaining: 1h 11m 31s. Rate: 7.1 symbols/min [2025-10-08T21:22:22.317937] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:22.348465] [DEBUG] [LOCAL ] SAR: Loaded 16626 existing records from primary storage. [2025-10-08T21:22:22.350033] [INFO ] [MAIN ] SAR: Loaded 16626 existing records. [2025-10-08T21:22:22.477971] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T21:22:22.559381] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-10-08T21:22:22.593189] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:22:22.597748] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-08T21:22:22.598317] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-08T21:22:22.599415] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-08T21:22:22.599849] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-08T21:22:23.068264] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:23.081006] [DEBUG] [LOCAL ] SAN: Primary data saved (52980 records). [2025-10-08T21:22:23.081315] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-08T21:22:23.081473] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAN took 36.4s. Estimated remaining: 1h 11m 21s. Rate: 7.1 symbols/min [2025-10-08T21:22:23.231666] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-10-08T21:22:23.267274] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:23.297451] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:22:23.348723] [DEBUG] [LOCAL ] SARO: Loaded 48570 existing records from primary storage. [2025-10-08T21:22:23.349094] [INFO ] [MAIN ] SARO: Loaded 48570 existing records. [2025-10-08T21:22:23.524380] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:22:23.524628] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-08T21:22:23.524767] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-08T21:22:23.525778] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-08T21:22:23.525848] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-08T21:22:23.878290] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:23.994022] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T21:22:24.017540] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-08T21:22:24.387675] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-08T21:22:24.817588] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-10. [2025-10-08T21:22:25.617704] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-08T21:22:25.755343] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:22:26.417558] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-08T21:22:26.471851] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T21:22:26.483263] [INFO ] [REMOTE ] SAND: Full fetch complete (74456 records). [2025-10-08T21:22:26.484222] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-10-08T21:22:26.484157] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T21:22:26.887544] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-10-08T21:22:26.887630] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-10-08T21:22:26.888815] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-10-08T21:22:26.888882] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-10-08T21:22:26.890338] [DEBUG] [LOCAL ] SAND: Trimmed 74456 records to 51820 (keeping 200 days of data) [2025-10-08T21:22:27.213746] [DEBUG] [LOCAL ] SAND: Primary data saved (51820 records). [2025-10-08T21:22:27.213872] [INFO ] [MAIN ] SAND: Full history saved. [2025-10-08T21:22:27.213970] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAND took 30.8s. Estimated remaining: 1h 11m 11s. Rate: 7.1 symbols/min [2025-10-08T21:22:27.225277] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-10-08T21:22:27.391788] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:27.391938] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-08T21:22:27.391974] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-08T21:22:27.392092] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-08T21:22:27.392134] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-08T21:22:27.392174] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-08T21:22:27.392205] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-08T21:22:27.799330] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:28.017525] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-10-08T21:22:28.319491] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T21:22:28.454224] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T21:22:28.795361] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T21:22:28.817496] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-08T21:22:29.617557] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-08T21:22:30.417530] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-08T21:22:30.588919] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T21:22:30.993735] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T21:22:31.217568] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-08T21:22:31.568848] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T21:22:31.580296] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T21:22:32.017560] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-08T21:22:32.374273] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T21:22:32.817566] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-08T21:22:33.246190] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-08T21:22:33.617551] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-08T21:22:34.417552] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-08T21:22:35.217573] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-08T21:22:35.441424] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T21:22:35.508939] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-08T21:22:35.539279] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T21:22:36.017605] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-08T21:22:36.309543] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-08T21:22:36.817552] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-08T21:22:37.617554] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-08T21:22:38.045922] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T21:22:38.417510] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-08T21:22:39.217508] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-08T21:22:39.403235] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T21:22:40.017547] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-08T21:22:40.087066] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T21:22:40.218958] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T21:22:40.817549] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-08T21:22:41.617609] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-08T21:22:41.743577] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T21:22:41.862667] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T21:22:41.878593] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-08T21:22:42.417564] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-08T21:22:43.217561] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-08T21:22:43.299342] [DEBUG] [REMOTE ] SARO: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-08T21:22:43.299760] [WARN ] [REMOTE ] SARO: No data returned for month 2025-04 [2025-10-08T21:22:43.299885] [FATAL] [REMOTE ] SARO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:22:43.300049] [FATAL] [MAIN ] SARO: Failed to fetch primary data. [2025-10-08T21:22:43.300131] [WARN ] [MAIN ] SARO: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:22:43.300341] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-08T21:22:43.300557] [DEBUG] [LOCAL ] SARO: No primary data file found to delete. [2025-10-08T21:22:43.300711] [INFO ] [LOCAL ] SARO: Starting deletion of derivative data. [2025-10-08T21:22:43.301298] [DEBUG] [LOCAL ] SARO: Deleted derivative data file. [2025-10-08T21:22:43.301438] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SARO took 20.2s. Estimated remaining: 1h 11m 5s. Rate: 7.1 symbols/min [2025-10-08T21:22:43.437342] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T21:22:43.508051] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:43.508226] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-08T21:22:43.508262] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-08T21:22:43.508388] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-08T21:22:43.508444] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-08T21:22:43.508491] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-08T21:22:43.508526] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-08T21:22:43.866785] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:44.017543] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-10-08T21:22:44.448974] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T21:22:44.817587] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-08T21:22:45.123013] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-08T21:22:45.617561] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-08T21:22:45.977542] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T21:22:46.417562] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-08T21:22:46.675037] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-08T21:22:47.217594] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-08T21:22:47.474236] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-10-08T21:22:47.475083] [INFO ] [REMOTE ] SAT: Full fetch complete (1518 records). [2025-10-08T21:22:47.475153] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-08T21:22:47.657322] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-08T21:22:47.657518] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:22:47.657588] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:22:47.657687] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-08T21:22:47.657763] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-08T21:22:47.657802] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-08T21:22:47.657842] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-08T21:22:47.657920] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAT took 20.4s. Estimated remaining: 1h 10m 55s. Rate: 7.1 symbols/min [2025-10-08T21:22:47.828210] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:22:47.828407] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-08T21:22:47.828445] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-08T21:22:47.828559] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-08T21:22:47.828600] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-08T21:22:47.828665] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-08T21:22:47.828722] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-08T21:22:48.022896] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-08T21:22:48.226841] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:22:48.817508] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-08T21:22:49.174007] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T21:22:49.617556] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-08T21:22:50.417528] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-08T21:22:50.689954] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T21:22:50.704131] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-08T21:22:50.705306] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T21:22:51.217550] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-08T21:22:52.017562] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-08T21:22:52.817558] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-08T21:22:53.617619] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-10-08T21:23:05.402897] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (12.59 seconds). [2025-10-08T21:23:05.404605] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-08T21:23:05.422496] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (13.40 seconds). [2025-10-08T21:23:05.427336] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-08T21:23:06.039265] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T21:23:06.040235] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-08T21:23:06.089970] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (14.87 seconds). [2025-10-08T21:23:06.103499] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-08T21:23:06.113135] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T21:23:06.116238] [INFO ] [REMOTE ] SAR: Full fetch complete (23312 records). [2025-10-08T21:23:06.116358] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-08T21:23:06.439508] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-08T21:23:06.455198] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-08T21:23:06.555628] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-08T21:23:06.555780] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-08T21:23:06.556780] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-08T21:23:06.556901] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-08T21:23:06.558027] [DEBUG] [LOCAL ] SAR: Trimmed 23312 records to 16872 (keeping 200 days of data) [2025-10-08T21:23:06.679723] [DEBUG] [LOCAL ] SAR: Primary data saved (16872 records). [2025-10-08T21:23:06.679952] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-08T21:23:06.680084] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAR took 44.6s. Estimated remaining: 1h 10m 50s. Rate: 7.1 symbols/min [2025-10-08T21:23:06.871316] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T21:23:06.878498] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-08T21:23:06.875979] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:06.923295] [DEBUG] [LOCAL ] SB: Loaded 33087 existing records from primary storage. [2025-10-08T21:23:06.923841] [INFO ] [MAIN ] SB: Loaded 33087 existing records. [2025-10-08T21:23:07.122966] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:07.123284] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-08T21:23:07.123369] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-08T21:23:07.124250] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-08T21:23:07.124314] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-08T21:23:07.288609] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-08T21:23:07.319803] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-08T21:23:07.536178] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:07.536537] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-10-08T21:23:07.952022] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T21:23:07.953402] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-08T21:23:07.968538] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T21:23:07.973024] [INFO ] [REMOTE ] SAP: Full fetch complete (71889 records). [2025-10-08T21:23:07.973199] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-08T21:23:08.411989] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T21:23:08.432928] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-08T21:23:08.432598] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-08T21:23:08.433214] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-08T21:23:08.436168] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-08T21:23:08.436404] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-08T21:23:08.438183] [DEBUG] [LOCAL ] SAP: Trimmed 71889 records to 49897 (keeping 200 days of data) [2025-10-08T21:23:08.451268] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (14.83 seconds). [2025-10-08T21:23:08.452707] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-08T21:23:08.780518] [DEBUG] [LOCAL ] SAP: Primary data saved (49897 records). [2025-10-08T21:23:08.780822] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-08T21:23:08.780964] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SAP took 51.5s. Estimated remaining: 1h 10m 40s. Rate: 7.1 symbols/min [2025-10-08T21:23:08.843719] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T21:23:08.865907] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-08T21:23:08.843463] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T21:23:08.890468] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-08T21:23:09.009159] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T21:23:09.022751] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-08T21:23:09.021688] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:09.024076] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-08T21:23:09.024140] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-08T21:23:09.024269] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-08T21:23:09.024313] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-08T21:23:09.024355] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-08T21:23:09.024390] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-08T21:23:09.221520] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-08T21:23:09.292055] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-08T21:23:09.428440] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:09.428893] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-10-08T21:23:09.618897] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:23:09.619251] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-10-08T21:23:09.619339] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:23:09.619391] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-08T21:23:09.619450] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:23:09.619520] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-08T21:23:09.619583] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-08T21:23:09.619619] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-08T21:23:09.619693] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-08T21:23:09.619757] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SBDS took 0.8s. Estimated remaining: 1h 10m 29s. Rate: 7.1 symbols/min [2025-10-08T21:23:09.793596] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:09.796446] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T21:23:09.798140] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-08T21:23:09.846536] [DEBUG] [LOCAL ] SBH: Loaded 49797 existing records from primary storage. [2025-10-08T21:23:09.846935] [INFO ] [MAIN ] SBH: Loaded 49797 existing records. [2025-10-08T21:23:10.024082] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:10.024312] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-08T21:23:10.024381] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-08T21:23:10.025382] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-08T21:23:10.025444] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-08T21:23:10.379157] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:10.379492] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-10-08T21:23:11.521742] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-08T21:23:11.522523] [INFO ] [REMOTE ] SAY: Full fetch complete (1381 records). [2025-10-08T21:23:11.522607] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-08T21:23:11.701660] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-08T21:23:11.701901] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:23:11.701989] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:23:11.702083] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-08T21:23:11.702163] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-08T21:23:11.702253] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-08T21:23:11.702326] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-08T21:23:11.702403] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SAY took 28.4s. Estimated remaining: 1h 10m 19s. Rate: 7.1 symbols/min [2025-10-08T21:23:11.870628] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:11.881132] [DEBUG] [LOCAL ] SBI: Loaded 7424 existing records from primary storage. [2025-10-08T21:23:11.881353] [INFO ] [MAIN ] SBI: Loaded 7424 existing records. [2025-10-08T21:23:12.061921] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:12.066013] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-08T21:23:12.065864] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-08T21:23:12.066192] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-08T21:23:12.067699] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-08T21:23:12.068824] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-08T21:23:12.068892] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-08T21:23:12.432310] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:12.432874] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-10-08T21:23:12.665031] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T21:23:12.666400] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-08T21:23:12.698299] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (3.68 seconds). [2025-10-08T21:23:12.706994] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-08T21:23:12.970880] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-08T21:23:12.971922] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-08T21:23:13.206539] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T21:23:13.208754] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-08T21:23:13.352989] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T21:23:13.354917] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-10-08T21:23:13.617497] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-08T21:23:13.774092] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:23:13.850013] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T21:23:14.040736] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-08T21:23:14.417583] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-08T21:23:15.217534] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-08T21:23:15.837753] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:23:16.017571] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-08T21:23:16.576970] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T21:23:16.817577] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-08T21:23:17.613722] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-08T21:23:17.622831] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-08T21:23:18.233553] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T21:23:18.291039] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T21:23:18.417574] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-08T21:23:19.217563] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-08T21:23:19.604977] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T21:23:20.017509] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-08T21:23:20.148967] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:23:20.300009] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T21:23:20.300818] [INFO ] [REMOTE ] SAZ: Full fetch complete (1817 records). [2025-10-08T21:23:20.300939] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-08T21:23:20.504569] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T21:23:20.504824] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:23:20.504919] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:23:20.504993] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-08T21:23:20.505061] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-08T21:23:20.505097] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-08T21:23:20.505137] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-08T21:23:20.505211] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SAZ took 32.8s. Estimated remaining: 1h 10m 11s. Rate: 7.1 symbols/min [2025-10-08T21:23:20.719623] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:20.733324] [DEBUG] [LOCAL ] SBR: Loaded 7553 existing records from primary storage. [2025-10-08T21:23:20.733668] [INFO ] [MAIN ] SBR: Loaded 7553 existing records. [2025-10-08T21:23:20.822695] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-08T21:23:20.962105] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:20.962402] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-08T21:23:20.962498] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-08T21:23:20.963633] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-08T21:23:20.963731] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-08T21:23:21.343467] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:21.617538] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-10-08T21:23:22.391674] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T21:23:22.422606] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-08T21:23:22.441732] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:23:23.217518] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-08T21:23:23.237559] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T21:23:24.017566] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-08T21:23:24.610187] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T21:23:24.782038] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T21:23:24.817506] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-08T21:23:25.576145] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T21:23:25.617575] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-08T21:23:26.366975] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T21:23:26.417602] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-08T21:23:27.217534] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-08T21:23:27.237186] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T21:23:28.017542] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-08T21:23:28.069352] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T21:23:28.656431] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T21:23:28.817554] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-08T21:23:29.597604] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T21:23:29.617578] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-08T21:23:30.417501] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-08T21:23:30.894764] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T21:23:31.170808] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T21:23:31.217506] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-08T21:23:31.927095] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T21:23:32.017539] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-08T21:23:32.817578] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-08T21:23:33.617565] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-08T21:23:33.682303] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T21:23:34.189556] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T21:23:34.304184] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T21:23:34.417556] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-08T21:23:34.846044] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:23:34.847048] [INFO ] [REMOTE ] SBI: Full fetch complete (10482 records). [2025-10-08T21:23:34.847124] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-08T21:23:35.232294] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-08T21:23:35.279196] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-08T21:23:35.279290] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-08T21:23:35.279602] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-08T21:23:35.279670] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-08T21:23:35.280280] [DEBUG] [LOCAL ] SBI: Trimmed 10482 records to 7410 (keeping 200 days of data) [2025-10-08T21:23:35.322939] [DEBUG] [LOCAL ] SBI: Primary data saved (7410 records). [2025-10-08T21:23:35.323073] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-08T21:23:35.323178] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBI took 23.6s. Estimated remaining: 1h 10m 4s. Rate: 7.1 symbols/min [2025-10-08T21:23:35.490041] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:35.542366] [DEBUG] [LOCAL ] SBS: Loaded 49403 existing records from primary storage. [2025-10-08T21:23:35.542737] [INFO ] [MAIN ] SBS: Loaded 49403 existing records. [2025-10-08T21:23:35.717913] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:35.718160] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-08T21:23:35.718252] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-08T21:23:35.719429] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-08T21:23:35.719496] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-08T21:23:36.022686] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-08T21:23:36.086001] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:36.664255] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T21:23:36.807887] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T21:23:36.817532] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-08T21:23:37.617597] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-08T21:23:38.405601] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T21:23:38.419833] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-08T21:23:38.871449] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T21:23:39.221466] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-08T21:23:39.223494] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T21:23:40.017622] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-10-08T21:23:40.312411] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T21:23:40.315069] [INFO ] [REMOTE ] SB: Full fetch complete (49861 records). [2025-10-08T21:23:40.315162] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-08T21:23:40.782737] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-08T21:23:40.782836] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-08T21:23:40.784029] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-08T21:23:40.784097] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-08T21:23:40.785392] [DEBUG] [LOCAL ] SB: Trimmed 49861 records to 33034 (keeping 200 days of data) [2025-10-08T21:23:40.846716] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-08T21:23:41.022408] [DEBUG] [LOCAL ] SB: Primary data saved (33034 records). [2025-10-08T21:23:41.022600] [INFO ] [MAIN ] SB: Full history saved. [2025-10-08T21:23:41.022763] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SB took 34.3s. Estimated remaining: 1h 9m 55s. Rate: 7.1 symbols/min [2025-10-08T21:23:41.243878] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:41.262194] [DEBUG] [LOCAL ] SBSI: Loaded 14852 existing records from primary storage. [2025-10-08T21:23:41.262488] [INFO ] [MAIN ] SBSI: Loaded 14852 existing records. [2025-10-08T21:23:41.492047] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:41.493144] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-08T21:23:41.493264] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-08T21:23:41.493988] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-08T21:23:41.494460] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-08T21:23:41.622804] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-08T21:23:41.781046] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T21:23:41.953585] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T21:23:41.988711] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:42.417627] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-08T21:23:43.217533] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-08T21:23:43.413879] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T21:23:43.763499] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T21:23:43.918004] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T21:23:44.017491] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-08T21:23:44.817604] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-10-08T21:23:45.568383] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T21:23:45.604366] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T21:23:45.617547] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-08T21:23:46.417585] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-08T21:23:46.568013] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T21:23:47.217616] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-08T21:23:47.891992] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T21:23:48.017633] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-08T21:23:48.046710] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T21:23:48.817618] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-08T21:23:49.617611] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-08T21:23:49.865003] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:23:50.427556] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-08T21:23:50.460309] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:23:50.563606] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-08T21:23:51.217571] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-08T21:23:52.017631] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-08T21:23:52.264672] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T21:23:52.817631] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-08T21:23:52.957973] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T21:23:53.111972] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T21:23:53.566975] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T21:23:53.617567] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-08T21:23:54.327212] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:23:54.328660] [INFO ] [REMOTE ] SBR: Full fetch complete (11233 records). [2025-10-08T21:23:54.328740] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-08T21:23:54.426233] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-08T21:23:54.692246] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-08T21:23:54.692326] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-08T21:23:54.692579] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-08T21:23:54.692615] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-08T21:23:54.693071] [DEBUG] [LOCAL ] SBR: Trimmed 11233 records to 7598 (keeping 200 days of data) [2025-10-08T21:23:54.740844] [DEBUG] [LOCAL ] SBR: Primary data saved (7598 records). [2025-10-08T21:23:54.740947] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-08T21:23:54.741030] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBR took 34.2s. Estimated remaining: 1h 9m 48s. Rate: 7.1 symbols/min [2025-10-08T21:23:54.916283] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:54.972557] [DEBUG] [LOCAL ] SBSW: Loaded 53069 existing records from primary storage. [2025-10-08T21:23:54.972940] [INFO ] [MAIN ] SBSW: Loaded 53069 existing records. [2025-10-08T21:23:55.147235] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:23:55.147453] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-08T21:23:55.147511] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-08T21:23:55.148561] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-08T21:23:55.148626] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-08T21:23:55.222703] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-08T21:23:55.504027] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:55.918133] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T21:23:55.922826] [INFO ] [REMOTE ] SBH: Full fetch complete (72880 records). [2025-10-08T21:23:55.922974] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-08T21:23:56.023722] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-08T21:23:56.324705] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-08T21:23:56.324830] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-08T21:23:56.325871] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-08T21:23:56.325937] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-08T21:23:56.327483] [DEBUG] [LOCAL ] SBH: Trimmed 72880 records to 49785 (keeping 200 days of data) [2025-10-08T21:23:56.636229] [DEBUG] [LOCAL ] SBH: Primary data saved (49785 records). [2025-10-08T21:23:56.636409] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-08T21:23:56.636523] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBH took 47.0s. Estimated remaining: 1h 9m 38s. Rate: 7.1 symbols/min [2025-10-08T21:23:56.823615] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-10-08T21:23:56.873039] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:23:56.873485] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-08T21:23:56.873676] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-08T21:23:56.873798] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-08T21:23:56.873840] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-08T21:23:56.873881] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-08T21:23:56.873912] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-08T21:23:56.986638] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T21:23:57.093383] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T21:23:57.323997] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:23:57.617577] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-10-08T21:23:57.927097] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-08T21:23:58.417518] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-08T21:23:58.822414] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T21:23:59.217809] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-08T21:23:59.767764] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T21:24:00.017738] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-08T21:24:00.320850] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-08T21:24:00.817596] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-08T21:24:01.139982] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-08T21:24:01.178313] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-08T21:24:01.617561] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-08T21:24:02.417630] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-08T21:24:03.217511] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-08T21:24:03.391070] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T21:24:03.392033] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T21:24:03.447061] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-08T21:24:04.017552] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-08T21:24:04.817605] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-08T21:24:04.939468] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T21:24:05.617606] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-08T21:24:06.417574] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-08T21:24:06.554138] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-08T21:24:06.645213] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-08T21:24:06.740925] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T21:24:07.217726] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-08T21:24:07.541078] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T21:24:08.017680] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-08T21:24:08.817587] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-08T21:24:08.837397] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T21:24:09.617548] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-08T21:24:10.084486] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T21:24:10.417570] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-08T21:24:10.581190] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T21:24:11.217499] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-08T21:24:11.453597] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T21:24:11.702400] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T21:24:12.017551] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-08T21:24:12.817547] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-08T21:24:13.155502] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-08T21:24:13.592845] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T21:24:13.617516] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-08T21:24:14.417581] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-08T21:24:14.670779] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-10-08T21:24:14.671517] [INFO ] [REMOTE ] SBXD: Full fetch complete (3103 records). [2025-10-08T21:24:14.671590] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-08T21:24:14.872314] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-10-08T21:24:14.872536] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:24:14.872606] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:24:14.872707] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-08T21:24:14.872779] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-08T21:24:14.872817] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-08T21:24:14.872887] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-08T21:24:14.872973] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBXD took 18.2s. Estimated remaining: 1h 9m 32s. Rate: 7.1 symbols/min [2025-10-08T21:24:15.131947] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T21:24:15.135741] [INFO ] [REMOTE ] SBS: Full fetch complete (70112 records). [2025-10-08T21:24:15.135863] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-08T21:24:15.222786] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-08T21:24:15.534337] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-08T21:24:15.534432] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-08T21:24:15.535419] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-08T21:24:15.535490] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-08T21:24:15.536958] [DEBUG] [LOCAL ] SBS: Trimmed 70112 records to 49399 (keeping 200 days of data) [2025-10-08T21:24:15.847294] [DEBUG] [LOCAL ] SBS: Primary data saved (49399 records). [2025-10-08T21:24:15.847426] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-08T21:24:15.847512] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBS took 40.5s. Estimated remaining: 1h 9m 21s. Rate: 7.1 symbols/min [2025-10-08T21:24:16.017579] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-08T21:24:16.660265] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:24:16.661879] [INFO ] [REMOTE ] SBSI: Full fetch complete (21195 records). [2025-10-08T21:24:16.661950] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-08T21:24:17.061470] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-08T21:24:17.061614] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-08T21:24:17.062167] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-08T21:24:17.062218] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-08T21:24:17.063210] [DEBUG] [LOCAL ] SBSI: Trimmed 21195 records to 14797 (keeping 200 days of data) [2025-10-08T21:24:17.158355] [DEBUG] [LOCAL ] SBSI: Primary data saved (14797 records). [2025-10-08T21:24:17.158578] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-08T21:24:17.158715] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBSI took 36.1s. Estimated remaining: 1h 9m 11s. Rate: 7.1 symbols/min [2025-10-08T21:24:17.205595] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T21:24:17.218106] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-08T21:24:19.150419] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T21:24:19.165098] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-08T21:24:21.226281] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T21:24:21.237898] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-08T21:24:23.309792] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-08T21:24:23.321537] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-08T21:24:25.272772] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T21:24:25.284443] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-08T21:24:27.019991] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T21:24:27.031541] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-08T21:24:28.872626] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T21:24:28.877022] [INFO ] [REMOTE ] SBSW: Full fetch complete (76540 records). [2025-10-08T21:24:28.877193] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-08T21:24:29.283283] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-08T21:24:29.283377] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-08T21:24:29.284427] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-08T21:24:29.284497] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-08T21:24:29.286139] [DEBUG] [LOCAL ] SBSW: Trimmed 76540 records to 53079 (keeping 200 days of data) [2025-10-08T21:24:29.605233] [DEBUG] [LOCAL ] SBSW: Primary data saved (53079 records). [2025-10-08T21:24:29.605433] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-08T21:24:29.605543] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 34.9s. Estimated remaining: 1h 9m 4s. Rate: 7.1 symbols/min [2025-10-08T21:24:30.135103] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:30.278888] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:30.301788] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:30.325745] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:30.346120] [DEBUG] [LOCAL ] SCD: Loaded 13049 existing records from primary storage. [2025-10-08T21:24:30.360736] [INFO ] [MAIN ] SCD: Loaded 13049 existing records. [2025-10-08T21:24:30.586632] [DEBUG] [LOCAL ] SCI: Loaded 46524 existing records from primary storage. [2025-10-08T21:24:30.641633] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:30.643351] [INFO ] [MAIN ] SCI: Loaded 46524 existing records. [2025-10-08T21:24:30.634321] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-08T21:24:30.656223] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-08T21:24:30.656489] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-08T21:24:30.656140] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-08T21:24:30.673037] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-08T21:24:30.695058] [DEBUG] [LOCAL ] SCCO: Loaded 49563 existing records from primary storage. [2025-10-08T21:24:30.695336] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-08T21:24:30.742163] [INFO ] [MAIN ] SCCO: Loaded 49563 existing records. [2025-10-08T21:24:31.176142] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:31.238097] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-08T21:24:31.300926] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-08T21:24:31.389354] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:31.394722] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-08T21:24:31.425962] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-08T21:24:31.436706] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-08T21:24:31.446738] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-08T21:24:31.436493] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-08T21:24:31.494046] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-08T21:24:31.473166] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:31.686455] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-08T21:24:31.768692] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-08T21:24:31.852015] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-08T21:24:31.957850] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-08T21:24:32.028550] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:32.076416] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-10-08T21:24:32.602256] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:32.630100] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-10-08T21:24:32.748447] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:32.765709] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-10-08T21:24:32.871427] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:32.871757] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-10-08T21:24:32.962311] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T21:24:32.964336] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-08T21:24:33.727199] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T21:24:33.729592] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-08T21:24:34.030604] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T21:24:34.040239] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-08T21:24:34.232792] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T21:24:34.249334] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-08T21:24:34.516144] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T21:24:34.519349] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-08T21:24:34.559634] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:24:34.569163] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-08T21:24:35.023679] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-08T21:24:35.026075] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-08T21:24:35.245215] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T21:24:35.256738] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-08T21:24:35.848509] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T21:24:35.849369] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T21:24:35.861806] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-08T21:24:35.862058] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-08T21:24:36.086715] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T21:24:36.097311] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-08T21:24:36.549091] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T21:24:36.559355] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-08T21:24:36.592871] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T21:24:36.595324] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-08T21:24:37.578147] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T21:24:37.583279] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-08T21:24:37.658071] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T21:24:37.668015] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-08T21:24:37.752069] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-08T21:24:37.762801] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-08T21:24:37.820556] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T21:24:37.831440] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-08T21:24:38.357491] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T21:24:38.417569] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-08T21:24:39.321804] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T21:24:39.325702] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-08T21:24:39.536189] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T21:24:39.630920] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T21:24:39.718330] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-08T21:24:39.840792] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T21:24:40.017520] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-08T21:24:40.817633] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-08T21:24:41.617705] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-08T21:24:41.867049] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:24:42.206338] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T21:24:42.207918] [INFO ] [REMOTE ] SCD: Full fetch complete (16514 records). [2025-10-08T21:24:42.207998] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-08T21:24:42.422834] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-08T21:24:42.618055] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-08T21:24:42.618214] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-08T21:24:42.618721] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-08T21:24:42.618812] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-08T21:24:42.619480] [DEBUG] [LOCAL ] SCD: Trimmed 16514 records to 13042 (keeping 200 days of data) [2025-10-08T21:24:42.701842] [DEBUG] [LOCAL ] SCD: Primary data saved (13042 records). [2025-10-08T21:24:42.701997] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-08T21:24:42.702086] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 13.1s. Estimated remaining: 1h 8m 56s. Rate: 7.1 symbols/min [2025-10-08T21:24:42.932426] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:42.962685] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-08T21:24:42.989529] [DEBUG] [LOCAL ] SCL: Loaded 14865 existing records from primary storage. [2025-10-08T21:24:42.989852] [INFO ] [MAIN ] SCL: Loaded 14865 existing records. [2025-10-08T21:24:43.171552] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:43.171799] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-08T21:24:43.171849] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-08T21:24:43.172398] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-08T21:24:43.172458] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-08T21:24:43.226510] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-08T21:24:43.533041] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:44.017555] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-10-08T21:24:44.263923] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T21:24:44.732701] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-08T21:24:44.777933] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T21:24:44.817574] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-08T21:24:45.617561] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-08T21:24:46.397372] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T21:24:46.417504] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-08T21:24:47.217531] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-08T21:24:47.342986] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T21:24:48.017529] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-08T21:24:48.184835] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T21:24:48.500673] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-08T21:24:48.817621] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-08T21:24:49.617539] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-08T21:24:49.726986] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T21:24:50.324582] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T21:24:50.417509] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-08T21:24:51.217558] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-08T21:24:51.262865] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-08T21:24:52.017523] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-08T21:24:52.505218] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T21:24:52.817598] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-08T21:24:52.843317] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T21:24:53.115912] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-08T21:24:53.617566] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-08T21:24:54.126885] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T21:24:54.131274] [INFO ] [REMOTE ] SCHW: Full fetch complete (77704 records). [2025-10-08T21:24:54.131397] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-08T21:24:54.419627] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-08T21:24:54.433530] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T21:24:54.568542] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-08T21:24:54.568624] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-08T21:24:54.569837] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-08T21:24:54.569903] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-08T21:24:54.571382] [DEBUG] [LOCAL ] SCHW: Trimmed 77704 records to 53685 (keeping 200 days of data) [2025-10-08T21:24:54.909959] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-08T21:24:54.910113] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-08T21:24:54.911749] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCHW took 25.3s. Estimated remaining: 1h 8m 49s. Rate: 7.1 symbols/min [2025-10-08T21:24:55.080678] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:24:55.102305] [DEBUG] [LOCAL ] SCM: Loaded 19820 existing records from primary storage. [2025-10-08T21:24:55.102588] [INFO ] [MAIN ] SCM: Loaded 19820 existing records. [2025-10-08T21:24:55.222598] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-08T21:24:55.289049] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:24:55.289252] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-08T21:24:55.289298] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-08T21:24:55.289877] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-08T21:24:55.289937] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-08T21:24:55.652491] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:24:56.000973] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T21:24:56.017499] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-08T21:24:56.767128] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T21:24:56.817567] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-10-08T21:24:57.617520] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-08T21:24:57.810603] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T21:24:57.994568] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T21:24:58.417517] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-08T21:24:59.018350] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T21:24:59.217621] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-08T21:24:59.468878] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T21:25:00.017602] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-08T21:25:00.276537] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T21:25:00.817555] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-08T21:25:01.617521] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-08T21:25:01.805119] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T21:25:01.861130] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T21:25:02.417710] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-08T21:25:03.108931] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T21:25:03.113360] [INFO ] [REMOTE ] SCCO: Full fetch complete (71241 records). [2025-10-08T21:25:03.113477] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-08T21:25:03.217776] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-08T21:25:03.280118] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T21:25:03.608324] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-08T21:25:03.608449] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-08T21:25:03.610232] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-08T21:25:03.610307] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-08T21:25:03.613176] [DEBUG] [LOCAL ] SCCO: Trimmed 71241 records to 49592 (keeping 200 days of data) [2025-10-08T21:25:03.977081] [DEBUG] [LOCAL ] SCCO: Primary data saved (49592 records). [2025-10-08T21:25:03.977302] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-08T21:25:03.977413] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCCO took 34.4s. Estimated remaining: 1h 8m 41s. Rate: 7.1 symbols/min [2025-10-08T21:25:04.022745] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-08T21:25:04.100819] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-08T21:25:04.199209] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:04.247325] [DEBUG] [LOCAL ] SCS: Loaded 43572 existing records from primary storage. [2025-10-08T21:25:04.247720] [INFO ] [MAIN ] SCS: Loaded 43572 existing records. [2025-10-08T21:25:04.461029] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:04.461265] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-08T21:25:04.461319] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-08T21:25:04.462468] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-08T21:25:04.462533] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-08T21:25:04.822929] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-08T21:25:04.909024] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:05.542852] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T21:25:05.547129] [INFO ] [REMOTE ] SCI: Full fetch complete (67389 records). [2025-10-08T21:25:05.547312] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-08T21:25:05.622840] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-08T21:25:06.002686] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-08T21:25:06.002835] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-08T21:25:06.004515] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-08T21:25:06.004617] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-08T21:25:06.006897] [DEBUG] [LOCAL ] SCI: Trimmed 67389 records to 46538 (keeping 200 days of data) [2025-10-08T21:25:06.147553] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T21:25:06.327495] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T21:25:06.387347] [DEBUG] [LOCAL ] SCI: Primary data saved (46538 records). [2025-10-08T21:25:06.387571] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-08T21:25:06.387812] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCI took 36.8s. Estimated remaining: 1h 8m 31s. Rate: 7.1 symbols/min [2025-10-08T21:25:06.423746] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-08T21:25:06.590212] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:06.627998] [DEBUG] [LOCAL ] SD: Loaded 28769 existing records from primary storage. [2025-10-08T21:25:06.628402] [INFO ] [MAIN ] SD: Loaded 28769 existing records. [2025-10-08T21:25:06.836674] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:06.836975] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-08T21:25:06.837037] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-08T21:25:06.837902] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-08T21:25:06.837987] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-08T21:25:07.221994] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-10-08T21:25:07.249284] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:07.313024] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T21:25:08.017693] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-10-08T21:25:08.703745] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T21:25:08.817574] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-08T21:25:09.290832] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T21:25:09.617506] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-08T21:25:10.014367] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T21:25:10.417523] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-08T21:25:10.604161] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T21:25:11.170995] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T21:25:11.217493] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-08T21:25:11.949804] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T21:25:12.017574] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-08T21:25:12.817529] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-08T21:25:13.207381] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:25:13.617555] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-08T21:25:13.756268] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T21:25:14.417542] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-08T21:25:14.452050] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T21:25:14.453610] [INFO ] [REMOTE ] SCL: Full fetch complete (21396 records). [2025-10-08T21:25:14.453707] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-08T21:25:14.817748] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-08T21:25:14.817828] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-08T21:25:14.818260] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-08T21:25:14.818321] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-08T21:25:14.818922] [DEBUG] [LOCAL ] SCL: Trimmed 21396 records to 14833 (keeping 200 days of data) [2025-10-08T21:25:14.911076] [DEBUG] [LOCAL ] SCL: Primary data saved (14833 records). [2025-10-08T21:25:14.911228] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-08T21:25:14.911315] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 32.2s. Estimated remaining: 1h 8m 22s. Rate: 7.1 symbols/min [2025-10-08T21:25:15.084169] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:15.096058] [DEBUG] [LOCAL ] SDHC: Loaded 10332 existing records from primary storage. [2025-10-08T21:25:15.096279] [INFO ] [MAIN ] SDHC: Loaded 10332 existing records. [2025-10-08T21:25:15.222666] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-08T21:25:15.276403] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:15.276569] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-08T21:25:15.276615] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-08T21:25:15.276915] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-08T21:25:15.276972] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-08T21:25:15.631586] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:15.880987] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-08T21:25:16.017509] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-08T21:25:16.478055] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T21:25:16.817552] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-08T21:25:17.498069] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T21:25:17.617556] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-08T21:25:17.889636] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T21:25:18.417553] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-08T21:25:19.011222] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T21:25:19.217584] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-10-08T21:25:19.521145] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T21:25:20.017518] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-08T21:25:20.069193] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:25:20.817564] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-08T21:25:21.413084] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T21:25:21.460588] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T21:25:21.617556] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-08T21:25:22.417566] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-08T21:25:23.148135] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T21:25:23.217502] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-08T21:25:24.000322] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T21:25:24.017495] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-08T21:25:24.765773] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T21:25:24.817530] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-08T21:25:25.208194] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T21:25:25.617517] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-08T21:25:25.911545] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T21:25:25.913874] [INFO ] [REMOTE ] SCM: Full fetch complete (28646 records). [2025-10-08T21:25:25.913983] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-08T21:25:26.284052] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-08T21:25:26.284167] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-08T21:25:26.284806] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-08T21:25:26.284868] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-08T21:25:26.285772] [DEBUG] [LOCAL ] SCM: Trimmed 28646 records to 19886 (keeping 200 days of data) [2025-10-08T21:25:26.413298] [DEBUG] [LOCAL ] SCM: Primary data saved (19886 records). [2025-10-08T21:25:26.413462] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-08T21:25:26.413584] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCM took 31.5s. Estimated remaining: 1h 8m 15s. Rate: 7.1 symbols/min [2025-10-08T21:25:26.419678] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-08T21:25:26.587129] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:26.599577] [DEBUG] [LOCAL ] SDHY: Loaded 10757 existing records from primary storage. [2025-10-08T21:25:26.599858] [INFO ] [MAIN ] SDHY: Loaded 10757 existing records. [2025-10-08T21:25:26.776301] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:26.776511] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-08T21:25:26.776558] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-08T21:25:26.776914] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-08T21:25:26.776972] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-08T21:25:27.186721] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:27.219431] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-08T21:25:27.213215] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T21:25:27.231483] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T21:25:28.017547] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-08T21:25:28.536109] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T21:25:28.817501] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-08T21:25:29.549977] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T21:25:29.609007] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T21:25:29.617492] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-08T21:25:30.365094] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T21:25:30.417554] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-08T21:25:31.143708] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-08T21:25:31.217556] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-08T21:25:32.017601] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-10-08T21:25:32.817731] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-08T21:25:33.008695] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T21:25:33.107827] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T21:25:33.395223] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T21:25:33.617565] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-08T21:25:34.417582] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-08T21:25:34.440461] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T21:25:35.217594] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-08T21:25:35.841537] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T21:25:35.982205] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T21:25:36.017494] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-08T21:25:36.768677] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T21:25:36.817519] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-08T21:25:37.617534] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-08T21:25:37.646048] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T21:25:38.417555] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-08T21:25:39.038551] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T21:25:39.042072] [INFO ] [REMOTE ] SCS: Full fetch complete (60814 records). [2025-10-08T21:25:39.042183] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-08T21:25:39.220983] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-08T21:25:39.443712] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-08T21:25:39.443884] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-08T21:25:39.444889] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-08T21:25:39.444997] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-08T21:25:39.446751] [DEBUG] [LOCAL ] SCS: Trimmed 60814 records to 43480 (keeping 200 days of data) [2025-10-08T21:25:39.562693] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T21:25:39.746846] [DEBUG] [LOCAL ] SCS: Primary data saved (43480 records). [2025-10-08T21:25:39.747005] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-08T21:25:39.747101] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCS took 35.8s. Estimated remaining: 1h 8m 7s. Rate: 7.1 symbols/min [2025-10-08T21:25:39.914535] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:39.953116] [DEBUG] [LOCAL ] SDRL: Loaded 41477 existing records from primary storage. [2025-10-08T21:25:39.953419] [INFO ] [MAIN ] SDRL: Loaded 41477 existing records. [2025-10-08T21:25:40.026753] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-08T21:25:40.135797] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:40.143301] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T21:25:40.143396] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-08T21:25:40.145981] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-08T21:25:40.147515] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-08T21:25:40.147576] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-08T21:25:40.509790] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:40.817562] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-08T21:25:41.349591] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T21:25:41.364740] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T21:25:41.617559] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-08T21:25:42.317183] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T21:25:42.318715] [INFO ] [REMOTE ] SDHC: Full fetch complete (17235 records). [2025-10-08T21:25:42.318921] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-08T21:25:42.419845] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-10-08T21:25:42.683768] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-08T21:25:42.683846] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-08T21:25:42.684218] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-08T21:25:42.684256] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-08T21:25:42.684783] [DEBUG] [LOCAL ] SDHC: Trimmed 17235 records to 10348 (keeping 200 days of data) [2025-10-08T21:25:42.744479] [DEBUG] [LOCAL ] SDHC: Primary data saved (10348 records). [2025-10-08T21:25:42.744616] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-08T21:25:42.744725] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 27.8s. Estimated remaining: 1h 7m 58s. Rate: 7.1 symbols/min [2025-10-08T21:25:42.914589] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:42.973070] [DEBUG] [LOCAL ] SE: Loaded 53329 existing records from primary storage. [2025-10-08T21:25:42.973532] [INFO ] [MAIN ] SE: Loaded 53329 existing records. [2025-10-08T21:25:43.155047] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:43.155278] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-08T21:25:43.155325] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-08T21:25:43.156450] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-10-08T21:25:43.156511] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-08T21:25:43.222672] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-08T21:25:43.514538] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:44.017575] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-08T21:25:44.065588] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:25:44.133260] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T21:25:44.817584] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-08T21:25:44.921480] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T21:25:44.925941] [DEBUG] [REMOTE ] SD: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-08T21:25:44.926464] [WARN ] [REMOTE ] SD: No data returned for month 2025-10 [2025-10-08T21:25:44.926560] [FATAL] [REMOTE ] SD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:25:44.926678] [FATAL] [MAIN ] SD: Failed to fetch primary data. [2025-10-08T21:25:44.926754] [WARN ] [MAIN ] SD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:25:44.926821] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-08T21:25:44.926910] [DEBUG] [LOCAL ] SD: No primary data file found to delete. [2025-10-08T21:25:44.926961] [INFO ] [LOCAL ] SD: Starting deletion of derivative data. [2025-10-08T21:25:44.927240] [DEBUG] [LOCAL ] SD: Deleted derivative data file. [2025-10-08T21:25:44.927347] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SD took 38.5s. Estimated remaining: 1h 7m 48s. Rate: 7.1 symbols/min [2025-10-08T21:25:45.098521] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:45.159491] [DEBUG] [LOCAL ] SEE: Loaded 48226 existing records from primary storage. [2025-10-08T21:25:45.159868] [INFO ] [MAIN ] SEE: Loaded 48226 existing records. [2025-10-08T21:25:45.335460] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:45.335692] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-08T21:25:45.335749] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-08T21:25:45.336362] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-08T21:25:45.336420] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-08T21:25:45.622959] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-08T21:25:45.717802] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:46.417543] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-08T21:25:46.464198] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T21:25:47.217590] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-10-08T21:25:47.872377] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T21:25:48.017569] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-08T21:25:48.786955] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T21:25:48.817571] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-08T21:25:49.061832] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T21:25:49.610194] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T21:25:49.617509] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-08T21:25:50.363899] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T21:25:50.417551] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-08T21:25:51.217589] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-08T21:25:51.998213] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T21:25:52.017507] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-08T21:25:52.346907] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-08T21:25:52.717418] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T21:25:52.719022] [INFO ] [REMOTE ] SDHY: Full fetch complete (15734 records). [2025-10-08T21:25:52.719131] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-08T21:25:52.817830] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-10-08T21:25:53.086917] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-08T21:25:53.087008] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-08T21:25:53.087372] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-08T21:25:53.087433] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-08T21:25:53.088016] [DEBUG] [LOCAL ] SDHY: Trimmed 15734 records to 10901 (keeping 200 days of data) [2025-10-08T21:25:53.156028] [DEBUG] [LOCAL ] SDHY: Primary data saved (10901 records). [2025-10-08T21:25:53.156175] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-08T21:25:53.156277] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SDHY took 26.7s. Estimated remaining: 1h 7m 39s. Rate: 7.1 symbols/min [2025-10-08T21:25:53.322908] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:25:53.337299] [DEBUG] [LOCAL ] SEG: Loaded 13247 existing records from primary storage. [2025-10-08T21:25:53.337546] [INFO ] [MAIN ] SEG: Loaded 13247 existing records. [2025-10-08T21:25:53.511555] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:25:53.511798] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-08T21:25:53.511885] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-08T21:25:53.512204] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-08T21:25:53.512261] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-08T21:25:53.622716] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-08T21:25:53.881072] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:25:54.417527] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-10-08T21:25:54.471723] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:25:55.189518] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T21:25:55.217493] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-08T21:25:55.443126] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T21:25:55.737003] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T21:25:56.017593] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-08T21:25:56.817589] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-08T21:25:57.617534] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-08T21:25:57.697852] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T21:25:58.422804] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-08T21:25:58.437235] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T21:25:59.217599] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-08T21:25:59.474295] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T21:25:59.647532] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-08T21:26:00.017569] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-08T21:26:00.817597] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-08T21:26:01.067881] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-08T21:26:01.617614] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-08T21:26:02.172181] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T21:26:02.216486] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-08T21:26:02.417588] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-08T21:26:03.217529] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-08T21:26:03.463556] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T21:26:03.912397] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:26:04.017716] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-08T21:26:04.817626] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-08T21:26:05.441869] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-08T21:26:05.617556] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-08T21:26:05.766463] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T21:26:06.189585] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T21:26:06.417571] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-08T21:26:07.217561] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-08T21:26:07.440449] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T21:26:08.017540] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-08T21:26:08.084532] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T21:26:08.817515] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-08T21:26:08.956734] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T21:26:09.024896] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T21:26:09.617552] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-08T21:26:10.417566] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-08T21:26:10.989932] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-08T21:26:11.033924] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T21:26:11.063235] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T21:26:11.217539] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-08T21:26:12.017557] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-08T21:26:12.437068] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T21:26:12.817560] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-08T21:26:13.524670] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:26:13.617576] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-08T21:26:14.417580] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-08T21:26:15.037320] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-08T21:26:15.083941] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T21:26:15.217552] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-08T21:26:15.395992] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-08T21:26:16.017557] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-08T21:26:16.817511] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-08T21:26:16.913821] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T21:26:17.617556] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-08T21:26:18.227988] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T21:26:18.316094] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:26:18.417528] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-08T21:26:18.513276] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T21:26:19.217585] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-08T21:26:20.017515] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-08T21:26:20.211285] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-08T21:26:20.215314] [INFO ] [REMOTE ] SE: Full fetch complete (77084 records). [2025-10-08T21:26:20.215434] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-08T21:26:20.541324] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T21:26:20.573757] [INFO ] [REMOTE ] SDRL: Full fetch complete (61659 records). [2025-10-08T21:26:20.609025] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-08T21:26:20.636377] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-10-08T21:26:20.636484] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-10-08T21:26:20.671443] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-10-08T21:26:20.697316] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-10-08T21:26:20.748686] [DEBUG] [LOCAL ] SE: Trimmed 77084 records to 53331 (keeping 200 days of data) [2025-10-08T21:26:20.897754] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-08T21:26:21.289351] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-08T21:26:21.289808] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-08T21:26:21.290782] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-08T21:26:21.317394] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-08T21:26:21.322011] [DEBUG] [LOCAL ] SDRL: Trimmed 61659 records to 41463 (keeping 200 days of data) [2025-10-08T21:26:21.666310] [DEBUG] [LOCAL ] SE: Primary data saved (53331 records). [2025-10-08T21:26:21.666870] [INFO ] [MAIN ] SE: Full history saved. [2025-10-08T21:26:21.672472] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SE took 38.9s. Estimated remaining: 1h 7m 36s. Rate: 7.1 symbols/min [2025-10-08T21:26:21.789693] [DEBUG] [LOCAL ] SDRL: Primary data saved (41463 records). [2025-10-08T21:26:21.808035] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T21:26:21.818014] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-08T21:26:21.853427] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-08T21:26:21.842701] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SDRL took 42.1s. Estimated remaining: 1h 7m 25s. Rate: 7.1 symbols/min [2025-10-08T21:26:21.948457] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:22.024184] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T21:26:22.101703] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:22.136997] [DEBUG] [LOCAL ] SEI: Loaded 49697 existing records from primary storage. [2025-10-08T21:26:22.137519] [INFO ] [MAIN ] SEI: Loaded 49697 existing records. [2025-10-08T21:26:22.287049] [DEBUG] [LOCAL ] SEM: Loaded 42871 existing records from primary storage. [2025-10-08T21:26:22.319703] [INFO ] [MAIN ] SEM: Loaded 42871 existing records. [2025-10-08T21:26:22.340444] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:22.377976] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-08T21:26:22.393082] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-08T21:26:22.428305] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-08T21:26:22.422094] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-08T21:26:22.437020] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-08T21:26:22.809574] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:22.815164] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-08T21:26:22.826023] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-08T21:26:22.846554] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-08T21:26:22.846700] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-08T21:26:23.039971] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:23.222610] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-10-08T21:26:23.356923] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:23.473211] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T21:26:23.485622] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T21:26:23.490180] [INFO ] [REMOTE ] SEE: Full fetch complete (69815 records). [2025-10-08T21:26:23.490316] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-08T21:26:23.873591] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-08T21:26:23.873696] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-08T21:26:23.874685] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-08T21:26:23.874747] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-08T21:26:23.876123] [DEBUG] [LOCAL ] SEE: Trimmed 69815 records to 48187 (keeping 200 days of data) [2025-10-08T21:26:24.052871] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-10-08T21:26:24.174882] [DEBUG] [LOCAL ] SEE: Primary data saved (48187 records). [2025-10-08T21:26:24.175020] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-08T21:26:24.175108] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEE took 39.2s. Estimated remaining: 1h 7m 15s. Rate: 7.1 symbols/min [2025-10-08T21:26:24.340102] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:24.379093] [DEBUG] [LOCAL ] SEMR: Loaded 41770 existing records from primary storage. [2025-10-08T21:26:24.379435] [INFO ] [MAIN ] SEMR: Loaded 41770 existing records. [2025-10-08T21:26:24.559098] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:24.559454] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-08T21:26:24.559566] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-08T21:26:24.559989] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-08T21:26:24.560047] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-08T21:26:24.817921] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-08T21:26:24.921341] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:24.954328] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T21:26:25.440032] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T21:26:25.617515] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-08T21:26:25.634465] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T21:26:26.417590] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-10-08T21:26:27.057199] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T21:26:27.217544] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-08T21:26:27.784072] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T21:26:28.017555] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-08T21:26:28.762365] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T21:26:28.817521] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-08T21:26:29.611818] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T21:26:29.621869] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-08T21:26:30.218198] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T21:26:30.417605] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-08T21:26:31.053633] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T21:26:31.217551] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-08T21:26:31.968086] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T21:26:32.017526] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-08T21:26:32.436095] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T21:26:32.817563] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-08T21:26:33.501301] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:26:33.503085] [INFO ] [REMOTE ] SEG: Full fetch complete (19748 records). [2025-10-08T21:26:33.503174] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-08T21:26:33.618618] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-08T21:26:33.951021] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-08T21:26:33.951153] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-08T21:26:33.951682] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-08T21:26:33.951818] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-08T21:26:33.952821] [DEBUG] [LOCAL ] SEG: Trimmed 19748 records to 13214 (keeping 200 days of data) [2025-10-08T21:26:34.051373] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-08T21:26:34.085901] [DEBUG] [LOCAL ] SEG: Primary data saved (13214 records). [2025-10-08T21:26:34.086086] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-08T21:26:34.086185] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SEG took 40.9s. Estimated remaining: 1h 7m 7s. Rate: 7.1 symbols/min [2025-10-08T21:26:34.254293] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:34.311626] [DEBUG] [LOCAL ] SES: Loaded 51568 existing records from primary storage. [2025-10-08T21:26:34.312038] [INFO ] [MAIN ] SES: Loaded 51568 existing records. [2025-10-08T21:26:34.422678] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-08T21:26:34.499848] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:34.500275] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-08T21:26:34.500340] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-08T21:26:34.500621] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-08T21:26:34.500747] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-08T21:26:34.867332] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:35.217517] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-08T21:26:35.265955] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T21:26:36.017621] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-08T21:26:36.251610] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T21:26:36.551756] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T21:26:36.817571] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-08T21:26:37.473205] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T21:26:37.617547] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-08T21:26:38.341797] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:26:38.417545] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-10-08T21:26:39.225884] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-08T21:26:39.245554] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T21:26:40.017531] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-08T21:26:40.384428] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T21:26:40.817680] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-08T21:26:40.970700] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T21:26:41.389609] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T21:26:41.617591] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-08T21:26:42.417554] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-08T21:26:43.185940] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T21:26:43.217522] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-08T21:26:43.379538] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-08T21:26:43.977908] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-08T21:26:44.017501] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-08T21:26:44.344256] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-08T21:26:44.817617] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-08T21:26:45.603754] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T21:26:45.617490] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-08T21:26:46.417565] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-08T21:26:46.767225] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T21:26:47.030977] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T21:26:47.217513] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-08T21:26:47.662430] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T21:26:48.017563] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-08T21:26:48.229998] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T21:26:48.233597] [INFO ] [REMOTE ] SEM: Full fetch complete (61615 records). [2025-10-08T21:26:48.233732] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-08T21:26:48.606745] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-08T21:26:48.606829] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-08T21:26:48.607664] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-08T21:26:48.607725] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-08T21:26:48.608924] [DEBUG] [LOCAL ] SEM: Trimmed 61615 records to 42906 (keeping 200 days of data) [2025-10-08T21:26:48.818672] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-08T21:26:48.873931] [DEBUG] [LOCAL ] SEM: Primary data saved (42906 records). [2025-10-08T21:26:48.874079] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-08T21:26:48.874177] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEM took 27.0s. Estimated remaining: 1h 7m 0s. Rate: 7.1 symbols/min [2025-10-08T21:26:49.038702] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:49.078988] [DEBUG] [LOCAL ] SF: Loaded 41637 existing records from primary storage. [2025-10-08T21:26:49.079408] [INFO ] [MAIN ] SF: Loaded 41637 existing records. [2025-10-08T21:26:49.253075] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:49.253312] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-08T21:26:49.253358] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-08T21:26:49.253735] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-08T21:26:49.253792] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-08T21:26:49.607998] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:49.622594] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-10-08T21:26:49.638279] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:26:50.428432] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-08T21:26:50.433091] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T21:26:50.715397] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T21:26:51.217633] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-08T21:26:52.017585] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-08T21:26:52.533602] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T21:26:52.817548] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-08T21:26:52.861369] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-08T21:26:53.617509] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-08T21:26:53.818093] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T21:26:54.183194] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T21:26:54.186714] [INFO ] [REMOTE ] SEMR: Full fetch complete (59603 records). [2025-10-08T21:26:54.186817] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-08T21:26:54.426189] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-08T21:26:54.580667] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-08T21:26:54.580762] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-08T21:26:54.581692] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-08T21:26:54.581755] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-08T21:26:54.583060] [DEBUG] [LOCAL ] SEMR: Trimmed 59603 records to 41795 (keeping 200 days of data) [2025-10-08T21:26:54.824109] [DEBUG] [LOCAL ] SEMR: Primary data saved (41795 records). [2025-10-08T21:26:54.824242] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-08T21:26:54.824323] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEMR took 30.6s. Estimated remaining: 1h 6m 51s. Rate: 7.1 symbols/min [2025-10-08T21:26:54.998588] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:55.006350] [DEBUG] [LOCAL ] SFB: Loaded 4159 existing records from primary storage. [2025-10-08T21:26:55.006578] [INFO ] [MAIN ] SFB: Loaded 4159 existing records. [2025-10-08T21:26:55.181507] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:55.181846] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-08T21:26:55.181907] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-08T21:26:55.182091] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-08T21:26:55.182148] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-08T21:26:55.223963] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-08T21:26:55.540228] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:55.955083] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:26:56.017509] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-10-08T21:26:56.068102] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-08T21:26:56.598759] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T21:26:56.817570] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-08T21:26:56.901077] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-08T21:26:56.905190] [INFO ] [REMOTE ] SEI: Full fetch complete (70213 records). [2025-10-08T21:26:56.905339] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-08T21:26:57.290017] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-08T21:26:57.290110] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-08T21:26:57.291141] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-08T21:26:57.291210] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-08T21:26:57.292681] [DEBUG] [LOCAL ] SEI: Trimmed 70213 records to 49760 (keeping 200 days of data) [2025-10-08T21:26:57.617764] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-08T21:26:57.628926] [DEBUG] [LOCAL ] SEI: Primary data saved (49760 records). [2025-10-08T21:26:57.629286] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-08T21:26:57.629452] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEI took 36.0s. Estimated remaining: 1h 6m 41s. Rate: 7.1 symbols/min [2025-10-08T21:26:57.815250] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:26:57.837777] [DEBUG] [LOCAL ] SFBS: Loaded 21147 existing records from primary storage. [2025-10-08T21:26:57.838084] [INFO ] [MAIN ] SFBS: Loaded 21147 existing records. [2025-10-08T21:26:58.019849] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:26:58.020277] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-08T21:26:58.020332] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-08T21:26:58.020747] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-08T21:26:58.020806] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-08T21:26:58.383967] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:26:58.404571] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T21:26:58.417514] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-08T21:26:59.217532] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-10-08T21:27:00.017637] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-08T21:27:00.078251] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T21:27:00.131477] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-08T21:27:00.239422] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T21:27:00.406617] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-08T21:27:00.817548] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-08T21:27:01.617565] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-08T21:27:02.164415] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T21:27:02.417494] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-08T21:27:02.594180] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T21:27:02.959064] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T21:27:03.217573] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-08T21:27:04.017545] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-08T21:27:04.330422] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T21:27:04.817582] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-08T21:27:05.619207] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-08T21:27:05.625446] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T21:27:06.417589] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-08T21:27:06.616479] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T21:27:06.926508] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-08T21:27:07.217568] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-08T21:27:07.965575] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T21:27:08.017549] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-08T21:27:08.817638] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-08T21:27:09.359177] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-08T21:27:09.401451] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T21:27:09.417108] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T21:27:09.617575] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-08T21:27:10.168305] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T21:27:10.417678] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-08T21:27:11.217533] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-08T21:27:11.492727] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T21:27:12.017680] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-08T21:27:12.817629] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-08T21:27:13.373477] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T21:27:13.505119] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-08T21:27:13.537447] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:27:13.617529] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-08T21:27:14.417553] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-08T21:27:15.176754] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T21:27:15.217548] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-08T21:27:16.017513] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-08T21:27:16.186945] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:27:16.527863] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T21:27:16.531187] [INFO ] [REMOTE ] SF: Full fetch complete (60080 records). [2025-10-08T21:27:16.531288] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-08T21:27:16.821125] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-08T21:27:16.926347] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-08T21:27:16.926530] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-08T21:27:16.927499] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-08T21:27:16.927612] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-08T21:27:16.929224] [DEBUG] [LOCAL ] SF: Trimmed 60080 records to 41634 (keeping 200 days of data) [2025-10-08T21:27:17.051259] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T21:27:17.224542] [DEBUG] [LOCAL ] SF: Primary data saved (41634 records). [2025-10-08T21:27:17.224704] [INFO ] [MAIN ] SF: Full history saved. [2025-10-08T21:27:17.224800] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SF took 28.4s. Estimated remaining: 1h 6m 36s. Rate: 7.1 symbols/min [2025-10-08T21:27:17.326719] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-08T21:27:17.398295] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:17.438570] [DEBUG] [LOCAL ] SFL: Loaded 45130 existing records from primary storage. [2025-10-08T21:27:17.438917] [INFO ] [MAIN ] SFL: Loaded 45130 existing records. [2025-10-08T21:27:17.613314] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:27:17.613547] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-08T21:27:17.613602] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-08T21:27:17.613823] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-08T21:27:17.613879] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-08T21:27:17.624587] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-08T21:27:17.969924] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:18.417545] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-08T21:27:18.823169] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T21:27:19.217543] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-08T21:27:19.769776] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T21:27:20.015980] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-08T21:27:20.025795] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-08T21:27:20.455187] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:27:20.456124] [INFO ] [REMOTE ] SFB: Full fetch complete (5842 records). [2025-10-08T21:27:20.456214] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-08T21:27:20.808419] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-08T21:27:20.808501] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-08T21:27:20.808713] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-08T21:27:20.808781] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-08T21:27:20.809210] [DEBUG] [LOCAL ] SFB: Trimmed 5842 records to 4199 (keeping 200 days of data) [2025-10-08T21:27:20.820613] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-08T21:27:20.840113] [DEBUG] [LOCAL ] SFB: Primary data saved (4199 records). [2025-10-08T21:27:20.840208] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-08T21:27:20.840308] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SFB took 26.0s. Estimated remaining: 1h 6m 26s. Rate: 7.1 symbols/min [2025-10-08T21:27:21.010257] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:21.067451] [DEBUG] [LOCAL ] SG: Loaded 53472 existing records from primary storage. [2025-10-08T21:27:21.067836] [INFO ] [MAIN ] SG: Loaded 53472 existing records. [2025-10-08T21:27:21.242114] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:27:21.242351] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-08T21:27:21.242397] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-08T21:27:21.242639] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-08T21:27:21.242730] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-08T21:27:21.591020] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:21.617493] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-10-08T21:27:21.696864] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T21:27:22.417548] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-08T21:27:23.217518] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-08T21:27:23.537077] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T21:27:23.543859] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-08T21:27:24.017544] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-08T21:27:24.817559] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-08T21:27:25.225469] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T21:27:25.347511] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-08T21:27:25.352630] [INFO ] [REMOTE ] SES: Full fetch complete (75468 records). [2025-10-08T21:27:25.352841] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-08T21:27:25.622768] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-08T21:27:25.755941] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-08T21:27:25.756025] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-08T21:27:25.757095] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-08T21:27:25.757161] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-08T21:27:25.758634] [DEBUG] [LOCAL ] SES: Trimmed 75468 records to 51569 (keeping 200 days of data) [2025-10-08T21:27:26.070080] [DEBUG] [LOCAL ] SES: Primary data saved (51569 records). [2025-10-08T21:27:26.070240] [INFO ] [MAIN ] SES: Full history saved. [2025-10-08T21:27:26.071543] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SES took 52.0s. Estimated remaining: 1h 6m 17s. Rate: 7.1 symbols/min [2025-10-08T21:27:26.254735] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:26.306288] [DEBUG] [LOCAL ] SGHC: Loaded 46419 existing records from primary storage. [2025-10-08T21:27:26.306701] [INFO ] [MAIN ] SGHC: Loaded 46419 existing records. [2025-10-08T21:27:26.427972] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-10-08T21:27:26.496827] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:27:26.497964] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-08T21:27:26.498098] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-08T21:27:26.533170] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-08T21:27:26.533480] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-08T21:27:26.586460] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T21:27:26.701890] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T21:27:26.945480] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:27.217588] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-08T21:27:28.017526] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-08T21:27:28.132583] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T21:27:28.817519] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-08T21:27:29.020276] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T21:27:29.074842] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T21:27:29.617576] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-10-08T21:27:30.377802] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T21:27:30.417577] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-08T21:27:30.602297] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T21:27:31.217626] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-08T21:27:31.246270] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T21:27:31.248322] [INFO ] [REMOTE ] SFBS: Full fetch complete (30262 records). [2025-10-08T21:27:31.248431] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-08T21:27:31.633906] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-08T21:27:31.633985] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-08T21:27:31.634570] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-08T21:27:31.634608] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-08T21:27:31.635509] [DEBUG] [LOCAL ] SFBS: Trimmed 30262 records to 21095 (keeping 200 days of data) [2025-10-08T21:27:31.770287] [DEBUG] [LOCAL ] SFBS: Primary data saved (21095 records). [2025-10-08T21:27:31.770432] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-08T21:27:31.770743] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 34.1s. Estimated remaining: 1h 6m 8s. Rate: 7.1 symbols/min [2025-10-08T21:27:31.942816] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:31.943004] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-08T21:27:31.943041] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-08T21:27:31.943149] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-08T21:27:31.943189] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-08T21:27:31.943230] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-08T21:27:31.943260] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-08T21:27:32.022709] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-08T21:27:32.298755] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:32.766952] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T21:27:32.817498] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-08T21:27:33.617631] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-08T21:27:33.953472] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T21:27:34.390578] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:27:34.417511] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-08T21:27:34.749272] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T21:27:35.217538] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-10-08T21:27:35.411523] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:27:35.411862] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-10-08T21:27:35.411956] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:27:35.412002] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-08T21:27:35.412036] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:27:35.412072] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-08T21:27:35.412127] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-08T21:27:35.412164] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-08T21:27:35.412211] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-08T21:27:35.412261] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SGI took 3.6s. Estimated remaining: 1h 5m 58s. Rate: 7.1 symbols/min [2025-10-08T21:27:35.581168] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:35.591976] [DEBUG] [LOCAL ] SGU: Loaded 6620 existing records from primary storage. [2025-10-08T21:27:35.592184] [INFO ] [MAIN ] SGU: Loaded 6620 existing records. [2025-10-08T21:27:35.790199] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:27:35.790546] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-08T21:27:35.790749] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-08T21:27:35.791018] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-08T21:27:35.791077] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-08T21:27:36.022626] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-08T21:27:36.176769] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-08T21:27:36.228026] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:36.817563] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-10-08T21:27:37.296380] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T21:27:37.409254] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-08T21:27:37.617560] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-08T21:27:38.417563] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-08T21:27:39.217546] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-08T21:27:39.445635] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T21:27:39.986385] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:27:40.017497] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-08T21:27:40.463332] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:27:40.817601] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-08T21:27:41.164678] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T21:27:41.617571] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-08T21:27:42.380923] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T21:27:42.406907] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T21:27:42.417493] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-08T21:27:43.217541] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-08T21:27:44.017541] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-08T21:27:44.232973] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T21:27:44.625253] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T21:27:44.750331] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T21:27:44.817601] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-08T21:27:45.617549] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-08T21:27:46.227826] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T21:27:46.370781] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T21:27:46.417577] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-08T21:27:47.217556] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-08T21:27:47.954703] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T21:27:48.010349] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T21:27:48.019606] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-08T21:27:48.817557] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-08T21:27:49.279738] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-08T21:27:49.626575] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-08T21:27:49.647269] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:27:50.417575] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-08T21:27:51.217590] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-08T21:27:51.358958] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:27:51.871475] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T21:27:52.017563] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-08T21:27:52.431055] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T21:27:52.817554] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-08T21:27:53.481728] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T21:27:53.617528] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-08T21:27:54.192349] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-08T21:27:54.363523] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-08T21:27:54.417572] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-08T21:27:55.217579] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-08T21:27:55.250457] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:27:56.017587] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-08T21:27:56.571367] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T21:27:56.575077] [INFO ] [REMOTE ] SFL: Full fetch complete (65643 records). [2025-10-08T21:27:56.575226] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-08T21:27:56.824409] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-08T21:27:56.909155] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T21:27:57.004983] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-08T21:27:57.005109] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-08T21:27:57.006072] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-08T21:27:57.006135] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-08T21:27:57.007524] [DEBUG] [LOCAL ] SFL: Trimmed 65643 records to 45174 (keeping 200 days of data) [2025-10-08T21:27:57.279579] [DEBUG] [LOCAL ] SFL: Primary data saved (45174 records). [2025-10-08T21:27:57.279854] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-08T21:27:57.280028] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SFL took 40.1s. Estimated remaining: 1h 5m 53s. Rate: 7.1 symbols/min [2025-10-08T21:27:57.450820] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:27:57.498044] [DEBUG] [LOCAL ] SHAK: Loaded 48936 existing records from primary storage. [2025-10-08T21:27:57.498392] [INFO ] [MAIN ] SHAK: Loaded 48936 existing records. [2025-10-08T21:27:57.622751] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-08T21:27:57.678026] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:27:57.678238] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-08T21:27:57.678284] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-08T21:27:57.678737] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-08T21:27:57.678794] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-08T21:27:58.052685] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:27:58.417542] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-10-08T21:27:58.873523] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T21:27:59.217530] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-08T21:27:59.293457] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T21:27:59.739757] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:27:59.740960] [INFO ] [REMOTE ] SGU: Full fetch complete (9051 records). [2025-10-08T21:27:59.741035] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-08T21:28:00.022711] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-08T21:28:00.120209] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-08T21:28:00.120402] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-08T21:28:00.120722] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-08T21:28:00.128163] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-08T21:28:00.141690] [DEBUG] [LOCAL ] SGU: Trimmed 9051 records to 6597 (keeping 200 days of data) [2025-10-08T21:28:00.143462] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T21:28:00.191089] [DEBUG] [LOCAL ] SGU: Primary data saved (6597 records). [2025-10-08T21:28:00.191220] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-08T21:28:00.191326] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SGU took 24.8s. Estimated remaining: 1h 5m 43s. Rate: 7.1 symbols/min [2025-10-08T21:28:00.360244] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:00.385323] [DEBUG] [LOCAL ] SHCO: Loaded 25498 existing records from primary storage. [2025-10-08T21:28:00.385615] [INFO ] [MAIN ] SHCO: Loaded 25498 existing records. [2025-10-08T21:28:00.560006] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:00.560235] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-08T21:28:00.560297] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-08T21:28:00.560663] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-08T21:28:00.560726] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-08T21:28:00.822755] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-08T21:28:00.920813] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:01.617609] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-08T21:28:02.197304] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-08T21:28:02.417598] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-10-08T21:28:02.680008] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T21:28:03.217525] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-08T21:28:03.294939] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:28:03.539388] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T21:28:04.017540] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-08T21:28:04.594564] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T21:28:04.598532] [INFO ] [REMOTE ] SGHC: Full fetch complete (64211 records). [2025-10-08T21:28:04.598702] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-08T21:28:04.822703] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-08T21:28:04.991266] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-08T21:28:04.991399] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-08T21:28:04.992740] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-08T21:28:04.992804] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-08T21:28:04.994240] [DEBUG] [LOCAL ] SGHC: Trimmed 64211 records to 46532 (keeping 200 days of data) [2025-10-08T21:28:05.230317] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:28:05.303819] [DEBUG] [LOCAL ] SGHC: Primary data saved (46532 records). [2025-10-08T21:28:05.303953] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-08T21:28:05.304908] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGHC took 39.2s. Estimated remaining: 1h 5m 34s. Rate: 7.1 symbols/min [2025-10-08T21:28:05.507385] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:05.564412] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-08T21:28:05.564756] [INFO ] [MAIN ] SHEL: Loaded 53672 existing records. [2025-10-08T21:28:05.626629] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-08T21:28:05.757465] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:05.757699] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-08T21:28:05.757759] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-08T21:28:05.758162] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-08T21:28:05.758220] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-08T21:28:06.115903] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:06.417553] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-08T21:28:06.632228] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T21:28:07.217581] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-08T21:28:07.391885] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-08T21:28:07.396802] [INFO ] [REMOTE ] SG: Full fetch complete (77308 records). [2025-10-08T21:28:07.396952] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-08T21:28:07.701703] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T21:28:07.823370] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-08T21:28:07.823456] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-08T21:28:07.824614] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-08T21:28:07.824709] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-08T21:28:07.826317] [DEBUG] [LOCAL ] SG: Trimmed 77308 records to 53472 (keeping 200 days of data) [2025-10-08T21:28:08.030272] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-10-08T21:28:08.146049] [DEBUG] [LOCAL ] SG: Primary data saved (53472 records). [2025-10-08T21:28:08.146205] [INFO ] [MAIN ] SG: Full history saved. [2025-10-08T21:28:08.146292] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SG took 47.3s. Estimated remaining: 1h 5m 24s. Rate: 7.1 symbols/min [2025-10-08T21:28:08.323045] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:08.351115] [DEBUG] [LOCAL ] SHG: Loaded 26280 existing records from primary storage. [2025-10-08T21:28:08.351398] [INFO ] [MAIN ] SHG: Loaded 26280 existing records. [2025-10-08T21:28:08.535247] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:08.535576] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-08T21:28:08.535665] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-08T21:28:08.536005] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-08T21:28:08.536063] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-08T21:28:08.823866] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-08T21:28:08.918114] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:08.947413] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:28:09.617610] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-10-08T21:28:10.207022] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T21:28:10.300162] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-08T21:28:10.417548] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-08T21:28:10.563596] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T21:28:11.217567] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-08T21:28:11.651034] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T21:28:12.017558] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-08T21:28:12.817520] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-08T21:28:13.036876] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T21:28:13.367470] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-08T21:28:13.617544] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-08T21:28:13.732861] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T21:28:14.417557] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-08T21:28:15.135727] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T21:28:15.217566] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-08T21:28:15.720358] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T21:28:16.017564] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-08T21:28:16.817574] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-08T21:28:17.354828] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T21:28:17.384940] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:28:17.618003] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-08T21:28:18.338293] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:28:18.417556] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-08T21:28:19.217548] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-08T21:28:19.850473] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-08T21:28:20.017568] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-08T21:28:20.165200] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T21:28:20.224892] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T21:28:20.817533] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-08T21:28:21.617555] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-08T21:28:21.879145] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:28:21.976952] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T21:28:22.417559] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-08T21:28:23.056861] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T21:28:23.217551] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-08T21:28:23.768868] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T21:28:24.017557] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-08T21:28:24.706854] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T21:28:24.817617] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-08T21:28:25.259831] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T21:28:25.617600] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-08T21:28:26.417607] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-08T21:28:26.787831] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:28:27.009241] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T21:28:27.217567] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-08T21:28:28.017725] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-08T21:28:28.303974] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T21:28:28.817535] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-08T21:28:29.283226] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T21:28:29.417012] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-08T21:28:29.617571] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-08T21:28:30.206570] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T21:28:30.417508] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-08T21:28:30.522061] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T21:28:30.524349] [INFO ] [REMOTE ] SHCO: Full fetch complete (38003 records). [2025-10-08T21:28:30.524436] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-08T21:28:30.920085] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-08T21:28:30.920178] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-08T21:28:30.920917] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-08T21:28:30.920979] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-08T21:28:30.921891] [DEBUG] [LOCAL ] SHCO: Trimmed 38003 records to 25465 (keeping 200 days of data) [2025-10-08T21:28:31.067250] [DEBUG] [LOCAL ] SHCO: Primary data saved (25465 records). [2025-10-08T21:28:31.067408] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-08T21:28:31.067518] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHCO took 30.9s. Estimated remaining: 1h 5m 19s. Rate: 7.1 symbols/min [2025-10-08T21:28:31.222679] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-08T21:28:31.257018] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:31.303580] [DEBUG] [LOCAL ] SHO: Loaded 49629 existing records from primary storage. [2025-10-08T21:28:31.303954] [INFO ] [MAIN ] SHO: Loaded 49629 existing records. [2025-10-08T21:28:31.495277] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:31.495581] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-08T21:28:31.495638] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-08T21:28:31.496004] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-08T21:28:31.496063] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-08T21:28:31.670343] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T21:28:31.900184] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:32.017519] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-08T21:28:32.817512] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-08T21:28:33.175777] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T21:28:33.335958] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T21:28:33.617569] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-08T21:28:34.417532] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-10-08T21:28:34.584846] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:28:35.217583] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-08T21:28:35.712018] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-08T21:28:35.758017] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T21:28:36.017597] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-08T21:28:36.817526] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-08T21:28:36.950673] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:28:37.617510] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-08T21:28:37.852834] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-08T21:28:37.862929] [INFO ] [REMOTE ] SHEL: Full fetch complete (77694 records). [2025-10-08T21:28:37.863731] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T21:28:37.863892] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-08T21:28:37.866433] [INFO ] [REMOTE ] SHG: Full fetch complete (40979 records). [2025-10-08T21:28:37.866550] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-08T21:28:38.426968] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-08T21:28:38.665975] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-08T21:28:38.671203] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-08T21:28:38.672416] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-08T21:28:38.677616] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-08T21:28:38.770035] [DEBUG] [LOCAL ] SHEL: Trimmed 77694 records to 53672 (keeping 200 days of data) [2025-10-08T21:28:38.772873] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-08T21:28:38.772945] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-08T21:28:38.773472] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-08T21:28:38.773557] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-08T21:28:38.775058] [DEBUG] [LOCAL ] SHG: Trimmed 40979 records to 26285 (keeping 200 days of data) [2025-10-08T21:28:39.192150] [DEBUG] [LOCAL ] SHG: Primary data saved (26285 records). [2025-10-08T21:28:39.205336] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-08T21:28:39.216885] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHG took 31.1s. Estimated remaining: 1h 5m 11s. Rate: 7.1 symbols/min [2025-10-08T21:28:39.218893] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T21:28:39.258909] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-08T21:28:39.520354] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:39.531637] [DEBUG] [LOCAL ] SHOC: Loaded 3365 existing records from primary storage. [2025-10-08T21:28:39.532573] [INFO ] [MAIN ] SHOC: Loaded 3365 existing records. [2025-10-08T21:28:39.724266] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:39.725760] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-08T21:28:39.726161] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-08T21:28:39.726861] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-08T21:28:39.727174] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-08T21:28:39.787578] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-10-08T21:28:39.813490] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-08T21:28:39.835976] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHEL took 34.5s. Estimated remaining: 1h 5m 0s. Rate: 7.1 symbols/min [2025-10-08T21:28:40.099877] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T21:28:40.217438] [INFO ] [REMOTE ] SHAK: Full fetch complete (70624 records). [2025-10-08T21:28:40.212168] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:40.222827] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-08T21:28:40.333476] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:40.355343] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-10-08T21:28:40.651914] [DEBUG] [LOCAL ] SHW: Loaded 50318 existing records from primary storage. [2025-10-08T21:28:40.684477] [INFO ] [MAIN ] SHW: Loaded 50318 existing records. [2025-10-08T21:28:40.800247] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-08T21:28:40.805588] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-08T21:28:40.806810] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-08T21:28:40.820081] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-08T21:28:40.960252] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:40.960463] [DEBUG] [LOCAL ] SHAK: Trimmed 70624 records to 48826 (keeping 200 days of data) [2025-10-08T21:28:40.960876] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-08T21:28:40.960995] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-08T21:28:40.986257] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T21:28:40.984454] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-08T21:28:41.081363] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-08T21:28:41.099180] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-08T21:28:41.223076] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T21:28:41.597240] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:41.619598] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-08T21:28:41.682370] [DEBUG] [LOCAL ] SHAK: Primary data saved (48826 records). [2025-10-08T21:28:41.682512] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-08T21:28:41.682596] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHAK took 44.4s. Estimated remaining: 1h 4m 50s. Rate: 7.1 symbols/min [2025-10-08T21:28:41.849211] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:41.849425] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-08T21:28:41.849480] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-08T21:28:41.849595] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-08T21:28:41.849636] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-08T21:28:41.849724] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-08T21:28:41.849761] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-08T21:28:42.197747] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:42.373879] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T21:28:42.417508] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-10-08T21:28:42.622394] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:28:42.624168] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T21:28:42.624534] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-10-08T21:28:42.634588] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:28:42.634741] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-08T21:28:42.635139] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:28:42.635330] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-08T21:28:42.635436] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-08T21:28:42.635833] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-08T21:28:42.635913] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-08T21:28:42.635985] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SI took 1.0s. Estimated remaining: 1h 4m 40s. Rate: 7.1 symbols/min [2025-10-08T21:28:42.805202] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:28:42.845265] [DEBUG] [LOCAL ] SID: Loaded 42365 existing records from primary storage. [2025-10-08T21:28:42.845689] [INFO ] [MAIN ] SID: Loaded 42365 existing records. [2025-10-08T21:28:43.020488] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:28:43.020731] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-08T21:28:43.020785] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-08T21:28:43.020999] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-08T21:28:43.021067] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-08T21:28:43.224383] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-10-08T21:28:43.378088] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:28:44.017566] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-10-08T21:28:44.817555] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-08T21:28:45.131486] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T21:28:45.575504] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:28:45.617515] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-08T21:28:46.329786] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T21:28:46.417530] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-08T21:28:47.139743] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T21:28:47.217526] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-08T21:28:48.017601] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-08T21:28:48.179089] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T21:28:48.247756] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T21:28:48.544686] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-08T21:28:48.817546] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-08T21:28:49.617552] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-08T21:28:50.417592] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-08T21:28:50.544074] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T21:28:51.111501] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T21:28:51.217559] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-08T21:28:51.721078] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T21:28:52.017593] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-08T21:28:52.382026] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T21:28:52.796612] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T21:28:52.817513] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-08T21:28:53.617559] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-08T21:28:54.407952] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T21:28:54.417586] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-08T21:28:55.210833] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T21:28:55.221408] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-08T21:28:55.650326] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-08T21:28:56.017551] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-08T21:28:56.426351] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-08T21:28:56.817565] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-08T21:28:57.061087] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T21:28:57.617570] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-08T21:28:58.417572] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-08T21:28:58.754935] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T21:28:59.217929] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T21:28:59.218093] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-08T21:28:59.698207] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T21:28:59.890622] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T21:29:00.017572] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-08T21:29:00.539079] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-08T21:29:00.817554] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-08T21:29:01.617627] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-08T21:29:02.417519] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-08T21:29:02.460637] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-08T21:29:02.493638] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T21:29:03.217593] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-08T21:29:03.769321] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T21:29:03.843126] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T21:29:04.017548] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-08T21:29:04.817631] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-08T21:29:05.317892] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T21:29:05.617536] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-08T21:29:05.812809] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T21:29:06.038295] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:29:06.039256] [INFO ] [REMOTE ] SHOC: Full fetch complete (7166 records). [2025-10-08T21:29:06.039337] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-08T21:29:06.411221] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-08T21:29:06.411329] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-08T21:29:06.411559] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-08T21:29:06.411622] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-08T21:29:06.412097] [DEBUG] [LOCAL ] SHOC: Trimmed 7166 records to 3342 (keeping 200 days of data) [2025-10-08T21:29:06.423197] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-08T21:29:06.435629] [DEBUG] [LOCAL ] SHOC: Primary data saved (3342 records). [2025-10-08T21:29:06.435807] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-08T21:29:06.435900] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHOC took 27.2s. Estimated remaining: 1h 4m 35s. Rate: 7.1 symbols/min [2025-10-08T21:29:06.608896] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:29:06.649364] [DEBUG] [LOCAL ] SIG: Loaded 45878 existing records from primary storage. [2025-10-08T21:29:06.649739] [INFO ] [MAIN ] SIG: Loaded 45878 existing records. [2025-10-08T21:29:06.826225] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:29:06.826519] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-08T21:29:06.826577] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-08T21:29:06.826813] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-08T21:29:06.826870] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-08T21:29:07.183312] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:29:07.217523] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-10-08T21:29:08.017583] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-08T21:29:08.280417] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:29:08.817578] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-08T21:29:08.896005] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T21:29:09.127006] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T21:29:09.130782] [INFO ] [REMOTE ] SHO: Full fetch complete (70976 records). [2025-10-08T21:29:09.130919] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-08T21:29:09.537817] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-08T21:29:09.537952] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-08T21:29:09.538986] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-08T21:29:09.539078] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-08T21:29:09.540585] [DEBUG] [LOCAL ] SHO: Trimmed 70976 records to 49577 (keeping 200 days of data) [2025-10-08T21:29:09.627419] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-08T21:29:09.837264] [DEBUG] [LOCAL ] SHO: Primary data saved (49577 records). [2025-10-08T21:29:09.837403] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-08T21:29:09.837484] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHO took 38.8s. Estimated remaining: 1h 4m 26s. Rate: 7.1 symbols/min [2025-10-08T21:29:10.009936] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:29:10.032581] [DEBUG] [LOCAL ] SII: Loaded 23648 existing records from primary storage. [2025-10-08T21:29:10.032870] [INFO ] [MAIN ] SII: Loaded 23648 existing records. [2025-10-08T21:29:10.214483] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:29:10.214961] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-08T21:29:10.215086] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-08T21:29:10.215476] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-08T21:29:10.215534] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-08T21:29:10.430557] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-08T21:29:10.537824] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T21:29:10.610241] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:29:11.217536] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-08T21:29:11.384505] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T21:29:12.017588] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-08T21:29:12.334178] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T21:29:12.553339] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T21:29:12.557152] [INFO ] [REMOTE ] SID: Full fetch complete (60797 records). [2025-10-08T21:29:12.557282] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-08T21:29:12.824146] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-10-08T21:29:12.951375] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-08T21:29:12.951456] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-08T21:29:12.952482] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-08T21:29:12.952547] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-08T21:29:12.953859] [DEBUG] [LOCAL ] SID: Trimmed 60797 records to 42554 (keeping 200 days of data) [2025-10-08T21:29:13.192042] [DEBUG] [LOCAL ] SID: Primary data saved (42554 records). [2025-10-08T21:29:13.192167] [INFO ] [MAIN ] SID: Full history saved. [2025-10-08T21:29:13.192258] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SID took 30.6s. Estimated remaining: 1h 4m 16s. Rate: 7.1 symbols/min [2025-10-08T21:29:13.361898] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:29:13.392203] [DEBUG] [LOCAL ] SILA: Loaded 30664 existing records from primary storage. [2025-10-08T21:29:13.392479] [INFO ] [MAIN ] SILA: Loaded 30664 existing records. [2025-10-08T21:29:13.576390] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:29:13.576874] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-08T21:29:13.577115] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-08T21:29:13.577544] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-08T21:29:13.577702] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-08T21:29:13.622611] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-08T21:29:13.698395] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T21:29:13.823672] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T21:29:14.006301] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:29:14.417613] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-08T21:29:15.217544] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-08T21:29:15.388383] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T21:29:16.017561] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-10-08T21:29:16.054886] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T21:29:16.294262] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T21:29:16.817615] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-08T21:29:17.364817] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T21:29:17.617557] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-08T21:29:17.798396] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T21:29:18.417588] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-08T21:29:19.217710] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-08T21:29:19.442074] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T21:29:20.017559] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-08T21:29:20.187827] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T21:29:20.318131] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T21:29:20.817535] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-08T21:29:21.211881] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T21:29:21.617581] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-08T21:29:22.134332] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T21:29:22.417560] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-08T21:29:23.217574] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-08T21:29:23.423245] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T21:29:23.458706] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T21:29:24.017607] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-08T21:29:24.527341] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T21:29:24.817562] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-08T21:29:25.130766] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T21:29:25.617551] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-08T21:29:26.151334] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T21:29:26.417553] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-08T21:29:27.217530] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-08T21:29:27.278438] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T21:29:27.796469] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T21:29:28.017712] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-08T21:29:28.418336] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T21:29:28.422529] [INFO ] [REMOTE ] SHW: Full fetch complete (73052 records). [2025-10-08T21:29:28.422807] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-08T21:29:28.821194] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-08T21:29:28.847705] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-08T21:29:28.847795] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-08T21:29:28.848866] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-08T21:29:28.848932] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-08T21:29:28.853990] [DEBUG] [LOCAL ] SHW: Trimmed 73052 records to 50320 (keeping 200 days of data) [2025-10-08T21:29:29.102871] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-08T21:29:29.211827] [DEBUG] [LOCAL ] SHW: Primary data saved (50320 records). [2025-10-08T21:29:29.211994] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-08T21:29:29.212090] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SHW took 49.4s. Estimated remaining: 1h 4m 9s. Rate: 7.1 symbols/min [2025-10-08T21:29:29.406385] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:29:29.447106] [DEBUG] [LOCAL ] SITC: Loaded 41616 existing records from primary storage. [2025-10-08T21:29:29.447488] [INFO ] [MAIN ] SITC: Loaded 41616 existing records. [2025-10-08T21:29:29.623772] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:29:29.623987] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-08T21:29:29.624041] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-08T21:29:29.620098] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-08T21:29:29.624851] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-08T21:29:29.624911] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-08T21:29:29.991614] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:29:30.108438] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T21:29:30.417583] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-10-08T21:29:30.737019] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T21:29:31.217537] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-08T21:29:31.992594] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T21:29:32.017507] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-08T21:29:32.755021] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-08T21:29:32.817532] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-08T21:29:33.502819] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T21:29:33.617573] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-08T21:29:34.042111] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T21:29:34.417602] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-08T21:29:34.782924] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T21:29:35.217555] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-08T21:29:35.765380] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:29:35.967970] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T21:29:36.017541] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-08T21:29:36.817547] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-08T21:29:36.985986] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T21:29:36.989255] [INFO ] [REMOTE ] SII: Full fetch complete (30404 records). [2025-10-08T21:29:36.989379] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-08T21:29:37.363665] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-08T21:29:37.363760] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-08T21:29:37.364378] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-08T21:29:37.364417] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-08T21:29:37.365220] [DEBUG] [LOCAL ] SII: Trimmed 30404 records to 23684 (keeping 200 days of data) [2025-10-08T21:29:37.516027] [DEBUG] [LOCAL ] SII: Primary data saved (23684 records). [2025-10-08T21:29:37.516163] [INFO ] [MAIN ] SII: Full history saved. [2025-10-08T21:29:37.516289] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 27.7s. Estimated remaining: 1h 4m 1s. Rate: 7.1 symbols/min [2025-10-08T21:29:37.617832] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-08T21:29:37.688458] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:29:37.725592] [DEBUG] [LOCAL ] SITE: Loaded 35237 existing records from primary storage. [2025-10-08T21:29:37.725953] [INFO ] [MAIN ] SITE: Loaded 35237 existing records. [2025-10-08T21:29:37.899679] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:29:37.899914] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-08T21:29:37.899975] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-08T21:29:37.900149] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-08T21:29:37.900186] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-08T21:29:38.254586] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:29:38.277889] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T21:29:38.417556] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-08T21:29:38.998373] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T21:29:39.217569] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-08T21:29:40.025564] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-08T21:29:40.049362] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T21:29:40.447320] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T21:29:40.817606] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-10-08T21:29:41.436194] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T21:29:41.617602] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-08T21:29:42.059965] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T21:29:42.417589] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-08T21:29:43.146070] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T21:29:43.217504] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-08T21:29:43.777720] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T21:29:43.781103] [INFO ] [REMOTE ] SIG: Full fetch complete (67851 records). [2025-10-08T21:29:43.781215] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-08T21:29:44.023723] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-08T21:29:44.162580] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-08T21:29:44.162687] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-08T21:29:44.163671] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-08T21:29:44.163736] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-08T21:29:44.165111] [DEBUG] [LOCAL ] SIG: Trimmed 67851 records to 45786 (keeping 200 days of data) [2025-10-08T21:29:44.449385] [DEBUG] [LOCAL ] SIG: Primary data saved (45786 records). [2025-10-08T21:29:44.449544] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-08T21:29:44.449700] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 38.0s. Estimated remaining: 1h 3m 52s. Rate: 7.1 symbols/min [2025-10-08T21:29:44.708346] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T21:29:44.817496] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-08T21:29:45.178677] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T21:29:45.617587] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-08T21:29:46.080907] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T21:29:46.417558] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-08T21:29:46.947062] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T21:29:47.217513] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-08T21:29:47.616040] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T21:29:48.017518] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-08T21:29:48.214575] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T21:29:48.217111] [INFO ] [REMOTE ] SILA: Full fetch complete (44687 records). [2025-10-08T21:29:48.217246] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-08T21:29:48.595819] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-08T21:29:48.595891] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-08T21:29:48.596698] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-08T21:29:48.596763] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-08T21:29:48.598439] [DEBUG] [LOCAL ] SILA: Trimmed 44687 records to 30608 (keeping 200 days of data) [2025-10-08T21:29:48.792592] [DEBUG] [LOCAL ] SILA: Primary data saved (30608 records). [2025-10-08T21:29:48.792763] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-08T21:29:48.792857] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 35.6s. Estimated remaining: 1h 3m 43s. Rate: 7.1 symbols/min [2025-10-08T21:29:48.817520] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-08T21:29:49.290259] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T21:29:49.617609] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-08T21:29:50.251946] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T21:29:50.417547] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-08T21:29:51.274990] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:29:51.285930] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-08T21:29:51.666953] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T21:29:52.017585] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-08T21:29:52.590836] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T21:29:52.594779] [INFO ] [REMOTE ] SITC: Full fetch complete (60698 records). [2025-10-08T21:29:52.594945] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-08T21:29:53.057348] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-08T21:29:53.057466] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-08T21:29:53.058503] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-08T21:29:53.058582] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-08T21:29:53.060272] [DEBUG] [LOCAL ] SITC: Trimmed 60698 records to 41578 (keeping 200 days of data) [2025-10-08T21:29:53.322185] [DEBUG] [LOCAL ] SITC: Primary data saved (41578 records). [2025-10-08T21:29:53.322323] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-08T21:29:53.323195] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITC took 24.1s. Estimated remaining: 1h 3m 33s. Rate: 7.1 symbols/min [2025-10-08T21:29:53.638494] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:29:53.647623] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-08T21:29:55.002740] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T21:29:55.010374] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-08T21:29:56.343506] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T21:29:56.350537] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-08T21:29:57.845198] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T21:29:57.853510] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-08T21:29:59.285089] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T21:29:59.293631] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-08T21:30:00.695824] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T21:30:00.704391] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-08T21:30:02.096565] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-08T21:30:02.101140] [INFO ] [REMOTE ] SITE: Full fetch complete (49949 records). [2025-10-08T21:30:02.101342] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-08T21:30:02.519211] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-08T21:30:02.519318] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-08T21:30:02.520278] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-08T21:30:02.520344] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-08T21:30:02.521455] [DEBUG] [LOCAL ] SITE: Trimmed 49949 records to 35253 (keeping 200 days of data) [2025-10-08T21:30:02.738589] [DEBUG] [LOCAL ] SITE: Primary data saved (35253 records). [2025-10-08T21:30:02.738772] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-08T21:30:02.738869] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITE took 25.2s. Estimated remaining: 1h 3m 25s. Rate: 7.1 symbols/min [2025-10-08T21:30:03.498580] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:03.491795] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:03.525193] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:03.555296] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:03.560108] [DEBUG] [LOCAL ] SKIL: Loaded 6496 existing records from primary storage. [2025-10-08T21:30:03.560840] [INFO ] [MAIN ] SKIL: Loaded 6496 existing records. [2025-10-08T21:30:03.715330] [DEBUG] [LOCAL ] SJT: Loaded 22383 existing records from primary storage. [2025-10-08T21:30:03.748819] [INFO ] [MAIN ] SJT: Loaded 22383 existing records. [2025-10-08T21:30:03.772241] [DEBUG] [LOCAL ] SKE: Loaded 36214 existing records from primary storage. [2025-10-08T21:30:03.791122] [INFO ] [MAIN ] SKE: Loaded 36214 existing records. [2025-10-08T21:30:03.859692] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:03.940112] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-08T21:30:03.950620] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-08T21:30:03.982637] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-08T21:30:04.008793] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-08T21:30:04.171535] [DEBUG] [LOCAL ] SJM: Loaded 50142 existing records from primary storage. [2025-10-08T21:30:04.244883] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:04.258120] [INFO ] [MAIN ] SJM: Loaded 50142 existing records. [2025-10-08T21:30:04.252902] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-08T21:30:04.306904] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:04.344923] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-08T21:30:04.341817] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-08T21:30:04.350432] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-08T21:30:04.355710] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-08T21:30:04.360936] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-08T21:30:04.414639] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-08T21:30:04.484835] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-08T21:30:04.773688] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:04.852359] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-08T21:30:04.892580] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-08T21:30:04.939797] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-08T21:30:04.997550] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-08T21:30:05.319234] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:05.391266] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-10-08T21:30:05.660110] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:05.745126] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-10-08T21:30:05.799219] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:05.823754] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-10-08T21:30:05.968812] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:05.969190] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-10-08T21:30:06.309001] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T21:30:06.311367] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-08T21:30:06.958112] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:30:06.966517] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-08T21:30:06.974773] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T21:30:06.977916] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-08T21:30:07.060327] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T21:30:07.066056] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-08T21:30:07.441411] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T21:30:07.451205] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-08T21:30:07.724169] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T21:30:07.726265] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-08T21:30:07.907883] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T21:30:07.912251] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-08T21:30:07.989942] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-08T21:30:07.997124] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-08T21:30:08.452984] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-08T21:30:08.455896] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-08T21:30:08.860466] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T21:30:08.871257] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-08T21:30:08.901377] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T21:30:08.903582] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-08T21:30:08.969026] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T21:30:09.348414] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:30:09.617521] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-08T21:30:09.674485] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T21:30:10.247369] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T21:30:10.417532] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-08T21:30:10.987889] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:30:11.002422] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T21:30:11.217528] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-08T21:30:12.017539] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-08T21:30:12.368378] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T21:30:12.817558] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-08T21:30:13.617516] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-08T21:30:13.980491] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T21:30:14.254755] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-08T21:30:14.417557] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-08T21:30:14.927505] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T21:30:15.217534] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-08T21:30:16.017566] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-08T21:30:16.405788] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T21:30:16.817528] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-08T21:30:16.905528] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (4.89 seconds). [2025-10-08T21:30:17.024177] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T21:30:17.617559] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-08T21:30:18.325249] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:30:18.327038] [INFO ] [REMOTE ] SKIL: Full fetch complete (10120 records). [2025-10-08T21:30:18.327130] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-08T21:30:18.418075] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-08T21:30:18.711296] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-08T21:30:18.711404] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-08T21:30:18.711697] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-08T21:30:18.711770] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-08T21:30:18.712693] [DEBUG] [LOCAL ] SKIL: Trimmed 10120 records to 6539 (keeping 200 days of data) [2025-10-08T21:30:18.758208] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T21:30:18.793690] [DEBUG] [LOCAL ] SKIL: Primary data saved (6539 records). [2025-10-08T21:30:18.793806] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-08T21:30:18.793887] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SKIL took 16.0s. Estimated remaining: 1h 3m 18s. Rate: 7.1 symbols/min [2025-10-08T21:30:18.963026] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:18.975817] [DEBUG] [LOCAL ] SKLZ: Loaded 11624 existing records from primary storage. [2025-10-08T21:30:18.976055] [INFO ] [MAIN ] SKLZ: Loaded 11624 existing records. [2025-10-08T21:30:19.165315] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:19.165582] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-08T21:30:19.165662] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-08T21:30:19.165865] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-08T21:30:19.165921] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-08T21:30:19.222635] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-08T21:30:19.549306] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:19.578883] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T21:30:20.017554] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-10-08T21:30:20.703562] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T21:30:20.817524] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-08T21:30:21.137603] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T21:30:21.617571] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-08T21:30:22.196888] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T21:30:22.417594] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-08T21:30:22.588929] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-08T21:30:23.217569] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-08T21:30:24.017531] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-08T21:30:24.207979] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T21:30:24.632502] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T21:30:24.817519] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-08T21:30:25.016679] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T21:30:25.617555] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-08T21:30:26.259842] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T21:30:26.340846] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T21:30:26.417585] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-08T21:30:27.174529] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-08T21:30:27.217689] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-08T21:30:27.994030] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-08T21:30:28.017564] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-08T21:30:28.817550] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-08T21:30:29.617530] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-08T21:30:29.632452] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-08T21:30:29.705781] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T21:30:30.417603] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-08T21:30:31.217527] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-08T21:30:31.287842] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T21:30:31.902197] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T21:30:31.905634] [INFO ] [REMOTE ] SKE: Full fetch complete (51041 records). [2025-10-08T21:30:31.905751] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-08T21:30:32.019066] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-08T21:30:32.225829] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T21:30:32.320776] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-08T21:30:32.320865] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-08T21:30:32.321701] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-08T21:30:32.321763] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-08T21:30:32.322835] [DEBUG] [LOCAL ] SKE: Trimmed 51041 records to 36311 (keeping 200 days of data) [2025-10-08T21:30:32.541632] [DEBUG] [LOCAL ] SKE: Primary data saved (36311 records). [2025-10-08T21:30:32.541851] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-08T21:30:32.541965] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SKE took 29.8s. Estimated remaining: 1h 3m 11s. Rate: 7.1 symbols/min [2025-10-08T21:30:32.731771] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:32.731963] [DEBUG] [LOCAL ] SKM: No existing data file found in primary storage. [2025-10-08T21:30:32.732018] [WARN ] [MAIN ] SKM: No existing data found, performing full refresh instead. [2025-10-08T21:30:32.732139] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-08T21:30:32.732181] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-08T21:30:32.732221] [DEBUG] [LOCAL ] SKM: No primary data file found to delete. [2025-10-08T21:30:32.732253] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-08T21:30:32.822736] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-08T21:30:33.026529] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T21:30:33.109437] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:33.617518] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-08T21:30:33.762953] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T21:30:34.378042] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:30:34.417585] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-10-08T21:30:35.217567] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-08T21:30:35.560131] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:30:36.017828] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-08T21:30:36.223821] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T21:30:36.817585] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-08T21:30:37.617539] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-08T21:30:37.892359] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T21:30:38.040300] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T21:30:38.158164] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T21:30:38.417616] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-08T21:30:39.025176] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T21:30:39.026496] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18593 records). [2025-10-08T21:30:39.026567] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-08T21:30:39.222700] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-08T21:30:39.397097] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-08T21:30:39.397176] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-08T21:30:39.397586] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-08T21:30:39.397624] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-08T21:30:39.398197] [DEBUG] [LOCAL ] SKLZ: Trimmed 18593 records to 11603 (keeping 200 days of data) [2025-10-08T21:30:39.464168] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11603 records). [2025-10-08T21:30:39.464320] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-08T21:30:39.464406] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SKLZ took 20.7s. Estimated remaining: 1h 3m 2s. Rate: 7.1 symbols/min [2025-10-08T21:30:39.629960] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:39.675740] [DEBUG] [LOCAL ] SKT: Loaded 42521 existing records from primary storage. [2025-10-08T21:30:39.676028] [INFO ] [MAIN ] SKT: Loaded 42521 existing records. [2025-10-08T21:30:39.857585] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:39.857868] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-08T21:30:39.857921] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-08T21:30:39.858173] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-08T21:30:39.858229] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-08T21:30:40.030684] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-08T21:30:40.216318] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:40.686744] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T21:30:40.817554] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-08T21:30:41.596547] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T21:30:41.598737] [INFO ] [REMOTE ] SJT: Full fetch complete (31951 records). [2025-10-08T21:30:41.598819] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-08T21:30:41.624796] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-08T21:30:41.765112] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:30:42.104356] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-08T21:30:42.104436] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-08T21:30:42.105190] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-08T21:30:42.105256] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-08T21:30:42.106062] [DEBUG] [LOCAL ] SJT: Trimmed 31951 records to 22517 (keeping 200 days of data) [2025-10-08T21:30:42.246123] [DEBUG] [LOCAL ] SJT: Primary data saved (22517 records). [2025-10-08T21:30:42.246259] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-08T21:30:42.246386] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SJT took 39.5s. Estimated remaining: 1h 2m 53s. Rate: 7.1 symbols/min [2025-10-08T21:30:42.426770] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-10-08T21:30:42.471449] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:42.516037] [DEBUG] [LOCAL ] SKY: Loaded 38001 existing records from primary storage. [2025-10-08T21:30:42.516420] [INFO ] [MAIN ] SKY: Loaded 38001 existing records. [2025-10-08T21:30:42.723290] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:42.723521] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-08T21:30:42.723581] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-08T21:30:42.723866] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-08T21:30:42.723926] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-08T21:30:43.184722] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:43.186942] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T21:30:43.217506] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-08T21:30:43.827796] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T21:30:44.017579] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-10-08T21:30:44.749905] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T21:30:44.817592] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-08T21:30:45.617521] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-08T21:30:45.649497] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T21:30:46.427221] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-08T21:30:46.432680] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:30:47.217596] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-08T21:30:47.263005] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:30:47.880784] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:30:47.991681] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T21:30:48.017494] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-08T21:30:48.817558] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-08T21:30:48.926297] [DEBUG] [REMOTE ] SKM: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-08T21:30:48.926607] [WARN ] [REMOTE ] SKM: No data returned for month 2025-06 [2025-10-08T21:30:48.926720] [FATAL] [REMOTE ] SKM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:30:48.926808] [FATAL] [MAIN ] SKM: Failed to fetch primary data. [2025-10-08T21:30:48.926872] [WARN ] [MAIN ] SKM: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:30:48.926925] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-08T21:30:48.926993] [DEBUG] [LOCAL ] SKM: No primary data file found to delete. [2025-10-08T21:30:48.927058] [INFO ] [LOCAL ] SKM: Starting deletion of derivative data. [2025-10-08T21:30:48.927123] [DEBUG] [LOCAL ] SKM: No derivative data file found to delete. [2025-10-08T21:30:48.927205] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKM took 16.4s. Estimated remaining: 1h 2m 44s. Rate: 7.1 symbols/min [2025-10-08T21:30:49.127006] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:49.145275] [DEBUG] [LOCAL ] SKYH: Loaded 16609 existing records from primary storage. [2025-10-08T21:30:49.145529] [INFO ] [MAIN ] SKYH: Loaded 16609 existing records. [2025-10-08T21:30:49.325294] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:49.325567] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-08T21:30:49.325617] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-08T21:30:49.325997] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-08T21:30:49.326054] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-08T21:30:49.479185] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T21:30:49.556340] [INFO ] [REMOTE ] SJM: Full fetch complete (72076 records). [2025-10-08T21:30:49.588498] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-08T21:30:49.632172] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-08T21:30:49.807504] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:50.125402] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-08T21:30:50.125568] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-08T21:30:50.127455] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-08T21:30:50.127554] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-08T21:30:50.129873] [DEBUG] [LOCAL ] SJM: Trimmed 72076 records to 50116 (keeping 200 days of data) [2025-10-08T21:30:50.442001] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-08T21:30:50.488958] [DEBUG] [LOCAL ] SJM: Primary data saved (50116 records). [2025-10-08T21:30:50.489224] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-08T21:30:50.489349] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SJM took 47.7s. Estimated remaining: 1h 2m 34s. Rate: 7.1 symbols/min [2025-10-08T21:30:50.676119] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:30:50.734722] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-08T21:30:50.735305] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-10-08T21:30:50.934073] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:30:50.934460] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-08T21:30:50.934520] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-08T21:30:50.935022] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-10-08T21:30:50.935081] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-08T21:30:51.229376] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-10-08T21:30:51.317619] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T21:30:51.339539] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:30:51.633784] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T21:30:52.017562] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-08T21:30:52.404489] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T21:30:52.817583] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-08T21:30:53.441792] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T21:30:53.617612] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-08T21:30:53.766022] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T21:30:54.407636] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T21:30:54.417519] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-08T21:30:55.198601] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T21:30:55.217487] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-08T21:30:56.017559] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-10-08T21:30:56.414223] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T21:30:56.817597] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-08T21:30:57.617532] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-08T21:30:57.825023] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:30:58.111684] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-08T21:30:58.417563] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-08T21:30:58.855264] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T21:30:59.217512] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-08T21:30:59.302761] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T21:31:00.017570] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-08T21:31:00.817527] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-08T21:31:01.123252] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T21:31:01.543152] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T21:31:01.617586] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-08T21:31:02.417557] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-08T21:31:02.487332] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T21:31:03.086411] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T21:31:03.217543] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-08T21:31:04.018410] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-08T21:31:04.022182] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T21:31:04.817595] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-08T21:31:05.127726] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T21:31:05.256805] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-08T21:31:05.617557] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-08T21:31:06.355746] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:31:06.417585] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-08T21:31:06.755445] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T21:31:07.217523] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-08T21:31:08.017560] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-08T21:31:08.508776] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T21:31:08.817559] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-08T21:31:08.862927] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:31:09.213696] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-08T21:31:09.617581] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-08T21:31:09.749201] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T21:31:10.417543] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-08T21:31:11.217518] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-08T21:31:11.631253] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-08T21:31:11.776052] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T21:31:11.941021] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:31:12.017525] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-08T21:31:12.817554] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-08T21:31:13.220906] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T21:31:13.617556] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-08T21:31:14.182074] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T21:31:14.417548] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-08T21:31:15.217520] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-08T21:31:15.657309] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T21:31:15.730866] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T21:31:16.017517] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-08T21:31:16.535558] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T21:31:16.538837] [INFO ] [REMOTE ] SKT: Full fetch complete (60448 records). [2025-10-08T21:31:16.538932] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-08T21:31:16.826379] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-08T21:31:16.922312] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-08T21:31:16.922391] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-08T21:31:16.923292] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-08T21:31:16.923411] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-08T21:31:16.924665] [DEBUG] [LOCAL ] SKT: Trimmed 60448 records to 42467 (keeping 200 days of data) [2025-10-08T21:31:17.182167] [DEBUG] [LOCAL ] SKT: Primary data saved (42467 records). [2025-10-08T21:31:17.182295] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-08T21:31:17.182376] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKT took 37.7s. Estimated remaining: 1h 2m 30s. Rate: 7.1 symbols/min [2025-10-08T21:31:17.352255] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:17.388057] [DEBUG] [LOCAL ] SLF: Loaded 38723 existing records from primary storage. [2025-10-08T21:31:17.388374] [INFO ] [MAIN ] SLF: Loaded 38723 existing records. [2025-10-08T21:31:17.568847] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:31:17.569096] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-08T21:31:17.569156] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-08T21:31:17.569447] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-08T21:31:17.569506] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-08T21:31:17.632207] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-08T21:31:17.929902] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:18.065720] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T21:31:18.128920] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T21:31:18.417499] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-08T21:31:18.494118] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T21:31:19.217536] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-08T21:31:20.017634] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-10-08T21:31:20.085314] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-08T21:31:20.088050] [INFO ] [REMOTE ] SKYH: Full fetch complete (22338 records). [2025-10-08T21:31:20.088212] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-08T21:31:20.576415] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-08T21:31:20.576691] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-08T21:31:20.577721] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-08T21:31:20.577811] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-08T21:31:20.578799] [DEBUG] [LOCAL ] SKYH: Trimmed 22338 records to 16565 (keeping 200 days of data) [2025-10-08T21:31:20.690856] [DEBUG] [LOCAL ] SKYH: Primary data saved (16565 records). [2025-10-08T21:31:20.691020] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-08T21:31:20.691110] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKYH took 31.8s. Estimated remaining: 1h 2m 20s. Rate: 7.1 symbols/min [2025-10-08T21:31:20.818768] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-08T21:31:20.887193] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:20.925052] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-08T21:31:20.979526] [DEBUG] [LOCAL ] SLG: Loaded 45184 existing records from primary storage. [2025-10-08T21:31:20.979909] [INFO ] [MAIN ] SLG: Loaded 45184 existing records. [2025-10-08T21:31:21.163442] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:31:21.163804] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-08T21:31:21.163906] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-08T21:31:21.172171] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-08T21:31:21.184621] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-08T21:31:21.229401] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:31:21.544140] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:21.617525] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-08T21:31:21.829712] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T21:31:21.832936] [INFO ] [REMOTE ] SKY: Full fetch complete (54341 records). [2025-10-08T21:31:21.833062] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-08T21:31:22.231512] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-08T21:31:22.231595] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-08T21:31:22.232466] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-08T21:31:22.232528] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-08T21:31:22.233693] [DEBUG] [LOCAL ] SKY: Trimmed 54341 records to 38006 (keeping 200 days of data) [2025-10-08T21:31:22.430419] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-10-08T21:31:22.466748] [DEBUG] [LOCAL ] SKY: Primary data saved (38006 records). [2025-10-08T21:31:22.466915] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-08T21:31:22.467011] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKY took 40.2s. Estimated remaining: 1h 2m 10s. Rate: 7.1 symbols/min [2025-10-08T21:31:22.652128] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:22.690817] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T21:31:22.734118] [DEBUG] [LOCAL ] SLGN: Loaded 40559 existing records from primary storage. [2025-10-08T21:31:22.734460] [INFO ] [MAIN ] SLGN: Loaded 40559 existing records. [2025-10-08T21:31:22.917371] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:31:22.917597] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-08T21:31:22.917664] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-08T21:31:22.917998] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-08T21:31:22.918055] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-08T21:31:23.223619] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-08T21:31:23.306232] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:23.997945] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T21:31:24.017505] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-08T21:31:24.817602] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-08T21:31:25.373119] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-08T21:31:25.436805] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:31:25.617551] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-08T21:31:26.142902] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T21:31:26.417616] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-10-08T21:31:26.735884] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:31:27.217580] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-08T21:31:27.904397] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T21:31:28.017597] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-08T21:31:28.753613] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T21:31:28.817551] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-08T21:31:29.524219] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T21:31:29.617561] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-08T21:31:30.417550] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-08T21:31:30.644616] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T21:31:30.991627] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T21:31:30.995739] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-10-08T21:31:30.995870] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-08T21:31:31.224684] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-08T21:31:31.407396] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-08T21:31:31.407487] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-08T21:31:31.408574] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-08T21:31:31.408666] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-08T21:31:31.410313] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 53697 (keeping 200 days of data) [2025-10-08T21:31:31.536586] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:31:31.781899] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-08T21:31:31.782057] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-08T21:31:31.782143] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SLB took 41.3s. Estimated remaining: 1h 2m 2s. Rate: 7.1 symbols/min [2025-10-08T21:31:31.950435] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:31.950664] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-08T21:31:31.950721] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-08T21:31:31.950873] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-08T21:31:31.950914] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-08T21:31:31.950954] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-08T21:31:31.950990] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-08T21:31:32.022913] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-08T21:31:32.305938] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:32.817557] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-10-08T21:31:32.886173] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T21:31:33.211010] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-08T21:31:33.251306] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T21:31:33.617553] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-08T21:31:34.417530] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-08T21:31:35.170850] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T21:31:35.217543] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-08T21:31:35.970441] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T21:31:36.017536] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-08T21:31:36.460200] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T21:31:36.817561] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-08T21:31:37.557288] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:31:37.617515] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-08T21:31:38.417531] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-08T21:31:38.469778] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:31:38.712451] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T21:31:39.217636] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-08T21:31:39.911791] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:31:40.017583] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-08T21:31:40.275013] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-08T21:31:40.766146] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T21:31:40.817519] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-08T21:31:41.617545] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-08T21:31:42.337323] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:31:42.417501] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-08T21:31:43.085707] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T21:31:43.217502] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-08T21:31:44.017548] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-08T21:31:44.063638] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T21:31:44.369461] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T21:31:44.818914] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T21:31:44.819058] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-08T21:31:45.617558] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-08T21:31:46.148707] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T21:31:46.152312] [INFO ] [REMOTE ] SLGN: Full fetch complete (58750 records). [2025-10-08T21:31:46.152416] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-08T21:31:46.423470] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-08T21:31:46.544176] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-08T21:31:46.544278] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-08T21:31:46.545253] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-08T21:31:46.545321] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-08T21:31:46.546776] [DEBUG] [LOCAL ] SLGN: Trimmed 58750 records to 40575 (keeping 200 days of data) [2025-10-08T21:31:46.798958] [DEBUG] [LOCAL ] SLGN: Primary data saved (40575 records). [2025-10-08T21:31:46.799123] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-08T21:31:46.799214] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLGN took 24.3s. Estimated remaining: 1h 1m 55s. Rate: 7.1 symbols/min [2025-10-08T21:31:46.976049] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:47.016847] [DEBUG] [LOCAL ] SLQT: Loaded 43504 existing records from primary storage. [2025-10-08T21:31:47.017327] [INFO ] [MAIN ] SLQT: Loaded 43504 existing records. [2025-10-08T21:31:47.198253] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T21:31:47.223973] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-08T21:31:47.229461] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:31:47.239168] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-08T21:31:47.239259] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-08T21:31:47.240222] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-08T21:31:47.240285] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-08T21:31:47.608840] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:47.626175] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-08T21:31:48.017502] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-08T21:31:48.086588] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:31:48.817609] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-08T21:31:49.375068] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T21:31:49.617557] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-10-08T21:31:50.116526] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T21:31:50.119765] [INFO ] [REMOTE ] SLG: Full fetch complete (64973 records). [2025-10-08T21:31:50.119882] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-08T21:31:50.422724] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-08T21:31:50.526217] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-08T21:31:50.526299] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-08T21:31:50.527267] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-08T21:31:50.527330] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-08T21:31:50.528688] [DEBUG] [LOCAL ] SLG: Trimmed 64973 records to 45182 (keeping 200 days of data) [2025-10-08T21:31:50.815621] [DEBUG] [LOCAL ] SLG: Primary data saved (45182 records). [2025-10-08T21:31:50.815778] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-08T21:31:50.816852] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLG took 30.1s. Estimated remaining: 1h 1m 45s. Rate: 7.1 symbols/min [2025-10-08T21:31:50.883974] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-08T21:31:50.995127] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:51.025377] [DEBUG] [LOCAL ] SLVM: Loaded 27995 existing records from primary storage. [2025-10-08T21:31:51.025677] [INFO ] [MAIN ] SLVM: Loaded 27995 existing records. [2025-10-08T21:31:51.222462] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:31:51.219005] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-08T21:31:51.222819] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-08T21:31:51.223868] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-08T21:31:51.231332] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-08T21:31:51.231591] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-08T21:31:51.316174] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-08T21:31:51.622345] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:31:51.624904] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-08T21:31:52.017548] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-08T21:31:52.817568] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-08T21:31:53.569891] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T21:31:53.617533] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-08T21:31:54.372490] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T21:31:54.417566] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-08T21:31:55.217527] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-08T21:31:55.376052] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T21:31:55.586723] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-08T21:31:55.823505] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T21:31:56.017578] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-10-08T21:31:56.822520] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-08T21:31:56.826702] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T21:31:57.176051] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T21:31:57.617545] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-08T21:31:58.417553] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-08T21:31:58.889236] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T21:31:58.892352] [INFO ] [REMOTE ] SLF: Full fetch complete (56360 records). [2025-10-08T21:31:58.892460] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-08T21:31:59.229433] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-08T21:31:59.283928] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-08T21:31:59.284019] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-08T21:31:59.284958] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-08T21:31:59.285023] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-08T21:31:59.286311] [DEBUG] [LOCAL ] SLF: Trimmed 56360 records to 38750 (keeping 200 days of data) [2025-10-08T21:31:59.555745] [DEBUG] [LOCAL ] SLF: Primary data saved (38750 records). [2025-10-08T21:31:59.555910] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-08T21:31:59.556020] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLF took 42.4s. Estimated remaining: 1h 1m 37s. Rate: 7.1 symbols/min [2025-10-08T21:31:59.642772] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-08T21:31:59.718552] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T21:31:59.794459] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:31:59.851837] [DEBUG] [LOCAL ] SM: Loaded 52319 existing records from primary storage. [2025-10-08T21:31:59.852251] [INFO ] [MAIN ] SM: Loaded 52319 existing records. [2025-10-08T21:32:00.022837] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-08T21:32:00.072479] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:00.073014] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-08T21:32:00.073081] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-08T21:32:00.073461] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-08T21:32:00.073521] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-08T21:32:00.464273] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:00.817571] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-08T21:32:01.220256] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T21:32:01.372347] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:32:01.617539] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-08T21:32:01.893344] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T21:32:01.894119] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1051 records). [2025-10-08T21:32:01.894190] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-08T21:32:02.075422] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-08T21:32:02.075625] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:32:02.075717] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:32:02.075787] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-08T21:32:02.075851] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-08T21:32:02.075910] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-08T21:32:02.075980] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-08T21:32:02.076059] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLNZ took 30.3s. Estimated remaining: 1h 1m 27s. Rate: 7.1 symbols/min [2025-10-08T21:32:02.243696] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:02.243871] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-08T21:32:02.243909] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-08T21:32:02.244027] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-08T21:32:02.244071] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-08T21:32:02.244120] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-08T21:32:02.244152] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-08T21:32:02.422254] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-08T21:32:02.613467] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:03.217560] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-10-08T21:32:03.420507] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:32:03.420880] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-10-08T21:32:03.420973] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:32:03.421031] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-08T21:32:03.421100] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:32:03.421173] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-08T21:32:03.421260] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-08T21:32:03.421307] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-08T21:32:03.421349] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-08T21:32:03.421396] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SMA took 1.3s. Estimated remaining: 1h 1m 17s. Rate: 7.1 symbols/min [2025-10-08T21:32:03.600383] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:03.613934] [DEBUG] [LOCAL ] SMBK: Loaded 8173 existing records from primary storage. [2025-10-08T21:32:03.614254] [INFO ] [MAIN ] SMBK: Loaded 8173 existing records. [2025-10-08T21:32:03.800287] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:03.800550] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-08T21:32:03.800599] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-08T21:32:03.800800] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-08T21:32:03.800858] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-08T21:32:04.021580] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-10-08T21:32:04.183582] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:04.212112] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T21:32:04.817558] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-08T21:32:05.617521] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-10-08T21:32:05.783852] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T21:32:06.408251] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T21:32:06.422610] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-08T21:32:06.438285] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:32:07.217550] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-08T21:32:08.017591] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-08T21:32:08.282880] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T21:32:08.803761] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T21:32:08.825319] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-08T21:32:08.844860] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:32:09.504566] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T21:32:09.617540] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-08T21:32:10.393349] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T21:32:10.417529] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-08T21:32:10.949561] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T21:32:11.217549] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-08T21:32:12.017556] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-08T21:32:12.817581] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-08T21:32:13.081215] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T21:32:13.412883] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T21:32:13.569841] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T21:32:13.617509] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-08T21:32:14.422160] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-08T21:32:14.424131] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T21:32:15.217586] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-08T21:32:15.603021] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T21:32:16.017635] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-08T21:32:16.738060] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T21:32:16.817590] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-08T21:32:17.364209] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T21:32:17.617552] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-08T21:32:18.417575] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-08T21:32:18.479570] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T21:32:18.558903] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T21:32:19.222363] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-08T21:32:19.224313] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T21:32:20.017563] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-08T21:32:20.409273] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:32:20.817589] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-08T21:32:21.565136] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T21:32:21.617495] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-08T21:32:22.134973] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T21:32:22.417560] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-08T21:32:22.998819] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T21:32:23.126322] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T21:32:23.217530] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-08T21:32:23.950134] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T21:32:24.017514] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-08T21:32:24.661808] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:32:24.662988] [INFO ] [REMOTE ] SMBK: Full fetch complete (11788 records). [2025-10-08T21:32:24.663078] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-08T21:32:24.818155] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-08T21:32:25.035390] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-08T21:32:25.035495] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-08T21:32:25.035834] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-08T21:32:25.035895] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-08T21:32:25.036406] [DEBUG] [LOCAL ] SMBK: Trimmed 11788 records to 8170 (keeping 200 days of data) [2025-10-08T21:32:25.086071] [DEBUG] [LOCAL ] SMBK: Primary data saved (8170 records). [2025-10-08T21:32:25.086195] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-08T21:32:25.086289] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SMBK took 21.7s. Estimated remaining: 1h 1m 12s. Rate: 7.1 symbols/min [2025-10-08T21:32:25.261327] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:25.274032] [DEBUG] [LOCAL ] SMC: Loaded 11308 existing records from primary storage. [2025-10-08T21:32:25.274240] [INFO ] [MAIN ] SMC: Loaded 11308 existing records. [2025-10-08T21:32:25.448195] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:25.448411] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-08T21:32:25.448457] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-08T21:32:25.448700] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-08T21:32:25.448757] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-08T21:32:25.627286] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-08T21:32:25.809795] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:26.191906] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T21:32:26.417699] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-08T21:32:26.949213] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T21:32:26.952537] [INFO ] [REMOTE ] SLQT: Full fetch complete (63860 records). [2025-10-08T21:32:26.952693] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-08T21:32:27.222460] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-10-08T21:32:27.395902] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-08T21:32:27.396034] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-08T21:32:27.397525] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-08T21:32:27.397678] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-08T21:32:27.406046] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T21:32:27.409942] [INFO ] [REMOTE ] SLVM: Full fetch complete (40175 records). [2025-10-08T21:32:27.410128] [DEBUG] [LOCAL ] SLQT: Trimmed 63860 records to 43514 (keeping 200 days of data) [2025-10-08T21:32:27.410213] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-08T21:32:27.910755] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-08T21:32:27.911565] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-08T21:32:27.912928] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-08T21:32:27.913757] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-08T21:32:27.917100] [DEBUG] [LOCAL ] SLVM: Trimmed 40175 records to 27872 (keeping 200 days of data) [2025-10-08T21:32:28.039113] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-08T21:32:28.199763] [DEBUG] [LOCAL ] SLQT: Primary data saved (43514 records). [2025-10-08T21:32:28.202239] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-08T21:32:28.202412] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SLQT took 41.4s. Estimated remaining: 1h 1m 2s. Rate: 7.1 symbols/min [2025-10-08T21:32:28.360113] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:32:28.450875] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:28.468304] [DEBUG] [LOCAL ] SLVM: Primary data saved (27872 records). [2025-10-08T21:32:28.468545] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-08T21:32:28.468670] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SLVM took 37.7s. Estimated remaining: 1h 0m 52s. Rate: 7.1 symbols/min [2025-10-08T21:32:28.655159] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:28.673802] [DEBUG] [LOCAL ] SMFG: Loaded 48186 existing records from primary storage. [2025-10-08T21:32:28.674289] [INFO ] [MAIN ] SMFG: Loaded 48186 existing records. [2025-10-08T21:32:28.838183] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-08T21:32:28.893001] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:28.894662] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-08T21:32:28.894744] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-08T21:32:28.895137] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-08T21:32:28.895206] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-08T21:32:29.010273] [DEBUG] [LOCAL ] SMG: Loaded 43653 existing records from primary storage. [2025-10-08T21:32:29.021315] [INFO ] [MAIN ] SMG: Loaded 43653 existing records. [2025-10-08T21:32:29.414264] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:29.427082] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-08T21:32:29.427970] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-08T21:32:29.452406] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:29.452918] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-08T21:32:29.453008] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-08T21:32:29.627531] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-10-08T21:32:29.764929] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-08T21:32:29.834397] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:30.025238] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T21:32:30.417597] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-08T21:32:31.217548] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-10-08T21:32:31.255550] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T21:32:31.287531] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T21:32:32.017562] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-08T21:32:32.544185] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T21:32:32.817612] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-08T21:32:33.618939] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-08T21:32:33.625079] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T21:32:34.302716] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:32:34.417504] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-08T21:32:34.462809] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T21:32:35.217556] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-08T21:32:36.017561] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-08T21:32:36.230715] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T21:32:36.310891] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T21:32:36.817553] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-08T21:32:37.027688] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:32:37.617576] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-08T21:32:38.303061] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T21:32:38.417544] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-08T21:32:38.754958] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T21:32:39.186365] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-08T21:32:39.217532] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-08T21:32:39.994921] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T21:32:40.017527] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-08T21:32:40.817530] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-08T21:32:41.593547] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T21:32:41.617504] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-08T21:32:42.425774] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-08T21:32:42.431924] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T21:32:43.217514] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-08T21:32:43.466389] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:32:43.993181] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-08T21:32:44.019920] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-08T21:32:44.022102] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-08T21:32:44.817548] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-08T21:32:45.617589] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-08T21:32:45.821015] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:32:46.417509] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-08T21:32:46.429282] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T21:32:46.690071] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-08T21:32:47.217640] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-08T21:32:47.995911] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T21:32:48.017492] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-08T21:32:48.072312] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T21:32:48.464522] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T21:32:48.466352] [INFO ] [REMOTE ] SMC: Full fetch complete (16429 records). [2025-10-08T21:32:48.466441] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-08T21:32:48.818043] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-08T21:32:48.845691] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-08T21:32:48.845804] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-08T21:32:48.846184] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-08T21:32:48.846245] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-08T21:32:48.846805] [DEBUG] [LOCAL ] SMC: Trimmed 16429 records to 11264 (keeping 200 days of data) [2025-10-08T21:32:48.914087] [DEBUG] [LOCAL ] SMC: Primary data saved (11264 records). [2025-10-08T21:32:48.914216] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-08T21:32:48.914301] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SMC took 23.8s. Estimated remaining: 1h 0m 46s. Rate: 7.1 symbols/min [2025-10-08T21:32:49.084530] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:49.099310] [DEBUG] [LOCAL ] SMHI: Loaded 13095 existing records from primary storage. [2025-10-08T21:32:49.099547] [INFO ] [MAIN ] SMHI: Loaded 13095 existing records. [2025-10-08T21:32:49.271630] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:49.271900] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-08T21:32:49.271970] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-08T21:32:49.272203] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-08T21:32:49.272259] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-08T21:32:49.615560] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:32:49.617510] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-10-08T21:32:50.237377] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T21:32:50.417583] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-08T21:32:50.932435] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T21:32:51.217578] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-08T21:32:52.017567] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-08T21:32:52.309942] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:32:52.363699] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T21:32:52.817542] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-08T21:32:53.617597] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-08T21:32:53.793302] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T21:32:54.271944] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T21:32:54.337360] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T21:32:54.417516] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-08T21:32:55.217563] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-08T21:32:56.017544] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-08T21:32:56.159580] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T21:32:56.637267] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T21:32:56.817537] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-08T21:32:57.566240] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T21:32:57.617523] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-08T21:32:58.325525] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T21:32:58.329838] [INFO ] [REMOTE ] SM: Full fetch complete (75504 records). [2025-10-08T21:32:58.329998] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-08T21:32:58.422768] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-08T21:32:58.788413] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-08T21:32:58.788544] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-08T21:32:58.790248] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-08T21:32:58.790360] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-08T21:32:58.792805] [DEBUG] [LOCAL ] SM: Trimmed 75504 records to 52313 (keeping 200 days of data) [2025-10-08T21:32:59.074465] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T21:32:59.128393] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T21:32:59.217716] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-08T21:32:59.231184] [DEBUG] [LOCAL ] SM: Primary data saved (52313 records). [2025-10-08T21:32:59.231854] [INFO ] [MAIN ] SM: Full history saved. [2025-10-08T21:32:59.232000] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SM took 59.7s. Estimated remaining: 1h 0m 38s. Rate: 7.1 symbols/min [2025-10-08T21:32:59.422588] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:32:59.454965] [DEBUG] [LOCAL ] SMP: Loaded 19030 existing records from primary storage. [2025-10-08T21:32:59.455354] [INFO ] [MAIN ] SMP: Loaded 19030 existing records. [2025-10-08T21:32:59.637612] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:32:59.637874] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-08T21:32:59.637923] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-08T21:32:59.638199] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-08T21:32:59.638255] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-08T21:32:59.984718] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:00.017508] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-10-08T21:33:00.817572] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-08T21:33:00.970328] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T21:33:01.142238] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T21:33:01.617555] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-08T21:33:01.909128] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T21:33:02.417562] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-08T21:33:02.950195] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T21:33:02.954067] [INFO ] [REMOTE ] SMG: Full fetch complete (62791 records). [2025-10-08T21:33:02.954185] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-08T21:33:03.222625] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-08T21:33:03.391077] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-08T21:33:03.391225] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-08T21:33:03.392236] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-08T21:33:03.392307] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-08T21:33:03.393798] [DEBUG] [LOCAL ] SMG: Trimmed 62791 records to 43618 (keeping 200 days of data) [2025-10-08T21:33:03.671970] [DEBUG] [LOCAL ] SMG: Primary data saved (43618 records). [2025-10-08T21:33:03.672551] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-08T21:33:03.673738] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMG took 35.2s. Estimated remaining: 1h 0m 29s. Rate: 7.1 symbols/min [2025-10-08T21:33:03.847585] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:03.908414] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-08T21:33:03.908853] [INFO ] [MAIN ] SMR: Loaded 53798 existing records. [2025-10-08T21:33:04.022760] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-08T21:33:04.096638] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:04.097052] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-08T21:33:04.097127] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-08T21:33:04.098080] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-10-08T21:33:04.098141] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-08T21:33:04.252069] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T21:33:04.547361] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-08T21:33:04.676358] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:04.751686] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T21:33:04.817591] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-08T21:33:05.617573] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-08T21:33:05.811138] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T21:33:06.298253] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T21:33:06.417562] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-10-08T21:33:07.217565] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-08T21:33:08.017629] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-08T21:33:08.040823] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T21:33:08.781101] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-08T21:33:08.817502] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-08T21:33:09.199736] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T21:33:09.617551] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-08T21:33:10.323302] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T21:33:10.408470] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T21:33:10.418057] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-08T21:33:11.217551] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-08T21:33:12.017571] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-08T21:33:12.385482] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T21:33:12.817635] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-08T21:33:12.975317] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-08T21:33:13.090031] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T21:33:13.095341] [INFO ] [REMOTE ] SMFG: Full fetch complete (69078 records). [2025-10-08T21:33:13.095521] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-08T21:33:13.518486] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-08T21:33:13.518867] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-08T21:33:13.520073] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-08T21:33:13.520242] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-08T21:33:13.521850] [DEBUG] [LOCAL ] SMFG: Trimmed 69078 records to 48189 (keeping 200 days of data) [2025-10-08T21:33:13.617574] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-08T21:33:13.845326] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T21:33:13.862878] [DEBUG] [LOCAL ] SMFG: Primary data saved (48189 records). [2025-10-08T21:33:13.863068] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-08T21:33:13.863171] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMFG took 45.7s. Estimated remaining: 1h 0m 21s. Rate: 7.1 symbols/min [2025-10-08T21:33:14.051344] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:14.096419] [DEBUG] [LOCAL ] SMRT: Loaded 44033 existing records from primary storage. [2025-10-08T21:33:14.096810] [INFO ] [MAIN ] SMRT: Loaded 44033 existing records. [2025-10-08T21:33:14.282981] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:14.283329] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-08T21:33:14.283381] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-08T21:33:14.283902] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-08T21:33:14.283963] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-08T21:33:14.422799] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-08T21:33:14.575347] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T21:33:14.699478] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:15.217585] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-08T21:33:16.017572] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-10-08T21:33:16.401142] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:33:16.817602] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-08T21:33:17.029485] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-08T21:33:17.172774] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T21:33:17.302587] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T21:33:17.304583] [INFO ] [REMOTE ] SMHI: Full fetch complete (22314 records). [2025-10-08T21:33:17.304723] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-08T21:33:17.622777] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-08T21:33:17.713882] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-08T21:33:17.713993] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-08T21:33:17.714761] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-08T21:33:17.714876] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-08T21:33:17.715831] [DEBUG] [LOCAL ] SMHI: Trimmed 22314 records to 13112 (keeping 200 days of data) [2025-10-08T21:33:17.798587] [DEBUG] [LOCAL ] SMHI: Primary data saved (13112 records). [2025-10-08T21:33:17.798829] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-08T21:33:17.798943] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMHI took 28.9s. Estimated remaining: 1h 0m 11s. Rate: 7.1 symbols/min [2025-10-08T21:33:17.983668] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:18.026375] [DEBUG] [LOCAL ] SMWB: Loaded 32300 existing records from primary storage. [2025-10-08T21:33:18.027106] [INFO ] [MAIN ] SMWB: Loaded 32300 existing records. [2025-10-08T21:33:18.244971] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:18.245301] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-08T21:33:18.245357] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-08T21:33:18.245817] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-08T21:33:18.245879] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-08T21:33:18.431811] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-08T21:33:18.642960] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:19.217609] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-08T21:33:19.541318] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T21:33:20.017519] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-08T21:33:20.218534] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-08T21:33:20.568764] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T21:33:20.817614] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-08T21:33:21.162060] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-08T21:33:21.617559] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-08T21:33:22.417601] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-08T21:33:22.606631] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T21:33:22.990286] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T21:33:23.217579] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-10-08T21:33:23.810693] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T21:33:24.017628] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-08T21:33:24.359956] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:33:24.817603] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-08T21:33:25.536473] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T21:33:25.538074] [INFO ] [REMOTE ] SMP: Full fetch complete (26154 records). [2025-10-08T21:33:25.538153] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-08T21:33:25.619930] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-08T21:33:25.837637] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T21:33:25.971000] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-08T21:33:25.971197] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-08T21:33:25.973343] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-08T21:33:25.973445] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-08T21:33:25.975443] [DEBUG] [LOCAL ] SMP: Trimmed 26154 records to 18965 (keeping 200 days of data) [2025-10-08T21:33:26.114178] [DEBUG] [LOCAL ] SMP: Primary data saved (18965 records). [2025-10-08T21:33:26.114407] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-08T21:33:26.114518] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMP took 26.9s. Estimated remaining: 1h 0m 3s. Rate: 7.1 symbols/min [2025-10-08T21:33:26.305807] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:26.364729] [DEBUG] [LOCAL ] SN: Loaded 49906 existing records from primary storage. [2025-10-08T21:33:26.365212] [INFO ] [MAIN ] SN: Loaded 49906 existing records. [2025-10-08T21:33:26.423332] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-08T21:33:26.560909] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:26.561234] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-08T21:33:26.561287] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-08T21:33:26.561689] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-08T21:33:26.561751] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-08T21:33:26.981223] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:27.200476] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T21:33:27.217499] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-08T21:33:28.017590] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-08T21:33:28.746634] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T21:33:28.817528] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-10-08T21:33:28.881215] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-08T21:33:29.622639] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-08T21:33:29.646798] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T21:33:30.032363] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:33:30.417606] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-08T21:33:31.217573] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-08T21:33:32.018503] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T21:33:32.018715] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-08T21:33:32.243828] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-08T21:33:32.778316] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T21:33:32.817492] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-08T21:33:33.139618] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T21:33:33.617627] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-08T21:33:34.417577] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-08T21:33:34.496353] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T21:33:34.672318] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T21:33:35.217538] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-08T21:33:36.017612] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-08T21:33:36.666726] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:33:36.817544] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-08T21:33:37.189771] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:33:37.221129] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-08T21:33:37.617545] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-08T21:33:38.257840] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:33:38.417529] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-08T21:33:38.834889] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T21:33:39.217565] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-08T21:33:39.807713] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T21:33:40.017542] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-08T21:33:40.817559] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-08T21:33:41.032300] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T21:33:41.617563] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-08T21:33:42.324159] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T21:33:42.417592] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-08T21:33:42.723037] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-08T21:33:43.121264] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T21:33:43.217502] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-08T21:33:43.486740] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T21:33:44.017567] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-08T21:33:44.681798] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T21:33:44.817498] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-08T21:33:45.617582] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-08T21:33:45.774548] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T21:33:45.973924] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T21:33:45.977457] [INFO ] [REMOTE ] SMRT: Full fetch complete (62154 records). [2025-10-08T21:33:45.977571] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-08T21:33:46.353705] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-08T21:33:46.353794] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-08T21:33:46.354714] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-08T21:33:46.354777] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-08T21:33:46.356039] [DEBUG] [LOCAL ] SMRT: Trimmed 62154 records to 44025 (keeping 200 days of data) [2025-10-08T21:33:46.436504] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-08T21:33:46.608462] [DEBUG] [LOCAL ] SMRT: Primary data saved (44025 records). [2025-10-08T21:33:46.608626] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-08T21:33:46.608750] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMRT took 32.7s. Estimated remaining: 59m 57s. Rate: 7.1 symbols/min [2025-10-08T21:33:46.815520] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:46.842790] [DEBUG] [LOCAL ] SNA: Loaded 25689 existing records from primary storage. [2025-10-08T21:33:46.843056] [INFO ] [MAIN ] SNA: Loaded 25689 existing records. [2025-10-08T21:33:47.017214] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:47.017406] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-08T21:33:47.017476] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-08T21:33:47.017848] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-08T21:33:47.017927] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-08T21:33:47.223757] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-08T21:33:47.375315] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:48.017568] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-10-08T21:33:48.181989] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T21:33:48.233746] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T21:33:48.305952] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-08T21:33:48.817544] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-08T21:33:49.059535] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T21:33:49.617582] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-08T21:33:50.417525] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-08T21:33:50.733095] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T21:33:50.735839] [INFO ] [REMOTE ] SMWB: Full fetch complete (49347 records). [2025-10-08T21:33:50.735934] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-08T21:33:51.194432] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-08T21:33:51.194596] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-08T21:33:51.195670] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-08T21:33:51.195801] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-08T21:33:51.197040] [DEBUG] [LOCAL ] SMWB: Trimmed 49347 records to 32277 (keeping 200 days of data) [2025-10-08T21:33:51.244804] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-08T21:33:51.379130] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-08T21:33:51.385150] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-10-08T21:33:51.385932] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-08T21:33:51.755198] [DEBUG] [LOCAL ] SMWB: Primary data saved (32277 records). [2025-10-08T21:33:51.774788] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-08T21:33:51.817043] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMWB took 34.0s. Estimated remaining: 59m 48s. Rate: 7.1 symbols/min [2025-10-08T21:33:51.822699] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-10-08T21:33:51.835276] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-10-08T21:33:51.844162] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-10-08T21:33:51.870472] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-10-08T21:33:51.995966] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53798 (keeping 200 days of data) [2025-10-08T21:33:52.018005] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T21:33:52.063576] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:52.064194] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-08T21:33:52.213826] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-08T21:33:52.215377] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-08T21:33:52.434556] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:52.434870] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-08T21:33:52.434929] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-08T21:33:52.435219] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-08T21:33:52.435288] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-08T21:33:52.914091] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:52.915617] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-10-08T21:33:52.952994] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T21:33:53.077430] [DEBUG] [LOCAL ] SMR: Primary data saved (53798 records). [2025-10-08T21:33:53.077585] [INFO ] [MAIN ] SMR: Full history saved. [2025-10-08T21:33:53.078813] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMR took 49.4s. Estimated remaining: 59m 38s. Rate: 7.1 symbols/min [2025-10-08T21:33:53.252846] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:33:53.261159] [DEBUG] [LOCAL ] SNDA: Loaded 4458 existing records from primary storage. [2025-10-08T21:33:53.261404] [INFO ] [MAIN ] SNDA: Loaded 4458 existing records. [2025-10-08T21:33:53.443154] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:33:53.443605] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-08T21:33:53.443854] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-08T21:33:53.444216] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-08T21:33:53.450185] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-08T21:33:53.533772] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T21:33:53.622706] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-08T21:33:53.874373] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:33:54.417559] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-08T21:33:54.868824] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T21:33:55.020191] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T21:33:55.217556] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-08T21:33:55.739621] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T21:33:56.017572] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-08T21:33:56.817550] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-08T21:33:57.600277] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T21:33:57.617494] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-08T21:33:57.703881] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-08T21:33:58.124543] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T21:33:58.417557] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-10-08T21:33:58.907590] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T21:33:59.124582] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-08T21:33:59.217561] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-08T21:34:00.017570] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-08T21:34:00.813450] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T21:34:00.817482] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-08T21:34:01.249901] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-08T21:34:01.455599] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T21:34:01.617562] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-08T21:34:02.160430] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-08T21:34:02.417578] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-08T21:34:03.217565] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-08T21:34:03.903550] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T21:34:03.907346] [INFO ] [REMOTE ] SN: Full fetch complete (71186 records). [2025-10-08T21:34:03.907462] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-08T21:34:04.022675] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-08T21:34:04.353372] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-08T21:34:04.353474] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-08T21:34:04.354622] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-08T21:34:04.354730] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-08T21:34:04.356324] [DEBUG] [LOCAL ] SN: Trimmed 71186 records to 49926 (keeping 200 days of data) [2025-10-08T21:34:04.668879] [DEBUG] [LOCAL ] SN: Primary data saved (49926 records). [2025-10-08T21:34:04.669077] [INFO ] [MAIN ] SN: Full history saved. [2025-10-08T21:34:04.669239] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SN took 38.6s. Estimated remaining: 59m 30s. Rate: 7.1 symbols/min [2025-10-08T21:34:04.821032] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-08T21:34:04.842955] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:04.887416] [DEBUG] [LOCAL ] SNDR: Loaded 41045 existing records from primary storage. [2025-10-08T21:34:04.887795] [INFO ] [MAIN ] SNDR: Loaded 41045 existing records. [2025-10-08T21:34:05.071108] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:05.071445] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-08T21:34:05.071625] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-08T21:34:05.071994] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-08T21:34:05.072054] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-08T21:34:05.372785] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:34:05.464783] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:05.578780] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-08T21:34:05.579753] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-08T21:34:05.617572] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-08T21:34:06.417612] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-08T21:34:06.959932] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T21:34:07.217558] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-08T21:34:07.867100] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T21:34:08.017562] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-08T21:34:08.601216] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T21:34:08.817513] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-08T21:34:09.179157] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T21:34:09.422669] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T21:34:09.617609] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-08T21:34:10.417558] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-10-08T21:34:11.217621] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-08T21:34:11.948608] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-08T21:34:12.003504] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T21:34:12.017494] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-08T21:34:12.069814] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:34:12.817572] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-08T21:34:13.081461] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T21:34:13.083721] [INFO ] [REMOTE ] SNA: Full fetch complete (38767 records). [2025-10-08T21:34:13.083802] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-08T21:34:13.398706] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T21:34:13.509970] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-08T21:34:13.510106] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-08T21:34:13.511592] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-08T21:34:13.511750] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-08T21:34:13.513064] [DEBUG] [LOCAL ] SNA: Trimmed 38767 records to 25697 (keeping 200 days of data) [2025-10-08T21:34:13.634738] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-08T21:34:13.745488] [DEBUG] [LOCAL ] SNA: Primary data saved (25697 records). [2025-10-08T21:34:13.745728] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-08T21:34:13.745907] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 27.1s. Estimated remaining: 59m 22s. Rate: 7.1 symbols/min [2025-10-08T21:34:14.022079] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:14.086908] [DEBUG] [LOCAL ] SNN: Loaded 44165 existing records from primary storage. [2025-10-08T21:34:14.087335] [INFO ] [MAIN ] SNN: Loaded 44165 existing records. [2025-10-08T21:34:14.268413] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-08T21:34:14.388114] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:14.388426] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-08T21:34:14.388500] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-08T21:34:14.388831] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-08T21:34:14.388892] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-08T21:34:14.425690] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-08T21:34:14.828066] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:15.100889] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T21:34:15.217578] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-08T21:34:15.636628] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T21:34:15.637521] [INFO ] [REMOTE ] SNDA: Full fetch complete (7785 records). [2025-10-08T21:34:15.637592] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-08T21:34:16.032049] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-10-08T21:34:16.042111] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-08T21:34:16.042935] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-08T21:34:16.043204] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-08T21:34:16.043269] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-08T21:34:16.044049] [DEBUG] [LOCAL ] SNDA: Trimmed 7785 records to 4435 (keeping 200 days of data) [2025-10-08T21:34:16.072410] [DEBUG] [LOCAL ] SNDA: Primary data saved (4435 records). [2025-10-08T21:34:16.072537] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-08T21:34:16.072688] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SNDA took 23.0s. Estimated remaining: 59m 12s. Rate: 7.1 symbols/min [2025-10-08T21:34:16.243438] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:16.304871] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-08T21:34:16.305251] [INFO ] [MAIN ] SNOW: Loaded 53593 existing records. [2025-10-08T21:34:16.487567] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:16.487854] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-08T21:34:16.487917] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-08T21:34:16.488190] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-10-08T21:34:16.488269] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-08T21:34:16.825773] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-08T21:34:16.857074] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:17.567725] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T21:34:17.617521] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-10-08T21:34:18.356046] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:34:18.417611] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-08T21:34:19.217584] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-08T21:34:19.524705] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-08T21:34:20.017583] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-08T21:34:20.302672] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:34:20.348255] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T21:34:20.817564] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-08T21:34:21.617577] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-08T21:34:22.417584] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-08T21:34:22.503274] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-08T21:34:22.993111] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T21:34:23.217608] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-08T21:34:23.357046] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T21:34:23.434712] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T21:34:24.017617] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-08T21:34:24.817616] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-08T21:34:25.623374] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-08T21:34:25.626509] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-08T21:34:25.792094] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:34:26.417530] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-08T21:34:26.483035] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T21:34:27.037014] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T21:34:27.217551] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-08T21:34:28.017550] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-08T21:34:28.713634] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-08T21:34:28.817534] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-08T21:34:28.904520] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T21:34:29.172885] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-08T21:34:29.617612] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-08T21:34:30.417566] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-08T21:34:30.615605] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T21:34:30.717049] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T21:34:30.721144] [INFO ] [REMOTE ] SNAP: Full fetch complete (77934 records). [2025-10-08T21:34:30.721320] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-08T21:34:31.109371] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-08T21:34:31.109484] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-08T21:34:31.110572] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-08T21:34:31.110639] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-08T21:34:31.112199] [DEBUG] [LOCAL ] SNAP: Trimmed 77934 records to 53796 (keeping 200 days of data) [2025-10-08T21:34:31.217793] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-08T21:34:31.434351] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-08T21:34:31.434502] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-08T21:34:31.434608] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNAP took 39.6s. Estimated remaining: 59m 5s. Rate: 7.1 symbols/min [2025-10-08T21:34:31.599201] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:31.644948] [DEBUG] [LOCAL ] SNV: Loaded 48867 existing records from primary storage. [2025-10-08T21:34:31.645286] [INFO ] [MAIN ] SNV: Loaded 48867 existing records. [2025-10-08T21:34:31.823306] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:31.823556] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-08T21:34:31.823608] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-08T21:34:31.823857] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-08T21:34:31.823914] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-08T21:34:32.037376] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-08T21:34:32.192243] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:32.699792] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-08T21:34:32.809786] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T21:34:32.819107] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-10-08T21:34:33.617554] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-08T21:34:34.099574] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-08T21:34:34.417526] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-08T21:34:34.599596] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:34:34.990525] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T21:34:35.217590] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-08T21:34:35.857863] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T21:34:36.017557] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-08T21:34:36.615282] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T21:34:36.817554] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-08T21:34:37.617560] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-08T21:34:38.331768] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-08T21:34:38.368188] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T21:34:38.417502] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-08T21:34:39.218220] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-08T21:34:39.223452] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T21:34:39.922365] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:34:40.017574] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-08T21:34:40.817526] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-08T21:34:40.946308] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:34:41.344305] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T21:34:41.348120] [INFO ] [REMOTE ] SNDR: Full fetch complete (59577 records). [2025-10-08T21:34:41.348260] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-08T21:34:41.622720] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-08T21:34:41.737797] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-08T21:34:41.737892] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-08T21:34:41.738830] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-08T21:34:41.738894] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-08T21:34:41.740098] [DEBUG] [LOCAL ] SNDR: Trimmed 59577 records to 41104 (keeping 200 days of data) [2025-10-08T21:34:41.991724] [DEBUG] [LOCAL ] SNDR: Primary data saved (41104 records). [2025-10-08T21:34:41.991865] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-08T21:34:41.991982] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 37.3s. Estimated remaining: 58m 57s. Rate: 7.1 symbols/min [2025-10-08T21:34:42.164164] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:42.202716] [DEBUG] [LOCAL ] SNX: Loaded 40068 existing records from primary storage. [2025-10-08T21:34:42.203098] [INFO ] [MAIN ] SNX: Loaded 40068 existing records. [2025-10-08T21:34:42.379028] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:42.379302] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-08T21:34:42.379364] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-08T21:34:42.379557] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-08T21:34:42.379614] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-08T21:34:42.442193] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-08T21:34:42.729351] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:43.202630] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-08T21:34:43.217484] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-08T21:34:43.361778] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T21:34:44.017518] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-10-08T21:34:44.085610] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:34:44.817523] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-08T21:34:45.328453] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T21:34:45.503969] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T21:34:45.617541] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-08T21:34:46.417540] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-08T21:34:46.527248] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-08T21:34:47.217510] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-08T21:34:47.338980] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T21:34:48.018813] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-08T21:34:48.024041] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T21:34:48.817543] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-08T21:34:49.591696] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:34:49.617493] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-08T21:34:49.852032] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-08T21:34:50.264674] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T21:34:50.267866] [INFO ] [REMOTE ] SNN: Full fetch complete (63047 records). [2025-10-08T21:34:50.267970] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-08T21:34:50.427139] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-08T21:34:50.661096] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-08T21:34:50.661179] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-08T21:34:50.662229] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-08T21:34:50.662294] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-08T21:34:50.663587] [DEBUG] [LOCAL ] SNN: Trimmed 63047 records to 44210 (keeping 200 days of data) [2025-10-08T21:34:50.948082] [DEBUG] [LOCAL ] SNN: Primary data saved (44210 records). [2025-10-08T21:34:50.948244] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-08T21:34:50.948387] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNN took 37.2s. Estimated remaining: 58m 49s. Rate: 7.1 symbols/min [2025-10-08T21:34:51.138003] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:34:51.192060] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T21:34:51.217506] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-08T21:34:51.218328] [DEBUG] [LOCAL ] SO: Loaded 53607 existing records from primary storage. [2025-10-08T21:34:51.219585] [INFO ] [MAIN ] SO: Loaded 53607 existing records. [2025-10-08T21:34:51.398950] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:34:51.399219] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-08T21:34:51.399288] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-08T21:34:51.399574] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-08T21:34:51.399632] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-08T21:34:51.763518] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:34:52.017560] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-10-08T21:34:52.801089] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T21:34:52.817492] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-08T21:34:52.918527] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-08T21:34:53.617518] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-08T21:34:53.844113] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-08T21:34:54.417527] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-08T21:34:54.468578] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T21:34:55.041768] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T21:34:55.217595] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-08T21:34:56.017694] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-08T21:34:56.818459] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-08T21:34:56.839480] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T21:34:56.871569] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-08T21:34:57.384346] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:34:57.617599] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-08T21:34:58.417615] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-08T21:34:59.217614] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-08T21:35:00.154094] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T21:35:00.164588] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-08T21:35:01.330836] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-08T21:35:01.335608] [INFO ] [REMOTE ] SNOW: Full fetch complete (77652 records). [2025-10-08T21:35:01.335877] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-08T21:35:01.755235] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-10-08T21:35:01.755437] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-10-08T21:35:01.756726] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-10-08T21:35:01.756869] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-10-08T21:35:01.772406] [DEBUG] [LOCAL ] SNOW: Trimmed 77652 records to 53593 (keeping 200 days of data) [2025-10-08T21:35:01.783734] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T21:35:01.886885] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-08T21:35:02.140563] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (5.32 seconds). [2025-10-08T21:35:02.182781] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-08T21:35:02.206140] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (4.59 seconds). [2025-10-08T21:35:02.212403] [INFO ] [REMOTE ] SNV: Full fetch complete (71300 records). [2025-10-08T21:35:02.213630] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-08T21:35:02.586092] [DEBUG] [LOCAL ] SNOW: Primary data saved (53593 records). [2025-10-08T21:35:02.609557] [INFO ] [MAIN ] SNOW: Full history saved. [2025-10-08T21:35:02.655543] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNOW took 46.6s. Estimated remaining: 58m 41s. Rate: 7.1 symbols/min [2025-10-08T21:35:02.655773] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-08T21:35:02.655853] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-08T21:35:02.657181] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-08T21:35:02.657290] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-08T21:35:02.781630] [DEBUG] [LOCAL ] SNV: Trimmed 71300 records to 48866 (keeping 200 days of data) [2025-10-08T21:35:02.966712] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:03.026439] [DEBUG] [LOCAL ] SOBO: Loaded 39360 existing records from primary storage. [2025-10-08T21:35:03.028605] [INFO ] [MAIN ] SOBO: Loaded 39360 existing records. [2025-10-08T21:35:03.361584] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:03.363125] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-08T21:35:03.363761] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-08T21:35:03.367397] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-08T21:35:03.367602] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-08T21:35:03.733027] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T21:35:03.796930] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-08T21:35:03.829889] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:03.832533] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-10-08T21:35:03.908152] [DEBUG] [LOCAL ] SNV: Primary data saved (48866 records). [2025-10-08T21:35:03.908452] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-08T21:35:03.908733] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNV took 32.5s. Estimated remaining: 58m 31s. Rate: 7.1 symbols/min [2025-10-08T21:35:04.048853] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-08T21:35:04.081511] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-08T21:35:04.132429] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:04.180776] [DEBUG] [LOCAL ] SOC: Loaded 50620 existing records from primary storage. [2025-10-08T21:35:04.181121] [INFO ] [MAIN ] SOC: Loaded 50620 existing records. [2025-10-08T21:35:04.365119] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:04.365419] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-08T21:35:04.365481] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-08T21:35:04.365748] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-08T21:35:04.365807] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-08T21:35:04.723957] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:04.817550] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-10-08T21:35:05.445830] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:35:05.477170] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T21:35:05.617555] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-08T21:35:06.105394] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T21:35:06.319737] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-08T21:35:06.417577] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-08T21:35:07.066321] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T21:35:07.217572] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-08T21:35:07.606896] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T21:35:08.017605] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-08T21:35:08.817691] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-08T21:35:08.881789] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T21:35:09.162639] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T21:35:09.617548] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-08T21:35:10.191385] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T21:35:10.417570] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-08T21:35:11.217514] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-08T21:35:11.246769] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T21:35:11.719875] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T21:35:11.723275] [INFO ] [REMOTE ] SNX: Full fetch complete (57278 records). [2025-10-08T21:35:11.723391] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-08T21:35:12.025227] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-08T21:35:12.124327] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-08T21:35:12.124437] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-08T21:35:12.125400] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-08T21:35:12.125473] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-08T21:35:12.126961] [DEBUG] [LOCAL ] SNX: Trimmed 57278 records to 40038 (keeping 200 days of data) [2025-10-08T21:35:12.382924] [DEBUG] [LOCAL ] SNX: Primary data saved (40038 records). [2025-10-08T21:35:12.383052] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-08T21:35:12.383151] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SNX took 30.4s. Estimated remaining: 58m 23s. Rate: 7.1 symbols/min [2025-10-08T21:35:12.548394] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:12.555396] [DEBUG] [LOCAL ] SOJC: Loaded 4996 existing records from primary storage. [2025-10-08T21:35:12.555578] [INFO ] [MAIN ] SOJC: Loaded 4996 existing records. [2025-10-08T21:35:12.731858] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:12.732243] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-08T21:35:12.732356] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-08T21:35:12.732624] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-08T21:35:12.732707] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-08T21:35:12.822013] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-08T21:35:13.091056] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:13.134107] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T21:35:13.546672] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T21:35:13.617504] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-08T21:35:14.396427] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-08T21:35:14.417487] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-08T21:35:15.068395] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T21:35:15.217499] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-08T21:35:15.756776] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T21:35:16.017566] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-08T21:35:16.817574] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-08T21:35:16.912146] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T21:35:17.235245] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T21:35:17.617560] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-10-08T21:35:18.417585] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-08T21:35:18.468281] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:35:18.543991] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T21:35:19.217590] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-08T21:35:20.017547] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-08T21:35:20.246541] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T21:35:20.417175] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-08T21:35:20.516502] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T21:35:20.817551] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-08T21:35:21.399208] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T21:35:21.617606] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-08T21:35:22.417611] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-08T21:35:23.217533] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-08T21:35:23.435320] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T21:35:24.017526] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-08T21:35:24.374905] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T21:35:24.588943] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T21:35:24.817569] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-08T21:35:25.399596] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T21:35:25.617541] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-08T21:35:25.819674] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:35:26.351856] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T21:35:26.417537] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-08T21:35:27.217610] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-08T21:35:27.888470] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T21:35:28.017521] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-08T21:35:28.817706] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-08T21:35:29.124625] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T21:35:29.209885] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T21:35:29.216446] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-08T21:35:29.617577] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-08T21:35:30.219935] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-08T21:35:30.417610] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-08T21:35:31.217602] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-08T21:35:31.877312] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-08T21:35:32.017518] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-08T21:35:32.484981] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T21:35:32.537198] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-08T21:35:32.817610] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-08T21:35:33.617625] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-08T21:35:33.972498] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T21:35:33.975875] [INFO ] [REMOTE ] SOBO: Full fetch complete (58273 records). [2025-10-08T21:35:33.976004] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-08T21:35:34.279852] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T21:35:34.313577] [INFO ] [REMOTE ] SO: Full fetch complete (77597 records). [2025-10-08T21:35:34.329539] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-08T21:35:34.419108] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-08T21:35:34.488389] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-08T21:35:34.505476] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-08T21:35:34.514747] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-08T21:35:34.518601] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-08T21:35:34.598804] [DEBUG] [LOCAL ] SOBO: Trimmed 58273 records to 39274 (keeping 200 days of data) [2025-10-08T21:35:34.919763] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-08T21:35:34.920170] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-08T21:35:34.921545] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-08T21:35:34.922382] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-08T21:35:34.927245] [DEBUG] [LOCAL ] SO: Trimmed 77597 records to 53609 (keeping 200 days of data) [2025-10-08T21:35:35.172009] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T21:35:35.236919] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-08T21:35:35.408196] [DEBUG] [LOCAL ] SOBO: Primary data saved (39274 records). [2025-10-08T21:35:35.410793] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-08T21:35:35.411970] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SOBO took 32.8s. Estimated remaining: 58m 17s. Rate: 7.1 symbols/min [2025-10-08T21:35:35.423765] [DEBUG] [LOCAL ] SO: Primary data saved (53609 records). [2025-10-08T21:35:35.423889] [INFO ] [MAIN ] SO: Full history saved. [2025-10-08T21:35:35.423976] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SO took 44.5s. Estimated remaining: 58m 7s. Rate: 7.1 symbols/min [2025-10-08T21:35:36.017613] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-08T21:35:36.505704] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T21:35:36.506548] [INFO ] [REMOTE ] SOJC: Full fetch complete (7649 records). [2025-10-08T21:35:36.506619] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-08T21:35:36.889870] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-08T21:35:36.890061] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-08T21:35:36.890386] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-08T21:35:36.890552] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-08T21:35:36.891290] [DEBUG] [LOCAL ] SOJC: Trimmed 7649 records to 4981 (keeping 200 days of data) [2025-10-08T21:35:36.952732] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T21:35:36.951312] [DEBUG] [LOCAL ] SOJC: Primary data saved (4981 records). [2025-10-08T21:35:36.952929] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-08T21:35:36.962766] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOJC took 24.6s. Estimated remaining: 57m 57s. Rate: 7.1 symbols/min [2025-10-08T21:35:36.964034] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-08T21:35:38.508245] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T21:35:38.521412] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-08T21:35:40.165468] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T21:35:40.169974] [INFO ] [REMOTE ] SOC: Full fetch complete (71745 records). [2025-10-08T21:35:40.170145] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-08T21:35:40.570550] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-08T21:35:40.570636] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-08T21:35:40.571689] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-08T21:35:40.571753] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-08T21:35:40.573198] [DEBUG] [LOCAL ] SOC: Trimmed 71745 records to 50643 (keeping 200 days of data) [2025-10-08T21:35:40.870199] [DEBUG] [LOCAL ] SOC: Primary data saved (50643 records). [2025-10-08T21:35:40.870343] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-08T21:35:40.870427] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 37.0s. Estimated remaining: 57m 48s. Rate: 7.1 symbols/min [2025-10-08T21:35:41.493124] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:41.575368] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:41.611597] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:41.646922] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:41.642260] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-08T21:35:41.647216] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-08T21:35:41.647415] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-08T21:35:41.647628] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-08T21:35:41.648779] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-08T21:35:41.648876] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-08T21:35:41.779119] [DEBUG] [LOCAL ] SOJD: Loaded 12988 existing records from primary storage. [2025-10-08T21:35:41.779488] [DEBUG] [LOCAL ] SOL: Loaded 12966 existing records from primary storage. [2025-10-08T21:35:41.780188] [DEBUG] [LOCAL ] SOJE: Loaded 9118 existing records from primary storage. [2025-10-08T21:35:41.779941] [INFO ] [MAIN ] SOJD: Loaded 12988 existing records. [2025-10-08T21:35:41.780397] [INFO ] [MAIN ] SOJE: Loaded 9118 existing records. [2025-10-08T21:35:41.785763] [INFO ] [MAIN ] SOL: Loaded 12966 existing records. [2025-10-08T21:35:42.455743] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:42.588325] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-08T21:35:42.588134] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:42.588499] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-08T21:35:42.582862] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:35:42.617483] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-08T21:35:42.620529] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-08T21:35:42.620738] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-08T21:35:42.617686] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-08T21:35:42.620464] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-08T21:35:42.626320] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-08T21:35:42.636212] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:42.646559] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-08T21:35:42.662270] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-10-08T21:35:42.662426] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-08T21:35:42.662563] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-08T21:35:42.662705] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-08T21:35:43.000570] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:35:43.057863] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-10-08T21:35:43.099569] [FATAL] [REMOTE ] SOJF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:35:43.184190] [FATAL] [MAIN ] SOJF: Failed to fetch primary data. [2025-10-08T21:35:43.235143] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:35:43.289103] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-08T21:35:43.361743] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-08T21:35:43.459874] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-08T21:35:43.506022] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-08T21:35:43.589401] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 2.7s. Estimated remaining: 57m 38s. Rate: 7.1 symbols/min [2025-10-08T21:35:43.571590] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:43.693126] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-10-08T21:35:43.828232] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:43.904579] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-10-08T21:35:44.006815] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:35:44.014040] [DEBUG] [LOCAL ] SOLV: No existing data file found in primary storage. [2025-10-08T21:35:44.036139] [WARN ] [MAIN ] SOLV: No existing data found, performing full refresh instead. [2025-10-08T21:35:44.036064] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:44.036386] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-08T21:35:44.036485] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-08T21:35:44.036802] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-10-08T21:35:44.036920] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-08T21:35:44.037868] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-08T21:35:44.447091] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:35:44.447427] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-10-08T21:35:44.960025] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T21:35:44.965242] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-08T21:35:45.044508] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:35:45.051032] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-08T21:35:45.078032] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T21:35:45.082193] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-08T21:35:45.627870] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T21:35:45.630838] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-08T21:35:45.659501] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:35:45.668523] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-08T21:35:45.742504] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-08T21:35:45.879383] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-08T21:35:46.180853] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T21:35:46.417560] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-08T21:35:47.202057] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:35:47.217977] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-08T21:35:47.221401] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T21:35:48.017559] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-08T21:35:48.051155] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T21:35:48.817604] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-08T21:35:49.488759] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-08T21:35:49.514870] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T21:35:49.617550] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-08T21:35:50.417540] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-08T21:35:50.520287] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T21:35:51.217514] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-08T21:35:51.354623] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T21:35:52.017534] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-08T21:35:52.319261] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T21:35:52.817551] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-08T21:35:53.542559] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T21:35:53.617533] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-08T21:35:53.651615] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T21:35:54.417521] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-08T21:35:54.469217] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T21:35:55.217596] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-08T21:35:56.017535] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-08T21:35:56.049995] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T21:35:56.070308] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T21:35:56.817529] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-08T21:35:57.115190] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T21:35:57.617778] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-08T21:35:58.188370] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T21:35:58.417635] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-08T21:35:58.540606] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T21:35:59.217524] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-08T21:35:59.451555] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T21:36:00.017557] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-08T21:36:00.636306] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T21:36:00.653510] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T21:36:00.817503] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-08T21:36:01.617556] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-08T21:36:01.710323] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T21:36:02.417576] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-08T21:36:02.545704] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T21:36:03.117107] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T21:36:03.217521] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-08T21:36:04.017545] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-08T21:36:04.741894] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T21:36:04.777744] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-08T21:36:04.779490] [INFO ] [REMOTE ] SOL: Full fetch complete (21386 records). [2025-10-08T21:36:04.779561] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-08T21:36:04.822749] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-08T21:36:05.145428] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-08T21:36:05.145510] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-08T21:36:05.146054] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-08T21:36:05.146117] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-08T21:36:05.146757] [DEBUG] [LOCAL ] SOL: Trimmed 21386 records to 12994 (keeping 200 days of data) [2025-10-08T21:36:05.220229] [DEBUG] [LOCAL ] SOL: Primary data saved (12994 records). [2025-10-08T21:36:05.220387] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-08T21:36:05.220475] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOL took 24.3s. Estimated remaining: 57m 32s. Rate: 7.1 symbols/min [2025-10-08T21:36:05.395207] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:05.441493] [DEBUG] [LOCAL ] SON: Loaded 43009 existing records from primary storage. [2025-10-08T21:36:05.441869] [INFO ] [MAIN ] SON: Loaded 43009 existing records. [2025-10-08T21:36:05.615159] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T21:36:05.619305] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-08T21:36:05.640987] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:05.642987] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-08T21:36:05.643107] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-08T21:36:05.643384] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-08T21:36:05.643445] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-08T21:36:06.003799] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:06.417521] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-10-08T21:36:06.536760] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T21:36:07.217566] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-08T21:36:07.809865] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-08T21:36:08.017677] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-08T21:36:08.022884] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-08T21:36:08.783865] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T21:36:08.817582] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-08T21:36:09.343426] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T21:36:09.617568] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-08T21:36:10.141543] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:36:10.142984] [INFO ] [REMOTE ] SOJD: Full fetch complete (19532 records). [2025-10-08T21:36:10.143059] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-08T21:36:10.422744] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-08T21:36:10.550128] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-08T21:36:10.550218] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-08T21:36:10.550724] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-08T21:36:10.550788] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-08T21:36:10.551482] [DEBUG] [LOCAL ] SOJD: Trimmed 19532 records to 13003 (keeping 200 days of data) [2025-10-08T21:36:10.635716] [DEBUG] [LOCAL ] SOJD: Primary data saved (13003 records). [2025-10-08T21:36:10.635878] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-08T21:36:10.635966] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 29.8s. Estimated remaining: 57m 23s. Rate: 7.1 symbols/min [2025-10-08T21:36:10.803151] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:10.863416] [DEBUG] [LOCAL ] SONY: Loaded 53373 existing records from primary storage. [2025-10-08T21:36:10.863787] [INFO ] [MAIN ] SONY: Loaded 53373 existing records. [2025-10-08T21:36:11.060009] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:11.060281] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-08T21:36:11.060341] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-08T21:36:11.060736] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-08T21:36:11.060803] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-08T21:36:11.225940] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-08T21:36:11.452936] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:12.017545] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-08T21:36:12.056023] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:36:12.156313] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:36:12.817553] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-08T21:36:13.470969] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T21:36:13.500271] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T21:36:13.617566] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-10-08T21:36:14.417598] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-08T21:36:15.060235] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T21:36:15.217528] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-08T21:36:15.255860] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T21:36:16.017580] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-08T21:36:16.308926] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T21:36:16.312242] [INFO ] [REMOTE ] SOLV: Full fetch complete (63358 records). [2025-10-08T21:36:16.312342] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-08T21:36:16.706740] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-08T21:36:16.706827] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-08T21:36:16.707936] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-08T21:36:16.708001] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-08T21:36:16.711963] [DEBUG] [LOCAL ] SOLV: Trimmed 63358 records to 43920 (keeping 200 days of data) [2025-10-08T21:36:16.817596] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-08T21:36:16.977978] [DEBUG] [LOCAL ] SOLV: Primary data saved (43920 records). [2025-10-08T21:36:16.978133] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-08T21:36:16.978212] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOLV took 33.4s. Estimated remaining: 57m 14s. Rate: 7.1 symbols/min [2025-10-08T21:36:17.150838] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:17.156261] [DEBUG] [LOCAL ] SOR: Loaded 2872 existing records from primary storage. [2025-10-08T21:36:17.156466] [INFO ] [MAIN ] SOR: Loaded 2872 existing records. [2025-10-08T21:36:17.279957] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T21:36:17.364614] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:17.364863] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-08T21:36:17.364909] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-08T21:36:17.365136] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-08T21:36:17.365193] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-08T21:36:17.622776] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-08T21:36:17.721015] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:18.222314] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:36:18.223447] [INFO ] [REMOTE ] SOJE: Full fetch complete (14006 records). [2025-10-08T21:36:18.223515] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-08T21:36:18.427164] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-08T21:36:18.600709] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-08T21:36:18.600810] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-08T21:36:18.601174] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-08T21:36:18.601317] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-08T21:36:18.602021] [DEBUG] [LOCAL ] SOJE: Trimmed 14006 records to 9072 (keeping 200 days of data) [2025-10-08T21:36:18.681305] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T21:36:18.706562] [DEBUG] [LOCAL ] SOJE: Primary data saved (9072 records). [2025-10-08T21:36:18.706688] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-08T21:36:18.706809] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SOJE took 37.8s. Estimated remaining: 57m 5s. Rate: 7.1 symbols/min [2025-10-08T21:36:18.872432] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:18.884461] [DEBUG] [LOCAL ] SOS: Loaded 9086 existing records from primary storage. [2025-10-08T21:36:18.884719] [INFO ] [MAIN ] SOS: Loaded 9086 existing records. [2025-10-08T21:36:19.060771] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:19.061016] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-08T21:36:19.061070] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-08T21:36:19.061228] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-08T21:36:19.061294] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-08T21:36:19.219174] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-08T21:36:19.429843] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:20.017608] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-10-08T21:36:20.062030] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T21:36:20.817631] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-08T21:36:21.200519] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T21:36:21.379827] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-08T21:36:21.617601] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-08T21:36:22.014624] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T21:36:22.417619] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-08T21:36:23.217602] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-10-08T21:36:23.365597] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T21:36:23.703327] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T21:36:24.014270] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T21:36:24.022680] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-08T21:36:24.392675] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-08T21:36:24.817582] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-08T21:36:25.472515] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-08T21:36:25.617623] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-08T21:36:26.417601] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-08T21:36:26.996145] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T21:36:27.217525] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-08T21:36:27.629338] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-08T21:36:27.742805] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-08T21:36:28.017576] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-08T21:36:28.346845] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-08T21:36:28.817691] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-08T21:36:29.617624] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-08T21:36:30.417519] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-08T21:36:30.737184] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T21:36:30.904896] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T21:36:31.034672] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T21:36:31.217549] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-08T21:36:31.802619] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T21:36:32.017577] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-08T21:36:32.461604] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T21:36:32.817534] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-08T21:36:33.241970] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T21:36:33.617522] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-08T21:36:34.189714] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T21:36:34.417583] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-08T21:36:34.891159] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T21:36:35.217572] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-08T21:36:35.679703] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T21:36:36.017584] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-08T21:36:36.618602] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T21:36:36.817546] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-08T21:36:37.296928] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T21:36:37.617568] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-08T21:36:38.417592] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-08T21:36:38.772705] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T21:36:38.806277] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-08T21:36:39.217588] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-08T21:36:40.017586] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-08T21:36:40.409444] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T21:36:40.410473] [INFO ] [REMOTE ] SOR: Full fetch complete (4397 records). [2025-10-08T21:36:40.410547] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-08T21:36:40.790229] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-08T21:36:40.790322] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-08T21:36:40.790478] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-08T21:36:40.790538] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-08T21:36:40.790936] [DEBUG] [LOCAL ] SOR: Trimmed 4397 records to 2879 (keeping 200 days of data) [2025-10-08T21:36:40.809071] [DEBUG] [LOCAL ] SOR: Primary data saved (2879 records). [2025-10-08T21:36:40.809165] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-08T21:36:40.809263] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOR took 23.8s. Estimated remaining: 56m 59s. Rate: 7.1 symbols/min [2025-10-08T21:36:40.822635] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-08T21:36:40.987032] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:41.024905] [DEBUG] [LOCAL ] SPB: Loaded 34229 existing records from primary storage. [2025-10-08T21:36:41.025244] [INFO ] [MAIN ] SPB: Loaded 34229 existing records. [2025-10-08T21:36:41.217761] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:41.218083] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-08T21:36:41.218164] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-08T21:36:41.218494] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-08T21:36:41.218558] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-08T21:36:41.440347] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-08T21:36:41.617547] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-08T21:36:41.656523] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:41.669062] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T21:36:42.417567] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-08T21:36:43.217526] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-08T21:36:43.414712] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T21:36:43.474706] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T21:36:44.017597] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-10-08T21:36:44.817586] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-08T21:36:45.224057] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T21:36:45.256084] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T21:36:45.617595] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-08T21:36:45.871400] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T21:36:45.872982] [INFO ] [REMOTE ] SOS: Full fetch complete (11155 records). [2025-10-08T21:36:45.873054] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-08T21:36:46.233044] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-08T21:36:46.233124] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-08T21:36:46.233414] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-08T21:36:46.233453] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-08T21:36:46.233950] [DEBUG] [LOCAL ] SOS: Trimmed 11155 records to 9141 (keeping 200 days of data) [2025-10-08T21:36:46.286722] [DEBUG] [LOCAL ] SOS: Primary data saved (9141 records). [2025-10-08T21:36:46.286862] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-08T21:36:46.286950] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SOS took 27.6s. Estimated remaining: 56m 50s. Rate: 7.1 symbols/min [2025-10-08T21:36:46.427878] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-08T21:36:46.460355] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:46.510955] [DEBUG] [LOCAL ] SPCE: Loaded 49928 existing records from primary storage. [2025-10-08T21:36:46.511280] [INFO ] [MAIN ] SPCE: Loaded 49928 existing records. [2025-10-08T21:36:46.690607] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:46.690871] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-08T21:36:46.690920] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-08T21:36:46.691150] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-08T21:36:46.691206] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-08T21:36:47.071121] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:47.217631] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-08T21:36:47.670598] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T21:36:47.745562] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T21:36:48.017599] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-08T21:36:48.732108] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T21:36:48.817541] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-08T21:36:49.617555] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-10-08T21:36:49.680549] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:36:50.049809] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-08T21:36:50.417602] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-08T21:36:51.217682] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-08T21:36:51.630462] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T21:36:51.842324] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T21:36:52.017631] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-08T21:36:52.817555] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-08T21:36:52.932906] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-08T21:36:52.936971] [INFO ] [REMOTE ] SONY: Full fetch complete (77240 records). [2025-10-08T21:36:52.937159] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-08T21:36:53.363184] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-08T21:36:53.363271] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-08T21:36:53.364325] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-08T21:36:53.364392] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-08T21:36:53.365936] [DEBUG] [LOCAL ] SONY: Trimmed 77240 records to 53369 (keeping 200 days of data) [2025-10-08T21:36:53.619740] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-08T21:36:53.755026] [DEBUG] [LOCAL ] SONY: Primary data saved (53369 records). [2025-10-08T21:36:53.755317] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-08T21:36:53.756369] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SONY took 43.1s. Estimated remaining: 56m 41s. Rate: 7.1 symbols/min [2025-10-08T21:36:53.938619] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:53.983462] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T21:36:54.003967] [DEBUG] [LOCAL ] SPE: Loaded 6284 existing records from primary storage. [2025-10-08T21:36:54.004252] [INFO ] [MAIN ] SPE: Loaded 6284 existing records. [2025-10-08T21:36:54.186872] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:54.187181] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-08T21:36:54.187322] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-08T21:36:54.187620] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-08T21:36:54.187754] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-08T21:36:54.421615] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-08T21:36:54.542022] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-08T21:36:54.624208] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:55.039123] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T21:36:55.217579] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-08T21:36:56.017593] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-08T21:36:56.403616] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T21:36:56.476118] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T21:36:56.817587] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-08T21:36:57.243247] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:36:57.247387] [INFO ] [REMOTE ] SON: Full fetch complete (62432 records). [2025-10-08T21:36:57.247515] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-08T21:36:57.623877] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-10-08T21:36:57.662386] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-08T21:36:57.662497] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-08T21:36:57.663582] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-08T21:36:57.663811] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-08T21:36:57.665494] [DEBUG] [LOCAL ] SON: Trimmed 62432 records to 43020 (keeping 200 days of data) [2025-10-08T21:36:57.927024] [DEBUG] [LOCAL ] SON: Primary data saved (43020 records). [2025-10-08T21:36:57.927162] [INFO ] [MAIN ] SON: Full history saved. [2025-10-08T21:36:57.927260] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SON took 52.7s. Estimated remaining: 56m 32s. Rate: 7.1 symbols/min [2025-10-08T21:36:58.094517] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:36:58.143922] [DEBUG] [LOCAL ] SPG: Loaded 50253 existing records from primary storage. [2025-10-08T21:36:58.144249] [INFO ] [MAIN ] SPG: Loaded 50253 existing records. [2025-10-08T21:36:58.336362] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:36:58.336942] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-08T21:36:58.337051] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-08T21:36:58.337481] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-08T21:36:58.337570] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-08T21:36:58.427823] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-08T21:36:58.476271] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:36:58.770635] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T21:36:58.776788] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:36:59.217580] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-08T21:36:59.774165] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:37:00.005901] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T21:37:00.017503] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-08T21:37:00.817554] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-08T21:37:00.949959] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T21:37:01.617577] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-08T21:37:01.956364] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T21:37:02.417583] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-10-08T21:37:03.102935] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:37:03.217513] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-08T21:37:04.017548] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-08T21:37:04.217378] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T21:37:04.797201] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T21:37:04.817502] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-08T21:37:05.456875] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-08T21:37:05.584218] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T21:37:05.617574] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-08T21:37:06.417588] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-08T21:37:07.217580] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-08T21:37:07.706528] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T21:37:07.822874] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T21:37:08.017558] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-08T21:37:08.817609] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-08T21:37:08.948051] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T21:37:09.008607] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T21:37:09.617597] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-08T21:37:10.417563] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-08T21:37:10.962175] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-08T21:37:11.217630] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-08T21:37:11.341836] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T21:37:11.481250] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T21:37:11.483876] [INFO ] [REMOTE ] SPB: Full fetch complete (47519 records). [2025-10-08T21:37:11.483985] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-08T21:37:11.926963] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-08T21:37:11.927222] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T21:37:11.927519] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-08T21:37:11.928818] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-08T21:37:11.930530] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-08T21:37:11.932873] [DEBUG] [LOCAL ] SPB: Trimmed 47519 records to 34211 (keeping 200 days of data) [2025-10-08T21:37:12.023365] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-08T21:37:12.163936] [DEBUG] [LOCAL ] SPB: Primary data saved (34211 records). [2025-10-08T21:37:12.164097] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-08T21:37:12.164184] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SPB took 31.4s. Estimated remaining: 56m 25s. Rate: 7.1 symbols/min [2025-10-08T21:37:12.373051] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:12.413704] [DEBUG] [LOCAL ] SPGI: Loaded 45765 existing records from primary storage. [2025-10-08T21:37:12.414033] [INFO ] [MAIN ] SPGI: Loaded 45765 existing records. [2025-10-08T21:37:12.589206] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:37:12.589433] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-08T21:37:12.589480] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-08T21:37:12.589783] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-08T21:37:12.589842] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-08T21:37:12.827397] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-08T21:37:12.946749] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:37:13.617571] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-08T21:37:14.101854] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T21:37:14.280336] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T21:37:14.417500] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-08T21:37:14.809502] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-08T21:37:15.175894] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:37:15.217609] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-08T21:37:15.910976] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T21:37:16.017528] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-08T21:37:16.817597] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-08T21:37:17.328133] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-08T21:37:17.617562] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-08T21:37:17.915757] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T21:37:18.417634] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-08T21:37:18.908367] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T21:37:18.909692] [INFO ] [REMOTE ] SPE: Full fetch complete (9875 records). [2025-10-08T21:37:18.909763] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-08T21:37:19.222625] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-10-08T21:37:19.287553] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-08T21:37:19.287635] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-08T21:37:19.287931] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-08T21:37:19.287978] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-08T21:37:19.288402] [DEBUG] [LOCAL ] SPE: Trimmed 9875 records to 6289 (keeping 200 days of data) [2025-10-08T21:37:19.326903] [DEBUG] [LOCAL ] SPE: Primary data saved (6289 records). [2025-10-08T21:37:19.327014] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-08T21:37:19.327100] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPE took 25.6s. Estimated remaining: 56m 16s. Rate: 7.1 symbols/min [2025-10-08T21:37:19.505559] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:19.527285] [DEBUG] [LOCAL ] SPH: Loaded 17016 existing records from primary storage. [2025-10-08T21:37:19.527556] [INFO ] [MAIN ] SPH: Loaded 17016 existing records. [2025-10-08T21:37:19.720747] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:37:19.721353] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-08T21:37:19.721425] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-08T21:37:19.721942] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-08T21:37:19.722064] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-08T21:37:19.860030] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-08T21:37:20.022739] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-08T21:37:20.118543] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:37:20.817533] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-10-08T21:37:20.969779] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T21:37:21.617510] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-08T21:37:21.894174] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T21:37:21.965841] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-08T21:37:22.417583] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-08T21:37:23.217532] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-08T21:37:23.242545] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T21:37:23.246548] [INFO ] [REMOTE ] SPCE: Full fetch complete (72416 records). [2025-10-08T21:37:23.246698] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-08T21:37:23.652209] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-08T21:37:23.652309] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-08T21:37:23.653685] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-08T21:37:23.653780] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-08T21:37:23.655811] [DEBUG] [LOCAL ] SPCE: Trimmed 72416 records to 49933 (keeping 200 days of data) [2025-10-08T21:37:23.954224] [DEBUG] [LOCAL ] SPCE: Primary data saved (49933 records). [2025-10-08T21:37:23.954491] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-08T21:37:23.954712] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 37.7s. Estimated remaining: 56m 7s. Rate: 7.1 symbols/min [2025-10-08T21:37:24.033820] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-08T21:37:24.143976] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:24.181379] [DEBUG] [LOCAL ] SPHR: Loaded 40260 existing records from primary storage. [2025-10-08T21:37:24.181720] [INFO ] [MAIN ] SPHR: Loaded 40260 existing records. [2025-10-08T21:37:24.361758] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-08T21:37:24.392514] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:37:24.403342] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-08T21:37:24.403411] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-08T21:37:24.403712] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-08T21:37:24.403773] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-08T21:37:24.785453] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:37:24.814374] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T21:37:24.824718] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-10-08T21:37:25.170065] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T21:37:25.617622] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-08T21:37:26.074601] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T21:37:26.417586] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-08T21:37:27.217607] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-08T21:37:27.926157] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-08T21:37:28.017552] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-08T21:37:28.083375] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T21:37:28.345011] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T21:37:28.817595] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-08T21:37:29.617633] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-08T21:37:29.793846] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T21:37:30.417586] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-08T21:37:30.962024] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T21:37:31.042566] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:37:31.217549] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-08T21:37:31.998931] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T21:37:32.017497] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-08T21:37:32.487262] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T21:37:32.817568] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-08T21:37:33.522223] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T21:37:33.526411] [INFO ] [REMOTE ] SPG: Full fetch complete (71976 records). [2025-10-08T21:37:33.526573] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-08T21:37:33.622780] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-08T21:37:34.002396] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-08T21:37:34.002530] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-08T21:37:34.003854] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-08T21:37:34.003934] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-08T21:37:34.005746] [DEBUG] [LOCAL ] SPG: Trimmed 71976 records to 50240 (keeping 200 days of data) [2025-10-08T21:37:34.367940] [DEBUG] [LOCAL ] SPG: Primary data saved (50240 records). [2025-10-08T21:37:34.368090] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-08T21:37:34.369736] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPG took 36.4s. Estimated remaining: 55m 59s. Rate: 7.1 symbols/min [2025-10-08T21:37:34.418844] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-08T21:37:34.603975] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:34.606956] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T21:37:34.655611] [DEBUG] [LOCAL ] SPIR: Loaded 37275 existing records from primary storage. [2025-10-08T21:37:34.655958] [INFO ] [MAIN ] SPIR: Loaded 37275 existing records. [2025-10-08T21:37:34.874599] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:37:34.874846] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-08T21:37:34.874895] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-08T21:37:34.875131] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-08T21:37:34.875189] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-08T21:37:35.222789] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-08T21:37:35.319919] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:37:35.354921] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T21:37:35.382000] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-08T21:37:36.017565] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-08T21:37:36.523013] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T21:37:36.817560] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-10-08T21:37:37.423242] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:37:37.617562] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-08T21:37:38.005456] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T21:37:38.417529] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-08T21:37:38.626694] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:37:39.217573] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-08T21:37:39.708604] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-08T21:37:40.017580] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-08T21:37:40.266376] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T21:37:40.817561] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-08T21:37:41.490894] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T21:37:41.617496] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-08T21:37:41.977417] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T21:37:42.417593] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-08T21:37:43.082117] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T21:37:43.217578] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-08T21:37:43.854721] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T21:37:44.017560] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-08T21:37:44.696866] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T21:37:44.715354] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T21:37:44.817514] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-08T21:37:45.617542] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-08T21:37:46.417546] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-08T21:37:46.461159] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T21:37:46.841115] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T21:37:47.217610] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-08T21:37:47.770879] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T21:37:47.774738] [INFO ] [REMOTE ] SPGI: Full fetch complete (67080 records). [2025-10-08T21:37:47.774857] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-08T21:37:47.912674] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T21:37:48.027111] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-08T21:37:48.197278] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-08T21:37:48.197363] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-08T21:37:48.198372] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-08T21:37:48.198438] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-08T21:37:48.200124] [DEBUG] [LOCAL ] SPGI: Trimmed 67080 records to 45763 (keeping 200 days of data) [2025-10-08T21:37:48.500199] [DEBUG] [LOCAL ] SPGI: Primary data saved (45763 records). [2025-10-08T21:37:48.500354] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-08T21:37:48.500448] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPGI took 36.3s. Estimated remaining: 55m 52s. Rate: 7.1 symbols/min [2025-10-08T21:37:48.672074] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:48.680773] [DEBUG] [LOCAL ] SPMC: Loaded 5333 existing records from primary storage. [2025-10-08T21:37:48.681084] [INFO ] [MAIN ] SPMC: Loaded 5333 existing records. [2025-10-08T21:37:48.822596] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-08T21:37:48.907106] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:37:48.907343] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-08T21:37:48.907407] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-08T21:37:48.907580] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-08T21:37:48.907639] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-08T21:37:49.307722] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:37:49.520373] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T21:37:49.617571] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-08T21:37:50.419616] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-10-08T21:37:50.422504] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T21:37:50.803432] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-08T21:37:51.040321] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T21:37:51.217592] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-08T21:37:51.787494] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T21:37:52.017551] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-08T21:37:52.747808] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T21:37:52.817555] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-08T21:37:53.624402] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-08T21:37:53.628592] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T21:37:54.417578] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-08T21:37:55.217592] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-08T21:37:55.285370] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:37:55.536363] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T21:37:55.965721] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T21:37:56.017546] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-08T21:37:56.506667] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-08T21:37:56.817612] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-08T21:37:57.617557] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-08T21:37:58.214079] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T21:37:58.217605] [INFO ] [REMOTE ] SPHR: Full fetch complete (58032 records). [2025-10-08T21:37:58.217836] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-08T21:37:58.417740] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-08T21:37:58.602999] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-08T21:37:58.603097] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-08T21:37:58.604034] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-08T21:37:58.604097] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-08T21:37:58.605321] [DEBUG] [LOCAL ] SPHR: Trimmed 58032 records to 40341 (keeping 200 days of data) [2025-10-08T21:37:58.838723] [DEBUG] [LOCAL ] SPHR: Primary data saved (40341 records). [2025-10-08T21:37:58.838847] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-08T21:37:58.838924] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPHR took 34.9s. Estimated remaining: 55m 43s. Rate: 7.1 symbols/min [2025-10-08T21:37:59.011712] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:37:59.011912] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-08T21:37:59.012043] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-08T21:37:59.012126] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-08T21:37:59.012164] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-08T21:37:59.012204] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-08T21:37:59.012235] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-08T21:37:59.239618] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T21:37:59.219000] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-08T21:37:59.274122] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T21:37:59.439003] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:00.017770] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-08T21:38:00.278315] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T21:38:00.416751] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-08T21:38:00.817561] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-08T21:38:01.423147] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-08T21:38:01.617542] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-08T21:38:02.281994] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-08T21:38:02.417559] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-08T21:38:03.036284] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T21:38:03.217549] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-08T21:38:03.724827] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-08T21:38:03.725777] [INFO ] [REMOTE ] SPMC: Full fetch complete (8091 records). [2025-10-08T21:38:03.725849] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-08T21:38:04.022638] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-08T21:38:04.099224] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-08T21:38:04.099306] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-08T21:38:04.099558] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-08T21:38:04.099619] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-08T21:38:04.100122] [DEBUG] [LOCAL ] SPMC: Trimmed 8091 records to 5333 (keeping 200 days of data) [2025-10-08T21:38:04.137102] [DEBUG] [LOCAL ] SPMC: Primary data saved (5333 records). [2025-10-08T21:38:04.137263] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-08T21:38:04.137356] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPMC took 15.6s. Estimated remaining: 55m 34s. Rate: 7.1 symbols/min [2025-10-08T21:38:04.322344] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:04.357831] [DEBUG] [LOCAL ] SPNT: Loaded 34803 existing records from primary storage. [2025-10-08T21:38:04.358124] [INFO ] [MAIN ] SPNT: Loaded 34803 existing records. [2025-10-08T21:38:04.540231] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:04.540496] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-08T21:38:04.540542] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-08T21:38:04.540807] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-08T21:38:04.540864] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-08T21:38:04.822730] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-08T21:38:04.891874] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:05.605812] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T21:38:05.607925] [INFO ] [REMOTE ] SPH: Full fetch complete (28082 records). [2025-10-08T21:38:05.608053] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-08T21:38:05.622756] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-10-08T21:38:05.916031] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:38:05.952149] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:38:05.963469] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-10-08T21:38:05.964363] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:38:05.964463] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-08T21:38:05.964555] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:38:05.964680] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-08T21:38:05.976170] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-08T21:38:05.976274] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-08T21:38:05.986630] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-08T21:38:05.997025] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPME took 7.2s. Estimated remaining: 55m 25s. Rate: 7.1 symbols/min [2025-10-08T21:38:06.191077] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-08T21:38:06.191529] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-08T21:38:06.198047] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-08T21:38:06.218749] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-08T21:38:06.263283] [DEBUG] [LOCAL ] SPH: Trimmed 28082 records to 16887 (keeping 200 days of data) [2025-10-08T21:38:06.266354] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:06.395537] [DEBUG] [LOCAL ] SPH: Primary data saved (16887 records). [2025-10-08T21:38:06.395795] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-08T21:38:06.395895] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPH took 47.1s. Estimated remaining: 55m 15s. Rate: 7.1 symbols/min [2025-10-08T21:38:06.426044] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-10-08T21:38:06.566713] [DEBUG] [LOCAL ] SPOT: Loaded 50482 existing records from primary storage. [2025-10-08T21:38:06.606303] [INFO ] [MAIN ] SPOT: Loaded 50482 existing records. [2025-10-08T21:38:06.703878] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:06.811224] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:06.811530] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-08T21:38:06.811662] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-08T21:38:06.812433] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-10-08T21:38:06.812492] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-08T21:38:07.015048] [DEBUG] [LOCAL ] SPR: Loaded 41108 existing records from primary storage. [2025-10-08T21:38:07.088530] [INFO ] [MAIN ] SPR: Loaded 41108 existing records. [2025-10-08T21:38:07.218255] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-08T21:38:07.369973] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:07.401043] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:07.401997] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-08T21:38:07.402048] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-08T21:38:07.402332] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-08T21:38:07.402388] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-08T21:38:07.783345] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:07.804936] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T21:38:08.017564] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-10-08T21:38:08.385708] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T21:38:08.817558] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-10-08T21:38:09.617680] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-08T21:38:09.663797] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:38:10.417611] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-08T21:38:10.778736] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-08T21:38:11.173206] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T21:38:11.217536] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-08T21:38:11.604406] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T21:38:12.017624] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-08T21:38:12.726103] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T21:38:12.817544] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-08T21:38:13.534149] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T21:38:13.617586] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-08T21:38:13.840854] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T21:38:14.417573] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-08T21:38:14.687171] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:38:15.217705] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-08T21:38:15.996094] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T21:38:16.017491] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-08T21:38:16.817576] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-08T21:38:16.914461] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T21:38:17.478137] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T21:38:17.617572] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-08T21:38:17.853522] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T21:38:17.857431] [INFO ] [REMOTE ] SPIR: Full fetch complete (53361 records). [2025-10-08T21:38:17.857591] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-08T21:38:18.245252] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-08T21:38:18.245351] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-08T21:38:18.246327] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-08T21:38:18.246394] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-08T21:38:18.247762] [DEBUG] [LOCAL ] SPIR: Trimmed 53361 records to 37392 (keeping 200 days of data) [2025-10-08T21:38:18.421758] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-08T21:38:18.481763] [DEBUG] [LOCAL ] SPIR: Primary data saved (37392 records). [2025-10-08T21:38:18.481958] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-08T21:38:18.482075] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 44.1s. Estimated remaining: 55m 7s. Rate: 7.1 symbols/min [2025-10-08T21:38:18.653842] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:18.666158] [DEBUG] [LOCAL ] SPRU: Loaded 9437 existing records from primary storage. [2025-10-08T21:38:18.666401] [INFO ] [MAIN ] SPRU: Loaded 9437 existing records. [2025-10-08T21:38:18.848764] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:18.849079] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-08T21:38:18.849141] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-08T21:38:18.849326] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-08T21:38:18.849383] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-08T21:38:19.211872] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:19.217504] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-10-08T21:38:19.250410] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-08T21:38:20.017573] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-08T21:38:20.078479] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T21:38:20.096879] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T21:38:20.817723] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-08T21:38:21.617622] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-08T21:38:22.073117] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-08T21:38:22.414628] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-08T21:38:22.427078] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-08T21:38:22.450579] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T21:38:23.217537] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-08T21:38:24.017584] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-08T21:38:24.444957] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T21:38:24.476278] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-08T21:38:24.569130] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-08T21:38:24.817564] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-08T21:38:25.617559] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-08T21:38:26.417574] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-08T21:38:26.999964] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T21:38:27.025825] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:38:27.217508] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-08T21:38:27.274305] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-08T21:38:28.017604] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-08T21:38:28.537845] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T21:38:28.817564] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-08T21:38:29.169288] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-08T21:38:29.617564] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-08T21:38:29.937456] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T21:38:30.353432] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-08T21:38:30.417537] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-08T21:38:31.211173] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T21:38:31.217545] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-08T21:38:32.017566] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-08T21:38:32.817604] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-08T21:38:33.454547] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T21:38:33.540813] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T21:38:33.617571] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-08T21:38:34.182065] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T21:38:34.417572] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-08T21:38:35.217636] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-08T21:38:35.487118] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-08T21:38:35.753537] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T21:38:36.017560] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-08T21:38:36.475777] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T21:38:36.817553] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-08T21:38:37.617532] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-08T21:38:37.978198] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T21:38:37.980992] [INFO ] [REMOTE ] SPNT: Full fetch complete (48961 records). [2025-10-08T21:38:37.981095] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-08T21:38:38.287067] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T21:38:38.390510] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-08T21:38:38.390610] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-08T21:38:38.391547] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-08T21:38:38.391628] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-08T21:38:38.419167] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-08T21:38:38.403702] [DEBUG] [LOCAL ] SPNT: Trimmed 48961 records to 34716 (keeping 200 days of data) [2025-10-08T21:38:38.426575] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-08T21:38:38.648345] [DEBUG] [LOCAL ] SPNT: Primary data saved (34716 records). [2025-10-08T21:38:38.648510] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-08T21:38:38.648665] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 34.5s. Estimated remaining: 55m 1s. Rate: 7.1 symbols/min [2025-10-08T21:38:38.825772] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:38.850171] [DEBUG] [LOCAL ] SPXC: Loaded 23293 existing records from primary storage. [2025-10-08T21:38:38.850448] [INFO ] [MAIN ] SPXC: Loaded 23293 existing records. [2025-10-08T21:38:39.034586] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:39.034837] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-08T21:38:39.034884] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-08T21:38:39.035151] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-08T21:38:39.035207] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-08T21:38:39.223738] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-08T21:38:39.411966] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:39.716436] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T21:38:39.719898] [INFO ] [REMOTE ] SPR: Full fetch complete (60103 records). [2025-10-08T21:38:39.720021] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-08T21:38:40.026196] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-08T21:38:40.135103] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-08T21:38:40.135197] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-08T21:38:40.136247] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-08T21:38:40.136334] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-08T21:38:40.137618] [DEBUG] [LOCAL ] SPR: Trimmed 60103 records to 41057 (keeping 200 days of data) [2025-10-08T21:38:40.386534] [DEBUG] [LOCAL ] SPR: Primary data saved (41057 records). [2025-10-08T21:38:40.386693] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-08T21:38:40.387492] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPR took 34.0s. Estimated remaining: 54m 51s. Rate: 7.1 symbols/min [2025-10-08T21:38:40.562573] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:40.581451] [DEBUG] [LOCAL ] SPXX: Loaded 9407 existing records from primary storage. [2025-10-08T21:38:40.581765] [INFO ] [MAIN ] SPXX: Loaded 9407 existing records. [2025-10-08T21:38:40.780147] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:40.780466] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-08T21:38:40.780520] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-08T21:38:40.780761] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-08T21:38:40.780820] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-08T21:38:40.823886] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-10-08T21:38:41.039761] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T21:38:41.200761] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:41.231802] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T21:38:41.617602] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-08T21:38:42.031758] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:38:42.340368] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T21:38:42.417547] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-08T21:38:42.988824] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T21:38:43.217566] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-08T21:38:43.858777] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-08T21:38:43.860499] [INFO ] [REMOTE ] SPRU: Full fetch complete (11894 records). [2025-10-08T21:38:43.860610] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-08T21:38:44.030736] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-08T21:38:44.221605] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-08T21:38:44.221725] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-08T21:38:44.222016] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-08T21:38:44.222075] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-08T21:38:44.222731] [DEBUG] [LOCAL ] SPRU: Trimmed 11894 records to 9534 (keeping 200 days of data) [2025-10-08T21:38:44.277041] [DEBUG] [LOCAL ] SPRU: Primary data saved (9534 records). [2025-10-08T21:38:44.277194] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-08T21:38:44.277280] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 25.8s. Estimated remaining: 54m 42s. Rate: 7.1 symbols/min [2025-10-08T21:38:44.473090] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:38:44.519081] [DEBUG] [LOCAL ] SQM: Loaded 48616 existing records from primary storage. [2025-10-08T21:38:44.519446] [INFO ] [MAIN ] SQM: Loaded 48616 existing records. [2025-10-08T21:38:44.698708] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:38:44.698935] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-08T21:38:44.699015] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-08T21:38:44.699311] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-08T21:38:44.699372] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-08T21:38:44.822634] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-10-08T21:38:45.078052] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:38:45.240443] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:38:45.527513] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T21:38:45.617607] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-08T21:38:46.417550] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-08T21:38:46.490028] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T21:38:47.046143] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T21:38:47.217571] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-10-08T21:38:48.017562] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-08T21:38:48.817512] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-08T21:38:48.860139] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T21:38:49.129609] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T21:38:49.617558] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-08T21:38:50.417583] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-08T21:38:50.755414] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T21:38:50.897200] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T21:38:51.217597] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-08T21:38:51.735720] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T21:38:52.010177] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T21:38:52.017505] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-08T21:38:52.817588] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-08T21:38:53.050070] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T21:38:53.617562] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-08T21:38:54.408559] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T21:38:54.417485] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-08T21:38:54.556715] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:38:55.161949] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T21:38:55.217580] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-08T21:38:55.693520] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T21:38:56.017576] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-08T21:38:56.817618] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-08T21:38:57.432192] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T21:38:57.555266] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T21:38:57.617549] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-08T21:38:58.417531] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-08T21:38:59.217561] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-08T21:38:59.519126] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-08T21:38:59.524324] [INFO ] [REMOTE ] SPOT: Full fetch complete (73677 records). [2025-10-08T21:38:59.524568] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-08T21:38:59.929871] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T21:38:59.975703] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-10-08T21:38:59.975941] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-10-08T21:38:59.977283] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-10-08T21:38:59.977383] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-10-08T21:38:59.979113] [DEBUG] [LOCAL ] SPOT: Trimmed 73677 records to 50455 (keeping 200 days of data) [2025-10-08T21:39:00.044540] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-08T21:39:00.137568] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T21:39:00.373137] [DEBUG] [LOCAL ] SPOT: Primary data saved (50455 records). [2025-10-08T21:39:00.373303] [INFO ] [MAIN ] SPOT: Full history saved. [2025-10-08T21:39:00.373437] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPOT took 54.4s. Estimated remaining: 54m 35s. Rate: 7.1 symbols/min [2025-10-08T21:39:00.547048] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:00.574182] [DEBUG] [LOCAL ] SQNS: Loaded 26867 existing records from primary storage. [2025-10-08T21:39:00.574479] [INFO ] [MAIN ] SQNS: Loaded 26867 existing records. [2025-10-08T21:39:00.764500] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:00.764938] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-08T21:39:00.765009] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-08T21:39:00.765245] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-08T21:39:00.765339] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-08T21:39:00.829154] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-08T21:39:01.130764] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:01.377941] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T21:39:01.617603] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-08T21:39:01.678326] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T21:39:02.417551] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-10-08T21:39:02.563710] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-08T21:39:03.217553] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-08T21:39:03.408407] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T21:39:03.767623] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-08T21:39:04.017554] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-08T21:39:04.817547] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-08T21:39:05.095979] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-08T21:39:05.098023] [INFO ] [REMOTE ] SPXC: Full fetch complete (34133 records). [2025-10-08T21:39:05.098334] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-08T21:39:05.422015] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T21:39:05.556570] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-08T21:39:05.556723] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-08T21:39:05.558175] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-08T21:39:05.558244] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-08T21:39:05.559564] [DEBUG] [LOCAL ] SPXC: Trimmed 34133 records to 23256 (keeping 200 days of data) [2025-10-08T21:39:05.629065] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-08T21:39:05.727736] [DEBUG] [LOCAL ] SPXC: Primary data saved (23256 records). [2025-10-08T21:39:05.727925] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-08T21:39:05.728031] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPXC took 27.1s. Estimated remaining: 54m 26s. Rate: 7.1 symbols/min [2025-10-08T21:39:05.922627] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:05.960899] [DEBUG] [LOCAL ] SR: Loaded 32712 existing records from primary storage. [2025-10-08T21:39:05.961394] [INFO ] [MAIN ] SR: Loaded 32712 existing records. [2025-10-08T21:39:06.160760] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:06.161177] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-08T21:39:06.161252] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-08T21:39:06.161589] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-08T21:39:06.161695] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-08T21:39:06.422790] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-08T21:39:06.581943] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:06.591900] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-08T21:39:07.217583] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-08T21:39:08.020779] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-08T21:39:08.021767] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T21:39:08.025384] [INFO ] [REMOTE ] SPXX: Full fetch complete (13299 records). [2025-10-08T21:39:08.025519] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-08T21:39:08.152537] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T21:39:08.417699] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-08T21:39:08.417788] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-08T21:39:08.418068] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-08T21:39:08.418106] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-08T21:39:08.418556] [DEBUG] [LOCAL ] SPXX: Trimmed 13299 records to 9456 (keeping 200 days of data) [2025-10-08T21:39:08.474904] [DEBUG] [LOCAL ] SPXX: Primary data saved (9456 records). [2025-10-08T21:39:08.475044] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-08T21:39:08.475152] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 28.1s. Estimated remaining: 54m 16s. Rate: 7.1 symbols/min [2025-10-08T21:39:08.644608] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:08.705232] [DEBUG] [LOCAL ] SRE: Loaded 53416 existing records from primary storage. [2025-10-08T21:39:08.705607] [INFO ] [MAIN ] SRE: Loaded 53416 existing records. [2025-10-08T21:39:08.822702] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-10-08T21:39:08.885961] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:08.886134] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-08T21:39:08.886179] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-08T21:39:08.886612] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-08T21:39:08.886697] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-08T21:39:09.168958] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T21:39:09.251579] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:09.617585] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-08T21:39:10.022318] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-08T21:39:10.417580] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-08T21:39:11.217595] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-08T21:39:11.322328] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T21:39:11.333332] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-08T21:39:12.017700] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-08T21:39:12.513111] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-08T21:39:12.817566] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-08T21:39:13.606135] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T21:39:13.622588] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-10-08T21:39:13.642342] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T21:39:14.417555] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-08T21:39:15.074052] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T21:39:15.217608] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-08T21:39:15.827767] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T21:39:16.017632] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-08T21:39:16.741552] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T21:39:16.817538] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-08T21:39:17.617583] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-08T21:39:17.936355] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T21:39:18.057141] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T21:39:18.417576] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-08T21:39:18.568418] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T21:39:18.899726] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T21:39:19.217611] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-08T21:39:20.017617] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-08T21:39:20.199958] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T21:39:20.817708] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-08T21:39:21.508430] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T21:39:21.617581] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-08T21:39:22.417596] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-08T21:39:22.721396] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T21:39:23.107467] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:39:23.217636] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-08T21:39:24.017611] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-08T21:39:24.640114] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T21:39:24.753111] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T21:39:24.817614] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-08T21:39:25.617534] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-08T21:39:25.986266] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T21:39:26.417720] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-08T21:39:26.546757] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:39:27.217537] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-08T21:39:27.451191] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T21:39:27.515885] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T21:39:28.017572] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-08T21:39:28.681983] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T21:39:28.686376] [INFO ] [REMOTE ] SQM: Full fetch complete (69174 records). [2025-10-08T21:39:28.686519] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-08T21:39:28.829664] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-08T21:39:29.096692] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-08T21:39:29.096838] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-08T21:39:29.097909] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-08T21:39:29.098011] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-08T21:39:29.099444] [DEBUG] [LOCAL ] SQM: Trimmed 69174 records to 48630 (keeping 200 days of data) [2025-10-08T21:39:29.403468] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T21:39:29.425042] [DEBUG] [LOCAL ] SQM: Primary data saved (48630 records). [2025-10-08T21:39:29.425230] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-08T21:39:29.425374] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SQM took 45.1s. Estimated remaining: 54m 10s. Rate: 7.1 symbols/min [2025-10-08T21:39:29.597457] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:29.610765] [DEBUG] [LOCAL ] SREA: Loaded 10251 existing records from primary storage. [2025-10-08T21:39:29.611041] [INFO ] [MAIN ] SREA: Loaded 10251 existing records. [2025-10-08T21:39:29.622763] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-08T21:39:29.790109] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:29.790344] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-08T21:39:29.790395] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-08T21:39:29.790572] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-08T21:39:29.790629] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-08T21:39:30.140581] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:30.417557] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-08T21:39:30.717816] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-08T21:39:31.222611] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-08T21:39:31.235875] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:39:31.863414] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T21:39:32.017534] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-08T21:39:32.817582] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-08T21:39:33.150307] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T21:39:33.152562] [INFO ] [REMOTE ] SQNS: Full fetch complete (32503 records). [2025-10-08T21:39:33.152712] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-08T21:39:33.349229] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-08T21:39:33.583954] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-08T21:39:33.584078] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-08T21:39:33.585021] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-08T21:39:33.585099] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-08T21:39:33.586388] [DEBUG] [LOCAL ] SQNS: Trimmed 32503 records to 26949 (keeping 200 days of data) [2025-10-08T21:39:33.649982] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-08T21:39:33.765236] [DEBUG] [LOCAL ] SQNS: Primary data saved (26949 records). [2025-10-08T21:39:33.765403] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-08T21:39:33.765506] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SQNS took 33.4s. Estimated remaining: 54m 1s. Rate: 7.1 symbols/min [2025-10-08T21:39:34.000974] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:34.038214] [DEBUG] [LOCAL ] SRFM: Loaded 37579 existing records from primary storage. [2025-10-08T21:39:34.038688] [INFO ] [MAIN ] SRFM: Loaded 37579 existing records. [2025-10-08T21:39:34.233059] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:34.233474] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-08T21:39:34.233589] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-08T21:39:34.234070] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-08T21:39:34.234268] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-08T21:39:34.350049] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T21:39:34.429585] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-08T21:39:34.664308] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:35.217511] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-10-08T21:39:35.331967] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T21:39:35.929883] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:39:36.017598] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-08T21:39:36.209304] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T21:39:36.817693] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-08T21:39:37.190117] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T21:39:37.192619] [INFO ] [REMOTE ] SR: Full fetch complete (46153 records). [2025-10-08T21:39:37.192743] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-08T21:39:37.570432] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-08T21:39:37.570530] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-08T21:39:37.571373] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-08T21:39:37.571435] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-08T21:39:37.572749] [DEBUG] [LOCAL ] SR: Trimmed 46153 records to 32604 (keeping 200 days of data) [2025-10-08T21:39:37.627451] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-10-08T21:39:37.777234] [DEBUG] [LOCAL ] SR: Primary data saved (32604 records). [2025-10-08T21:39:37.777380] [INFO ] [MAIN ] SR: Full history saved. [2025-10-08T21:39:37.777467] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SR took 32.0s. Estimated remaining: 53m 52s. Rate: 7.1 symbols/min [2025-10-08T21:39:37.945108] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:37.961372] [DEBUG] [LOCAL ] SRG: Loaded 15472 existing records from primary storage. [2025-10-08T21:39:37.961597] [INFO ] [MAIN ] SRG: Loaded 15472 existing records. [2025-10-08T21:39:38.139352] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:38.139578] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-08T21:39:38.139625] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-08T21:39:38.139908] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-08T21:39:38.139966] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-08T21:39:38.420073] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-08T21:39:38.516514] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:38.596165] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:39:39.217573] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-10-08T21:39:39.278957] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:39:39.318415] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T21:39:40.017508] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-08T21:39:40.251060] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T21:39:40.817557] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-08T21:39:41.269748] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T21:39:41.360272] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T21:39:41.364334] [INFO ] [REMOTE ] SRE: Full fetch complete (77291 records). [2025-10-08T21:39:41.364455] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-08T21:39:41.622671] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-08T21:39:41.753341] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-08T21:39:41.753430] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-08T21:39:41.754503] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-08T21:39:41.754573] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-08T21:39:41.756293] [DEBUG] [LOCAL ] SRE: Trimmed 77291 records to 53414 (keeping 200 days of data) [2025-10-08T21:39:42.111468] [DEBUG] [LOCAL ] SRE: Primary data saved (53414 records). [2025-10-08T21:39:42.111614] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-08T21:39:42.112747] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SRE took 33.6s. Estimated remaining: 53m 42s. Rate: 7.1 symbols/min [2025-10-08T21:39:42.279872] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:42.309088] [DEBUG] [LOCAL ] SRI: Loaded 26802 existing records from primary storage. [2025-10-08T21:39:42.309367] [INFO ] [MAIN ] SRI: Loaded 26802 existing records. [2025-10-08T21:39:42.422321] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-08T21:39:42.490832] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:39:42.491180] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-08T21:39:42.491230] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-08T21:39:42.491448] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-08T21:39:42.491505] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-08T21:39:42.795379] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T21:39:42.861223] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:43.015859] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T21:39:43.217592] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-08T21:39:44.017559] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-08T21:39:44.401001] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:39:44.821160] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-08T21:39:44.826101] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T21:39:45.617559] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-10-08T21:39:45.684751] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-08T21:39:46.417621] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-08T21:39:46.622841] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T21:39:47.222853] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-08T21:39:47.230299] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T21:39:48.017632] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-08T21:39:48.457507] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T21:39:48.826999] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-08T21:39:48.833482] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T21:39:49.572393] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T21:39:49.617608] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-08T21:39:50.417533] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-08T21:39:50.658260] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T21:39:51.217616] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-08T21:39:51.413450] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-08T21:39:52.017566] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-08T21:39:52.795594] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T21:39:52.817524] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-08T21:39:53.029668] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T21:39:53.442369] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T21:39:53.617570] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-08T21:39:54.376937] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T21:39:54.417547] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-08T21:39:54.920719] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-08T21:39:55.217549] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-08T21:39:55.832326] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T21:39:55.833990] [INFO ] [REMOTE ] SREA: Full fetch complete (15481 records). [2025-10-08T21:39:55.834079] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-08T21:39:56.022671] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-08T21:39:56.215066] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-08T21:39:56.215150] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-08T21:39:56.215513] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-08T21:39:56.215550] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-08T21:39:56.216176] [DEBUG] [LOCAL ] SREA: Trimmed 15481 records to 10258 (keeping 200 days of data) [2025-10-08T21:39:56.280976] [DEBUG] [LOCAL ] SREA: Primary data saved (10258 records). [2025-10-08T21:39:56.281125] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-08T21:39:56.281211] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SREA took 26.9s. Estimated remaining: 53m 35s. Rate: 7.1 symbols/min [2025-10-08T21:39:56.450118] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:39:56.450317] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-08T21:39:56.450373] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-08T21:39:56.450495] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-08T21:39:56.450537] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-08T21:39:56.450578] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-08T21:39:56.450610] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-08T21:39:56.810066] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:39:56.817492] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-10-08T21:39:57.306584] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T21:39:57.379905] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T21:39:57.617554] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-08T21:39:57.955526] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-08T21:39:58.417579] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-08T21:39:58.723625] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-08T21:39:59.217569] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-08T21:40:00.017547] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-08T21:40:00.481749] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T21:40:00.817558] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-08T21:40:01.617567] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-08T21:40:02.010418] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-08T21:40:02.288719] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T21:40:02.417597] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-08T21:40:02.614131] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-08T21:40:03.217539] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-08T21:40:03.459176] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T21:40:03.719148] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-08T21:40:04.017578] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-08T21:40:04.817516] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-08T21:40:05.231868] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T21:40:05.617551] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-08T21:40:05.699119] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T21:40:06.417606] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-08T21:40:06.848616] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T21:40:07.217536] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-08T21:40:07.861765] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-08T21:40:08.017541] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-08T21:40:08.452917] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T21:40:08.817565] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-08T21:40:09.195532] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-08T21:40:09.617520] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-08T21:40:10.031125] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-08T21:40:10.172027] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T21:40:10.417575] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-08T21:40:11.217527] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-08T21:40:11.265706] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T21:40:11.653334] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-08T21:40:12.017547] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-08T21:40:12.817592] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-08T21:40:13.181434] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-08T21:40:13.319116] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T21:40:13.617569] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-08T21:40:13.974467] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T21:40:14.417757] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-08T21:40:15.035456] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T21:40:15.217591] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-08T21:40:16.017612] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-08T21:40:16.331124] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T21:40:16.765131] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T21:40:16.817616] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-08T21:40:17.617608] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-08T21:40:17.896036] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T21:40:18.417633] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-08T21:40:18.478965] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T21:40:18.779913] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T21:40:18.780765] [INFO ] [REMOTE ] SRL: Full fetch complete (1959 records). [2025-10-08T21:40:18.780837] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-08T21:40:18.977368] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-08T21:40:18.977591] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:40:18.977636] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:40:18.977717] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-08T21:40:18.977777] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-08T21:40:18.977811] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-08T21:40:18.977866] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-08T21:40:18.977943] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SRL took 22.7s. Estimated remaining: 53m 29s. Rate: 7.1 symbols/min [2025-10-08T21:40:19.148306] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:19.157851] [DEBUG] [LOCAL ] SRV: Loaded 7351 existing records from primary storage. [2025-10-08T21:40:19.158059] [INFO ] [MAIN ] SRV: Loaded 7351 existing records. [2025-10-08T21:40:19.222764] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-08T21:40:19.336465] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:19.336706] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-08T21:40:19.336769] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-08T21:40:19.337000] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-08T21:40:19.337057] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-08T21:40:19.690963] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:20.017622] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-08T21:40:20.771698] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T21:40:20.773827] [INFO ] [REMOTE ] SRG: Full fetch complete (24056 records). [2025-10-08T21:40:20.773908] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-08T21:40:20.826812] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-10-08T21:40:21.097237] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-08T21:40:21.141328] [INFO ] [REMOTE ] SRFM: Full fetch complete (49984 records). [2025-10-08T21:40:21.159125] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-08T21:40:21.244170] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-08T21:40:21.260158] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-08T21:40:21.260900] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-08T21:40:21.261032] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-08T21:40:21.278526] [DEBUG] [LOCAL ] SRG: Trimmed 24056 records to 15365 (keeping 200 days of data) [2025-10-08T21:40:21.634011] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-08T21:40:21.659268] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-08T21:40:21.662602] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-08T21:40:21.665159] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-08T21:40:21.667359] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-08T21:40:21.667462] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-08T21:40:21.673918] [DEBUG] [LOCAL ] SRFM: Trimmed 49984 records to 37831 (keeping 200 days of data) [2025-10-08T21:40:21.765489] [DEBUG] [LOCAL ] SRG: Primary data saved (15365 records). [2025-10-08T21:40:21.766168] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-08T21:40:21.766557] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRG took 44.0s. Estimated remaining: 53m 20s. Rate: 7.1 symbols/min [2025-10-08T21:40:21.957484] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:22.088842] [DEBUG] [LOCAL ] SSB: Loaded 42687 existing records from primary storage. [2025-10-08T21:40:22.091357] [INFO ] [MAIN ] SSB: Loaded 42687 existing records. [2025-10-08T21:40:22.288518] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:22.294521] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-08T21:40:22.296040] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-08T21:40:22.297544] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-08T21:40:22.297617] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-08T21:40:22.434749] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-08T21:40:22.604631] [DEBUG] [LOCAL ] SRFM: Primary data saved (37831 records). [2025-10-08T21:40:22.620573] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-08T21:40:22.620852] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRFM took 48.9s. Estimated remaining: 53m 10s. Rate: 7.1 symbols/min [2025-10-08T21:40:22.633207] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T21:40:22.671182] [INFO ] [REMOTE ] SRI: Full fetch complete (40751 records). [2025-10-08T21:40:22.688233] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-08T21:40:22.846282] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:23.051849] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:23.224146] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-10-08T21:40:23.217692] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T21:40:23.240007] [DEBUG] [LOCAL ] SSD: Loaded 22498 existing records from primary storage. [2025-10-08T21:40:23.265443] [INFO ] [MAIN ] SSD: Loaded 22498 existing records. [2025-10-08T21:40:23.348618] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-08T21:40:23.360684] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-08T21:40:23.375429] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-08T21:40:23.384776] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-08T21:40:23.442189] [DEBUG] [LOCAL ] SRI: Trimmed 40751 records to 26723 (keeping 200 days of data) [2025-10-08T21:40:23.591395] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:23.592459] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-08T21:40:23.592901] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-08T21:40:23.593234] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-08T21:40:23.593840] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-08T21:40:24.018239] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-08T21:40:24.049731] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:24.060559] [DEBUG] [LOCAL ] SRI: Primary data saved (26723 records). [2025-10-08T21:40:24.061254] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-08T21:40:24.061419] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRI took 41.9s. Estimated remaining: 53m 0s. Rate: 7.1 symbols/min [2025-10-08T21:40:24.250724] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:24.305482] [DEBUG] [LOCAL ] SSL: Loaded 41347 existing records from primary storage. [2025-10-08T21:40:24.306201] [INFO ] [MAIN ] SSL: Loaded 41347 existing records. [2025-10-08T21:40:24.506782] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:24.507155] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-08T21:40:24.507222] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-08T21:40:24.507532] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-08T21:40:24.507594] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-08T21:40:24.824473] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-10-08T21:40:24.864380] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T21:40:24.916244] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:24.953250] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T21:40:25.617621] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-08T21:40:25.960357] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:40:26.241153] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T21:40:26.417585] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-10-08T21:40:27.217562] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-08T21:40:27.943519] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T21:40:28.017586] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-08T21:40:28.817534] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-08T21:40:28.867299] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:40:29.141612] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T21:40:29.617586] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-08T21:40:30.387177] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-08T21:40:30.417508] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-08T21:40:30.487791] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:40:30.850688] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T21:40:31.217615] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-08T21:40:32.017561] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-08T21:40:32.663421] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T21:40:32.680112] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T21:40:32.817593] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-08T21:40:33.617699] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-08T21:40:34.281259] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T21:40:34.349477] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T21:40:34.417513] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-08T21:40:35.220723] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-08T21:40:35.221676] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T21:40:36.017533] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-08T21:40:36.332948] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T21:40:36.817631] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-08T21:40:37.617582] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-08T21:40:37.790341] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T21:40:38.332713] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T21:40:38.417497] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-08T21:40:38.765494] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T21:40:39.217608] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-08T21:40:39.878602] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T21:40:40.017589] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-08T21:40:40.362766] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T21:40:40.817593] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-08T21:40:41.483512] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T21:40:41.617562] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-08T21:40:42.004929] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T21:40:42.417504] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-08T21:40:42.802444] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-08T21:40:43.217569] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-08T21:40:43.898200] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T21:40:44.017545] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-08T21:40:44.357977] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T21:40:44.731974] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T21:40:44.817559] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-08T21:40:45.202902] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T21:40:45.204615] [INFO ] [REMOTE ] SRV: Full fetch complete (11446 records). [2025-10-08T21:40:45.204721] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-08T21:40:45.556277] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-08T21:40:45.556360] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-08T21:40:45.556601] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-08T21:40:45.556639] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-08T21:40:45.557135] [DEBUG] [LOCAL ] SRV: Trimmed 11446 records to 7374 (keeping 200 days of data) [2025-10-08T21:40:45.602300] [DEBUG] [LOCAL ] SRV: Primary data saved (7374 records). [2025-10-08T21:40:45.602402] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-08T21:40:45.602507] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRV took 26.6s. Estimated remaining: 52m 54s. Rate: 7.1 symbols/min [2025-10-08T21:40:45.617563] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-08T21:40:45.776446] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:45.790946] [DEBUG] [LOCAL ] SST: Loaded 11825 existing records from primary storage. [2025-10-08T21:40:45.791188] [INFO ] [MAIN ] SST: Loaded 11825 existing records. [2025-10-08T21:40:45.964153] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:45.964351] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-08T21:40:45.964411] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-08T21:40:45.964581] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-08T21:40:45.964636] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-08T21:40:46.312125] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:46.417554] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-10-08T21:40:47.197322] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T21:40:47.220060] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-08T21:40:47.225178] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T21:40:48.017576] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-08T21:40:48.402605] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:40:48.817589] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-08T21:40:49.623506] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-08T21:40:49.629615] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:40:50.035583] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T21:40:50.417637] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-08T21:40:50.729002] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T21:40:51.217586] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-08T21:40:51.713882] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T21:40:52.017586] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-08T21:40:52.794337] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T21:40:52.817537] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-08T21:40:53.602599] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T21:40:53.617495] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-08T21:40:54.417590] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-08T21:40:54.507904] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T21:40:54.521799] [DEBUG] [REMOTE ] SSD: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-08T21:40:54.522222] [WARN ] [REMOTE ] SSD: No data returned for month 2025-08 [2025-10-08T21:40:54.522339] [FATAL] [REMOTE ] SSD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:40:54.522509] [FATAL] [MAIN ] SSD: Failed to fetch primary data. [2025-10-08T21:40:54.522597] [WARN ] [MAIN ] SSD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:40:54.522743] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-08T21:40:54.522826] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-08T21:40:54.522867] [INFO ] [LOCAL ] SSD: Starting deletion of derivative data. [2025-10-08T21:40:54.523135] [DEBUG] [LOCAL ] SSD: Deleted derivative data file. [2025-10-08T21:40:54.523257] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SSD took 31.9s. Estimated remaining: 52m 46s. Rate: 7.1 symbols/min [2025-10-08T21:40:54.677683] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T21:40:54.729858] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:40:54.733778] [INFO ] [REMOTE ] SSB: Full fetch complete (61374 records). [2025-10-08T21:40:54.734155] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-08T21:40:55.041080] [DEBUG] [LOCAL ] SSTK: Loaded 25665 existing records from primary storage. [2025-10-08T21:40:55.061608] [INFO ] [MAIN ] SSTK: Loaded 25665 existing records. [2025-10-08T21:40:55.218748] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-08T21:40:55.271881] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-08T21:40:55.295485] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-08T21:40:55.302077] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-08T21:40:55.307701] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-08T21:40:55.340403] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:40:55.340639] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-08T21:40:55.340741] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-08T21:40:55.341176] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-08T21:40:55.341239] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-08T21:40:55.372301] [DEBUG] [LOCAL ] SSB: Trimmed 61374 records to 42616 (keeping 200 days of data) [2025-10-08T21:40:55.836510] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:40:55.982517] [DEBUG] [LOCAL ] SSB: Primary data saved (42616 records). [2025-10-08T21:40:55.982672] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-08T21:40:55.982776] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSB took 34.2s. Estimated remaining: 52m 36s. Rate: 7.1 symbols/min [2025-10-08T21:40:56.017557] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-08T21:40:56.817599] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-10-08T21:40:56.840911] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T21:40:56.879627] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T21:40:57.617556] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-08T21:40:57.796012] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T21:40:58.417515] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-08T21:40:58.547829] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-08T21:40:59.217573] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-08T21:40:59.857805] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T21:41:00.017739] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-08T21:41:00.203715] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T21:41:00.207363] [INFO ] [REMOTE ] SSL: Full fetch complete (60021 records). [2025-10-08T21:41:00.207496] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-08T21:41:00.660931] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-08T21:41:00.661047] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-08T21:41:00.662346] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-08T21:41:00.662430] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-08T21:41:00.664261] [DEBUG] [LOCAL ] SSL: Trimmed 60021 records to 41399 (keeping 200 days of data) [2025-10-08T21:41:00.831387] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-08T21:41:00.911545] [DEBUG] [LOCAL ] SSL: Primary data saved (41399 records). [2025-10-08T21:41:00.911700] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-08T21:41:00.912668] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSL took 36.9s. Estimated remaining: 52m 27s. Rate: 7.1 symbols/min [2025-10-08T21:41:01.400727] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T21:41:01.617618] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-08T21:41:01.736183] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-08T21:41:02.417631] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-08T21:41:02.997321] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T21:41:03.217548] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-08T21:41:03.254348] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T21:41:04.017541] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-08T21:41:04.447163] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-08T21:41:04.817546] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-08T21:41:05.199089] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:41:05.617533] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-08T21:41:05.707032] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-08T21:41:06.304289] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-08T21:41:06.417606] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-08T21:41:07.111895] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T21:41:07.217546] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-08T21:41:08.017575] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-08T21:41:08.387264] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:41:08.447316] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-08T21:41:08.817627] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-08T21:41:09.617608] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-08T21:41:09.988494] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T21:41:10.230368] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T21:41:10.231451] [INFO ] [REMOTE ] SST: Full fetch complete (18648 records). [2025-10-08T21:41:10.231541] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-08T21:41:10.445592] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-08T21:41:10.609088] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-08T21:41:10.609195] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-08T21:41:10.609975] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-08T21:41:10.610041] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-08T21:41:10.610730] [DEBUG] [LOCAL ] SST: Trimmed 18648 records to 11764 (keeping 200 days of data) [2025-10-08T21:41:10.680006] [DEBUG] [LOCAL ] SST: Primary data saved (11764 records). [2025-10-08T21:41:10.680187] [INFO ] [MAIN ] SST: Full history saved. [2025-10-08T21:41:10.680293] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SST took 25.1s. Estimated remaining: 52m 19s. Rate: 7.1 symbols/min [2025-10-08T21:41:11.609429] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T21:41:11.615375] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-08T21:41:12.603305] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T21:41:12.610063] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-08T21:41:13.494437] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-08T21:41:13.496623] [INFO ] [REMOTE ] SSTK: Full fetch complete (41733 records). [2025-10-08T21:41:13.496755] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-08T21:41:13.873950] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-08T21:41:13.874034] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-08T21:41:13.874821] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-08T21:41:13.874885] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-08T21:41:13.875765] [DEBUG] [LOCAL ] SSTK: Trimmed 41733 records to 25598 (keeping 200 days of data) [2025-10-08T21:41:14.048829] [DEBUG] [LOCAL ] SSTK: Primary data saved (25598 records). [2025-10-08T21:41:14.049109] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-08T21:41:14.049293] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSTK took 19.5s. Estimated remaining: 52m 9s. Rate: 7.1 symbols/min [2025-10-08T21:41:14.639237] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:14.757444] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:14.801215] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:14.837266] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:14.859154] [DEBUG] [LOCAL ] STC: Loaded 17406 existing records from primary storage. [2025-10-08T21:41:14.862922] [INFO ] [MAIN ] STC: Loaded 17406 existing records. [2025-10-08T21:41:15.010085] [DEBUG] [LOCAL ] STE: Loaded 35541 existing records from primary storage. [2025-10-08T21:41:15.085692] [DEBUG] [LOCAL ] ST: Loaded 49790 existing records from primary storage. [2025-10-08T21:41:15.068316] [INFO ] [MAIN ] STE: Loaded 35541 existing records. [2025-10-08T21:41:15.145927] [INFO ] [MAIN ] ST: Loaded 49790 existing records. [2025-10-08T21:41:15.145799] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:15.172328] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-08T21:41:15.201466] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-08T21:41:15.226361] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-08T21:41:15.354485] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-08T21:41:15.359363] [DEBUG] [LOCAL ] STAG: Loaded 50117 existing records from primary storage. [2025-10-08T21:41:15.391427] [INFO ] [MAIN ] STAG: Loaded 50117 existing records. [2025-10-08T21:41:15.635755] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:15.741831] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:15.742677] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-08T21:41:15.753204] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-08T21:41:15.730256] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-08T21:41:15.769306] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-08T21:41:15.769530] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-08T21:41:15.814259] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-08T21:41:15.945831] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-08T21:41:16.049837] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:16.086979] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-08T21:41:16.103210] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-08T21:41:16.189764] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-08T21:41:16.396066] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-08T21:41:16.477422] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:16.473314] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-08T21:41:16.541494] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-10-08T21:41:16.966772] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:16.994237] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-10-08T21:41:17.263095] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:17.273823] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-10-08T21:41:17.335944] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:17.336296] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-10-08T21:41:17.685884] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T21:41:17.690316] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-08T21:41:18.536896] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T21:41:18.541239] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-08T21:41:18.581102] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T21:41:18.588608] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-08T21:41:18.681625] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T21:41:18.691799] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-08T21:41:18.958777] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T21:41:19.217540] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-08T21:41:19.360925] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T21:41:20.017575] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-08T21:41:20.075725] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T21:41:20.390558] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T21:41:20.722364] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-08T21:41:20.772897] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T21:41:20.817523] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-08T21:41:21.617717] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-08T21:41:22.289799] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T21:41:22.417684] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-08T21:41:22.885425] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T21:41:23.217611] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-08T21:41:24.017550] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-08T21:41:24.074713] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T21:41:24.513125] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T21:41:24.817520] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-08T21:41:25.134967] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T21:41:25.617581] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-08T21:41:26.417594] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-08T21:41:26.553625] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T21:41:27.058252] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:41:27.217568] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-08T21:41:27.501243] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T21:41:28.017632] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-08T21:41:28.822749] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-08T21:41:28.837383] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:41:29.617555] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-08T21:41:29.730724] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T21:41:30.417620] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-08T21:41:30.547532] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T21:41:31.184094] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:41:31.217521] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-08T21:41:31.237204] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-08T21:41:32.017588] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-08T21:41:32.605385] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T21:41:32.817520] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-08T21:41:33.428371] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:41:33.617601] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-08T21:41:34.299263] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T21:41:34.417549] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-08T21:41:35.197610] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T21:41:35.217506] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-08T21:41:35.918597] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T21:41:36.017569] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-08T21:41:36.690226] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T21:41:36.817572] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-08T21:41:37.617524] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-08T21:41:37.746532] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T21:41:38.187920] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T21:41:38.417516] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-08T21:41:39.217523] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-08T21:41:39.291919] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T21:41:39.319115] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T21:41:39.322257] [INFO ] [REMOTE ] STE: Full fetch complete (50677 records). [2025-10-08T21:41:39.322357] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-08T21:41:39.696784] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-08T21:41:39.696869] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-08T21:41:39.697722] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-08T21:41:39.697783] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-08T21:41:39.698899] [DEBUG] [LOCAL ] STE: Trimmed 50677 records to 35429 (keeping 200 days of data) [2025-10-08T21:41:39.928563] [DEBUG] [LOCAL ] STE: Primary data saved (35429 records). [2025-10-08T21:41:39.928803] [INFO ] [MAIN ] STE: Full history saved. [2025-10-08T21:41:39.928920] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STE took 25.9s. Estimated remaining: 52m 4s. Rate: 7.1 symbols/min [2025-10-08T21:41:40.025807] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-08T21:41:40.099914] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:40.123321] [DEBUG] [LOCAL ] STEL: Loaded 22963 existing records from primary storage. [2025-10-08T21:41:40.123600] [INFO ] [MAIN ] STEL: Loaded 22963 existing records. [2025-10-08T21:41:40.301268] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:40.301491] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-08T21:41:40.301537] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-08T21:41:40.301780] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-08T21:41:40.301839] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-08T21:41:40.671529] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:40.702292] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T21:41:40.817514] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-08T21:41:41.194628] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T21:41:41.617548] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-08T21:41:42.417574] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-10-08T21:41:42.466121] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:41:43.217581] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-08T21:41:43.265284] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:41:43.304701] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T21:41:44.017519] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-08T21:41:44.203499] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T21:41:44.775023] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T21:41:44.817494] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-08T21:41:45.617579] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-08T21:41:45.838275] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T21:41:46.417639] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-08T21:41:46.730687] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T21:41:46.735310] [INFO ] [REMOTE ] ST: Full fetch complete (71975 records). [2025-10-08T21:41:46.735533] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-08T21:41:47.223375] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-08T21:41:47.225678] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-08T21:41:47.225813] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-08T21:41:47.227282] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-08T21:41:47.227532] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-08T21:41:47.229309] [DEBUG] [LOCAL ] ST: Trimmed 71975 records to 49807 (keeping 200 days of data) [2025-10-08T21:41:47.562548] [DEBUG] [LOCAL ] ST: Primary data saved (49807 records). [2025-10-08T21:41:47.563973] [INFO ] [MAIN ] ST: Full history saved. [2025-10-08T21:41:47.563835] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T21:41:47.564192] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. ST took 33.5s. Estimated remaining: 51m 56s. Rate: 7.1 symbols/min [2025-10-08T21:41:47.748966] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:47.785581] [DEBUG] [LOCAL ] STEM: Loaded 39149 existing records from primary storage. [2025-10-08T21:41:47.785923] [INFO ] [MAIN ] STEM: Loaded 39149 existing records. [2025-10-08T21:41:47.959694] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:47.959924] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-08T21:41:47.959973] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-08T21:41:47.960297] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-08T21:41:47.960356] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-08T21:41:48.022479] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-08T21:41:48.324312] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:48.335603] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T21:41:48.817558] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-08T21:41:49.166172] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T21:41:49.617610] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-08T21:41:50.417518] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-10-08T21:41:50.436851] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T21:41:50.438495] [INFO ] [REMOTE ] STC: Full fetch complete (25750 records). [2025-10-08T21:41:50.438569] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-08T21:41:50.766065] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-08T21:41:50.861675] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-08T21:41:50.861765] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-08T21:41:50.862279] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-08T21:41:50.862318] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-08T21:41:50.862995] [DEBUG] [LOCAL ] STC: Trimmed 25750 records to 17369 (keeping 200 days of data) [2025-10-08T21:41:50.971220] [DEBUG] [LOCAL ] STC: Primary data saved (17369 records). [2025-10-08T21:41:50.971362] [INFO ] [MAIN ] STC: Full history saved. [2025-10-08T21:41:50.971444] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STC took 36.9s. Estimated remaining: 51m 46s. Rate: 7.1 symbols/min [2025-10-08T21:41:51.157324] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:41:51.177002] [DEBUG] [LOCAL ] STEW: Loaded 16168 existing records from primary storage. [2025-10-08T21:41:51.177430] [INFO ] [MAIN ] STEW: Loaded 16168 existing records. [2025-10-08T21:41:51.222790] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-08T21:41:51.402860] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:41:51.403161] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-08T21:41:51.403223] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-08T21:41:51.403453] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-08T21:41:51.403511] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-08T21:41:51.755095] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:41:52.017512] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-10-08T21:41:52.390433] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-08T21:41:52.414075] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T21:41:52.817563] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-08T21:41:53.011001] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T21:41:53.617550] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-08T21:41:54.417554] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-08T21:41:54.440201] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T21:41:54.764168] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T21:41:55.217553] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-08T21:41:55.843634] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T21:41:56.017521] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-08T21:41:56.261459] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T21:41:56.817560] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-08T21:41:57.617573] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-08T21:41:57.663145] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T21:41:57.927250] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T21:41:58.417753] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-08T21:41:59.134675] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T21:41:59.138603] [INFO ] [REMOTE ] STAG: Full fetch complete (72222 records). [2025-10-08T21:41:59.138755] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-08T21:41:59.222899] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-08T21:41:59.552127] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-08T21:41:59.548531] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-08T21:41:59.556452] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-08T21:41:59.557823] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-08T21:41:59.557886] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-08T21:41:59.559177] [DEBUG] [LOCAL ] STAG: Trimmed 72222 records to 50089 (keeping 200 days of data) [2025-10-08T21:41:59.870819] [DEBUG] [LOCAL ] STAG: Primary data saved (50089 records). [2025-10-08T21:41:59.870961] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-08T21:41:59.871045] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. STAG took 45.8s. Estimated remaining: 51m 38s. Rate: 7.1 symbols/min [2025-10-08T21:42:00.022767] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-08T21:42:00.078606] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:00.078854] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-08T21:42:00.078929] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-08T21:42:00.079132] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-08T21:42:00.079200] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-08T21:42:00.079259] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-08T21:42:00.079302] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-08T21:42:00.451423] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:00.514019] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-08T21:42:00.817598] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-10-08T21:42:01.247830] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-08T21:42:01.617588] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-08T21:42:02.104094] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T21:42:02.417528] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-08T21:42:02.726415] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T21:42:03.217542] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-08T21:42:03.503775] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T21:42:03.908043] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-08T21:42:04.017573] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-08T21:42:04.817515] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-08T21:42:05.145868] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T21:42:05.307633] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T21:42:05.617561] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-08T21:42:06.417563] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-08T21:42:06.602405] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T21:42:06.762837] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T21:42:07.217599] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-08T21:42:08.017541] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-08T21:42:08.061224] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T21:42:08.063805] [INFO ] [REMOTE ] STEL: Full fetch complete (32035 records). [2025-10-08T21:42:08.063908] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-08T21:42:08.464576] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-08T21:42:08.464710] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-08T21:42:08.465370] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-08T21:42:08.465412] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-08T21:42:08.466337] [DEBUG] [LOCAL ] STEL: Trimmed 32035 records to 22835 (keeping 200 days of data) [2025-10-08T21:42:08.612837] [DEBUG] [LOCAL ] STEL: Primary data saved (22835 records). [2025-10-08T21:42:08.612985] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-08T21:42:08.613093] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEL took 28.7s. Estimated remaining: 51m 30s. Rate: 7.1 symbols/min [2025-10-08T21:42:08.798239] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:08.810882] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-08T21:42:08.818708] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-08T21:42:08.824726] [DEBUG] [LOCAL ] STK: Loaded 9561 existing records from primary storage. [2025-10-08T21:42:08.824932] [INFO ] [MAIN ] STK: Loaded 9561 existing records. [2025-10-08T21:42:09.016543] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:42:09.016757] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-08T21:42:09.016810] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-08T21:42:09.017032] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-08T21:42:09.017090] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-08T21:42:09.390359] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:09.617567] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-10-08T21:42:10.417558] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-08T21:42:10.429204] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T21:42:10.694345] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T21:42:11.019941] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-08T21:42:11.217633] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-08T21:42:11.775189] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T21:42:12.017612] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-08T21:42:12.800777] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T21:42:12.817518] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-08T21:42:13.540545] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T21:42:13.542599] [INFO ] [REMOTE ] STEW: Full fetch complete (21759 records). [2025-10-08T21:42:13.542934] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-08T21:42:13.622836] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-08T21:42:13.950820] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-08T21:42:13.950928] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-08T21:42:13.951456] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-08T21:42:13.951499] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-08T21:42:13.952379] [DEBUG] [LOCAL ] STEW: Trimmed 21759 records to 16161 (keeping 200 days of data) [2025-10-08T21:42:14.056136] [DEBUG] [LOCAL ] STEW: Primary data saved (16161 records). [2025-10-08T21:42:14.056301] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-08T21:42:14.056387] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STEW took 23.1s. Estimated remaining: 51m 21s. Rate: 7.1 symbols/min [2025-10-08T21:42:14.234114] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:14.295628] [DEBUG] [LOCAL ] STLA: Loaded 53552 existing records from primary storage. [2025-10-08T21:42:14.296035] [INFO ] [MAIN ] STLA: Loaded 53552 existing records. [2025-10-08T21:42:14.422716] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-08T21:42:14.493362] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:42:14.493823] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-08T21:42:14.494017] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-08T21:42:14.502179] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-08T21:42:14.503192] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-08T21:42:14.509078] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-08T21:42:14.860263] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:15.217532] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-10-08T21:42:16.017532] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-08T21:42:16.313035] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-08T21:42:16.341868] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T21:42:16.817618] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-08T21:42:17.085753] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T21:42:17.160001] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-08T21:42:17.617576] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-08T21:42:17.993425] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T21:42:18.417559] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-08T21:42:19.207875] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T21:42:19.217491] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-08T21:42:20.017565] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-08T21:42:20.052467] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T21:42:20.817775] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-08T21:42:21.598609] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T21:42:21.617516] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-08T21:42:22.083928] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-08T21:42:22.358787] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T21:42:22.417613] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-08T21:42:23.217634] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-08T21:42:23.240433] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T21:42:24.017622] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-08T21:42:24.309514] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-08T21:42:24.817543] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-08T21:42:24.885483] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T21:42:25.592609] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T21:42:25.617602] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-08T21:42:26.344339] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-08T21:42:26.417573] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-08T21:42:27.103746] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T21:42:27.105090] [INFO ] [REMOTE ] STK: Full fetch complete (14113 records). [2025-10-08T21:42:27.105166] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-08T21:42:27.222704] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-08T21:42:27.489271] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-08T21:42:27.489430] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-08T21:42:27.489787] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-08T21:42:27.489913] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-08T21:42:27.490489] [DEBUG] [LOCAL ] STK: Trimmed 14113 records to 9582 (keeping 200 days of data) [2025-10-08T21:42:27.552509] [DEBUG] [LOCAL ] STK: Primary data saved (9582 records). [2025-10-08T21:42:27.552699] [INFO ] [MAIN ] STK: Full history saved. [2025-10-08T21:42:27.552807] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STK took 18.9s. Estimated remaining: 51m 13s. Rate: 7.1 symbols/min [2025-10-08T21:42:27.736894] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:27.790236] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-08T21:42:27.790665] [INFO ] [MAIN ] STM: Loaded 53573 existing records. [2025-10-08T21:42:27.972757] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:42:27.973154] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-08T21:42:27.973238] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-08T21:42:27.973725] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-08T21:42:27.973797] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-08T21:42:28.022733] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-08T21:42:28.348775] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:28.817596] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-08T21:42:28.892551] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-08T21:42:29.083762] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T21:42:29.617607] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-08T21:42:30.052361] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-08T21:42:30.404432] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T21:42:30.417512] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-08T21:42:31.217616] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-08T21:42:31.831034] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T21:42:32.017566] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-08T21:42:32.333592] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-08T21:42:32.817570] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-10-08T21:42:33.241465] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T21:42:33.617561] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-08T21:42:34.417527] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-08T21:42:34.717753] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T21:42:34.718474] [INFO ] [REMOTE ] STG: Full fetch complete (2504 records). [2025-10-08T21:42:34.718547] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-08T21:42:34.906722] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-08T21:42:34.936836] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:42:34.937346] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:42:34.939786] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-08T21:42:34.939927] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-08T21:42:34.940185] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-08T21:42:34.951167] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-08T21:42:34.952374] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-08T21:42:34.952488] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STG took 35.1s. Estimated remaining: 51m 4s. Rate: 7.1 symbols/min [2025-10-08T21:42:35.052722] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T21:42:35.162829] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:35.187534] [DEBUG] [LOCAL ] STN: Loaded 22825 existing records from primary storage. [2025-10-08T21:42:35.187833] [INFO ] [MAIN ] STN: Loaded 22825 existing records. [2025-10-08T21:42:35.222835] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-08T21:42:35.364250] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:42:35.364469] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-08T21:42:35.364517] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-08T21:42:35.364893] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-08T21:42:35.364951] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-08T21:42:35.713114] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:36.017565] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-10-08T21:42:36.817568] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-08T21:42:37.104168] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T21:42:37.606036] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-08T21:42:37.617489] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-08T21:42:38.053824] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T21:42:38.057041] [INFO ] [REMOTE ] STEM: Full fetch complete (61695 records). [2025-10-08T21:42:38.057153] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-08T21:42:38.422847] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-08T21:42:38.630568] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-08T21:42:38.631008] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-08T21:42:38.632833] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-08T21:42:38.632985] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-08T21:42:38.635034] [DEBUG] [LOCAL ] STEM: Trimmed 61695 records to 39032 (keeping 200 days of data) [2025-10-08T21:42:38.972451] [DEBUG] [LOCAL ] STEM: Primary data saved (39032 records). [2025-10-08T21:42:38.972680] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-08T21:42:38.972798] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STEM took 51.4s. Estimated remaining: 50m 55s. Rate: 7.1 symbols/min [2025-10-08T21:42:39.222746] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-08T21:42:39.225705] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:42:39.281297] [DEBUG] [LOCAL ] STNG: Loaded 43696 existing records from primary storage. [2025-10-08T21:42:39.281812] [INFO ] [MAIN ] STNG: Loaded 43696 existing records. [2025-10-08T21:42:39.528402] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:42:39.528686] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-08T21:42:39.528790] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-08T21:42:39.529345] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-08T21:42:39.529403] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-08T21:42:39.921774] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:42:39.924262] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-08T21:42:40.017503] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-10-08T21:42:40.282886] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T21:42:40.388603] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-08T21:42:40.817550] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-08T21:42:41.617549] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-08T21:42:41.665689] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:42:41.839283] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T21:42:42.417543] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-08T21:42:43.217528] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-08T21:42:43.558636] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-08T21:42:43.812990] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T21:42:44.017518] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-08T21:42:44.421253] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T21:42:44.817581] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-08T21:42:45.617521] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-08T21:42:46.127225] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T21:42:46.183219] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T21:42:46.417712] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-08T21:42:47.131828] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T21:42:47.215099] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-08T21:42:47.221023] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-08T21:42:48.017547] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-08T21:42:48.817532] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-08T21:42:49.238394] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-08T21:42:49.614932] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T21:42:49.625355] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-08T21:42:49.872038] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T21:42:50.417547] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-08T21:42:51.217556] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-08T21:42:51.512372] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T21:42:52.028224] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-08T21:42:52.032334] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T21:42:52.817630] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-08T21:42:53.213029] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-08T21:42:53.617613] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-08T21:42:54.094925] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-08T21:42:54.122947] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T21:42:54.417590] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-08T21:42:55.201397] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T21:42:55.217486] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-08T21:42:56.017575] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-08T21:42:56.292605] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T21:42:56.387228] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T21:42:56.817602] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-08T21:42:57.190521] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-08T21:42:57.617573] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-08T21:42:58.417718] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-08T21:42:58.867874] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T21:42:59.225804] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-08T21:42:59.232015] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:42:59.505397] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T21:43:00.017559] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-08T21:43:00.817557] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-08T21:43:01.078576] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T21:43:01.438216] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:43:01.440482] [INFO ] [REMOTE ] STN: Full fetch complete (32385 records). [2025-10-08T21:43:01.440588] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-08T21:43:01.630482] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-08T21:43:01.839074] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-08T21:43:01.839229] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-08T21:43:01.840323] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-08T21:43:01.840406] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-08T21:43:01.841777] [DEBUG] [LOCAL ] STN: Trimmed 32385 records to 22841 (keeping 200 days of data) [2025-10-08T21:43:02.002347] [DEBUG] [LOCAL ] STN: Primary data saved (22841 records). [2025-10-08T21:43:02.002497] [INFO ] [MAIN ] STN: Full history saved. [2025-10-08T21:43:02.002588] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STN took 27.0s. Estimated remaining: 50m 49s. Rate: 7.1 symbols/min [2025-10-08T21:43:02.180488] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:02.194156] [DEBUG] [LOCAL ] STRV: Loaded 11304 existing records from primary storage. [2025-10-08T21:43:02.194407] [INFO ] [MAIN ] STRV: Loaded 11304 existing records. [2025-10-08T21:43:02.365273] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-08T21:43:02.420319] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-08T21:43:02.479786] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:02.481416] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-08T21:43:02.481505] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-08T21:43:02.482050] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-08T21:43:02.482422] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-08T21:43:02.893036] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:03.217616] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-08T21:43:03.760577] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-08T21:43:03.769932] [INFO ] [REMOTE ] STLA: Full fetch complete (77535 records). [2025-10-08T21:43:03.770267] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-08T21:43:04.023375] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-10-08T21:43:04.224893] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-08T21:43:04.225072] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-08T21:43:04.226973] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-08T21:43:04.227173] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-08T21:43:04.255415] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-08T21:43:04.266376] [DEBUG] [LOCAL ] STLA: Trimmed 77535 records to 53551 (keeping 200 days of data) [2025-10-08T21:43:04.632772] [DEBUG] [LOCAL ] STLA: Primary data saved (53551 records). [2025-10-08T21:43:04.632999] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-08T21:43:04.633208] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STLA took 50.6s. Estimated remaining: 50m 40s. Rate: 7.1 symbols/min [2025-10-08T21:43:04.822772] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-08T21:43:04.822611] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:04.885778] [DEBUG] [LOCAL ] STT: Loaded 50964 existing records from primary storage. [2025-10-08T21:43:04.886264] [INFO ] [MAIN ] STT: Loaded 50964 existing records. [2025-10-08T21:43:05.099022] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:05.100116] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-08T21:43:05.100316] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-08T21:43:05.110132] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-08T21:43:05.110330] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-08T21:43:05.185555] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T21:43:05.522540] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:05.541990] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-08T21:43:05.617544] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-08T21:43:06.088250] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T21:43:06.417528] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-08T21:43:07.206253] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T21:43:07.217500] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-08T21:43:07.676455] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-08T21:43:08.017619] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-08T21:43:08.122829] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T21:43:08.817624] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-08T21:43:09.188537] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T21:43:09.191864] [INFO ] [REMOTE ] STNG: Full fetch complete (64405 records). [2025-10-08T21:43:09.191997] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-08T21:43:09.572187] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-08T21:43:09.572266] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-08T21:43:09.573260] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-08T21:43:09.573323] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-08T21:43:09.574524] [DEBUG] [LOCAL ] STNG: Trimmed 64405 records to 43676 (keeping 200 days of data) [2025-10-08T21:43:09.628222] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-08T21:43:09.844508] [DEBUG] [LOCAL ] STNG: Primary data saved (43676 records). [2025-10-08T21:43:09.844702] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-08T21:43:09.844826] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STNG took 30.9s. Estimated remaining: 50m 31s. Rate: 7.1 symbols/min [2025-10-08T21:43:10.012149] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:10.012327] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-08T21:43:10.012364] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-08T21:43:10.012478] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-08T21:43:10.012522] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-08T21:43:10.012620] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-08T21:43:10.012692] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-08T21:43:10.372577] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:10.381503] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T21:43:10.417488] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-08T21:43:10.451911] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T21:43:10.455977] [INFO ] [REMOTE ] STM: Full fetch complete (77523 records). [2025-10-08T21:43:10.456081] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-08T21:43:10.845728] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-08T21:43:10.845817] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-08T21:43:10.846928] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-08T21:43:10.846991] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-08T21:43:10.849355] [DEBUG] [LOCAL ] STM: Trimmed 77523 records to 53571 (keeping 200 days of data) [2025-10-08T21:43:11.186697] [DEBUG] [LOCAL ] STM: Primary data saved (53571 records). [2025-10-08T21:43:11.186844] [INFO ] [MAIN ] STM: Full history saved. [2025-10-08T21:43:11.186929] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STM took 43.6s. Estimated remaining: 50m 21s. Rate: 7.1 symbols/min [2025-10-08T21:43:11.219358] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-10-08T21:43:11.364263] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:11.391016] [DEBUG] [LOCAL ] STVN: Loaded 26531 existing records from primary storage. [2025-10-08T21:43:11.391280] [INFO ] [MAIN ] STVN: Loaded 26531 existing records. [2025-10-08T21:43:11.489616] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:43:11.517371] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-10-08T21:43:11.558752] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T21:43:11.556614] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:43:11.586097] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-08T21:43:11.586267] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:43:11.592698] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-08T21:43:11.597469] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:11.593203] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-08T21:43:11.598333] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-08T21:43:11.598415] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-08T21:43:11.598487] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-08T21:43:11.598599] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-08T21:43:11.598698] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STUB took 1.8s. Estimated remaining: 50m 11s. Rate: 7.1 symbols/min [2025-10-08T21:43:11.609685] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-08T21:43:11.629594] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-08T21:43:11.947290] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:12.021048] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-10-08T21:43:12.137593] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:12.177622] [DEBUG] [LOCAL ] STWD: Loaded 51920 existing records from primary storage. [2025-10-08T21:43:12.177983] [INFO ] [MAIN ] STWD: Loaded 51920 existing records. [2025-10-08T21:43:12.360471] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:12.360778] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-08T21:43:12.360834] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-08T21:43:12.361070] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-08T21:43:12.361128] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-08T21:43:12.731745] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:12.817551] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-08T21:43:13.617731] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-10-08T21:43:13.678244] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-08T21:43:13.788680] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T21:43:14.417543] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-08T21:43:14.779419] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T21:43:15.218088] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-08T21:43:15.220031] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T21:43:16.017611] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-08T21:43:16.817517] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-08T21:43:16.994627] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T21:43:17.051908] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T21:43:17.617559] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-08T21:43:17.664153] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T21:43:18.417515] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-08T21:43:18.762248] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T21:43:19.166914] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T21:43:19.217560] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-08T21:43:19.762061] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T21:43:20.017685] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-08T21:43:20.817563] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-08T21:43:21.393510] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T21:43:21.415200] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T21:43:21.416692] [INFO ] [REMOTE ] STRV: Full fetch complete (17944 records). [2025-10-08T21:43:21.416786] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-08T21:43:21.625935] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-10-08T21:43:21.840197] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-08T21:43:21.840324] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-08T21:43:21.840794] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-08T21:43:21.840855] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-08T21:43:21.841541] [DEBUG] [LOCAL ] STRV: Trimmed 17944 records to 11293 (keeping 200 days of data) [2025-10-08T21:43:21.914419] [DEBUG] [LOCAL ] STRV: Primary data saved (11293 records). [2025-10-08T21:43:21.914581] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-08T21:43:21.914796] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STRV took 19.9s. Estimated remaining: 50m 3s. Rate: 7.1 symbols/min [2025-10-08T21:43:22.086623] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:22.091310] [DEBUG] [LOCAL ] STXD: Loaded 1255 existing records from primary storage. [2025-10-08T21:43:22.091517] [INFO ] [MAIN ] STXD: Loaded 1255 existing records. [2025-10-08T21:43:22.283254] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:22.283509] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-08T21:43:22.283562] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-08T21:43:22.283761] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-08T21:43:22.283818] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-08T21:43:22.422702] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-08T21:43:22.647093] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:23.217525] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-08T21:43:23.408234] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:43:24.017554] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-10-08T21:43:24.108246] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T21:43:24.248755] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T21:43:24.378034] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-08T21:43:24.817591] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-08T21:43:25.617590] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-08T21:43:25.929111] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T21:43:26.417581] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-08T21:43:27.217578] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-08T21:43:27.402559] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T21:43:27.729368] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T21:43:28.017524] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-08T21:43:28.134827] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-08T21:43:28.817515] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-08T21:43:29.116612] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T21:43:29.617730] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-08T21:43:30.196693] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T21:43:30.417621] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-08T21:43:30.850270] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T21:43:31.217567] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-08T21:43:31.374077] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T21:43:32.017550] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-08T21:43:32.341588] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T21:43:32.817676] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-08T21:43:33.617516] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-08T21:43:33.882818] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T21:43:33.892482] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T21:43:34.056740] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T21:43:34.417542] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-08T21:43:35.217583] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-08T21:43:35.607588] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T21:43:36.017568] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-08T21:43:36.118453] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T21:43:36.817563] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-08T21:43:37.078754] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T21:43:37.617573] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-08T21:43:38.428940] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-08T21:43:38.435847] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T21:43:38.811908] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T21:43:39.217541] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-08T21:43:39.477302] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T21:43:39.552309] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-08T21:43:40.017603] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-08T21:43:40.817553] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-08T21:43:41.617540] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-08T21:43:41.785457] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:43:41.815957] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T21:43:42.417547] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-08T21:43:43.217541] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-08T21:43:43.264141] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T21:43:43.523595] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-08T21:43:44.017522] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-08T21:43:44.117247] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T21:43:44.345568] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-08T21:43:44.817558] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-08T21:43:45.165516] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T21:43:45.617545] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-08T21:43:46.417582] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-08T21:43:47.039015] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T21:43:47.217556] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-08T21:43:47.440548] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T21:43:47.443453] [INFO ] [REMOTE ] STVN: Full fetch complete (39253 records). [2025-10-08T21:43:47.443662] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-08T21:43:47.525890] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T21:43:47.551544] [INFO ] [REMOTE ] STXD: Full fetch complete (2027 records). [2025-10-08T21:43:47.554059] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-08T21:43:48.032301] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-08T21:43:48.155720] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-08T21:43:48.187203] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-08T21:43:48.215063] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-08T21:43:48.220140] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-08T21:43:48.285940] [DEBUG] [LOCAL ] STVN: Trimmed 39253 records to 26633 (keeping 200 days of data) [2025-10-08T21:43:48.308448] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-08T21:43:48.308880] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-08T21:43:48.308996] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-08T21:43:48.309091] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-08T21:43:48.309733] [DEBUG] [LOCAL ] STXD: Trimmed 2027 records to 1238 (keeping 200 days of data) [2025-10-08T21:43:48.420372] [DEBUG] [LOCAL ] STXD: Primary data saved (1238 records). [2025-10-08T21:43:48.421052] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-08T21:43:48.421725] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STXD took 26.5s. Estimated remaining: 49m 58s. Rate: 7.1 symbols/min [2025-10-08T21:43:48.599619] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:48.608177] [DEBUG] [LOCAL ] STXE: Loaded 2102 existing records from primary storage. [2025-10-08T21:43:48.609389] [INFO ] [MAIN ] STXE: Loaded 2102 existing records. [2025-10-08T21:43:48.802011] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:48.803138] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-08T21:43:48.803896] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-08T21:43:48.805396] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-08T21:43:48.806036] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-08T21:43:48.837943] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-08T21:43:49.242717] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:49.248732] [DEBUG] [LOCAL ] STVN: Primary data saved (26633 records). [2025-10-08T21:43:49.248897] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-08T21:43:49.248992] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STVN took 38.1s. Estimated remaining: 49m 48s. Rate: 7.1 symbols/min [2025-10-08T21:43:49.446606] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:49.456857] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T21:43:49.462458] [INFO ] [REMOTE ] STT: Full fetch complete (74280 records). [2025-10-08T21:43:49.462751] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-08T21:43:49.465625] [DEBUG] [LOCAL ] STXG: Loaded 2465 existing records from primary storage. [2025-10-08T21:43:49.465903] [INFO ] [MAIN ] STXG: Loaded 2465 existing records. [2025-10-08T21:43:49.622772] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-10-08T21:43:49.799708] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:49.815669] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-08T21:43:49.826341] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-08T21:43:49.856594] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-08T21:43:49.856901] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-08T21:43:50.358741] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-08T21:43:50.368151] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T21:43:50.394698] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-08T21:43:50.418094] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-08T21:43:50.423351] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-08T21:43:50.444874] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-08T21:43:50.536531] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-08T21:43:50.571248] [DEBUG] [LOCAL ] STT: Trimmed 74280 records to 50951 (keeping 200 days of data) [2025-10-08T21:43:50.578014] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:50.915003] [DEBUG] [LOCAL ] STT: Primary data saved (50951 records). [2025-10-08T21:43:50.915163] [INFO ] [MAIN ] STT: Full history saved. [2025-10-08T21:43:50.915271] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STT took 46.3s. Estimated remaining: 49m 38s. Rate: 7.1 symbols/min [2025-10-08T21:43:51.101991] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T21:43:51.105582] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:43:51.118071] [DEBUG] [LOCAL ] STXK: Loaded 1500 existing records from primary storage. [2025-10-08T21:43:51.118327] [INFO ] [MAIN ] STXK: Loaded 1500 existing records. [2025-10-08T21:43:51.222754] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-08T21:43:51.360760] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:43:51.361010] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-08T21:43:51.361061] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-08T21:43:51.361250] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-08T21:43:51.361313] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-08T21:43:51.725373] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:43:52.017577] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-10-08T21:43:52.540145] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-08T21:43:52.817605] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-10-08T21:43:52.942624] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T21:43:53.391716] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T21:43:53.617629] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-08T21:43:54.171945] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T21:43:54.417558] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-08T21:43:55.217555] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-08T21:43:55.769069] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-08T21:43:55.879020] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T21:43:56.017550] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-08T21:43:56.414691] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T21:43:56.817580] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-08T21:43:57.237793] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-08T21:43:57.617571] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-08T21:43:58.172736] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T21:43:58.417588] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-08T21:43:58.887517] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T21:43:59.217614] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-08T21:43:59.575340] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-08T21:44:00.017623] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-08T21:44:00.817631] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-08T21:44:01.209270] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-08T21:44:01.514622] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T21:44:01.519114] [INFO ] [REMOTE ] STWD: Full fetch complete (75195 records). [2025-10-08T21:44:01.519265] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-08T21:44:01.622801] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-08T21:44:01.934126] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-08T21:44:01.934351] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-08T21:44:01.935489] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-08T21:44:01.935560] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-08T21:44:01.937261] [DEBUG] [LOCAL ] STWD: Trimmed 75195 records to 51938 (keeping 200 days of data) [2025-10-08T21:44:02.156821] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T21:44:02.275670] [DEBUG] [LOCAL ] STWD: Primary data saved (51938 records). [2025-10-08T21:44:02.275866] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-08T21:44:02.276012] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STWD took 50.7s. Estimated remaining: 49m 31s. Rate: 7.1 symbols/min [2025-10-08T21:44:02.420057] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-08T21:44:02.453944] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:02.454224] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-08T21:44:02.454268] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-08T21:44:02.454391] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-08T21:44:02.454432] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-08T21:44:02.454529] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-08T21:44:02.454578] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-08T21:44:02.848254] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:03.064312] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T21:44:03.217600] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-08T21:44:03.685948] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T21:44:04.017526] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-10-08T21:44:04.394100] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-08T21:44:04.817562] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-08T21:44:05.182621] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-08T21:44:05.617578] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-08T21:44:06.064673] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T21:44:06.417555] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-08T21:44:06.843799] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T21:44:07.217574] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-08T21:44:07.652781] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T21:44:08.017578] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-08T21:44:08.366228] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T21:44:08.817553] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-08T21:44:09.171538] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-08T21:44:09.617582] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-08T21:44:10.041192] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-08T21:44:10.417537] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-08T21:44:10.862091] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-08T21:44:11.217587] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-08T21:44:11.579114] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T21:44:12.017586] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-08T21:44:12.470201] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T21:44:12.817600] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-08T21:44:13.165476] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T21:44:13.617557] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-08T21:44:14.103353] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-08T21:44:14.417560] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-08T21:44:14.694598] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-08T21:44:15.217598] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-08T21:44:15.676603] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T21:44:16.017593] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-08T21:44:16.464742] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T21:44:16.817549] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-08T21:44:17.118164] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-08T21:44:17.617620] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-08T21:44:18.094330] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T21:44:18.417559] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-08T21:44:18.840519] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T21:44:19.217577] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-08T21:44:19.730036] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-08T21:44:20.017570] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-08T21:44:20.386230] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-08T21:44:20.387026] [INFO ] [REMOTE ] STXK: Full fetch complete (2409 records). [2025-10-08T21:44:20.387095] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-08T21:44:20.738727] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-08T21:44:20.738837] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-08T21:44:20.740359] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-08T21:44:20.740416] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-08T21:44:20.740818] [DEBUG] [LOCAL ] STXK: Trimmed 2409 records to 1514 (keeping 200 days of data) [2025-10-08T21:44:20.751744] [DEBUG] [LOCAL ] STXK: Primary data saved (1514 records). [2025-10-08T21:44:20.751914] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-08T21:44:20.752015] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXK took 29.8s. Estimated remaining: 49m 24s. Rate: 7.1 symbols/min [2025-10-08T21:44:20.822791] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-08T21:44:20.921777] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:20.927060] [DEBUG] [LOCAL ] STXT: Loaded 2495 existing records from primary storage. [2025-10-08T21:44:20.927227] [INFO ] [MAIN ] STXT: Loaded 2495 existing records. [2025-10-08T21:44:21.100267] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:21.100486] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-08T21:44:21.100535] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-08T21:44:21.100731] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-08T21:44:21.100791] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-08T21:44:21.357925] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-08T21:44:21.456988] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:21.617530] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-10-08T21:44:22.201890] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T21:44:22.417553] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-08T21:44:22.772356] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-08T21:44:23.217588] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-08T21:44:23.561604] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-08T21:44:24.017574] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-08T21:44:24.338230] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-08T21:44:24.817564] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-08T21:44:25.374275] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-08T21:44:25.617547] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-08T21:44:26.011097] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T21:44:26.011910] [INFO ] [REMOTE ] STXG: Full fetch complete (4117 records). [2025-10-08T21:44:26.011978] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-08T21:44:26.432525] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-08T21:44:26.455384] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-08T21:44:26.455447] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-08T21:44:26.455580] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-08T21:44:26.455618] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-08T21:44:26.456070] [DEBUG] [LOCAL ] STXG: Trimmed 4117 records to 2469 (keeping 200 days of data) [2025-10-08T21:44:26.471606] [DEBUG] [LOCAL ] STXG: Primary data saved (2469 records). [2025-10-08T21:44:26.471732] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-08T21:44:26.471819] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXG took 37.2s. Estimated remaining: 49m 15s. Rate: 7.1 symbols/min [2025-10-08T21:44:26.642219] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:26.646164] [DEBUG] [LOCAL ] STXV: Loaded 1552 existing records from primary storage. [2025-10-08T21:44:26.646328] [INFO ] [MAIN ] STXV: Loaded 1552 existing records. [2025-10-08T21:44:26.834224] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:26.834485] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-08T21:44:26.834547] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-08T21:44:26.834724] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-08T21:44:26.834782] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-08T21:44:26.905423] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-08T21:44:27.195348] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:27.217512] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-10-08T21:44:27.682199] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T21:44:28.017577] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-08T21:44:28.485286] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-08T21:44:28.817595] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-08T21:44:29.617571] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-08T21:44:29.707034] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T21:44:29.707865] [INFO ] [REMOTE ] STXE: Full fetch complete (3532 records). [2025-10-08T21:44:29.707936] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-08T21:44:30.065961] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-08T21:44:30.066044] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-08T21:44:30.066164] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-08T21:44:30.066201] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-08T21:44:30.066555] [DEBUG] [LOCAL ] STXE: Trimmed 3532 records to 2097 (keeping 200 days of data) [2025-10-08T21:44:30.080498] [DEBUG] [LOCAL ] STXE: Primary data saved (2097 records). [2025-10-08T21:44:30.080599] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-08T21:44:30.080741] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXE took 41.7s. Estimated remaining: 49m 6s. Rate: 7.1 symbols/min [2025-10-08T21:44:30.253981] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:30.250711] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-08T21:44:30.312106] [DEBUG] [LOCAL ] STZ: Loaded 52326 existing records from primary storage. [2025-10-08T21:44:30.312522] [INFO ] [MAIN ] STZ: Loaded 52326 existing records. [2025-10-08T21:44:30.422683] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-08T21:44:30.495956] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:30.496302] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-08T21:44:30.496351] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-08T21:44:30.496782] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-10-08T21:44:30.496843] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-08T21:44:30.854994] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:30.994387] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T21:44:31.217537] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-08T21:44:31.666113] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T21:44:32.017562] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-08T21:44:32.362623] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T21:44:32.817596] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-10-08T21:44:33.617589] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-08T21:44:34.088772] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-08T21:44:34.417580] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-08T21:44:34.634109] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-08T21:44:34.886585] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-08T21:44:35.217561] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-08T21:44:35.789499] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-08T21:44:36.017543] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-08T21:44:36.493245] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-08T21:44:36.817555] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-08T21:44:37.617571] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-08T21:44:37.905565] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-08T21:44:37.906296] [INFO ] [REMOTE ] STXM: Full fetch complete (1420 records). [2025-10-08T21:44:37.906367] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-08T21:44:38.112207] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-08T21:44:38.112964] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:44:38.113055] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:44:38.113149] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-08T21:44:38.113260] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-08T21:44:38.113319] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-08T21:44:38.113365] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-08T21:44:38.113431] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXM took 35.8s. Estimated remaining: 48m 57s. Rate: 7.1 symbols/min [2025-10-08T21:44:38.285024] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:38.341128] [DEBUG] [LOCAL ] SU: Loaded 53435 existing records from primary storage. [2025-10-08T21:44:38.341494] [INFO ] [MAIN ] SU: Loaded 53435 existing records. [2025-10-08T21:44:38.427804] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-08T21:44:38.565880] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:38.566282] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-08T21:44:38.566467] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-08T21:44:38.566769] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-08T21:44:38.566833] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-08T21:44:38.920746] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-08T21:44:39.004041] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:39.036028] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-08T21:44:39.217556] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-08T21:44:39.673119] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T21:44:40.017522] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-08T21:44:40.398360] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-08T21:44:40.817562] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-08T21:44:41.617564] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-10-08T21:44:42.417588] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-08T21:44:42.858980] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T21:44:42.898708] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-08T21:44:43.217537] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-08T21:44:43.481325] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T21:44:43.662767] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T21:44:43.663527] [INFO ] [REMOTE ] STXT: Full fetch complete (3912 records). [2025-10-08T21:44:43.663596] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-08T21:44:44.029869] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-08T21:44:44.039280] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-08T21:44:44.039372] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-08T21:44:44.039540] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-08T21:44:44.039585] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-08T21:44:44.040005] [DEBUG] [LOCAL ] STXT: Trimmed 3912 records to 2495 (keeping 200 days of data) [2025-10-08T21:44:44.057619] [DEBUG] [LOCAL ] STXT: Primary data saved (2495 records). [2025-10-08T21:44:44.057771] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-08T21:44:44.057865] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXT took 23.3s. Estimated remaining: 48m 48s. Rate: 7.1 symbols/min [2025-10-08T21:44:44.227302] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:44.275885] [DEBUG] [LOCAL ] SUI: Loaded 41630 existing records from primary storage. [2025-10-08T21:44:44.276225] [INFO ] [MAIN ] SUI: Loaded 41630 existing records. [2025-10-08T21:44:44.457113] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:44.457348] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-08T21:44:44.457428] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-08T21:44:44.458012] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-08T21:44:44.458071] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-08T21:44:44.831511] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-08T21:44:44.838232] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:45.248594] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-08T21:44:45.617593] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-08T21:44:46.017704] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T21:44:46.417539] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-10-08T21:44:47.091392] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T21:44:47.217577] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-08T21:44:47.902585] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T21:44:48.017547] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-08T21:44:48.670203] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T21:44:48.817550] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-08T21:44:49.282294] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-08T21:44:49.617632] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-08T21:44:50.417557] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-08T21:44:50.548219] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:44:51.217533] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-08T21:44:51.483139] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:44:51.518281] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T21:44:51.811492] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T21:44:52.017556] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-08T21:44:52.817601] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-08T21:44:53.189494] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-08T21:44:53.617557] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-08T21:44:54.147749] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-08T21:44:54.166514] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T21:44:54.417538] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-08T21:44:55.217596] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-08T21:44:56.017525] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-08T21:44:56.508148] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T21:44:56.541923] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:44:56.542931] [INFO ] [REMOTE ] STXV: Full fetch complete (2568 records). [2025-10-08T21:44:56.543049] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-08T21:44:56.670546] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T21:44:56.822785] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-08T21:44:56.937520] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-08T21:44:56.937618] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-08T21:44:56.937771] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-08T21:44:56.937890] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-08T21:44:56.938249] [DEBUG] [LOCAL ] STXV: Trimmed 2568 records to 1545 (keeping 200 days of data) [2025-10-08T21:44:56.949034] [DEBUG] [LOCAL ] STXV: Primary data saved (1545 records). [2025-10-08T21:44:56.949224] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-08T21:44:56.949354] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXV took 30.5s. Estimated remaining: 48m 41s. Rate: 7.1 symbols/min [2025-10-08T21:44:57.138256] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:44:57.174146] [DEBUG] [LOCAL ] SUN: Loaded 37843 existing records from primary storage. [2025-10-08T21:44:57.174442] [INFO ] [MAIN ] SUN: Loaded 37843 existing records. [2025-10-08T21:44:57.347554] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:44:57.347871] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-08T21:44:57.347918] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-08T21:44:57.348260] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-08T21:44:57.348317] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-08T21:44:57.617566] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-08T21:44:57.696140] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:44:58.417537] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-08T21:44:58.576580] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T21:44:59.218756] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-08T21:44:59.220612] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T21:45:00.017523] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-08T21:45:00.268158] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-08T21:45:00.817571] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-08T21:45:01.098192] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T21:45:01.429629] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:45:01.617597] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-10-08T21:45:02.417561] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-08T21:45:02.569120] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:45:03.178904] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-08T21:45:03.217503] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-08T21:45:03.307733] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-08T21:45:04.017564] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-08T21:45:04.769079] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T21:45:04.817541] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-08T21:45:05.532329] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T21:45:05.617560] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-08T21:45:06.417531] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-08T21:45:06.652324] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-08T21:45:06.656512] [INFO ] [REMOTE ] STZ: Full fetch complete (75918 records). [2025-10-08T21:45:06.656724] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-08T21:45:07.050004] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-10-08T21:45:07.050262] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-10-08T21:45:07.051835] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-10-08T21:45:07.051952] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-10-08T21:45:07.054106] [DEBUG] [LOCAL ] STZ: Trimmed 75918 records to 52332 (keeping 200 days of data) [2025-10-08T21:45:07.242872] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-08T21:45:07.330532] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T21:45:07.443052] [DEBUG] [LOCAL ] STZ: Primary data saved (52332 records). [2025-10-08T21:45:07.443213] [INFO ] [MAIN ] STZ: Full history saved. [2025-10-08T21:45:07.444180] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STZ took 37.4s. Estimated remaining: 48m 33s. Rate: 7.1 symbols/min [2025-10-08T21:45:07.621839] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:07.670632] [DEBUG] [LOCAL ] SUPV: Loaded 47407 existing records from primary storage. [2025-10-08T21:45:07.671008] [INFO ] [MAIN ] SUPV: Loaded 47407 existing records. [2025-10-08T21:45:07.850125] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:07.850378] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-08T21:45:07.850427] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-08T21:45:07.850901] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-08T21:45:07.850963] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-08T21:45:08.018552] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-08T21:45:08.219581] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:08.269816] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T21:45:08.817504] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-10-08T21:45:08.911284] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T21:45:09.519556] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T21:45:09.617502] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-08T21:45:10.121005] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T21:45:10.417535] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-08T21:45:10.605837] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T21:45:11.217617] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-08T21:45:12.017596] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-08T21:45:12.150607] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:45:12.817532] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-08T21:45:12.871001] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T21:45:13.188444] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T21:45:13.617538] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-08T21:45:14.301814] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T21:45:14.417612] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-08T21:45:15.217525] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-08T21:45:16.017605] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-08T21:45:16.126789] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T21:45:16.415990] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T21:45:16.420358] [INFO ] [REMOTE ] SU: Full fetch complete (77386 records). [2025-10-08T21:45:16.420511] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-08T21:45:16.828342] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-08T21:45:16.832954] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-08T21:45:16.833009] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-08T21:45:16.834083] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-08T21:45:16.834147] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-08T21:45:16.835688] [DEBUG] [LOCAL ] SU: Trimmed 77386 records to 53435 (keeping 200 days of data) [2025-10-08T21:45:17.210796] [DEBUG] [LOCAL ] SU: Primary data saved (53435 records). [2025-10-08T21:45:17.210973] [INFO ] [MAIN ] SU: Full history saved. [2025-10-08T21:45:17.211082] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SU took 39.1s. Estimated remaining: 48m 24s. Rate: 7.1 symbols/min [2025-10-08T21:45:17.384881] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:17.427243] [DEBUG] [LOCAL ] SUZ: Loaded 45520 existing records from primary storage. [2025-10-08T21:45:17.427564] [INFO ] [MAIN ] SUZ: Loaded 45520 existing records. [2025-10-08T21:45:17.618303] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:17.618745] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-08T21:45:17.618856] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-08T21:45:17.619289] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-08T21:45:17.619368] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-08T21:45:17.757599] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-08T21:45:17.906874] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-08T21:45:18.080219] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:18.133635] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T21:45:18.417704] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-08T21:45:18.772999] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (5.16 seconds). [2025-10-08T21:45:19.217575] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-08T21:45:19.273830] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T21:45:19.277818] [INFO ] [REMOTE ] SUI: Full fetch complete (60844 records). [2025-10-08T21:45:19.277987] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-08T21:45:19.733968] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-08T21:45:19.734096] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-08T21:45:19.736415] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-08T21:45:19.736515] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-08T21:45:19.738226] [DEBUG] [LOCAL ] SUI: Trimmed 60844 records to 41672 (keeping 200 days of data) [2025-10-08T21:45:20.021386] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-10-08T21:45:20.020327] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T21:45:20.084107] [DEBUG] [LOCAL ] SUI: Primary data saved (41672 records). [2025-10-08T21:45:20.084268] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-08T21:45:20.084386] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SUI took 36.0s. Estimated remaining: 48m 15s. Rate: 7.1 symbols/min [2025-10-08T21:45:20.263426] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:20.311580] [DEBUG] [LOCAL ] SVV: Loaded 39888 existing records from primary storage. [2025-10-08T21:45:20.312053] [INFO ] [MAIN ] SVV: Loaded 39888 existing records. [2025-10-08T21:45:20.492590] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:20.492852] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-08T21:45:20.493082] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-08T21:45:20.493337] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-08T21:45:20.493394] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-08T21:45:20.818507] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-08T21:45:20.915541] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T21:45:20.921263] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:21.271732] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T21:45:21.617562] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-10-08T21:45:22.195705] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T21:45:22.417554] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-08T21:45:22.974099] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T21:45:23.217612] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-08T21:45:23.960380] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:45:24.017557] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-08T21:45:24.416735] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T21:45:24.817588] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-08T21:45:25.554321] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:45:25.617519] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-08T21:45:26.258336] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T21:45:26.417547] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-08T21:45:27.217577] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-08T21:45:27.318260] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T21:45:27.957875] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T21:45:28.017564] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-08T21:45:28.376540] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T21:45:28.817620] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-08T21:45:29.110159] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T21:45:29.617582] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-08T21:45:30.167530] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T21:45:30.417561] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-08T21:45:31.217627] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-08T21:45:31.268971] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-08T21:45:32.014090] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T21:45:32.025354] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-08T21:45:32.815261] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T21:45:32.824131] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-08T21:45:33.617578] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-08T21:45:33.664819] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T21:45:34.417550] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-08T21:45:34.533499] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T21:45:34.538096] [INFO ] [REMOTE ] SUPV: Full fetch complete (68436 records). [2025-10-08T21:45:34.538287] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-08T21:45:35.024122] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-08T21:45:35.024291] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-08T21:45:35.025402] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-08T21:45:35.025623] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-08T21:45:35.048209] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-08T21:45:35.058425] [DEBUG] [LOCAL ] SUPV: Trimmed 68436 records to 47466 (keeping 200 days of data) [2025-10-08T21:45:35.242521] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-08T21:45:35.358358] [DEBUG] [LOCAL ] SUPV: Primary data saved (47466 records). [2025-10-08T21:45:35.358539] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-08T21:45:35.359381] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUPV took 27.9s. Estimated remaining: 48m 8s. Rate: 7.1 symbols/min [2025-10-08T21:45:35.540048] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:35.596434] [DEBUG] [LOCAL ] SW: Loaded 53183 existing records from primary storage. [2025-10-08T21:45:35.596820] [INFO ] [MAIN ] SW: Loaded 53183 existing records. [2025-10-08T21:45:35.777583] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:35.778096] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-08T21:45:35.778269] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-08T21:45:35.778704] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-08T21:45:35.778788] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-08T21:45:36.027407] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-08T21:45:36.131256] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T21:45:36.202520] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:36.496821] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T21:45:36.817553] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-08T21:45:37.617527] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-08T21:45:37.640934] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-08T21:45:38.338145] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:45:38.417535] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-10-08T21:45:39.217570] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-08T21:45:39.267275] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:45:40.017586] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-08T21:45:40.075801] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T21:45:40.744102] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T21:45:40.817604] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-08T21:45:40.937294] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T21:45:40.942534] [INFO ] [REMOTE ] SUN: Full fetch complete (55211 records). [2025-10-08T21:45:40.942741] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-08T21:45:41.376238] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-08T21:45:41.376385] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-08T21:45:41.377879] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-08T21:45:41.377946] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-08T21:45:41.379843] [DEBUG] [LOCAL ] SUN: Trimmed 55211 records to 37938 (keeping 200 days of data) [2025-10-08T21:45:41.617694] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-08T21:45:41.648044] [DEBUG] [LOCAL ] SUN: Primary data saved (37938 records). [2025-10-08T21:45:41.648232] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-08T21:45:41.648361] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SUN took 44.7s. Estimated remaining: 47m 59s. Rate: 7.1 symbols/min [2025-10-08T21:45:41.844338] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:41.903397] [DEBUG] [LOCAL ] SWK: Loaded 52434 existing records from primary storage. [2025-10-08T21:45:41.903851] [INFO ] [MAIN ] SWK: Loaded 52434 existing records. [2025-10-08T21:45:42.097614] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:42.097984] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-08T21:45:42.098039] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-08T21:45:42.098584] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-08T21:45:42.098686] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-08T21:45:42.419228] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-08T21:45:42.521760] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:42.597956] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T21:45:42.950283] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T21:45:43.217574] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-10-08T21:45:43.651394] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T21:45:44.017564] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-08T21:45:44.817562] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-08T21:45:44.909875] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T21:45:45.617558] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-08T21:45:46.222850] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T21:45:46.417506] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-08T21:45:46.545118] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T21:45:46.912806] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T21:45:47.217560] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-08T21:45:47.930610] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T21:45:48.017526] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-08T21:45:48.151955] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T21:45:48.155850] [INFO ] [REMOTE ] SUZ: Full fetch complete (66622 records). [2025-10-08T21:45:48.155962] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-08T21:45:48.640612] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-08T21:45:48.640821] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-08T21:45:48.642029] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-08T21:45:48.642106] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-08T21:45:48.643661] [DEBUG] [LOCAL ] SUZ: Trimmed 66622 records to 45553 (keeping 200 days of data) [2025-10-08T21:45:48.841798] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-08T21:45:48.908750] [DEBUG] [LOCAL ] SUZ: Primary data saved (45553 records). [2025-10-08T21:45:48.908890] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-08T21:45:48.908979] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUZ took 31.7s. Estimated remaining: 47m 50s. Rate: 7.1 symbols/min [2025-10-08T21:45:49.082847] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:49.113832] [DEBUG] [LOCAL ] SWX: Loaded 31242 existing records from primary storage. [2025-10-08T21:45:49.114119] [INFO ] [MAIN ] SWX: Loaded 31242 existing records. [2025-10-08T21:45:49.301572] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:49.302008] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-08T21:45:49.302096] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-08T21:45:49.302545] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-08T21:45:49.302607] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-08T21:45:49.623072] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-08T21:45:49.684212] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T21:45:49.721629] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:50.417584] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-08T21:45:50.718361] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-08T21:45:51.217546] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-08T21:45:51.337929] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T21:45:52.017575] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-10-08T21:45:52.144813] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:45:52.817564] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-08T21:45:52.872224] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:45:53.233022] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-08T21:45:53.617560] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-08T21:45:54.417539] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-08T21:45:54.688624] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:45:54.981333] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T21:45:55.217620] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-08T21:45:55.971570] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T21:45:56.017509] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-08T21:45:56.783411] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:45:56.817494] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-08T21:45:57.064498] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T21:45:57.068518] [INFO ] [REMOTE ] SVV: Full fetch complete (56676 records). [2025-10-08T21:45:57.068718] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-08T21:45:57.474154] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-08T21:45:57.474239] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-08T21:45:57.475085] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-08T21:45:57.475147] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-08T21:45:57.476455] [DEBUG] [LOCAL ] SVV: Trimmed 56676 records to 39949 (keeping 200 days of data) [2025-10-08T21:45:57.639484] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-08T21:45:57.711255] [DEBUG] [LOCAL ] SVV: Primary data saved (39949 records). [2025-10-08T21:45:57.711395] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-08T21:45:57.711491] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SVV took 37.6s. Estimated remaining: 47m 42s. Rate: 7.1 symbols/min [2025-10-08T21:45:57.884009] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:45:57.892061] [DEBUG] [LOCAL ] SWZ: Loaded 6079 existing records from primary storage. [2025-10-08T21:45:57.892256] [INFO ] [MAIN ] SWZ: Loaded 6079 existing records. [2025-10-08T21:45:58.072271] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:45:58.072519] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-08T21:45:58.072589] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-08T21:45:58.072834] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-08T21:45:58.072891] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-08T21:45:58.435606] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-08T21:45:58.441335] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:45:58.580270] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T21:45:59.217548] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-10-08T21:45:59.470964] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T21:45:59.601230] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-08T21:45:59.695079] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-08T21:46:00.017592] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-08T21:46:00.680701] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-08T21:46:00.817597] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-08T21:46:01.617552] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-08T21:46:02.417575] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-08T21:46:02.622749] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T21:46:03.217574] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-08T21:46:03.342589] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:46:03.487616] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T21:46:04.017559] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-08T21:46:04.614263] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T21:46:04.817522] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-08T21:46:04.948195] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T21:46:05.617571] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-08T21:46:06.163292] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T21:46:06.417577] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-08T21:46:07.226563] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-08T21:46:07.249133] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T21:46:07.371211] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-08T21:46:08.017531] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-08T21:46:08.542073] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T21:46:08.817506] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-08T21:46:08.867824] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:46:09.617561] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-08T21:46:10.166897] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:46:10.417604] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-08T21:46:11.217580] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-08T21:46:11.401495] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:46:11.450541] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T21:46:12.004215] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-08T21:46:12.018173] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-08T21:46:12.707046] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T21:46:12.817608] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-08T21:46:13.484316] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-08T21:46:13.617543] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-08T21:46:14.417617] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-08T21:46:14.703070] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T21:46:15.004090] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T21:46:15.217553] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-08T21:46:16.017595] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-08T21:46:16.655221] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-08T21:46:16.701418] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T21:46:16.705372] [INFO ] [REMOTE ] SWK: Full fetch complete (75312 records). [2025-10-08T21:46:16.705485] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-08T21:46:16.822740] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-08T21:46:17.111184] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-08T21:46:17.111294] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-08T21:46:17.112619] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-08T21:46:17.112728] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-08T21:46:17.114433] [DEBUG] [LOCAL ] SWK: Trimmed 75312 records to 52432 (keeping 200 days of data) [2025-10-08T21:46:17.449732] [DEBUG] [LOCAL ] SWK: Primary data saved (52432 records). [2025-10-08T21:46:17.450061] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-08T21:46:17.450190] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SWK took 35.8s. Estimated remaining: 47m 35s. Rate: 7.1 symbols/min [2025-10-08T21:46:17.619914] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:46:17.619998] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-08T21:46:17.659008] [DEBUG] [LOCAL ] SXC: Loaded 41436 existing records from primary storage. [2025-10-08T21:46:17.659368] [INFO ] [MAIN ] SXC: Loaded 41436 existing records. [2025-10-08T21:46:17.841416] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:46:17.841722] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-08T21:46:17.841779] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-08T21:46:17.842130] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-08T21:46:17.842189] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-08T21:46:18.274090] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:46:18.277465] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T21:46:18.394793] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T21:46:18.417540] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-10-08T21:46:19.217570] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-08T21:46:19.822246] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T21:46:19.960080] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T21:46:20.017540] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-08T21:46:20.817597] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-08T21:46:21.367241] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T21:46:21.368278] [INFO ] [REMOTE ] SWZ: Full fetch complete (8170 records). [2025-10-08T21:46:21.368522] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-08T21:46:21.617860] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-08T21:46:21.747533] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-08T21:46:21.756373] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-08T21:46:21.772563] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-08T21:46:21.772932] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-08T21:46:21.775921] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T21:46:21.787906] [DEBUG] [LOCAL ] SWZ: Trimmed 8170 records to 6101 (keeping 200 days of data) [2025-10-08T21:46:21.824204] [DEBUG] [LOCAL ] SWZ: Primary data saved (6101 records). [2025-10-08T21:46:21.824335] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-08T21:46:21.824424] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SWZ took 24.1s. Estimated remaining: 47m 26s. Rate: 7.1 symbols/min [2025-10-08T21:46:21.993951] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:46:22.008545] [DEBUG] [LOCAL ] SXI: Loaded 11693 existing records from primary storage. [2025-10-08T21:46:22.008825] [INFO ] [MAIN ] SXI: Loaded 11693 existing records. [2025-10-08T21:46:22.184823] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:46:22.185099] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-08T21:46:22.185147] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-08T21:46:22.185380] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-08T21:46:22.185439] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-08T21:46:22.422621] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-08T21:46:22.537522] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:46:23.154972] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T21:46:23.159393] [INFO ] [REMOTE ] SW: Full fetch complete (76816 records). [2025-10-08T21:46:23.159619] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-08T21:46:23.224176] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-10-08T21:46:23.568604] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-08T21:46:23.568735] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-08T21:46:23.570048] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-08T21:46:23.570120] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-08T21:46:23.571809] [DEBUG] [LOCAL ] SW: Trimmed 76816 records to 53184 (keeping 200 days of data) [2025-10-08T21:46:23.986336] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T21:46:24.018588] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-08T21:46:24.032997] [DEBUG] [LOCAL ] SW: Primary data saved (53184 records). [2025-10-08T21:46:24.033230] [INFO ] [MAIN ] SW: Full history saved. [2025-10-08T21:46:24.034510] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SW took 48.7s. Estimated remaining: 47m 17s. Rate: 7.1 symbols/min [2025-10-08T21:46:24.232928] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T21:46:24.391957] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:46:24.436104] [DEBUG] [LOCAL ] SXT: Loaded 29823 existing records from primary storage. [2025-10-08T21:46:24.436620] [INFO ] [MAIN ] SXT: Loaded 29823 existing records. [2025-10-08T21:46:24.696968] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:46:24.697285] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-08T21:46:24.697349] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-08T21:46:24.697682] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-08T21:46:24.697747] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-08T21:46:24.819420] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-08T21:46:25.112311] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:46:25.123783] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T21:46:25.127106] [INFO ] [REMOTE ] SWX: Full fetch complete (43996 records). [2025-10-08T21:46:25.127302] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-08T21:46:25.550105] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T21:46:25.556117] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-08T21:46:25.556269] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-08T21:46:25.557976] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-08T21:46:25.558164] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-08T21:46:25.559753] [DEBUG] [LOCAL ] SWX: Trimmed 43996 records to 31200 (keeping 200 days of data) [2025-10-08T21:46:25.621436] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-08T21:46:25.779775] [DEBUG] [LOCAL ] SWX: Primary data saved (31200 records). [2025-10-08T21:46:25.779975] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-08T21:46:25.780080] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWX took 36.9s. Estimated remaining: 47m 7s. Rate: 7.1 symbols/min [2025-10-08T21:46:25.960989] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:46:26.016211] [DEBUG] [LOCAL ] SYF: Loaded 53443 existing records from primary storage. [2025-10-08T21:46:26.016708] [INFO ] [MAIN ] SYF: Loaded 53443 existing records. [2025-10-08T21:46:26.212714] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:46:26.213018] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-08T21:46:26.213075] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-08T21:46:26.213351] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-08T21:46:26.213423] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-08T21:46:26.422907] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T21:46:26.422221] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-08T21:46:26.618574] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:46:27.217583] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-10-08T21:46:28.017537] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-08T21:46:28.058547] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T21:46:28.165067] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T21:46:28.823511] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-08T21:46:28.825866] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T21:46:29.617594] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-08T21:46:29.876751] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T21:46:30.332976] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-08T21:46:30.417555] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-08T21:46:31.217541] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-08T21:46:31.606085] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T21:46:32.017590] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-08T21:46:32.822810] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-10-08T21:46:32.842272] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T21:46:33.246905] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T21:46:33.617567] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-08T21:46:34.332386] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-08T21:46:34.417536] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-08T21:46:35.071213] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T21:46:35.217554] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-08T21:46:35.910523] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T21:46:36.017530] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-08T21:46:36.714218] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T21:46:36.817538] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-08T21:46:37.617541] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-08T21:46:37.750455] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T21:46:37.947455] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T21:46:38.417614] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-08T21:46:38.849386] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T21:46:39.217595] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-08T21:46:39.668969] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:46:39.785316] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T21:46:40.017560] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-08T21:46:40.820510] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T21:46:40.819519] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-08T21:46:41.617601] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-08T21:46:42.417553] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-08T21:46:42.446073] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T21:46:42.558943] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T21:46:43.217558] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-08T21:46:44.017529] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-08T21:46:44.394894] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-08T21:46:44.526865] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-08T21:46:44.817516] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-08T21:46:44.946826] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T21:46:45.617575] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-08T21:46:46.054131] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T21:46:46.057608] [INFO ] [REMOTE ] SXC: Full fetch complete (60993 records). [2025-10-08T21:46:46.057728] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-08T21:46:46.432246] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-08T21:46:46.454378] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-08T21:46:46.456075] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-08T21:46:46.456922] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T21:46:46.461207] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-08T21:46:46.461616] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-08T21:46:46.462869] [DEBUG] [LOCAL ] SXC: Trimmed 60993 records to 41425 (keeping 200 days of data) [2025-10-08T21:46:46.710366] [DEBUG] [LOCAL ] SXC: Primary data saved (41425 records). [2025-10-08T21:46:46.710513] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-08T21:46:46.710595] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXC took 29.3s. Estimated remaining: 47m 1s. Rate: 7.1 symbols/min [2025-10-08T21:46:47.217721] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-08T21:46:47.692546] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-08T21:46:48.017702] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-08T21:46:48.817579] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-08T21:46:48.925342] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T21:46:49.444857] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-08T21:46:49.446261] [INFO ] [REMOTE ] SXI: Full fetch complete (15089 records). [2025-10-08T21:46:49.446333] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-08T21:46:49.627249] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-08T21:46:49.657841] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T21:46:49.875353] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-08T21:46:49.875454] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-08T21:46:49.875836] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-08T21:46:49.875901] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-08T21:46:49.876708] [DEBUG] [LOCAL ] SXI: Trimmed 15089 records to 11669 (keeping 200 days of data) [2025-10-08T21:46:49.960984] [DEBUG] [LOCAL ] SXI: Primary data saved (11669 records). [2025-10-08T21:46:49.961162] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-08T21:46:49.961268] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXI took 28.1s. Estimated remaining: 46m 51s. Rate: 7.1 symbols/min [2025-10-08T21:46:50.417569] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-08T21:46:51.626814] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T21:46:51.639792] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-08T21:46:51.776519] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T21:46:52.017619] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-08T21:46:53.490437] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T21:46:53.521494] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T21:46:53.519991] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-08T21:46:53.617546] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-08T21:46:54.802972] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T21:46:54.806001] [INFO ] [REMOTE ] SXT: Full fetch complete (38992 records). [2025-10-08T21:46:54.806143] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-08T21:46:55.219586] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-08T21:46:55.219723] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-08T21:46:55.220612] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-08T21:46:55.220753] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-08T21:46:55.221836] [DEBUG] [LOCAL ] SXT: Trimmed 38992 records to 29829 (keeping 200 days of data) [2025-10-08T21:46:55.415015] [DEBUG] [LOCAL ] SXT: Primary data saved (29829 records). [2025-10-08T21:46:55.415152] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-08T21:46:55.415239] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 31.4s. Estimated remaining: 46m 42s. Rate: 7.1 symbols/min [2025-10-08T21:46:55.466218] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T21:46:55.478016] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-08T21:46:57.297980] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T21:46:57.310590] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-08T21:46:59.093367] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:46:59.106597] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-08T21:46:59.718481] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T21:46:59.722741] [INFO ] [REMOTE ] SYF: Full fetch complete (77336 records). [2025-10-08T21:46:59.722906] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-08T21:47:00.126434] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-08T21:47:00.126679] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-08T21:47:00.128402] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-08T21:47:00.128531] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-08T21:47:00.130264] [DEBUG] [LOCAL ] SYF: Trimmed 77336 records to 53446 (keeping 200 days of data) [2025-10-08T21:47:00.485339] [DEBUG] [LOCAL ] SYF: Primary data saved (53446 records). [2025-10-08T21:47:00.485506] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-08T21:47:00.485606] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SYF took 34.7s. Estimated remaining: 46m 33s. Rate: 7.1 symbols/min [2025-10-08T21:47:01.192044] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:01.265468] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:01.264225] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:01.286507] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:01.390207] [DEBUG] [LOCAL ] TAC: Loaded 42620 existing records from primary storage. [2025-10-08T21:47:01.392400] [INFO ] [MAIN ] TAC: Loaded 42620 existing records. [2025-10-08T21:47:01.398387] [DEBUG] [LOCAL ] SYY: Loaded 53232 existing records from primary storage. [2025-10-08T21:47:01.423175] [INFO ] [MAIN ] SYY: Loaded 53232 existing records. [2025-10-08T21:47:01.527141] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-08T21:47:01.598715] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-08T21:47:01.593050] [DEBUG] [LOCAL ] SYK: Loaded 46879 existing records from primary storage. [2025-10-08T21:47:01.689902] [INFO ] [MAIN ] SYK: Loaded 46879 existing records. [2025-10-08T21:47:01.804759] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:01.935463] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-08T21:47:01.957838] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-08T21:47:01.989016] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-08T21:47:01.957723] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:02.008638] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-08T21:47:02.009186] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-08T21:47:02.008439] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-08T21:47:02.035430] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-08T21:47:02.071265] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-08T21:47:02.323349] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:02.362598] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-08T21:47:02.326854] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:02.398199] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-08T21:47:02.382486] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-08T21:47:02.415598] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-08T21:47:02.425536] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-08T21:47:02.425726] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-08T21:47:02.456945] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-08T21:47:02.470338] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-08T21:47:03.276902] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:03.355631] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-10-08T21:47:03.582881] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:03.608576] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-10-08T21:47:03.794293] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:03.790430] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:03.795010] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-10-08T21:47:03.795268] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-10-08T21:47:05.223713] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T21:47:05.233288] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-08T21:47:05.454436] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T21:47:05.465449] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-08T21:47:05.570070] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:47:05.579528] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-08T21:47:05.849481] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-08T21:47:05.860498] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-08T21:47:06.891286] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T21:47:06.901077] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-08T21:47:07.270722] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T21:47:07.281818] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-08T21:47:07.361964] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T21:47:07.372216] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-08T21:47:08.184366] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T21:47:08.194197] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-08T21:47:08.233608] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-08T21:47:08.245802] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-08T21:47:09.076702] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T21:47:09.088390] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-08T21:47:09.170848] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T21:47:09.180463] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-08T21:47:09.920431] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:47:09.930764] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-08T21:47:10.536910] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-08T21:47:10.548278] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-08T21:47:10.642675] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T21:47:10.653811] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-08T21:47:10.928593] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T21:47:11.217567] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-08T21:47:11.333137] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T21:47:12.017550] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-08T21:47:12.835605] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-08T21:47:12.884130] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-08T21:47:12.886765] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-08T21:47:13.165317] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T21:47:13.262605] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-08T21:47:13.617574] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-08T21:47:14.417526] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-08T21:47:14.519254] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T21:47:15.230861] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-08T21:47:15.237173] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T21:47:16.017564] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-08T21:47:16.817709] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-08T21:47:17.022987] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T21:47:17.070274] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-08T21:47:17.621248] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-08T21:47:17.628226] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:47:18.423224] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-08T21:47:18.449367] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T21:47:19.217570] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-08T21:47:19.350848] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T21:47:19.576370] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T21:47:20.017567] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-08T21:47:20.817589] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-08T21:47:21.555458] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-08T21:47:21.617524] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-08T21:47:21.678275] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T21:47:22.344273] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T21:47:22.417491] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-08T21:47:23.217572] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-08T21:47:23.367940] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T21:47:23.865354] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T21:47:24.017545] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-08T21:47:24.817557] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-08T21:47:25.415805] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-08T21:47:25.617555] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-08T21:47:26.019584] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T21:47:26.180809] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T21:47:26.417573] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-08T21:47:27.217600] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-08T21:47:28.017519] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-08T21:47:28.121066] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-08T21:47:28.167331] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T21:47:28.206708] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-08T21:47:28.211235] [INFO ] [REMOTE ] SYY: Full fetch complete (76987 records). [2025-10-08T21:47:28.211431] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-08T21:47:28.578609] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T21:47:28.634514] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-08T21:47:28.633806] [INFO ] [REMOTE ] TAC: Full fetch complete (63924 records). [2025-10-08T21:47:28.634633] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-08T21:47:28.634764] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-08T21:47:28.635974] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-08T21:47:28.636318] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-08T21:47:28.751955] [DEBUG] [LOCAL ] SYY: Trimmed 76987 records to 53234 (keeping 200 days of data) [2025-10-08T21:47:28.851224] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-08T21:47:29.157573] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-08T21:47:29.157947] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-08T21:47:29.159397] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-08T21:47:29.159511] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-08T21:47:29.164430] [DEBUG] [LOCAL ] TAC: Trimmed 63924 records to 42688 (keeping 200 days of data) [2025-10-08T21:47:29.592299] [DEBUG] [LOCAL ] TAC: Primary data saved (42688 records). [2025-10-08T21:47:29.592527] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-08T21:47:29.628729] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-08T21:47:29.629180] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. TAC took 29.1s. Estimated remaining: 46m 28s. Rate: 7.1 symbols/min [2025-10-08T21:47:29.787125] [DEBUG] [LOCAL ] SYY: Primary data saved (53234 records). [2025-10-08T21:47:29.801258] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-08T21:47:29.812414] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T21:47:29.812583] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 29.3s. Estimated remaining: 46m 19s. Rate: 7.1 symbols/min [2025-10-08T21:47:29.832110] [INFO ] [REMOTE ] SYK: Full fetch complete (68927 records). [2025-10-08T21:47:29.848187] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-08T21:47:29.929934] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:30.193711] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:30.366487] [DEBUG] [LOCAL ] TAK: Loaded 50004 existing records from primary storage. [2025-10-08T21:47:30.366838] [INFO ] [MAIN ] TAK: Loaded 50004 existing records. [2025-10-08T21:47:30.650187] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-08T21:47:30.689715] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-08T21:47:30.692672] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:30.710332] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-08T21:47:30.710493] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-08T21:47:30.710899] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-08T21:47:30.710973] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-08T21:47:30.711344] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-08T21:47:30.711463] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-08T21:47:30.744721] [DEBUG] [LOCAL ] TAL: Loaded 51852 existing records from primary storage. [2025-10-08T21:47:30.762919] [DEBUG] [LOCAL ] SYK: Trimmed 68927 records to 46882 (keeping 200 days of data) [2025-10-08T21:47:30.762780] [INFO ] [MAIN ] TAL: Loaded 51852 existing records. [2025-10-08T21:47:31.272590] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:31.292768] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-08T21:47:31.296232] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-08T21:47:31.297675] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-08T21:47:31.303539] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-08T21:47:31.433199] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:31.448299] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-10-08T21:47:31.768194] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:31.769192] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-10-08T21:47:31.969138] [DEBUG] [LOCAL ] SYK: Primary data saved (46882 records). [2025-10-08T21:47:31.969398] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-08T21:47:31.969716] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYK took 31.5s. Estimated remaining: 46m 9s. Rate: 7.1 symbols/min [2025-10-08T21:47:32.175133] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:32.171925] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T21:47:32.186826] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-08T21:47:32.232780] [DEBUG] [LOCAL ] TALO: Loaded 50818 existing records from primary storage. [2025-10-08T21:47:32.233132] [INFO ] [MAIN ] TALO: Loaded 50818 existing records. [2025-10-08T21:47:32.408517] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:32.408770] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-08T21:47:32.408821] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-08T21:47:32.409014] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-08T21:47:32.409101] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-08T21:47:32.772206] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:32.817483] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-10-08T21:47:33.075091] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T21:47:33.489471] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T21:47:33.617524] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-08T21:47:34.140983] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T21:47:34.224213] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-08T21:47:34.417508] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-08T21:47:34.737897] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-08T21:47:34.741970] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-10-08T21:47:34.742099] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-08T21:47:35.137752] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-08T21:47:35.137969] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-08T21:47:35.139138] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-08T21:47:35.139234] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-08T21:47:35.141106] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 53798 (keeping 200 days of data) [2025-10-08T21:47:35.231294] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-08T21:47:35.298823] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:47:35.546885] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-08T21:47:35.547008] [INFO ] [MAIN ] T: Full history saved. [2025-10-08T21:47:35.547943] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 35.1s. Estimated remaining: 45m 60s. Rate: 7.1 symbols/min [2025-10-08T21:47:35.718904] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:47:35.774124] [DEBUG] [LOCAL ] TAP: Loaded 52914 existing records from primary storage. [2025-10-08T21:47:35.774510] [INFO ] [MAIN ] TAP: Loaded 52914 existing records. [2025-10-08T21:47:35.955489] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:47:35.955795] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-08T21:47:35.955847] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-08T21:47:35.956061] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-08T21:47:35.956117] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-08T21:47:36.022741] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-08T21:47:36.310185] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:47:36.817506] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-08T21:47:37.015236] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T21:47:37.377345] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:47:37.617537] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-08T21:47:38.056468] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T21:47:38.417566] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-08T21:47:39.217589] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-10-08T21:47:39.256687] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T21:47:40.017588] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-08T21:47:40.331353] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T21:47:40.817598] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-08T21:47:40.974939] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T21:47:41.309566] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T21:47:41.617529] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-08T21:47:42.417532] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-08T21:47:42.531713] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T21:47:43.221245] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-08T21:47:43.228010] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T21:47:43.773010] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T21:47:44.017588] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-08T21:47:44.817532] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-08T21:47:45.145342] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T21:47:45.284421] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-08T21:47:45.617580] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-08T21:47:46.417538] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-08T21:47:46.617043] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T21:47:47.077398] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T21:47:47.217506] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-08T21:47:48.017622] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-08T21:47:48.105337] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T21:47:48.817558] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-08T21:47:48.948714] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T21:47:49.503981] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-08T21:47:49.617607] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-08T21:47:50.417615] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-08T21:47:50.673558] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:47:50.798777] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:47:51.217610] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-08T21:47:52.017580] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-08T21:47:52.228868] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T21:47:52.641540] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-08T21:47:52.817610] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-08T21:47:53.200112] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:47:53.617600] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-08T21:47:54.417635] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-08T21:47:54.489874] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T21:47:55.222591] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-08T21:47:55.230636] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T21:47:55.908544] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T21:47:56.017597] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-08T21:47:56.817498] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-08T21:47:57.073586] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T21:47:57.617571] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-08T21:47:57.834231] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T21:47:58.410915] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T21:47:58.420862] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-08T21:47:59.103679] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T21:47:59.217551] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-08T21:48:00.017592] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-08T21:48:00.122715] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T21:48:00.544397] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T21:48:00.548427] [INFO ] [REMOTE ] TAK: Full fetch complete (71725 records). [2025-10-08T21:48:00.548574] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-08T21:48:00.822787] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-08T21:48:00.956356] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-08T21:48:00.956450] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-08T21:48:00.957487] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-08T21:48:00.957553] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-08T21:48:00.959106] [DEBUG] [LOCAL ] TAK: Trimmed 71725 records to 49986 (keeping 200 days of data) [2025-10-08T21:48:01.271961] [DEBUG] [LOCAL ] TAK: Primary data saved (49986 records). [2025-10-08T21:48:01.272174] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-08T21:48:01.272307] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TAK took 31.6s. Estimated remaining: 45m 54s. Rate: 7.1 symbols/min [2025-10-08T21:48:01.451186] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:01.465616] [DEBUG] [LOCAL ] TBB: Loaded 11674 existing records from primary storage. [2025-10-08T21:48:01.465889] [INFO ] [MAIN ] TBB: Loaded 11674 existing records. [2025-10-08T21:48:01.622821] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-08T21:48:01.669565] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:01.670152] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-08T21:48:01.670356] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-08T21:48:01.670771] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-08T21:48:01.670845] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-08T21:48:02.013046] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T21:48:02.105800] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:02.417848] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-10-08T21:48:02.647371] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T21:48:03.217572] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-08T21:48:03.522425] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T21:48:03.615502] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T21:48:04.017570] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-08T21:48:04.445686] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:48:04.449572] [INFO ] [REMOTE ] TAL: Full fetch complete (75457 records). [2025-10-08T21:48:04.449758] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-08T21:48:04.726440] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-08T21:48:04.836945] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-08T21:48:04.862351] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-08T21:48:04.862426] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-08T21:48:04.863607] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-08T21:48:04.863789] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-08T21:48:04.865415] [DEBUG] [LOCAL ] TAL: Trimmed 75457 records to 51818 (keeping 200 days of data) [2025-10-08T21:48:05.171970] [DEBUG] [LOCAL ] TAL: Primary data saved (51818 records). [2025-10-08T21:48:05.172147] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-08T21:48:05.172281] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAL took 35.3s. Estimated remaining: 45m 45s. Rate: 7.1 symbols/min [2025-10-08T21:48:05.345937] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:05.379620] [DEBUG] [LOCAL ] TBBB: Loaded 35662 existing records from primary storage. [2025-10-08T21:48:05.379975] [INFO ] [MAIN ] TBBB: Loaded 35662 existing records. [2025-10-08T21:48:05.555759] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:05.555967] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-08T21:48:05.556036] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-08T21:48:05.556453] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-08T21:48:05.556515] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-08T21:48:05.622688] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-08T21:48:05.666907] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T21:48:05.932939] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:06.417551] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-08T21:48:07.217560] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-10-08T21:48:07.288940] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T21:48:07.320919] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T21:48:08.017600] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-08T21:48:08.205600] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T21:48:08.817578] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-08T21:48:08.901620] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-08T21:48:09.617605] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-08T21:48:10.118184] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T21:48:10.122084] [INFO ] [REMOTE ] TALO: Full fetch complete (73266 records). [2025-10-08T21:48:10.122193] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-08T21:48:10.426036] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-08T21:48:10.530106] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-08T21:48:10.530207] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-08T21:48:10.531261] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-08T21:48:10.531325] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-08T21:48:10.532874] [DEBUG] [LOCAL ] TALO: Trimmed 73266 records to 50854 (keeping 200 days of data) [2025-10-08T21:48:10.717531] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T21:48:10.843422] [DEBUG] [LOCAL ] TALO: Primary data saved (50854 records). [2025-10-08T21:48:10.843606] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-08T21:48:10.843762] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TALO took 38.9s. Estimated remaining: 45m 36s. Rate: 7.1 symbols/min [2025-10-08T21:48:11.010926] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:11.032296] [DEBUG] [LOCAL ] TBI: Loaded 22538 existing records from primary storage. [2025-10-08T21:48:11.032562] [INFO ] [MAIN ] TBI: Loaded 22538 existing records. [2025-10-08T21:48:11.207316] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:11.207673] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-08T21:48:11.207732] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-08T21:48:11.208007] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-08T21:48:11.208065] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-08T21:48:11.228152] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-08T21:48:11.571235] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:11.955482] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T21:48:12.017504] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-08T21:48:12.326494] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T21:48:12.817523] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-08T21:48:12.829743] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-08T21:48:13.622754] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-08T21:48:13.659735] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T21:48:14.299065] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T21:48:14.417583] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-08T21:48:15.217582] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-08T21:48:15.900070] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-08T21:48:15.904170] [INFO ] [REMOTE ] TAP: Full fetch complete (76201 records). [2025-10-08T21:48:15.904289] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-08T21:48:16.022811] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-08T21:48:16.315004] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-08T21:48:16.315197] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-08T21:48:16.316301] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-08T21:48:16.316389] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-08T21:48:16.318017] [DEBUG] [LOCAL ] TAP: Trimmed 76201 records to 52922 (keeping 200 days of data) [2025-10-08T21:48:16.430983] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T21:48:16.659124] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-08T21:48:16.679146] [DEBUG] [LOCAL ] TAP: Primary data saved (52922 records). [2025-10-08T21:48:16.679260] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-08T21:48:16.681373] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAP took 41.1s. Estimated remaining: 45m 27s. Rate: 7.1 symbols/min [2025-10-08T21:48:16.824271] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-08T21:48:16.849916] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:16.850113] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-08T21:48:16.850157] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-08T21:48:16.850264] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-08T21:48:16.850305] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-08T21:48:16.850344] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-08T21:48:16.850375] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-08T21:48:17.205815] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:17.617563] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-08T21:48:18.331106] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:48:18.332531] [INFO ] [REMOTE ] TBB: Full fetch complete (17218 records). [2025-10-08T21:48:18.332707] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-08T21:48:18.421930] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-10-08T21:48:18.431333] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T21:48:18.751099] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-08T21:48:18.751184] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-08T21:48:18.751589] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-08T21:48:18.751628] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-08T21:48:18.752246] [DEBUG] [LOCAL ] TBB: Trimmed 17218 records to 11692 (keeping 200 days of data) [2025-10-08T21:48:18.838001] [DEBUG] [LOCAL ] TBB: Primary data saved (11692 records). [2025-10-08T21:48:18.838161] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-08T21:48:18.838277] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 17.6s. Estimated remaining: 45m 18s. Rate: 7.1 symbols/min [2025-10-08T21:48:19.019243] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:19.026120] [DEBUG] [LOCAL ] TBN: Loaded 3840 existing records from primary storage. [2025-10-08T21:48:19.026377] [INFO ] [MAIN ] TBN: Loaded 3840 existing records. [2025-10-08T21:48:19.211699] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:19.211954] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-08T21:48:19.212002] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-08T21:48:19.212173] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-08T21:48:19.212232] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-08T21:48:19.223216] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-10-08T21:48:19.593968] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:19.596325] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-08T21:48:19.610158] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T21:48:20.017551] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-08T21:48:20.817586] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-10-08T21:48:20.995801] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-08T21:48:21.354220] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-08T21:48:21.617560] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-08T21:48:22.192615] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T21:48:22.417555] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-08T21:48:23.217559] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-08T21:48:23.562961] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-08T21:48:23.973974] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T21:48:24.017528] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-08T21:48:24.817519] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-08T21:48:25.042563] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T21:48:25.430174] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T21:48:25.617566] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-08T21:48:26.417552] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-08T21:48:26.683836] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T21:48:26.985116] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T21:48:27.217550] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-08T21:48:28.017553] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-08T21:48:28.770935] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T21:48:28.822980] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-08T21:48:28.832070] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T21:48:29.170705] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T21:48:29.617563] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-08T21:48:29.987786] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-08T21:48:30.417555] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-08T21:48:30.863584] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T21:48:31.217596] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-08T21:48:32.017557] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-08T21:48:32.619151] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T21:48:32.817508] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-08T21:48:33.178576] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-08T21:48:33.272738] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-08T21:48:33.617549] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-08T21:48:34.417631] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-08T21:48:34.845603] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T21:48:35.160958] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:48:35.217519] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-08T21:48:36.017576] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-08T21:48:36.291409] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T21:48:36.334570] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-08T21:48:36.817564] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-08T21:48:37.172379] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T21:48:37.617583] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-08T21:48:37.965709] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-08T21:48:38.417538] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-08T21:48:39.217527] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-08T21:48:39.436290] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-08T21:48:40.017600] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-08T21:48:40.517845] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T21:48:40.539347] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T21:48:40.817565] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-08T21:48:41.172210] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-08T21:48:41.617574] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-08T21:48:42.417517] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-08T21:48:42.625947] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T21:48:42.781835] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T21:48:43.217572] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-08T21:48:44.017554] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-08T21:48:44.319605] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-10-08T21:48:44.320471] [INFO ] [REMOTE ] TBLU: Full fetch complete (1176 records). [2025-10-08T21:48:44.320548] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-08T21:48:44.549478] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-08T21:48:44.549758] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-08T21:48:44.549837] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-08T21:48:44.549956] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-08T21:48:44.550073] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-08T21:48:44.550139] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-08T21:48:44.550189] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-08T21:48:44.550294] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBLU took 27.9s. Estimated remaining: 45m 12s. Rate: 7.1 symbols/min [2025-10-08T21:48:44.729000] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:44.729329] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-08T21:48:44.729392] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-08T21:48:44.729632] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-08T21:48:44.729871] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-08T21:48:44.750475] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-08T21:48:44.750626] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-08T21:48:44.815961] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-08T21:48:44.821544] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-08T21:48:45.154485] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:45.422492] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T21:48:45.617543] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-08T21:48:46.417556] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-08T21:48:46.519242] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T21:48:46.521324] [INFO ] [REMOTE ] TBI: Full fetch complete (31707 records). [2025-10-08T21:48:46.521402] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-08T21:48:46.888364] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-08T21:48:46.888442] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-08T21:48:46.889101] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-08T21:48:46.889161] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-08T21:48:46.889911] [DEBUG] [LOCAL ] TBI: Trimmed 31707 records to 22436 (keeping 200 days of data) [2025-10-08T21:48:46.979338] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T21:48:47.029878] [DEBUG] [LOCAL ] TBI: Primary data saved (22436 records). [2025-10-08T21:48:47.030019] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-08T21:48:47.030101] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBI took 36.2s. Estimated remaining: 45m 3s. Rate: 7.1 symbols/min [2025-10-08T21:48:47.199720] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:47.211440] [DEBUG] [LOCAL ] TCBX: Loaded 10211 existing records from primary storage. [2025-10-08T21:48:47.211681] [INFO ] [MAIN ] TCBX: Loaded 10211 existing records. [2025-10-08T21:48:47.223031] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-10-08T21:48:47.389428] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:47.389690] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-08T21:48:47.389749] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-08T21:48:47.389964] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-08T21:48:47.390022] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-08T21:48:47.486229] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:48:47.488974] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-10-08T21:48:47.504667] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:48:47.533153] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-08T21:48:47.565998] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:48:47.632438] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-08T21:48:47.669494] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-08T21:48:47.669562] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-08T21:48:47.669622] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-08T21:48:47.669990] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TCAI took 3.1s. Estimated remaining: 44m 53s. Rate: 7.1 symbols/min [2025-10-08T21:48:47.848976] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:47.915982] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:47.971254] [DEBUG] [LOCAL ] TD: Loaded 52350 existing records from primary storage. [2025-10-08T21:48:47.971581] [INFO ] [MAIN ] TD: Loaded 52350 existing records. [2025-10-08T21:48:48.024390] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2024-12. [2025-10-08T21:48:48.163826] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:48.164089] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-08T21:48:48.164138] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-08T21:48:48.164414] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-08T21:48:48.164473] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-08T21:48:48.522808] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:48.817594] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-08T21:48:48.927497] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T21:48:49.617618] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-08T21:48:50.170472] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-08T21:48:50.417531] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-08T21:48:50.559122] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T21:48:51.217520] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-08T21:48:51.957561] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T21:48:52.017534] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-08T21:48:52.162506] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-08T21:48:52.742222] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-08T21:48:52.817607] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-08T21:48:53.617699] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-08T21:48:53.978897] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T21:48:53.981983] [INFO ] [REMOTE ] TBBB: Full fetch complete (51470 records). [2025-10-08T21:48:53.982115] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-08T21:48:54.348877] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-08T21:48:54.394339] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-08T21:48:54.394438] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-08T21:48:54.395373] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-08T21:48:54.395458] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-08T21:48:54.394197] [INFO ] [REMOTE ] TBN: Full fetch complete (5695 records). [2025-10-08T21:48:54.395736] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-08T21:48:54.421582] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-10-08T21:48:54.509423] [DEBUG] [LOCAL ] TBBB: Trimmed 51470 records to 35659 (keeping 200 days of data) [2025-10-08T21:48:54.934293] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-08T21:48:54.934399] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-08T21:48:54.938176] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-08T21:48:54.944960] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-08T21:48:54.982402] [DEBUG] [LOCAL ] TBN: Trimmed 5695 records to 3862 (keeping 200 days of data) [2025-10-08T21:48:55.058759] [DEBUG] [LOCAL ] TBN: Primary data saved (3862 records). [2025-10-08T21:48:55.067893] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-08T21:48:55.068069] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TBN took 36.2s. Estimated remaining: 44m 45s. Rate: 7.1 symbols/min [2025-10-08T21:48:55.067797] [DEBUG] [LOCAL ] TBBB: Primary data saved (35659 records). [2025-10-08T21:48:55.089300] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-08T21:48:55.128181] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBBB took 50.0s. Estimated remaining: 44m 35s. Rate: 7.1 symbols/min [2025-10-08T21:48:55.232993] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-08T21:48:55.370279] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:55.424842] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:48:55.434209] [DEBUG] [LOCAL ] TDF: Loaded 6251 existing records from primary storage. [2025-10-08T21:48:55.434497] [INFO ] [MAIN ] TDF: Loaded 6251 existing records. [2025-10-08T21:48:55.624882] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:55.637528] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-08T21:48:55.637685] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-08T21:48:55.638339] [DEBUG] [LOCAL ] TDC: Loaded 46588 existing records from primary storage. [2025-10-08T21:48:55.638612] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-08T21:48:55.638589] [INFO ] [MAIN ] TDC: Loaded 46588 existing records. [2025-10-08T21:48:55.638725] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-08T21:48:56.020013] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:48:56.068504] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-08T21:48:56.073763] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-08T21:48:56.085454] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-08T21:48:56.103908] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-08T21:48:56.292352] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:56.293089] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-10-08T21:48:56.444389] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T21:48:56.566564] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:48:56.594590] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-08T21:48:56.802232] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-08T21:48:56.817491] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-08T21:48:57.537213] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T21:48:57.617536] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-08T21:48:58.417606] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-08T21:48:59.217592] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-10-08T21:48:59.347117] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T21:48:59.447396] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T21:49:00.017582] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-08T21:49:00.458709] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T21:49:00.693786] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-08T21:49:00.817536] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-08T21:49:01.617586] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-08T21:49:02.143160] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T21:49:02.417556] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-08T21:49:02.865451] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-08T21:49:03.057253] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T21:49:03.217548] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-08T21:49:04.017607] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-08T21:49:04.819913] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-08T21:49:04.820938] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T21:49:04.902748] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T21:49:05.617592] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-08T21:49:06.194192] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T21:49:06.417513] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-08T21:49:07.217589] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-08T21:49:07.351421] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:49:07.370023] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-08T21:49:08.017610] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-08T21:49:08.817589] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-08T21:49:09.025820] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T21:49:09.253618] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T21:49:09.617568] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-08T21:49:09.778142] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T21:49:10.417606] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-08T21:49:11.180247] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:49:11.217482] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-08T21:49:11.390724] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T21:49:12.017579] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-08T21:49:12.035048] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T21:49:12.817601] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-08T21:49:13.410229] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-08T21:49:13.426481] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-08T21:49:13.617558] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-08T21:49:14.378033] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T21:49:14.417598] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-08T21:49:15.217557] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-08T21:49:15.809022] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T21:49:15.810397] [INFO ] [REMOTE ] TCBX: Full fetch complete (15853 records). [2025-10-08T21:49:15.810469] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-08T21:49:16.028176] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-08T21:49:16.211258] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T21:49:16.209984] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-08T21:49:16.220620] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-08T21:49:16.221344] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-08T21:49:16.221444] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-08T21:49:16.222436] [DEBUG] [LOCAL ] TCBX: Trimmed 15853 records to 10176 (keeping 200 days of data) [2025-10-08T21:49:16.284298] [DEBUG] [LOCAL ] TCBX: Primary data saved (10176 records). [2025-10-08T21:49:16.284454] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-08T21:49:16.284543] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TCBX took 29.3s. Estimated remaining: 44m 28s. Rate: 7.1 symbols/min [2025-10-08T21:49:16.452164] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:16.475867] [DEBUG] [LOCAL ] TDG: Loaded 22105 existing records from primary storage. [2025-10-08T21:49:16.476140] [INFO ] [MAIN ] TDG: Loaded 22105 existing records. [2025-10-08T21:49:16.652669] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:16.652922] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-08T21:49:16.652970] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-08T21:49:16.653261] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-08T21:49:16.653319] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-08T21:49:16.749104] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-08T21:49:16.822694] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-08T21:49:17.113140] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:17.617618] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-10-08T21:49:18.417528] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-08T21:49:18.646126] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T21:49:18.798238] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T21:49:19.217626] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-08T21:49:19.602120] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-08T21:49:19.861243] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T21:49:20.017580] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-08T21:49:20.817568] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-08T21:49:21.488739] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-08T21:49:21.495067] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T21:49:21.617543] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-08T21:49:22.417552] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-08T21:49:22.510852] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T21:49:23.217531] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-08T21:49:23.235780] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T21:49:24.017557] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-08T21:49:24.583088] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T21:49:24.584840] [INFO ] [REMOTE ] TDF: Full fetch complete (10318 records). [2025-10-08T21:49:24.584931] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-08T21:49:24.819795] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-08T21:49:24.981416] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-08T21:49:24.981595] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-08T21:49:24.982198] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-08T21:49:24.982288] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-08T21:49:24.983274] [DEBUG] [LOCAL ] TDF: Trimmed 10318 records to 6248 (keeping 200 days of data) [2025-10-08T21:49:25.048030] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T21:49:25.068856] [DEBUG] [LOCAL ] TDF: Primary data saved (6248 records). [2025-10-08T21:49:25.068990] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-08T21:49:25.069102] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDF took 29.9s. Estimated remaining: 44m 20s. Rate: 7.1 symbols/min [2025-10-08T21:49:25.251583] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:25.313814] [DEBUG] [LOCAL ] TDOC: Loaded 53349 existing records from primary storage. [2025-10-08T21:49:25.314219] [INFO ] [MAIN ] TDOC: Loaded 53349 existing records. [2025-10-08T21:49:25.498322] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:25.498583] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-08T21:49:25.498630] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-08T21:49:25.498913] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-08T21:49:25.498972] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-08T21:49:25.622747] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-08T21:49:25.866215] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:26.292504] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T21:49:26.417553] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-10-08T21:49:27.217562] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-08T21:49:27.386812] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T21:49:28.017546] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-08T21:49:28.158716] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T21:49:28.658360] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T21:49:28.662256] [INFO ] [REMOTE ] TDC: Full fetch complete (67232 records). [2025-10-08T21:49:28.662421] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-08T21:49:28.823458] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-08T21:49:29.087156] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-08T21:49:29.087274] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-08T21:49:29.088450] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-08T21:49:29.088551] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-08T21:49:29.104689] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T21:49:29.109565] [DEBUG] [LOCAL ] TDC: Trimmed 67232 records to 46558 (keeping 200 days of data) [2025-10-08T21:49:29.387201] [DEBUG] [LOCAL ] TDC: Primary data saved (46558 records). [2025-10-08T21:49:29.387346] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-08T21:49:29.387450] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDC took 34.3s. Estimated remaining: 44m 11s. Rate: 7.1 symbols/min [2025-10-08T21:49:29.553444] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:29.595387] [DEBUG] [LOCAL ] TDS: Loaded 42731 existing records from primary storage. [2025-10-08T21:49:29.595728] [INFO ] [MAIN ] TDS: Loaded 42731 existing records. [2025-10-08T21:49:29.625728] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-08T21:49:29.779392] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:29.779625] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-08T21:49:29.779710] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-08T21:49:29.779904] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-08T21:49:29.779944] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-08T21:49:30.166210] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:30.417588] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-10-08T21:49:30.897145] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-08T21:49:31.217602] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-08T21:49:31.407922] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T21:49:31.639410] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T21:49:32.017593] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-08T21:49:32.817581] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-08T21:49:33.496790] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-08T21:49:33.550389] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:49:33.617519] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-08T21:49:34.417612] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-08T21:49:34.458210] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-08T21:49:34.465151] [INFO ] [REMOTE ] TD: Full fetch complete (75792 records). [2025-10-08T21:49:34.465433] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-08T21:49:34.878795] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-08T21:49:34.879023] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-08T21:49:34.880324] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-08T21:49:34.880425] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-08T21:49:34.882454] [DEBUG] [LOCAL ] TD: Trimmed 75792 records to 52354 (keeping 200 days of data) [2025-10-08T21:49:34.907313] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T21:49:35.223502] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-08T21:49:35.248468] [DEBUG] [LOCAL ] TD: Primary data saved (52354 records). [2025-10-08T21:49:35.248591] [INFO ] [MAIN ] TD: Full history saved. [2025-10-08T21:49:35.249764] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TD took 47.6s. Estimated remaining: 44m 2s. Rate: 7.1 symbols/min [2025-10-08T21:49:35.441924] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:35.495075] [DEBUG] [LOCAL ] TDW: Loaded 45134 existing records from primary storage. [2025-10-08T21:49:35.495535] [INFO ] [MAIN ] TDW: Loaded 45134 existing records. [2025-10-08T21:49:35.717547] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T21:49:35.742270] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:35.748163] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-08T21:49:35.748241] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-08T21:49:35.748615] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-08T21:49:35.748716] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-08T21:49:36.023577] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-08T21:49:36.151286] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:36.817577] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-08T21:49:36.847879] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T21:49:37.397403] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T21:49:37.617587] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-08T21:49:38.417626] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-08T21:49:38.896309] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-08T21:49:39.220157] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-10-08T21:49:39.226938] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T21:49:39.255119] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-08T21:49:40.017554] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-08T21:49:40.817533] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-08T21:49:40.987848] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T21:49:41.047279] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T21:49:41.617617] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-08T21:49:42.417579] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-08T21:49:42.790591] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T21:49:42.954718] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T21:49:43.217577] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-08T21:49:43.565612] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T21:49:44.017603] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-08T21:49:44.817532] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-08T21:49:44.929369] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T21:49:44.966781] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T21:49:45.617606] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-08T21:49:46.337921] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T21:49:46.417547] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-08T21:49:47.217592] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-08T21:49:47.577786] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T21:49:47.671138] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T21:49:48.017550] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-08T21:49:48.817515] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-08T21:49:48.911285] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T21:49:49.545105] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T21:49:49.617505] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-08T21:49:49.764236] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-08T21:49:50.417573] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-08T21:49:51.185295] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T21:49:51.217544] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-08T21:49:51.650775] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T21:49:52.017621] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-08T21:49:52.345451] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T21:49:52.348867] [INFO ] [REMOTE ] TDS: Full fetch complete (61600 records). [2025-10-08T21:49:52.349067] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-08T21:49:52.482031] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T21:49:52.521404] [INFO ] [REMOTE ] TDG: Full fetch complete (31912 records). [2025-10-08T21:49:52.537194] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-08T21:49:52.818799] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-08T21:49:53.035531] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-08T21:49:53.051120] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-08T21:49:53.062828] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-08T21:49:53.063309] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-08T21:49:53.119502] [DEBUG] [LOCAL ] TDS: Trimmed 61600 records to 42645 (keeping 200 days of data) [2025-10-08T21:49:53.214631] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-08T21:49:53.241559] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-08T21:49:53.242281] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-08T21:49:53.242361] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-08T21:49:53.245720] [DEBUG] [LOCAL ] TDG: Trimmed 31912 records to 22042 (keeping 200 days of data) [2025-10-08T21:49:53.528693] [DEBUG] [LOCAL ] TDG: Primary data saved (22042 records). [2025-10-08T21:49:53.529395] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-08T21:49:53.529784] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDG took 37.2s. Estimated remaining: 43m 55s. Rate: 7.1 symbols/min [2025-10-08T21:49:53.626122] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-08T21:49:53.718967] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:53.767988] [DEBUG] [LOCAL ] TDS: Primary data saved (42645 records). [2025-10-08T21:49:53.768174] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-08T21:49:53.768291] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDS took 24.4s. Estimated remaining: 43m 45s. Rate: 7.1 symbols/min [2025-10-08T21:49:53.768870] [DEBUG] [LOCAL ] TDY: Loaded 22459 existing records from primary storage. [2025-10-08T21:49:53.769320] [INFO ] [MAIN ] TDY: Loaded 22459 existing records. [2025-10-08T21:49:54.121262] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:54.159675] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-08T21:49:54.162557] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-08T21:49:54.186667] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:54.187310] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-08T21:49:54.187361] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-08T21:49:54.187455] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-08T21:49:54.187552] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-08T21:49:54.187766] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-08T21:49:54.187834] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-08T21:49:54.187930] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-08T21:49:54.199496] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-08T21:49:54.998076] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:54.993816] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:54.998932] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-10-08T21:49:55.001001] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T21:49:55.217584] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-08T21:49:55.222441] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:49:55.222735] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-10-08T21:49:55.222823] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:49:55.222870] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-08T21:49:55.222930] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:49:55.223001] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-08T21:49:55.223066] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-08T21:49:55.223101] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-08T21:49:55.223153] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-08T21:49:55.223223] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TE took 1.5s. Estimated remaining: 43m 36s. Rate: 7.1 symbols/min [2025-10-08T21:49:55.389424] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:55.399061] [DEBUG] [LOCAL ] TEAF: Loaded 7527 existing records from primary storage. [2025-10-08T21:49:55.399272] [INFO ] [MAIN ] TEAF: Loaded 7527 existing records. [2025-10-08T21:49:55.578619] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:55.578909] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-08T21:49:55.579063] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-08T21:49:55.579293] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-08T21:49:55.579359] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-08T21:49:55.893387] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-08T21:49:55.982266] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:49:56.017496] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-10-08T21:49:56.817571] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-08T21:49:56.885070] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T21:49:56.949175] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T21:49:57.617595] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-08T21:49:58.063225] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T21:49:58.417519] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-08T21:49:58.796630] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-08T21:49:58.822090] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-08T21:49:59.217558] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-08T21:49:59.322085] [DEBUG] [REMOTE ] TDOC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T21:49:59.322463] [WARN ] [REMOTE ] TDOC: No data returned for month 2025-09 [2025-10-08T21:49:59.322556] [FATAL] [REMOTE ] TDOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:49:59.322691] [FATAL] [MAIN ] TDOC: Failed to fetch primary data. [2025-10-08T21:49:59.322761] [WARN ] [MAIN ] TDOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:49:59.322864] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-08T21:49:59.322966] [DEBUG] [LOCAL ] TDOC: No primary data file found to delete. [2025-10-08T21:49:59.323022] [INFO ] [LOCAL ] TDOC: Starting deletion of derivative data. [2025-10-08T21:49:59.323284] [DEBUG] [LOCAL ] TDOC: Deleted derivative data file. [2025-10-08T21:49:59.323383] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDOC took 34.3s. Estimated remaining: 43m 27s. Rate: 7.1 symbols/min [2025-10-08T21:49:59.493056] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:49:59.542349] [DEBUG] [LOCAL ] TECK: Loaded 53438 existing records from primary storage. [2025-10-08T21:49:59.542706] [INFO ] [MAIN ] TECK: Loaded 53438 existing records. [2025-10-08T21:49:59.716932] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:49:59.717153] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-08T21:49:59.717204] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-08T21:49:59.717428] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-08T21:49:59.717484] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-08T21:50:00.029397] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-10-08T21:50:00.070586] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:00.817530] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-08T21:50:01.261439] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-08T21:50:01.345140] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T21:50:01.617604] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-10-08T21:50:02.417626] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-08T21:50:03.217516] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-08T21:50:03.629006] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-08T21:50:04.020940] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-08T21:50:04.046019] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T21:50:04.052852] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T21:50:04.817595] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-08T21:50:05.241961] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T21:50:05.471482] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T21:50:05.617617] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-08T21:50:06.417612] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-08T21:50:07.033386] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:50:07.217584] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-08T21:50:07.944111] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T21:50:08.017532] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-08T21:50:08.373568] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-08T21:50:08.817506] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-08T21:50:09.196070] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:50:09.617620] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-08T21:50:10.417603] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-08T21:50:10.561490] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T21:50:10.587816] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-08T21:50:11.217628] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-08T21:50:12.017617] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-08T21:50:12.074106] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T21:50:12.779218] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T21:50:12.817503] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-08T21:50:13.190197] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T21:50:13.526945] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T21:50:13.617557] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-08T21:50:14.417563] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-08T21:50:14.963753] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T21:50:15.175265] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T21:50:15.217525] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-08T21:50:16.017567] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-08T21:50:16.494369] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-08T21:50:16.817618] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-08T21:50:17.617599] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-08T21:50:17.706735] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T21:50:17.914179] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T21:50:18.180720] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T21:50:18.181856] [INFO ] [REMOTE ] TEAF: Full fetch complete (10009 records). [2025-10-08T21:50:18.181927] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-08T21:50:18.424746] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-08T21:50:18.546790] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-08T21:50:18.546872] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-08T21:50:18.547139] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-08T21:50:18.547176] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-08T21:50:18.547592] [DEBUG] [LOCAL ] TEAF: Trimmed 10009 records to 7537 (keeping 200 days of data) [2025-10-08T21:50:18.593665] [DEBUG] [LOCAL ] TEAF: Primary data saved (7537 records). [2025-10-08T21:50:18.593791] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-08T21:50:18.593923] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 23.4s. Estimated remaining: 43m 20s. Rate: 7.1 symbols/min [2025-10-08T21:50:18.760008] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:50:18.795134] [DEBUG] [LOCAL ] TEF: Loaded 37196 existing records from primary storage. [2025-10-08T21:50:18.795428] [INFO ] [MAIN ] TEF: Loaded 37196 existing records. [2025-10-08T21:50:18.971165] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:50:18.971328] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-08T21:50:18.971373] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-08T21:50:18.971592] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-08T21:50:18.971680] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-08T21:50:19.226502] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-08T21:50:19.347086] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:20.017614] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-08T21:50:20.516145] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-08T21:50:20.807563] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T21:50:20.817867] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-08T21:50:21.399485] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T21:50:21.617560] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-08T21:50:22.377289] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T21:50:22.417571] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-08T21:50:22.631598] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T21:50:23.111436] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T21:50:23.217550] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-08T21:50:23.593442] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T21:50:23.595326] [INFO ] [REMOTE ] TDY: Full fetch complete (32018 records). [2025-10-08T21:50:23.595429] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-08T21:50:23.967685] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-08T21:50:23.967781] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-08T21:50:23.968467] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-08T21:50:23.968506] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-08T21:50:23.969418] [DEBUG] [LOCAL ] TDY: Trimmed 32018 records to 22410 (keeping 200 days of data) [2025-10-08T21:50:24.027526] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-08T21:50:24.124877] [DEBUG] [LOCAL ] TDY: Primary data saved (22410 records). [2025-10-08T21:50:24.125025] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-08T21:50:24.125182] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TDY took 30.6s. Estimated remaining: 43m 11s. Rate: 7.1 symbols/min [2025-10-08T21:50:24.298201] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:50:24.318540] [DEBUG] [LOCAL ] TEI: Loaded 21350 existing records from primary storage. [2025-10-08T21:50:24.318845] [INFO ] [MAIN ] TEI: Loaded 21350 existing records. [2025-10-08T21:50:24.493992] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:50:24.494230] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-08T21:50:24.494276] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-08T21:50:24.494480] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-08T21:50:24.494535] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-08T21:50:24.839861] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-10-08T21:50:24.844530] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:25.617610] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-08T21:50:25.881209] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-08T21:50:26.427002] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-10-08T21:50:26.447220] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T21:50:27.020545] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-08T21:50:27.024916] [INFO ] [REMOTE ] TDW: Full fetch complete (66970 records). [2025-10-08T21:50:27.025113] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-08T21:50:27.221581] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-08T21:50:27.481905] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-08T21:50:27.482506] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-08T21:50:27.484166] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-08T21:50:27.484343] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-08T21:50:27.499941] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T21:50:27.505822] [DEBUG] [LOCAL ] TDW: Trimmed 66970 records to 45083 (keeping 200 days of data) [2025-10-08T21:50:27.827076] [DEBUG] [LOCAL ] TDW: Primary data saved (45083 records). [2025-10-08T21:50:27.827256] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-08T21:50:27.828110] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TDW took 52.6s. Estimated remaining: 43m 2s. Rate: 7.1 symbols/min [2025-10-08T21:50:27.997632] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:50:28.017536] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-08T21:50:28.055875] [DEBUG] [LOCAL ] TEL: Loaded 51095 existing records from primary storage. [2025-10-08T21:50:28.056224] [INFO ] [MAIN ] TEL: Loaded 51095 existing records. [2025-10-08T21:50:28.237907] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:50:28.238183] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-08T21:50:28.238241] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-08T21:50:28.238494] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-08T21:50:28.238552] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-08T21:50:28.594895] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:28.817535] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-08T21:50:29.047984] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T21:50:29.581338] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T21:50:29.617574] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-08T21:50:29.686002] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T21:50:30.417609] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-08T21:50:31.071437] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T21:50:31.217570] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-08T21:50:32.017581] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-10-08T21:50:32.188368] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T21:50:32.665177] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-08T21:50:32.817603] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-08T21:50:33.496298] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T21:50:33.617588] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-08T21:50:34.402330] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T21:50:34.417486] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-08T21:50:34.721978] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T21:50:35.217568] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-08T21:50:35.639780] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-08T21:50:36.017583] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-08T21:50:36.252399] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T21:50:36.817550] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-08T21:50:37.064533] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T21:50:37.617571] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-08T21:50:38.417600] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-08T21:50:38.669942] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T21:50:39.217597] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-08T21:50:39.404587] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T21:50:39.820623] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T21:50:40.017575] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-08T21:50:40.585718] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T21:50:40.589937] [INFO ] [REMOTE ] TECK: Full fetch complete (77316 records). [2025-10-08T21:50:40.590100] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-08T21:50:40.822822] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-08T21:50:40.992098] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-08T21:50:40.992206] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-08T21:50:40.993456] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-08T21:50:40.993526] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-08T21:50:40.995211] [DEBUG] [LOCAL ] TECK: Trimmed 77316 records to 53439 (keeping 200 days of data) [2025-10-08T21:50:41.331380] [DEBUG] [LOCAL ] TECK: Primary data saved (53439 records). [2025-10-08T21:50:41.331548] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-08T21:50:41.331637] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TECK took 42.0s. Estimated remaining: 42m 54s. Rate: 7.1 symbols/min [2025-10-08T21:50:41.500706] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:50:41.530752] [DEBUG] [LOCAL ] TEN: Loaded 30447 existing records from primary storage. [2025-10-08T21:50:41.531047] [INFO ] [MAIN ] TEN: Loaded 30447 existing records. [2025-10-08T21:50:41.622852] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-08T21:50:41.730890] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:50:41.731225] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-08T21:50:41.731343] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-08T21:50:41.731791] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-08T21:50:41.731915] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-08T21:50:42.055073] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-08T21:50:42.140107] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:42.386182] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T21:50:42.408808] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T21:50:42.417502] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-10-08T21:50:43.217607] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-08T21:50:43.872148] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T21:50:44.017579] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-08T21:50:44.273298] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T21:50:44.817594] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-08T21:50:45.522747] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T21:50:45.617547] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-08T21:50:46.417519] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-08T21:50:46.676460] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-08T21:50:46.763000] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-08T21:50:47.217583] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-08T21:50:47.680060] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T21:50:47.683979] [INFO ] [REMOTE ] TEF: Full fetch complete (54866 records). [2025-10-08T21:50:47.684165] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-08T21:50:48.022828] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-08T21:50:48.173186] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-08T21:50:48.173476] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-08T21:50:48.174501] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-08T21:50:48.174680] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-08T21:50:48.176005] [DEBUG] [LOCAL ] TEF: Trimmed 54866 records to 37117 (keeping 200 days of data) [2025-10-08T21:50:48.278341] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T21:50:48.416728] [DEBUG] [LOCAL ] TEF: Primary data saved (37117 records). [2025-10-08T21:50:48.416894] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-08T21:50:48.416983] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEF took 29.8s. Estimated remaining: 42m 46s. Rate: 7.1 symbols/min [2025-10-08T21:50:48.588145] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:50:48.611057] [DEBUG] [LOCAL ] TEO: Loaded 22300 existing records from primary storage. [2025-10-08T21:50:48.611375] [INFO ] [MAIN ] TEO: Loaded 22300 existing records. [2025-10-08T21:50:48.802405] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:50:48.802672] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-08T21:50:48.802771] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-08T21:50:48.803005] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-08T21:50:48.803062] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-08T21:50:48.823228] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-08T21:50:49.158033] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:50:49.617535] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-08T21:50:49.807796] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T21:50:49.893737] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:50:50.417563] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-08T21:50:50.553631] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T21:50:51.217598] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-08T21:50:52.017595] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-10-08T21:50:52.243955] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T21:50:52.459751] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T21:50:52.817554] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-08T21:50:53.168636] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T21:50:53.617539] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-08T21:50:54.305204] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T21:50:54.417551] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-08T21:50:54.769796] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T21:50:55.217559] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-08T21:50:56.017536] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-08T21:50:56.287741] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T21:50:56.312468] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T21:50:56.817505] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-08T21:50:57.218422] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T21:50:57.617529] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-08T21:50:57.703564] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-08T21:50:58.417587] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-08T21:50:58.663357] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T21:50:59.217624] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-08T21:50:59.783062] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T21:51:00.017561] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-08T21:51:00.355062] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T21:51:00.817585] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-08T21:51:01.617599] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-08T21:51:01.806510] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T21:51:01.914634] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T21:51:02.417634] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-08T21:51:03.084778] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T21:51:03.217610] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-08T21:51:03.540432] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T21:51:04.017495] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-08T21:51:04.221219] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T21:51:04.224421] [INFO ] [REMOTE ] TEI: Full fetch complete (30705 records). [2025-10-08T21:51:04.224519] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-08T21:51:04.446339] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T21:51:04.538316] [INFO ] [REMOTE ] TEL: Full fetch complete (73426 records). [2025-10-08T21:51:04.549546] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-08T21:51:04.778835] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-08T21:51:04.789543] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-08T21:51:04.815178] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-08T21:51:04.834633] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-08T21:51:04.820218] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-08T21:51:04.944089] [DEBUG] [LOCAL ] TEI: Trimmed 30705 records to 21277 (keeping 200 days of data) [2025-10-08T21:51:05.126487] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-08T21:51:05.128249] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-08T21:51:05.130284] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-08T21:51:05.130773] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-08T21:51:05.145132] [DEBUG] [LOCAL ] TEL: Trimmed 73426 records to 51073 (keeping 200 days of data) [2025-10-08T21:51:05.278291] [DEBUG] [LOCAL ] TEI: Primary data saved (21277 records). [2025-10-08T21:51:05.279680] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-08T21:51:05.281033] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TEI took 41.2s. Estimated remaining: 42m 38s. Rate: 7.1 symbols/min [2025-10-08T21:51:05.473891] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:05.474983] [DEBUG] [LOCAL ] TEVA: No existing data file found in primary storage. [2025-10-08T21:51:05.475306] [WARN ] [MAIN ] TEVA: No existing data found, performing full refresh instead. [2025-10-08T21:51:05.477077] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-08T21:51:05.477368] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-08T21:51:05.478149] [DEBUG] [LOCAL ] TEVA: No primary data file found to delete. [2025-10-08T21:51:05.478700] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-08T21:51:05.621880] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-08T21:51:05.952748] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:06.062309] [DEBUG] [LOCAL ] TEL: Primary data saved (51073 records). [2025-10-08T21:51:06.062472] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-08T21:51:06.063313] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEL took 38.2s. Estimated remaining: 42m 29s. Rate: 7.1 symbols/min [2025-10-08T21:51:06.225876] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T21:51:06.264143] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:06.313931] [DEBUG] [LOCAL ] TEX: Loaded 44018 existing records from primary storage. [2025-10-08T21:51:06.314260] [INFO ] [MAIN ] TEX: Loaded 44018 existing records. [2025-10-08T21:51:06.422740] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-10-08T21:51:06.536136] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:06.536374] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-08T21:51:06.536424] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-08T21:51:06.536675] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-08T21:51:06.536734] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-08T21:51:06.921082] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T21:51:06.956905] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:07.217567] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-10-08T21:51:08.017568] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-08T21:51:08.373693] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T21:51:08.818847] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-08T21:51:08.825587] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T21:51:08.888217] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T21:51:09.617551] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-08T21:51:10.375950] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T21:51:10.417570] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-08T21:51:11.216726] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T21:51:11.225124] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-08T21:51:12.017530] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-08T21:51:12.265940] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T21:51:12.321952] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-08T21:51:12.817632] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-08T21:51:13.253090] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T21:51:13.617545] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-08T21:51:13.975910] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T21:51:14.417517] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-08T21:51:14.875445] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T21:51:15.217562] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-08T21:51:16.017575] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-08T21:51:16.331475] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T21:51:16.572694] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T21:51:16.731253] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T21:51:16.733464] [INFO ] [REMOTE ] TEO: Full fetch complete (32619 records). [2025-10-08T21:51:16.733547] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-08T21:51:16.822781] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-08T21:51:17.133955] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-08T21:51:17.134084] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-08T21:51:17.135506] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-08T21:51:17.135617] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-08T21:51:17.137042] [DEBUG] [LOCAL ] TEO: Trimmed 32619 records to 22380 (keeping 200 days of data) [2025-10-08T21:51:17.279829] [DEBUG] [LOCAL ] TEO: Primary data saved (22380 records). [2025-10-08T21:51:17.279980] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-08T21:51:17.280070] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEO took 28.9s. Estimated remaining: 42m 21s. Rate: 7.1 symbols/min [2025-10-08T21:51:17.473911] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:17.525503] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-08T21:51:17.525855] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-08T21:51:17.626197] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-08T21:51:17.715714] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:17.715983] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-08T21:51:17.716030] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-08T21:51:17.716388] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-08T21:51:17.716445] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-08T21:51:18.065734] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:18.417565] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-10-08T21:51:18.644196] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T21:51:19.217511] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-08T21:51:19.325006] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-08T21:51:20.017566] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-08T21:51:20.198111] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-08T21:51:20.327936] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T21:51:20.330261] [INFO ] [REMOTE ] TEN: Full fetch complete (43943 records). [2025-10-08T21:51:20.330342] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-08T21:51:20.701692] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-08T21:51:20.701793] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-08T21:51:20.702544] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-08T21:51:20.702585] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-08T21:51:20.703561] [DEBUG] [LOCAL ] TEN: Trimmed 43943 records to 30426 (keeping 200 days of data) [2025-10-08T21:51:20.818760] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-08T21:51:20.891978] [DEBUG] [LOCAL ] TEN: Primary data saved (30426 records). [2025-10-08T21:51:20.892106] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-08T21:51:20.892186] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEN took 39.6s. Estimated remaining: 42m 12s. Rate: 7.1 symbols/min [2025-10-08T21:51:21.057370] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:21.090462] [DEBUG] [LOCAL ] TFII: Loaded 33427 existing records from primary storage. [2025-10-08T21:51:21.090866] [INFO ] [MAIN ] TFII: Loaded 33427 existing records. [2025-10-08T21:51:21.269564] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:21.269835] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-08T21:51:21.269935] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-08T21:51:21.270210] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-08T21:51:21.270267] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-08T21:51:21.622512] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-08T21:51:21.622391] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:22.031691] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T21:51:22.417596] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-10-08T21:51:22.690198] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-08T21:51:22.809456] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T21:51:23.217612] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-08T21:51:23.629261] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:51:24.017608] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-08T21:51:24.817588] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-08T21:51:25.493604] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-08T21:51:25.581913] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T21:51:25.617504] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-08T21:51:26.133516] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T21:51:26.417606] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-08T21:51:26.799627] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T21:51:27.217576] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-08T21:51:28.017693] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-08T21:51:28.308204] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T21:51:28.343085] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T21:51:28.817590] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-08T21:51:29.619193] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-08T21:51:29.626318] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:51:30.417629] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-08T21:51:30.556336] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T21:51:31.082716] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T21:51:31.217510] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-08T21:51:31.832833] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T21:51:32.017514] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-08T21:51:32.817610] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-08T21:51:33.162228] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T21:51:33.617582] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-08T21:51:33.674381] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T21:51:34.417533] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-08T21:51:34.488043] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T21:51:35.217555] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-08T21:51:35.715797] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-08T21:51:35.901849] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T21:51:36.017509] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-08T21:51:36.356267] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T21:51:36.817584] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-08T21:51:37.247888] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:51:37.251347] [INFO ] [REMOTE ] TEX: Full fetch complete (64537 records). [2025-10-08T21:51:37.251454] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-08T21:51:37.628265] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-08T21:51:37.631630] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-08T21:51:37.632600] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-08T21:51:37.633798] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-08T21:51:37.633989] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-08T21:51:37.635520] [DEBUG] [LOCAL ] TEX: Trimmed 64537 records to 43978 (keeping 200 days of data) [2025-10-08T21:51:37.919283] [DEBUG] [LOCAL ] TEX: Primary data saved (43978 records). [2025-10-08T21:51:37.919467] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-08T21:51:37.920737] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEX took 31.9s. Estimated remaining: 42m 4s. Rate: 7.1 symbols/min [2025-10-08T21:51:38.089882] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:38.115140] [DEBUG] [LOCAL ] TFIN: Loaded 23508 existing records from primary storage. [2025-10-08T21:51:38.115406] [INFO ] [MAIN ] TFIN: Loaded 23508 existing records. [2025-10-08T21:51:38.291176] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:38.291464] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-08T21:51:38.291519] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-08T21:51:38.291792] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-08T21:51:38.291851] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-08T21:51:38.431745] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-08T21:51:38.655683] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:38.936569] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-08T21:51:39.109216] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T21:51:39.217498] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-08T21:51:40.017617] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-10-08T21:51:40.160923] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T21:51:40.487901] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T21:51:40.519816] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-08T21:51:40.817557] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-08T21:51:41.606513] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-08T21:51:41.617498] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-08T21:51:42.417578] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-08T21:51:42.483555] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T21:51:43.217610] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-08T21:51:44.017559] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-08T21:51:44.278703] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T21:51:44.357574] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-08T21:51:44.361930] [INFO ] [REMOTE ] TEVA: Full fetch complete (77707 records). [2025-10-08T21:51:44.362052] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-08T21:51:44.753474] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-08T21:51:44.753558] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-08T21:51:44.754639] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-08T21:51:44.754724] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-08T21:51:44.756281] [DEBUG] [LOCAL ] TEVA: Trimmed 77707 records to 53633 (keeping 200 days of data) [2025-10-08T21:51:44.826400] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-08T21:51:45.092763] [DEBUG] [LOCAL ] TEVA: Primary data saved (53633 records). [2025-10-08T21:51:45.092919] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-08T21:51:45.093018] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TEVA took 39.8s. Estimated remaining: 41m 56s. Rate: 7.1 symbols/min [2025-10-08T21:51:45.268755] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:45.305926] [DEBUG] [LOCAL ] TFPM: Loaded 38362 existing records from primary storage. [2025-10-08T21:51:45.306246] [INFO ] [MAIN ] TFPM: Loaded 38362 existing records. [2025-10-08T21:51:45.482465] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:45.482738] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-08T21:51:45.482864] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-08T21:51:45.483198] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-08T21:51:45.483253] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-08T21:51:45.626041] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-08T21:51:45.851587] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:45.881957] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T21:51:46.146037] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-08T21:51:46.417500] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-10-08T21:51:47.123340] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T21:51:47.217499] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-08T21:51:47.706244] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T21:51:48.017563] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-08T21:51:48.485888] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T21:51:48.817553] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-08T21:51:49.153340] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T21:51:49.617566] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-08T21:51:49.912889] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-08T21:51:50.417553] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-08T21:51:51.217516] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-08T21:51:51.547057] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T21:51:51.584975] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T21:51:52.017523] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-08T21:51:52.259325] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T21:51:52.817519] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-08T21:51:52.860581] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T21:51:52.863118] [INFO ] [REMOTE ] TFII: Full fetch complete (48006 records). [2025-10-08T21:51:52.863225] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-08T21:51:53.253766] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-08T21:51:53.253854] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-08T21:51:53.254717] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-08T21:51:53.254780] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-08T21:51:53.257512] [DEBUG] [LOCAL ] TFII: Trimmed 48006 records to 33410 (keeping 200 days of data) [2025-10-08T21:51:53.467479] [DEBUG] [LOCAL ] TFII: Primary data saved (33410 records). [2025-10-08T21:51:53.467636] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-08T21:51:53.467846] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFII took 32.6s. Estimated remaining: 41m 47s. Rate: 7.1 symbols/min [2025-10-08T21:51:53.622583] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-08T21:51:53.650001] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:51:53.691391] [DEBUG] [LOCAL ] TFX: Loaded 36913 existing records from primary storage. [2025-10-08T21:51:53.691749] [INFO ] [MAIN ] TFX: Loaded 36913 existing records. [2025-10-08T21:51:53.871207] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:51:53.871421] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-08T21:51:53.871466] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-08T21:51:53.871816] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-08T21:51:53.871874] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-08T21:51:54.216681] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T21:51:54.257929] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:51:54.417565] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-08T21:51:55.217613] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-08T21:51:55.524624] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T21:51:55.678520] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T21:51:56.017551] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-08T21:51:56.500381] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-08T21:51:56.817604] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-08T21:51:57.505539] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T21:51:57.574634] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T21:51:57.617501] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-08T21:51:58.417572] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-08T21:51:58.706026] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T21:51:59.217572] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-10-08T21:51:59.961799] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:52:00.017517] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-08T21:52:00.599243] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T21:52:00.817602] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-08T21:52:00.925863] [DEBUG] [REMOTE ] TFC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-08T21:52:00.926217] [WARN ] [REMOTE ] TFC: No data returned for month 2025-09 [2025-10-08T21:52:00.926309] [FATAL] [REMOTE ] TFC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:52:00.926396] [FATAL] [MAIN ] TFC: Failed to fetch primary data. [2025-10-08T21:52:00.926432] [WARN ] [MAIN ] TFC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:52:00.926471] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-08T21:52:00.926530] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-10-08T21:52:00.926567] [INFO ] [LOCAL ] TFC: Starting deletion of derivative data. [2025-10-08T21:52:00.926850] [DEBUG] [LOCAL ] TFC: Deleted derivative data file. [2025-10-08T21:52:00.926976] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFC took 43.6s. Estimated remaining: 41m 39s. Rate: 7.1 symbols/min [2025-10-08T21:52:01.100686] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:01.112527] [DEBUG] [LOCAL ] TG: Loaded 10390 existing records from primary storage. [2025-10-08T21:52:01.112786] [INFO ] [MAIN ] TG: Loaded 10390 existing records. [2025-10-08T21:52:01.312528] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:01.312922] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-08T21:52:01.312995] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-08T21:52:01.313204] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-08T21:52:01.313275] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-08T21:52:01.653458] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-08T21:52:01.739195] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:01.763780] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T21:52:02.417596] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-10-08T21:52:02.662933] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T21:52:02.665045] [INFO ] [REMOTE ] TFIN: Full fetch complete (31614 records). [2025-10-08T21:52:02.665144] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-08T21:52:03.055816] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-08T21:52:03.055956] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-08T21:52:03.056790] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-08T21:52:03.056854] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-08T21:52:03.057792] [DEBUG] [LOCAL ] TFIN: Trimmed 31614 records to 23527 (keeping 200 days of data) [2025-10-08T21:52:03.200349] [DEBUG] [LOCAL ] TFIN: Primary data saved (23527 records). [2025-10-08T21:52:03.200495] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-08T21:52:03.200582] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFIN took 25.3s. Estimated remaining: 41m 30s. Rate: 7.1 symbols/min [2025-10-08T21:52:03.222728] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-08T21:52:03.377078] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:03.385161] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-08T21:52:03.385279] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-08T21:52:03.385476] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-08T21:52:03.386062] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-08T21:52:03.386400] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T21:52:03.386530] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-08T21:52:03.390084] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-08T21:52:03.744225] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:04.017558] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-08T21:52:04.817543] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-10-08T21:52:04.861824] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T21:52:05.018876] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:52:05.019229] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-10-08T21:52:05.019318] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:52:05.019370] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-08T21:52:05.019430] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:52:05.019501] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-08T21:52:05.019566] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-08T21:52:05.019602] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-08T21:52:05.019689] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-08T21:52:05.019761] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TGE took 1.8s. Estimated remaining: 41m 20s. Rate: 7.1 symbols/min [2025-10-08T21:52:05.546831] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:52:05.617606] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-08T21:52:06.417557] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-08T21:52:07.227506] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-08T21:52:07.235558] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:52:07.958417] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T21:52:08.000185] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-08T21:52:08.017486] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-08T21:52:08.817547] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-08T21:52:08.840989] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T21:52:09.617589] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-08T21:52:10.341383] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T21:52:10.417568] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-08T21:52:10.996068] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T21:52:11.030921] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T21:52:11.217573] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-08T21:52:12.017554] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-08T21:52:12.036881] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T21:52:12.817545] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-08T21:52:13.620126] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-08T21:52:13.619987] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-08T21:52:13.696567] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-08T21:52:14.417559] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-08T21:52:15.045114] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T21:52:15.050440] [INFO ] [REMOTE ] TFPM: Full fetch complete (51770 records). [2025-10-08T21:52:15.050549] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-08T21:52:15.218533] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-08T21:52:15.344453] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T21:52:15.484464] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-08T21:52:15.484553] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-08T21:52:15.485416] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-08T21:52:15.485479] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-08T21:52:15.486746] [DEBUG] [LOCAL ] TFPM: Trimmed 51770 records to 38574 (keeping 200 days of data) [2025-10-08T21:52:15.728243] [DEBUG] [LOCAL ] TFPM: Primary data saved (38574 records). [2025-10-08T21:52:15.728443] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-08T21:52:15.728564] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TFPM took 30.6s. Estimated remaining: 41m 12s. Rate: 7.1 symbols/min [2025-10-08T21:52:16.017549] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-08T21:52:16.587603] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T21:52:16.785393] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T21:52:16.817769] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-08T21:52:17.617573] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-08T21:52:18.234503] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T21:52:18.417558] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-08T21:52:18.446197] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T21:52:19.217549] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-08T21:52:19.933186] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T21:52:20.017528] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-08T21:52:20.062130] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T21:52:20.817563] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-08T21:52:21.305089] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T21:52:21.508529] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T21:52:21.509931] [INFO ] [REMOTE ] TG: Full fetch complete (14989 records). [2025-10-08T21:52:21.510006] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-08T21:52:21.622632] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-08T21:52:21.901358] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-08T21:52:21.901444] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-08T21:52:21.901832] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-08T21:52:21.901895] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-08T21:52:21.902410] [DEBUG] [LOCAL ] TG: Trimmed 14989 records to 10354 (keeping 200 days of data) [2025-10-08T21:52:21.962072] [DEBUG] [LOCAL ] TG: Primary data saved (10354 records). [2025-10-08T21:52:21.962260] [INFO ] [MAIN ] TG: Full history saved. [2025-10-08T21:52:21.962388] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 21.0s. Estimated remaining: 41m 3s. Rate: 7.1 symbols/min [2025-10-08T21:52:23.191760] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T21:52:23.200739] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-08T21:52:24.454605] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T21:52:24.457949] [INFO ] [REMOTE ] TFX: Full fetch complete (54628 records). [2025-10-08T21:52:24.458075] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-08T21:52:24.850433] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-08T21:52:24.850520] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-08T21:52:24.851409] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-08T21:52:24.851471] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-08T21:52:24.852622] [DEBUG] [LOCAL ] TFX: Trimmed 54628 records to 36748 (keeping 200 days of data) [2025-10-08T21:52:25.078467] [DEBUG] [LOCAL ] TFX: Primary data saved (36748 records). [2025-10-08T21:52:25.078611] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-08T21:52:25.079703] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TFX took 31.6s. Estimated remaining: 40m 54s. Rate: 7.1 symbols/min [2025-10-08T21:52:25.757865] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:25.863185] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:25.751205] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:25.883160] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:25.946075] [DEBUG] [LOCAL ] TGLS: Loaded 27698 existing records from primary storage. [2025-10-08T21:52:25.946750] [INFO ] [MAIN ] TGLS: Loaded 27698 existing records. [2025-10-08T21:52:26.029893] [DEBUG] [LOCAL ] TGS: Loaded 32906 existing records from primary storage. [2025-10-08T21:52:26.088833] [INFO ] [MAIN ] TGS: Loaded 32906 existing records. [2025-10-08T21:52:26.124191] [DEBUG] [LOCAL ] TGNA: Loaded 48672 existing records from primary storage. [2025-10-08T21:52:26.166252] [INFO ] [MAIN ] TGNA: Loaded 48672 existing records. [2025-10-08T21:52:26.290872] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-08T21:52:26.409551] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:26.409765] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-10-08T21:52:26.473798] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-08T21:52:26.548203] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-08T21:52:26.637789] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-08T21:52:26.664697] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-08T21:52:26.683681] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:26.726827] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-08T21:52:26.696369] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:26.751355] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-08T21:52:26.815667] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-08T21:52:26.815818] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-08T21:52:26.858215] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-08T21:52:26.882392] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-08T21:52:26.868105] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:26.912920] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-08T21:52:26.952844] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-08T21:52:26.953036] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-08T21:52:26.944157] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-08T21:52:27.001818] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-08T21:52:27.065867] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-08T21:52:28.073888] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:28.100052] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-10-08T21:52:28.233465] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:28.265345] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-10-08T21:52:28.270857] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:28.283030] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-10-08T21:52:28.352720] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:28.353010] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-10-08T21:52:29.218095] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T21:52:29.223632] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-08T21:52:29.430271] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T21:52:29.436879] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-08T21:52:29.518330] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T21:52:29.529635] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-08T21:52:30.166634] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T21:52:30.172488] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-08T21:52:30.512854] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T21:52:30.525877] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-08T21:52:30.558776] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T21:52:30.567465] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-08T21:52:31.168359] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-08T21:52:31.217568] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-08T21:52:31.388622] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T21:52:31.520724] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T21:52:32.017635] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-08T21:52:32.515171] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T21:52:32.599485] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-08T21:52:32.817530] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-08T21:52:33.194009] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T21:52:33.617610] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-08T21:52:34.417530] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-08T21:52:34.945340] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-08T21:52:35.156695] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T21:52:35.217538] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-08T21:52:35.408732] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T21:52:36.017557] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-08T21:52:36.817622] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-08T21:52:37.083447] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T21:52:37.112630] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T21:52:37.617589] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-08T21:52:38.158147] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T21:52:38.417520] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-08T21:52:38.989782] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T21:52:39.217571] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-08T21:52:40.017574] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-08T21:52:40.096751] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T21:52:40.171512] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-08T21:52:40.817527] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-08T21:52:41.126842] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-08T21:52:41.617636] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-08T21:52:42.148902] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-08T21:52:42.417566] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-08T21:52:42.812440] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:52:43.217603] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-08T21:52:43.628986] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T21:52:44.017565] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-08T21:52:44.817614] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-08T21:52:44.986582] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T21:52:45.617531] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-08T21:52:45.674438] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-08T21:52:46.414982] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T21:52:46.423843] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-08T21:52:46.939095] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T21:52:47.220513] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-08T21:52:47.224821] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T21:52:48.017626] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-08T21:52:48.817576] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-08T21:52:48.864264] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T21:52:49.145043] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T21:52:49.147250] [INFO ] [REMOTE ] TGLS: Full fetch complete (40540 records). [2025-10-08T21:52:49.147323] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-08T21:52:49.515594] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-08T21:52:49.515708] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-08T21:52:49.516493] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-08T21:52:49.516533] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-08T21:52:49.517534] [DEBUG] [LOCAL ] TGLS: Trimmed 40540 records to 27549 (keeping 200 days of data) [2025-10-08T21:52:49.617622] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-08T21:52:49.691538] [DEBUG] [LOCAL ] TGLS: Primary data saved (27549 records). [2025-10-08T21:52:49.691703] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-08T21:52:49.691816] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGLS took 24.6s. Estimated remaining: 40m 48s. Rate: 7.1 symbols/min [2025-10-08T21:52:49.859994] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:49.911456] [DEBUG] [LOCAL ] THC: Loaded 47471 existing records from primary storage. [2025-10-08T21:52:49.911791] [INFO ] [MAIN ] THC: Loaded 47471 existing records. [2025-10-08T21:52:50.087619] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:50.087864] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-08T21:52:50.087910] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-08T21:52:50.088185] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-08T21:52:50.088244] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-08T21:52:50.432993] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-08T21:52:50.477809] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:50.880363] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T21:52:51.219452] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-10-08T21:52:51.222829] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-08T21:52:52.017583] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-08T21:52:52.174951] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T21:52:52.488788] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T21:52:52.817548] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-08T21:52:53.617616] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-08T21:52:54.336615] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-08T21:52:54.417501] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-08T21:52:54.497822] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-08T21:52:54.898328] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T21:52:54.902001] [INFO ] [REMOTE ] TGS: Full fetch complete (47915 records). [2025-10-08T21:52:54.902162] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-08T21:52:55.222761] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-08T21:52:55.308634] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-08T21:52:55.308827] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-08T21:52:55.309893] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-08T21:52:55.309962] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-08T21:52:55.311256] [DEBUG] [LOCAL ] TGS: Trimmed 47915 records to 32929 (keeping 200 days of data) [2025-10-08T21:52:55.514332] [DEBUG] [LOCAL ] TGS: Primary data saved (32929 records). [2025-10-08T21:52:55.514524] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-08T21:52:55.514628] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGS took 30.4s. Estimated remaining: 40m 39s. Rate: 7.1 symbols/min [2025-10-08T21:52:55.692771] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:52:55.716765] [DEBUG] [LOCAL ] THG: Loaded 21623 existing records from primary storage. [2025-10-08T21:52:55.717109] [INFO ] [MAIN ] THG: Loaded 21623 existing records. [2025-10-08T21:52:55.937129] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:52:55.937420] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-08T21:52:55.937475] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-08T21:52:55.937734] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-08T21:52:55.937795] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-08T21:52:56.023273] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-08T21:52:56.382483] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:52:56.592520] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-08T21:52:56.817521] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-10-08T21:52:57.067959] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T21:52:57.335508] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T21:52:57.493006] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T21:52:57.617547] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-08T21:52:58.417612] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-08T21:52:59.217502] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-08T21:52:59.406338] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T21:52:59.524983] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-08T21:53:00.017548] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-08T21:53:00.449967] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:53:00.453772] [INFO ] [REMOTE ] TGNA: Full fetch complete (69949 records). [2025-10-08T21:53:00.453893] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-08T21:53:00.820774] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-08T21:53:00.844045] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-08T21:53:00.844184] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-08T21:53:00.845369] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-08T21:53:00.845692] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-08T21:53:00.862748] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T21:53:00.869249] [DEBUG] [LOCAL ] TGNA: Trimmed 69949 records to 48633 (keeping 200 days of data) [2025-10-08T21:53:01.165780] [DEBUG] [LOCAL ] TGNA: Primary data saved (48633 records). [2025-10-08T21:53:01.165934] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-08T21:53:01.166023] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. TGNA took 36.1s. Estimated remaining: 40m 30s. Rate: 7.1 symbols/min [2025-10-08T21:53:01.334990] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:01.339616] [DEBUG] [LOCAL ] THIR: Loaded 2271 existing records from primary storage. [2025-10-08T21:53:01.339818] [INFO ] [MAIN ] THIR: Loaded 2271 existing records. [2025-10-08T21:53:01.524562] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:01.524838] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-08T21:53:01.524968] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-08T21:53:01.525162] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-08T21:53:01.525220] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-08T21:53:01.622794] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-08T21:53:01.935737] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:02.417554] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-10-08T21:53:02.822034] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-08T21:53:03.177671] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T21:53:03.217604] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-08T21:53:03.285275] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-08T21:53:04.017562] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-08T21:53:04.489698] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T21:53:04.817555] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-08T21:53:05.617527] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-08T21:53:06.165572] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T21:53:06.166778] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T21:53:06.379365] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-08T21:53:06.417529] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-08T21:53:07.217568] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-08T21:53:07.992474] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:53:08.017533] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-08T21:53:08.390891] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T21:53:08.653605] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T21:53:08.817564] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-08T21:53:09.617534] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-08T21:53:09.725749] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T21:53:09.899838] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-08T21:53:10.417601] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-08T21:53:10.930818] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T21:53:11.217554] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-08T21:53:11.642298] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T21:53:12.017689] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-08T21:53:12.817552] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-08T21:53:13.617591] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-08T21:53:13.889621] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-08T21:53:14.055287] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-08T21:53:14.417523] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-08T21:53:14.474021] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-08T21:53:15.217606] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-08T21:53:15.632823] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T21:53:15.755233] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-08T21:53:16.017587] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-08T21:53:16.418041] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T21:53:16.422864] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-10-08T21:53:16.423055] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-08T21:53:16.820776] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-08T21:53:16.872107] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-08T21:53:16.872208] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-08T21:53:16.873334] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-08T21:53:16.873410] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-08T21:53:16.875072] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 53778 (keeping 200 days of data) [2025-10-08T21:53:17.218187] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-10-08T21:53:17.218347] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-08T21:53:17.218433] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 52.1s. Estimated remaining: 40m 23s. Rate: 7.1 symbols/min [2025-10-08T21:53:17.420691] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:17.424862] [DEBUG] [LOCAL ] THLV: Loaded 1542 existing records from primary storage. [2025-10-08T21:53:17.425064] [INFO ] [MAIN ] THLV: Loaded 1542 existing records. [2025-10-08T21:53:17.602407] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:17.602689] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-08T21:53:17.602748] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-08T21:53:17.602905] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-08T21:53:17.602963] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-08T21:53:17.624508] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-08T21:53:17.967836] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:18.261226] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T21:53:18.417536] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-08T21:53:18.537856] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T21:53:18.819977] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T21:53:19.217556] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-08T21:53:19.713564] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T21:53:19.714425] [INFO ] [REMOTE ] THIR: Full fetch complete (2790 records). [2025-10-08T21:53:19.714496] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-08T21:53:20.022634] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-10-08T21:53:20.080213] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-08T21:53:20.080284] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-08T21:53:20.080392] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-08T21:53:20.080429] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-08T21:53:20.080817] [DEBUG] [LOCAL ] THIR: Trimmed 2790 records to 2284 (keeping 200 days of data) [2025-10-08T21:53:20.094588] [DEBUG] [LOCAL ] THIR: Primary data saved (2284 records). [2025-10-08T21:53:20.094685] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-08T21:53:20.094775] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THIR took 18.9s. Estimated remaining: 40m 14s. Rate: 7.1 symbols/min [2025-10-08T21:53:20.263286] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:20.302298] [DEBUG] [LOCAL ] THO: Loaded 41733 existing records from primary storage. [2025-10-08T21:53:20.302623] [INFO ] [MAIN ] THO: Loaded 41733 existing records. [2025-10-08T21:53:20.476665] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:20.476870] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-08T21:53:20.476916] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-08T21:53:20.477138] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-08T21:53:20.477195] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-08T21:53:20.579404] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-08T21:53:20.829787] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:20.824932] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-08T21:53:21.617583] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-10-08T21:53:21.917381] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-08T21:53:22.417571] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-08T21:53:23.099968] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T21:53:23.217553] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-08T21:53:23.665941] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-08T21:53:23.941946] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:53:24.017506] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-08T21:53:24.817598] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-08T21:53:25.249146] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-08T21:53:25.276517] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-08T21:53:25.617556] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-08T21:53:26.078392] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-08T21:53:26.417565] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-08T21:53:27.217507] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-08T21:53:27.498124] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T21:53:28.017599] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-08T21:53:28.440668] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T21:53:28.817544] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-08T21:53:28.904525] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-08T21:53:28.906425] [INFO ] [REMOTE ] THG: Full fetch complete (31086 records). [2025-10-08T21:53:28.906506] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-08T21:53:29.288296] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-08T21:53:29.288466] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-08T21:53:29.288566] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-08T21:53:29.290696] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-08T21:53:29.290765] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-08T21:53:29.291564] [DEBUG] [LOCAL ] THG: Trimmed 31086 records to 21582 (keeping 200 days of data) [2025-10-08T21:53:29.434559] [DEBUG] [LOCAL ] THG: Primary data saved (21582 records). [2025-10-08T21:53:29.434725] [INFO ] [MAIN ] THG: Full history saved. [2025-10-08T21:53:29.434825] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THG took 33.9s. Estimated remaining: 40m 5s. Rate: 7.1 symbols/min [2025-10-08T21:53:29.609563] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:29.617540] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-08T21:53:29.637075] [DEBUG] [LOCAL ] THQ: Loaded 25172 existing records from primary storage. [2025-10-08T21:53:29.637331] [INFO ] [MAIN ] THQ: Loaded 25172 existing records. [2025-10-08T21:53:29.815697] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:29.815958] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-08T21:53:29.816028] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-08T21:53:29.816560] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-08T21:53:29.816619] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-08T21:53:30.170167] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:30.417578] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-08T21:53:30.849522] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-08T21:53:31.107345] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T21:53:31.217588] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-08T21:53:31.573419] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T21:53:32.017556] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-08T21:53:32.346435] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-08T21:53:32.817539] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-08T21:53:33.617548] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-10-08T21:53:34.417592] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-08T21:53:34.476262] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T21:53:34.749890] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T21:53:34.860207] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-08T21:53:35.217553] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-08T21:53:36.017506] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-08T21:53:36.262675] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T21:53:36.376462] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-08T21:53:36.817552] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-08T21:53:37.617554] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-08T21:53:38.072598] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-08T21:53:38.076254] [INFO ] [REMOTE ] THC: Full fetch complete (68939 records). [2025-10-08T21:53:38.076355] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-08T21:53:38.438190] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-08T21:53:38.460483] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-08T21:53:38.460555] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-08T21:53:38.461551] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-08T21:53:38.461616] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-08T21:53:38.463268] [DEBUG] [LOCAL ] THC: Trimmed 68939 records to 47368 (keeping 200 days of data) [2025-10-08T21:53:38.688056] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:53:38.771160] [DEBUG] [LOCAL ] THC: Primary data saved (47368 records). [2025-10-08T21:53:38.771280] [INFO ] [MAIN ] THC: Full history saved. [2025-10-08T21:53:38.772168] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THC took 49.1s. Estimated remaining: 39m 57s. Rate: 7.1 symbols/min [2025-10-08T21:53:38.880943] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T21:53:38.902176] [INFO ] [REMOTE ] THLV: Full fetch complete (2606 records). [2025-10-08T21:53:38.921411] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-08T21:53:39.020146] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:39.202419] [DEBUG] [LOCAL ] THR: Loaded 19876 existing records from primary storage. [2025-10-08T21:53:39.218981] [INFO ] [MAIN ] THR: Loaded 19876 existing records. [2025-10-08T21:53:39.218824] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-08T21:53:39.453726] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-08T21:53:39.487284] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-08T21:53:39.487475] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-08T21:53:39.488035] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-08T21:53:39.510517] [DEBUG] [LOCAL ] THLV: Trimmed 2606 records to 1541 (keeping 200 days of data) [2025-10-08T21:53:39.510146] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:39.511068] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-08T21:53:39.511174] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-08T21:53:39.515963] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-08T21:53:39.516070] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-08T21:53:39.625196] [DEBUG] [LOCAL ] THLV: Primary data saved (1541 records). [2025-10-08T21:53:39.625357] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-08T21:53:39.625455] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THLV took 22.4s. Estimated remaining: 39m 48s. Rate: 7.1 symbols/min [2025-10-08T21:53:39.990463] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:53:40.032718] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-08T21:53:40.078403] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:40.109707] [DEBUG] [LOCAL ] THS: Loaded 38487 existing records from primary storage. [2025-10-08T21:53:40.110009] [INFO ] [MAIN ] THS: Loaded 38487 existing records. [2025-10-08T21:53:40.283628] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:53:40.283842] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-08T21:53:40.283887] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-08T21:53:40.284109] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-08T21:53:40.284164] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-08T21:53:40.628770] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:53:40.817504] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-10-08T21:53:41.040724] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T21:53:41.091063] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-08T21:53:41.617549] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-08T21:53:42.102669] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T21:53:42.417536] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-08T21:53:42.756136] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T21:53:43.217564] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-10-08T21:53:43.608462] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T21:53:44.017530] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-08T21:53:44.314112] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T21:53:44.817519] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-08T21:53:45.580896] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T21:53:45.623394] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-08T21:53:45.625435] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T21:53:46.417565] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-08T21:53:46.794616] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T21:53:47.217574] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-08T21:53:47.610876] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:53:48.017547] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-08T21:53:48.292312] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:53:48.817571] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-08T21:53:49.203907] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T21:53:49.617570] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-08T21:53:49.784517] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T21:53:50.417594] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-08T21:53:50.522932] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T21:53:51.217576] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-08T21:53:51.885495] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T21:53:52.017548] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-08T21:53:52.225786] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:53:52.817606] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-08T21:53:53.500687] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:53:53.617519] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-08T21:53:53.973725] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T21:53:54.417542] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-08T21:53:54.736413] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T21:53:55.217626] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-08T21:53:55.537399] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T21:53:56.017638] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-08T21:53:56.574294] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T21:53:56.817615] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-08T21:53:57.458322] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T21:53:57.617556] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-08T21:53:57.752348] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T21:53:58.417562] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-08T21:53:58.806361] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:53:59.217597] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-08T21:53:59.675934] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T21:54:00.017578] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-08T21:54:00.717867] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T21:54:00.817605] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-08T21:54:01.471198] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T21:54:01.617544] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-08T21:54:01.734355] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-08T21:54:02.417550] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-08T21:54:02.519543] [DEBUG] [REMOTE ] THR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-08T21:54:02.519958] [WARN ] [REMOTE ] THR: No data returned for month 2025-07 [2025-10-08T21:54:02.520050] [FATAL] [REMOTE ] THR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:54:02.520166] [FATAL] [MAIN ] THR: Failed to fetch primary data. [2025-10-08T21:54:02.520249] [WARN ] [MAIN ] THR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:54:02.520346] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-08T21:54:02.520429] [DEBUG] [LOCAL ] THR: No primary data file found to delete. [2025-10-08T21:54:02.520481] [INFO ] [LOCAL ] THR: Starting deletion of derivative data. [2025-10-08T21:54:02.520858] [DEBUG] [LOCAL ] THR: Deleted derivative data file. [2025-10-08T21:54:02.521004] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THR took 23.7s. Estimated remaining: 39m 41s. Rate: 7.1 symbols/min [2025-10-08T21:54:02.698267] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:02.719255] [DEBUG] [LOCAL ] THW: Loaded 19643 existing records from primary storage. [2025-10-08T21:54:02.719600] [INFO ] [MAIN ] THW: Loaded 19643 existing records. [2025-10-08T21:54:02.856905] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T21:54:02.900796] [INFO ] [REMOTE ] THO: Full fetch complete (60248 records). [2025-10-08T21:54:02.902094] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-08T21:54:02.924757] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:02.967744] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-08T21:54:03.002162] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-08T21:54:03.044534] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-08T21:54:03.044785] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-08T21:54:03.218563] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-08T21:54:03.674504] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-08T21:54:03.684873] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-08T21:54:03.698516] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-08T21:54:03.709140] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-08T21:54:03.739215] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:03.740288] [DEBUG] [LOCAL ] THO: Trimmed 60248 records to 41671 (keeping 200 days of data) [2025-10-08T21:54:04.018709] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-10-08T21:54:04.022838] [DEBUG] [LOCAL ] THO: Primary data saved (41671 records). [2025-10-08T21:54:04.023011] [INFO ] [MAIN ] THO: Full history saved. [2025-10-08T21:54:04.023128] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THO took 43.9s. Estimated remaining: 39m 32s. Rate: 7.1 symbols/min [2025-10-08T21:54:04.192677] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:04.192872] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-08T21:54:04.192910] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-08T21:54:04.193021] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-08T21:54:04.193061] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-08T21:54:04.193101] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-08T21:54:04.193133] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-08T21:54:04.569465] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-08T21:54:04.573418] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:04.817597] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-08T21:54:04.923828] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T21:54:05.617520] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-08T21:54:05.844503] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T21:54:05.847001] [INFO ] [REMOTE ] THQ: Full fetch complete (35089 records). [2025-10-08T21:54:05.847131] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-08T21:54:06.237323] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-08T21:54:06.237411] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-08T21:54:06.238346] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-08T21:54:06.238434] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-08T21:54:06.240192] [DEBUG] [LOCAL ] THQ: Trimmed 35089 records to 25201 (keeping 200 days of data) [2025-10-08T21:54:06.393079] [DEBUG] [LOCAL ] THQ: Primary data saved (25201 records). [2025-10-08T21:54:06.393212] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-08T21:54:06.393314] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THQ took 37.0s. Estimated remaining: 39m 22s. Rate: 7.1 symbols/min [2025-10-08T21:54:06.425137] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-10-08T21:54:06.568862] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:06.604549] [DEBUG] [LOCAL ] TIMB: Loaded 35692 existing records from primary storage. [2025-10-08T21:54:06.604906] [INFO ] [MAIN ] TIMB: Loaded 35692 existing records. [2025-10-08T21:54:06.712320] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:54:06.723635] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-10-08T21:54:06.746633] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:54:06.767182] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-08T21:54:06.790357] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:06.790488] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:54:06.790792] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-08T21:54:06.790984] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-08T21:54:06.791133] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-08T21:54:06.791203] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-08T21:54:06.791342] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-08T21:54:06.791522] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-08T21:54:06.791690] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. TIC took 2.8s. Estimated remaining: 39m 13s. Rate: 7.1 symbols/min [2025-10-08T21:54:06.791773] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-08T21:54:06.791873] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-08T21:54:07.217807] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-08T21:54:07.253894] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:07.393367] [DEBUG] [LOCAL ] TISI: Loaded 3531 existing records from primary storage. [2025-10-08T21:54:07.433029] [INFO ] [MAIN ] TISI: Loaded 3531 existing records. [2025-10-08T21:54:07.449103] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:07.517294] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T21:54:07.631977] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:07.632227] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-08T21:54:07.632273] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-08T21:54:07.632469] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-08T21:54:07.632525] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-08T21:54:07.983115] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:08.017512] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-10-08T21:54:08.268273] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T21:54:08.677404] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T21:54:08.817553] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-08T21:54:09.285756] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T21:54:09.617547] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-08T21:54:10.417612] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-08T21:54:10.953439] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T21:54:10.958493] [INFO ] [REMOTE ] THS: Full fetch complete (54326 records). [2025-10-08T21:54:10.958677] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-08T21:54:11.079509] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T21:54:11.224323] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-08T21:54:11.363599] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-08T21:54:11.363711] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-08T21:54:11.364615] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-08T21:54:11.364686] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-08T21:54:11.366508] [DEBUG] [LOCAL ] THS: Trimmed 54326 records to 38450 (keeping 200 days of data) [2025-10-08T21:54:11.587723] [DEBUG] [LOCAL ] THS: Primary data saved (38450 records). [2025-10-08T21:54:11.587876] [INFO ] [MAIN ] THS: Full history saved. [2025-10-08T21:54:11.587962] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. THS took 32.0s. Estimated remaining: 39m 4s. Rate: 7.1 symbols/min [2025-10-08T21:54:11.760164] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:11.792689] [DEBUG] [LOCAL ] TIXT: Loaded 31839 existing records from primary storage. [2025-10-08T21:54:11.793051] [INFO ] [MAIN ] TIXT: Loaded 31839 existing records. [2025-10-08T21:54:11.989150] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:11.990425] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T21:54:11.990632] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-08T21:54:11.993038] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-08T21:54:11.994252] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-08T21:54:11.994335] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-08T21:54:12.025361] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-08T21:54:12.366507] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:12.817515] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-08T21:54:12.895850] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T21:54:13.617533] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-08T21:54:13.780399] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T21:54:14.195685] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T21:54:14.417559] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-10-08T21:54:15.217804] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-10-08T21:54:15.944511] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T21:54:16.017488] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-08T21:54:16.483820] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T21:54:16.817629] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-08T21:54:17.164736] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T21:54:17.179971] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-08T21:54:17.617536] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-08T21:54:18.069332] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-08T21:54:18.417548] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-08T21:54:19.217508] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-08T21:54:19.695001] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T21:54:19.786103] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T21:54:20.017570] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-08T21:54:20.817605] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-08T21:54:21.214012] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T21:54:21.290739] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-08T21:54:21.617564] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-08T21:54:22.417612] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-08T21:54:23.162527] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T21:54:23.217505] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-08T21:54:23.423733] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T21:54:24.017556] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-08T21:54:24.434697] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T21:54:24.460555] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-08T21:54:24.817541] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-08T21:54:25.617585] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-08T21:54:26.254020] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T21:54:26.417544] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-08T21:54:26.740582] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:54:27.217598] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-08T21:54:27.613977] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T21:54:27.615018] [INFO ] [REMOTE ] TISI: Full fetch complete (4935 records). [2025-10-08T21:54:27.615104] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-08T21:54:28.011152] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-08T21:54:28.011410] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-08T21:54:28.012013] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-08T21:54:28.013080] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T21:54:28.013166] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-08T21:54:28.020931] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-08T21:54:28.022308] [DEBUG] [LOCAL ] TISI: Trimmed 4935 records to 3473 (keeping 200 days of data) [2025-10-08T21:54:28.044887] [DEBUG] [LOCAL ] TISI: Primary data saved (3473 records). [2025-10-08T21:54:28.044984] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-08T21:54:28.045084] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TISI took 21.2s. Estimated remaining: 38m 57s. Rate: 7.1 symbols/min [2025-10-08T21:54:28.215036] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:28.275288] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-08T21:54:28.275704] [INFO ] [MAIN ] TJX: Loaded 53668 existing records. [2025-10-08T21:54:28.462554] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:28.462844] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-08T21:54:28.462892] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-08T21:54:28.463125] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-08T21:54:28.463182] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-08T21:54:28.826198] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-08T21:54:28.838150] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:29.222889] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T21:54:29.617565] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-10-08T21:54:30.017068] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:54:30.417581] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-08T21:54:31.217535] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-08T21:54:31.323068] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-08T21:54:31.621722] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-08T21:54:32.017582] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-08T21:54:32.674592] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-08T21:54:32.817594] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-08T21:54:33.025063] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T21:54:33.617525] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-08T21:54:33.792056] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T21:54:34.417559] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-08T21:54:34.435303] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T21:54:35.217566] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-08T21:54:36.017577] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-08T21:54:36.281537] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T21:54:36.323116] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T21:54:36.817569] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-08T21:54:37.209847] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T21:54:37.617536] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-08T21:54:37.880174] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T21:54:38.408122] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T21:54:38.410730] [INFO ] [REMOTE ] TIMB: Full fetch complete (53734 records). [2025-10-08T21:54:38.410823] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-08T21:54:38.422809] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-08T21:54:38.790146] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-08T21:54:38.790231] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-08T21:54:38.791205] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-08T21:54:38.791269] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-08T21:54:38.792451] [DEBUG] [LOCAL ] TIMB: Trimmed 53734 records to 35638 (keeping 200 days of data) [2025-10-08T21:54:39.021471] [DEBUG] [LOCAL ] TIMB: Primary data saved (35638 records). [2025-10-08T21:54:39.021690] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-08T21:54:39.021810] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIMB took 32.6s. Estimated remaining: 38m 49s. Rate: 7.1 symbols/min [2025-10-08T21:54:39.194798] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:39.217531] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-08T21:54:39.236347] [DEBUG] [LOCAL ] TK: Loaded 39309 existing records from primary storage. [2025-10-08T21:54:39.236824] [INFO ] [MAIN ] TK: Loaded 39309 existing records. [2025-10-08T21:54:39.334557] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-08T21:54:39.371543] [INFO ] [REMOTE ] THW: Full fetch complete (29260 records). [2025-10-08T21:54:39.372278] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-08T21:54:39.570964] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:39.581269] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-08T21:54:39.584410] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-08T21:54:39.585092] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-08T21:54:39.595752] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-08T21:54:40.022694] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-08T21:54:40.225132] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-08T21:54:40.249990] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-08T21:54:40.260537] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-08T21:54:40.266966] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-08T21:54:40.295075] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-08T21:54:40.295836] [DEBUG] [LOCAL ] THW: Trimmed 29260 records to 19674 (keeping 200 days of data) [2025-10-08T21:54:40.292422] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:40.425571] [DEBUG] [LOCAL ] THW: Primary data saved (19674 records). [2025-10-08T21:54:40.425765] [INFO ] [MAIN ] THW: Full history saved. [2025-10-08T21:54:40.425873] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. THW took 37.9s. Estimated remaining: 38m 39s. Rate: 7.1 symbols/min [2025-10-08T21:54:40.636207] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:40.677661] [DEBUG] [LOCAL ] TKC: Loaded 38994 existing records from primary storage. [2025-10-08T21:54:40.677997] [INFO ] [MAIN ] TKC: Loaded 38994 existing records. [2025-10-08T21:54:40.824730] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-10-08T21:54:40.856379] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:54:40.857167] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-08T21:54:40.857269] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-08T21:54:40.857551] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-08T21:54:40.857614] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-08T21:54:41.279275] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:41.617553] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-10-08T21:54:41.679219] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T21:54:42.422636] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-08T21:54:42.442744] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T21:54:42.503683] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-08T21:54:43.217562] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-08T21:54:43.879897] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T21:54:44.017586] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-08T21:54:44.526128] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T21:54:44.817579] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-08T21:54:45.270578] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T21:54:45.617522] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-08T21:54:46.278306] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T21:54:46.417579] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-08T21:54:47.012275] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T21:54:47.217610] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-08T21:54:47.853296] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T21:54:48.017630] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-08T21:54:48.663435] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T21:54:48.817553] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-08T21:54:49.475191] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T21:54:49.617552] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-08T21:54:49.806144] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T21:54:49.809864] [INFO ] [REMOTE ] TIXT: Full fetch complete (46225 records). [2025-10-08T21:54:49.810029] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-08T21:54:50.209389] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-08T21:54:50.209479] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-08T21:54:50.210432] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-08T21:54:50.210498] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-08T21:54:50.211666] [DEBUG] [LOCAL ] TIXT: Trimmed 46225 records to 31936 (keeping 200 days of data) [2025-10-08T21:54:50.395676] [DEBUG] [LOCAL ] TIXT: Primary data saved (31936 records). [2025-10-08T21:54:50.395845] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-08T21:54:50.395937] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TIXT took 38.8s. Estimated remaining: 38m 31s. Rate: 7.1 symbols/min [2025-10-08T21:54:50.427019] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-08T21:54:50.568710] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:54:50.568920] [DEBUG] [LOCAL ] TKO: No existing data file found in primary storage. [2025-10-08T21:54:50.568958] [WARN ] [MAIN ] TKO: No existing data found, performing full refresh instead. [2025-10-08T21:54:50.569095] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-08T21:54:50.569146] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-08T21:54:50.569203] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-10-08T21:54:50.569236] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-08T21:54:50.939156] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:54:51.093911] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:54:51.217581] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-10-08T21:54:52.017734] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-08T21:54:52.476267] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T21:54:52.538913] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T21:54:52.817518] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-08T21:54:53.157000] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T21:54:53.617591] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-08T21:54:54.056628] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T21:54:54.417564] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-08T21:54:55.187142] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:54:55.217516] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-08T21:54:56.017576] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-08T21:54:56.326737] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T21:54:56.774624] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T21:54:56.817518] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-08T21:54:57.511670] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T21:54:57.617543] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-08T21:54:58.060998] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-08T21:54:58.417580] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-08T21:54:58.734493] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T21:54:59.217601] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-08T21:55:00.017580] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-08T21:55:00.478812] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T21:55:00.595499] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T21:55:00.817577] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-08T21:55:01.617562] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-08T21:55:02.064991] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-08T21:55:02.417533] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-08T21:55:02.908705] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T21:55:03.147675] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T21:55:03.217609] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-08T21:55:03.528005] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-08T21:55:04.017571] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-08T21:55:04.817528] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-08T21:55:05.232861] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T21:55:05.433306] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-08T21:55:05.617538] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-08T21:55:05.840249] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-08T21:55:06.417554] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-08T21:55:07.217580] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-08T21:55:07.402435] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-08T21:55:07.857335] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T21:55:08.017506] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-08T21:55:08.268225] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T21:55:08.817559] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-08T21:55:08.840623] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T21:55:08.843553] [INFO ] [REMOTE ] TK: Full fetch complete (56406 records). [2025-10-08T21:55:08.843665] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-08T21:55:09.221237] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-08T21:55:09.221349] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-08T21:55:09.222380] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-08T21:55:09.222443] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-08T21:55:09.223733] [DEBUG] [LOCAL ] TK: Trimmed 56406 records to 39226 (keeping 200 days of data) [2025-10-08T21:55:09.451052] [DEBUG] [LOCAL ] TK: Primary data saved (39226 records). [2025-10-08T21:55:09.451204] [INFO ] [MAIN ] TK: Full history saved. [2025-10-08T21:55:09.451300] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TK took 30.4s. Estimated remaining: 38m 24s. Rate: 7.1 symbols/min [2025-10-08T21:55:09.621616] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:09.621712] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-08T21:55:09.660293] [DEBUG] [LOCAL ] TKR: Loaded 39915 existing records from primary storage. [2025-10-08T21:55:09.660606] [INFO ] [MAIN ] TKR: Loaded 39915 existing records. [2025-10-08T21:55:09.837495] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:09.837726] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-08T21:55:09.837779] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-08T21:55:09.838018] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-08T21:55:09.838075] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-08T21:55:10.193152] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:10.417506] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-10-08T21:55:10.540537] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T21:55:11.217622] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-08T21:55:11.562084] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T21:55:11.824765] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T21:55:12.017570] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-08T21:55:12.824608] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-08T21:55:12.830833] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T21:55:13.451585] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T21:55:13.617532] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-08T21:55:14.248338] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:55:14.417553] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-08T21:55:14.600721] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (0.18 seconds). [2025-10-08T21:55:14.604993] [INFO ] [REMOTE ] TJX: Full fetch complete (77682 records). [2025-10-08T21:55:14.605135] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-08T21:55:15.024335] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-08T21:55:15.024485] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-08T21:55:15.025703] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-08T21:55:15.025795] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-08T21:55:15.038769] [DEBUG] [LOCAL ] TJX: Trimmed 77682 records to 53668 (keeping 200 days of data) [2025-10-08T21:55:15.059948] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T21:55:15.257936] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-08T21:55:15.422534] [DEBUG] [LOCAL ] TJX: Primary data saved (53668 records). [2025-10-08T21:55:15.422733] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-08T21:55:15.423844] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 47.4s. Estimated remaining: 38m 15s. Rate: 7.1 symbols/min [2025-10-08T21:55:15.592397] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:15.633335] [DEBUG] [LOCAL ] TLK: Loaded 38847 existing records from primary storage. [2025-10-08T21:55:15.633691] [INFO ] [MAIN ] TLK: Loaded 38847 existing records. [2025-10-08T21:55:15.809159] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:15.809385] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-08T21:55:15.809432] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-08T21:55:15.809688] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-08T21:55:15.809791] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-08T21:55:16.022811] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-08T21:55:16.160337] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:16.817695] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-10-08T21:55:16.872132] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-08T21:55:17.487859] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T21:55:17.617535] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-08T21:55:18.117372] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T21:55:18.417548] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-08T21:55:19.026949] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T21:55:19.217627] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-08T21:55:19.839725] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T21:55:19.843589] [INFO ] [REMOTE ] TKC: Full fetch complete (52769 records). [2025-10-08T21:55:19.843725] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-08T21:55:20.029286] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-08T21:55:20.226425] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-08T21:55:20.226511] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-08T21:55:20.227588] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-08T21:55:20.227674] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-08T21:55:20.228874] [DEBUG] [LOCAL ] TKC: Trimmed 52769 records to 39065 (keeping 200 days of data) [2025-10-08T21:55:20.461115] [DEBUG] [LOCAL ] TKC: Primary data saved (39065 records). [2025-10-08T21:55:20.461268] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-08T21:55:20.462627] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TKC took 40.0s. Estimated remaining: 38m 6s. Rate: 7.1 symbols/min [2025-10-08T21:55:20.637062] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:20.655509] [DEBUG] [LOCAL ] TLYS: Loaded 16491 existing records from primary storage. [2025-10-08T21:55:20.655812] [INFO ] [MAIN ] TLYS: Loaded 16491 existing records. [2025-10-08T21:55:20.819700] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-08T21:55:20.845610] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:20.846669] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-08T21:55:20.847443] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-08T21:55:20.847981] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-08T21:55:20.848158] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-08T21:55:20.947518] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:55:21.248632] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:21.555600] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T21:55:21.617515] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-08T21:55:22.118063] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-08T21:55:22.380924] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T21:55:22.417550] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-08T21:55:22.968831] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T21:55:22.972523] [INFO ] [REMOTE ] TKO: Full fetch complete (64771 records). [2025-10-08T21:55:22.972696] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-08T21:55:23.226338] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-08T21:55:23.359609] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-08T21:55:23.359717] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-08T21:55:23.360672] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-08T21:55:23.360733] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-08T21:55:23.361997] [DEBUG] [LOCAL ] TKO: Trimmed 64771 records to 43861 (keeping 200 days of data) [2025-10-08T21:55:23.647419] [DEBUG] [LOCAL ] TKO: Primary data saved (43861 records). [2025-10-08T21:55:23.647578] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-08T21:55:23.647707] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKO took 33.3s. Estimated remaining: 37m 57s. Rate: 7.1 symbols/min [2025-10-08T21:55:23.821742] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:23.861052] [DEBUG] [LOCAL ] TM: Loaded 36326 existing records from primary storage. [2025-10-08T21:55:23.861367] [INFO ] [MAIN ] TM: Loaded 36326 existing records. [2025-10-08T21:55:24.018145] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-08T21:55:24.043163] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:24.043426] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-08T21:55:24.044218] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-08T21:55:24.044723] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-08T21:55:24.044782] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-08T21:55:24.411061] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:24.818015] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-10-08T21:55:24.823149] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T21:55:25.575528] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T21:55:25.621963] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-08T21:55:25.625755] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-08T21:55:26.417560] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-10-08T21:55:26.967974] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T21:55:27.217602] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-08T21:55:27.973628] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-08T21:55:28.017576] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-08T21:55:28.173425] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T21:55:28.738152] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-08T21:55:28.817726] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-08T21:55:29.617598] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-08T21:55:30.320229] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T21:55:30.417596] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-08T21:55:31.208430] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T21:55:31.219549] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-08T21:55:31.542715] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T21:55:32.017551] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-08T21:55:32.605116] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T21:55:32.817584] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-08T21:55:33.541090] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T21:55:33.536422] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T21:55:33.617570] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-08T21:55:34.417528] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-08T21:55:34.430158] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T21:55:35.217607] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-08T21:55:35.587600] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T21:55:36.017569] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-08T21:55:36.749953] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T21:55:36.817607] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-08T21:55:37.559640] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:55:37.617564] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-08T21:55:37.945493] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T21:55:38.417561] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-08T21:55:39.060362] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:55:39.217577] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-08T21:55:39.608779] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T21:55:40.017562] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-08T21:55:40.450031] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:55:40.457092] [INFO ] [REMOTE ] TKR: Full fetch complete (57776 records). [2025-10-08T21:55:40.457321] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-08T21:55:40.822704] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-08T21:55:40.954093] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-08T21:55:40.954192] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-08T21:55:40.955360] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-08T21:55:40.955436] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-08T21:55:40.956893] [DEBUG] [LOCAL ] TKR: Trimmed 57776 records to 39922 (keeping 200 days of data) [2025-10-08T21:55:41.232410] [DEBUG] [LOCAL ] TKR: Primary data saved (39922 records). [2025-10-08T21:55:41.232697] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-08T21:55:41.232832] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKR took 31.8s. Estimated remaining: 37m 50s. Rate: 7.1 symbols/min [2025-10-08T21:55:41.419417] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:41.459914] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T21:55:41.516828] [DEBUG] [LOCAL ] TME: Loaded 53178 existing records from primary storage. [2025-10-08T21:55:41.517370] [INFO ] [MAIN ] TME: Loaded 53178 existing records. [2025-10-08T21:55:41.622705] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-08T21:55:41.741031] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:41.741353] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-08T21:55:41.741433] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-08T21:55:41.741754] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-08T21:55:41.741814] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-08T21:55:42.094160] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T21:55:42.120630] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:42.417595] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-08T21:55:43.217522] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-08T21:55:43.348673] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T21:55:43.728963] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-08T21:55:44.017554] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-08T21:55:44.029099] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T21:55:44.817541] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-08T21:55:45.617522] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-10-08T21:55:45.777351] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T21:55:46.376344] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T21:55:46.417500] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-08T21:55:46.996702] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T21:55:47.217538] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-08T21:55:47.941261] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T21:55:48.017598] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-08T21:55:48.660265] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T21:55:48.817554] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-08T21:55:49.047879] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-08T21:55:49.051230] [INFO ] [REMOTE ] TLK: Full fetch complete (57387 records). [2025-10-08T21:55:49.051326] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-08T21:55:49.445064] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-08T21:55:49.445153] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-08T21:55:49.446497] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-08T21:55:49.446559] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-08T21:55:49.447862] [DEBUG] [LOCAL ] TLK: Trimmed 57387 records to 38832 (keeping 200 days of data) [2025-10-08T21:55:49.619297] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-08T21:55:49.687576] [DEBUG] [LOCAL ] TLK: Primary data saved (38832 records). [2025-10-08T21:55:49.687776] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-08T21:55:49.687924] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 34.3s. Estimated remaining: 37m 41s. Rate: 7.1 symbols/min [2025-10-08T21:55:49.864197] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:49.907768] [DEBUG] [LOCAL ] TMHC: Loaded 45302 existing records from primary storage. [2025-10-08T21:55:49.908099] [INFO ] [MAIN ] TMHC: Loaded 45302 existing records. [2025-10-08T21:55:50.086030] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:50.086279] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-08T21:55:50.086327] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-08T21:55:50.086595] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-08T21:55:50.086690] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-08T21:55:50.432976] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-08T21:55:50.471426] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:50.503691] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T21:55:50.600947] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T21:55:51.217552] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-08T21:55:51.956549] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T21:55:52.017555] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-10-08T21:55:52.817591] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-08T21:55:52.928107] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T21:55:53.514806] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T21:55:53.617574] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-08T21:55:54.428871] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-08T21:55:54.454223] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T21:55:55.028142] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T21:55:55.110284] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T21:55:55.111754] [INFO ] [REMOTE ] TLYS: Full fetch complete (21795 records). [2025-10-08T21:55:55.111829] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-08T21:55:55.222601] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-08T21:55:55.523038] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-08T21:55:55.523168] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-08T21:55:55.523976] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-08T21:55:55.524045] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-08T21:55:55.525325] [DEBUG] [LOCAL ] TLYS: Trimmed 21795 records to 16495 (keeping 200 days of data) [2025-10-08T21:55:55.628850] [DEBUG] [LOCAL ] TLYS: Primary data saved (16495 records). [2025-10-08T21:55:55.629093] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-08T21:55:55.629249] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TLYS took 35.2s. Estimated remaining: 37m 33s. Rate: 7.1 symbols/min [2025-10-08T21:55:55.816756] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:55:55.881243] [DEBUG] [LOCAL ] TMO: Loaded 52414 existing records from primary storage. [2025-10-08T21:55:55.881793] [INFO ] [MAIN ] TMO: Loaded 52414 existing records. [2025-10-08T21:55:56.022760] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-08T21:55:56.090750] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:55:56.091194] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-08T21:55:56.091253] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-08T21:55:56.091540] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-08T21:55:56.091601] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-08T21:55:56.542252] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:55:56.817574] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-10-08T21:55:56.966830] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T21:55:57.623904] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-08T21:55:57.631537] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T21:55:58.417556] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-08T21:55:58.500329] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T21:55:59.217584] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-08T21:55:59.264462] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T21:55:59.661267] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T21:56:00.017604] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-08T21:56:00.817546] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-08T21:56:01.169224] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-08T21:56:01.617578] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-08T21:56:01.710553] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T21:56:02.010590] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T21:56:02.417582] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-08T21:56:03.217614] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-08T21:56:03.348418] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T21:56:04.017585] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-08T21:56:04.112527] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-08T21:56:04.273753] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T21:56:04.278254] [INFO ] [REMOTE ] TM: Full fetch complete (52715 records). [2025-10-08T21:56:04.278546] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-08T21:56:04.710066] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-08T21:56:04.710201] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-08T21:56:04.711697] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-08T21:56:04.711767] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-08T21:56:04.713515] [DEBUG] [LOCAL ] TM: Trimmed 52715 records to 36372 (keeping 200 days of data) [2025-10-08T21:56:04.819880] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-08T21:56:04.978326] [DEBUG] [LOCAL ] TM: Primary data saved (36372 records). [2025-10-08T21:56:04.978567] [INFO ] [MAIN ] TM: Full history saved. [2025-10-08T21:56:04.978710] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TM took 41.3s. Estimated remaining: 37m 24s. Rate: 7.1 symbols/min [2025-10-08T21:56:05.178675] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:05.197458] [DEBUG] [LOCAL ] TNC: Loaded 14698 existing records from primary storage. [2025-10-08T21:56:05.197774] [INFO ] [MAIN ] TNC: Loaded 14698 existing records. [2025-10-08T21:56:05.404317] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:05.405338] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-08T21:56:05.405408] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-08T21:56:05.405588] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-08T21:56:05.405689] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-08T21:56:05.624153] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-08T21:56:05.830281] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:05.833237] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T21:56:06.417572] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-08T21:56:06.487938] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T21:56:07.191458] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T21:56:07.217513] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-10-08T21:56:08.017549] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-08T21:56:08.061428] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T21:56:08.256444] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T21:56:08.817610] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-08T21:56:09.617591] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-08T21:56:09.916435] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T21:56:10.417586] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-08T21:56:10.811945] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T21:56:10.932918] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T21:56:11.020919] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T21:56:11.217553] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-08T21:56:12.017540] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-08T21:56:12.231461] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T21:56:12.817626] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-08T21:56:13.617507] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-08T21:56:13.710515] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T21:56:14.417497] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-08T21:56:14.663760] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T21:56:15.023080] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-08T21:56:15.217548] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-08T21:56:16.017541] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-08T21:56:16.129197] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T21:56:16.205791] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-08T21:56:16.817593] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-08T21:56:17.617505] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-08T21:56:17.863577] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-08T21:56:18.011670] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-08T21:56:18.417564] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-08T21:56:18.867515] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T21:56:19.217508] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-08T21:56:19.280718] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T21:56:20.017597] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-08T21:56:20.817614] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-08T21:56:21.160279] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-08T21:56:21.617564] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-08T21:56:21.674169] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-08T21:56:21.705429] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-08T21:56:21.710558] [INFO ] [REMOTE ] TME: Full fetch complete (76921 records). [2025-10-08T21:56:21.711248] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-08T21:56:22.104043] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-08T21:56:22.104130] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-08T21:56:22.105186] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-08T21:56:22.105250] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-08T21:56:22.106772] [DEBUG] [LOCAL ] TME: Trimmed 76921 records to 53178 (keeping 200 days of data) [2025-10-08T21:56:22.417904] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-08T21:56:22.427701] [DEBUG] [LOCAL ] TME: Primary data saved (53178 records). [2025-10-08T21:56:22.427875] [INFO ] [MAIN ] TME: Full history saved. [2025-10-08T21:56:22.428024] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TME took 41.2s. Estimated remaining: 37m 17s. Rate: 7.1 symbols/min [2025-10-08T21:56:22.595954] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:22.629718] [DEBUG] [LOCAL ] TNET: Loaded 28339 existing records from primary storage. [2025-10-08T21:56:22.630095] [INFO ] [MAIN ] TNET: Loaded 28339 existing records. [2025-10-08T21:56:22.815007] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:22.815248] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-08T21:56:22.815309] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-08T21:56:22.815556] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-08T21:56:22.815616] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-08T21:56:23.185462] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:23.217504] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-10-08T21:56:23.306248] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T21:56:23.570335] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T21:56:24.017617] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-08T21:56:24.505265] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T21:56:24.817505] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-08T21:56:24.958331] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T21:56:25.617516] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-08T21:56:25.690750] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T21:56:26.417617] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-08T21:56:26.788619] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T21:56:26.792666] [INFO ] [REMOTE ] TMHC: Full fetch complete (66005 records). [2025-10-08T21:56:26.792784] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-08T21:56:27.186673] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-08T21:56:27.186786] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-08T21:56:27.188185] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-08T21:56:27.188252] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-08T21:56:27.190306] [DEBUG] [LOCAL ] TMHC: Trimmed 66005 records to 45297 (keeping 200 days of data) [2025-10-08T21:56:27.239246] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-08T21:56:27.464637] [DEBUG] [LOCAL ] TMHC: Primary data saved (45297 records). [2025-10-08T21:56:27.464815] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-08T21:56:27.464914] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TMHC took 37.8s. Estimated remaining: 37m 8s. Rate: 7.1 symbols/min [2025-10-08T21:56:27.632497] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:27.633111] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-08T21:56:27.633169] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-08T21:56:27.633280] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-08T21:56:27.633324] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-08T21:56:27.633367] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-08T21:56:27.633400] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-08T21:56:28.001811] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:28.017488] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-08T21:56:28.148982] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T21:56:28.587177] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-08T21:56:28.678228] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T21:56:28.679674] [INFO ] [REMOTE ] TNC: Full fetch complete (22638 records). [2025-10-08T21:56:28.679746] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-08T21:56:28.827803] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-08T21:56:29.046499] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-08T21:56:29.046575] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-08T21:56:29.047117] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-08T21:56:29.047179] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-08T21:56:29.047799] [DEBUG] [LOCAL ] TNC: Trimmed 22638 records to 14618 (keeping 200 days of data) [2025-10-08T21:56:29.135981] [DEBUG] [LOCAL ] TNC: Primary data saved (14618 records). [2025-10-08T21:56:29.136111] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-08T21:56:29.136211] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TNC took 24.2s. Estimated remaining: 36m 59s. Rate: 7.1 symbols/min [2025-10-08T21:56:29.302146] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:29.336263] [DEBUG] [LOCAL ] TNK: Loaded 35156 existing records from primary storage. [2025-10-08T21:56:29.336551] [INFO ] [MAIN ] TNK: Loaded 35156 existing records. [2025-10-08T21:56:29.518227] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:29.518462] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-08T21:56:29.518519] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-08T21:56:29.518776] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-08T21:56:29.518834] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-08T21:56:29.620208] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-10-08T21:56:29.878339] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:29.878933] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T21:56:29.879464] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-10-08T21:56:29.879598] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T21:56:29.879707] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-08T21:56:29.879782] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T21:56:29.879853] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-08T21:56:29.879917] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-08T21:56:29.879992] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-08T21:56:29.880056] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-08T21:56:29.880127] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNGY took 2.4s. Estimated remaining: 36m 50s. Rate: 7.1 symbols/min [2025-10-08T21:56:30.058250] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:30.100083] [DEBUG] [LOCAL ] TNL: Loaded 41746 existing records from primary storage. [2025-10-08T21:56:30.100384] [INFO ] [MAIN ] TNL: Loaded 41746 existing records. [2025-10-08T21:56:30.267785] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-08T21:56:30.309541] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:30.309750] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-08T21:56:30.309799] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-08T21:56:30.310018] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-08T21:56:30.310074] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-08T21:56:30.422804] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-08T21:56:30.669999] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:31.217569] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-10-08T21:56:32.017731] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-08T21:56:32.393482] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T21:56:32.583236] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T21:56:32.817612] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-10-08T21:56:33.414845] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T21:56:33.617553] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-08T21:56:33.857385] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-08T21:56:34.417579] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-08T21:56:35.089889] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-08T21:56:35.217551] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-08T21:56:35.314429] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-08T21:56:35.769767] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T21:56:35.773840] [INFO ] [REMOTE ] TMO: Full fetch complete (75498 records). [2025-10-08T21:56:35.773961] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-08T21:56:36.026381] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-08T21:56:36.175349] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-08T21:56:36.175449] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-08T21:56:36.176720] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-08T21:56:36.176792] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-08T21:56:36.178336] [DEBUG] [LOCAL ] TMO: Trimmed 75498 records to 52421 (keeping 200 days of data) [2025-10-08T21:56:36.518066] [DEBUG] [LOCAL ] TMO: Primary data saved (52421 records). [2025-10-08T21:56:36.518262] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-08T21:56:36.519819] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TMO took 40.9s. Estimated remaining: 36m 41s. Rate: 7.1 symbols/min [2025-10-08T21:56:36.695238] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:36.748285] [DEBUG] [LOCAL ] TOL: Loaded 50749 existing records from primary storage. [2025-10-08T21:56:36.748622] [INFO ] [MAIN ] TOL: Loaded 50749 existing records. [2025-10-08T21:56:36.825707] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-08T21:56:36.934221] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:36.934422] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-08T21:56:36.934491] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-08T21:56:36.934844] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-08T21:56:36.934920] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-08T21:56:37.308524] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:37.445801] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:56:37.617559] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-08T21:56:38.123954] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T21:56:38.417598] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-10-08T21:56:38.802253] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-08T21:56:39.217590] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-08T21:56:40.017581] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-08T21:56:40.209848] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T21:56:40.245855] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T21:56:40.817555] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-08T21:56:41.366881] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T21:56:41.617548] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-08T21:56:41.840851] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-08T21:56:42.417567] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-08T21:56:43.217574] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-08T21:56:43.361137] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T21:56:44.017508] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-08T21:56:44.052070] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T21:56:44.658727] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T21:56:44.817581] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-08T21:56:45.617548] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-08T21:56:45.787312] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T21:56:46.180959] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T21:56:46.417557] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-08T21:56:47.089520] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T21:56:47.217570] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-08T21:56:48.017618] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-08T21:56:48.241419] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-08T21:56:48.562126] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T21:56:48.817563] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-08T21:56:49.558172] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T21:56:49.617731] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-08T21:56:50.417634] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-08T21:56:50.526090] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T21:56:50.601416] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-08T21:56:51.217567] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-08T21:56:51.781484] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T21:56:52.017583] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-08T21:56:52.431149] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T21:56:52.817519] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-08T21:56:53.617517] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-08T21:56:53.747905] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T21:56:53.834439] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T21:56:53.836833] [INFO ] [REMOTE ] TNET: Full fetch complete (41578 records). [2025-10-08T21:56:53.836922] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-08T21:56:54.210079] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-08T21:56:54.210166] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-08T21:56:54.210977] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-08T21:56:54.211039] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-08T21:56:54.212044] [DEBUG] [LOCAL ] TNET: Trimmed 41578 records to 28274 (keeping 200 days of data) [2025-10-08T21:56:54.389510] [DEBUG] [LOCAL ] TNET: Primary data saved (28274 records). [2025-10-08T21:56:54.389672] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-08T21:56:54.389781] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNET took 32.0s. Estimated remaining: 36m 34s. Rate: 7.1 symbols/min [2025-10-08T21:56:54.422182] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-08T21:56:54.566313] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:56:54.616415] [DEBUG] [LOCAL ] TOST: Loaded 53683 existing records from primary storage. [2025-10-08T21:56:54.616776] [INFO ] [MAIN ] TOST: Loaded 53683 existing records. [2025-10-08T21:56:54.798034] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:56:54.798230] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-08T21:56:54.798277] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-08T21:56:54.798488] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-08T21:56:54.798545] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-08T21:56:55.197452] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T21:56:55.196070] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:56:55.217496] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-10-08T21:56:56.017579] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-08T21:56:56.419307] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-08T21:56:56.817542] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-08T21:56:57.244247] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-08T21:56:57.345090] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T21:56:57.617565] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-08T21:56:58.103273] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T21:56:58.417561] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-08T21:56:59.217601] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-08T21:56:59.354995] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T21:57:00.017601] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-08T21:57:00.235899] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T21:57:00.331904] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T21:57:00.817601] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-08T21:57:01.617621] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-08T21:57:01.914152] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T21:57:01.941688] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T21:57:01.945056] [INFO ] [REMOTE ] TNL: Full fetch complete (59177 records). [2025-10-08T21:57:01.945171] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-08T21:57:02.348944] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-08T21:57:02.352935] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-08T21:57:02.354057] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-08T21:57:02.354138] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-08T21:57:02.355591] [DEBUG] [LOCAL ] TNL: Trimmed 59177 records to 41743 (keeping 200 days of data) [2025-10-08T21:57:02.425513] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-08T21:57:02.630752] [DEBUG] [LOCAL ] TNL: Primary data saved (41743 records). [2025-10-08T21:57:02.630894] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-08T21:57:02.630980] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 32.8s. Estimated remaining: 36m 25s. Rate: 7.1 symbols/min [2025-10-08T21:57:02.832505] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:57:02.830913] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T21:57:02.835725] [INFO ] [REMOTE ] TNK: Full fetch complete (51795 records). [2025-10-08T21:57:02.835815] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-08T21:57:03.078534] [DEBUG] [LOCAL ] TPB: Loaded 25450 existing records from primary storage. [2025-10-08T21:57:03.116520] [INFO ] [MAIN ] TPB: Loaded 25450 existing records. [2025-10-08T21:57:03.226934] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-08T21:57:03.395606] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-08T21:57:03.400872] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-08T21:57:03.412393] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-08T21:57:03.417676] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-08T21:57:03.482622] [DEBUG] [LOCAL ] TNK: Trimmed 51795 records to 35169 (keeping 200 days of data) [2025-10-08T21:57:03.531541] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:57:03.531826] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-08T21:57:03.532326] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-08T21:57:03.532611] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-08T21:57:03.532753] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-08T21:57:04.033467] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:57:04.034759] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-10-08T21:57:04.142113] [DEBUG] [LOCAL ] TNK: Primary data saved (35169 records). [2025-10-08T21:57:04.142275] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-08T21:57:04.142364] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TNK took 35.0s. Estimated remaining: 36m 16s. Rate: 7.1 symbols/min [2025-10-08T21:57:04.328009] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:57:04.368274] [DEBUG] [LOCAL ] TPC: Loaded 38914 existing records from primary storage. [2025-10-08T21:57:04.368592] [INFO ] [MAIN ] TPC: Loaded 38914 existing records. [2025-10-08T21:57:04.547239] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:57:04.559605] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-08T21:57:04.581156] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-08T21:57:04.581993] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-08T21:57:04.582065] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-08T21:57:04.615586] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-08T21:57:04.837520] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-08T21:57:04.961874] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:57:05.087050] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T21:57:05.247686] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T21:57:05.617574] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-08T21:57:06.417554] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-10-08T21:57:06.694290] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T21:57:07.217755] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-08T21:57:07.555419] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-08T21:57:07.864107] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T21:57:08.017594] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-08T21:57:08.817588] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-08T21:57:09.214357] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-08T21:57:09.524197] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T21:57:09.617565] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-08T21:57:09.904857] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T21:57:10.417685] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-08T21:57:10.704247] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T21:57:11.217602] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-08T21:57:12.017561] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-08T21:57:12.444310] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-08T21:57:12.500315] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T21:57:12.817573] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-08T21:57:13.617531] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-08T21:57:13.923161] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T21:57:13.966049] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T21:57:14.417703] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-08T21:57:15.049964] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T21:57:15.217604] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-08T21:57:16.017585] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-08T21:57:16.157400] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-08T21:57:16.343544] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T21:57:16.817589] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-08T21:57:17.535994] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T21:57:17.617574] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-08T21:57:17.737244] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T21:57:18.417615] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-08T21:57:19.217543] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-08T21:57:19.366450] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T21:57:19.625793] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-08T21:57:20.017527] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-08T21:57:20.270760] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T21:57:20.817628] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-08T21:57:21.617556] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-08T21:57:21.982617] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T21:57:22.017034] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T21:57:22.417610] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-08T21:57:23.217526] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-08T21:57:23.460307] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T21:57:23.786214] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-08T21:57:24.017596] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-08T21:57:24.822866] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-08T21:57:24.832762] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T21:57:25.244201] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T21:57:25.617581] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-08T21:57:26.417533] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-08T21:57:26.451751] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T21:57:26.455564] [INFO ] [REMOTE ] TOL: Full fetch complete (73696 records). [2025-10-08T21:57:26.455718] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-08T21:57:26.865639] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-08T21:57:26.865746] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-08T21:57:26.866818] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-08T21:57:26.866883] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-08T21:57:26.868333] [DEBUG] [LOCAL ] TOL: Trimmed 73696 records to 50750 (keeping 200 days of data) [2025-10-08T21:57:27.137033] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-08T21:57:27.142759] [INFO ] [REMOTE ] TOST: Full fetch complete (77700 records). [2025-10-08T21:57:27.143681] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-08T21:57:27.222201] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-08T21:57:27.523032] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T21:57:27.554632] [INFO ] [REMOTE ] TPB: Full fetch complete (35543 records). [2025-10-08T21:57:27.578944] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-08T21:57:27.638045] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-08T21:57:27.644228] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-08T21:57:27.655741] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-08T21:57:27.666217] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-08T21:57:27.744712] [DEBUG] [LOCAL ] TOST: Trimmed 77700 records to 53683 (keeping 200 days of data) [2025-10-08T21:57:28.048115] [DEBUG] [LOCAL ] TOL: Primary data saved (50750 records). [2025-10-08T21:57:28.065091] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-08T21:57:28.096378] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TOL took 51.6s. Estimated remaining: 36m 9s. Rate: 7.1 symbols/min [2025-10-08T21:57:28.169393] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-08T21:57:28.178160] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-08T21:57:28.178966] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-08T21:57:28.179107] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-08T21:57:28.235094] [DEBUG] [LOCAL ] TPB: Trimmed 35543 records to 25571 (keeping 200 days of data) [2025-10-08T21:57:28.497495] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:57:28.622847] [DEBUG] [LOCAL ] TPB: Primary data saved (25571 records). [2025-10-08T21:57:28.623876] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-08T21:57:28.624303] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TPB took 26.0s. Estimated remaining: 35m 60s. Rate: 7.1 symbols/min [2025-10-08T21:57:28.725199] [DEBUG] [LOCAL ] TPH: Loaded 44886 existing records from primary storage. [2025-10-08T21:57:28.752977] [INFO ] [MAIN ] TPH: Loaded 44886 existing records. [2025-10-08T21:57:28.992307] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:57:29.134147] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:57:29.135542] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-08T21:57:29.135783] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-08T21:57:29.137806] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-08T21:57:29.138965] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-08T21:57:29.175949] [DEBUG] [LOCAL ] TPL: Loaded 12376 existing records from primary storage. [2025-10-08T21:57:29.188197] [INFO ] [MAIN ] TPL: Loaded 12376 existing records. [2025-10-08T21:57:29.375827] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T21:57:29.438166] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-08T21:57:29.452287] [DEBUG] [LOCAL ] TOST: Primary data saved (53683 records). [2025-10-08T21:57:29.462004] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-08T21:57:29.502827] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TOST took 35.1s. Estimated remaining: 35m 51s. Rate: 7.1 symbols/min [2025-10-08T21:57:29.502252] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:57:29.594771] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-08T21:57:29.655093] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-08T21:57:29.771753] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-08T21:57:29.791213] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-08T21:57:29.906857] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:57:30.002024] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:57:30.015070] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-10-08T21:57:30.342463] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:57:30.342956] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-10-08T21:57:30.359809] [DEBUG] [LOCAL ] TPR: Loaded 53452 existing records from primary storage. [2025-10-08T21:57:30.360146] [INFO ] [MAIN ] TPR: Loaded 53452 existing records. [2025-10-08T21:57:30.540295] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:57:30.540538] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-08T21:57:30.540585] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-08T21:57:30.540801] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-08T21:57:30.540859] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-08T21:57:30.923131] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:57:30.923632] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-10-08T21:57:30.993907] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-08T21:57:31.121118] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T21:57:31.217598] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-08T21:57:31.305715] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-08T21:57:31.855741] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-08T21:57:32.017628] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-08T21:57:32.817562] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-08T21:57:32.899143] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-08T21:57:33.524916] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T21:57:33.617564] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-08T21:57:33.919176] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T21:57:34.417611] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-08T21:57:34.825947] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T21:57:34.830712] [INFO ] [REMOTE ] TPC: Full fetch complete (55261 records). [2025-10-08T21:57:34.830875] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-08T21:57:35.222835] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-08T21:57:35.260568] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-08T21:57:35.260931] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-08T21:57:35.262124] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-08T21:57:35.262195] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-08T21:57:35.265740] [DEBUG] [LOCAL ] TPC: Trimmed 55261 records to 38968 (keeping 200 days of data) [2025-10-08T21:57:35.483830] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T21:57:35.519339] [DEBUG] [LOCAL ] TPC: Primary data saved (38968 records). [2025-10-08T21:57:35.519489] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-08T21:57:35.519591] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPC took 31.4s. Estimated remaining: 35m 42s. Rate: 7.1 symbols/min [2025-10-08T21:57:36.017580] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-08T21:57:36.817569] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-08T21:57:37.082284] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T21:57:37.582450] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-08T21:57:37.619059] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-08T21:57:37.622413] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T21:57:38.417702] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-08T21:57:39.217543] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-08T21:57:39.264887] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T21:57:39.541111] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-08T21:57:40.017571] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-08T21:57:40.817684] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-08T21:57:41.124410] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-08T21:57:41.498473] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T21:57:41.524861] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T21:57:41.617624] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-08T21:57:42.417691] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-08T21:57:43.156357] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T21:57:43.217514] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-08T21:57:44.017549] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-08T21:57:44.340778] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T21:57:44.737670] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T21:57:44.756162] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T21:57:44.817514] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-08T21:57:45.584596] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T21:57:45.617504] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-08T21:57:46.417580] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-08T21:57:46.522021] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T21:57:47.217516] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-08T21:57:47.706132] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T21:57:48.017547] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-08T21:57:48.185367] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-08T21:57:48.817568] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-08T21:57:49.042621] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-10-08T21:57:49.043928] [INFO ] [REMOTE ] TPL: Full fetch complete (17684 records). [2025-10-08T21:57:49.044021] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-08T21:57:49.468224] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-08T21:57:49.468437] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-08T21:57:49.469083] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-08T21:57:49.469208] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-08T21:57:49.470017] [DEBUG] [LOCAL ] TPL: Trimmed 17684 records to 12301 (keeping 200 days of data) [2025-10-08T21:57:49.556665] [DEBUG] [LOCAL ] TPL: Primary data saved (12301 records). [2025-10-08T21:57:49.557024] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-08T21:57:49.557196] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPL took 20.9s. Estimated remaining: 35m 34s. Rate: 7.1 symbols/min [2025-10-08T21:57:49.617565] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-08T21:57:49.667637] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T21:57:50.417561] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-08T21:57:51.477362] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-08T21:57:51.491148] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-08T21:57:52.048464] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-08T21:57:52.060359] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-08T21:57:53.003161] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:57:53.015934] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-08T21:57:53.504874] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T21:57:53.617562] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-08T21:57:54.881094] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T21:57:54.897104] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T21:57:54.902093] [INFO ] [REMOTE ] TPH: Full fetch complete (64896 records). [2025-10-08T21:57:54.902297] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-08T21:57:54.902898] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-08T21:57:55.309973] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-08T21:57:55.310108] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-08T21:57:55.311279] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-08T21:57:55.311352] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-08T21:57:55.312755] [DEBUG] [LOCAL ] TPH: Trimmed 64896 records to 44861 (keeping 200 days of data) [2025-10-08T21:57:55.572400] [DEBUG] [LOCAL ] TPH: Primary data saved (44861 records). [2025-10-08T21:57:55.572532] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-08T21:57:55.572699] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPH took 27.4s. Estimated remaining: 35m 25s. Rate: 7.1 symbols/min [2025-10-08T21:57:57.036623] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-08T21:57:57.049878] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-08T21:57:59.052493] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-08T21:57:59.065789] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-08T21:58:00.669821] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T21:58:00.674625] [INFO ] [REMOTE ] TPR: Full fetch complete (77400 records). [2025-10-08T21:58:00.674907] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-08T21:58:01.096433] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-08T21:58:01.096554] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-08T21:58:01.098194] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-08T21:58:01.098419] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-08T21:58:01.100556] [DEBUG] [LOCAL ] TPR: Trimmed 77400 records to 53443 (keeping 200 days of data) [2025-10-08T21:58:01.487106] [DEBUG] [LOCAL ] TPR: Primary data saved (53443 records). [2025-10-08T21:58:01.487384] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-08T21:58:01.487582] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 32.0s. Estimated remaining: 35m 17s. Rate: 7.1 symbols/min [2025-10-08T21:58:02.241805] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:02.278889] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:02.310700] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:02.329147] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:02.343679] [DEBUG] [LOCAL ] TPZ: Loaded 4876 existing records from primary storage. [2025-10-08T21:58:02.361851] [INFO ] [MAIN ] TPZ: Loaded 4876 existing records. [2025-10-08T21:58:02.361333] [DEBUG] [LOCAL ] TPYP: Loaded 7898 existing records from primary storage. [2025-10-08T21:58:02.391458] [INFO ] [MAIN ] TPYP: Loaded 7898 existing records. [2025-10-08T21:58:02.447243] [DEBUG] [LOCAL ] TR: Loaded 18745 existing records from primary storage. [2025-10-08T21:58:02.446916] [DEBUG] [LOCAL ] TPVG: Loaded 26934 existing records from primary storage. [2025-10-08T21:58:02.470010] [INFO ] [MAIN ] TPVG: Loaded 26934 existing records. [2025-10-08T21:58:02.469886] [INFO ] [MAIN ] TR: Loaded 18745 existing records. [2025-10-08T21:58:03.001592] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:03.149723] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-08T21:58:03.125309] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:03.191281] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-08T21:58:03.188727] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-08T21:58:03.245432] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:03.245753] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-08T21:58:03.221331] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:03.245925] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-08T21:58:03.246081] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-08T21:58:03.245887] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-08T21:58:03.246173] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-08T21:58:03.246344] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-08T21:58:03.252078] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-08T21:58:03.252032] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-08T21:58:03.251930] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-08T21:58:03.276497] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-08T21:58:03.257961] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-08T21:58:03.383761] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-08T21:58:03.493608] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-08T21:58:04.580046] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:04.670166] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-10-08T21:58:04.729581] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:04.746300] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-10-08T21:58:04.882305] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:04.887317] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:04.887632] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-10-08T21:58:04.888693] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-10-08T21:58:05.580572] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T21:58:05.584228] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-08T21:58:05.596786] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T21:58:05.600131] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-08T21:58:05.677660] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-08T21:58:05.680517] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-08T21:58:06.322632] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T21:58:06.307436] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T21:58:06.329939] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-08T21:58:06.330989] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T21:58:06.340908] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-08T21:58:06.340611] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-08T21:58:06.360292] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-08T21:58:06.363795] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-08T21:58:07.056801] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T21:58:07.060990] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-08T21:58:07.129873] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T21:58:07.133013] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-08T21:58:07.211141] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T21:58:07.217502] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-08T21:58:07.557893] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T21:58:07.617591] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T21:58:07.778766] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T21:58:07.908311] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T21:58:08.017583] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-08T21:58:08.574856] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-08T21:58:08.817606] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-08T21:58:09.617560] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-08T21:58:09.835320] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-08T21:58:10.417583] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-08T21:58:10.468701] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T21:58:11.217529] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-08T21:58:11.532794] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T21:58:11.810258] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T21:58:12.017555] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-08T21:58:12.455767] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T21:58:12.817569] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-08T21:58:13.617528] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-08T21:58:13.786595] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T21:58:14.417560] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-08T21:58:14.662804] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T21:58:15.185135] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T21:58:15.217521] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-08T21:58:16.017536] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-08T21:58:16.043209] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T21:58:16.817611] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-08T21:58:17.083148] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T21:58:17.273055] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T21:58:17.617555] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-08T21:58:18.321944] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T21:58:18.417547] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-08T21:58:19.217565] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-08T21:58:19.806013] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-08T21:58:19.830155] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T21:58:20.017587] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-08T21:58:20.417050] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T21:58:20.418227] [INFO ] [REMOTE ] TPYP: Full fetch complete (12492 records). [2025-10-08T21:58:20.418304] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-08T21:58:20.830512] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-08T21:58:20.845561] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-08T21:58:20.845794] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-08T21:58:20.846456] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-08T21:58:20.846632] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-08T21:58:20.847604] [DEBUG] [LOCAL ] TPYP: Trimmed 12492 records to 7913 (keeping 200 days of data) [2025-10-08T21:58:20.908509] [DEBUG] [LOCAL ] TPYP: Primary data saved (7913 records). [2025-10-08T21:58:20.908726] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-08T21:58:20.908838] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TPYP took 19.4s. Estimated remaining: 35m 10s. Rate: 7.1 symbols/min [2025-10-08T21:58:21.086254] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:21.098378] [DEBUG] [LOCAL ] TRAK: Loaded 9557 existing records from primary storage. [2025-10-08T21:58:21.098622] [INFO ] [MAIN ] TRAK: Loaded 9557 existing records. [2025-10-08T21:58:21.273968] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:21.274217] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-08T21:58:21.274319] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-08T21:58:21.274518] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-08T21:58:21.274575] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-08T21:58:21.623466] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:21.619855] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-08T21:58:21.960559] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-08T21:58:22.417581] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-08T21:58:22.777577] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T21:58:22.890093] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T21:58:23.217576] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-08T21:58:24.017564] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-10-08T21:58:24.472126] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T21:58:24.813704] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T21:58:24.817482] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-08T21:58:25.365350] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T21:58:25.617621] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-08T21:58:26.417540] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-08T21:58:26.671329] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T21:58:27.012488] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-08T21:58:27.217561] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-08T21:58:28.018511] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-08T21:58:28.022243] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T21:58:28.421727] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-08T21:58:28.817577] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-08T21:58:29.617535] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-08T21:58:29.937092] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T21:58:29.988168] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-08T21:58:30.417589] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-08T21:58:31.217578] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-08T21:58:31.456313] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T21:58:31.873364] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T21:58:32.017605] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-08T21:58:32.817591] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-08T21:58:32.847993] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T21:58:32.850434] [INFO ] [REMOTE ] TR: Full fetch complete (25322 records). [2025-10-08T21:58:32.850622] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-08T21:58:33.279308] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-08T21:58:33.279456] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-08T21:58:33.280691] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-08T21:58:33.280760] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-08T21:58:33.281977] [DEBUG] [LOCAL ] TR: Trimmed 25322 records to 18758 (keeping 200 days of data) [2025-10-08T21:58:33.423228] [DEBUG] [LOCAL ] TR: Primary data saved (18758 records). [2025-10-08T21:58:33.423456] [INFO ] [MAIN ] TR: Full history saved. [2025-10-08T21:58:33.423602] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TR took 31.9s. Estimated remaining: 35m 2s. Rate: 7.1 symbols/min [2025-10-08T21:58:33.621393] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-08T21:58:33.651819] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:33.676695] [DEBUG] [LOCAL ] TRC: Loaded 15658 existing records from primary storage. [2025-10-08T21:58:33.677264] [INFO ] [MAIN ] TRC: Loaded 15658 existing records. [2025-10-08T21:58:34.005507] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:34.005985] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-08T21:58:34.006172] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-08T21:58:34.006617] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-08T21:58:34.006720] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-08T21:58:34.143249] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T21:58:34.158938] [INFO ] [REMOTE ] TPZ: Full fetch complete (9203 records). [2025-10-08T21:58:34.159476] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-08T21:58:34.291497] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T21:58:34.417969] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-08T21:58:34.907713] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:34.982666] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-08T21:58:34.982798] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-08T21:58:34.983124] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-08T21:58:34.983182] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-08T21:58:34.983614] [DEBUG] [LOCAL ] TPZ: Trimmed 9203 records to 4854 (keeping 200 days of data) [2025-10-08T21:58:35.014367] [DEBUG] [LOCAL ] TPZ: Primary data saved (4854 records). [2025-10-08T21:58:35.014522] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-08T21:58:35.014635] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TPZ took 33.5s. Estimated remaining: 34m 52s. Rate: 7.1 symbols/min [2025-10-08T21:58:35.182571] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:35.227823] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-10-08T21:58:35.231284] [DEBUG] [LOCAL ] TREX: Loaded 49939 existing records from primary storage. [2025-10-08T21:58:35.231692] [INFO ] [MAIN ] TREX: Loaded 49939 existing records. [2025-10-08T21:58:35.422260] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:35.423029] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T21:58:35.425576] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-08T21:58:35.426416] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-08T21:58:35.427142] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-08T21:58:35.427209] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-08T21:58:35.781765] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:36.017626] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-10-08T21:58:36.255743] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T21:58:36.817565] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-08T21:58:37.491538] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T21:58:37.617600] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-08T21:58:37.652746] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-08T21:58:38.417534] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-08T21:58:38.457945] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T21:58:39.217547] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-08T21:58:39.723532] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T21:58:40.017561] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-08T21:58:40.097310] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T21:58:40.515196] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T21:58:40.817586] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-08T21:58:41.617564] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-08T21:58:42.215168] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T21:58:42.361473] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-08T21:58:42.417498] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-08T21:58:42.984404] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T21:58:43.217528] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-08T21:58:43.972126] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T21:58:43.973588] [INFO ] [REMOTE ] TRAK: Full fetch complete (13590 records). [2025-10-08T21:58:43.973681] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-08T21:58:44.025790] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-08T21:58:44.331817] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-08T21:58:44.331910] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-08T21:58:44.332276] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-08T21:58:44.332321] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-08T21:58:44.332832] [DEBUG] [LOCAL ] TRAK: Trimmed 13590 records to 9567 (keeping 200 days of data) [2025-10-08T21:58:44.391432] [DEBUG] [LOCAL ] TRAK: Primary data saved (9567 records). [2025-10-08T21:58:44.391557] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-08T21:58:44.391671] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TRAK took 23.5s. Estimated remaining: 34m 44s. Rate: 7.1 symbols/min [2025-10-08T21:58:44.558107] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:44.610995] [DEBUG] [LOCAL ] TRGP: Loaded 50761 existing records from primary storage. [2025-10-08T21:58:44.611313] [INFO ] [MAIN ] TRGP: Loaded 50761 existing records. [2025-10-08T21:58:44.786031] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:44.786258] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-08T21:58:44.786313] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-08T21:58:44.786570] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-08T21:58:44.786627] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-08T21:58:44.822700] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-08T21:58:45.077250] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T21:58:45.163285] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:45.617586] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-08T21:58:46.417612] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-08T21:58:46.455999] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T21:58:46.671492] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T21:58:47.217580] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-08T21:58:47.490234] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T21:58:47.493153] [INFO ] [REMOTE ] TPVG: Full fetch complete (39855 records). [2025-10-08T21:58:47.493246] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-08T21:58:47.887408] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-08T21:58:47.887510] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-08T21:58:47.888393] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-08T21:58:47.888462] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-08T21:58:47.889817] [DEBUG] [LOCAL ] TPVG: Trimmed 39855 records to 27010 (keeping 200 days of data) [2025-10-08T21:58:48.027925] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-08T21:58:48.065919] [DEBUG] [LOCAL ] TPVG: Primary data saved (27010 records). [2025-10-08T21:58:48.067740] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-08T21:58:48.067609] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T21:58:48.067971] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TPVG took 46.6s. Estimated remaining: 34m 35s. Rate: 7.1 symbols/min [2025-10-08T21:58:48.247198] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:48.282320] [DEBUG] [LOCAL ] TRN: Loaded 36812 existing records from primary storage. [2025-10-08T21:58:48.282664] [INFO ] [MAIN ] TRN: Loaded 36812 existing records. [2025-10-08T21:58:48.463153] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:48.463405] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-08T21:58:48.463461] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-08T21:58:48.463707] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-08T21:58:48.463768] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-08T21:58:48.815432] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:48.817493] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-10-08T21:58:49.617583] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-08T21:58:49.841909] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T21:58:50.143408] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-08T21:58:50.191747] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T21:58:50.417539] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-08T21:58:51.217589] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-08T21:58:51.834212] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T21:58:52.017595] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-08T21:58:52.817632] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-10-08T21:58:52.901703] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-08T21:58:53.060181] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T21:58:53.617539] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-08T21:58:54.325139] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-08T21:58:54.417614] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-08T21:58:54.569222] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-08T21:58:55.217692] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-08T21:58:55.412785] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-08T21:58:56.017558] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-08T21:58:56.795106] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T21:58:56.796728] [INFO ] [REMOTE ] TRC: Full fetch complete (21975 records). [2025-10-08T21:58:56.796812] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-08T21:58:56.826159] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-08T21:58:57.125335] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T21:58:57.269323] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-08T21:58:57.269440] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-08T21:58:57.270590] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-08T21:58:57.270679] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-08T21:58:57.271521] [DEBUG] [LOCAL ] TRC: Trimmed 21975 records to 15664 (keeping 200 days of data) [2025-10-08T21:58:57.378520] [DEBUG] [LOCAL ] TRC: Primary data saved (15664 records). [2025-10-08T21:58:57.378783] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-08T21:58:57.378920] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 24.0s. Estimated remaining: 34m 27s. Rate: 7.1 symbols/min [2025-10-08T21:58:57.564703] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:58:57.613624] [DEBUG] [LOCAL ] TRNO: Loaded 43993 existing records from primary storage. [2025-10-08T21:58:57.614126] [INFO ] [MAIN ] TRNO: Loaded 43993 existing records. [2025-10-08T21:58:57.626176] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-08T21:58:57.811523] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:58:57.811897] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-08T21:58:57.811951] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-08T21:58:57.812277] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-08T21:58:57.812337] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-08T21:58:58.220246] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:58:58.301288] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T21:58:58.417739] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-10-08T21:58:58.965813] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T21:58:59.217569] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-08T21:58:59.781201] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T21:59:00.017609] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-08T21:59:00.703205] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T21:59:00.817557] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-08T21:59:01.643951] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-08T21:59:01.668282] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T21:59:02.417532] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-08T21:59:02.489437] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T21:59:03.217585] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-08T21:59:03.490851] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-08T21:59:03.565796] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-08T21:59:04.017562] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-08T21:59:04.817537] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-08T21:59:04.974012] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-08T21:59:05.533587] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-08T21:59:05.617553] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-08T21:59:06.324944] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T21:59:06.417568] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-08T21:59:07.064103] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T21:59:07.217584] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-08T21:59:08.028224] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-08T21:59:08.035773] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:59:08.817688] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-08T21:59:09.121420] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-08T21:59:09.178686] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T21:59:09.617554] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-08T21:59:10.230917] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-08T21:59:10.417607] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-08T21:59:11.076527] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T21:59:11.217526] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-08T21:59:11.734525] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-08T21:59:12.017590] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-08T21:59:12.817583] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-08T21:59:13.059458] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T21:59:13.617519] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-08T21:59:13.873098] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T21:59:13.960377] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T21:59:13.964211] [INFO ] [REMOTE ] TREX: Full fetch complete (71141 records). [2025-10-08T21:59:13.964324] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-08T21:59:14.349205] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-08T21:59:14.349288] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-08T21:59:14.350311] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-08T21:59:14.350374] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-08T21:59:14.351776] [DEBUG] [LOCAL ] TREX: Trimmed 71141 records to 49905 (keeping 200 days of data) [2025-10-08T21:59:14.435878] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-08T21:59:14.642936] [DEBUG] [LOCAL ] TREX: Primary data saved (49905 records). [2025-10-08T21:59:14.643080] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-08T21:59:14.644103] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 39.6s. Estimated remaining: 34m 19s. Rate: 7.1 symbols/min [2025-10-08T21:59:14.810621] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:14.863127] [DEBUG] [LOCAL ] TROX: Loaded 51959 existing records from primary storage. [2025-10-08T21:59:14.863454] [INFO ] [MAIN ] TROX: Loaded 51959 existing records. [2025-10-08T21:59:15.055556] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:15.056021] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-08T21:59:15.056083] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-08T21:59:15.056316] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-08T21:59:15.056375] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-08T21:59:15.218121] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-08T21:59:15.431180] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T21:59:15.482588] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:15.709176] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-08T21:59:16.017574] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-08T21:59:16.791255] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T21:59:16.817526] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-08T21:59:17.524269] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T21:59:17.617532] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-10-08T21:59:17.979109] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-08T21:59:18.417559] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-08T21:59:19.217579] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-08T21:59:19.262873] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T21:59:19.816788] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T21:59:20.017551] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-08T21:59:20.403988] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T21:59:20.817502] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-08T21:59:21.112477] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T21:59:21.115320] [INFO ] [REMOTE ] TRN: Full fetch complete (52718 records). [2025-10-08T21:59:21.115424] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-08T21:59:21.491760] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-08T21:59:21.491848] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-08T21:59:21.492985] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-08T21:59:21.493050] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-08T21:59:21.494264] [DEBUG] [LOCAL ] TRN: Trimmed 52718 records to 36813 (keeping 200 days of data) [2025-10-08T21:59:21.619795] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-08T21:59:21.718551] [DEBUG] [LOCAL ] TRN: Primary data saved (36813 records). [2025-10-08T21:59:21.718719] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-08T21:59:21.718817] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRN took 33.6s. Estimated remaining: 34m 11s. Rate: 7.1 symbols/min [2025-10-08T21:59:21.885375] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:21.932671] [DEBUG] [LOCAL ] TRP: Loaded 52123 existing records from primary storage. [2025-10-08T21:59:21.932990] [INFO ] [MAIN ] TRP: Loaded 52123 existing records. [2025-10-08T21:59:22.119095] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:22.119693] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-08T21:59:22.119781] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-08T21:59:22.120252] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-08T21:59:22.120341] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-08T21:59:22.422077] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-08T21:59:22.438483] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T21:59:22.528801] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:23.217573] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-08T21:59:23.311233] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T21:59:23.995399] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T21:59:24.017514] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-08T21:59:24.691216] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-08T21:59:24.817579] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-08T21:59:25.340888] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T21:59:25.617687] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-08T21:59:26.417617] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-08T21:59:26.552127] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T21:59:27.217630] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-10-08T21:59:27.359761] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-08T21:59:27.645026] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T21:59:27.648392] [INFO ] [REMOTE ] TRNO: Full fetch complete (63397 records). [2025-10-08T21:59:27.648532] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-08T21:59:28.021055] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-08T21:59:28.036596] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-08T21:59:28.037742] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-08T21:59:28.038750] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-08T21:59:28.038891] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-08T21:59:28.040305] [DEBUG] [LOCAL ] TRNO: Trimmed 63397 records to 43954 (keeping 200 days of data) [2025-10-08T21:59:28.329554] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-08T21:59:28.328679] [DEBUG] [LOCAL ] TRNO: Primary data saved (43954 records). [2025-10-08T21:59:28.329790] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-08T21:59:28.333873] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRNO took 31.0s. Estimated remaining: 34m 2s. Rate: 7.1 symbols/min [2025-10-08T21:59:28.339527] [INFO ] [REMOTE ] TRGP: Full fetch complete (73532 records). [2025-10-08T21:59:28.388728] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-08T21:59:28.628852] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:28.829615] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-08T21:59:28.950567] [DEBUG] [LOCAL ] TRTX: Loaded 37568 existing records from primary storage. [2025-10-08T21:59:28.950831] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-08T21:59:28.951473] [INFO ] [MAIN ] TRTX: Loaded 37568 existing records. [2025-10-08T21:59:28.951311] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-08T21:59:28.958446] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-08T21:59:28.985761] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-08T21:59:29.083165] [DEBUG] [LOCAL ] TRGP: Trimmed 73532 records to 50804 (keeping 200 days of data) [2025-10-08T21:59:29.213577] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:29.240878] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-08T21:59:29.241292] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-08T21:59:29.241855] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-08T21:59:29.243612] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-08T21:59:29.370973] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T21:59:29.621588] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-08T21:59:29.780349] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:29.920140] [DEBUG] [LOCAL ] TRGP: Primary data saved (50804 records). [2025-10-08T21:59:29.920294] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-08T21:59:29.920491] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TRGP took 45.5s. Estimated remaining: 33m 53s. Rate: 7.1 symbols/min [2025-10-08T21:59:30.091783] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:30.140260] [DEBUG] [LOCAL ] TRU: Loaded 51320 existing records from primary storage. [2025-10-08T21:59:30.140620] [INFO ] [MAIN ] TRU: Loaded 51320 existing records. [2025-10-08T21:59:30.322090] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:30.322317] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-08T21:59:30.322366] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-08T21:59:30.322620] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-08T21:59:30.322703] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-08T21:59:30.421218] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-10-08T21:59:30.696313] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:30.743697] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-08T21:59:31.217543] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-08T21:59:31.432403] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T21:59:31.821260] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-08T21:59:32.017571] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-08T21:59:32.817582] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-10-08T21:59:33.043809] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T21:59:33.617520] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-08T21:59:33.727219] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T21:59:34.040633] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T21:59:34.417610] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-08T21:59:34.955224] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-08T21:59:35.217569] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-08T21:59:36.017607] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-08T21:59:36.090890] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T21:59:36.326210] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-08T21:59:36.817604] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-08T21:59:37.617511] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-08T21:59:37.798670] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-08T21:59:38.417508] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-08T21:59:38.453564] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T21:59:39.216326] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T21:59:39.224571] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-08T21:59:39.878485] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T21:59:40.017560] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-08T21:59:40.817519] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-08T21:59:41.014024] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T21:59:41.617560] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-08T21:59:41.656122] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T21:59:42.243699] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T21:59:42.417543] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-08T21:59:43.146879] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T21:59:43.217578] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-08T21:59:43.921851] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T21:59:44.017561] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-08T21:59:44.631052] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T21:59:44.817551] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-08T21:59:44.979566] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T21:59:45.617618] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-08T21:59:46.417520] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-08T21:59:46.528683] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T21:59:47.217566] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-08T21:59:47.313012] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T21:59:48.017527] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-08T21:59:48.208849] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T21:59:48.246189] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T21:59:48.817544] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-08T21:59:49.452703] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T21:59:49.617536] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-08T21:59:50.322583] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T21:59:50.417572] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-08T21:59:51.192532] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T21:59:51.217494] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-08T21:59:51.913807] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T21:59:52.017540] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-08T21:59:52.817588] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-08T21:59:52.976337] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T21:59:53.296329] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-08T21:59:53.617582] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-08T21:59:54.317281] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-08T21:59:54.321373] [INFO ] [REMOTE ] TROX: Full fetch complete (73333 records). [2025-10-08T21:59:54.321523] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-08T21:59:54.422703] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-08T21:59:54.723218] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-08T21:59:54.723306] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-08T21:59:54.724595] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-08T21:59:54.724697] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-08T21:59:54.726213] [DEBUG] [LOCAL ] TROX: Trimmed 73333 records to 51979 (keeping 200 days of data) [2025-10-08T21:59:54.853011] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-08T21:59:55.068278] [DEBUG] [LOCAL ] TROX: Primary data saved (51979 records). [2025-10-08T21:59:55.068436] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-08T21:59:55.069296] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TROX took 40.4s. Estimated remaining: 33m 46s. Rate: 7.1 symbols/min [2025-10-08T21:59:55.222360] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-08T21:59:55.247546] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:55.303793] [DEBUG] [LOCAL ] TRV: Loaded 47572 existing records from primary storage. [2025-10-08T21:59:55.304172] [INFO ] [MAIN ] TRV: Loaded 47572 existing records. [2025-10-08T21:59:55.480134] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:55.480336] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-08T21:59:55.480383] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-08T21:59:55.480613] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-08T21:59:55.480704] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-08T21:59:55.835598] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:55.995925] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T21:59:56.002926] [INFO ] [REMOTE ] TRP: Full fetch complete (75532 records). [2025-10-08T21:59:56.003052] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-08T21:59:56.024504] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-10-08T21:59:56.405231] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-08T21:59:56.405391] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-08T21:59:56.406505] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-08T21:59:56.406634] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-08T21:59:56.408127] [DEBUG] [LOCAL ] TRP: Trimmed 75532 records to 52151 (keeping 200 days of data) [2025-10-08T21:59:56.662810] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T21:59:56.783674] [DEBUG] [LOCAL ] TRP: Primary data saved (52151 records). [2025-10-08T21:59:56.783830] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-08T21:59:56.783913] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRP took 35.1s. Estimated remaining: 33m 37s. Rate: 7.1 symbols/min [2025-10-08T21:59:56.825988] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-08T21:59:56.987635] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:57.036540] [DEBUG] [LOCAL ] TS: Loaded 51687 existing records from primary storage. [2025-10-08T21:59:57.036891] [INFO ] [MAIN ] TS: Loaded 51687 existing records. [2025-10-08T21:59:57.212251] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:57.212479] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-08T21:59:57.212525] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-08T21:59:57.212773] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-08T21:59:57.212830] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-08T21:59:57.569192] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:57.617487] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-10-08T21:59:57.873811] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-08T21:59:57.929471] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-08T21:59:57.932342] [INFO ] [REMOTE ] TRTX: Full fetch complete (53281 records). [2025-10-08T21:59:57.932456] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-08T21:59:58.307152] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-08T21:59:58.307239] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-08T21:59:58.308157] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-08T21:59:58.308231] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-08T21:59:58.309440] [DEBUG] [LOCAL ] TRTX: Trimmed 53281 records to 37485 (keeping 200 days of data) [2025-10-08T21:59:58.418616] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-08T21:59:58.535806] [DEBUG] [LOCAL ] TRTX: Primary data saved (37485 records). [2025-10-08T21:59:58.535954] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-08T21:59:58.536054] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRTX took 30.2s. Estimated remaining: 33m 28s. Rate: 7.1 symbols/min [2025-10-08T21:59:58.702520] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T21:59:58.728631] [DEBUG] [LOCAL ] TSE: Loaded 27970 existing records from primary storage. [2025-10-08T21:59:58.728967] [INFO ] [MAIN ] TSE: Loaded 27970 existing records. [2025-10-08T21:59:58.905268] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T21:59:58.905457] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-08T21:59:58.905500] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-08T21:59:58.905753] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-08T21:59:58.905810] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-08T21:59:59.239379] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-08T21:59:59.269964] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T21:59:59.302430] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-08T22:00:00.017516] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-08T22:00:00.303731] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-08T22:00:00.817546] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-10-08T22:00:00.946138] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T22:00:01.583777] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T22:00:01.617597] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-08T22:00:01.903818] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T22:00:02.417589] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-08T22:00:03.217519] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-08T22:00:03.422715] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T22:00:04.017576] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-08T22:00:04.276599] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T22:00:04.817614] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-08T22:00:04.937085] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-08T22:00:05.626745] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-08T22:00:05.666000] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T22:00:06.033736] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T22:00:06.417564] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-08T22:00:07.217550] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-08T22:00:07.381162] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T22:00:07.607761] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T22:00:08.017586] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-08T22:00:08.817617] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-08T22:00:09.014409] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T22:00:09.617527] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-08T22:00:09.823912] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T22:00:10.417558] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-08T22:00:10.694203] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T22:00:11.217522] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-08T22:00:11.510402] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T22:00:11.958769] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T22:00:11.963002] [INFO ] [REMOTE ] TRU: Full fetch complete (73630 records). [2025-10-08T22:00:11.963146] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-08T22:00:12.029036] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-08T22:00:12.405601] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-08T22:00:12.405810] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-08T22:00:12.406975] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-08T22:00:12.407041] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-08T22:00:12.408751] [DEBUG] [LOCAL ] TRU: Trimmed 73630 records to 51337 (keeping 200 days of data) [2025-10-08T22:00:12.766996] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T22:00:12.789117] [DEBUG] [LOCAL ] TRU: Primary data saved (51337 records). [2025-10-08T22:00:12.789304] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-08T22:00:12.789419] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TRU took 42.9s. Estimated remaining: 33m 20s. Rate: 7.1 symbols/min [2025-10-08T22:00:12.822772] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-08T22:00:12.963777] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:12.973523] [DEBUG] [LOCAL ] TSI: Loaded 7438 existing records from primary storage. [2025-10-08T22:00:12.973807] [INFO ] [MAIN ] TSI: Loaded 7438 existing records. [2025-10-08T22:00:13.154626] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:13.154929] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-08T22:00:13.154994] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-08T22:00:13.155210] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-08T22:00:13.155267] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-08T22:00:13.505364] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:00:13.617604] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-08T22:00:13.891036] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T22:00:13.936073] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T22:00:14.417738] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-08T22:00:14.904999] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T22:00:15.217636] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-10-08T22:00:15.899662] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T22:00:16.017535] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-08T22:00:16.068961] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T22:00:16.520736] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-08T22:00:16.817565] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-08T22:00:17.617571] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-08T22:00:18.417512] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-08T22:00:18.505724] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T22:00:18.547591] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T22:00:19.217558] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-08T22:00:19.719726] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-08T22:00:20.017514] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-08T22:00:20.174446] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-08T22:00:20.817561] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-08T22:00:21.617536] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-08T22:00:21.784784] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T22:00:22.179348] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-08T22:00:22.417565] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-08T22:00:23.217509] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-08T22:00:23.439771] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T22:00:23.883149] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-08T22:00:23.887130] [INFO ] [REMOTE ] TS: Full fetch complete (74545 records). [2025-10-08T22:00:23.887264] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-08T22:00:24.022751] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-08T22:00:24.307978] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-08T22:00:24.308083] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-08T22:00:24.309319] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-08T22:00:24.309398] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-08T22:00:24.311107] [DEBUG] [LOCAL ] TS: Trimmed 74545 records to 51684 (keeping 200 days of data) [2025-10-08T22:00:24.583097] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-08T22:00:24.690547] [DEBUG] [LOCAL ] TS: Primary data saved (51684 records). [2025-10-08T22:00:24.690805] [INFO ] [MAIN ] TS: Full history saved. [2025-10-08T22:00:24.690908] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TS took 27.9s. Estimated remaining: 33m 12s. Rate: 7.1 symbols/min [2025-10-08T22:00:24.817908] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-08T22:00:24.892215] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:24.927227] [DEBUG] [LOCAL ] TSLX: Loaded 35356 existing records from primary storage. [2025-10-08T22:00:24.927557] [INFO ] [MAIN ] TSLX: Loaded 35356 existing records. [2025-10-08T22:00:25.108916] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:25.109202] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-08T22:00:25.109264] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-08T22:00:25.109508] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-08T22:00:25.109566] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-08T22:00:25.490274] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:00:25.617567] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-08T22:00:25.679139] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T22:00:25.997793] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-08T22:00:26.417622] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-08T22:00:26.554008] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T22:00:26.938359] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-08T22:00:26.942422] [INFO ] [REMOTE ] TRV: Full fetch complete (69572 records). [2025-10-08T22:00:26.942583] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-08T22:00:27.222698] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-08T22:00:27.340624] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-08T22:00:27.340776] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-08T22:00:27.341858] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-08T22:00:27.341926] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-08T22:00:27.343402] [DEBUG] [LOCAL ] TRV: Trimmed 69572 records to 47501 (keeping 200 days of data) [2025-10-08T22:00:27.659400] [DEBUG] [LOCAL ] TRV: Primary data saved (47501 records). [2025-10-08T22:00:27.659551] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-08T22:00:27.660299] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TRV took 32.6s. Estimated remaining: 33m 3s. Rate: 7.1 symbols/min [2025-10-08T22:00:27.826828] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:27.883208] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-08T22:00:27.883565] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-08T22:00:28.019821] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-08T22:00:28.014428] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T22:00:28.092373] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:28.092714] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-08T22:00:28.092804] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-08T22:00:28.093119] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-08T22:00:28.093192] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-08T22:00:28.501175] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:00:28.817576] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-08T22:00:29.361632] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-08T22:00:29.419390] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T22:00:29.617591] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-08T22:00:30.417532] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-10-08T22:00:30.581501] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T22:00:31.217587] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-08T22:00:32.017607] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-08T22:00:32.347543] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T22:00:32.779902] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-08T22:00:32.817516] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-08T22:00:32.862876] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-08T22:00:33.550790] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T22:00:33.617527] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-08T22:00:34.417608] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-10-08T22:00:34.513819] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-08T22:00:35.217566] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-08T22:00:35.759489] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:00:35.761843] [INFO ] [REMOTE ] TSI: Full fetch complete (13475 records). [2025-10-08T22:00:35.764379] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-08T22:00:35.764572] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-08T22:00:36.022894] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-08T22:00:36.358581] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-08T22:00:36.358720] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-08T22:00:36.359251] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-08T22:00:36.359324] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-08T22:00:36.360339] [DEBUG] [LOCAL ] TSI: Trimmed 13475 records to 7500 (keeping 200 days of data) [2025-10-08T22:00:36.429486] [DEBUG] [LOCAL ] TSI: Primary data saved (7500 records). [2025-10-08T22:00:36.429690] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-08T22:00:36.429823] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 23.6s. Estimated remaining: 32m 55s. Rate: 7.1 symbols/min [2025-10-08T22:00:36.625096] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:36.680025] [DEBUG] [LOCAL ] TSN: Loaded 52938 existing records from primary storage. [2025-10-08T22:00:36.680765] [INFO ] [MAIN ] TSN: Loaded 52938 existing records. [2025-10-08T22:00:36.822683] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-08T22:00:36.897527] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:36.897771] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-08T22:00:36.897821] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-08T22:00:36.898041] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-08T22:00:36.898124] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-08T22:00:37.282508] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:00:37.617560] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-08T22:00:38.024986] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T22:00:38.417516] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-08T22:00:38.574744] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T22:00:38.576820] [INFO ] [REMOTE ] TSE: Full fetch complete (40742 records). [2025-10-08T22:00:38.576898] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-08T22:00:39.007887] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.98 seconds). [2025-10-08T22:00:39.061169] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-08T22:00:39.061321] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-08T22:00:39.062195] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-08T22:00:39.062259] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-08T22:00:39.063200] [DEBUG] [LOCAL ] TSE: Trimmed 40742 records to 27896 (keeping 200 days of data) [2025-10-08T22:00:39.217871] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-10-08T22:00:39.226764] [DEBUG] [LOCAL ] TSE: Primary data saved (27896 records). [2025-10-08T22:00:39.226932] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-08T22:00:39.227058] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSE took 40.7s. Estimated remaining: 32m 46s. Rate: 7.1 symbols/min [2025-10-08T22:00:39.416003] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:39.430302] [DEBUG] [LOCAL ] TSQ: Loaded 11798 existing records from primary storage. [2025-10-08T22:00:39.430582] [INFO ] [MAIN ] TSQ: Loaded 11798 existing records. [2025-10-08T22:00:39.631877] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:39.632364] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-08T22:00:39.632415] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-08T22:00:39.632607] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-08T22:00:39.632704] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-08T22:00:39.896981] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T22:00:40.030178] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-08T22:00:40.050822] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:00:40.817558] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-08T22:00:41.024303] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T22:00:41.617574] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-08T22:00:42.224079] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T22:00:42.417525] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-10-08T22:00:42.626741] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-08T22:00:43.123255] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T22:00:43.166879] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T22:00:43.217541] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-08T22:00:43.885259] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-08T22:00:44.017556] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-08T22:00:44.817553] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-08T22:00:45.607049] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T22:00:45.617491] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-08T22:00:46.417523] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-08T22:00:46.556043] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T22:00:47.183130] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T22:00:47.217506] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-08T22:00:47.426786] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T22:00:48.017549] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-08T22:00:48.610729] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T22:00:48.669830] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T22:00:48.817571] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-08T22:00:49.617522] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-08T22:00:49.673780] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-08T22:00:50.417564] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-08T22:00:50.867094] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-08T22:00:51.217599] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-08T22:00:52.017617] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-08T22:00:52.780720] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T22:00:52.820151] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-08T22:00:52.828876] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T22:00:52.917071] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-08T22:00:53.617545] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-08T22:00:53.833222] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-08T22:00:54.417595] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-08T22:00:55.217620] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-08T22:00:55.314399] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T22:00:56.017548] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-08T22:00:56.507793] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-08T22:00:56.777688] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T22:00:56.817528] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-08T22:00:57.234446] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-08T22:00:57.414974] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T22:00:57.617549] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-08T22:00:58.417565] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-08T22:00:58.992339] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:00:58.994477] [INFO ] [REMOTE ] TSQ: Full fetch complete (16380 records). [2025-10-08T22:00:58.994572] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-08T22:00:59.222732] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-08T22:00:59.377882] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-08T22:00:59.377975] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-08T22:00:59.378352] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-08T22:00:59.378391] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-08T22:00:59.378961] [DEBUG] [LOCAL ] TSQ: Trimmed 16380 records to 11745 (keeping 200 days of data) [2025-10-08T22:00:59.449162] [DEBUG] [LOCAL ] TSQ: Primary data saved (11745 records). [2025-10-08T22:00:59.449332] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-08T22:00:59.449424] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSQ took 20.2s. Estimated remaining: 32m 38s. Rate: 7.1 symbols/min [2025-10-08T22:00:59.622553] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:00:59.671624] [DEBUG] [LOCAL ] TT: Loaded 47532 existing records from primary storage. [2025-10-08T22:00:59.672030] [INFO ] [MAIN ] TT: Loaded 47532 existing records. [2025-10-08T22:00:59.857308] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:00:59.857585] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-08T22:00:59.857706] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-08T22:00:59.858103] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-08T22:00:59.858166] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-08T22:00:59.991825] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-08T22:01:00.022070] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-08T22:01:00.268205] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:00.817548] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-08T22:01:01.516638] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T22:01:01.617584] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-08T22:01:02.138580] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-08T22:01:02.417543] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-10-08T22:01:02.532815] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T22:01:02.536398] [INFO ] [REMOTE ] TSLX: Full fetch complete (49679 records). [2025-10-08T22:01:02.536518] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-08T22:01:02.930158] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-08T22:01:02.930267] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-08T22:01:02.931269] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-08T22:01:02.931351] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-08T22:01:02.960485] [DEBUG] [LOCAL ] TSLX: Trimmed 49679 records to 35390 (keeping 200 days of data) [2025-10-08T22:01:02.962746] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-08T22:01:03.195590] [DEBUG] [LOCAL ] TSLX: Primary data saved (35390 records). [2025-10-08T22:01:03.195793] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-08T22:01:03.195894] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSLX took 38.5s. Estimated remaining: 32m 29s. Rate: 7.1 symbols/min [2025-10-08T22:01:03.226699] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-08T22:01:03.368674] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:03.368866] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-08T22:01:03.368920] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-08T22:01:03.369062] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-08T22:01:03.369117] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-08T22:01:03.369159] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-08T22:01:03.369191] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-08T22:01:03.724796] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:04.017518] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-10-08T22:01:04.188741] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-08T22:01:04.817611] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-08T22:01:05.096197] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:01:05.096527] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-10-08T22:01:05.096621] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:01:05.096708] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-08T22:01:05.096771] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:01:05.096843] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-08T22:01:05.096925] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-08T22:01:05.096979] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-08T22:01:05.097037] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-08T22:01:05.097107] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TTAM took 1.9s. Estimated remaining: 32m 20s. Rate: 7.1 symbols/min [2025-10-08T22:01:05.272508] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:05.312082] [DEBUG] [LOCAL ] TTC: Loaded 42053 existing records from primary storage. [2025-10-08T22:01:05.312446] [INFO ] [MAIN ] TTC: Loaded 42053 existing records. [2025-10-08T22:01:05.493855] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:05.494152] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-08T22:01:05.494208] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-08T22:01:05.494498] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-08T22:01:05.494557] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-08T22:01:05.622617] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-08T22:01:05.862547] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:06.417577] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-10-08T22:01:06.567104] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-08T22:01:06.959883] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (3.73 seconds). [2025-10-08T22:01:07.197909] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T22:01:07.217499] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-08T22:01:08.017608] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-08T22:01:08.634052] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T22:01:08.817544] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-08T22:01:09.044845] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T22:01:09.617538] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-08T22:01:09.761976] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-08T22:01:10.321207] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-08T22:01:10.417496] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-08T22:01:11.217564] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-08T22:01:11.494151] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-08T22:01:12.017530] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-08T22:01:12.049882] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:01:12.817538] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-08T22:01:13.617583] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-08T22:01:13.952510] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-08T22:01:14.052808] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-08T22:01:14.106633] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-08T22:01:14.373758] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T22:01:14.417506] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-08T22:01:14.973728] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:01:14.977931] [INFO ] [REMOTE ] TSN: Full fetch complete (76387 records). [2025-10-08T22:01:14.978077] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-08T22:01:15.222782] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-08T22:01:15.382882] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-08T22:01:15.382968] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-08T22:01:15.384027] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-08T22:01:15.384090] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-08T22:01:15.385600] [DEBUG] [LOCAL ] TSN: Trimmed 76387 records to 52958 (keeping 200 days of data) [2025-10-08T22:01:15.736432] [DEBUG] [LOCAL ] TSN: Primary data saved (52958 records). [2025-10-08T22:01:15.736580] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-08T22:01:15.736708] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 39.3s. Estimated remaining: 32m 12s. Rate: 7.1 symbols/min [2025-10-08T22:01:15.905007] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:15.951711] [DEBUG] [LOCAL ] TTE: Loaded 51602 existing records from primary storage. [2025-10-08T22:01:15.952026] [INFO ] [MAIN ] TTE: Loaded 51602 existing records. [2025-10-08T22:01:16.025125] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-08T22:01:16.131855] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:16.132076] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-08T22:01:16.132134] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-08T22:01:16.132346] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-08T22:01:16.132405] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-08T22:01:16.495470] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:16.817593] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-08T22:01:17.097942] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-08T22:01:17.617579] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-08T22:01:18.417606] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-10-08T22:01:18.649192] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T22:01:18.930204] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-08T22:01:19.222426] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-08T22:01:19.228019] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T22:01:19.987923] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T22:01:20.017507] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-08T22:01:20.622096] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-08T22:01:20.817550] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-08T22:01:21.617538] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-08T22:01:21.742730] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T22:01:22.417526] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-08T22:01:22.535115] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-08T22:01:23.217523] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-08T22:01:23.246577] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-08T22:01:23.968860] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T22:01:24.017561] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-08T22:01:24.817550] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-08T22:01:25.056587] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T22:01:25.617621] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-08T22:01:26.188209] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-08T22:01:26.417594] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-08T22:01:27.114400] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T22:01:27.217593] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-08T22:01:27.429177] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-08T22:01:27.952031] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T22:01:28.017695] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-08T22:01:28.485891] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-08T22:01:28.817685] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-08T22:01:28.994100] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (0.18 seconds). [2025-10-08T22:01:28.998919] [INFO ] [REMOTE ] TT: Full fetch complete (69730 records). [2025-10-08T22:01:28.999312] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-08T22:01:29.412618] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-08T22:01:29.412943] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-08T22:01:29.414392] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-08T22:01:29.414515] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-08T22:01:29.441335] [DEBUG] [LOCAL ] TT: Trimmed 69730 records to 47467 (keeping 200 days of data) [2025-10-08T22:01:29.442631] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-08T22:01:29.690264] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-08T22:01:29.828443] [DEBUG] [LOCAL ] TT: Primary data saved (47467 records). [2025-10-08T22:01:29.828667] [INFO ] [MAIN ] TT: Full history saved. [2025-10-08T22:01:29.828789] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TT took 30.4s. Estimated remaining: 32m 4s. Rate: 7.1 symbols/min [2025-10-08T22:01:30.011898] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:30.063734] [DEBUG] [LOCAL ] TTI: Loaded 45892 existing records from primary storage. [2025-10-08T22:01:30.064209] [INFO ] [MAIN ] TTI: Loaded 45892 existing records. [2025-10-08T22:01:30.259066] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:30.259374] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-08T22:01:30.259425] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-08T22:01:30.259820] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-08T22:01:30.259882] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-08T22:01:30.422745] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-08T22:01:30.657805] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:31.217588] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-10-08T22:01:31.635603] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-08T22:01:31.858991] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-08T22:01:32.017552] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-08T22:01:32.598293] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T22:01:32.817559] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-08T22:01:33.259902] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T22:01:33.263395] [INFO ] [REMOTE ] TTC: Full fetch complete (62170 records). [2025-10-08T22:01:33.263514] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-08T22:01:33.627990] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-08T22:01:33.648722] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-08T22:01:33.648799] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-08T22:01:33.649811] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-08T22:01:33.649876] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-08T22:01:33.651411] [DEBUG] [LOCAL ] TTC: Trimmed 62170 records to 42048 (keeping 200 days of data) [2025-10-08T22:01:33.920253] [DEBUG] [LOCAL ] TTC: Primary data saved (42048 records). [2025-10-08T22:01:33.920371] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-08T22:01:33.920477] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 28.8s. Estimated remaining: 31m 55s. Rate: 7.1 symbols/min [2025-10-08T22:01:34.090509] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:34.138348] [DEBUG] [LOCAL ] TU: Loaded 49853 existing records from primary storage. [2025-10-08T22:01:34.138687] [INFO ] [MAIN ] TU: Loaded 49853 existing records. [2025-10-08T22:01:34.325505] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:34.325849] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-08T22:01:34.325913] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-08T22:01:34.326365] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-08T22:01:34.326440] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-08T22:01:34.427460] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-08T22:01:34.709576] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:35.217570] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-10-08T22:01:35.286481] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T22:01:35.434508] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-08T22:01:35.438749] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-10-08T22:01:35.438904] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-08T22:01:35.851243] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-08T22:01:35.851326] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-08T22:01:35.852434] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-08T22:01:35.852499] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-08T22:01:35.853965] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 53819 (keeping 200 days of data) [2025-10-08T22:01:36.047197] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-08T22:01:36.157393] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T22:01:36.266978] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-08T22:01:36.267147] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-08T22:01:36.268285] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TSM took 1m 9s. Estimated remaining: 31m 46s. Rate: 7.1 symbols/min [2025-10-08T22:01:36.440407] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:36.487676] [DEBUG] [LOCAL ] TUYA: Loaded 46045 existing records from primary storage. [2025-10-08T22:01:36.488065] [INFO ] [MAIN ] TUYA: Loaded 46045 existing records. [2025-10-08T22:01:36.668906] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:36.669192] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-08T22:01:36.669240] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-08T22:01:36.669715] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-08T22:01:36.669776] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-08T22:01:36.828905] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-08T22:01:37.043501] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:37.074335] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T22:01:37.482880] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T22:01:37.617549] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-08T22:01:38.386390] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T22:01:38.417562] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-08T22:01:39.222818] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-10-08T22:01:39.235795] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T22:01:40.017521] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-08T22:01:40.426214] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T22:01:40.712203] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T22:01:40.817525] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-08T22:01:41.376246] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T22:01:41.617550] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-08T22:01:42.303339] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T22:01:42.417511] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-08T22:01:43.222758] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-08T22:01:43.246513] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-08T22:01:44.017538] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-08T22:01:44.396555] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-08T22:01:44.630579] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-08T22:01:44.817572] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-08T22:01:45.617581] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-08T22:01:45.678181] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T22:01:46.417567] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-08T22:01:46.784433] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T22:01:47.217607] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-08T22:01:47.437695] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-08T22:01:48.017549] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-08T22:01:48.191113] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T22:01:48.627757] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T22:01:48.817602] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-08T22:01:49.580837] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T22:01:49.617580] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-08T22:01:50.417581] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-08T22:01:50.636101] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T22:01:51.142127] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T22:01:51.217521] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-08T22:01:51.750595] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T22:01:51.756058] [INFO ] [REMOTE ] TTE: Full fetch complete (74965 records). [2025-10-08T22:01:51.756212] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-08T22:01:52.028120] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-08T22:01:52.262126] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-08T22:01:52.262224] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-08T22:01:52.263533] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-08T22:01:52.263600] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-08T22:01:52.265365] [DEBUG] [LOCAL ] TTE: Trimmed 74965 records to 51598 (keeping 200 days of data) [2025-10-08T22:01:52.640840] [DEBUG] [LOCAL ] TTE: Primary data saved (51598 records). [2025-10-08T22:01:52.641178] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-08T22:01:52.641447] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTE took 36.9s. Estimated remaining: 31m 39s. Rate: 7.1 symbols/min [2025-10-08T22:01:52.757602] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T22:01:52.822724] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-08T22:01:52.879249] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:01:52.922956] [DEBUG] [LOCAL ] TV: Loaded 42192 existing records from primary storage. [2025-10-08T22:01:52.923366] [INFO ] [MAIN ] TV: Loaded 42192 existing records. [2025-10-08T22:01:53.101886] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:01:53.102140] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-08T22:01:53.102186] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-08T22:01:53.102502] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-08T22:01:53.102541] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-08T22:01:53.463074] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:01:53.617526] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-10-08T22:01:53.681422] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T22:01:54.173895] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T22:01:54.417595] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-08T22:01:54.793063] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-08T22:01:55.217548] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-08T22:01:56.022700] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-08T22:01:56.040234] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T22:01:56.817575] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-08T22:01:56.906425] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T22:01:57.617533] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-08T22:01:57.680914] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-08T22:01:58.019755] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-08T22:01:58.417563] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-08T22:01:59.210419] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T22:01:59.219052] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-08T22:02:00.017687] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-08T22:02:00.044247] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T22:02:00.817577] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-08T22:02:00.985508] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T22:02:01.617514] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-08T22:02:01.648204] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:02:02.417550] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-08T22:02:02.522404] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T22:02:03.217520] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-08T22:02:03.259543] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T22:02:03.926288] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T22:02:03.930099] [INFO ] [REMOTE ] TTI: Full fetch complete (65497 records). [2025-10-08T22:02:03.930300] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-08T22:02:04.027686] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-08T22:02:04.321195] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-08T22:02:04.321277] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-08T22:02:04.322377] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-08T22:02:04.322478] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-08T22:02:04.323795] [DEBUG] [LOCAL ] TTI: Trimmed 65497 records to 45959 (keeping 200 days of data) [2025-10-08T22:02:04.585178] [DEBUG] [LOCAL ] TTI: Primary data saved (45959 records). [2025-10-08T22:02:04.585316] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-08T22:02:04.585449] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TTI took 34.8s. Estimated remaining: 31m 31s. Rate: 7.1 symbols/min [2025-10-08T22:02:04.754522] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:04.760421] [DEBUG] [LOCAL ] TVC: Loaded 3323 existing records from primary storage. [2025-10-08T22:02:04.760731] [INFO ] [MAIN ] TVC: Loaded 3323 existing records. [2025-10-08T22:02:04.822852] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-08T22:02:04.967177] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:04.967450] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-08T22:02:04.967696] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-08T22:02:04.969401] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-08T22:02:04.969355] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T22:02:04.978999] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-08T22:02:05.334167] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:05.408069] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T22:02:05.411824] [INFO ] [REMOTE ] TUYA: Full fetch complete (65811 records). [2025-10-08T22:02:05.411958] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-08T22:02:05.622708] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-10-08T22:02:05.793974] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-08T22:02:05.794050] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-08T22:02:05.795036] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-08T22:02:05.795098] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-08T22:02:05.796370] [DEBUG] [LOCAL ] TUYA: Trimmed 65811 records to 45953 (keeping 200 days of data) [2025-10-08T22:02:06.058940] [DEBUG] [LOCAL ] TUYA: Primary data saved (45953 records). [2025-10-08T22:02:06.059096] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-08T22:02:06.059913] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TUYA took 29.8s. Estimated remaining: 31m 21s. Rate: 7.1 symbols/min [2025-10-08T22:02:06.243451] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:06.249557] [DEBUG] [LOCAL ] TVE: Loaded 2782 existing records from primary storage. [2025-10-08T22:02:06.249786] [INFO ] [MAIN ] TVE: Loaded 2782 existing records. [2025-10-08T22:02:06.429543] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-08T22:02:06.435466] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:06.437444] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-08T22:02:06.437520] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-08T22:02:06.437926] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-08T22:02:06.461973] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-08T22:02:06.545388] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T22:02:06.529460] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T22:02:06.855536] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:07.217539] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-10-08T22:02:07.801383] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T22:02:08.017536] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-08T22:02:08.283509] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-08T22:02:08.817591] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-08T22:02:09.404744] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T22:02:09.617527] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-08T22:02:09.654663] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T22:02:10.213686] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T22:02:10.417577] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-08T22:02:11.217601] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-08T22:02:11.853087] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-08T22:02:11.857918] [INFO ] [REMOTE ] TU: Full fetch complete (72784 records). [2025-10-08T22:02:11.858098] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-08T22:02:12.025598] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-08T22:02:12.283554] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-08T22:02:12.283675] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-08T22:02:12.284779] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-08T22:02:12.284847] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-08T22:02:12.286601] [DEBUG] [LOCAL ] TU: Trimmed 72784 records to 49844 (keeping 200 days of data) [2025-10-08T22:02:12.612258] [DEBUG] [LOCAL ] TU: Primary data saved (49844 records). [2025-10-08T22:02:12.612435] [INFO ] [MAIN ] TU: Full history saved. [2025-10-08T22:02:12.612543] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TU took 38.7s. Estimated remaining: 31m 13s. Rate: 7.1 symbols/min [2025-10-08T22:02:12.793262] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T22:02:12.800293] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:12.818238] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-08T22:02:12.833915] [DEBUG] [LOCAL ] TWI: Loaded 34116 existing records from primary storage. [2025-10-08T22:02:12.834216] [INFO ] [MAIN ] TWI: Loaded 34116 existing records. [2025-10-08T22:02:13.015691] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:13.043037] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-08T22:02:13.043143] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-08T22:02:13.043944] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-08T22:02:13.044018] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-08T22:02:13.045431] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T22:02:13.346933] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T22:02:13.425243] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:13.617562] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-08T22:02:14.155174] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-08T22:02:14.417621] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-08T22:02:15.217610] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-10-08T22:02:15.984690] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-08T22:02:16.017515] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-08T22:02:16.817526] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-08T22:02:16.872289] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T22:02:17.411464] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-08T22:02:17.449568] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T22:02:17.617543] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-08T22:02:18.202001] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T22:02:18.417585] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-08T22:02:19.217610] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-08T22:02:19.894943] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-08T22:02:19.928459] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T22:02:20.017682] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-08T22:02:20.817709] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-08T22:02:21.470619] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-08T22:02:21.524667] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T22:02:21.617587] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-08T22:02:22.199962] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T22:02:22.417591] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-08T22:02:23.217614] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-08T22:02:23.528255] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-08T22:02:23.697519] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T22:02:24.017597] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-08T22:02:24.817580] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-08T22:02:25.175002] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T22:02:25.178386] [INFO ] [REMOTE ] TV: Full fetch complete (61623 records). [2025-10-08T22:02:25.178604] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-08T22:02:25.314330] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T22:02:25.624228] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-08T22:02:25.627270] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-08T22:02:25.627409] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-08T22:02:25.629271] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-08T22:02:25.629517] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-08T22:02:25.631811] [DEBUG] [LOCAL ] TV: Trimmed 61623 records to 42009 (keeping 200 days of data) [2025-10-08T22:02:25.899613] [DEBUG] [LOCAL ] TV: Primary data saved (42009 records). [2025-10-08T22:02:25.899857] [INFO ] [MAIN ] TV: Full history saved. [2025-10-08T22:02:25.899986] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TV took 33.2s. Estimated remaining: 31m 5s. Rate: 7.1 symbols/min [2025-10-08T22:02:26.094691] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:26.157619] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-08T22:02:26.160775] [DEBUG] [LOCAL ] TWLO: Loaded 52746 existing records from primary storage. [2025-10-08T22:02:26.161415] [INFO ] [MAIN ] TWLO: Loaded 52746 existing records. [2025-10-08T22:02:26.354870] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:26.355343] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-08T22:02:26.355443] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-08T22:02:26.355906] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-08T22:02:26.355967] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-08T22:02:26.422869] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-08T22:02:26.744035] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:26.879175] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-08T22:02:27.217584] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-10-08T22:02:28.017568] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-08T22:02:28.817526] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-08T22:02:29.209795] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-08T22:02:29.314577] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T22:02:29.319470] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T22:02:29.617553] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-08T22:02:30.417555] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-08T22:02:30.879099] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-08T22:02:31.217519] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-08T22:02:31.292613] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T22:02:32.017546] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-08T22:02:32.817512] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-08T22:02:33.318546] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-08T22:02:33.348667] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T22:02:33.392894] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T22:02:33.617541] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-08T22:02:34.417683] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-08T22:02:35.217525] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-08T22:02:35.605299] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-08T22:02:35.625680] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T22:02:35.626697] [INFO ] [REMOTE ] TVC: Full fetch complete (5415 records). [2025-10-08T22:02:35.626777] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-08T22:02:35.996479] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T22:02:36.019672] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-08T22:02:36.105066] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-08T22:02:36.105145] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-08T22:02:36.105321] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-08T22:02:36.105360] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-08T22:02:36.105820] [DEBUG] [LOCAL ] TVC: Trimmed 5415 records to 3319 (keeping 200 days of data) [2025-10-08T22:02:36.129222] [DEBUG] [LOCAL ] TVC: Primary data saved (3319 records). [2025-10-08T22:02:36.129331] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-08T22:02:36.129439] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVC took 31.5s. Estimated remaining: 30m 57s. Rate: 7.1 symbols/min [2025-10-08T22:02:36.297417] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:36.303383] [DEBUG] [LOCAL ] TWN: Loaded 3192 existing records from primary storage. [2025-10-08T22:02:36.303590] [INFO ] [MAIN ] TWN: Loaded 3192 existing records. [2025-10-08T22:02:36.478503] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:36.478739] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-08T22:02:36.478792] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-08T22:02:36.478997] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-08T22:02:36.479090] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-08T22:02:36.828639] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-08T22:02:36.834550] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:37.389081] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T22:02:37.617504] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-08T22:02:37.831475] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T22:02:37.999913] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T22:02:38.000744] [INFO ] [REMOTE ] TVE: Full fetch complete (4381 records). [2025-10-08T22:02:38.000823] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-08T22:02:38.358749] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-08T22:02:38.358833] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-08T22:02:38.358984] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-08T22:02:38.359047] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-08T22:02:38.359420] [DEBUG] [LOCAL ] TVE: Trimmed 4381 records to 2772 (keeping 200 days of data) [2025-10-08T22:02:38.376760] [DEBUG] [LOCAL ] TVE: Primary data saved (2772 records). [2025-10-08T22:02:38.376844] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-08T22:02:38.376932] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TVE took 32.3s. Estimated remaining: 30m 48s. Rate: 7.1 symbols/min [2025-10-08T22:02:38.422781] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-08T22:02:38.548895] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:38.609325] [DEBUG] [LOCAL ] TWO: Loaded 48513 existing records from primary storage. [2025-10-08T22:02:38.609697] [INFO ] [MAIN ] TWO: Loaded 48513 existing records. [2025-10-08T22:02:38.797424] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:38.797791] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-08T22:02:38.797853] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-08T22:02:38.798167] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-08T22:02:38.798420] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-08T22:02:39.180537] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:39.217579] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-10-08T22:02:39.823844] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T22:02:39.861390] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-08T22:02:40.017579] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-08T22:02:40.817588] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-08T22:02:41.275413] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T22:02:41.617546] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-08T22:02:42.323212] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T22:02:42.417544] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-08T22:02:42.737965] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T22:02:43.217517] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-08T22:02:43.795110] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T22:02:44.017578] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-08T22:02:44.140853] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T22:02:44.470576] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-08T22:02:44.817545] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-08T22:02:45.341427] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T22:02:45.617564] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-08T22:02:46.417565] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-08T22:02:46.959570] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T22:02:47.217614] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-08T22:02:48.017522] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-08T22:02:48.180697] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-08T22:02:48.184329] [INFO ] [REMOTE ] TWI: Full fetch complete (52545 records). [2025-10-08T22:02:48.184433] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-08T22:02:48.512245] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T22:02:48.638508] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-08T22:02:48.638384] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-08T22:02:48.638689] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-08T22:02:48.641974] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-08T22:02:48.642048] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-08T22:02:48.643327] [DEBUG] [LOCAL ] TWI: Trimmed 52545 records to 34088 (keeping 200 days of data) [2025-10-08T22:02:48.818684] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-08T22:02:48.843032] [DEBUG] [LOCAL ] TWI: Primary data saved (34088 records). [2025-10-08T22:02:48.843209] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-08T22:02:48.843307] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWI took 36.2s. Estimated remaining: 30m 39s. Rate: 7.1 symbols/min [2025-10-08T22:02:49.013710] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:49.013889] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-08T22:02:49.013927] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-08T22:02:49.014038] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-08T22:02:49.014080] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-08T22:02:49.014124] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-08T22:02:49.014156] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-08T22:02:49.370912] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:49.407242] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T22:02:49.617546] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-10-08T22:02:49.816568] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:02:49.816959] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-10-08T22:02:49.817058] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:02:49.817107] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-08T22:02:49.817149] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:02:49.817230] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-08T22:02:49.817325] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-08T22:02:49.817393] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-08T22:02:49.817491] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-08T22:02:49.817586] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWOD took 1.0s. Estimated remaining: 30m 30s. Rate: 7.1 symbols/min [2025-10-08T22:02:50.035003] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:02:50.058717] [DEBUG] [LOCAL ] TX: Loaded 23434 existing records from primary storage. [2025-10-08T22:02:50.058977] [INFO ] [MAIN ] TX: Loaded 23434 existing records. [2025-10-08T22:02:50.254878] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:02:50.255248] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-08T22:02:50.255324] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-08T22:02:50.255791] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-08T22:02:50.255852] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-08T22:02:50.423525] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-08T22:02:50.632061] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:02:51.217546] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-10-08T22:02:52.017538] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-10-08T22:02:52.546733] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-08T22:02:52.717689] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T22:02:52.817507] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-08T22:02:52.929192] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T22:02:53.617507] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-08T22:02:53.777854] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-08T22:02:54.071016] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T22:02:54.417544] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-08T22:02:55.217594] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-08T22:02:56.017595] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-08T22:02:56.112168] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T22:02:56.817516] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-08T22:02:57.143141] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T22:02:57.324942] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-08T22:02:57.617546] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-08T22:02:58.149321] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T22:02:58.417560] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-08T22:02:59.217750] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-08T22:02:59.606468] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T22:03:00.017580] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-08T22:03:00.089883] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T22:03:00.156735] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T22:03:00.817625] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-08T22:03:01.617539] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-08T22:03:01.671901] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-08T22:03:01.677410] [INFO ] [REMOTE ] TWLO: Full fetch complete (76458 records). [2025-10-08T22:03:01.677908] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-08T22:03:02.026595] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T22:03:02.052448] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T22:03:02.144867] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-08T22:03:02.144965] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-08T22:03:02.146077] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-08T22:03:02.146141] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-08T22:03:02.147720] [DEBUG] [LOCAL ] TWLO: Trimmed 76458 records to 52762 (keeping 200 days of data) [2025-10-08T22:03:02.424921] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-08T22:03:02.478350] [DEBUG] [LOCAL ] TWLO: Primary data saved (52762 records). [2025-10-08T22:03:02.478547] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-08T22:03:02.478674] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWLO took 36.6s. Estimated remaining: 30m 22s. Rate: 7.1 symbols/min [2025-10-08T22:03:02.650199] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:02.696029] [DEBUG] [LOCAL ] TXNM: Loaded 43424 existing records from primary storage. [2025-10-08T22:03:02.696379] [INFO ] [MAIN ] TXNM: Loaded 43424 existing records. [2025-10-08T22:03:02.884613] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:02.884880] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-08T22:03:02.884930] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-08T22:03:02.885433] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-08T22:03:02.885503] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-08T22:03:02.965850] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T22:03:03.222720] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-08T22:03:03.286669] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:03.772130] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T22:03:04.017547] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-08T22:03:04.817577] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-10-08T22:03:05.103589] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-08T22:03:05.617534] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-08T22:03:06.097473] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T22:03:06.098971] [INFO ] [REMOTE ] TWN: Full fetch complete (5362 records). [2025-10-08T22:03:06.099337] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-08T22:03:06.101333] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T22:03:06.422763] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-08T22:03:06.479601] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-08T22:03:06.479890] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-08T22:03:06.480055] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-08T22:03:06.480092] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-08T22:03:06.480455] [DEBUG] [LOCAL ] TWN: Trimmed 5362 records to 3195 (keeping 200 days of data) [2025-10-08T22:03:06.499528] [DEBUG] [LOCAL ] TWN: Primary data saved (3195 records). [2025-10-08T22:03:06.499596] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-08T22:03:06.499695] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWN took 30.4s. Estimated remaining: 30m 13s. Rate: 7.1 symbols/min [2025-10-08T22:03:06.676297] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:06.697537] [DEBUG] [LOCAL ] TXO: Loaded 19125 existing records from primary storage. [2025-10-08T22:03:06.697847] [INFO ] [MAIN ] TXO: Loaded 19125 existing records. [2025-10-08T22:03:06.914267] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:06.914556] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-08T22:03:06.914628] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-08T22:03:06.914930] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-08T22:03:06.915009] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-08T22:03:07.222826] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-08T22:03:07.339309] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:08.017538] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-08T22:03:08.364940] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T22:03:08.449161] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T22:03:08.822953] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-08T22:03:08.832502] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-08T22:03:09.617542] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-08T22:03:10.189447] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T22:03:10.417513] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-10-08T22:03:10.809424] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-08T22:03:11.217626] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-08T22:03:11.324048] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T22:03:12.017624] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-08T22:03:12.817638] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-08T22:03:12.974420] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T22:03:13.017979] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T22:03:13.581934] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T22:03:13.617683] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-08T22:03:14.417585] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-08T22:03:15.230814] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-08T22:03:15.234096] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T22:03:16.017573] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-08T22:03:16.090862] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T22:03:16.220315] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-08T22:03:16.817610] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-08T22:03:17.541079] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T22:03:17.617592] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-08T22:03:18.010733] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-08T22:03:18.417557] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-08T22:03:18.671181] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T22:03:19.217585] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-08T22:03:20.017623] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-08T22:03:20.158490] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T22:03:20.190020] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-08T22:03:20.192712] [INFO ] [REMOTE ] TX: Full fetch complete (35781 records). [2025-10-08T22:03:20.192829] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-08T22:03:20.574313] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-08T22:03:20.574407] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-08T22:03:20.575174] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-08T22:03:20.575242] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-08T22:03:20.576306] [DEBUG] [LOCAL ] TX: Trimmed 35781 records to 23363 (keeping 200 days of data) [2025-10-08T22:03:20.718552] [DEBUG] [LOCAL ] TX: Primary data saved (23363 records). [2025-10-08T22:03:20.718747] [INFO ] [MAIN ] TX: Full history saved. [2025-10-08T22:03:20.718849] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TX took 30.9s. Estimated remaining: 30m 5s. Rate: 7.1 symbols/min [2025-10-08T22:03:20.817575] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-08T22:03:21.345283] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T22:03:21.617603] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-08T22:03:22.417716] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-08T22:03:22.487176] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T22:03:23.217520] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-08T22:03:23.232249] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T22:03:23.813018] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T22:03:24.017572] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-08T22:03:24.794556] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-08T22:03:24.798521] [INFO ] [REMOTE ] TWO: Full fetch complete (69131 records). [2025-10-08T22:03:24.798707] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-08T22:03:24.833030] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-08T22:03:25.214570] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-08T22:03:25.214743] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-08T22:03:25.215900] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-08T22:03:25.216056] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-08T22:03:25.217684] [DEBUG] [LOCAL ] TWO: Trimmed 69131 records to 48554 (keeping 200 days of data) [2025-10-08T22:03:25.333001] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T22:03:25.551630] [DEBUG] [LOCAL ] TWO: Primary data saved (48554 records). [2025-10-08T22:03:25.551816] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-08T22:03:25.552783] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TWO took 47.2s. Estimated remaining: 29m 57s. Rate: 7.1 symbols/min [2025-10-08T22:03:25.617563] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-08T22:03:26.501582] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-08T22:03:26.511332] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-08T22:03:26.653064] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T22:03:27.217553] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-08T22:03:27.868523] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-08T22:03:28.017568] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-08T22:03:28.260116] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-08T22:03:28.817559] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-08T22:03:29.203107] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:03:29.617581] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-08T22:03:29.816884] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-08T22:03:30.417552] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-08T22:03:31.040053] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T22:03:31.217570] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-08T22:03:31.327428] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-08T22:03:32.017632] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-08T22:03:32.283513] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T22:03:32.287009] [INFO ] [REMOTE ] TXNM: Full fetch complete (62780 records). [2025-10-08T22:03:32.287115] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-08T22:03:32.704914] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-08T22:03:32.743779] [INFO ] [REMOTE ] TXO: Full fetch complete (26304 records). [2025-10-08T22:03:32.759372] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-08T22:03:32.759112] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-08T22:03:32.759530] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-08T22:03:32.760617] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-08T22:03:32.761083] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-08T22:03:32.870103] [DEBUG] [LOCAL ] TXNM: Trimmed 62780 records to 43437 (keeping 200 days of data) [2025-10-08T22:03:33.249925] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-08T22:03:33.250359] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-08T22:03:33.250971] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-08T22:03:33.251501] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-08T22:03:33.254734] [DEBUG] [LOCAL ] TXO: Trimmed 26304 records to 19142 (keeping 200 days of data) [2025-10-08T22:03:33.382522] [DEBUG] [LOCAL ] TXO: Primary data saved (19142 records). [2025-10-08T22:03:33.383243] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-08T22:03:33.383607] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXO took 26.9s. Estimated remaining: 29m 48s. Rate: 7.1 symbols/min [2025-10-08T22:03:33.545881] [DEBUG] [LOCAL ] TXNM: Primary data saved (43437 records). [2025-10-08T22:03:33.546014] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-08T22:03:33.546095] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXNM took 31.1s. Estimated remaining: 29m 39s. Rate: 7.1 symbols/min [2025-10-08T22:03:34.182326] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:34.228504] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:34.257281] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:34.329328] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:03:34.338513] [DEBUG] [LOCAL ] TY: Loaded 7612 existing records from primary storage. [2025-10-08T22:03:34.339683] [INFO ] [MAIN ] TY: Loaded 7612 existing records. [2025-10-08T22:03:34.408834] [DEBUG] [LOCAL ] TYG: Loaded 13917 existing records from primary storage. [2025-10-08T22:03:34.436982] [DEBUG] [LOCAL ] TYL: Loaded 22251 existing records from primary storage. [2025-10-08T22:03:34.442933] [INFO ] [MAIN ] TYG: Loaded 13917 existing records. [2025-10-08T22:03:34.453737] [INFO ] [MAIN ] TYL: Loaded 22251 existing records. [2025-10-08T22:03:34.802453] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:34.870124] [DEBUG] [LOCAL ] TXT: Loaded 49726 existing records from primary storage. [2025-10-08T22:03:34.880702] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-08T22:03:34.959232] [INFO ] [MAIN ] TXT: Loaded 49726 existing records. [2025-10-08T22:03:34.945423] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-08T22:03:34.965725] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:35.037166] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-08T22:03:35.048935] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-08T22:03:35.101306] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-08T22:03:35.101041] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-08T22:03:35.095754] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:35.157500] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-08T22:03:35.166996] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-08T22:03:35.163106] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-08T22:03:35.167667] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-08T22:03:35.255009] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-08T22:03:35.369205] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-08T22:03:35.407949] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:03:35.470114] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-08T22:03:35.527175] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-08T22:03:35.574552] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-08T22:03:35.726897] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-08T22:03:36.446707] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:36.449300] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-10-08T22:03:36.671340] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:36.618661] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:36.689857] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-10-08T22:03:36.719711] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-10-08T22:03:36.836415] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:03:36.836823] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-10-08T22:03:37.466571] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T22:03:37.471598] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-08T22:03:37.593772] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-08T22:03:37.596328] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-08T22:03:37.752489] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T22:03:37.757087] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-08T22:03:38.068387] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-08T22:03:38.308378] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-08T22:03:38.334742] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-08T22:03:38.417523] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-08T22:03:38.760982] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T22:03:39.217558] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-08T22:03:40.017569] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-08T22:03:40.194548] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T22:03:40.360470] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T22:03:40.532172] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-08T22:03:40.817568] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-08T22:03:41.617595] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-08T22:03:41.992000] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-08T22:03:42.417630] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-08T22:03:42.950859] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T22:03:43.217564] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-08T22:03:43.886473] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T22:03:44.017546] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-08T22:03:44.231239] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T22:03:44.817525] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-08T22:03:45.157437] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T22:03:45.553201] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T22:03:45.617561] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-08T22:03:46.127138] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-08T22:03:46.417621] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-08T22:03:47.217565] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-08T22:03:47.357861] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T22:03:48.017608] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-08T22:03:48.147255] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-08T22:03:48.817519] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-08T22:03:48.845408] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-08T22:03:49.617590] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-08T22:03:50.220330] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T22:03:50.417540] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-08T22:03:50.585402] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-08T22:03:51.217525] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-08T22:03:51.286536] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T22:03:52.017578] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-08T22:03:52.817516] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-08T22:03:52.952558] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T22:03:52.984347] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-08T22:03:53.617589] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-08T22:03:54.020401] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-08T22:03:54.365183] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T22:03:54.417573] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-08T22:03:55.159964] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-08T22:03:55.217518] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-08T22:03:56.017577] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-08T22:03:56.024993] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-08T22:03:56.817527] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-08T22:03:56.985173] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-08T22:03:57.617571] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-08T22:03:58.271810] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T22:03:58.417517] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-08T22:03:58.542375] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-08T22:03:59.217539] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-08T22:03:59.668555] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T22:03:59.670813] [INFO ] [REMOTE ] TYL: Full fetch complete (31460 records). [2025-10-08T22:03:59.670894] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-08T22:03:59.714491] [DEBUG] [REMOTE ] TXT: Error fetching primary data for 2025-06: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-08T22:03:59.740456] [WARN ] [REMOTE ] TXT: No data returned for month 2025-06 [2025-10-08T22:03:59.773291] [FATAL] [REMOTE ] TXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:03:59.773436] [FATAL] [MAIN ] TXT: Failed to fetch primary data. [2025-10-08T22:03:59.779188] [WARN ] [MAIN ] TXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:03:59.797815] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-08T22:03:59.803054] [DEBUG] [LOCAL ] TXT: No primary data file found to delete. [2025-10-08T22:03:59.817551] [INFO ] [LOCAL ] TXT: Starting deletion of derivative data. [2025-10-08T22:03:59.838985] [DEBUG] [LOCAL ] TXT: Deleted derivative data file. [2025-10-08T22:03:59.854762] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TXT took 26.3s. Estimated remaining: 29m 32s. Rate: 7.1 symbols/min [2025-10-08T22:04:00.030744] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-08T22:04:00.238073] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:00.252311] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-08T22:04:00.252404] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-08T22:04:00.253316] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-08T22:04:00.253390] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-08T22:04:00.254283] [DEBUG] [LOCAL ] TYL: Trimmed 31460 records to 22342 (keeping 200 days of data) [2025-10-08T22:04:00.413575] [DEBUG] [LOCAL ] TYL: Primary data saved (22342 records). [2025-10-08T22:04:00.413835] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-08T22:04:00.413991] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYL took 26.9s. Estimated remaining: 29m 23s. Rate: 7.1 symbols/min [2025-10-08T22:04:00.505167] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-08T22:04:00.529403] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-08T22:04:00.707849] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:00.788899] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:00.789225] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-08T22:04:00.789273] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-08T22:04:00.789547] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-08T22:04:00.789604] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-08T22:04:00.820584] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-08T22:04:01.068805] [DEBUG] [LOCAL ] UA: Loaded 50453 existing records from primary storage. [2025-10-08T22:04:01.094742] [INFO ] [MAIN ] UA: Loaded 50453 existing records. [2025-10-08T22:04:01.300995] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:01.367725] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T22:04:01.396236] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:01.401570] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-08T22:04:01.406391] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-08T22:04:01.407153] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T22:04:01.408914] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-08T22:04:01.409383] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-08T22:04:01.622618] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-08T22:04:01.791207] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:02.417549] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-08T22:04:02.583111] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-08T22:04:02.944063] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T22:04:02.945382] [INFO ] [REMOTE ] TY: Full fetch complete (11588 records). [2025-10-08T22:04:02.945462] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-08T22:04:03.222674] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-08T22:04:03.358243] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-08T22:04:03.358370] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-08T22:04:03.358788] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-08T22:04:03.358866] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-08T22:04:03.359724] [DEBUG] [LOCAL ] TY: Trimmed 11588 records to 7605 (keeping 200 days of data) [2025-10-08T22:04:03.416141] [DEBUG] [LOCAL ] TY: Primary data saved (7605 records). [2025-10-08T22:04:03.416304] [INFO ] [MAIN ] TY: Full history saved. [2025-10-08T22:04:03.416426] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TY took 29.9s. Estimated remaining: 29m 14s. Rate: 7.1 symbols/min [2025-10-08T22:04:03.619964] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:03.694944] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-10-08T22:04:03.695344] [INFO ] [MAIN ] UAA: Loaded 53509 existing records. [2025-10-08T22:04:03.894308] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:03.894595] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-08T22:04:03.894685] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-08T22:04:03.895172] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-08T22:04:03.895240] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-08T22:04:04.022627] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-10-08T22:04:04.249479] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-08T22:04:04.362459] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:04.817585] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-10-08T22:04:05.539044] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-08T22:04:05.617583] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-08T22:04:06.230090] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T22:04:06.232523] [INFO ] [REMOTE ] TYG: Full fetch complete (22428 records). [2025-10-08T22:04:06.232669] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-08T22:04:06.425075] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-10-08T22:04:06.597728] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-08T22:04:06.597816] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-08T22:04:06.598313] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-08T22:04:06.598364] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-08T22:04:06.599062] [DEBUG] [LOCAL ] TYG: Trimmed 22428 records to 13922 (keeping 200 days of data) [2025-10-08T22:04:06.687249] [DEBUG] [LOCAL ] TYG: Primary data saved (13922 records). [2025-10-08T22:04:06.687406] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-08T22:04:06.687517] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. TYG took 33.1s. Estimated remaining: 29m 5s. Rate: 7.1 symbols/min [2025-10-08T22:04:06.861295] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:06.873044] [DEBUG] [LOCAL ] UAN: Loaded 5439 existing records from primary storage. [2025-10-08T22:04:06.873264] [INFO ] [MAIN ] UAN: Loaded 5439 existing records. [2025-10-08T22:04:07.053579] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:07.053973] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-08T22:04:07.054145] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-08T22:04:07.054423] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-08T22:04:07.054484] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-08T22:04:07.219777] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-08T22:04:07.431462] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-08T22:04:07.464684] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:08.017545] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-08T22:04:08.370158] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-08T22:04:08.817552] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-08T22:04:08.996748] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T22:04:09.617621] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-10-08T22:04:10.227610] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-08T22:04:10.417533] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-08T22:04:10.529373] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-08T22:04:10.566942] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T22:04:11.217539] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-08T22:04:11.648028] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-08T22:04:12.017558] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-08T22:04:12.391857] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-08T22:04:12.742423] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-08T22:04:12.817495] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-08T22:04:13.617583] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-08T22:04:14.417577] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-08T22:04:15.193371] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-08T22:04:15.217506] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-08T22:04:15.424961] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-08T22:04:15.627331] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T22:04:16.017628] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-08T22:04:16.817574] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-08T22:04:17.543086] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-08T22:04:17.617548] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-08T22:04:17.888184] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T22:04:18.356271] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T22:04:18.417513] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-08T22:04:19.217566] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-08T22:04:19.694439] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-08T22:04:19.891940] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T22:04:20.017534] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-08T22:04:20.817575] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-08T22:04:20.945918] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-08T22:04:21.617569] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-08T22:04:21.760194] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T22:04:22.417576] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-08T22:04:22.927048] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-08T22:04:23.033974] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T22:04:23.217554] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-08T22:04:23.532705] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-08T22:04:23.814805] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-08T22:04:24.017566] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-08T22:04:24.817550] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-08T22:04:25.622727] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-08T22:04:25.636639] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T22:04:26.419044] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-08T22:04:26.423722] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T22:04:27.217585] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-08T22:04:28.017563] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-08T22:04:28.126239] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T22:04:28.188886] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T22:04:28.193413] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-08T22:04:28.817624] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-08T22:04:29.617583] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-08T22:04:29.698951] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T22:04:30.417569] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-08T22:04:30.482203] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T22:04:31.114205] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-08T22:04:31.217525] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-08T22:04:32.017541] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-08T22:04:32.075723] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T22:04:32.598018] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-08T22:04:32.817616] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-08T22:04:33.617512] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-08T22:04:33.687903] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-08T22:04:34.417542] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-08T22:04:34.523533] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T22:04:34.977749] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-08T22:04:35.078283] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T22:04:35.217573] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-08T22:04:35.811967] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-08T22:04:36.017584] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-08T22:04:36.473999] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-08T22:04:36.475099] [INFO ] [REMOTE ] UAN: Full fetch complete (8062 records). [2025-10-08T22:04:36.475194] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-08T22:04:36.822772] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-08T22:04:36.894751] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-08T22:04:36.894908] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-08T22:04:36.895389] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-08T22:04:36.896026] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-08T22:04:36.896751] [DEBUG] [LOCAL ] UAN: Trimmed 8062 records to 5432 (keeping 200 days of data) [2025-10-08T22:04:36.941017] [DEBUG] [LOCAL ] UAN: Primary data saved (5432 records). [2025-10-08T22:04:36.941188] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-08T22:04:36.941326] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 30.3s. Estimated remaining: 28m 59s. Rate: 7.1 symbols/min [2025-10-08T22:04:37.155347] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:37.209342] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-08T22:04:37.209740] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-08T22:04:37.393818] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:37.394063] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-08T22:04:37.394112] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-08T22:04:37.394480] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-08T22:04:37.394547] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-08T22:04:37.622764] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-08T22:04:37.764109] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:38.134095] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T22:04:38.139159] [INFO ] [REMOTE ] UA: Full fetch complete (72962 records). [2025-10-08T22:04:38.139436] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-08T22:04:38.424613] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-10-08T22:04:38.555291] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-08T22:04:38.555417] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-08T22:04:38.556637] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-08T22:04:38.556728] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-08T22:04:38.558358] [DEBUG] [LOCAL ] UA: Trimmed 72962 records to 50445 (keeping 200 days of data) [2025-10-08T22:04:38.862199] [DEBUG] [LOCAL ] UA: Primary data saved (50445 records). [2025-10-08T22:04:38.862351] [INFO ] [MAIN ] UA: Full history saved. [2025-10-08T22:04:38.862485] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 38.4s. Estimated remaining: 28m 50s. Rate: 7.1 symbols/min [2025-10-08T22:04:39.040350] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:39.091133] [DEBUG] [LOCAL ] UBS: Loaded 52354 existing records from primary storage. [2025-10-08T22:04:39.091500] [INFO ] [MAIN ] UBS: Loaded 52354 existing records. [2025-10-08T22:04:39.222737] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-08T22:04:39.314485] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:39.314875] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-08T22:04:39.315063] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-08T22:04:39.315324] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-08T22:04:39.315382] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-08T22:04:39.684197] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:39.784361] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T22:04:40.017604] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-08T22:04:40.708141] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T22:04:40.817606] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-08T22:04:41.457584] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-08T22:04:41.461833] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-10-08T22:04:41.461959] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-08T22:04:41.631989] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-10-08T22:04:41.840897] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-08T22:04:41.891801] [INFO ] [REMOTE ] UAA: Full fetch complete (77485 records). [2025-10-08T22:04:41.900946] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-08T22:04:42.055256] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-08T22:04:42.067693] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-08T22:04:42.069797] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-08T22:04:42.075474] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-08T22:04:42.134264] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 53799 (keeping 200 days of data) [2025-10-08T22:04:42.467281] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-08T22:04:42.467637] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-08T22:04:42.469460] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-08T22:04:42.469824] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-08T22:04:42.474281] [DEBUG] [LOCAL ] UAA: Trimmed 77485 records to 53508 (keeping 200 days of data) [2025-10-08T22:04:43.035307] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-08T22:04:43.036099] [INFO ] [MAIN ] U: Full history saved. [2025-10-08T22:04:43.036587] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. U took 43.2s. Estimated remaining: 28m 41s. Rate: 7.1 symbols/min [2025-10-08T22:04:43.160399] [DEBUG] [LOCAL ] UAA: Primary data saved (53508 records). [2025-10-08T22:04:43.175387] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-08T22:04:43.178943] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UAA took 39.8s. Estimated remaining: 28m 32s. Rate: 7.1 symbols/min [2025-10-08T22:04:43.177833] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-08T22:04:43.330753] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-08T22:04:43.331629] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:43.443050] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:04:43.472438] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T22:04:43.488018] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-08T22:04:43.515721] [DEBUG] [LOCAL ] UCB: Loaded 37828 existing records from primary storage. [2025-10-08T22:04:43.516055] [INFO ] [MAIN ] UCB: Loaded 37828 existing records. [2025-10-08T22:04:43.729362] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:43.730525] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-08T22:04:43.730627] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-08T22:04:43.730440] [DEBUG] [LOCAL ] UDR: Loaded 51890 existing records from primary storage. [2025-10-08T22:04:43.731060] [INFO ] [MAIN ] UDR: Loaded 51890 existing records. [2025-10-08T22:04:43.731132] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-08T22:04:43.774930] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-08T22:04:44.188620] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:04:44.215247] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-08T22:04:44.226037] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-08T22:04:44.247039] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-08T22:04:44.247136] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-08T22:04:44.436860] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:44.457813] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-10-08T22:04:44.691542] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:04:44.817505] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-10-08T22:04:45.350720] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T22:04:45.617538] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-08T22:04:45.787527] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-08T22:04:45.955258] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T22:04:46.417526] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-08T22:04:46.525126] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T22:04:47.217528] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-08T22:04:47.329256] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T22:04:47.633935] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T22:04:48.017602] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-08T22:04:48.817553] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-08T22:04:48.988870] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-08T22:04:49.617561] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-08T22:04:50.006868] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T22:04:50.417581] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-08T22:04:50.684247] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T22:04:51.076063] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T22:04:51.217552] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-08T22:04:51.951663] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T22:04:52.017561] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-08T22:04:52.817628] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-08T22:04:53.613063] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-08T22:04:53.617632] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-08T22:04:53.791390] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T22:04:54.249901] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-08T22:04:54.417562] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-08T22:04:54.865017] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-08T22:04:55.217606] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-08T22:04:56.017567] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-08T22:04:56.307723] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T22:04:56.822632] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-08T22:04:56.844340] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T22:04:57.617523] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-08T22:04:57.666317] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-08T22:04:58.417596] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-08T22:04:59.217763] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-08T22:04:59.273100] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T22:04:59.325336] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-08T22:04:59.362394] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T22:05:00.017625] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-08T22:05:00.817619] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-08T22:05:00.971606] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T22:05:01.503716] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T22:05:01.617703] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-08T22:05:02.417586] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-08T22:05:02.745310] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-08T22:05:03.221138] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-08T22:05:03.227456] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T22:05:03.582250] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-08T22:05:04.017714] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-08T22:05:04.817554] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-08T22:05:05.226563] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-08T22:05:05.617548] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-08T22:05:05.706835] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T22:05:06.425427] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-08T22:05:06.462277] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T22:05:07.004639] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-08T22:05:07.217551] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-08T22:05:08.025788] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-08T22:05:08.050719] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:05:08.281591] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T22:05:08.817594] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-08T22:05:09.617605] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-08T22:05:10.417582] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-08T22:05:10.577395] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-08T22:05:10.632758] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T22:05:11.217515] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-08T22:05:11.384066] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T22:05:11.455195] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-08T22:05:11.458295] [INFO ] [REMOTE ] UCB: Full fetch complete (54727 records). [2025-10-08T22:05:11.458383] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-08T22:05:11.889307] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-08T22:05:11.889571] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-08T22:05:11.890588] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-08T22:05:11.900941] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-08T22:05:11.923428] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T22:05:11.934327] [DEBUG] [LOCAL ] UCB: Trimmed 54727 records to 37776 (keeping 200 days of data) [2025-10-08T22:05:12.024264] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-08T22:05:12.171965] [DEBUG] [LOCAL ] UCB: Primary data saved (37776 records). [2025-10-08T22:05:12.172117] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-08T22:05:12.172222] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UCB took 29.1s. Estimated remaining: 28m 25s. Rate: 7.1 symbols/min [2025-10-08T22:05:12.339140] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:12.380666] [DEBUG] [LOCAL ] UE: Loaded 42693 existing records from primary storage. [2025-10-08T22:05:12.380995] [INFO ] [MAIN ] UE: Loaded 42693 existing records. [2025-10-08T22:05:12.557473] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:12.557844] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-08T22:05:12.557901] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-08T22:05:12.558529] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-08T22:05:12.558586] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-08T22:05:12.824378] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-08T22:05:12.912609] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:13.617549] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-10-08T22:05:14.254407] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T22:05:14.259247] [INFO ] [REMOTE ] UBS: Full fetch complete (75732 records). [2025-10-08T22:05:14.259494] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-08T22:05:14.422789] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-08T22:05:14.602261] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-08T22:05:14.971584] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-08T22:05:14.972020] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-08T22:05:14.973687] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-08T22:05:14.973853] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-08T22:05:14.988020] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:05:14.993592] [DEBUG] [LOCAL ] UBS: Trimmed 75732 records to 52336 (keeping 200 days of data) [2025-10-08T22:05:14.993813] [INFO ] [REMOTE ] UDR: Full fetch complete (74690 records). [2025-10-08T22:05:14.994726] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-08T22:05:15.227015] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-08T22:05:15.489562] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-08T22:05:15.579802] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-08T22:05:15.580449] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-08T22:05:15.581901] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-08T22:05:15.582325] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-08T22:05:15.593037] [DEBUG] [LOCAL ] UDR: Trimmed 74690 records to 51890 (keeping 200 days of data) [2025-10-08T22:05:15.898854] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-08T22:05:15.926839] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-10-08T22:05:15.927858] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-08T22:05:16.075313] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-08T22:05:16.465224] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-08T22:05:16.465985] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-08T22:05:16.467896] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-08T22:05:16.468026] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-08T22:05:16.475436] [DEBUG] [LOCAL ] UBS: Primary data saved (52336 records). [2025-10-08T22:05:16.477092] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 53806 (keeping 200 days of data) [2025-10-08T22:05:16.476195] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-08T22:05:16.477987] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBS took 37.6s. Estimated remaining: 28m 16s. Rate: 7.1 symbols/min [2025-10-08T22:05:16.812695] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:16.836690] [DEBUG] [LOCAL ] UFI: Loaded 8117 existing records from primary storage. [2025-10-08T22:05:16.837712] [INFO ] [MAIN ] UFI: Loaded 8117 existing records. [2025-10-08T22:05:16.888973] [DEBUG] [LOCAL ] UDR: Primary data saved (51890 records). [2025-10-08T22:05:16.902373] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-08T22:05:16.911541] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 33.7s. Estimated remaining: 28m 7s. Rate: 7.1 symbols/min [2025-10-08T22:05:17.135946] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:17.158754] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-08T22:05:17.166447] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-08T22:05:17.177735] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-08T22:05:17.189300] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-08T22:05:17.298630] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:17.762119] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:17.747957] [DEBUG] [LOCAL ] UGI: Loaded 50531 existing records from primary storage. [2025-10-08T22:05:17.763985] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-10-08T22:05:17.766589] [INFO ] [MAIN ] UGI: Loaded 50531 existing records. [2025-10-08T22:05:17.851815] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-08T22:05:17.892877] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-08T22:05:17.994473] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:17.995618] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-08T22:05:17.996507] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-08T22:05:17.997871] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-08T22:05:17.997952] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-08T22:05:18.375031] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:18.422393] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-10-08T22:05:18.466808] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-08T22:05:18.466953] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-08T22:05:18.467043] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UBER took 41.5s. Estimated remaining: 27m 58s. Rate: 7.1 symbols/min [2025-10-08T22:05:18.582251] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-08T22:05:18.651189] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:18.691384] [DEBUG] [LOCAL ] UGP: Loaded 42867 existing records from primary storage. [2025-10-08T22:05:18.691726] [INFO ] [MAIN ] UGP: Loaded 42867 existing records. [2025-10-08T22:05:18.871915] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:18.872183] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-08T22:05:18.872252] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-08T22:05:18.872721] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-08T22:05:18.872783] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-08T22:05:19.233071] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:19.226972] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-08T22:05:19.301722] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T22:05:20.006199] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T22:05:20.009239] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T22:05:20.023586] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-08T22:05:20.817566] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-08T22:05:21.617568] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-08T22:05:21.933319] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-08T22:05:22.222965] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T22:05:22.255635] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T22:05:22.417536] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-08T22:05:23.217563] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-08T22:05:23.823200] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T22:05:23.996929] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T22:05:24.017507] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-08T22:05:24.817562] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-08T22:05:25.388821] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T22:05:25.617568] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-10-08T22:05:26.427841] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-08T22:05:26.432522] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T22:05:26.973298] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T22:05:27.217556] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-08T22:05:27.590667] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T22:05:28.017609] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-08T22:05:28.128347] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T22:05:28.817547] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-08T22:05:29.428633] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T22:05:29.617574] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-08T22:05:29.962797] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T22:05:30.417597] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-08T22:05:31.218711] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-08T22:05:31.218814] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-08T22:05:32.017539] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-08T22:05:32.601711] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-08T22:05:32.780227] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T22:05:32.809551] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T22:05:32.818380] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-08T22:05:33.617628] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-08T22:05:34.151746] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T22:05:34.174437] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T22:05:34.417578] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-08T22:05:35.042278] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T22:05:35.217619] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-08T22:05:35.949770] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-08T22:05:36.017519] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-08T22:05:36.563207] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-08T22:05:36.817757] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-08T22:05:37.481378] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T22:05:37.482757] [INFO ] [REMOTE ] UFI: Full fetch complete (12466 records). [2025-10-08T22:05:37.482832] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-08T22:05:37.623742] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-08T22:05:37.850491] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-08T22:05:37.850574] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-08T22:05:37.850896] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-08T22:05:37.850957] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-08T22:05:37.851428] [DEBUG] [LOCAL ] UFI: Trimmed 12466 records to 8134 (keeping 200 days of data) [2025-10-08T22:05:37.896951] [DEBUG] [LOCAL ] UFI: Primary data saved (8134 records). [2025-10-08T22:05:37.897105] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-08T22:05:37.897193] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UFI took 21.4s. Estimated remaining: 27m 51s. Rate: 7.1 symbols/min [2025-10-08T22:05:38.063154] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:38.079925] [DEBUG] [LOCAL ] UHAL: Loaded 16716 existing records from primary storage. [2025-10-08T22:05:38.080172] [INFO ] [MAIN ] UHAL: Loaded 16716 existing records. [2025-10-08T22:05:38.258550] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:38.258864] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-08T22:05:38.258922] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-08T22:05:38.259126] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-08T22:05:38.259182] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-08T22:05:38.439906] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-08T22:05:38.634408] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:39.215529] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T22:05:39.225423] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-10-08T22:05:39.716587] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T22:05:39.720551] [INFO ] [REMOTE ] UE: Full fetch complete (61193 records). [2025-10-08T22:05:39.720777] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-08T22:05:40.020790] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-08T22:05:40.148426] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-08T22:05:40.148577] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-08T22:05:40.155188] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-08T22:05:40.159441] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-08T22:05:40.161045] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-08T22:05:40.166530] [DEBUG] [LOCAL ] UE: Trimmed 61193 records to 42577 (keeping 200 days of data) [2025-10-08T22:05:40.436308] [DEBUG] [LOCAL ] UE: Primary data saved (42577 records). [2025-10-08T22:05:40.436455] [INFO ] [MAIN ] UE: Full history saved. [2025-10-08T22:05:40.436542] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 28.3s. Estimated remaining: 27m 42s. Rate: 7.1 symbols/min [2025-10-08T22:05:40.613070] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:40.660933] [DEBUG] [LOCAL ] UHS: Loaded 40668 existing records from primary storage. [2025-10-08T22:05:40.661513] [INFO ] [MAIN ] UHS: Loaded 40668 existing records. [2025-10-08T22:05:40.822749] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-08T22:05:40.854698] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:40.855103] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-08T22:05:40.855159] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-08T22:05:40.855461] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-08T22:05:40.855520] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-08T22:05:41.264439] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:41.617554] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-10-08T22:05:41.859964] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-08T22:05:41.884379] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-08T22:05:42.417607] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-08T22:05:43.218234] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-08T22:05:43.220942] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-08T22:05:44.017521] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-08T22:05:44.042840] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T22:05:44.146371] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T22:05:44.817550] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-08T22:05:45.235127] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T22:05:45.600931] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-08T22:05:45.617510] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-08T22:05:46.417579] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-08T22:05:46.755209] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-08T22:05:47.217553] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-08T22:05:47.929920] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-08T22:05:48.023508] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-08T22:05:48.043034] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:05:48.817532] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-08T22:05:49.543112] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T22:05:49.617611] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-08T22:05:50.194922] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T22:05:50.417528] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-08T22:05:51.217570] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-08T22:05:51.427397] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:05:51.470986] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T22:05:52.017603] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-08T22:05:52.563072] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-08T22:05:52.817561] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-08T22:05:52.843212] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-08T22:05:53.617594] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-08T22:05:54.338886] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T22:05:54.417574] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-08T22:05:54.580321] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T22:05:55.217596] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-08T22:05:56.009309] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T22:05:56.020299] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-08T22:05:56.040136] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T22:05:56.817553] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-08T22:05:57.464209] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T22:05:57.617559] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-08T22:05:57.955037] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T22:05:57.958849] [INFO ] [REMOTE ] UGI: Full fetch complete (73301 records). [2025-10-08T22:05:57.958975] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-08T22:05:58.353205] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-08T22:05:58.353375] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-08T22:05:58.354581] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-08T22:05:58.354741] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-08T22:05:58.368414] [DEBUG] [LOCAL ] UGI: Trimmed 73301 records to 50564 (keeping 200 days of data) [2025-10-08T22:05:58.370373] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-08T22:05:58.427001] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-08T22:05:58.736107] [DEBUG] [LOCAL ] UGI: Primary data saved (50564 records). [2025-10-08T22:05:58.736319] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-08T22:05:58.737626] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UGI took 41.8s. Estimated remaining: 27m 34s. Rate: 7.1 symbols/min [2025-10-08T22:05:58.928474] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:05:58.944105] [DEBUG] [LOCAL ] UHT: Loaded 10020 existing records from primary storage. [2025-10-08T22:05:58.944434] [INFO ] [MAIN ] UHT: Loaded 10020 existing records. [2025-10-08T22:05:59.132697] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:05:59.133111] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-08T22:05:59.133177] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-08T22:05:59.133463] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-08T22:05:59.133522] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-08T22:05:59.222856] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-08T22:05:59.525768] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:05:59.955885] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T22:06:00.017531] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-10-08T22:06:00.760597] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T22:06:00.817523] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-08T22:06:01.064439] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-08T22:06:01.617557] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-08T22:06:02.417552] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-08T22:06:02.495399] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T22:06:03.121600] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-08T22:06:03.123385] [INFO ] [REMOTE ] UHAL: Full fetch complete (23289 records). [2025-10-08T22:06:03.123461] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-08T22:06:03.219264] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-08T22:06:03.535993] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-08T22:06:03.538546] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-08T22:06:03.539198] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-08T22:06:03.539294] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-08T22:06:03.541674] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T22:06:03.550736] [DEBUG] [LOCAL ] UHAL: Trimmed 23289 records to 16732 (keeping 200 days of data) [2025-10-08T22:06:03.651971] [DEBUG] [LOCAL ] UHAL: Primary data saved (16732 records). [2025-10-08T22:06:03.652122] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-08T22:06:03.652211] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UHAL took 25.8s. Estimated remaining: 27m 25s. Rate: 7.1 symbols/min [2025-10-08T22:06:03.833189] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:03.849385] [DEBUG] [LOCAL ] UI: Loaded 13335 existing records from primary storage. [2025-10-08T22:06:03.849671] [INFO ] [MAIN ] UI: Loaded 13335 existing records. [2025-10-08T22:06:04.033185] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-08T22:06:04.040125] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:04.041410] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-08T22:06:04.041550] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-08T22:06:04.042070] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-08T22:06:04.042203] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-08T22:06:04.211926] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-08T22:06:04.448527] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:04.817582] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-08T22:06:05.229778] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T22:06:05.577947] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-08T22:06:05.617563] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-08T22:06:06.417726] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-08T22:06:06.515926] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T22:06:07.217620] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-08T22:06:07.630750] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T22:06:07.635134] [INFO ] [REMOTE ] UGP: Full fetch complete (62177 records). [2025-10-08T22:06:07.635438] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-08T22:06:08.027107] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-08T22:06:08.030598] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-08T22:06:08.031799] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-08T22:06:08.032913] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-08T22:06:08.033108] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-08T22:06:08.037226] [DEBUG] [LOCAL ] UGP: Trimmed 62177 records to 42933 (keeping 200 days of data) [2025-10-08T22:06:08.308032] [DEBUG] [LOCAL ] UGP: Primary data saved (42933 records). [2025-10-08T22:06:08.308222] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-08T22:06:08.308340] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UGP took 49.8s. Estimated remaining: 27m 17s. Rate: 7.1 symbols/min [2025-10-08T22:06:08.484742] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:08.521274] [DEBUG] [LOCAL ] UIS: Loaded 36972 existing records from primary storage. [2025-10-08T22:06:08.521703] [INFO ] [MAIN ] UIS: Loaded 36972 existing records. [2025-10-08T22:06:08.720940] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:08.721884] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-08T22:06:08.722091] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-08T22:06:08.722331] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-08T22:06:08.722390] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-08T22:06:08.824443] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-10-08T22:06:08.984243] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T22:06:09.050748] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T22:06:09.149630] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:09.617541] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-08T22:06:09.759303] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T22:06:10.218239] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T22:06:10.417583] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-08T22:06:11.217575] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-08T22:06:12.017540] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-08T22:06:12.117273] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T22:06:12.120100] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T22:06:12.486050] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-08T22:06:12.817556] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-08T22:06:13.617622] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-08T22:06:14.246940] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-08T22:06:14.355968] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:06:14.417610] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-08T22:06:15.220575] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-08T22:06:15.224696] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-08T22:06:16.019141] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-08T22:06:16.024288] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-08T22:06:16.695874] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-08T22:06:16.817560] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-08T22:06:17.617520] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-10-08T22:06:17.723809] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T22:06:18.417556] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-08T22:06:18.978695] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T22:06:19.218291] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-08T22:06:19.222444] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T22:06:20.006320] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-08T22:06:20.017519] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-08T22:06:20.817573] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-08T22:06:20.917591] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T22:06:21.617605] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-08T22:06:22.103878] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T22:06:22.417523] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-08T22:06:22.550010] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T22:06:23.217697] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-08T22:06:23.475740] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T22:06:24.017582] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-08T22:06:24.088673] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T22:06:24.817597] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-08T22:06:25.288120] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T22:06:25.292153] [INFO ] [REMOTE ] UHS: Full fetch complete (58230 records). [2025-10-08T22:06:25.292335] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-08T22:06:25.621458] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-08T22:06:25.600725] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-08T22:06:25.761956] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-08T22:06:25.762061] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-08T22:06:25.763136] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-08T22:06:25.763203] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-08T22:06:25.764548] [DEBUG] [LOCAL ] UHS: Trimmed 58230 records to 40581 (keeping 200 days of data) [2025-10-08T22:06:26.034557] [DEBUG] [LOCAL ] UHS: Primary data saved (40581 records). [2025-10-08T22:06:26.034741] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-08T22:06:26.035878] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHS took 45.6s. Estimated remaining: 27m 9s. Rate: 7.1 symbols/min [2025-10-08T22:06:26.203145] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:26.272291] [DEBUG] [LOCAL ] UL: Loaded 53074 existing records from primary storage. [2025-10-08T22:06:26.272765] [INFO ] [MAIN ] UL: Loaded 53074 existing records. [2025-10-08T22:06:26.419817] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-08T22:06:26.457467] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:26.459142] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-08T22:06:26.459303] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-08T22:06:26.464809] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-08T22:06:26.470189] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-08T22:06:26.504115] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T22:06:26.845038] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:27.217540] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-10-08T22:06:27.933135] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T22:06:28.017587] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-08T22:06:28.817520] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-08T22:06:29.078171] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T22:06:29.160238] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T22:06:29.600636] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-08T22:06:29.617538] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-08T22:06:30.417529] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-08T22:06:30.441773] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T22:06:30.443318] [INFO ] [REMOTE ] UI: Full fetch complete (18687 records). [2025-10-08T22:06:30.443402] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-08T22:06:30.809571] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-08T22:06:30.809690] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-08T22:06:30.810124] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-08T22:06:30.810199] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-08T22:06:30.810801] [DEBUG] [LOCAL ] UI: Trimmed 18687 records to 13339 (keeping 200 days of data) [2025-10-08T22:06:30.900439] [DEBUG] [LOCAL ] UI: Primary data saved (13339 records). [2025-10-08T22:06:30.900593] [INFO ] [MAIN ] UI: Full history saved. [2025-10-08T22:06:30.900727] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UI took 27.2s. Estimated remaining: 27m 0s. Rate: 7.1 symbols/min [2025-10-08T22:06:31.067253] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:31.106091] [DEBUG] [LOCAL ] ULS: Loaded 39452 existing records from primary storage. [2025-10-08T22:06:31.106455] [INFO ] [MAIN ] ULS: Loaded 39452 existing records. [2025-10-08T22:06:31.222738] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-08T22:06:31.285538] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:31.285753] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-08T22:06:31.285804] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-08T22:06:31.286073] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-08T22:06:31.286130] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-08T22:06:31.663035] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:32.003171] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-08T22:06:32.017493] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-08T22:06:32.783471] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-08T22:06:32.817505] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-08T22:06:33.547253] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T22:06:33.617497] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-08T22:06:34.244292] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T22:06:34.417552] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-08T22:06:35.217541] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-08T22:06:35.560038] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T22:06:35.742324] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T22:06:35.967287] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T22:06:35.968639] [INFO ] [REMOTE ] UHT: Full fetch complete (15003 records). [2025-10-08T22:06:35.968744] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-08T22:06:36.023166] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-08T22:06:36.345003] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-08T22:06:36.345123] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-08T22:06:36.345523] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-08T22:06:36.345594] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-08T22:06:36.346165] [DEBUG] [LOCAL ] UHT: Trimmed 15003 records to 10003 (keeping 200 days of data) [2025-10-08T22:06:36.411414] [DEBUG] [LOCAL ] UHT: Primary data saved (10003 records). [2025-10-08T22:06:36.411555] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-08T22:06:36.411665] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. UHT took 37.7s. Estimated remaining: 26m 51s. Rate: 7.1 symbols/min [2025-10-08T22:06:36.585428] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:36.657038] [DEBUG] [LOCAL ] UMC: Loaded 52716 existing records from primary storage. [2025-10-08T22:06:36.657424] [INFO ] [MAIN ] UMC: Loaded 52716 existing records. [2025-10-08T22:06:36.835520] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-10-08T22:06:36.841596] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:36.842619] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-08T22:06:36.842707] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-08T22:06:36.842957] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-08T22:06:36.843015] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-08T22:06:37.201623] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:37.617575] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-10-08T22:06:38.004974] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-08T22:06:38.364061] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-08T22:06:38.417557] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-08T22:06:39.217508] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-08T22:06:39.463184] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T22:06:39.522004] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T22:06:40.017580] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-08T22:06:40.645129] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T22:06:40.817574] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-08T22:06:41.625550] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-08T22:06:41.631375] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T22:06:41.945218] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T22:06:41.948169] [INFO ] [REMOTE ] UIS: Full fetch complete (51874 records). [2025-10-08T22:06:41.948281] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-08T22:06:42.335578] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-08T22:06:42.335685] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-08T22:06:42.336692] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-08T22:06:42.336758] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-08T22:06:42.338037] [DEBUG] [LOCAL ] UIS: Trimmed 51874 records to 36941 (keeping 200 days of data) [2025-10-08T22:06:42.425158] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-08T22:06:42.557910] [DEBUG] [LOCAL ] UIS: Primary data saved (36941 records). [2025-10-08T22:06:42.558059] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-08T22:06:42.558198] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 34.2s. Estimated remaining: 26m 43s. Rate: 7.1 symbols/min [2025-10-08T22:06:42.727975] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:42.763380] [DEBUG] [LOCAL ] UMH: Loaded 33804 existing records from primary storage. [2025-10-08T22:06:42.763690] [INFO ] [MAIN ] UMH: Loaded 33804 existing records. [2025-10-08T22:06:42.978285] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:42.978576] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-08T22:06:42.978625] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-08T22:06:42.978934] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-08T22:06:42.978981] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-08T22:06:43.220002] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-08T22:06:43.360490] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:06:43.389547] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-08T22:06:44.017613] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-10-08T22:06:44.208927] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-08T22:06:44.817563] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-08T22:06:45.005715] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T22:06:45.238931] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T22:06:45.617575] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-08T22:06:46.417550] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-08T22:06:46.858618] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T22:06:47.217587] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-08T22:06:47.246522] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:06:47.943369] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-08T22:06:48.017493] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-08T22:06:48.215802] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-08T22:06:48.817570] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-08T22:06:49.237758] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T22:06:49.617719] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-08T22:06:50.354851] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:06:50.417513] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-08T22:06:51.095218] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T22:06:51.217538] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-08T22:06:51.637021] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T22:06:52.017554] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-08T22:06:52.401118] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T22:06:52.817583] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-08T22:06:53.312884] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T22:06:53.617602] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-08T22:06:53.826435] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T22:06:54.417530] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-08T22:06:55.049924] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T22:06:55.217570] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-08T22:06:56.017565] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-08T22:06:56.402519] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T22:06:56.593754] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T22:06:56.817528] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-08T22:06:57.432153] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T22:06:57.617549] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-08T22:06:58.412706] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T22:06:58.417545] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-08T22:06:58.419726] [INFO ] [REMOTE ] UL: Full fetch complete (76891 records). [2025-10-08T22:06:58.419930] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-08T22:06:59.057667] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-08T22:06:59.057807] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-08T22:06:59.059168] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-08T22:06:59.059289] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-08T22:06:59.096216] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T22:06:59.094220] [DEBUG] [LOCAL ] UL: Trimmed 76891 records to 53068 (keeping 200 days of data) [2025-10-08T22:06:59.219696] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-08T22:06:59.494236] [DEBUG] [LOCAL ] UL: Primary data saved (53068 records). [2025-10-08T22:06:59.494420] [INFO ] [MAIN ] UL: Full history saved. [2025-10-08T22:06:59.494513] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 33.5s. Estimated remaining: 26m 35s. Rate: 7.1 symbols/min [2025-10-08T22:06:59.679605] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:06:59.695094] [DEBUG] [LOCAL ] UNF: Loaded 12129 existing records from primary storage. [2025-10-08T22:06:59.695371] [INFO ] [MAIN ] UNF: Loaded 12129 existing records. [2025-10-08T22:06:59.884464] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:06:59.884863] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-08T22:06:59.885012] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-08T22:06:59.902808] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-08T22:06:59.903292] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-08T22:06:59.904039] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T22:07:00.028539] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-08T22:07:00.240431] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-08T22:07:00.284176] [INFO ] [REMOTE ] ULS: Full fetch complete (54173 records). [2025-10-08T22:07:00.289880] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-08T22:07:00.391498] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:00.749356] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-08T22:07:00.749487] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-08T22:07:00.750565] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-08T22:07:00.750635] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-08T22:07:00.752110] [DEBUG] [LOCAL ] ULS: Trimmed 54173 records to 39447 (keeping 200 days of data) [2025-10-08T22:07:00.820006] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-10-08T22:07:01.011709] [DEBUG] [LOCAL ] ULS: Primary data saved (39447 records). [2025-10-08T22:07:01.012669] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-08T22:07:01.012809] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. ULS took 30.1s. Estimated remaining: 26m 26s. Rate: 7.1 symbols/min [2025-10-08T22:07:01.185621] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:01.228082] [DEBUG] [LOCAL ] UNFI: Loaded 42313 existing records from primary storage. [2025-10-08T22:07:01.228409] [INFO ] [MAIN ] UNFI: Loaded 42313 existing records. [2025-10-08T22:07:01.424616] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:01.425028] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-08T22:07:01.425100] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-08T22:07:01.425554] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-08T22:07:01.425618] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-08T22:07:01.608096] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T22:07:01.619352] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-08T22:07:01.672564] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-08T22:07:01.870232] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:02.417562] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-08T22:07:03.217568] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-08T22:07:03.531862] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-08T22:07:03.750112] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T22:07:04.017535] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-08T22:07:04.042827] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T22:07:04.817599] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-08T22:07:05.532056] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T22:07:05.552377] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T22:07:05.617520] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-08T22:07:06.417599] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-08T22:07:06.922416] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T22:07:06.925580] [INFO ] [REMOTE ] UMH: Full fetch complete (46803 records). [2025-10-08T22:07:06.925699] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-08T22:07:07.218196] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-08T22:07:07.249899] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-08T22:07:07.336603] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-08T22:07:07.336735] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-08T22:07:07.337574] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-08T22:07:07.337616] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-08T22:07:07.338753] [DEBUG] [LOCAL ] UMH: Trimmed 46803 records to 33843 (keeping 200 days of data) [2025-10-08T22:07:07.546945] [DEBUG] [LOCAL ] UMH: Primary data saved (33843 records). [2025-10-08T22:07:07.547101] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-08T22:07:07.547194] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UMH took 25.0s. Estimated remaining: 26m 17s. Rate: 7.1 symbols/min [2025-10-08T22:07:07.739354] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:07.807438] [DEBUG] [LOCAL ] UNH: Loaded 53802 existing records from primary storage. [2025-10-08T22:07:07.807863] [INFO ] [MAIN ] UNH: Loaded 53802 existing records. [2025-10-08T22:07:07.983858] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:07.984132] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-08T22:07:07.984190] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-08T22:07:07.984439] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-08T22:07:07.984505] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-08T22:07:08.026228] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-08T22:07:08.341986] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:08.817612] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-10-08T22:07:09.039686] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T22:07:09.086180] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T22:07:09.617571] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-08T22:07:10.417593] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-08T22:07:11.097359] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T22:07:11.152613] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-08T22:07:11.217569] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-08T22:07:11.335993] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T22:07:12.017584] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-10-08T22:07:12.817598] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-08T22:07:13.566392] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-08T22:07:13.605052] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T22:07:13.617497] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-08T22:07:14.427203] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-08T22:07:14.459054] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T22:07:15.067317] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T22:07:15.087041] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T22:07:15.217587] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-08T22:07:16.017553] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-08T22:07:16.281799] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-08T22:07:16.817561] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-08T22:07:17.617567] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-08T22:07:17.769140] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T22:07:18.402856] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-08T22:07:18.417539] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-08T22:07:18.969117] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-08T22:07:18.977638] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-08T22:07:19.217684] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-08T22:07:20.017582] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-08T22:07:20.817534] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-08T22:07:21.154183] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-08T22:07:21.617600] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-08T22:07:22.229626] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T22:07:22.231351] [INFO ] [REMOTE ] UNF: Full fetch complete (17317 records). [2025-10-08T22:07:22.231518] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-08T22:07:22.233089] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T22:07:22.363619] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-08T22:07:22.425023] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-08T22:07:22.651275] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-08T22:07:22.651369] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-08T22:07:22.651777] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-08T22:07:22.651836] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-08T22:07:22.652449] [DEBUG] [LOCAL ] UNF: Trimmed 17317 records to 12125 (keeping 200 days of data) [2025-10-08T22:07:22.733511] [DEBUG] [LOCAL ] UNF: Primary data saved (12125 records). [2025-10-08T22:07:22.733722] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-08T22:07:22.733839] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UNF took 23.2s. Estimated remaining: 26m 10s. Rate: 7.1 symbols/min [2025-10-08T22:07:22.906219] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:22.949912] [DEBUG] [LOCAL ] UNM: Loaded 48288 existing records from primary storage. [2025-10-08T22:07:22.950320] [INFO ] [MAIN ] UNM: Loaded 48288 existing records. [2025-10-08T22:07:23.128148] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:23.128410] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-08T22:07:23.128457] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-08T22:07:23.128941] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-08T22:07:23.129027] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-08T22:07:23.227257] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-08T22:07:23.511127] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:24.017631] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-08T22:07:24.817554] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-10-08T22:07:24.989899] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-08T22:07:25.124914] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-08T22:07:25.180611] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T22:07:25.617567] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-08T22:07:26.153034] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T22:07:26.417624] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-08T22:07:26.900304] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T22:07:26.904287] [INFO ] [REMOTE ] UMC: Full fetch complete (76575 records). [2025-10-08T22:07:26.904406] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-08T22:07:27.222620] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-08T22:07:27.310669] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-08T22:07:27.310767] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-08T22:07:27.311884] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-08T22:07:27.311949] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-08T22:07:27.313446] [DEBUG] [LOCAL ] UMC: Trimmed 76575 records to 52718 (keeping 200 days of data) [2025-10-08T22:07:27.624580] [DEBUG] [LOCAL ] UMC: Primary data saved (52718 records). [2025-10-08T22:07:27.624767] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-08T22:07:27.624876] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UMC took 51.2s. Estimated remaining: 26m 1s. Rate: 7.1 symbols/min [2025-10-08T22:07:27.805729] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:27.812303] [DEBUG] [LOCAL ] UNMA: Loaded 3517 existing records from primary storage. [2025-10-08T22:07:27.812522] [INFO ] [MAIN ] UNMA: Loaded 3517 existing records. [2025-10-08T22:07:27.990415] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:27.990637] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-08T22:07:27.990727] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-08T22:07:27.990942] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-08T22:07:27.991001] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-08T22:07:28.022736] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-08T22:07:28.359579] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:28.711692] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T22:07:28.828225] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-10-08T22:07:28.834676] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-08T22:07:29.119569] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T22:07:29.317757] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-08T22:07:29.617574] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-08T22:07:30.417546] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-08T22:07:31.217536] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-08T22:07:31.325040] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-08T22:07:31.815371] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-08T22:07:32.017602] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-08T22:07:32.817555] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-08T22:07:33.008185] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-08T22:07:33.080583] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T22:07:33.617566] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-08T22:07:34.417577] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-08T22:07:34.541877] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T22:07:35.217564] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-08T22:07:35.312223] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T22:07:35.754718] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T22:07:36.017566] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-08T22:07:36.458263] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-08T22:07:36.817545] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-08T22:07:37.110396] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-08T22:07:37.617574] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-08T22:07:38.193824] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-08T22:07:38.279313] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T22:07:38.417573] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-08T22:07:39.217551] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-08T22:07:39.634519] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-08T22:07:40.017545] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-08T22:07:40.103696] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T22:07:40.356728] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-08T22:07:40.817545] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-08T22:07:41.617575] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-08T22:07:42.261597] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-08T22:07:42.417612] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-08T22:07:43.217611] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-08T22:07:43.689715] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-08T22:07:44.022623] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-08T22:07:44.040322] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T22:07:44.155530] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-08T22:07:44.572185] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-08T22:07:44.817601] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-08T22:07:45.617532] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-08T22:07:46.424408] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-08T22:07:46.432226] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T22:07:47.185576] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T22:07:47.222816] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-08T22:07:47.238318] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T22:07:48.017558] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-08T22:07:48.426301] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T22:07:48.427270] [INFO ] [REMOTE ] UNMA: Full fetch complete (5738 records). [2025-10-08T22:07:48.427342] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-08T22:07:48.786734] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-08T22:07:48.786830] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-08T22:07:48.787015] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-08T22:07:48.787054] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-08T22:07:48.787452] [DEBUG] [LOCAL ] UNMA: Trimmed 5738 records to 3550 (keeping 200 days of data) [2025-10-08T22:07:48.809319] [DEBUG] [LOCAL ] UNMA: Primary data saved (3550 records). [2025-10-08T22:07:48.809442] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-08T22:07:48.809533] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNMA took 21.2s. Estimated remaining: 25m 54s. Rate: 7.1 symbols/min [2025-10-08T22:07:48.822697] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-08T22:07:48.989296] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:49.040248] [DEBUG] [LOCAL ] UNP: Loaded 53301 existing records from primary storage. [2025-10-08T22:07:49.040635] [INFO ] [MAIN ] UNP: Loaded 53301 existing records. [2025-10-08T22:07:49.222586] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:49.222827] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-08T22:07:49.222876] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-08T22:07:49.223131] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-08T22:07:49.223195] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-08T22:07:49.573964] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:49.617510] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-08T22:07:49.855468] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-08T22:07:50.371441] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-08T22:07:50.376166] [INFO ] [REMOTE ] UNFI: Full fetch complete (59435 records). [2025-10-08T22:07:50.376308] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-08T22:07:50.427205] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-10-08T22:07:50.846031] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-08T22:07:50.846133] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-08T22:07:50.847490] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-08T22:07:50.847570] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-08T22:07:50.849269] [DEBUG] [LOCAL ] UNFI: Trimmed 59435 records to 42346 (keeping 200 days of data) [2025-10-08T22:07:51.118034] [DEBUG] [LOCAL ] UNFI: Primary data saved (42346 records). [2025-10-08T22:07:51.118253] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-08T22:07:51.118520] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNFI took 50.1s. Estimated remaining: 25m 45s. Rate: 7.1 symbols/min [2025-10-08T22:07:51.222008] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-08T22:07:51.240214] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T22:07:51.331511] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:51.373603] [DEBUG] [LOCAL ] UP: Loaded 43547 existing records from primary storage. [2025-10-08T22:07:51.373943] [INFO ] [MAIN ] UP: Loaded 43547 existing records. [2025-10-08T22:07:51.554919] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:51.555159] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-08T22:07:51.555207] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-08T22:07:51.555527] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-08T22:07:51.555565] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-08T22:07:51.966764] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:51.969180] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-08T22:07:51.973598] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-10-08T22:07:51.973764] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-08T22:07:52.018713] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-08T22:07:52.313178] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-08T22:07:52.420436] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-08T22:07:52.420519] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-08T22:07:52.421686] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-08T22:07:52.421750] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-08T22:07:52.423275] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 53803 (keeping 200 days of data) [2025-10-08T22:07:52.805879] [DEBUG] [LOCAL ] UNH: Primary data saved (53803 records). [2025-10-08T22:07:52.806063] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-08T22:07:52.806169] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 45.3s. Estimated remaining: 25m 36s. Rate: 7.1 symbols/min [2025-10-08T22:07:52.822729] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-08T22:07:52.982836] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:53.032521] [DEBUG] [LOCAL ] UPS: Loaded 53717 existing records from primary storage. [2025-10-08T22:07:53.032879] [INFO ] [MAIN ] UPS: Loaded 53717 existing records. [2025-10-08T22:07:53.212428] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:53.212712] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-08T22:07:53.212881] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-08T22:07:53.213100] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-08T22:07:53.213156] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-08T22:07:53.604673] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:07:53.627465] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-10-08T22:07:53.632876] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T22:07:54.417576] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-08T22:07:54.467958] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-08T22:07:54.691014] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T22:07:55.217605] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-08T22:07:56.017598] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-10-08T22:07:56.065255] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T22:07:56.819727] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-08T22:07:56.825338] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T22:07:57.617558] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-08T22:07:58.259864] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-08T22:07:58.281436] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T22:07:58.285131] [INFO ] [REMOTE ] UNM: Full fetch complete (69816 records). [2025-10-08T22:07:58.285241] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-08T22:07:58.424105] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-08T22:07:58.676498] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-08T22:07:58.676586] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-08T22:07:58.677781] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-08T22:07:58.678062] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-08T22:07:58.679629] [DEBUG] [LOCAL ] UNM: Trimmed 69816 records to 48187 (keeping 200 days of data) [2025-10-08T22:07:58.937256] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T22:07:59.038235] [DEBUG] [LOCAL ] UNM: Primary data saved (48187 records). [2025-10-08T22:07:59.038459] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-08T22:07:59.038577] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNM took 36.3s. Estimated remaining: 25m 27s. Rate: 7.1 symbols/min [2025-10-08T22:07:59.219593] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-08T22:07:59.219471] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:07:59.265444] [DEBUG] [LOCAL ] URI: Loaded 35287 existing records from primary storage. [2025-10-08T22:07:59.265888] [INFO ] [MAIN ] URI: Loaded 35287 existing records. [2025-10-08T22:07:59.452501] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:07:59.452854] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-08T22:07:59.452907] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-08T22:07:59.453250] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-08T22:07:59.453310] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-08T22:07:59.843436] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:08:00.017573] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-10-08T22:08:00.463751] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-08T22:08:00.530802] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T22:08:00.817572] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-08T22:08:01.298294] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T22:08:01.617560] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-08T22:08:02.417525] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-08T22:08:02.809127] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-08T22:08:03.217540] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-08T22:08:03.511980] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-08T22:08:03.898807] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:08:04.017548] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-08T22:08:04.817628] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-08T22:08:05.207775] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-08T22:08:05.558928] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T22:08:05.617624] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-08T22:08:06.417601] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-08T22:08:06.813837] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T22:08:07.001212] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-08T22:08:07.217628] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-08T22:08:07.923017] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T22:08:08.017569] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-08T22:08:08.817526] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-08T22:08:09.032040] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-08T22:08:09.617563] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-08T22:08:09.848549] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-08T22:08:10.257047] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T22:08:10.417554] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-08T22:08:11.088362] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T22:08:11.217568] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-08T22:08:12.017546] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-08T22:08:12.387844] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-08T22:08:12.427205] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-08T22:08:12.817546] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-08T22:08:13.617548] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-08T22:08:13.761106] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T22:08:14.417675] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-08T22:08:14.475945] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-08T22:08:14.914499] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T22:08:15.217556] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-08T22:08:15.448222] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T22:08:16.017607] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-08T22:08:16.817571] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-08T22:08:17.535714] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-08T22:08:17.617524] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-08T22:08:18.071221] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T22:08:18.257125] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T22:08:18.417551] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-08T22:08:18.662980] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T22:08:19.217615] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-08T22:08:20.031236] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-08T22:08:20.055861] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T22:08:20.817566] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-08T22:08:20.920770] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T22:08:21.513078] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-08T22:08:21.617568] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-08T22:08:22.417562] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-08T22:08:22.900605] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-08T22:08:23.217542] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-08T22:08:23.305829] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-08T22:08:23.723429] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T22:08:24.017597] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-08T22:08:24.411694] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T22:08:24.415902] [INFO ] [REMOTE ] UNP: Full fetch complete (76914 records). [2025-10-08T22:08:24.416049] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-08T22:08:24.820691] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-08T22:08:24.843159] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-08T22:08:24.844109] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-08T22:08:24.845365] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-08T22:08:24.845556] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-08T22:08:24.847154] [DEBUG] [LOCAL ] UNP: Trimmed 76914 records to 53309 (keeping 200 days of data) [2025-10-08T22:08:25.089355] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-08T22:08:25.095580] [INFO ] [REMOTE ] URI: Full fetch complete (53079 records). [2025-10-08T22:08:25.096541] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-08T22:08:25.525886] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-08T22:08:25.526298] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-08T22:08:25.527617] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-08T22:08:25.528128] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-08T22:08:25.564401] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-08T22:08:25.615683] [DEBUG] [LOCAL ] URI: Trimmed 53079 records to 35216 (keeping 200 days of data) [2025-10-08T22:08:25.622495] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-08T22:08:25.877923] [DEBUG] [LOCAL ] UNP: Primary data saved (53309 records). [2025-10-08T22:08:25.879316] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-08T22:08:25.879937] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UNP took 37.1s. Estimated remaining: 25m 20s. Rate: 7.1 symbols/min [2025-10-08T22:08:26.016931] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-08T22:08:26.068772] [INFO ] [REMOTE ] UPS: Full fetch complete (77757 records). [2025-10-08T22:08:26.088880] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-08T22:08:26.136684] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:08:26.306402] [DEBUG] [LOCAL ] URI: Primary data saved (35216 records). [2025-10-08T22:08:26.329114] [INFO ] [MAIN ] URI: Full history saved. [2025-10-08T22:08:26.341752] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. URI took 27.3s. Estimated remaining: 25m 11s. Rate: 7.1 symbols/min [2025-10-08T22:08:26.342749] [DEBUG] [LOCAL ] USA: Loaded 35975 existing records from primary storage. [2025-10-08T22:08:26.428976] [INFO ] [MAIN ] USA: Loaded 35975 existing records. [2025-10-08T22:08:26.449844] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-08T22:08:26.951063] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:08:26.995387] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:08:26.995841] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-08T22:08:26.988859] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-08T22:08:26.996474] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-08T22:08:26.996615] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-08T22:08:26.998080] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-08T22:08:26.998163] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-08T22:08:26.998032] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-08T22:08:26.998270] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-08T22:08:27.099230] [DEBUG] [LOCAL ] UPS: Trimmed 77757 records to 53717 (keeping 200 days of data) [2025-10-08T22:08:27.340393] [DEBUG] [LOCAL ] USAC: Loaded 21747 existing records from primary storage. [2025-10-08T22:08:27.364677] [INFO ] [MAIN ] USAC: Loaded 21747 existing records. [2025-10-08T22:08:27.649282] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:08:27.672965] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-10-08T22:08:27.715718] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:08:27.717129] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-08T22:08:27.717811] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-08T22:08:27.718952] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-08T22:08:27.719286] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-08T22:08:28.110518] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:08:28.112141] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-10-08T22:08:28.260568] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:08:28.391132] [DEBUG] [LOCAL ] UPS: Primary data saved (53717 records). [2025-10-08T22:08:28.391280] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-08T22:08:28.391378] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. UPS took 35.6s. Estimated remaining: 25m 2s. Rate: 7.1 symbols/min [2025-10-08T22:08:28.559534] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:08:28.611319] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-08T22:08:28.611711] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-08T22:08:28.796367] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:08:28.796733] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-08T22:08:28.796950] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-08T22:08:28.797206] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-08T22:08:28.797264] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-08T22:08:28.829445] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-08T22:08:29.107222] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T22:08:29.218146] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:08:29.219766] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T22:08:29.617582] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-08T22:08:30.417632] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-08T22:08:30.722240] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T22:08:31.048407] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T22:08:31.217532] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-08T22:08:31.639988] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T22:08:32.017599] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-08T22:08:32.817624] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-08T22:08:32.889200] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-08T22:08:32.893244] [INFO ] [REMOTE ] UP: Full fetch complete (62648 records). [2025-10-08T22:08:32.893365] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-08T22:08:33.295272] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-08T22:08:33.295374] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-08T22:08:33.296470] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-08T22:08:33.296573] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-08T22:08:33.298162] [DEBUG] [LOCAL ] UP: Trimmed 62648 records to 43707 (keeping 200 days of data) [2025-10-08T22:08:33.405129] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T22:08:33.577118] [DEBUG] [LOCAL ] UP: Primary data saved (43707 records). [2025-10-08T22:08:33.577262] [INFO ] [MAIN ] UP: Full history saved. [2025-10-08T22:08:33.577358] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UP took 42.5s. Estimated remaining: 24m 53s. Rate: 7.1 symbols/min [2025-10-08T22:08:33.622819] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-10-08T22:08:33.757797] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:08:33.805854] [DEBUG] [LOCAL ] USFD: Loaded 51191 existing records from primary storage. [2025-10-08T22:08:33.806210] [INFO ] [MAIN ] USFD: Loaded 51191 existing records. [2025-10-08T22:08:33.990482] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:08:33.990790] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-08T22:08:33.990967] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-08T22:08:33.991291] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-08T22:08:33.991373] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-08T22:08:34.154758] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-08T22:08:34.392377] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:08:34.417553] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-10-08T22:08:35.217608] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-08T22:08:35.478324] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T22:08:36.017499] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-08T22:08:36.108158] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T22:08:36.135399] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T22:08:36.817537] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-08T22:08:37.617622] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-08T22:08:37.713155] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T22:08:38.311325] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-08T22:08:38.417564] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-08T22:08:38.547739] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-08T22:08:39.217600] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-08T22:08:40.017580] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-08T22:08:40.181288] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-08T22:08:40.401915] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T22:08:40.817551] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-08T22:08:41.262229] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T22:08:41.617526] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-08T22:08:41.841096] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T22:08:42.417633] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-08T22:08:42.946258] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T22:08:43.217567] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-08T22:08:43.638758] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-08T22:08:44.017612] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-08T22:08:44.557124] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-08T22:08:44.817557] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-08T22:08:45.033734] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T22:08:45.617591] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-08T22:08:46.230051] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T22:08:46.417566] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-08T22:08:47.217547] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-08T22:08:47.591681] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-08T22:08:47.677864] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-08T22:08:48.017565] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-08T22:08:48.395583] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-08T22:08:48.817554] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-08T22:08:49.617510] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-08T22:08:49.799791] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T22:08:49.900463] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-08T22:08:50.417552] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-08T22:08:51.224277] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-08T22:08:51.227158] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-08T22:08:51.989730] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-08T22:08:52.017553] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-08T22:08:52.342937] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-08T22:08:52.790931] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T22:08:52.817497] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-08T22:08:53.617556] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-08T22:08:54.004252] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:08:54.417585] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-08T22:08:55.217534] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-08T22:08:55.409355] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T22:08:56.017609] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-08T22:08:56.286242] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-08T22:08:56.594679] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T22:08:56.817548] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-08T22:08:57.617553] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-08T22:08:57.882419] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-08T22:08:58.054173] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T22:08:58.057224] [INFO ] [REMOTE ] USA: Full fetch complete (52018 records). [2025-10-08T22:08:58.057303] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-08T22:08:58.422128] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-08T22:08:58.476685] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-08T22:08:58.476842] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-08T22:08:58.477921] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-08T22:08:58.478288] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-08T22:08:58.479818] [DEBUG] [LOCAL ] USA: Trimmed 52018 records to 36029 (keeping 200 days of data) [2025-10-08T22:08:58.602091] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T22:08:58.741245] [DEBUG] [LOCAL ] USA: Primary data saved (36029 records). [2025-10-08T22:08:58.741410] [INFO ] [MAIN ] USA: Full history saved. [2025-10-08T22:08:58.742509] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USA took 32.9s. Estimated remaining: 24m 46s. Rate: 7.1 symbols/min [2025-10-08T22:08:58.947189] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:08:58.983188] [DEBUG] [LOCAL ] USNA: Loaded 17715 existing records from primary storage. [2025-10-08T22:08:58.983493] [INFO ] [MAIN ] USNA: Loaded 17715 existing records. [2025-10-08T22:08:59.195285] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:08:59.195562] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-08T22:08:59.195624] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-08T22:08:59.195912] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-08T22:08:59.195984] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-08T22:08:59.223732] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-08T22:08:59.728440] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:00.017521] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-10-08T22:09:00.164760] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T22:09:00.168187] [INFO ] [REMOTE ] USAC: Full fetch complete (35239 records). [2025-10-08T22:09:00.168269] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-08T22:09:00.556513] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-08T22:09:00.556746] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-08T22:09:00.557565] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-08T22:09:00.567884] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-08T22:09:00.586962] [DEBUG] [LOCAL ] USAC: Trimmed 35239 records to 21606 (keeping 200 days of data) [2025-10-08T22:09:00.588229] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-08T22:09:00.739283] [DEBUG] [LOCAL ] USAC: Primary data saved (21606 records). [2025-10-08T22:09:00.739413] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-08T22:09:00.739496] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USAC took 34.4s. Estimated remaining: 24m 37s. Rate: 7.1 symbols/min [2025-10-08T22:09:00.820256] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-08T22:09:00.920858] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T22:09:00.923967] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:00.943360] [DEBUG] [LOCAL ] USPH: Loaded 17004 existing records from primary storage. [2025-10-08T22:09:00.943604] [INFO ] [MAIN ] USPH: Loaded 17004 existing records. [2025-10-08T22:09:01.120284] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:01.120523] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-08T22:09:01.120567] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-08T22:09:01.120802] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-08T22:09:01.120859] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-08T22:09:01.522605] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:01.617545] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-08T22:09:02.417521] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-10-08T22:09:02.586929] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T22:09:02.643636] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-08T22:09:03.197605] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-08T22:09:03.217497] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-08T22:09:04.017543] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-08T22:09:04.041327] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T22:09:04.817533] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-08T22:09:05.086341] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-08T22:09:05.457320] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T22:09:05.617748] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-08T22:09:06.417515] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-08T22:09:06.513504] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-08T22:09:07.217559] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-08T22:09:08.017540] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-08T22:09:08.143841] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-08T22:09:08.180460] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-08T22:09:08.817548] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-08T22:09:09.617506] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-08T22:09:09.810009] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T22:09:10.015554] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-08T22:09:10.164346] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T22:09:10.168402] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-10-08T22:09:10.168545] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-08T22:09:10.424633] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-08T22:09:10.612949] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-08T22:09:10.613055] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-08T22:09:10.614380] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-08T22:09:10.614445] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-08T22:09:10.615872] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 53688 (keeping 200 days of data) [2025-10-08T22:09:10.953366] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-08T22:09:10.953505] [INFO ] [MAIN ] USB: Full history saved. [2025-10-08T22:09:10.953589] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 42.6s. Estimated remaining: 24m 29s. Rate: 7.1 symbols/min [2025-10-08T22:09:11.217517] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-08T22:09:11.495384] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T22:09:12.017558] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-08T22:09:12.203117] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-08T22:09:12.803756] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-08T22:09:12.817487] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-08T22:09:13.617544] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-08T22:09:13.636859] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-08T22:09:14.417555] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-08T22:09:14.962861] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T22:09:14.966957] [INFO ] [REMOTE ] USFD: Full fetch complete (74012 records). [2025-10-08T22:09:14.967086] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-08T22:09:15.222570] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-08T22:09:15.398699] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-08T22:09:15.398800] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-08T22:09:15.399919] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-08T22:09:15.399985] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-08T22:09:15.401915] [DEBUG] [LOCAL ] USFD: Trimmed 74012 records to 51161 (keeping 200 days of data) [2025-10-08T22:09:15.506732] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T22:09:15.741567] [DEBUG] [LOCAL ] USFD: Primary data saved (51161 records). [2025-10-08T22:09:15.741773] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-08T22:09:15.741907] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USFD took 42.2s. Estimated remaining: 24m 20s. Rate: 7.1 symbols/min [2025-10-08T22:09:16.017577] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-08T22:09:16.044164] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T22:09:16.817606] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-08T22:09:17.132985] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T22:09:17.617525] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-08T22:09:17.687315] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-08T22:09:18.417736] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-08T22:09:18.688029] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-08T22:09:19.174533] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T22:09:19.217538] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-08T22:09:20.017635] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-08T22:09:20.035774] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T22:09:20.037433] [INFO ] [REMOTE ] USNA: Full fetch complete (26577 records). [2025-10-08T22:09:20.037631] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-08T22:09:20.401763] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-08T22:09:20.401842] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-08T22:09:20.402289] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-08T22:09:20.402328] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-08T22:09:20.402982] [DEBUG] [LOCAL ] USNA: Trimmed 26577 records to 17668 (keeping 200 days of data) [2025-10-08T22:09:20.518413] [DEBUG] [LOCAL ] USNA: Primary data saved (17668 records). [2025-10-08T22:09:20.518624] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-08T22:09:20.518771] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USNA took 21.8s. Estimated remaining: 24m 11s. Rate: 7.1 symbols/min [2025-10-08T22:09:21.001105] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-08T22:09:21.005154] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-08T22:09:21.792992] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-08T22:09:21.795007] [INFO ] [REMOTE ] USPH: Full fetch complete (22939 records). [2025-10-08T22:09:21.795169] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-08T22:09:22.154477] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-08T22:09:22.154578] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-08T22:09:22.155215] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-08T22:09:22.155278] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-08T22:09:22.156327] [DEBUG] [LOCAL ] USPH: Trimmed 22939 records to 17025 (keeping 200 days of data) [2025-10-08T22:09:22.262023] [DEBUG] [LOCAL ] USPH: Primary data saved (17025 records). [2025-10-08T22:09:22.262168] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-08T22:09:22.262264] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. USPH took 21.5s. Estimated remaining: 24m 2s. Rate: 7.1 symbols/min [2025-10-08T22:09:23.039138] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:23.040380] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:23.044154] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:23.066944] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:23.088830] [DEBUG] [LOCAL ] UTL: Loaded 11505 existing records from primary storage. [2025-10-08T22:09:23.089147] [INFO ] [MAIN ] UTL: Loaded 11505 existing records. [2025-10-08T22:09:23.292229] [DEBUG] [LOCAL ] UTF: Loaded 29954 existing records from primary storage. [2025-10-08T22:09:23.353743] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:23.347069] [INFO ] [MAIN ] UTF: Loaded 29954 existing records. [2025-10-08T22:09:23.354122] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-08T22:09:23.365471] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-08T22:09:23.368132] [DEBUG] [LOCAL ] UTI: Loaded 40611 existing records from primary storage. [2025-10-08T22:09:23.387200] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-08T22:09:23.387354] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-08T22:09:23.387128] [INFO ] [MAIN ] UTI: Loaded 40611 existing records. [2025-10-08T22:09:23.367250] [DEBUG] [LOCAL ] UTZ: Loaded 44644 existing records from primary storage. [2025-10-08T22:09:23.537638] [INFO ] [MAIN ] UTZ: Loaded 44644 existing records. [2025-10-08T22:09:24.005846] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:24.038491] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-08T22:09:24.070054] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-08T22:09:24.135881] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-08T22:09:24.137639] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-08T22:09:24.159841] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:24.341747] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-08T22:09:24.392273] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:24.397702] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-08T22:09:24.451276] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-10-08T22:09:24.460758] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:24.473259] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-08T22:09:24.462454] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-08T22:09:24.494323] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-08T22:09:24.506442] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-08T22:09:24.517505] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-08T22:09:24.527184] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-08T22:09:25.053482] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:25.133317] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-10-08T22:09:25.481021] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:25.482335] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-08T22:09:25.485666] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-08T22:09:25.481969] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-10-08T22:09:25.577358] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:25.577787] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-10-08T22:09:26.239302] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-08T22:09:26.245359] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-08T22:09:26.328570] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-08T22:09:26.417712] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-08T22:09:26.653245] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T22:09:26.723595] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T22:09:27.206000] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T22:09:27.217502] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-08T22:09:27.495717] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T22:09:28.017533] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-08T22:09:28.452478] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T22:09:28.817560] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-08T22:09:29.535300] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-08T22:09:29.617515] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-08T22:09:29.717238] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-08T22:09:30.417572] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-08T22:09:30.977384] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T22:09:31.217564] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-08T22:09:31.770287] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-08T22:09:32.017562] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-08T22:09:32.477034] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T22:09:32.817543] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-08T22:09:33.294873] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T22:09:33.617552] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-08T22:09:33.996835] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T22:09:34.417588] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-08T22:09:35.087335] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-08T22:09:35.217549] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-08T22:09:35.634942] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T22:09:36.017592] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-08T22:09:36.182892] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T22:09:36.817606] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-08T22:09:37.591192] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T22:09:37.621092] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-08T22:09:37.619531] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-08T22:09:38.389438] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-08T22:09:38.417608] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-08T22:09:39.059213] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T22:09:39.217558] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-08T22:09:40.017631] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-08T22:09:40.439453] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-08T22:09:40.817556] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-08T22:09:41.545055] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T22:09:41.617515] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-08T22:09:41.697623] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-08T22:09:42.417562] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-08T22:09:43.174801] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T22:09:43.217523] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-08T22:09:43.243847] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-08T22:09:44.017591] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-08T22:09:44.670405] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T22:09:44.817542] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-08T22:09:45.250327] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T22:09:45.617602] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-08T22:09:46.403054] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T22:09:46.417518] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-08T22:09:46.860853] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-08T22:09:47.217553] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-08T22:09:47.989588] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T22:09:48.017500] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-08T22:09:48.824979] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-08T22:09:48.850038] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:09:49.175007] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T22:09:49.617593] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-08T22:09:50.417578] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-08T22:09:50.444281] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-08T22:09:50.448676] [INFO ] [REMOTE ] UTF: Full fetch complete (42582 records). [2025-10-08T22:09:50.448822] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-08T22:09:50.566709] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T22:09:50.847961] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-08T22:09:50.848065] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-08T22:09:50.848925] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-08T22:09:50.848988] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-08T22:09:50.850036] [DEBUG] [LOCAL ] UTF: Trimmed 42582 records to 30148 (keeping 200 days of data) [2025-10-08T22:09:51.039413] [DEBUG] [LOCAL ] UTF: Primary data saved (30148 records). [2025-10-08T22:09:51.039567] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-08T22:09:51.039690] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTF took 28.8s. Estimated remaining: 23m 56s. Rate: 7.1 symbols/min [2025-10-08T22:09:51.209934] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:51.222388] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-08T22:09:51.233066] [DEBUG] [LOCAL ] UVE: Loaded 21933 existing records from primary storage. [2025-10-08T22:09:51.233329] [INFO ] [MAIN ] UVE: Loaded 21933 existing records. [2025-10-08T22:09:51.432312] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:51.432819] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-08T22:09:51.432882] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-08T22:09:51.433238] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-08T22:09:51.433301] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-08T22:09:51.972215] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T22:09:51.999987] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:52.017626] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-10-08T22:09:52.394919] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T22:09:52.398401] [INFO ] [REMOTE ] UTI: Full fetch complete (58465 records). [2025-10-08T22:09:52.398546] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-08T22:09:52.818634] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-08T22:09:52.818425] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-08T22:09:52.819521] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-08T22:09:52.820594] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-08T22:09:52.820794] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-08T22:09:52.822067] [DEBUG] [LOCAL ] UTI: Trimmed 58465 records to 40585 (keeping 200 days of data) [2025-10-08T22:09:53.056019] [DEBUG] [LOCAL ] UTI: Primary data saved (40585 records). [2025-10-08T22:09:53.056129] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-08T22:09:53.056212] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 30.8s. Estimated remaining: 23m 47s. Rate: 7.1 symbols/min [2025-10-08T22:09:53.136832] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-08T22:09:53.241534] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:09:53.262628] [DEBUG] [LOCAL ] UVV: Loaded 22653 existing records from primary storage. [2025-10-08T22:09:53.262903] [INFO ] [MAIN ] UVV: Loaded 22653 existing records. [2025-10-08T22:09:53.438815] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:09:53.439178] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-08T22:09:53.439225] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-08T22:09:53.439472] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-08T22:09:53.439530] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-08T22:09:53.622719] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-08T22:09:53.740328] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T22:09:53.810218] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:09:54.417530] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-10-08T22:09:54.471062] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T22:09:55.217532] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-08T22:09:55.437699] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-08T22:09:56.017510] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-08T22:09:56.410950] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:09:56.817533] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-08T22:09:56.992534] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T22:09:57.617557] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-08T22:09:57.804477] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T22:09:58.417561] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-08T22:09:58.800867] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T22:09:59.217554] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-08T22:09:59.797848] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-08T22:10:00.017530] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-08T22:10:00.316380] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-08T22:10:00.585180] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:10:00.587519] [INFO ] [REMOTE ] UTL: Full fetch complete (15613 records). [2025-10-08T22:10:00.587638] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-08T22:10:00.822966] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-08T22:10:00.957522] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-08T22:10:00.957605] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-08T22:10:00.957997] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-08T22:10:00.958058] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-08T22:10:00.958675] [DEBUG] [LOCAL ] UTL: Trimmed 15613 records to 11598 (keeping 200 days of data) [2025-10-08T22:10:01.038772] [DEBUG] [LOCAL ] UTL: Primary data saved (11598 records). [2025-10-08T22:10:01.038921] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-08T22:10:01.039029] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTL took 38.8s. Estimated remaining: 23m 38s. Rate: 7.1 symbols/min [2025-10-08T22:10:01.245141] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:01.311346] [DEBUG] [LOCAL ] UWMC: Loaded 52849 existing records from primary storage. [2025-10-08T22:10:01.311856] [INFO ] [MAIN ] UWMC: Loaded 52849 existing records. [2025-10-08T22:10:01.491302] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:01.491527] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-08T22:10:01.491574] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-08T22:10:01.491858] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-08T22:10:01.491916] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-08T22:10:01.622708] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-08T22:10:01.858830] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:02.417536] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-10-08T22:10:02.533530] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-08T22:10:02.537534] [INFO ] [REMOTE ] UTZ: Full fetch complete (64464 records). [2025-10-08T22:10:02.537738] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-08T22:10:02.815202] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T22:10:02.946328] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-08T22:10:02.946441] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-08T22:10:02.947475] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-08T22:10:02.947539] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-08T22:10:02.948980] [DEBUG] [LOCAL ] UTZ: Trimmed 64464 records to 44598 (keeping 200 days of data) [2025-10-08T22:10:03.223686] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-08T22:10:03.239154] [DEBUG] [LOCAL ] UTZ: Primary data saved (44598 records). [2025-10-08T22:10:03.239294] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-08T22:10:03.239394] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UTZ took 41.0s. Estimated remaining: 23m 29s. Rate: 7.1 symbols/min [2025-10-08T22:10:03.411467] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:03.420373] [DEBUG] [LOCAL ] UZD: Loaded 6429 existing records from primary storage. [2025-10-08T22:10:03.420577] [INFO ] [MAIN ] UZD: Loaded 6429 existing records. [2025-10-08T22:10:03.593997] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:03.594223] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-08T22:10:03.594271] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-08T22:10:03.594454] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-08T22:10:03.594512] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-08T22:10:03.944916] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:04.017553] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-08T22:10:04.142538] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T22:10:04.346015] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T22:10:04.817542] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-08T22:10:05.124888] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-08T22:10:05.617523] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-08T22:10:05.963821] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-08T22:10:06.417566] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-10-08T22:10:06.557103] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-08T22:10:06.852854] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-08T22:10:07.217595] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-08T22:10:08.017569] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-08T22:10:08.817560] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-08T22:10:09.005054] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-08T22:10:09.062740] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T22:10:09.617608] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-08T22:10:09.722549] [DEBUG] [REMOTE ] UVE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-08T22:10:09.723079] [WARN ] [REMOTE ] UVE: No data returned for month 2025-07 [2025-10-08T22:10:09.723186] [FATAL] [REMOTE ] UVE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:10:09.723299] [FATAL] [MAIN ] UVE: Failed to fetch primary data. [2025-10-08T22:10:09.723367] [WARN ] [MAIN ] UVE: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:10:09.723424] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-08T22:10:09.723494] [DEBUG] [LOCAL ] UVE: No primary data file found to delete. [2025-10-08T22:10:09.723532] [INFO ] [LOCAL ] UVE: Starting deletion of derivative data. [2025-10-08T22:10:09.724004] [DEBUG] [LOCAL ] UVE: Deleted derivative data file. [2025-10-08T22:10:09.724268] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UVE took 18.7s. Estimated remaining: 23m 21s. Rate: 7.1 symbols/min [2025-10-08T22:10:09.868300] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T22:10:09.924540] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:09.934699] [DEBUG] [LOCAL ] UZE: Loaded 7430 existing records from primary storage. [2025-10-08T22:10:09.934960] [INFO ] [MAIN ] UZE: Loaded 7430 existing records. [2025-10-08T22:10:10.112857] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:10.113090] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-08T22:10:10.113161] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-08T22:10:10.113335] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-08T22:10:10.113391] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-08T22:10:10.425674] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-08T22:10:10.468445] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:11.217514] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-08T22:10:12.017606] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-08T22:10:12.126820] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T22:10:12.200138] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T22:10:12.801061] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T22:10:12.817502] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-08T22:10:13.438566] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T22:10:13.617526] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-08T22:10:14.417527] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-10-08T22:10:14.823077] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T22:10:14.998949] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-08T22:10:15.217570] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-08T22:10:16.017571] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-08T22:10:16.244108] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T22:10:16.589666] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-08T22:10:16.817588] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-08T22:10:17.567701] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-08T22:10:17.617524] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-08T22:10:18.183988] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-08T22:10:18.417499] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-08T22:10:19.003955] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T22:10:19.217567] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-08T22:10:20.017531] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-08T22:10:20.817946] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-08T22:10:20.818281] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-08T22:10:21.004302] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T22:10:21.617505] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-08T22:10:21.671593] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-08T22:10:22.298988] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-08T22:10:22.417538] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-08T22:10:23.217516] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-08T22:10:23.335041] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-08T22:10:23.337009] [INFO ] [REMOTE ] UVV: Full fetch complete (30109 records). [2025-10-08T22:10:23.337130] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-08T22:10:23.714907] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-08T22:10:23.714987] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-08T22:10:23.715712] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-08T22:10:23.715775] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-08T22:10:23.716514] [DEBUG] [LOCAL ] UVV: Trimmed 30109 records to 22680 (keeping 200 days of data) [2025-10-08T22:10:23.853403] [DEBUG] [LOCAL ] UVV: Primary data saved (22680 records). [2025-10-08T22:10:23.853539] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-08T22:10:23.853620] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 30.8s. Estimated remaining: 23m 13s. Rate: 7.1 symbols/min [2025-10-08T22:10:24.022511] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-08T22:10:24.024222] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:24.035204] [DEBUG] [LOCAL ] UZF: Loaded 6344 existing records from primary storage. [2025-10-08T22:10:24.035433] [INFO ] [MAIN ] UZF: Loaded 6344 existing records. [2025-10-08T22:10:24.220947] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:24.221203] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-08T22:10:24.221251] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-08T22:10:24.221418] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-10-08T22:10:24.221475] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-08T22:10:24.582484] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:24.683333] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-08T22:10:24.817537] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-08T22:10:24.933498] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T22:10:25.458339] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-08T22:10:25.617584] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-08T22:10:26.417580] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-08T22:10:27.067990] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-08T22:10:27.217514] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-08T22:10:27.434047] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T22:10:27.518074] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-08T22:10:28.017558] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-08T22:10:28.817517] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-08T22:10:28.834223] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-08T22:10:29.460239] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T22:10:29.617563] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-10-08T22:10:30.315915] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T22:10:30.417604] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-08T22:10:31.025594] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T22:10:31.217699] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-08T22:10:31.821606] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T22:10:32.017588] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-08T22:10:32.449106] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-08T22:10:32.817581] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-08T22:10:33.617619] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-08T22:10:33.744053] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-08T22:10:34.417620] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-08T22:10:35.022299] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-08T22:10:35.217499] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-08T22:10:35.323522] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-08T22:10:35.576554] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-08T22:10:35.577499] [INFO ] [REMOTE ] UZE: Full fetch complete (10054 records). [2025-10-08T22:10:35.577568] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-08T22:10:35.930183] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-08T22:10:35.930257] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-08T22:10:35.930458] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-08T22:10:35.930496] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-08T22:10:35.930941] [DEBUG] [LOCAL ] UZE: Trimmed 10054 records to 7448 (keeping 200 days of data) [2025-10-08T22:10:35.976463] [DEBUG] [LOCAL ] UZE: Primary data saved (7448 records). [2025-10-08T22:10:35.976566] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-08T22:10:35.976668] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZE took 26.3s. Estimated remaining: 23m 5s. Rate: 7.1 symbols/min [2025-10-08T22:10:36.022788] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-08T22:10:36.147566] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:36.197880] [DEBUG] [LOCAL ] V: Loaded 53752 existing records from primary storage. [2025-10-08T22:10:36.198206] [INFO ] [MAIN ] V: Loaded 53752 existing records. [2025-10-08T22:10:36.373617] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:36.373858] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-08T22:10:36.373905] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-08T22:10:36.374137] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-08T22:10:36.374194] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-08T22:10:36.724485] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:36.730147] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-08T22:10:36.817526] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-10-08T22:10:37.617571] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-08T22:10:38.417554] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-08T22:10:38.826927] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-08T22:10:39.038940] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-08T22:10:39.085440] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T22:10:39.217593] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-08T22:10:40.017561] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-08T22:10:40.817580] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-08T22:10:41.091603] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-08T22:10:41.334332] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T22:10:41.617732] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-08T22:10:42.005935] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-08T22:10:42.039514] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-08T22:10:42.040693] [INFO ] [REMOTE ] UZD: Full fetch complete (9360 records). [2025-10-08T22:10:42.040770] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-08T22:10:42.412172] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-08T22:10:42.412254] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-08T22:10:42.412540] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-08T22:10:42.412600] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-08T22:10:42.413057] [DEBUG] [LOCAL ] UZD: Trimmed 9360 records to 6412 (keeping 200 days of data) [2025-10-08T22:10:42.434326] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-08T22:10:42.458135] [DEBUG] [LOCAL ] UZD: Primary data saved (6412 records). [2025-10-08T22:10:42.458263] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-08T22:10:42.458368] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZD took 39.2s. Estimated remaining: 22m 56s. Rate: 7.1 symbols/min [2025-10-08T22:10:42.627069] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:42.665125] [DEBUG] [LOCAL ] VAC: Loaded 34356 existing records from primary storage. [2025-10-08T22:10:42.665454] [INFO ] [MAIN ] VAC: Loaded 34356 existing records. [2025-10-08T22:10:42.856189] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:42.856488] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-08T22:10:42.856540] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-08T22:10:42.857146] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-08T22:10:42.857208] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-08T22:10:43.219281] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:43.219413] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-08T22:10:44.017531] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-08T22:10:44.392311] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T22:10:44.682507] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-08T22:10:44.817619] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-08T22:10:45.016373] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T22:10:45.617555] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-08T22:10:46.417574] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-10-08T22:10:46.937514] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-08T22:10:46.957514] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-08T22:10:46.962354] [INFO ] [REMOTE ] UWMC: Full fetch complete (75662 records). [2025-10-08T22:10:46.962484] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-08T22:10:47.228127] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-08T22:10:47.370098] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-08T22:10:47.375414] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-08T22:10:47.376570] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-08T22:10:47.376705] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-08T22:10:47.386117] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T22:10:47.392129] [DEBUG] [LOCAL ] UWMC: Trimmed 75662 records to 52853 (keeping 200 days of data) [2025-10-08T22:10:47.718332] [DEBUG] [LOCAL ] UWMC: Primary data saved (52853 records). [2025-10-08T22:10:47.718468] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-08T22:10:47.719837] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 46.7s. Estimated remaining: 22m 47s. Rate: 7.1 symbols/min [2025-10-08T22:10:47.897604] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:47.902359] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-08T22:10:47.951113] [DEBUG] [LOCAL ] VAL: Loaded 50229 existing records from primary storage. [2025-10-08T22:10:47.951461] [INFO ] [MAIN ] VAL: Loaded 50229 existing records. [2025-10-08T22:10:48.022731] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-08T22:10:48.140448] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:48.140706] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-08T22:10:48.140764] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-08T22:10:48.140994] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-08T22:10:48.141052] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-08T22:10:48.424491] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-08T22:10:48.503990] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:48.817616] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-08T22:10:49.617588] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-08T22:10:49.787476] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T22:10:50.365082] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-08T22:10:50.417559] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-08T22:10:51] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-08T22:10:51.217597] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-08T22:10:51.624342] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-08T22:10:51.625332] [INFO ] [REMOTE ] UZF: Full fetch complete (8809 records). [2025-10-08T22:10:51.625410] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-08T22:10:51.995052] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-10-08T22:10:51.995136] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-10-08T22:10:51.995442] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-10-08T22:10:51.995502] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-10-08T22:10:51.995974] [DEBUG] [LOCAL ] UZF: Trimmed 8809 records to 6338 (keeping 200 days of data) [2025-10-08T22:10:52.024868] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-10-08T22:10:52.037615] [DEBUG] [LOCAL ] UZF: Primary data saved (6338 records). [2025-10-08T22:10:52.037723] [INFO ] [MAIN ] UZF: Full history saved. [2025-10-08T22:10:52.037882] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. UZF took 28.2s. Estimated remaining: 22m 39s. Rate: 7.1 symbols/min [2025-10-08T22:10:52.209290] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:10:52.264461] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-08T22:10:52.264824] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-08T22:10:52.444987] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:10:52.445238] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-08T22:10:52.445285] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-08T22:10:52.445529] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-08T22:10:52.445586] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-08T22:10:52.805501] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:10:52.817499] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-10-08T22:10:53.617601] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-08T22:10:53.662262] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T22:10:54.417563] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-08T22:10:55.003428] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T22:10:55.025658] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-08T22:10:55.217544] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-08T22:10:55.898621] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:10:56.017528] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-08T22:10:56.817601] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-08T22:10:57.346170] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-08T22:10:57.617567] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-08T22:10:58.172885] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T22:10:58.396791] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-08T22:10:58.417496] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-08T22:10:59.217635] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-08T22:10:59.669600] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-08T22:11:00.017597] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-08T22:11:00.620558] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-08T22:11:00.817601] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-08T22:11:01.158229] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T22:11:01.617571] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-08T22:11:01.965629] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-08T22:11:02.417555] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-08T22:11:03.000297] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-08T22:11:03.079800] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T22:11:03.217559] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-08T22:11:04.008939] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T22:11:04.020692] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-08T22:11:04.817580] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-08T22:11:04.988421] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-08T22:11:05.617552] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-08T22:11:06.347219] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T22:11:06.419542] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-08T22:11:06.422906] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T22:11:07.217557] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-08T22:11:07.381464] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T22:11:07.692560] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T22:11:08.017609] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-08T22:11:08.817634] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-08T22:11:09.354593] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-08T22:11:09.617635] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-08T22:11:09.995781] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-08T22:11:10.417527] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-08T22:11:10.541298] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T22:11:11.217596] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-08T22:11:11.839544] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-08T22:11:11.943633] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T22:11:12.017563] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-08T22:11:12.817620] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-08T22:11:13.374372] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:11:13.378945] [INFO ] [REMOTE ] V: Full fetch complete (77819 records). [2025-10-08T22:11:13.379170] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-08T22:11:13.624594] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-08T22:11:13.837712] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-08T22:11:13.876690] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-08T22:11:13.876841] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-08T22:11:13.878347] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-08T22:11:13.887310] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-08T22:11:13.906537] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T22:11:13.914957] [DEBUG] [LOCAL ] V: Trimmed 77819 records to 53752 (keeping 200 days of data) [2025-10-08T22:11:14.255921] [DEBUG] [LOCAL ] V: Primary data saved (53752 records). [2025-10-08T22:11:14.256070] [INFO ] [MAIN ] V: Full history saved. [2025-10-08T22:11:14.256223] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. V took 38.3s. Estimated remaining: 22m 31s. Rate: 7.1 symbols/min [2025-10-08T22:11:14.422220] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-08T22:11:14.422120] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:14.430782] [DEBUG] [LOCAL ] VATE: Loaded 5256 existing records from primary storage. [2025-10-08T22:11:14.431024] [INFO ] [MAIN ] VATE: Loaded 5256 existing records. [2025-10-08T22:11:14.605119] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:14.605375] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-08T22:11:14.605424] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-08T22:11:14.605607] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-08T22:11:14.605701] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-08T22:11:14.953748] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:15.217541] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-10-08T22:11:15.415692] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-08T22:11:15.757809] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T22:11:15.881371] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-08T22:11:16.017606] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-08T22:11:16.817584] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-08T22:11:17.598611] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T22:11:17.617507] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-08T22:11:18.417547] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-08T22:11:18.806542] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-08T22:11:19.022756] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-08T22:11:19.028038] [INFO ] [REMOTE ] VAL: Full fetch complete (73174 records). [2025-10-08T22:11:19.028397] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-08T22:11:19.220842] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-08T22:11:19.338949] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-08T22:11:19.522553] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-08T22:11:19.522687] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-08T22:11:19.524257] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-08T22:11:19.524327] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-08T22:11:19.526011] [DEBUG] [LOCAL ] VAL: Trimmed 73174 records to 50235 (keeping 200 days of data) [2025-10-08T22:11:19.827886] [DEBUG] [LOCAL ] VAL: Primary data saved (50235 records). [2025-10-08T22:11:19.828058] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-08T22:11:19.828955] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VAL took 32.1s. Estimated remaining: 22m 22s. Rate: 7.1 symbols/min [2025-10-08T22:11:20.003350] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:20.014123] [DEBUG] [LOCAL ] VBF: Loaded 6876 existing records from primary storage. [2025-10-08T22:11:20.014376] [INFO ] [MAIN ] VBF: Loaded 6876 existing records. [2025-10-08T22:11:20.026766] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-08T22:11:20.216282] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:20.216592] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-08T22:11:20.216686] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-08T22:11:20.216896] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-08T22:11:20.216952] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-08T22:11:20.573701] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:20.595293] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T22:11:20.689881] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-08T22:11:20.817551] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-10-08T22:11:21.515127] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-08T22:11:21.617526] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-08T22:11:22.417572] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-08T22:11:22.840844] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-08T22:11:22.976936] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-08T22:11:23.217566] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-08T22:11:24.017695] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-08T22:11:24.443049] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T22:11:24.660639] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T22:11:24.817577] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-08T22:11:25.255454] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-08T22:11:25.617563] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-08T22:11:26.119540] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-08T22:11:26.417546] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-08T22:11:27.024126] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T22:11:27.217568] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-08T22:11:28.017691] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-08T22:11:28.308066] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-08T22:11:28.310801] [INFO ] [REMOTE ] VAC: Full fetch complete (48491 records). [2025-10-08T22:11:28.311013] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-08T22:11:28.708547] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-08T22:11:28.708731] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-08T22:11:28.717946] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-08T22:11:28.718052] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-08T22:11:28.718356] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-08T22:11:28.724193] [DEBUG] [LOCAL ] VAC: Trimmed 48491 records to 34252 (keeping 200 days of data) [2025-10-08T22:11:28.821820] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-08T22:11:28.947152] [DEBUG] [LOCAL ] VAC: Primary data saved (34252 records). [2025-10-08T22:11:28.947298] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-08T22:11:28.947396] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VAC took 46.5s. Estimated remaining: 22m 14s. Rate: 7.1 symbols/min [2025-10-08T22:11:29.112044] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:29.127573] [DEBUG] [LOCAL ] VCV: Loaded 13606 existing records from primary storage. [2025-10-08T22:11:29.127835] [INFO ] [MAIN ] VCV: Loaded 13606 existing records. [2025-10-08T22:11:29.301071] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:29.301291] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-08T22:11:29.301351] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-08T22:11:29.301553] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-08T22:11:29.301609] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-08T22:11:29.622393] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-08T22:11:29.663513] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:29.691697] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T22:11:30.106422] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-08T22:11:30.417523] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-08T22:11:30.893772] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-08T22:11:31.217613] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-08T22:11:32.017593] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-08T22:11:32.600040] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T22:11:32.817572] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-10-08T22:11:32.976251] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-08T22:11:33.563176] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-08T22:11:33.617544] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-08T22:11:34.417574] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-08T22:11:34.435256] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-08T22:11:35.217547] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-08T22:11:35.832191] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T22:11:36.017521] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-08T22:11:36.231382] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-08T22:11:36.235431] [INFO ] [REMOTE ] VALE: Full fetch complete (77763 records). [2025-10-08T22:11:36.235551] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-08T22:11:36.548630] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-08T22:11:36.635427] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-08T22:11:36.635518] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-08T22:11:36.636680] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-08T22:11:36.636752] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-08T22:11:36.638328] [DEBUG] [LOCAL ] VALE: Trimmed 77763 records to 53693 (keeping 200 days of data) [2025-10-08T22:11:36.824849] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-08T22:11:36.974526] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-08T22:11:36.974701] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-08T22:11:36.974798] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VALE took 44.9s. Estimated remaining: 22m 6s. Rate: 7.1 symbols/min [2025-10-08T22:11:37.140613] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:37.183339] [DEBUG] [LOCAL ] VEEV: Loaded 47173 existing records from primary storage. [2025-10-08T22:11:37.183685] [INFO ] [MAIN ] VEEV: Loaded 47173 existing records. [2025-10-08T22:11:37.364186] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:37.364434] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-08T22:11:37.364492] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-08T22:11:37.364860] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-08T22:11:37.364918] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-08T22:11:37.617709] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-08T22:11:37.720505] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T22:11:37.725081] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:38.316807] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-08T22:11:38.417534] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-08T22:11:38.954801] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-08T22:11:39.217574] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-08T22:11:39.667320] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T22:11:39.668484] [INFO ] [REMOTE ] VATE: Full fetch complete (10508 records). [2025-10-08T22:11:39.668557] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-08T22:11:40.023870] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-10-08T22:11:40.065531] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-08T22:11:40.065630] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-08T22:11:40.065974] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-08T22:11:40.066036] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-08T22:11:40.066480] [DEBUG] [LOCAL ] VATE: Trimmed 10508 records to 5259 (keeping 200 days of data) [2025-10-08T22:11:40.097218] [DEBUG] [LOCAL ] VATE: Primary data saved (5259 records). [2025-10-08T22:11:40.097320] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-08T22:11:40.097425] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VATE took 25.8s. Estimated remaining: 21m 57s. Rate: 7.1 symbols/min [2025-10-08T22:11:40.261189] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:40.276114] [DEBUG] [LOCAL ] VEL: Loaded 12530 existing records from primary storage. [2025-10-08T22:11:40.276348] [INFO ] [MAIN ] VEL: Loaded 12530 existing records. [2025-10-08T22:11:40.447803] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:40.448038] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-08T22:11:40.448085] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-08T22:11:40.448280] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-08T22:11:40.448337] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-08T22:11:40.796280] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:40.817498] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-10-08T22:11:41.617619] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-08T22:11:41.690262] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-08T22:11:41.714911] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-08T22:11:42.417527] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-08T22:11:42.426556] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-08T22:11:43.217561] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-08T22:11:43.993720] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T22:11:44.017541] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-08T22:11:44.046683] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-08T22:11:44.817519] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-08T22:11:44.863993] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-08T22:11:45.370003] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-08T22:11:45.617626] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-08T22:11:46.351161] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T22:11:46.417557] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-08T22:11:47.217596] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-08T22:11:47.380675] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-08T22:11:48.017547] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-08T22:11:48.625678] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-08T22:11:48.663905] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-08T22:11:48.817563] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-08T22:11:49.617584] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-08T22:11:49.811091] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-08T22:11:50.417631] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-08T22:11:51.217552] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-08T22:11:51.309375] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T22:11:51.432624] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T22:11:52.017539] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-08T22:11:52.259127] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-08T22:11:52.817620] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-08T22:11:52.948780] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-08T22:11:53.617546] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-08T22:11:53.754370] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-08T22:11:54.417519] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-08T22:11:54.577148] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-08T22:11:55.217531] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-08T22:11:55.281831] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-08T22:11:55.780216] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T22:11:56.017566] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-08T22:11:56.817535] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-08T22:11:57.094383] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-08T22:11:57.315826] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T22:11:57.317135] [INFO ] [REMOTE ] VBF: Full fetch complete (10602 records). [2025-10-08T22:11:57.317203] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-08T22:11:57.622797] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-08T22:11:57.700638] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-08T22:11:57.700754] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-08T22:11:57.701050] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-08T22:11:57.701093] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-08T22:11:57.701549] [DEBUG] [LOCAL ] VBF: Trimmed 10602 records to 6925 (keeping 200 days of data) [2025-10-08T22:11:57.745963] [DEBUG] [LOCAL ] VBF: Primary data saved (6925 records). [2025-10-08T22:11:57.746103] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-08T22:11:57.746201] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 37.9s. Estimated remaining: 21m 49s. Rate: 7.1 symbols/min [2025-10-08T22:11:57.913988] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:57.957766] [DEBUG] [LOCAL ] VET: Loaded 43950 existing records from primary storage. [2025-10-08T22:11:57.958114] [INFO ] [MAIN ] VET: Loaded 43950 existing records. [2025-10-08T22:11:58.138060] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:58.138508] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-08T22:11:58.138555] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-08T22:11:58.138861] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-08T22:11:58.138921] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-08T22:11:58.431170] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T22:11:58.427132] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-08T22:11:58.439562] [INFO ] [REMOTE ] VCV: Full fetch complete (18956 records). [2025-10-08T22:11:58.460469] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-08T22:11:58.583493] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:11:58.973599] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-08T22:11:58.973717] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-08T22:11:58.974233] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-08T22:11:58.974301] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-08T22:11:58.975071] [DEBUG] [LOCAL ] VCV: Trimmed 18956 records to 13580 (keeping 200 days of data) [2025-10-08T22:11:59.066105] [DEBUG] [LOCAL ] VCV: Primary data saved (13580 records). [2025-10-08T22:11:59.066268] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-08T22:11:59.066356] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VCV took 30.1s. Estimated remaining: 21m 40s. Rate: 7.1 symbols/min [2025-10-08T22:11:59.229608] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-08T22:11:59.232226] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:11:59.287069] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-08T22:11:59.287498] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-08T22:11:59.460550] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:11:59.460833] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-08T22:11:59.460881] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-08T22:11:59.461275] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-08T22:11:59.461333] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-08T22:11:59.824939] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:00.020598] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-10-08T22:12:00.024936] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T22:12:00.363488] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T22:12:00.817560] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-08T22:12:01.617550] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-10-08T22:12:01.641360] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-08T22:12:01.958240] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-08T22:12:02.417557] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-08T22:12:03.217548] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-08T22:12:03.377323] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-08T22:12:03.753099] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:12:03.754483] [INFO ] [REMOTE ] VEL: Full fetch complete (17217 records). [2025-10-08T22:12:03.754580] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-08T22:12:04.020299] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-08T22:12:04.158205] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-08T22:12:04.158398] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-08T22:12:04.159234] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-08T22:12:04.159400] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-08T22:12:04.160296] [DEBUG] [LOCAL ] VEL: Trimmed 17217 records to 12445 (keeping 200 days of data) [2025-10-08T22:12:04.259625] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T22:12:04.292506] [DEBUG] [LOCAL ] VEL: Primary data saved (12445 records). [2025-10-08T22:12:04.292697] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-08T22:12:04.292814] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 24.2s. Estimated remaining: 21m 31s. Rate: 7.1 symbols/min [2025-10-08T22:12:04.464581] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:04.464803] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-08T22:12:04.464845] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-08T22:12:04.464954] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-08T22:12:04.464995] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-08T22:12:04.465035] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-08T22:12:04.465067] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-08T22:12:04.814262] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:04.817494] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-10-08T22:12:05.031363] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:12:05.031709] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-10-08T22:12:05.031799] [FATAL] [REMOTE ] VG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:12:05.031852] [FATAL] [MAIN ] VG: Failed to fetch primary data. [2025-10-08T22:12:05.031934] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:12:05.032021] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-08T22:12:05.032108] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-08T22:12:05.032183] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-08T22:12:05.032276] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-08T22:12:05.032360] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VG took 0.7s. Estimated remaining: 21m 22s. Rate: 7.1 symbols/min [2025-10-08T22:12:05.201408] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:05.209216] [DEBUG] [LOCAL ] VGI: Loaded 5160 existing records from primary storage. [2025-10-08T22:12:05.209436] [INFO ] [MAIN ] VGI: Loaded 5160 existing records. [2025-10-08T22:12:05.384872] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:05.385121] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-08T22:12:05.385232] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-08T22:12:05.385460] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-08T22:12:05.385530] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-08T22:12:05.627541] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-08T22:12:05.765041] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:05.821499] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T22:12:06.417582] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-08T22:12:06.904960] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-08T22:12:07.217529] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-08T22:12:08.017718] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-10-08T22:12:08.223619] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T22:12:08.473170] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-08T22:12:08.817549] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-08T22:12:08.907688] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T22:12:09.534799] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T22:12:09.617530] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-08T22:12:10.201170] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T22:12:10.417550] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-08T22:12:11.003948] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-08T22:12:11.217579] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-08T22:12:12.017556] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-08T22:12:12.621385] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-08T22:12:12.654825] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-08T22:12:12.817618] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-08T22:12:13.617545] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-08T22:12:14.282426] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-08T22:12:14.417562] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-08T22:12:15.217550] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-08T22:12:15.553722] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-08T22:12:16.017571] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-08T22:12:16.168527] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T22:12:16.640732] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T22:12:16.817568] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-08T22:12:17.617577] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-08T22:12:17.948263] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T22:12:18.278763] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-08T22:12:18.417583] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-08T22:12:19.217535] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-08T22:12:19.317883] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T22:12:20.023862] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-08T22:12:20.043879] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T22:12:20.791559] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T22:12:20.817526] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-08T22:12:21.558732] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-08T22:12:21.563204] [INFO ] [REMOTE ] VEEV: Full fetch complete (68246 records). [2025-10-08T22:12:21.563408] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-08T22:12:21.629496] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-08T22:12:21.992195] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-08T22:12:21.992316] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-08T22:12:21.993808] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-08T22:12:21.993879] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-08T22:12:21.996069] [DEBUG] [LOCAL ] VEEV: Trimmed 68246 records to 47169 (keeping 200 days of data) [2025-10-08T22:12:22.327945] [DEBUG] [LOCAL ] VEEV: Primary data saved (47169 records). [2025-10-08T22:12:22.328216] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-08T22:12:22.328394] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VEEV took 45.4s. Estimated remaining: 21m 15s. Rate: 7.1 symbols/min [2025-10-08T22:12:22.427099] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-08T22:12:22.519751] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:22.541280] [DEBUG] [LOCAL ] VGM: Loaded 18411 existing records from primary storage. [2025-10-08T22:12:22.541706] [INFO ] [MAIN ] VGM: Loaded 18411 existing records. [2025-10-08T22:12:22.742264] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:22.743042] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-08T22:12:22.743210] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-08T22:12:22.743579] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-08T22:12:22.743726] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-08T22:12:22.977307] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T22:12:23.079359] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-08T22:12:23.199313] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:23.217541] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-08T22:12:23.357520] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-08T22:12:24.017619] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-10-08T22:12:24.817532] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-08T22:12:25.078705] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T22:12:25.179034] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-08T22:12:25.617626] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-08T22:12:26.153129] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T22:12:26.417701] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-08T22:12:27.217513] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-08T22:12:27.264794] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T22:12:27.284363] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-08T22:12:28.017591] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-08T22:12:28.547933] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T22:12:28.817566] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-08T22:12:29.527046] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T22:12:29.550710] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T22:12:29.617568] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-08T22:12:30.417564] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-08T22:12:30.974861] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T22:12:31.122955] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T22:12:31.127213] [INFO ] [REMOTE ] VFC: Full fetch complete (77590 records). [2025-10-08T22:12:31.127375] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-08T22:12:31.222732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-08T22:12:31.538942] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-08T22:12:31.539182] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-08T22:12:31.540456] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-08T22:12:31.540526] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-08T22:12:31.542183] [DEBUG] [LOCAL ] VFC: Trimmed 77590 records to 53607 (keeping 200 days of data) [2025-10-08T22:12:31.881864] [DEBUG] [LOCAL ] VFC: Primary data saved (53607 records). [2025-10-08T22:12:31.882013] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-08T22:12:31.882097] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 32.8s. Estimated remaining: 21m 6s. Rate: 7.1 symbols/min [2025-10-08T22:12:32.022761] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-08T22:12:32.056393] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:32.061906] [DEBUG] [LOCAL ] VHI: Loaded 2686 existing records from primary storage. [2025-10-08T22:12:32.062103] [INFO ] [MAIN ] VHI: Loaded 2686 existing records. [2025-10-08T22:12:32.247801] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T22:12:32.252248] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:32.252555] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-08T22:12:32.252681] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-08T22:12:32.256360] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-08T22:12:32.256424] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-08T22:12:32.626361] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:32.722366] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T22:12:32.817538] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-08T22:12:33.617578] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-08T22:12:33.653922] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-08T22:12:34.417625] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-08T22:12:35.043112] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T22:12:35.217603] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-08T22:12:35.436114] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-08T22:12:35.828502] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-08T22:12:36.017562] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-08T22:12:36.533498] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-08T22:12:36.817560] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-08T22:12:37.193973] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T22:12:37.194922] [INFO ] [REMOTE ] VGI: Full fetch complete (7640 records). [2025-10-08T22:12:37.194992] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-08T22:12:37.552249] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-08T22:12:37.552384] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-08T22:12:37.552627] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-08T22:12:37.553575] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-08T22:12:37.554164] [DEBUG] [LOCAL ] VGI: Trimmed 7640 records to 5188 (keeping 200 days of data) [2025-10-08T22:12:37.585254] [DEBUG] [LOCAL ] VGI: Primary data saved (5188 records). [2025-10-08T22:12:37.585401] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-08T22:12:37.585492] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VGI took 32.6s. Estimated remaining: 20m 58s. Rate: 7.1 symbols/min [2025-10-08T22:12:37.623740] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-10-08T22:12:37.793218] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:37.793440] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-08T22:12:37.793492] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-08T22:12:37.793698] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-08T22:12:37.793754] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-08T22:12:37.793826] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-08T22:12:37.793891] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-08T22:12:38.223798] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:38.344100] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T22:12:38.417519] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-08T22:12:39.217587] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-08T22:12:39.330254] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T22:12:39.848843] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-08T22:12:40.017538] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-08T22:12:40.817536] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-10-08T22:12:41.034170] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:12:41.034475] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-10-08T22:12:41.034564] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:12:41.034609] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-08T22:12:41.034670] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:12:41.034744] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-08T22:12:41.034822] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-08T22:12:41.034911] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-08T22:12:41.034979] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-08T22:12:41.035043] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VIA took 3.4s. Estimated remaining: 20m 49s. Rate: 7.1 symbols/min [2025-10-08T22:12:41.219417] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-08T22:12:41.221941] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:41.226373] [INFO ] [REMOTE ] VET: Full fetch complete (64645 records). [2025-10-08T22:12:41.226557] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-08T22:12:41.618542] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-08T22:12:41.655554] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-08T22:12:41.655721] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-08T22:12:41.656778] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-08T22:12:41.658630] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-10-08T22:12:41.660602] [INFO ] [MAIN ] VICI: Loaded 53649 existing records. [2025-10-08T22:12:41.660464] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-08T22:12:41.763748] [DEBUG] [LOCAL ] VET: Trimmed 64645 records to 44003 (keeping 200 days of data) [2025-10-08T22:12:41.930247] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:41.931058] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-08T22:12:41.931425] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-08T22:12:41.932835] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-08T22:12:41.933407] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-08T22:12:42.240123] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T22:12:42.351770] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:42.419672] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-08T22:12:42.520465] [DEBUG] [LOCAL ] VET: Primary data saved (44003 records). [2025-10-08T22:12:42.520630] [INFO ] [MAIN ] VET: Full history saved. [2025-10-08T22:12:42.521530] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VET took 44.8s. Estimated remaining: 20m 40s. Rate: 7.1 symbols/min [2025-10-08T22:12:42.694601] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:42.750616] [DEBUG] [LOCAL ] VIK: Loaded 52468 existing records from primary storage. [2025-10-08T22:12:42.751010] [INFO ] [MAIN ] VIK: Loaded 52468 existing records. [2025-10-08T22:12:42.935534] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:42.935873] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-08T22:12:42.935928] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-08T22:12:42.936193] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-08T22:12:42.936250] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-08T22:12:43.041423] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T22:12:43.225053] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-08T22:12:43.308589] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:43.772980] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-08T22:12:44.017608] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-10-08T22:12:44.817639] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-08T22:12:45.197981] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-08T22:12:45.617538] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-08T22:12:45.707967] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T22:12:46.182172] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-08T22:12:46.417623] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-08T22:12:47.217614] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-10-08T22:12:47.465034] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-08T22:12:48.017596] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-08T22:12:48.817597] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-08T22:12:48.877513] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T22:12:49.364868] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T22:12:49.404475] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T22:12:49.617595] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-08T22:12:50.101256] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-08T22:12:50.417571] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-08T22:12:51.217554] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-08T22:12:52.017543] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-08T22:12:52.076358] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-08T22:12:52.118784] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-08T22:12:52.434478] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-08T22:12:52.817575] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-08T22:12:53.617537] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-08T22:12:54.417567] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-08T22:12:54.780513] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-08T22:12:54.991329] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-08T22:12:55.088379] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-08T22:12:55.217550] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-08T22:12:56.017596] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-08T22:12:56.817514] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-08T22:12:56.930479] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T22:12:57.522981] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-08T22:12:57.617507] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-08T22:12:57.866528] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T22:12:57.868389] [INFO ] [REMOTE ] VGM: Full fetch complete (26096 records). [2025-10-08T22:12:57.868467] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-08T22:12:58.232162] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-08T22:12:58.232488] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-08T22:12:58.233301] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-08T22:12:58.233368] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-08T22:12:58.234278] [DEBUG] [LOCAL ] VGM: Trimmed 26096 records to 18526 (keeping 200 days of data) [2025-10-08T22:12:58.361305] [DEBUG] [LOCAL ] VGM: Primary data saved (18526 records). [2025-10-08T22:12:58.361462] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-08T22:12:58.361549] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 36.0s. Estimated remaining: 20m 32s. Rate: 7.1 symbols/min [2025-10-08T22:12:58.424744] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-08T22:12:58.568216] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:58.621046] [DEBUG] [LOCAL ] VIPS: Loaded 51250 existing records from primary storage. [2025-10-08T22:12:58.621450] [INFO ] [MAIN ] VIPS: Loaded 51250 existing records. [2025-10-08T22:12:58.798874] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:12:58.799110] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-08T22:12:58.799161] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-08T22:12:58.799601] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-08T22:12:58.799694] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-08T22:12:58.912583] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-08T22:12:58.924704] [INFO ] [REMOTE ] VHI: Full fetch complete (4420 records). [2025-10-08T22:12:58.935076] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-08T22:12:59.219710] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-08T22:12:59.364544] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:12:59.581730] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-08T22:12:59.581873] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-08T22:12:59.582062] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-08T22:12:59.582138] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-08T22:12:59.582885] [DEBUG] [LOCAL ] VHI: Trimmed 4420 records to 2718 (keeping 200 days of data) [2025-10-08T22:12:59.602339] [DEBUG] [LOCAL ] VHI: Primary data saved (2718 records). [2025-10-08T22:12:59.602434] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-08T22:12:59.602543] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 27.7s. Estimated remaining: 20m 23s. Rate: 7.1 symbols/min [2025-10-08T22:12:59.803762] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:12:59.833968] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-08T22:12:59.889187] [DEBUG] [LOCAL ] VIRT: Loaded 46744 existing records from primary storage. [2025-10-08T22:12:59.889611] [INFO ] [MAIN ] VIRT: Loaded 46744 existing records. [2025-10-08T22:13:00.022635] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-10-08T22:13:00.106635] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:00.106975] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-08T22:13:00.107048] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-08T22:13:00.107297] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-08T22:13:00.107365] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-08T22:13:00.543668] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:00.817542] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-08T22:13:01.002337] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T22:13:01.617606] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-08T22:13:01.835280] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T22:13:02.417530] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-10-08T22:13:02.855733] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-08T22:13:03.217544] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-08T22:13:03.279154] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T22:13:03.903971] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-08T22:13:04.017570] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-08T22:13:04.694170] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:13:04.817543] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-08T22:13:05.612594] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-08T22:13:05.622497] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-08T22:13:06.417541] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-08T22:13:06.697725] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-08T22:13:07.024629] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-08T22:13:07.217579] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-08T22:13:08.017510] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-08T22:13:08.152123] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:13:08.817608] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-08T22:13:08.963711] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T22:13:09.617511] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-08T22:13:09.789130] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-08T22:13:10.313663] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-08T22:13:10.417501] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-08T22:13:11.217553] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-08T22:13:11.671489] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-08T22:13:12.017590] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-08T22:13:12.192701] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T22:13:12.713777] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T22:13:12.817595] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-08T22:13:13.617522] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-08T22:13:13.831074] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:13:14.417694] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-08T22:13:14.498823] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-08T22:13:15.032813] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T22:13:15.036954] [INFO ] [REMOTE ] VIK: Full fetch complete (75908 records). [2025-10-08T22:13:15.037177] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-08T22:13:15.220494] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-08T22:13:15.434195] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-08T22:13:15.434280] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-08T22:13:15.435368] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-08T22:13:15.435433] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-08T22:13:15.436902] [DEBUG] [LOCAL ] VIK: Trimmed 75908 records to 52453 (keeping 200 days of data) [2025-10-08T22:13:15.751996] [DEBUG] [LOCAL ] VIK: Primary data saved (52453 records). [2025-10-08T22:13:15.752204] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-08T22:13:15.753305] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VIK took 33.2s. Estimated remaining: 20m 15s. Rate: 7.1 symbols/min [2025-10-08T22:13:15.931120] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:13:15.964484] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T22:13:16.017820] [DEBUG] [LOCAL ] VIST: Loaded 46125 existing records from primary storage. [2025-10-08T22:13:16.017622] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-08T22:13:16.018342] [INFO ] [MAIN ] VIST: Loaded 46125 existing records. [2025-10-08T22:13:16.208319] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:16.208540] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-08T22:13:16.208591] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-08T22:13:16.208985] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-08T22:13:16.209077] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-08T22:13:16.563862] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:16.817549] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-10-08T22:13:17.119965] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-08T22:13:17.617540] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-08T22:13:17.816537] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T22:13:18.008144] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T22:13:18.417564] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-08T22:13:19.098186] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T22:13:19.217501] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-08T22:13:20.027931] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-08T22:13:20.048310] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T22:13:20.452454] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T22:13:20.817623] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-08T22:13:21.374184] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:13:21.378531] [INFO ] [REMOTE ] VICI: Full fetch complete (77658 records). [2025-10-08T22:13:21.378760] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-08T22:13:21.631560] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-08T22:13:21.766233] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T22:13:21.825768] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-08T22:13:21.826127] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-08T22:13:21.827547] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-08T22:13:21.827614] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-08T22:13:21.829060] [DEBUG] [LOCAL ] VICI: Trimmed 77658 records to 53650 (keeping 200 days of data) [2025-10-08T22:13:22.162202] [DEBUG] [LOCAL ] VICI: Primary data saved (53650 records). [2025-10-08T22:13:22.162347] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-08T22:13:22.162467] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VICI took 41.1s. Estimated remaining: 20m 7s. Rate: 7.1 symbols/min [2025-10-08T22:13:22.329622] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:13:22.373121] [DEBUG] [LOCAL ] VIV: Loaded 44825 existing records from primary storage. [2025-10-08T22:13:22.373467] [INFO ] [MAIN ] VIV: Loaded 44825 existing records. [2025-10-08T22:13:22.427059] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-08T22:13:22.557912] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:22.558196] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-08T22:13:22.558283] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-08T22:13:22.558557] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-08T22:13:22.558630] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-08T22:13:22.913761] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:23.217557] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-10-08T22:13:23.391694] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T22:13:23.924749] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T22:13:24.017561] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-08T22:13:24.793271] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T22:13:24.817500] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-08T22:13:25.617531] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-08T22:13:25.656864] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T22:13:26.204619] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T22:13:26.417583] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-08T22:13:27.217560] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-08T22:13:27.366190] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T22:13:27.696212] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-08T22:13:28.017561] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-08T22:13:28.437575] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T22:13:28.817569] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-08T22:13:29.319216] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T22:13:29.617684] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-08T22:13:30.417541] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-08T22:13:30.580480] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T22:13:31.003117] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-08T22:13:31.217614] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-08T22:13:31.532967] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T22:13:31.538686] [INFO ] [REMOTE ] VIRT: Full fetch complete (67269 records). [2025-10-08T22:13:31.538908] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-08T22:13:31.960214] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-08T22:13:31.960294] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-08T22:13:31.961314] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-08T22:13:31.961377] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-08T22:13:31.964067] [DEBUG] [LOCAL ] VIRT: Trimmed 67269 records to 46775 (keeping 200 days of data) [2025-10-08T22:13:32.022924] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-08T22:13:32.258588] [DEBUG] [LOCAL ] VIRT: Primary data saved (46775 records). [2025-10-08T22:13:32.258757] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-08T22:13:32.258863] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIRT took 32.7s. Estimated remaining: 19m 58s. Rate: 7.1 symbols/min [2025-10-08T22:13:32.431115] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:13:32.451944] [DEBUG] [LOCAL ] VKQ: Loaded 17408 existing records from primary storage. [2025-10-08T22:13:32.452221] [INFO ] [MAIN ] VKQ: Loaded 17408 existing records. [2025-10-08T22:13:32.627228] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:32.627436] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-08T22:13:32.627483] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-08T22:13:32.627751] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-08T22:13:32.627810] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-08T22:13:32.823909] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-08T22:13:32.986931] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:33.025167] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-08T22:13:33.617521] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-10-08T22:13:33.708462] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T22:13:34.152703] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-08T22:13:34.357684] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-08T22:13:34.417521] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-08T22:13:35.217700] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-08T22:13:36.001668] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T22:13:36.017496] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-08T22:13:36.469239] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T22:13:36.474166] [INFO ] [REMOTE ] VIPS: Full fetch complete (74558 records). [2025-10-08T22:13:36.474369] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-08T22:13:36.823228] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-08T22:13:36.909488] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-08T22:13:36.909595] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-08T22:13:36.910847] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-08T22:13:36.910915] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-08T22:13:36.912742] [DEBUG] [LOCAL ] VIPS: Trimmed 74558 records to 51234 (keeping 200 days of data) [2025-10-08T22:13:37.251249] [DEBUG] [LOCAL ] VIPS: Primary data saved (51234 records). [2025-10-08T22:13:37.251422] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-08T22:13:37.251533] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIPS took 38.9s. Estimated remaining: 19m 50s. Rate: 7.1 symbols/min [2025-10-08T22:13:37.505252] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:13:37.566911] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T22:13:37.597631] [DEBUG] [LOCAL ] VLN: Loaded 29562 existing records from primary storage. [2025-10-08T22:13:37.598024] [INFO ] [MAIN ] VLN: Loaded 29562 existing records. [2025-10-08T22:13:37.624630] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-08T22:13:37.911527] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:37.914259] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T22:13:37.913090] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-08T22:13:37.914555] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-08T22:13:37.920802] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-08T22:13:37.920988] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-08T22:13:38.350510] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:38.417513] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-10-08T22:13:39.217523] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-08T22:13:39.283868] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T22:13:40.025422] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-08T22:13:40.041509] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-08T22:13:40.037960] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T22:13:40.817561] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-08T22:13:41.621743] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-08T22:13:41.627175] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-08T22:13:42.042491] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T22:13:42.417526] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-08T22:13:43.102259] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-08T22:13:43.217583] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-08T22:13:43.541862] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-08T22:13:44.017562] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-08T22:13:44.771603] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T22:13:44.817574] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-08T22:13:45.425159] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-08T22:13:45.609952] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-08T22:13:45.617489] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-08T22:13:46.417605] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-08T22:13:46.963584] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:13:47.217535] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-08T22:13:47.415737] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T22:13:47.955053] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-08T22:13:48.017522] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-08T22:13:48.817515] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-08T22:13:49.155892] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T22:13:49.617548] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-08T22:13:50.417560] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-08T22:13:50.564310] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-08T22:13:50.613037] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-08T22:13:51.217545] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-08T22:13:51.565184] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T22:13:51.809771] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T22:13:52.017565] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-08T22:13:52.817546] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-08T22:13:53.508196] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-08T22:13:53.617568] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-08T22:13:53.719581] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T22:13:53.723356] [INFO ] [REMOTE ] VIV: Full fetch complete (64539 records). [2025-10-08T22:13:53.723496] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-08T22:13:54.126921] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-08T22:13:54.127035] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-08T22:13:54.128262] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-08T22:13:54.128333] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-08T22:13:54.129966] [DEBUG] [LOCAL ] VIV: Trimmed 64539 records to 44856 (keeping 200 days of data) [2025-10-08T22:13:54.368825] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T22:13:54.424217] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-08T22:13:54.444095] [DEBUG] [LOCAL ] VIV: Primary data saved (44856 records). [2025-10-08T22:13:54.444237] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-08T22:13:54.444367] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIV took 32.3s. Estimated remaining: 19m 42s. Rate: 7.1 symbols/min [2025-10-08T22:13:54.619326] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:13:54.673309] [DEBUG] [LOCAL ] VLO: Loaded 53084 existing records from primary storage. [2025-10-08T22:13:54.673709] [INFO ] [MAIN ] VLO: Loaded 53084 existing records. [2025-10-08T22:13:54.890573] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:13:54.890832] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-08T22:13:54.890889] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-08T22:13:54.891146] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-08T22:13:54.891203] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-08T22:13:55.220708] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-08T22:13:55.242658] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:13:55.257140] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T22:13:56.017551] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-10-08T22:13:56.817594] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-08T22:13:56.870678] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-08T22:13:57.617555] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-08T22:13:57.663447] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T22:13:57.731690] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T22:13:58.417560] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-08T22:13:59.217536] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-08T22:13:59.320727] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T22:14:00.017550] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-08T22:14:00.561336] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-08T22:14:00.724567] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-08T22:14:00.817537] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-08T22:14:01.229926] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T22:14:01.233557] [INFO ] [REMOTE ] VIST: Full fetch complete (66740 records). [2025-10-08T22:14:01.233721] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-08T22:14:01.628706] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-08T22:14:01.632412] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-08T22:14:01.633491] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-08T22:14:01.634685] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-08T22:14:01.634771] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-08T22:14:01.636350] [DEBUG] [LOCAL ] VIST: Trimmed 66740 records to 46177 (keeping 200 days of data) [2025-10-08T22:14:01.923771] [DEBUG] [LOCAL ] VIST: Primary data saved (46177 records). [2025-10-08T22:14:01.923939] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-08T22:14:01.924946] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 46.2s. Estimated remaining: 19m 33s. Rate: 7.1 symbols/min [2025-10-08T22:14:02.128765] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:02.153817] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-08T22:14:02.211484] [DEBUG] [LOCAL ] VLRS: Loaded 40224 existing records from primary storage. [2025-10-08T22:14:02.211899] [INFO ] [MAIN ] VLRS: Loaded 40224 existing records. [2025-10-08T22:14:02.394229] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:02.394481] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-08T22:14:02.394528] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-08T22:14:02.394848] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-08T22:14:02.394906] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-08T22:14:02.425768] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-08T22:14:02.768516] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:03.128451] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-08T22:14:03.217531] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-08T22:14:03.735438] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-08T22:14:03.738603] [INFO ] [REMOTE ] VLN: Full fetch complete (43124 records). [2025-10-08T22:14:03.738724] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-08T22:14:04.022955] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-10-08T22:14:04.149487] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-08T22:14:04.149592] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-08T22:14:04.150432] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-08T22:14:04.150493] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-08T22:14:04.151402] [DEBUG] [LOCAL ] VLN: Trimmed 43124 records to 29689 (keeping 200 days of data) [2025-10-08T22:14:04.317257] [DEBUG] [LOCAL ] VLN: Primary data saved (29689 records). [2025-10-08T22:14:04.317419] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-08T22:14:04.317552] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VLN took 27.1s. Estimated remaining: 19m 24s. Rate: 7.1 symbols/min [2025-10-08T22:14:04.487045] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:04.495115] [DEBUG] [LOCAL ] VLT: Loaded 4609 existing records from primary storage. [2025-10-08T22:14:04.495362] [INFO ] [MAIN ] VLT: Loaded 4609 existing records. [2025-10-08T22:14:04.676877] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:04.677267] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-08T22:14:04.677326] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-08T22:14:04.677575] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-08T22:14:04.677633] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-08T22:14:04.827601] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-08T22:14:05.047899] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:05.088302] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T22:14:05.617578] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-10-08T22:14:05.662161] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T22:14:06.049590] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-08T22:14:06.218872] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-08T22:14:06.417591] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-08T22:14:07.134665] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T22:14:07.136451] [INFO ] [REMOTE ] VKQ: Full fetch complete (24636 records). [2025-10-08T22:14:07.136522] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-08T22:14:07.222850] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-08T22:14:07.509182] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-08T22:14:07.509308] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-08T22:14:07.510146] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-08T22:14:07.510214] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-08T22:14:07.511394] [DEBUG] [LOCAL ] VKQ: Trimmed 24636 records to 17454 (keeping 200 days of data) [2025-10-08T22:14:07.630481] [DEBUG] [LOCAL ] VKQ: Primary data saved (17454 records). [2025-10-08T22:14:07.630736] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-08T22:14:07.630859] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VKQ took 35.4s. Estimated remaining: 19m 16s. Rate: 7.1 symbols/min [2025-10-08T22:14:07.807283] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:07.855533] [DEBUG] [LOCAL ] VLTO: Loaded 46108 existing records from primary storage. [2025-10-08T22:14:07.856012] [INFO ] [MAIN ] VLTO: Loaded 46108 existing records. [2025-10-08T22:14:08.019374] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-08T22:14:08.045228] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:08.046707] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-08T22:14:08.046772] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-08T22:14:08.047135] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-08T22:14:08.047198] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-08T22:14:08.420116] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:08.817559] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-08T22:14:09.294302] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T22:14:09.327757] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T22:14:09.388324] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-08T22:14:09.617616] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-08T22:14:10.417572] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-08T22:14:11.024375] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T22:14:11.105954] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-08T22:14:11.217537] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-08T22:14:12.017578] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-08T22:14:12.817524] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-08T22:14:12.945375] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T22:14:13.441872] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-08T22:14:13.492277] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T22:14:13.617494] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-08T22:14:14.417564] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-08T22:14:15.150698] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T22:14:15.217517] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-08T22:14:15.383529] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T22:14:15.567553] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-08T22:14:16.017560] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-08T22:14:16.600773] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-08T22:14:16.817588] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-10-08T22:14:17.617588] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-08T22:14:18.202992] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-08T22:14:18.428447] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-08T22:14:18.445929] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T22:14:19.049221] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T22:14:19.217600] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-08T22:14:20.017572] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-08T22:14:20.817700] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-08T22:14:20.945861] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:14:21.185925] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-08T22:14:21.617527] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-08T22:14:21.654181] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-08T22:14:22.417572] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-08T22:14:22.934196] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T22:14:23.217573] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-08T22:14:23.664608] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T22:14:23.665716] [INFO ] [REMOTE ] VLT: Full fetch complete (7513 records). [2025-10-08T22:14:23.665790] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-08T22:14:24.023512] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-08T22:14:24.144073] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-08T22:14:24.147140] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T22:14:24.147368] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-08T22:14:24.159759] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-08T22:14:24.159998] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-08T22:14:24.161283] [DEBUG] [LOCAL ] VLT: Trimmed 7513 records to 4527 (keeping 200 days of data) [2025-10-08T22:14:24.191270] [DEBUG] [LOCAL ] VLT: Primary data saved (4527 records). [2025-10-08T22:14:24.191433] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-08T22:14:24.191525] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLT took 19.9s. Estimated remaining: 19m 8s. Rate: 7.1 symbols/min [2025-10-08T22:14:24.381184] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:24.421823] [DEBUG] [LOCAL ] VMC: Loaded 43009 existing records from primary storage. [2025-10-08T22:14:24.422142] [INFO ] [MAIN ] VMC: Loaded 43009 existing records. [2025-10-08T22:14:24.599725] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:24.599938] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-08T22:14:24.599985] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-08T22:14:24.600219] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-08T22:14:24.600277] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-08T22:14:24.827027] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-08T22:14:24.964623] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:25.617518] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-08T22:14:25.697222] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-08T22:14:26.127135] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T22:14:26.417563] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-08T22:14:27.217553] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-10-08T22:14:27.257834] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-08T22:14:27.820821] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T22:14:28.017609] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-08T22:14:28.588933] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T22:14:28.817701] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-08T22:14:29.323935] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T22:14:29.617578] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-08T22:14:30.417611] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-08T22:14:30.478743] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T22:14:30.629176] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-08T22:14:31.217557] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-08T22:14:31.827226] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T22:14:32.017581] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-08T22:14:32.822945] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-08T22:14:32.839178] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T22:14:33.385770] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:14:33.389819] [INFO ] [REMOTE ] VLO: Full fetch complete (76901 records). [2025-10-08T22:14:33.389936] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-08T22:14:33.619435] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-08T22:14:33.790754] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-08T22:14:33.790972] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-08T22:14:33.792263] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-08T22:14:33.792360] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-08T22:14:33.824518] [DEBUG] [LOCAL ] VLO: Trimmed 76901 records to 53081 (keeping 200 days of data) [2025-10-08T22:14:33.831212] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T22:14:34.181089] [DEBUG] [LOCAL ] VLO: Primary data saved (53081 records). [2025-10-08T22:14:34.181246] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-08T22:14:34.181332] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLO took 39.7s. Estimated remaining: 18m 59s. Rate: 7.1 symbols/min [2025-10-08T22:14:34.356477] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:34.373207] [DEBUG] [LOCAL ] VMI: Loaded 15480 existing records from primary storage. [2025-10-08T22:14:34.373453] [INFO ] [MAIN ] VMI: Loaded 15480 existing records. [2025-10-08T22:14:34.427891] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-08T22:14:34.556029] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:34.556253] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-08T22:14:34.556301] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-08T22:14:34.556518] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-08T22:14:34.556577] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-08T22:14:34.682609] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T22:14:34.725600] [INFO ] [REMOTE ] VLRS: Full fetch complete (58442 records). [2025-10-08T22:14:34.781828] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-08T22:14:35.073821] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:35.222665] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-08T22:14:35.402458] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-08T22:14:35.402544] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-08T22:14:35.403622] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-08T22:14:35.403717] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-08T22:14:35.405107] [DEBUG] [LOCAL ] VLRS: Trimmed 58442 records to 40181 (keeping 200 days of data) [2025-10-08T22:14:35.657232] [DEBUG] [LOCAL ] VLRS: Primary data saved (40181 records). [2025-10-08T22:14:35.657364] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-08T22:14:35.658673] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLRS took 33.7s. Estimated remaining: 18m 50s. Rate: 7.1 symbols/min [2025-10-08T22:14:35.936420] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-08T22:14:36.017564] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-10-08T22:14:36.817524] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-08T22:14:36.968039] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T22:14:36.992234] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-08T22:14:37.617558] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-08T22:14:38.418311] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-08T22:14:38.424044] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-08T22:14:38.591202] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T22:14:39.217559] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-08T22:14:40.004239] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-08T22:14:40.017482] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-08T22:14:40.052558] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-08T22:14:40.817612] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-08T22:14:41.617545] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-08T22:14:41.659963] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T22:14:42.064213] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-08T22:14:42.413101] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-08T22:14:42.417483] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-08T22:14:43.217524] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-08T22:14:43.324037] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-08T22:14:44.017550] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-08T22:14:44.817597] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-08T22:14:44.976924] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-08T22:14:45.554726] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:14:45.580332] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-08T22:14:45.617572] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-08T22:14:46.355378] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-08T22:14:46.417604] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-08T22:14:47.217597] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-08T22:14:47.435939] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T22:14:48.017631] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-08T22:14:48.687495] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T22:14:48.817542] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-08T22:14:48.866278] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T22:14:49.617564] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-08T22:14:50.366568] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T22:14:50.417537] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-08T22:14:50.978278] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:14:50.982952] [INFO ] [REMOTE ] VLTO: Full fetch complete (66999 records). [2025-10-08T22:14:50.983114] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-08T22:14:51.227822] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-08T22:14:51.420470] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-08T22:14:51.454099] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-08T22:14:51.454390] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-08T22:14:51.456600] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-08T22:14:51.456795] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-08T22:14:51.459397] [DEBUG] [LOCAL ] VLTO: Trimmed 66999 records to 46089 (keeping 200 days of data) [2025-10-08T22:14:51.779598] [DEBUG] [LOCAL ] VLTO: Primary data saved (46089 records). [2025-10-08T22:14:51.780024] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-08T22:14:51.780137] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 44.1s. Estimated remaining: 18m 42s. Rate: 7.1 symbols/min [2025-10-08T22:14:52.017551] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-08T22:14:52.291000] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-08T22:14:52.817575] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-08T22:14:53.203049] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:14:53.319069] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-08T22:14:53.321574] [INFO ] [REMOTE ] VMI: Full fetch complete (21205 records). [2025-10-08T22:14:53.321787] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-08T22:14:53.626132] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-08T22:14:53.712492] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-08T22:14:53.712576] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-08T22:14:53.713089] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-08T22:14:53.713156] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-08T22:14:53.713886] [DEBUG] [LOCAL ] VMI: Trimmed 21205 records to 15305 (keeping 200 days of data) [2025-10-08T22:14:53.809862] [DEBUG] [LOCAL ] VMI: Primary data saved (15305 records). [2025-10-08T22:14:53.810000] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-08T22:14:53.810082] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMI took 19.6s. Estimated remaining: 18m 34s. Rate: 7.1 symbols/min [2025-10-08T22:14:55.109838] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T22:14:55.119043] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-08T22:14:55.594198] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T22:14:55.597465] [INFO ] [REMOTE ] VMC: Full fetch complete (62402 records). [2025-10-08T22:14:55.597602] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-08T22:14:56.038024] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-08T22:14:56.038111] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-08T22:14:56.039241] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-08T22:14:56.039308] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-08T22:14:56.040672] [DEBUG] [LOCAL ] VMC: Trimmed 62402 records to 42896 (keeping 200 days of data) [2025-10-08T22:14:56.306173] [DEBUG] [LOCAL ] VMC: Primary data saved (42896 records). [2025-10-08T22:14:56.306309] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-08T22:14:56.306391] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMC took 32.1s. Estimated remaining: 18m 25s. Rate: 7.1 symbols/min [2025-10-08T22:14:56.937923] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:56.976828] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:56.984284] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:57.055298] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:14:57.074022] [DEBUG] [LOCAL ] VMO: Loaded 20921 existing records from primary storage. [2025-10-08T22:14:57.074546] [INFO ] [MAIN ] VMO: Loaded 20921 existing records. [2025-10-08T22:14:57.108462] [DEBUG] [LOCAL ] VNCE: Loaded 8460 existing records from primary storage. [2025-10-08T22:14:57.120973] [INFO ] [MAIN ] VNCE: Loaded 8460 existing records. [2025-10-08T22:14:57.388517] [DEBUG] [LOCAL ] VNT: Loaded 43576 existing records from primary storage. [2025-10-08T22:14:57.425098] [INFO ] [MAIN ] VNT: Loaded 43576 existing records. [2025-10-08T22:14:57.455499] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:57.507970] [DEBUG] [LOCAL ] VNO: Loaded 48869 existing records from primary storage. [2025-10-08T22:14:57.556532] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-08T22:14:57.585452] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:57.601141] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-10-08T22:14:57.595343] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-08T22:14:57.621983] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-10-08T22:14:57.595603] [INFO ] [MAIN ] VNO: Loaded 48869 existing records. [2025-10-08T22:14:57.645185] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-10-08T22:14:57.677995] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-08T22:14:57.688973] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-08T22:14:57.645501] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-10-08T22:14:58.227085] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:58.223971] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:14:58.260874] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-08T22:14:58.271307] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-08T22:14:58.307935] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-08T22:14:58.356006] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-08T22:14:58.356121] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-08T22:14:58.393624] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-08T22:14:58.407138] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-08T22:14:58.506088] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-08T22:14:59.011365] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:59.067608] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-10-08T22:14:59.280279] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:59.415161] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-10-08T22:14:59.603980] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:59.627357] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-10-08T22:14:59.657167] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:14:59.657407] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-10-08T22:15:00.124068] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T22:15:00.129573] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-08T22:15:00.560348] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T22:15:00.565008] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-10-08T22:15:00.962393] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T22:15:00.967151] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-08T22:15:01.301707] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T22:15:01.309967] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-08T22:15:01.483143] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-08T22:15:01.570155] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-08T22:15:01.617610] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-08T22:15:01.878442] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-08T22:15:02.417545] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-08T22:15:02.620326] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T22:15:03.168567] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T22:15:03.217587] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-08T22:15:03.325020] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-08T22:15:04.017570] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-08T22:15:04.551020] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T22:15:04.817583] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-10-08T22:15:04.885056] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T22:15:05.617576] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-08T22:15:05.643351] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-08T22:15:06.417561] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-08T22:15:07.096885] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-08T22:15:07.217521] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-08T22:15:07.286365] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-08T22:15:08.017561] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-10-08T22:15:08.681244] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-08T22:15:08.817574] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-08T22:15:09.041590] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T22:15:09.617578] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-08T22:15:10.235025] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T22:15:10.417582] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-10-08T22:15:10.949903] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T22:15:11.217604] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-08T22:15:11.360501] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T22:15:12.017577] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-08T22:15:12.200336] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-08T22:15:12.817579] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-08T22:15:13.426383] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-08T22:15:13.617501] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-08T22:15:13.721727] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-08T22:15:14.417624] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-08T22:15:15.104856] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T22:15:15.217500] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-08T22:15:16.005870] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-08T22:15:16.017497] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-08T22:15:16.586844] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T22:15:16.817554] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-08T22:15:17.617517] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-08T22:15:17.649012] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T22:15:18.340404] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T22:15:18.387335] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T22:15:18.417509] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-10-08T22:15:18.974890] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-08T22:15:19.217624] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-08T22:15:20.017571] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-10-08T22:15:20.157122] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T22:15:20.795816] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T22:15:20.817493] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-10-08T22:15:21.420577] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-08T22:15:21.617562] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-10-08T22:15:22.293270] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-08T22:15:22.417556] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-10-08T22:15:23.217554] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-08T22:15:23.463920] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T22:15:24.017612] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-08T22:15:24.057725] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-08T22:15:24.060163] [INFO ] [REMOTE ] VMO: Full fetch complete (31225 records). [2025-10-08T22:15:24.060329] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-08T22:15:24.497162] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-08T22:15:24.497250] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-08T22:15:24.498029] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-08T22:15:24.498092] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-08T22:15:24.498870] [DEBUG] [LOCAL ] VMO: Trimmed 31225 records to 20901 (keeping 200 days of data) [2025-10-08T22:15:24.637466] [DEBUG] [LOCAL ] VMO: Primary data saved (20901 records). [2025-10-08T22:15:24.637599] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-08T22:15:24.637722] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VMO took 28.3s. Estimated remaining: 18m 18s. Rate: 7.1 symbols/min [2025-10-08T22:15:24.819857] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:24.819987] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-08T22:15:24.833547] [DEBUG] [LOCAL ] VOC: Loaded 9003 existing records from primary storage. [2025-10-08T22:15:24.834270] [INFO ] [MAIN ] VOC: Loaded 9003 existing records. [2025-10-08T22:15:25.025001] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:25.025270] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-08T22:15:25.025346] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-08T22:15:25.025623] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-08T22:15:25.025720] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-08T22:15:25.397709] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:25.436394] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T22:15:25.617538] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-08T22:15:26.248862] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-08T22:15:26.417573] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-08T22:15:27.217522] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-10-08T22:15:27.265639] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-08T22:15:27.344980] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T22:15:27.348964] [INFO ] [REMOTE ] VNT: Full fetch complete (63500 records). [2025-10-08T22:15:27.349121] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-08T22:15:27.734252] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-08T22:15:27.734340] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-08T22:15:27.735381] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-08T22:15:27.735445] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-08T22:15:27.736807] [DEBUG] [LOCAL ] VNT: Trimmed 63500 records to 43632 (keeping 200 days of data) [2025-10-08T22:15:27.939608] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T22:15:28.017690] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-08T22:15:28.024311] [DEBUG] [LOCAL ] VNT: Primary data saved (43632 records). [2025-10-08T22:15:28.024449] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-08T22:15:28.024588] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNT took 31.7s. Estimated remaining: 18m 9s. Rate: 7.1 symbols/min [2025-10-08T22:15:28.194785] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:28.234128] [DEBUG] [LOCAL ] VOYA: Loaded 42301 existing records from primary storage. [2025-10-08T22:15:28.234479] [INFO ] [MAIN ] VOYA: Loaded 42301 existing records. [2025-10-08T22:15:28.411601] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:28.411860] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-08T22:15:28.411908] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-08T22:15:28.412132] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-08T22:15:28.412190] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-08T22:15:28.784566] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:28.817502] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-10-08T22:15:29.560307] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:15:29.617516] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-10. [2025-10-08T22:15:30.410678] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T22:15:30.422059] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-08T22:15:30.617014] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T22:15:30.620064] [INFO ] [REMOTE ] VNCE: Full fetch complete (16135 records). [2025-10-08T22:15:30.620244] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-10-08T22:15:31.005001] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-10-08T22:15:31.005126] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-10-08T22:15:31.005497] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-10-08T22:15:31.005538] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-10-08T22:15:31.006496] [DEBUG] [LOCAL ] VNCE: Trimmed 16135 records to 8493 (keeping 200 days of data) [2025-10-08T22:15:31.058439] [DEBUG] [LOCAL ] VNCE: Primary data saved (8493 records). [2025-10-08T22:15:31.058697] [INFO ] [MAIN ] VNCE: Full history saved. [2025-10-08T22:15:31.058805] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VNCE took 34.7s. Estimated remaining: 18m 0s. Rate: 7.1 symbols/min [2025-10-08T22:15:31.227519] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-08T22:15:31.232739] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:31.233009] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-08T22:15:31.233057] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-08T22:15:31.233172] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-08T22:15:31.233216] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-08T22:15:31.233258] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-08T22:15:31.233290] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-08T22:15:31.605199] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:31.631839] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T22:15:32.017573] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-08T22:15:32.819440] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-10-08T22:15:32.826834] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-08T22:15:33.209496] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:15:33.209846] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-10-08T22:15:33.209954] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:15:33.210035] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-08T22:15:33.210117] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:15:33.210213] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-08T22:15:33.210296] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-08T22:15:33.210334] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-08T22:15:33.210390] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-08T22:15:33.210460] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOYG took 2.2s. Estimated remaining: 17m 51s. Rate: 7.1 symbols/min [2025-10-08T22:15:33.388408] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:33.408089] [DEBUG] [LOCAL ] VPG: Loaded 17127 existing records from primary storage. [2025-10-08T22:15:33.408345] [INFO ] [MAIN ] VPG: Loaded 17127 existing records. [2025-10-08T22:15:33.588200] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:33.588599] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-08T22:15:33.588691] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-08T22:15:33.588973] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-08T22:15:33.589090] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-08T22:15:33.633500] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-08T22:15:33.718359] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-08T22:15:33.988084] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:34.417624] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-08T22:15:34.525001] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T22:15:35.217599] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-08T22:15:35.631175] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-08T22:15:35.635117] [INFO ] [REMOTE ] VNO: Full fetch complete (70385 records). [2025-10-08T22:15:35.635281] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-08T22:15:36.027065] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-08T22:15:36.051819] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-08T22:15:36.051913] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-08T22:15:36.053106] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-08T22:15:36.053262] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-08T22:15:36.064930] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-08T22:15:36.069389] [DEBUG] [LOCAL ] VNO: Trimmed 70385 records to 48848 (keeping 200 days of data) [2025-10-08T22:15:36.368182] [DEBUG] [LOCAL ] VNO: Primary data saved (48848 records). [2025-10-08T22:15:36.368387] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-08T22:15:36.368568] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VNO took 40.1s. Estimated remaining: 17m 43s. Rate: 7.1 symbols/min [2025-10-08T22:15:36.545439] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:36.553737] [DEBUG] [LOCAL ] VPV: Loaded 5390 existing records from primary storage. [2025-10-08T22:15:36.553949] [INFO ] [MAIN ] VPV: Loaded 5390 existing records. [2025-10-08T22:15:36.736990] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:36.737226] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-08T22:15:36.737273] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-08T22:15:36.737442] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-08T22:15:36.737499] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-08T22:15:36.822704] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-08T22:15:37.116998] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:37.617543] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-10-08T22:15:37.639204] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-08T22:15:37.747826] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-08T22:15:38.377210] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-08T22:15:38.417680] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-08T22:15:39.217607] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-10-08T22:15:39.291004] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-08T22:15:40.017577] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-08T22:15:40.151919] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-08T22:15:40.795577] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T22:15:40.817520] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-08T22:15:41.513118] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-08T22:15:41.617546] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-08T22:15:42.420628] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-08T22:15:42.423587] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T22:15:43.001425] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T22:15:43.217570] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-08T22:15:43.841431] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-08T22:15:44.017567] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-08T22:15:44.817538] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-08T22:15:45.547466] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-08T22:15:45.617539] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-08T22:15:45.675577] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T22:15:46.148084] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-08T22:15:46.417524] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-08T22:15:47.217570] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-08T22:15:47.761404] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-08T22:15:47.778343] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T22:15:48.017502] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-08T22:15:48.817598] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-08T22:15:48.856702] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T22:15:49.624225] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-08T22:15:49.626196] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T22:15:50.260769] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T22:15:50.417560] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-08T22:15:50.998586] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T22:15:51.217560] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-08T22:15:51.882138] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-08T22:15:52.017571] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-08T22:15:52.382128] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-08T22:15:52.817565] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-08T22:15:53.196246] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-08T22:15:53.617562] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-08T22:15:54.417557] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-08T22:15:54.849007] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T22:15:55.183342] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T22:15:55.217492] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-08T22:15:55.654245] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T22:15:55.656163] [INFO ] [REMOTE ] VOC: Full fetch complete (13151 records). [2025-10-08T22:15:55.656283] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-08T22:15:56.022627] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-08T22:15:56.107122] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-08T22:15:56.107213] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-08T22:15:56.107549] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-08T22:15:56.107588] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-08T22:15:56.108128] [DEBUG] [LOCAL ] VOC: Trimmed 13151 records to 9006 (keeping 200 days of data) [2025-10-08T22:15:56.162105] [DEBUG] [LOCAL ] VOC: Primary data saved (9006 records). [2025-10-08T22:15:56.162274] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-08T22:15:56.162376] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOC took 31.5s. Estimated remaining: 17m 35s. Rate: 7.1 symbols/min [2025-10-08T22:15:56.329348] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:56.368823] [DEBUG] [LOCAL ] VRE: Loaded 35134 existing records from primary storage. [2025-10-08T22:15:56.369175] [INFO ] [MAIN ] VRE: Loaded 35134 existing records. [2025-10-08T22:15:56.547112] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:56.547328] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-08T22:15:56.547376] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-08T22:15:56.547795] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-08T22:15:56.547856] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-08T22:15:56.826490] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-08T22:15:56.934790] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:57.568032] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T22:15:57.623593] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-08T22:15:57.640316] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T22:15:58.094751] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T22:15:58.095829] [INFO ] [REMOTE ] VPV: Full fetch complete (9115 records). [2025-10-08T22:15:58.095899] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-08T22:15:58.422731] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-10-08T22:15:58.465095] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-08T22:15:58.465182] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-08T22:15:58.465430] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-08T22:15:58.465467] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-08T22:15:58.465959] [DEBUG] [LOCAL ] VPV: Trimmed 9115 records to 5408 (keeping 200 days of data) [2025-10-08T22:15:58.501662] [DEBUG] [LOCAL ] VPV: Primary data saved (5408 records). [2025-10-08T22:15:58.501844] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-08T22:15:58.501951] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPV took 22.1s. Estimated remaining: 17m 26s. Rate: 7.1 symbols/min [2025-10-08T22:15:58.702293] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:15:58.765224] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-08T22:15:58.765623] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-08T22:15:58.978299] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:15:58.978547] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-08T22:15:58.978596] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-08T22:15:58.978920] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-08T22:15:58.979022] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-08T22:15:59.222826] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-08T22:15:59.406770] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:15:59.747393] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-08T22:16:00.017570] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-10-08T22:16:00.501069] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T22:16:00.817620] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-08T22:16:01.617515] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-08T22:16:01.960004] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T22:16:02.172465] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-08T22:16:02.417554] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-08T22:16:02.998550] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-08T22:16:03.217506] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-08T22:16:03.668905] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-08T22:16:04.017598] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-08T22:16:04.817561] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-08T22:16:05.574475] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T22:16:05.617514] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-08T22:16:05.734401] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-08T22:16:05.903816] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-08T22:16:06.417687] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-08T22:16:06.603258] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-08T22:16:06.607341] [INFO ] [REMOTE ] VOYA: Full fetch complete (61672 records). [2025-10-08T22:16:06.607564] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-08T22:16:06.997220] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-08T22:16:06.997323] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-08T22:16:06.998389] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-08T22:16:06.998461] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-08T22:16:07.000341] [DEBUG] [LOCAL ] VOYA: Trimmed 61672 records to 42245 (keeping 200 days of data) [2025-10-08T22:16:07.220176] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-08T22:16:07.268070] [DEBUG] [LOCAL ] VOYA: Primary data saved (42245 records). [2025-10-08T22:16:07.268215] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-08T22:16:07.268322] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VOYA took 39.2s. Estimated remaining: 17m 18s. Rate: 7.1 symbols/min [2025-10-08T22:16:07.440394] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:07.453041] [DEBUG] [LOCAL ] VRTS: Loaded 9316 existing records from primary storage. [2025-10-08T22:16:07.453291] [INFO ] [MAIN ] VRTS: Loaded 9316 existing records. [2025-10-08T22:16:07.639112] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:07.639491] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-08T22:16:07.639736] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-08T22:16:07.640060] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-08T22:16:07.640167] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-08T22:16:07.789883] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T22:16:08.022712] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-08T22:16:08.063678] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:08.817554] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-08T22:16:09.542850] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-08T22:16:09.562834] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T22:16:09.617504] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-10-08T22:16:09.764530] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-08T22:16:10.094740] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T22:16:10.417726] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-08T22:16:10.912626] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T22:16:11.217561] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-08T22:16:11.702423] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-08T22:16:12.017542] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-08T22:16:12.817534] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-08T22:16:13.391193] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T22:16:13.617577] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-08T22:16:13.640570] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-08T22:16:14.417605] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-08T22:16:14.696593] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T22:16:15.135103] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-08T22:16:15.217577] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-08T22:16:16.017567] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-08T22:16:16.691382] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T22:16:16.708144] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T22:16:16.817560] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-08T22:16:17.617551] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-08T22:16:17.689081] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T22:16:18.417579] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-08T22:16:18.679588] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T22:16:18.964038] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-08T22:16:18.965483] [INFO ] [REMOTE ] VPG: Full fetch complete (22770 records). [2025-10-08T22:16:18.965562] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-08T22:16:19.222771] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-08T22:16:19.357840] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-08T22:16:19.357935] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-08T22:16:19.358419] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-08T22:16:19.358459] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-08T22:16:19.359199] [DEBUG] [LOCAL ] VPG: Trimmed 22770 records to 17071 (keeping 200 days of data) [2025-10-08T22:16:19.470027] [DEBUG] [LOCAL ] VPG: Primary data saved (17071 records). [2025-10-08T22:16:19.470204] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-08T22:16:19.470326] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VPG took 46.3s. Estimated remaining: 17m 9s. Rate: 7.1 symbols/min [2025-10-08T22:16:19.650635] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:19.705472] [DEBUG] [LOCAL ] VSCO: Loaded 52750 existing records from primary storage. [2025-10-08T22:16:19.705927] [INFO ] [MAIN ] VSCO: Loaded 52750 existing records. [2025-10-08T22:16:19.886611] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:19.886868] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-08T22:16:19.886917] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-08T22:16:19.887433] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-08T22:16:19.887492] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-08T22:16:20.022793] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-08T22:16:20.262685] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:20.817550] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-10-08T22:16:21.612449] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T22:16:21.621058] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-08T22:16:21.655483] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-08T22:16:22.150835] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T22:16:22.417519] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-08T22:16:22.653679] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T22:16:23.021425] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-08T22:16:23.217560] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-08T22:16:24.017608] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-08T22:16:24.434162] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T22:16:24.438827] [INFO ] [REMOTE ] VRE: Full fetch complete (48435 records). [2025-10-08T22:16:24.439115] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-08T22:16:24.824966] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-08T22:16:24.862151] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-08T22:16:24.862275] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-08T22:16:24.863207] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-08T22:16:24.863357] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-08T22:16:24.875196] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-08T22:16:24.879418] [DEBUG] [LOCAL ] VRE: Trimmed 48435 records to 35071 (keeping 200 days of data) [2025-10-08T22:16:25.104528] [DEBUG] [LOCAL ] VRE: Primary data saved (35071 records). [2025-10-08T22:16:25.104714] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-08T22:16:25.105552] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 28.9s. Estimated remaining: 17m 1s. Rate: 7.1 symbols/min [2025-10-08T22:16:25.278638] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:25.330325] [DEBUG] [LOCAL ] VSH: Loaded 48274 existing records from primary storage. [2025-10-08T22:16:25.330701] [INFO ] [MAIN ] VSH: Loaded 48274 existing records. [2025-10-08T22:16:25.510894] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:25.511158] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-08T22:16:25.511206] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-08T22:16:25.511467] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-08T22:16:25.511525] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-08T22:16:25.622726] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-08T22:16:25.869248] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:26.404113] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T22:16:26.417499] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-08T22:16:26.556971] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T22:16:27.217631] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-08T22:16:27.742384] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T22:16:28.017554] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-08T22:16:28.817604] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-08T22:16:29.577440] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-08T22:16:29.617505] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-08T22:16:29.685172] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-08T22:16:29.780249] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T22:16:30.376932] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-08T22:16:30.417518] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-08T22:16:30.898242] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-08T22:16:30.899621] [INFO ] [REMOTE ] VRTS: Full fetch complete (11503 records). [2025-10-08T22:16:30.899759] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-08T22:16:31.223057] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-08T22:16:31.450149] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-08T22:16:31.450285] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-08T22:16:31.450942] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-08T22:16:31.451029] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-08T22:16:31.452131] [DEBUG] [LOCAL ] VRTS: Trimmed 11503 records to 9303 (keeping 200 days of data) [2025-10-08T22:16:31.541941] [DEBUG] [LOCAL ] VRTS: Primary data saved (9303 records). [2025-10-08T22:16:31.542148] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-08T22:16:31.542262] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRTS took 24.3s. Estimated remaining: 16m 52s. Rate: 7.1 symbols/min [2025-10-08T22:16:31.838294] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:31.897129] [DEBUG] [LOCAL ] VST: Loaded 53716 existing records from primary storage. [2025-10-08T22:16:31.897523] [INFO ] [MAIN ] VST: Loaded 53716 existing records. [2025-10-08T22:16:32.022710] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-10-08T22:16:32.092276] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:32.092500] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-08T22:16:32.092570] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-08T22:16:32.092830] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-08T22:16:32.092888] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-08T22:16:32.487010] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:32.817523] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-08T22:16:33.179546] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-08T22:16:33.617582] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-08T22:16:33.813112] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T22:16:34.417570] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-08T22:16:35.217566] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-10-08T22:16:35.355602] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-08T22:16:35.406014] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T22:16:35.638058] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-08T22:16:36.017592] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-08T22:16:36.817549] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-08T22:16:37.381818] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-08T22:16:37.617534] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-08T22:16:38.344361] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-08T22:16:38.417496] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-08T22:16:38.637167] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T22:16:38.805921] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T22:16:39.217573] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-08T22:16:40.017593] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-08T22:16:40.817513] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-08T22:16:40.934957] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-08T22:16:41.441087] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-08T22:16:41.518662] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T22:16:41.617505] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-08T22:16:42.417596] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-08T22:16:42.619380] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T22:16:43.217538] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-08T22:16:43.273038] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T22:16:44.017579] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-08T22:16:44.722615] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T22:16:44.817545] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-08T22:16:45.038886] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-08T22:16:45.520666] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-08T22:16:45.617567] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-08T22:16:46.417562] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-08T22:16:47.184786] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T22:16:47.188812] [INFO ] [REMOTE ] VSCO: Full fetch complete (76216 records). [2025-10-08T22:16:47.188929] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-08T22:16:47.221230] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-08T22:16:47.528671] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-08T22:16:47.636331] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-08T22:16:47.636518] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-08T22:16:47.637995] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-08T22:16:47.638181] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-08T22:16:47.640289] [DEBUG] [LOCAL ] VSCO: Trimmed 76216 records to 52746 (keeping 200 days of data) [2025-10-08T22:16:47.901615] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T22:16:47.999048] [DEBUG] [LOCAL ] VSCO: Primary data saved (52746 records). [2025-10-08T22:16:47.999212] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-08T22:16:47.999327] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VSCO took 28.5s. Estimated remaining: 16m 44s. Rate: 7.1 symbols/min [2025-10-08T22:16:48.022702] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-08T22:16:48.176773] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:48.219242] [DEBUG] [LOCAL ] VSTS: Loaded 49012 existing records from primary storage. [2025-10-08T22:16:48.219574] [INFO ] [MAIN ] VSTS: Loaded 49012 existing records. [2025-10-08T22:16:48.394109] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:48.394381] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-08T22:16:48.394428] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-08T22:16:48.394818] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-08T22:16:48.394882] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-08T22:16:48.744253] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:48.817525] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-10-08T22:16:49.617541] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-08T22:16:49.680886] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-08T22:16:50.411754] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T22:16:50.422779] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-08T22:16:50.676188] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-08T22:16:50.775045] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T22:16:51.217539] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-08T22:16:51.696630] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T22:16:52.017597] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-08T22:16:52.817564] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-08T22:16:52.850479] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:16:53.425781] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-08T22:16:53.617713] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-08T22:16:54.417557] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-08T22:16:54.838259] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-08T22:16:55.217506] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-08T22:16:55.306159] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-08T22:16:56.017595] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-08T22:16:56.584428] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-08T22:16:56.589094] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-10-08T22:16:56.589267] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-08T22:16:56.826433] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-08T22:16:56.875337] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-08T22:16:57.135504] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-08T22:16:57.135612] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-08T22:16:57.136922] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-08T22:16:57.136994] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-08T22:16:57.138591] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 53753 (keeping 200 days of data) [2025-10-08T22:16:57.533290] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-08T22:16:57.533691] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-08T22:16:57.533805] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VRT took 59.0s. Estimated remaining: 16m 36s. Rate: 7.1 symbols/min [2025-10-08T22:16:57.618387] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-08T22:16:57.742268] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:16:57.772493] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-08T22:16:57.815618] [DEBUG] [LOCAL ] VTEX: Loaded 43025 existing records from primary storage. [2025-10-08T22:16:57.815953] [INFO ] [MAIN ] VTEX: Loaded 43025 existing records. [2025-10-08T22:16:57.990345] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:16:57.990694] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-08T22:16:57.990770] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-08T22:16:57.991398] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-08T22:16:57.991455] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-08T22:16:58.347632] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:16:58.417526] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-10-08T22:16:59.217553] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-08T22:16:59.259907] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T22:16:59.557844] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-08T22:16:59.568000] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-08T22:17:00.017612] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-08T22:17:00.817565] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-08T22:17:01.021470] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-08T22:17:01.548519] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-08T22:17:01.617526] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-08T22:17:02.039715] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T22:17:02.043533] [INFO ] [REMOTE ] VSH: Full fetch complete (70875 records). [2025-10-08T22:17:02.043723] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-08T22:17:02.424959] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-08T22:17:02.465737] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-08T22:17:02.465815] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-08T22:17:02.466991] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-08T22:17:02.467102] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-08T22:17:02.470765] [DEBUG] [LOCAL ] VSH: Trimmed 70875 records to 48244 (keeping 200 days of data) [2025-10-08T22:17:02.716485] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-08T22:17:02.808664] [DEBUG] [LOCAL ] VSH: Primary data saved (48244 records). [2025-10-08T22:17:02.808816] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-08T22:17:02.809751] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 37.7s. Estimated remaining: 16m 27s. Rate: 7.1 symbols/min [2025-10-08T22:17:02.992056] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:03.048956] [DEBUG] [LOCAL ] VTLE: Loaded 48329 existing records from primary storage. [2025-10-08T22:17:03.049379] [INFO ] [MAIN ] VTLE: Loaded 48329 existing records. [2025-10-08T22:17:03.229883] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-08T22:17:03.236783] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:03.237993] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-08T22:17:03.238069] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-08T22:17:03.238432] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-08T22:17:03.238493] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-08T22:17:03.618217] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:03.652364] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T22:17:04.017551] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-08T22:17:04.817535] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-08T22:17:05.217381] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T22:17:05.301746] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-08T22:17:05.617565] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-08T22:17:06.417600] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-10-08T22:17:06.647568] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-08T22:17:07.217580] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-08T22:17:07.946279] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-08T22:17:07.989040] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T22:17:08.017522] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-08T22:17:08.287772] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T22:17:08.817541] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-08T22:17:09.617611] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-08T22:17:10.423023] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-08T22:17:10.438022] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-08T22:17:10.602297] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-08T22:17:10.747275] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T22:17:11.217567] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-08T22:17:11.779399] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T22:17:12.017558] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-08T22:17:12.771401] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T22:17:12.817513] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-08T22:17:13.077403] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T22:17:13.617595] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-08T22:17:14.417594] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-08T22:17:14.461338] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T22:17:15.217598] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-08T22:17:15.541407] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-08T22:17:15.874675] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-08T22:17:16.017552] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-08T22:17:16.472633] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-08T22:17:16.817559] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-08T22:17:17.336686] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T22:17:17.617587] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-08T22:17:18.308409] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T22:17:18.417613] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-08T22:17:18.782745] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T22:17:18.786615] [INFO ] [REMOTE ] VSTS: Full fetch complete (69718 records). [2025-10-08T22:17:18.786754] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-08T22:17:19.128235] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T22:17:19.203162] [INFO ] [REMOTE ] VST: Full fetch complete (77802 records). [2025-10-08T22:17:19.203492] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-08T22:17:19.221852] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-08T22:17:19.217687] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-08T22:17:19.222771] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-08T22:17:19.226000] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-08T22:17:19.226148] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-08T22:17:19.338054] [DEBUG] [LOCAL ] VSTS: Trimmed 69718 records to 48958 (keeping 200 days of data) [2025-10-08T22:17:19.852413] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-08T22:17:19.852982] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-08T22:17:19.855223] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-08T22:17:19.856074] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-08T22:17:19.870509] [DEBUG] [LOCAL ] VST: Trimmed 77802 records to 53713 (keeping 200 days of data) [2025-10-08T22:17:20.034789] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-08T22:17:20.191894] [DEBUG] [LOCAL ] VSTS: Primary data saved (48958 records). [2025-10-08T22:17:20.193674] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-08T22:17:20.193822] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VSTS took 32.2s. Estimated remaining: 16m 19s. Rate: 7.1 symbols/min [2025-10-08T22:17:20.375871] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:20.504793] [DEBUG] [LOCAL ] VTMX: Loaded 17599 existing records from primary storage. [2025-10-08T22:17:20.506112] [INFO ] [MAIN ] VTMX: Loaded 17599 existing records. [2025-10-08T22:17:20.705823] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:20.707272] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-08T22:17:20.707393] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-08T22:17:20.707842] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-08T22:17:20.708390] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-08T22:17:21.047756] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-08T22:17:21.175014] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-08T22:17:21.203815] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:21.286972] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T22:17:21.308268] [DEBUG] [LOCAL ] VST: Primary data saved (53713 records). [2025-10-08T22:17:21.308417] [INFO ] [MAIN ] VST: Full history saved. [2025-10-08T22:17:21.309952] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VST took 49.8s. Estimated remaining: 16m 10s. Rate: 7.1 symbols/min [2025-10-08T22:17:21.481294] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:21.492697] [DEBUG] [LOCAL ] VTN: Loaded 7010 existing records from primary storage. [2025-10-08T22:17:21.492949] [INFO ] [MAIN ] VTN: Loaded 7010 existing records. [2025-10-08T22:17:21.632047] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-08T22:17:21.673926] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:21.674354] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-08T22:17:21.674403] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-08T22:17:21.674603] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-08T22:17:21.674700] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-08T22:17:22.038872] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:22.417546] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-10-08T22:17:22.579224] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T22:17:22.963184] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T22:17:22.966174] [INFO ] [REMOTE ] VTEX: Full fetch complete (60497 records). [2025-10-08T22:17:22.966269] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-08T22:17:23.152261] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-08T22:17:23.227718] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-08T22:17:23.434613] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-08T22:17:23.434747] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-08T22:17:23.435805] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-08T22:17:23.435873] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-08T22:17:23.437371] [DEBUG] [LOCAL ] VTEX: Trimmed 60497 records to 42978 (keeping 200 days of data) [2025-10-08T22:17:23.768757] [DEBUG] [LOCAL ] VTEX: Primary data saved (42978 records). [2025-10-08T22:17:23.768934] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-08T22:17:23.769071] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VTEX took 26.2s. Estimated remaining: 16m 2s. Rate: 7.1 symbols/min [2025-10-08T22:17:24.023842] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-08T22:17:24.048494] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:24.053299] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T22:17:24.092851] [DEBUG] [LOCAL ] VTOL: Loaded 19549 existing records from primary storage. [2025-10-08T22:17:24.093357] [INFO ] [MAIN ] VTOL: Loaded 19549 existing records. [2025-10-08T22:17:24.364378] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:24.364775] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-08T22:17:24.364846] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-08T22:17:24.365144] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-08T22:17:24.365216] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-08T22:17:24.748353] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:24.817561] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-08T22:17:25.455515] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-08T22:17:25.547045] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T22:17:25.617552] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-08T22:17:26.365568] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-08T22:17:26.417498] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-08T22:17:27.225373] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-08T22:17:27.228919] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-08T22:17:28.017605] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-08T22:17:28.567419] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-08T22:17:28.817525] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-08T22:17:28.992786] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-08T22:17:29.585895] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T22:17:29.617517] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-08T22:17:30.236080] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T22:17:30.417547] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-10-08T22:17:31.217528] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-08T22:17:31.400809] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-08T22:17:32.017552] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-08T22:17:32.672055] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-08T22:17:32.817525] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-10-08T22:17:32.826949] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-08T22:17:33.617721] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-08T22:17:33.970916] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T22:17:34.399499] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T22:17:34.417495] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-08T22:17:35.049919] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-08T22:17:35.217512] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-08T22:17:36.017570] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-08T22:17:36.405793] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T22:17:36.409164] [INFO ] [REMOTE ] VTLE: Full fetch complete (68762 records). [2025-10-08T22:17:36.409293] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-08T22:17:36.798281] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-08T22:17:36.798442] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-08T22:17:36.799768] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-08T22:17:36.799847] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-08T22:17:36.802295] [DEBUG] [LOCAL ] VTLE: Trimmed 68762 records to 48266 (keeping 200 days of data) [2025-10-08T22:17:36.855245] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-08T22:17:37.027313] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-08T22:17:37.112296] [DEBUG] [LOCAL ] VTLE: Primary data saved (48266 records). [2025-10-08T22:17:37.112453] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-08T22:17:37.113282] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 34.3s. Estimated remaining: 15m 54s. Rate: 7.1 symbols/min [2025-10-08T22:17:37.283586] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:37.302836] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-08T22:17:37.304025] [INFO ] [REMOTE ] VTN: Full fetch complete (11104 records). [2025-10-08T22:17:37.304156] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-08T22:17:37.477021] [DEBUG] [LOCAL ] VTR: Loaded 52793 existing records from primary storage. [2025-10-08T22:17:37.498077] [INFO ] [MAIN ] VTR: Loaded 52793 existing records. [2025-10-08T22:17:37.627984] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-08T22:17:37.878740] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-08T22:17:37.885702] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-08T22:17:37.901850] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-08T22:17:37.907628] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-08T22:17:37.907421] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:37.908343] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-08T22:17:37.908667] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-08T22:17:37.908790] [DEBUG] [LOCAL ] VTN: Trimmed 11104 records to 6991 (keeping 200 days of data) [2025-10-08T22:17:37.909543] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-08T22:17:37.909615] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-08T22:17:38.342425] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:38.346016] [DEBUG] [LOCAL ] VTN: Primary data saved (6991 records). [2025-10-08T22:17:38.346251] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-08T22:17:38.346394] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTN took 17.0s. Estimated remaining: 15m 45s. Rate: 7.1 symbols/min [2025-10-08T22:17:38.418143] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-08T22:17:38.535841] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:38.547975] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-08T22:17:38.581983] [DEBUG] [LOCAL ] VTS: Loaded 30231 existing records from primary storage. [2025-10-08T22:17:38.582308] [INFO ] [MAIN ] VTS: Loaded 30231 existing records. [2025-10-08T22:17:38.759768] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:38.760051] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-08T22:17:38.760101] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-08T22:17:38.760455] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-08T22:17:38.760513] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-08T22:17:39.114667] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:39.217547] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-08T22:17:39.360460] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T22:17:40.017534] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-08T22:17:40.308449] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T22:17:40.817573] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-10-08T22:17:40.967605] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-08T22:17:41.617542] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-10-08T22:17:41.970558] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T22:17:42.417560] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-08T22:17:43.217510] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-08T22:17:43.263069] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T22:17:43.316549] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-08T22:17:44.017516] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-08T22:17:44.250310] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-08T22:17:44.817539] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-08T22:17:45.135023] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T22:17:45.617561] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-08T22:17:45.989808] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-08T22:17:46.408754] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-08T22:17:46.417486] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-08T22:17:47.217558] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-08T22:17:47.439440] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-08T22:17:48.017587] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-08T22:17:48.817501] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-08T22:17:49.079306] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-08T22:17:49.134431] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-08T22:17:49.467767] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-08T22:17:49.617607] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-08T22:17:50.417550] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-08T22:17:50.668802] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-08T22:17:51.217525] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-08T22:17:51.331448] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-08T22:17:51.778525] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-08T22:17:51.781352] [INFO ] [REMOTE ] VTOL: Full fetch complete (26047 records). [2025-10-08T22:17:51.781973] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-08T22:17:52.022760] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-08T22:17:52.179695] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-08T22:17:52.179799] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-08T22:17:52.180390] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-08T22:17:52.180431] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-08T22:17:52.181530] [DEBUG] [LOCAL ] VTOL: Trimmed 26047 records to 19500 (keeping 200 days of data) [2025-10-08T22:17:52.295586] [DEBUG] [LOCAL ] VTOL: Primary data saved (19500 records). [2025-10-08T22:17:52.295784] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-08T22:17:52.295879] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTOL took 28.5s. Estimated remaining: 15m 37s. Rate: 7.1 symbols/min [2025-10-08T22:17:52.467962] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:17:52.499970] [DEBUG] [LOCAL ] VVR: Loaded 31655 existing records from primary storage. [2025-10-08T22:17:52.500275] [INFO ] [MAIN ] VVR: Loaded 31655 existing records. [2025-10-08T22:17:52.675225] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:17:52.675510] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-08T22:17:52.675569] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-08T22:17:52.675902] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-08T22:17:52.675960] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-08T22:17:52.819421] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-08T22:17:53.034928] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T22:17:53.056288] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:17:53.617585] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-10-08T22:17:54.417713] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-08T22:17:54.567176] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T22:17:54.807595] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-08T22:17:55.217524] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-08T22:17:55.233599] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-08T22:17:55.758074] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-08T22:17:56.017583] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-08T22:17:56.817534] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-08T22:17:57.350053] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T22:17:57.617581] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-08T22:17:57.861574] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T22:17:58.417531] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-08T22:17:58.585985] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T22:17:59.217555] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-08T22:18:00.017579] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-08T22:18:00.110555] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T22:18:00.491218] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T22:18:00.758080] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-08T22:18:00.760041] [INFO ] [REMOTE ] VTMX: Full fetch complete (25663 records). [2025-10-08T22:18:00.760112] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-08T22:18:00.824617] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-08T22:18:01.142267] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-08T22:18:01.142350] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-08T22:18:01.143130] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-08T22:18:01.143190] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-08T22:18:01.143860] [DEBUG] [LOCAL ] VTMX: Trimmed 25663 records to 17558 (keeping 200 days of data) [2025-10-08T22:18:01.258380] [DEBUG] [LOCAL ] VTMX: Primary data saved (17558 records). [2025-10-08T22:18:01.258532] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-08T22:18:01.258673] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTMX took 41.1s. Estimated remaining: 15m 28s. Rate: 7.1 symbols/min [2025-10-08T22:18:01.432333] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:01.483058] [DEBUG] [LOCAL ] VVV: Loaded 50285 existing records from primary storage. [2025-10-08T22:18:01.483381] [INFO ] [MAIN ] VVV: Loaded 50285 existing records. [2025-10-08T22:18:01.629198] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-08T22:18:01.671230] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:01.671575] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-08T22:18:01.671683] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-08T22:18:01.672071] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-08T22:18:01.672142] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-08T22:18:02.061572] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:02.334250] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-08T22:18:02.417529] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-10-08T22:18:03.217567] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-08T22:18:03.638140] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T22:18:03.844158] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-08T22:18:04.017585] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-08T22:18:04.220048] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-08T22:18:04.817557] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-08T22:18:05.499243] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:18:05.617560] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-08T22:18:06.117589] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T22:18:06.417582] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-08T22:18:07.061905] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T22:18:07.217511] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-08T22:18:07.499858] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T22:18:08.017626] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-08T22:18:08.684981] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-08T22:18:08.817530] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-08T22:18:09.623181] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-08T22:18:09.635737] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-08T22:18:10.422722] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-08T22:18:10.445825] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:18:10.670981] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T22:18:11.217565] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-08T22:18:11.980593] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T22:18:12.017503] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-08T22:18:12.180717] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-08T22:18:12.817593] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-08T22:18:13.617560] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-08T22:18:13.875022] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-08T22:18:13.950721] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-08T22:18:14.417591] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-08T22:18:14.673300] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T22:18:15.217584] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-08T22:18:16.017699] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-08T22:18:16.205017] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-08T22:18:16.438963] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-08T22:18:16.817558] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-08T22:18:17.617602] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-08T22:18:17.695507] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-08T22:18:17.731180] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-08T22:18:18.417560] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-08T22:18:19.036679] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-08T22:18:19.217567] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-08T22:18:19.662541] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T22:18:20.017594] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-08T22:18:20.349769] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-08T22:18:20.353536] [INFO ] [REMOTE ] VTS: Full fetch complete (41308 records). [2025-10-08T22:18:20.353717] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-08T22:18:20.799068] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-08T22:18:20.799161] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-08T22:18:20.799985] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-08T22:18:20.800052] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-08T22:18:20.800976] [DEBUG] [LOCAL ] VTS: Trimmed 41308 records to 30151 (keeping 200 days of data) [2025-10-08T22:18:20.853780] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-08T22:18:20.986409] [DEBUG] [LOCAL ] VTS: Primary data saved (30151 records). [2025-10-08T22:18:20.986558] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-08T22:18:20.986671] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 42.6s. Estimated remaining: 15m 20s. Rate: 7.1 symbols/min [2025-10-08T22:18:21.154813] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:21.176841] [DEBUG] [LOCAL ] VVX: Loaded 22950 existing records from primary storage. [2025-10-08T22:18:21.177120] [INFO ] [MAIN ] VVX: Loaded 22950 existing records. [2025-10-08T22:18:21.357513] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:21.357849] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-08T22:18:21.357898] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-08T22:18:21.358149] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-08T22:18:21.358207] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-08T22:18:21.626183] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-08T22:18:21.718103] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:21.755285] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T22:18:22.426568] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-08T22:18:22.432452] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-08T22:18:23.179682] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T22:18:23.217529] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-08T22:18:23.831438] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-08T22:18:24.017556] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-08T22:18:24.533593] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T22:18:24.537149] [INFO ] [REMOTE ] VVR: Full fetch complete (46614 records). [2025-10-08T22:18:24.537326] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-08T22:18:24.822723] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-10-08T22:18:24.947413] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-08T22:18:24.947503] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-08T22:18:24.948409] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-08T22:18:24.948474] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-08T22:18:24.949606] [DEBUG] [LOCAL ] VVR: Trimmed 46614 records to 31529 (keeping 200 days of data) [2025-10-08T22:18:25.128006] [DEBUG] [LOCAL ] VVR: Primary data saved (31529 records). [2025-10-08T22:18:25.128153] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-08T22:18:25.128249] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VVR took 32.8s. Estimated remaining: 15m 12s. Rate: 7.1 symbols/min [2025-10-08T22:18:25.296513] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:25.339821] [DEBUG] [LOCAL ] VYX: Loaded 48640 existing records from primary storage. [2025-10-08T22:18:25.340216] [INFO ] [MAIN ] VYX: Loaded 48640 existing records. [2025-10-08T22:18:25.521817] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:25.522147] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-08T22:18:25.522260] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-08T22:18:25.522526] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-08T22:18:25.522588] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-08T22:18:25.620170] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-08T22:18:25.850051] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T22:18:25.945857] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:26.090159] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-08T22:18:26.218604] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T22:18:26.222904] [INFO ] [REMOTE ] VTR: Full fetch complete (76336 records). [2025-10-08T22:18:26.223030] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-08T22:18:26.422777] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-08T22:18:26.619753] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-08T22:18:26.619840] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-08T22:18:26.621084] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-08T22:18:26.621177] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-08T22:18:26.622930] [DEBUG] [LOCAL ] VTR: Trimmed 76336 records to 52768 (keeping 200 days of data) [2025-10-08T22:18:26.960509] [DEBUG] [LOCAL ] VTR: Primary data saved (52768 records). [2025-10-08T22:18:26.960729] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-08T22:18:26.961819] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VTR took 49.8s. Estimated remaining: 15m 3s. Rate: 7.1 symbols/min [2025-10-08T22:18:27.143767] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:27.198189] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-08T22:18:27.198525] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-08T22:18:27.229359] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-10-08T22:18:27.385844] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:27.386061] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-08T22:18:27.386107] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-08T22:18:27.386334] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-08T22:18:27.386392] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-08T22:18:27.772617] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T22:18:27.774276] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:28.017545] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-10-08T22:18:28.817559] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-08T22:18:28.891619] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T22:18:29.572538] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-08T22:18:29.617546] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-08T22:18:29.706741] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-08T22:18:30.417600] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-08T22:18:31.189365] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T22:18:31.217528] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-08T22:18:32.017723] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-08T22:18:32.668372] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-08T22:18:32.796248] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T22:18:32.817520] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-08T22:18:32.856985] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-08T22:18:33.617584] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-08T22:18:34.020900] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T22:18:34.417544] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-08T22:18:34.677008] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-08T22:18:35.217511] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-08T22:18:36.017611] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-08T22:18:36.604457] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-08T22:18:36.759525] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T22:18:36.817526] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-08T22:18:37.422348] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T22:18:37.617551] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-08T22:18:38.427263] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-08T22:18:38.433349] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-08T22:18:38.536057] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T22:18:39.217590] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-08T22:18:39.918580] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T22:18:39.922962] [INFO ] [REMOTE ] VVV: Full fetch complete (72400 records). [2025-10-08T22:18:39.923124] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-08T22:18:40.022916] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-08T22:18:40.364359] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-08T22:18:40.364727] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-08T22:18:40.367686] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-08T22:18:40.367787] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-08T22:18:40.370112] [DEBUG] [LOCAL ] VVV: Trimmed 72400 records to 50287 (keeping 200 days of data) [2025-10-08T22:18:40.660340] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T22:18:40.754446] [DEBUG] [LOCAL ] VVV: Primary data saved (50287 records). [2025-10-08T22:18:40.754680] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-08T22:18:40.754810] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 39.5s. Estimated remaining: 14m 55s. Rate: 7.1 symbols/min [2025-10-08T22:18:40.832155] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-08T22:18:40.964893] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:40.976166] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T22:18:41.045343] [DEBUG] [LOCAL ] W: Loaded 53447 existing records from primary storage. [2025-10-08T22:18:41.046001] [INFO ] [MAIN ] W: Loaded 53447 existing records. [2025-10-08T22:18:41.264348] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:41.264818] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-08T22:18:41.264878] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-08T22:18:41.265256] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-08T22:18:41.265319] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-08T22:18:41.631287] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-08T22:18:41.684732] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:42.417594] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-10-08T22:18:43.186723] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-08T22:18:43.227291] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-08T22:18:43.246482] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T22:18:44.022629] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-08T22:18:44.045405] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T22:18:44.817526] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-08T22:18:44.848291] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-08T22:18:45.617511] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-08T22:18:45.783340] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-08T22:18:46.417612] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-08T22:18:46.657974] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T22:18:46.727101] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-08T22:18:47.217715] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-08T22:18:48.017565] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-08T22:18:48.445813] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T22:18:48.724690] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-08T22:18:48.817572] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-08T22:18:49.608872] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T22:18:49.618861] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-08T22:18:50.417560] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-08T22:18:50.991475] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-08T22:18:51.210871] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T22:18:51.220616] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-08T22:18:51.426283] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T22:18:51.428558] [INFO ] [REMOTE ] VVX: Full fetch complete (33398 records). [2025-10-08T22:18:51.428677] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-08T22:18:51.840938] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-08T22:18:51.841030] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-08T22:18:51.841718] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-08T22:18:51.841782] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-08T22:18:51.842663] [DEBUG] [LOCAL ] VVX: Trimmed 33398 records to 22935 (keeping 200 days of data) [2025-10-08T22:18:51.978148] [DEBUG] [LOCAL ] VVX: Primary data saved (22935 records). [2025-10-08T22:18:51.978287] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-08T22:18:51.978374] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 31.0s. Estimated remaining: 14m 46s. Rate: 7.1 symbols/min [2025-10-08T22:18:52.022688] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-08T22:18:52.152838] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:52.198848] [DEBUG] [LOCAL ] WAB: Loaded 44063 existing records from primary storage. [2025-10-08T22:18:52.199262] [INFO ] [MAIN ] WAB: Loaded 44063 existing records. [2025-10-08T22:18:52.397737] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:52.398021] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-08T22:18:52.398072] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-08T22:18:52.398334] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-08T22:18:52.398394] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-08T22:18:52.785836] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:52.817542] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-10-08T22:18:53.562131] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-08T22:18:53.611911] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-08T22:18:53.622351] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-08T22:18:54.420017] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-08T22:18:54.426282] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T22:18:55.181006] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T22:18:55.217490] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-08T22:18:55.424204] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-08T22:18:55.427763] [INFO ] [REMOTE ] VYX: Full fetch complete (70095 records). [2025-10-08T22:18:55.427867] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-08T22:18:55.820625] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-08T22:18:55.821039] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-08T22:18:55.822126] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-08T22:18:55.822190] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-08T22:18:55.823501] [DEBUG] [LOCAL ] VYX: Trimmed 70095 records to 48554 (keeping 200 days of data) [2025-10-08T22:18:56.027347] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-08T22:18:56.112230] [DEBUG] [LOCAL ] VYX: Primary data saved (48554 records). [2025-10-08T22:18:56.112376] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-08T22:18:56.112474] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 31.0s. Estimated remaining: 14m 38s. Rate: 7.1 symbols/min [2025-10-08T22:18:56.280261] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:18:56.320173] [DEBUG] [LOCAL ] WAL: Loaded 45135 existing records from primary storage. [2025-10-08T22:18:56.320522] [INFO ] [MAIN ] WAL: Loaded 45135 existing records. [2025-10-08T22:18:56.496851] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:18:56.497099] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-08T22:18:56.497196] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-08T22:18:56.497563] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-08T22:18:56.497623] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-08T22:18:56.831161] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-08T22:18:56.865637] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:18:56.953165] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-08T22:18:57.617554] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-08T22:18:58.024050] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T22:18:58.417576] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-08T22:18:58.572456] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-08T22:18:59.217519] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-10-08T22:18:59.327143] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-08T22:19:00.017551] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-08T22:19:00.490779] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-08T22:19:00.817565] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-08T22:19:01.137594] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-08T22:19:01.244687] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T22:19:01.248753] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-10-08T22:19:01.248876] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-08T22:19:01.636448] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-08T22:19:01.637043] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-08T22:19:01.638013] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-08T22:19:01.639213] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-08T22:19:01.639386] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-08T22:19:01.641173] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 53791 (keeping 200 days of data) [2025-10-08T22:19:01.806203] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T22:19:02.028369] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-08T22:19:02.028530] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-08T22:19:02.028614] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 35.1s. Estimated remaining: 14m 29s. Rate: 7.1 symbols/min [2025-10-08T22:19:02.194028] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:02.236849] [DEBUG] [LOCAL ] WAT: Loaded 35443 existing records from primary storage. [2025-10-08T22:19:02.237186] [INFO ] [MAIN ] WAT: Loaded 35443 existing records. [2025-10-08T22:19:02.413342] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:02.413543] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-08T22:19:02.413589] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-08T22:19:02.413833] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-08T22:19:02.413891] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-08T22:19:02.424957] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-08T22:19:02.773864] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:03.205918] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T22:19:03.217485] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-08T22:19:04.017542] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-10-08T22:19:04.465621] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-08T22:19:04.817567] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-08T22:19:04.878907] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-08T22:19:04.963679] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T22:19:05.617542] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-08T22:19:06.151397] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-08T22:19:06.417612] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-08T22:19:07.217544] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-08T22:19:07.312556] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T22:19:08.017604] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-08T22:19:08.241354] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T22:19:08.695668] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T22:19:08.817512] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-08T22:19:09.617579] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-08T22:19:09.771429] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-08T22:19:10.193057] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T22:19:10.417562] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-08T22:19:11.048329] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-08T22:19:11.217613] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-08T22:19:11.899480] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-08T22:19:12.017552] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-08T22:19:12.270218] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-08T22:19:12.817609] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-08T22:19:13.617539] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-08T22:19:13.659767] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T22:19:13.988282] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-08T22:19:14.417564] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-08T22:19:14.965378] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T22:19:14.971223] [INFO ] [REMOTE ] W: Full fetch complete (77392 records). [2025-10-08T22:19:14.971369] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-08T22:19:15.226849] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-08T22:19:15.376341] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-08T22:19:15.376455] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-08T22:19:15.377706] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-08T22:19:15.377790] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-08T22:19:15.379448] [DEBUG] [LOCAL ] W: Trimmed 77392 records to 53441 (keeping 200 days of data) [2025-10-08T22:19:15.708949] [DEBUG] [LOCAL ] W: Primary data saved (53441 records). [2025-10-08T22:19:15.709138] [INFO ] [MAIN ] W: Full history saved. [2025-10-08T22:19:15.709255] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 35.0s. Estimated remaining: 14m 21s. Rate: 7.1 symbols/min [2025-10-08T22:19:15.883621] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:15.884001] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-08T22:19:15.884109] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-08T22:19:15.884269] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-08T22:19:15.884335] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-08T22:19:15.884494] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-08T22:19:15.884553] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-08T22:19:16.022257] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-08T22:19:16.021201] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-08T22:19:16.283138] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:16.652768] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-08T22:19:16.817554] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-10-08T22:19:17.032796] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:19:17.033431] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-10-08T22:19:17.033559] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:19:17.033671] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-08T22:19:17.033748] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:19:17.033846] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-08T22:19:17.033948] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-08T22:19:17.034008] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-08T22:19:17.034055] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-08T22:19:17.034125] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WBI took 1.3s. Estimated remaining: 14m 12s. Rate: 7.1 symbols/min [2025-10-08T22:19:17.221246] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:17.269320] [DEBUG] [LOCAL ] WBS: Loaded 48692 existing records from primary storage. [2025-10-08T22:19:17.269730] [INFO ] [MAIN ] WBS: Loaded 48692 existing records. [2025-10-08T22:19:17.459637] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:17.459950] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-08T22:19:17.460065] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-08T22:19:17.460457] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-08T22:19:17.460527] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-08T22:19:17.572719] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T22:19:17.622598] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-08T22:19:17.861782] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:18.417553] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-08T22:19:19.217523] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-10-08T22:19:19.254103] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:19:20.017544] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-08T22:19:20.223082] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T22:19:20.459229] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T22:19:20.817547] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-08T22:19:21.511817] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T22:19:21.617524] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-08T22:19:22.014935] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-08T22:19:22.417549] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-08T22:19:23.071587] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-08T22:19:23.217588] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-08T22:19:24.004849] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T22:19:24.017499] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-08T22:19:24.163817] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-08T22:19:24.817619] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-08T22:19:25.581231] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-08T22:19:25.617508] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-08T22:19:26.110796] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-08T22:19:26.417599] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-08T22:19:27.153517] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-08T22:19:27.157765] [INFO ] [REMOTE ] WAL: Full fetch complete (66678 records). [2025-10-08T22:19:27.158019] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-08T22:19:27.232417] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-08T22:19:27.624790] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-08T22:19:27.624901] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-08T22:19:27.626343] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-08T22:19:27.626415] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-08T22:19:27.627866] [DEBUG] [LOCAL ] WAL: Trimmed 66678 records to 45173 (keeping 200 days of data) [2025-10-08T22:19:27.914377] [DEBUG] [LOCAL ] WAL: Primary data saved (45173 records). [2025-10-08T22:19:27.914509] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-08T22:19:27.914600] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAL took 31.8s. Estimated remaining: 14m 4s. Rate: 7.1 symbols/min [2025-10-08T22:19:28.020717] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-08T22:19:28.098476] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:28.125216] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T22:19:28.142338] [DEBUG] [LOCAL ] WBX: Loaded 11031 existing records from primary storage. [2025-10-08T22:19:28.142581] [INFO ] [MAIN ] WBX: Loaded 11031 existing records. [2025-10-08T22:19:28.329969] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:28.330369] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-08T22:19:28.330433] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-08T22:19:28.330603] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-08T22:19:28.330700] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-08T22:19:28.689477] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:28.820108] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-08T22:19:28.824906] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T22:19:29.464837] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T22:19:29.617527] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-08T22:19:30.417543] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-08T22:19:30.483991] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-08T22:19:31.188815] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T22:19:31.217509] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-08T22:19:31.613638] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-08T22:19:31.955120] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-08T22:19:32.017503] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-08T22:19:32.817548] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-08T22:19:33.098821] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-08T22:19:33.102406] [INFO ] [REMOTE ] WAB: Full fetch complete (64191 records). [2025-10-08T22:19:33.102515] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-08T22:19:33.514134] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-08T22:19:33.514288] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-08T22:19:33.515387] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-08T22:19:33.515467] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-08T22:19:33.517240] [DEBUG] [LOCAL ] WAB: Trimmed 64191 records to 44034 (keeping 200 days of data) [2025-10-08T22:19:33.618373] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-10-08T22:19:33.654568] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T22:19:33.850577] [DEBUG] [LOCAL ] WAB: Primary data saved (44034 records). [2025-10-08T22:19:33.850749] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-08T22:19:33.850842] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAB took 41.9s. Estimated remaining: 13m 55s. Rate: 7.1 symbols/min [2025-10-08T22:19:34.032530] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:34.076775] [DEBUG] [LOCAL ] WCC: Loaded 39191 existing records from primary storage. [2025-10-08T22:19:34.077314] [INFO ] [MAIN ] WCC: Loaded 39191 existing records. [2025-10-08T22:19:34.260727] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:34.260974] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-08T22:19:34.261034] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-08T22:19:34.261329] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-08T22:19:34.261386] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-08T22:19:34.428087] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-08T22:19:34.678302] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:35.067448] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-08T22:19:35.217551] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-08T22:19:35.686537] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T22:19:35.689910] [INFO ] [REMOTE ] WAT: Full fetch complete (50142 records). [2025-10-08T22:19:35.690031] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-08T22:19:36.023174] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-08T22:19:36.136106] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-08T22:19:36.136231] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-08T22:19:36.137350] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-08T22:19:36.137513] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-08T22:19:36.139136] [DEBUG] [LOCAL ] WAT: Trimmed 50142 records to 35446 (keeping 200 days of data) [2025-10-08T22:19:36.254567] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-08T22:19:36.390010] [DEBUG] [LOCAL ] WAT: Primary data saved (35446 records). [2025-10-08T22:19:36.390156] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-08T22:19:36.390243] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WAT took 34.4s. Estimated remaining: 13m 47s. Rate: 7.1 symbols/min [2025-10-08T22:19:36.556368] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:36.601368] [DEBUG] [LOCAL ] WCN: Loaded 47941 existing records from primary storage. [2025-10-08T22:19:36.601715] [INFO ] [MAIN ] WCN: Loaded 47941 existing records. [2025-10-08T22:19:36.782930] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:36.783284] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-08T22:19:36.783353] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-08T22:19:36.783687] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-08T22:19:36.783757] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-08T22:19:36.822697] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-08T22:19:37.163281] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:37.183942] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-08T22:19:37.617584] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-10-08T22:19:38.356823] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-08T22:19:38.417572] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-08T22:19:39.217532] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-10-08T22:19:39.268835] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T22:19:40.018131] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-08T22:19:40.024200] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-08T22:19:40.817590] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-08T22:19:40.955979] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T22:19:41.022343] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T22:19:41.617559] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-08T22:19:42.239061] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-08T22:19:42.417525] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-08T22:19:42.764506] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T22:19:43.217613] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-08T22:19:44.017529] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-08T22:19:44.112809] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T22:19:44.761759] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-08T22:19:44.817576] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-08T22:19:45.226311] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-08T22:19:45.617570] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-08T22:19:46.417590] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-08T22:19:46.551866] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T22:19:46.659255] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-08T22:19:47.217566] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-08T22:19:47.689104] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-08T22:19:47.693278] [INFO ] [REMOTE ] WBS: Full fetch complete (69810 records). [2025-10-08T22:19:47.693419] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-08T22:19:48.021997] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-08T22:19:48.118864] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-08T22:19:48.118970] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-08T22:19:48.120108] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-08T22:19:48.120197] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-08T22:19:48.121607] [DEBUG] [LOCAL ] WBS: Trimmed 69810 records to 48657 (keeping 200 days of data) [2025-10-08T22:19:48.232498] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-08T22:19:48.446779] [DEBUG] [LOCAL ] WBS: Primary data saved (48657 records). [2025-10-08T22:19:48.446941] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-08T22:19:48.447059] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBS took 31.4s. Estimated remaining: 13m 38s. Rate: 7.1 symbols/min [2025-10-08T22:19:48.620165] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:19:48.643102] [DEBUG] [LOCAL ] WD: Loaded 23197 existing records from primary storage. [2025-10-08T22:19:48.643381] [INFO ] [MAIN ] WD: Loaded 23197 existing records. [2025-10-08T22:19:48.822781] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-08T22:19:48.827009] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:19:48.828297] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-08T22:19:48.828358] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-08T22:19:48.828571] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-08T22:19:48.828628] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-08T22:19:49.198035] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:19:49.568599] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T22:19:49.617508] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-08T22:19:49.851506] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T22:19:50.417608] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-08T22:19:51.217507] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-10-08T22:19:51.509084] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-08T22:19:52.017519] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-08T22:19:52.130268] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-08T22:19:52.284942] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T22:19:52.817605] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-08T22:19:53.617600] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-08T22:19:53.766316] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T22:19:54.269786] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T22:19:54.306518] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-08T22:19:54.417509] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-08T22:19:55.217610] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-08T22:19:55.961674] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T22:19:56.017496] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-08T22:19:56.466211] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T22:19:56.817619] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-08T22:19:57.315478] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-08T22:19:57.617518] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-08T22:19:57.854264] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T22:19:58.150595] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-08T22:19:58.417563] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-08T22:19:59.217565] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-08T22:19:59.841315] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-08T22:20:00.017507] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-08T22:20:00.124744] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T22:20:00.587338] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:20:00.588696] [INFO ] [REMOTE ] WBX: Full fetch complete (24129 records). [2025-10-08T22:20:00.588770] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-08T22:20:00.822811] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-08T22:20:00.965140] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-08T22:20:00.965254] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-08T22:20:00.965925] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-08T22:20:00.966022] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-08T22:20:00.966690] [DEBUG] [LOCAL ] WBX: Trimmed 24129 records to 11011 (keeping 200 days of data) [2025-10-08T22:20:01.034123] [DEBUG] [LOCAL ] WBX: Primary data saved (11011 records). [2025-10-08T22:20:01.034284] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-08T22:20:01.034395] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBX took 33.1s. Estimated remaining: 13m 30s. Rate: 7.1 symbols/min [2025-10-08T22:20:01.225865] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:01.246614] [DEBUG] [LOCAL ] WDH: Loaded 17899 existing records from primary storage. [2025-10-08T22:20:01.246932] [INFO ] [MAIN ] WDH: Loaded 17899 existing records. [2025-10-08T22:20:01.420522] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:01.420818] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-08T22:20:01.420867] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-08T22:20:01.421182] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-08T22:20:01.421245] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-08T22:20:01.624472] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-08T22:20:01.773283] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:02.417525] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-08T22:20:02.660234] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-08T22:20:02.896258] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-08T22:20:03.217582] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-08T22:20:03.806992] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-08T22:20:04.017494] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-08T22:20:04.416517] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-08T22:20:04.817621] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-10-08T22:20:05.252512] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T22:20:05.617623] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-08T22:20:05.874555] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-08T22:20:06.417604] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-08T22:20:07.111831] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T22:20:07.120940] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T22:20:07.217586] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-08T22:20:08.017552] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-08T22:20:08.817522] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-08T22:20:09.059840] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T22:20:09.183753] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-08T22:20:09.186781] [INFO ] [REMOTE ] WCC: Full fetch complete (57450 records). [2025-10-08T22:20:09.186928] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-08T22:20:09.509367] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-08T22:20:09.582479] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-08T22:20:09.582566] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-08T22:20:09.583553] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-08T22:20:09.583683] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-08T22:20:09.584989] [DEBUG] [LOCAL ] WCC: Trimmed 57450 records to 39121 (keeping 200 days of data) [2025-10-08T22:20:09.641141] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-08T22:20:09.842790] [DEBUG] [LOCAL ] WCC: Primary data saved (39121 records). [2025-10-08T22:20:09.842952] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-08T22:20:09.843036] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCC took 36.0s. Estimated remaining: 13m 22s. Rate: 7.1 symbols/min [2025-10-08T22:20:10.007476] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:10.029196] [DEBUG] [LOCAL ] WDI: Loaded 21117 existing records from primary storage. [2025-10-08T22:20:10.029468] [INFO ] [MAIN ] WDI: Loaded 21117 existing records. [2025-10-08T22:20:10.206447] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:10.206693] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-08T22:20:10.206749] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-08T22:20:10.206966] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-08T22:20:10.207023] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-08T22:20:10.420352] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-08T22:20:10.521759] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-08T22:20:10.587979] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:11.218012] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-10-08T22:20:11.629767] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T22:20:12.017575] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-08T22:20:12.080026] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-08T22:20:12.750851] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-08T22:20:12.817520] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-08T22:20:13.513267] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-08T22:20:13.617567] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-08T22:20:14.417570] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-08T22:20:14.516543] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-08T22:20:15.217555] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-08T22:20:15.645980] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-08T22:20:16.017563] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-08T22:20:16.324093] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-08T22:20:16.817517] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-08T22:20:16.863346] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-08T22:20:17.617562] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-08T22:20:17.730912] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-08T22:20:18.403066] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T22:20:18.417525] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-08T22:20:19.217630] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-08T22:20:19.489593] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-08T22:20:20.017679] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-08T22:20:20.353167] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T22:20:20.359315] [INFO ] [REMOTE ] WCN: Full fetch complete (69361 records). [2025-10-08T22:20:20.359515] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-08T22:20:20.761991] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-08T22:20:20.762086] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-08T22:20:20.763198] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-08T22:20:20.763269] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-08T22:20:20.764770] [DEBUG] [LOCAL ] WCN: Trimmed 69361 records to 47963 (keeping 200 days of data) [2025-10-08T22:20:20.820799] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-08T22:20:21.080275] [DEBUG] [LOCAL ] WCN: Primary data saved (47963 records). [2025-10-08T22:20:21.080431] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-08T22:20:21.080521] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCN took 44.7s. Estimated remaining: 13m 13s. Rate: 7.1 symbols/min [2025-10-08T22:20:21.421171] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T22:20:21.617539] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-08T22:20:21.954976] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T22:20:22.417521] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-08T22:20:22.703262] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-08T22:20:23.217539] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-08T22:20:23.561127] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T22:20:24.017562] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-08T22:20:24.399146] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-08T22:20:24.401543] [INFO ] [REMOTE ] WDH: Full fetch complete (23759 records). [2025-10-08T22:20:24.401620] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-08T22:20:24.764392] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-08T22:20:24.764472] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-08T22:20:24.764996] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-08T22:20:24.765059] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-08T22:20:24.765756] [DEBUG] [LOCAL ] WDH: Trimmed 23759 records to 17977 (keeping 200 days of data) [2025-10-08T22:20:24.843006] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-08T22:20:24.879253] [DEBUG] [LOCAL ] WDH: Primary data saved (17977 records). [2025-10-08T22:20:24.879422] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-08T22:20:24.879512] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WDH took 23.8s. Estimated remaining: 13m 5s. Rate: 7.1 symbols/min [2025-10-08T22:20:25.277950] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T22:20:25.617516] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-08T22:20:25.695677] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-08T22:20:26.399617] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-08T22:20:26.417499] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-08T22:20:27.217594] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-08T22:20:27.546300] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T22:20:28.017560] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-08T22:20:28.137114] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T22:20:28.680942] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-08T22:20:28.682894] [INFO ] [REMOTE ] WD: Full fetch complete (33257 records). [2025-10-08T22:20:28.682983] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-08T22:20:28.822814] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-08T22:20:29.103745] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-08T22:20:29.103831] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-08T22:20:29.104612] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-08T22:20:29.104700] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-08T22:20:29.105616] [DEBUG] [LOCAL ] WD: Trimmed 33257 records to 23126 (keeping 200 days of data) [2025-10-08T22:20:29.256844] [DEBUG] [LOCAL ] WD: Primary data saved (23126 records). [2025-10-08T22:20:29.256978] [INFO ] [MAIN ] WD: Full history saved. [2025-10-08T22:20:29.257060] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WD took 40.8s. Estimated remaining: 12m 56s. Rate: 7.1 symbols/min [2025-10-08T22:20:29.713627] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T22:20:29.720889] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-08T22:20:30.743277] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-08T22:20:30.748172] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-08T22:20:31.558097] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-08T22:20:31.560040] [INFO ] [REMOTE ] WDI: Full fetch complete (30616 records). [2025-10-08T22:20:31.560124] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-08T22:20:31.986667] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-08T22:20:31.986786] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-08T22:20:31.987452] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-08T22:20:31.987493] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-08T22:20:31.988315] [DEBUG] [LOCAL ] WDI: Trimmed 30616 records to 21097 (keeping 200 days of data) [2025-10-08T22:20:32.125324] [DEBUG] [LOCAL ] WDI: Primary data saved (21097 records). [2025-10-08T22:20:32.125462] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-08T22:20:32.125545] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 22.3s. Estimated remaining: 12m 47s. Rate: 7.1 symbols/min [2025-10-08T22:20:32.771501] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:32.842038] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:32.814777] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:32.909433] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:32.914300] [DEBUG] [LOCAL ] WEA: Loaded 7396 existing records from primary storage. [2025-10-08T22:20:32.914557] [INFO ] [MAIN ] WEA: Loaded 7396 existing records. [2025-10-08T22:20:33.147523] [DEBUG] [LOCAL ] WEC: Loaded 52184 existing records from primary storage. [2025-10-08T22:20:33.153522] [DEBUG] [LOCAL ] WEAV: Loaded 41854 existing records from primary storage. [2025-10-08T22:20:33.159535] [INFO ] [MAIN ] WEAV: Loaded 41854 existing records. [2025-10-08T22:20:33.159368] [INFO ] [MAIN ] WEC: Loaded 52184 existing records. [2025-10-08T22:20:33.191778] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:33.280900] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-08T22:20:33.359277] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-08T22:20:33.388074] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-08T22:20:33.388003] [DEBUG] [LOCAL ] WDS: Loaded 43122 existing records from primary storage. [2025-10-08T22:20:33.425978] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-08T22:20:33.441613] [INFO ] [MAIN ] WDS: Loaded 43122 existing records. [2025-10-08T22:20:33.549351] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:33.806108] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:33.806410] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-08T22:20:33.760266] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-08T22:20:33.812522] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-08T22:20:33.807259] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-08T22:20:33.818044] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-08T22:20:33.828468] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-08T22:20:33.828398] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-08T22:20:33.910168] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-08T22:20:33.986909] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:34.015741] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-08T22:20:34.083333] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-08T22:20:34.233592] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-08T22:20:34.278372] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-08T22:20:34.739430] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:34.786722] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-10-08T22:20:35.062987] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:35.106166] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-10-08T22:20:35.333288] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:35.328201] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:35.333634] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-10-08T22:20:35.334625] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-10-08T22:20:35.693264] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-08T22:20:35.695485] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-08T22:20:36.314929] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-08T22:20:36.316994] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-08T22:20:36.646390] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T22:20:36.655739] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-08T22:20:36.832450] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T22:20:36.843080] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-08T22:20:36.913942] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T22:20:36.946532] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-08T22:20:37.617548] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-08T22:20:38.219921] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-08T22:20:38.320924] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:20:38.417539] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-08T22:20:38.830783] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-08T22:20:39.217553] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-08T22:20:39.824027] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-08T22:20:39.953932] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-08T22:20:40.017557] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-08T22:20:40.817550] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-08T22:20:41.507729] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-08T22:20:41.617500] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-08T22:20:41.766696] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-08T22:20:42.417554] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-08T22:20:42.987911] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-08T22:20:43.171569] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-08T22:20:43.217532] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-08T22:20:43.663765] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-08T22:20:44.017590] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-08T22:20:44.817571] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-08T22:20:45.316051] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-08T22:20:45.617518] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-08T22:20:46.417599] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-08T22:20:46.616673] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-08T22:20:46.646222] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T22:20:47.217613] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-08T22:20:47.956079] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-08T22:20:48.017565] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-08T22:20:48.817536] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-08T22:20:48.950445] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T22:20:49.538112] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-08T22:20:49.566441] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-08T22:20:49.617500] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-08T22:20:50.417586] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-08T22:20:51.199678] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-08T22:20:51.217549] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-08T22:20:51.928569] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T22:20:52.017526] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-08T22:20:52.092014] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-08T22:20:52.817578] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-08T22:20:53.435430] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-08T22:20:53.617544] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-08T22:20:54.417514] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-08T22:20:54.512553] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T22:20:55.217547] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-08T22:20:55.313740] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T22:20:55.616456] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-08T22:20:55.617853] [INFO ] [REMOTE ] WEA: Full fetch complete (9831 records). [2025-10-08T22:20:55.617932] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-08T22:20:56.030869] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-08T22:20:56.066835] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-08T22:20:56.067156] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-08T22:20:56.067853] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-08T22:20:56.067962] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-08T22:20:56.070372] [DEBUG] [LOCAL ] WEA: Trimmed 9831 records to 7462 (keeping 200 days of data) [2025-10-08T22:20:56.145027] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:20:56.168499] [DEBUG] [LOCAL ] WEA: Primary data saved (7462 records). [2025-10-08T22:20:56.168770] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-08T22:20:56.168919] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 24.0s. Estimated remaining: 12m 40s. Rate: 7.1 symbols/min [2025-10-08T22:20:56.373105] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:20:56.436740] [DEBUG] [LOCAL ] WELL: Loaded 52351 existing records from primary storage. [2025-10-08T22:20:56.437181] [INFO ] [MAIN ] WELL: Loaded 52351 existing records. [2025-10-08T22:20:56.668458] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:20:56.668794] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-08T22:20:56.668849] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-08T22:20:56.669314] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-08T22:20:56.669375] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-08T22:20:56.822799] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-08T22:20:57.077895] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:20:57.617610] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-08T22:20:57.976215] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-08T22:20:58.014142] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:20:58.417558] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-08T22:20:58.855573] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-08T22:20:59.217590] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-08T22:20:59.934002] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-08T22:21:00.017598] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-10-08T22:21:00.817598] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-08T22:21:01.039142] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T22:21:01.617562] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-08T22:21:01.759913] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-08T22:21:02.085128] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-08T22:21:02.417544] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-08T22:21:02.837036] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-08T22:21:02.840974] [INFO ] [REMOTE ] WEAV: Full fetch complete (61610 records). [2025-10-08T22:21:02.841122] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-08T22:21:03.218720] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-08T22:21:03.330305] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-08T22:21:03.330437] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-08T22:21:03.331784] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-08T22:21:03.331855] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-08T22:21:03.333437] [DEBUG] [LOCAL ] WEAV: Trimmed 61610 records to 41861 (keeping 200 days of data) [2025-10-08T22:21:03.624687] [DEBUG] [LOCAL ] WEAV: Primary data saved (41861 records). [2025-10-08T22:21:03.624940] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-08T22:21:03.626596] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 31.5s. Estimated remaining: 12m 31s. Rate: 7.1 symbols/min [2025-10-08T22:21:03.839281] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:03.891179] [DEBUG] [LOCAL ] WES: Loaded 48242 existing records from primary storage. [2025-10-08T22:21:03.891696] [INFO ] [MAIN ] WES: Loaded 48242 existing records. [2025-10-08T22:21:04.022697] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-08T22:21:04.119856] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:04.120215] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-08T22:21:04.120319] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-08T22:21:04.120624] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-08T22:21:04.120746] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-08T22:21:04.256947] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-08T22:21:04.536174] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:04.748544] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-08T22:21:04.817545] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-10-08T22:21:05.622726] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-08T22:21:05.638462] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-08T22:21:06.069426] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T22:21:06.195754] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:21:06.201401] [INFO ] [REMOTE ] WEC: Full fetch complete (75553 records). [2025-10-08T22:21:06.201827] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-08T22:21:06.427252] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-08T22:21:06.668350] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-08T22:21:06.668451] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-08T22:21:06.669883] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-08T22:21:06.669976] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-08T22:21:06.671618] [DEBUG] [LOCAL ] WEC: Trimmed 75553 records to 52168 (keeping 200 days of data) [2025-10-08T22:21:07.060531] [DEBUG] [LOCAL ] WEC: Primary data saved (52168 records). [2025-10-08T22:21:07.060809] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-08T22:21:07.061015] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WEC took 34.9s. Estimated remaining: 12m 23s. Rate: 7.1 symbols/min [2025-10-08T22:21:07.224485] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-08T22:21:07.255429] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:07.293260] [DEBUG] [LOCAL ] WEX: Loaded 33836 existing records from primary storage. [2025-10-08T22:21:07.293587] [INFO ] [MAIN ] WEX: Loaded 33836 existing records. [2025-10-08T22:21:07.486137] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:07.486402] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-08T22:21:07.486450] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-08T22:21:07.486750] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-08T22:21:07.486820] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-08T22:21:07.867367] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:08.017518] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-10-08T22:21:08.121917] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T22:21:08.817518] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-08T22:21:08.938079] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T22:21:09.015221] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-08T22:21:09.617525] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-08T22:21:10.417527] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-08T22:21:10.563052] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T22:21:11.217513] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-08T22:21:11.316860] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-08T22:21:11.385392] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T22:21:12.017637] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-08T22:21:12.817502] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-08T22:21:12.855509] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-08T22:21:13.339165] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-08T22:21:13.617549] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-08T22:21:14.177335] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T22:21:14.180690] [INFO ] [REMOTE ] WDS: Full fetch complete (64302 records). [2025-10-08T22:21:14.180822] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-08T22:21:14.424844] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-08T22:21:14.587473] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-08T22:21:14.587560] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-08T22:21:14.588711] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-08T22:21:14.588777] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-08T22:21:14.590196] [DEBUG] [LOCAL ] WDS: Trimmed 64302 records to 43104 (keeping 200 days of data) [2025-10-08T22:21:14.869158] [DEBUG] [LOCAL ] WDS: Primary data saved (43104 records). [2025-10-08T22:21:14.869287] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-08T22:21:14.869381] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WDS took 42.7s. Estimated remaining: 12m 14s. Rate: 7.1 symbols/min [2025-10-08T22:21:15.048710] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:15.081175] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T22:21:15.096043] [DEBUG] [LOCAL ] WF: Loaded 10762 existing records from primary storage. [2025-10-08T22:21:15.096274] [INFO ] [MAIN ] WF: Loaded 10762 existing records. [2025-10-08T22:21:15.232609] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-08T22:21:15.274629] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:15.274936] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-08T22:21:15.274995] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-08T22:21:15.275175] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-08T22:21:15.275233] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-08T22:21:15.631162] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:16.017586] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-10-08T22:21:16.154911] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-08T22:21:16.817545] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-08T22:21:16.847530] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T22:21:16.970152] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-08T22:21:17.617624] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-08T22:21:18.221161] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-08T22:21:18.417616] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-08T22:21:18.556499] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-08T22:21:19.217700] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-08T22:21:20.017518] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-08T22:21:20.339951] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T22:21:20.638570] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T22:21:20.654873] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-08T22:21:20.817559] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-08T22:21:21.617543] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-08T22:21:22.108820] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-08T22:21:22.417618] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-08T22:21:22.985804] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T22:21:23.217552] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-08T22:21:24.017625] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-08T22:21:24.080338] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T22:21:24.340022] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T22:21:24.817558] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-08T22:21:25.316732] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-08T22:21:25.617692] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-08T22:21:26.417543] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-08T22:21:26.435793] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-08T22:21:26.803179] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-08T22:21:27.217562] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-08T22:21:27.853427] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-08T22:21:28.017547] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-08T22:21:28.802218] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T22:21:28.817498] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-08T22:21:29.080095] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-08T22:21:29.504815] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-08T22:21:29.617565] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-08T22:21:30.417565] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-08T22:21:31.127632] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-08T22:21:31.217577] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-08T22:21:32.017541] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-08T22:21:32.334744] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-08T22:21:32.537712] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T22:21:32.817564] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-08T22:21:33.323382] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T22:21:33.617516] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-08T22:21:34.417563] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-08T22:21:34.651102] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-08T22:21:34.938439] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T22:21:35.217550] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-08T22:21:35.414921] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T22:21:36.017556] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-08T22:21:36.507951] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-08T22:21:36.512373] [INFO ] [REMOTE ] WES: Full fetch complete (70054 records). [2025-10-08T22:21:36.512523] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-08T22:21:36.824716] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-08T22:21:36.963448] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-08T22:21:36.963612] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-08T22:21:36.965743] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-08T22:21:36.965851] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-08T22:21:36.969688] [DEBUG] [LOCAL ] WES: Trimmed 70054 records to 48275 (keeping 200 days of data) [2025-10-08T22:21:37.104942] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T22:21:37.344561] [DEBUG] [LOCAL ] WES: Primary data saved (48275 records). [2025-10-08T22:21:37.344833] [INFO ] [MAIN ] WES: Full history saved. [2025-10-08T22:21:37.345001] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WES took 33.7s. Estimated remaining: 12m 6s. Rate: 7.1 symbols/min [2025-10-08T22:21:37.560029] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:37.618907] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-08T22:21:37.621597] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-08T22:21:37.622480] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-08T22:21:37.830312] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:37.830754] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-08T22:21:37.830864] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-08T22:21:37.831250] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-08T22:21:37.831297] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-08T22:21:38.205212] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:38.417561] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-08T22:21:38.597382] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T22:21:38.691068] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-08T22:21:38.693977] [INFO ] [REMOTE ] WEX: Full fetch complete (50308 records). [2025-10-08T22:21:38.694093] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-08T22:21:39.035828] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-08T22:21:39.126884] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-08T22:21:39.127009] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-08T22:21:39.128451] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-08T22:21:39.128524] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-08T22:21:39.130210] [DEBUG] [LOCAL ] WEX: Trimmed 50308 records to 33689 (keeping 200 days of data) [2025-10-08T22:21:39.227128] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-08T22:21:39.377732] [DEBUG] [LOCAL ] WEX: Primary data saved (33689 records). [2025-10-08T22:21:39.378050] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-08T22:21:39.378252] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WEX took 32.3s. Estimated remaining: 11m 57s. Rate: 7.1 symbols/min [2025-10-08T22:21:39.569622] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:39.597860] [DEBUG] [LOCAL ] WFG: Loaded 24810 existing records from primary storage. [2025-10-08T22:21:39.598288] [INFO ] [MAIN ] WFG: Loaded 24810 existing records. [2025-10-08T22:21:39.794986] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:39.795573] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-08T22:21:39.795630] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-08T22:21:39.795968] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-08T22:21:39.796027] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-08T22:21:40.023661] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-10-08T22:21:40.085789] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-08T22:21:40.205202] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:40.817619] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-08T22:21:41.350059] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-08T22:21:41.351341] [INFO ] [REMOTE ] WF: Full fetch complete (16177 records). [2025-10-08T22:21:41.351416] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-08T22:21:41.617762] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-08T22:21:41.728951] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-08T22:21:41.729088] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-08T22:21:41.729550] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-08T22:21:41.729620] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-08T22:21:41.730457] [DEBUG] [LOCAL ] WF: Trimmed 16177 records to 10780 (keeping 200 days of data) [2025-10-08T22:21:41.823638] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-08T22:21:41.848951] [DEBUG] [LOCAL ] WF: Primary data saved (10780 records). [2025-10-08T22:21:41.849093] [INFO ] [MAIN ] WF: Full history saved. [2025-10-08T22:21:41.849179] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WF took 27.0s. Estimated remaining: 11m 49s. Rate: 7.1 symbols/min [2025-10-08T22:21:42.026785] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:42.067968] [DEBUG] [LOCAL ] WGO: Loaded 38584 existing records from primary storage. [2025-10-08T22:21:42.068287] [INFO ] [MAIN ] WGO: Loaded 38584 existing records. [2025-10-08T22:21:42.253973] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:42.263836] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T22:21:42.263430] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-08T22:21:42.267454] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-08T22:21:42.267939] [INFO ] [REMOTE ] WELL: Full fetch complete (75733 records). [2025-10-08T22:21:42.268035] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-08T22:21:42.268019] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-08T22:21:42.268251] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-08T22:21:42.427257] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-10-08T22:21:42.958807] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:43.054281] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-08T22:21:43.054357] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-08T22:21:43.055508] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-08T22:21:43.055576] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-08T22:21:43.057172] [DEBUG] [LOCAL ] WELL: Trimmed 75733 records to 52339 (keeping 200 days of data) [2025-10-08T22:21:43.249864] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-10-08T22:21:43.409713] [DEBUG] [LOCAL ] WELL: Primary data saved (52339 records). [2025-10-08T22:21:43.409888] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-08T22:21:43.410004] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WELL took 47.2s. Estimated remaining: 11m 40s. Rate: 7.1 symbols/min [2025-10-08T22:21:43.590832] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:21:43.632810] [DEBUG] [LOCAL ] WH: Loaded 45319 existing records from primary storage. [2025-10-08T22:21:43.633235] [INFO ] [MAIN ] WH: Loaded 45319 existing records. [2025-10-08T22:21:43.810531] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T22:21:43.824328] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:21:43.828890] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-08T22:21:43.828940] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-08T22:21:43.829175] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-08T22:21:43.829234] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-08T22:21:44.023053] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-08T22:21:44.188012] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:21:44.656147] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T22:21:44.817506] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-10-08T22:21:45.209409] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T22:21:45.617705] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-08T22:21:46.225884] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-08T22:21:46.417534] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-08T22:21:47.184323] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T22:21:47.217491] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-08T22:21:48.017548] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-08T22:21:48.433358] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-08T22:21:48.635205] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-08T22:21:48.817604] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-08T22:21:49.323885] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-08T22:21:49.617587] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-08T22:21:50.417557] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-08T22:21:50.660810] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-08T22:21:51.119183] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-08T22:21:51.217556] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-08T22:21:51.499057] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T22:21:52.017551] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-08T22:21:52.659087] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-08T22:21:52.817539] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-08T22:21:53.370520] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:21:53.617577] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-08T22:21:54.417634] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-08T22:21:54.718411] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T22:21:54.802306] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T22:21:55.217561] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-08T22:21:55.489263] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-08T22:21:56.017548] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-08T22:21:56.817610] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-08T22:21:57.093947] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-08T22:21:57.133599] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-08T22:21:57.617566] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-08T22:21:57.880122] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-08T22:21:58.417607] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-08T22:21:59.217578] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-08T22:21:59.701684] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-08T22:21:59.984310] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-08T22:22:00.017501] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-08T22:22:00.339799] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T22:22:00.817524] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-08T22:22:01.617563] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-08T22:22:01.942244] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T22:22:02.417573] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-08T22:22:02.944276] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T22:22:03.012159] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-08T22:22:03.217581] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-08T22:22:03.748127] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-08T22:22:04.017586] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-08T22:22:04.428930] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-08T22:22:04.817594] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-08T22:22:05.617574] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-08T22:22:05.794797] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-08T22:22:06.004909] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-08T22:22:06.414078] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T22:22:06.419591] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-08T22:22:07.217561] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-08T22:22:07.921528] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T22:22:08.017537] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-08T22:22:08.096495] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T22:22:08.817570] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-08T22:22:09.617585] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-08T22:22:10.321369] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-08T22:22:10.342095] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T22:22:10.345124] [INFO ] [REMOTE ] WFG: Full fetch complete (35919 records). [2025-10-08T22:22:10.359321] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-08T22:22:10.396210] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-08T22:22:10.422727] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-08T22:22:10.825289] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-08T22:22:10.825397] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-08T22:22:10.826300] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-08T22:22:10.826367] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-08T22:22:10.827361] [DEBUG] [LOCAL ] WFG: Trimmed 35919 records to 24788 (keeping 200 days of data) [2025-10-08T22:22:11.009110] [DEBUG] [LOCAL ] WFG: Primary data saved (24788 records). [2025-10-08T22:22:11.009279] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-08T22:22:11.009415] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WFG took 31.6s. Estimated remaining: 11m 32s. Rate: 7.1 symbols/min [2025-10-08T22:22:11.220921] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-08T22:22:11.222351] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:11.267184] [DEBUG] [LOCAL ] WHD: Loaded 40105 existing records from primary storage. [2025-10-08T22:22:11.267563] [INFO ] [MAIN ] WHD: Loaded 40105 existing records. [2025-10-08T22:22:11.462969] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:11.463200] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-08T22:22:11.463310] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-08T22:22:11.463681] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-08T22:22:11.463740] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-08T22:22:11.782266] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T22:22:11.802936] [INFO ] [REMOTE ] WGO: Full fetch complete (57490 records). [2025-10-08T22:22:11.823714] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-08T22:22:11.908876] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:12.022674] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-10-08T22:22:12.305660] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-08T22:22:12.305758] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-08T22:22:12.306741] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-08T22:22:12.306803] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-08T22:22:12.308006] [DEBUG] [LOCAL ] WGO: Trimmed 57490 records to 38466 (keeping 200 days of data) [2025-10-08T22:22:12.547302] [DEBUG] [LOCAL ] WGO: Primary data saved (38466 records). [2025-10-08T22:22:12.547452] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-08T22:22:12.547550] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WGO took 30.7s. Estimated remaining: 11m 24s. Rate: 7.1 symbols/min [2025-10-08T22:22:12.721574] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:12.727457] [DEBUG] [LOCAL ] WHG: Loaded 3250 existing records from primary storage. [2025-10-08T22:22:12.727639] [INFO ] [MAIN ] WHG: Loaded 3250 existing records. [2025-10-08T22:22:12.819211] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-08T22:22:12.949148] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:12.951340] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:22:12.961951] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-08T22:22:12.962213] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-08T22:22:12.962712] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-08T22:22:12.962780] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-08T22:22:13.342876] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:13.364242] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-08T22:22:13.617602] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-10-08T22:22:14.182978] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-08T22:22:14.417505] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-08T22:22:14.743116] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-08T22:22:15.217561] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-08T22:22:15.818475] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-08T22:22:16.017551] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-08T22:22:16.817588] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-08T22:22:17.011033] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-08T22:22:17.134694] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-08T22:22:17.323554] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-08T22:22:17.617580] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-08T22:22:18.417565] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-08T22:22:18.722470] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-08T22:22:19.217552] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-08T22:22:19.803752] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T22:22:19.822073] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T22:22:20.017607] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-08T22:22:20.817608] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-08T22:22:21.300805] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T22:22:21.304184] [INFO ] [REMOTE ] WH: Full fetch complete (64917 records). [2025-10-08T22:22:21.304332] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-08T22:22:21.622795] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-08T22:22:21.695508] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-08T22:22:21.695591] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-08T22:22:21.696615] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-08T22:22:21.696709] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-08T22:22:21.698167] [DEBUG] [LOCAL ] WH: Trimmed 64917 records to 45268 (keeping 200 days of data) [2025-10-08T22:22:21.986429] [DEBUG] [LOCAL ] WH: Primary data saved (45268 records). [2025-10-08T22:22:21.986588] [INFO ] [MAIN ] WH: Full history saved. [2025-10-08T22:22:21.986706] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WH took 38.6s. Estimated remaining: 11m 15s. Rate: 7.1 symbols/min [2025-10-08T22:22:22.171461] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-08T22:22:22.197066] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:22.241122] [DEBUG] [LOCAL ] WHR: Loaded 48284 existing records from primary storage. [2025-10-08T22:22:22.241470] [INFO ] [MAIN ] WHR: Loaded 48284 existing records. [2025-10-08T22:22:22.421958] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:22.422123] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-08T22:22:22.423501] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-08T22:22:22.423833] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-08T22:22:22.424312] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-08T22:22:22.432913] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-08T22:22:22.455997] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-08T22:22:22.884254] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:22.946957] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-08T22:22:23.217553] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-08T22:22:23.705694] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-08T22:22:24.017553] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-08T22:22:24.556622] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:22:24.561547] [INFO ] [REMOTE ] WFC: Full fetch complete (77792 records). [2025-10-08T22:22:24.561803] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-08T22:22:24.822770] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-08T22:22:25.008044] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-08T22:22:25.008186] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-08T22:22:25.010242] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-08T22:22:25.010316] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-08T22:22:25.012801] [DEBUG] [LOCAL ] WFC: Trimmed 77792 records to 53748 (keeping 200 days of data) [2025-10-08T22:22:25.393560] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-08T22:22:25.423564] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-08T22:22:25.423716] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-08T22:22:25.423816] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WFC took 48.1s. Estimated remaining: 11m 7s. Rate: 7.1 symbols/min [2025-10-08T22:22:25.594443] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:25.601629] [DEBUG] [LOCAL ] WIA: Loaded 4903 existing records from primary storage. [2025-10-08T22:22:25.601863] [INFO ] [MAIN ] WIA: Loaded 4903 existing records. [2025-10-08T22:22:25.622860] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-08T22:22:25.783001] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:25.783225] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-08T22:22:25.783272] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-08T22:22:25.783478] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-08T22:22:25.783535] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-08T22:22:26.136860] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:26.277550] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-08T22:22:26.417535] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-10-08T22:22:27.037301] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-08T22:22:27.217555] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-08T22:22:27.677781] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-08T22:22:28.017540] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-08T22:22:28.817566] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-10-08T22:22:29.617509] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-08T22:22:29.720311] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T22:22:30.026343] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-08T22:22:30.389961] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T22:22:30.417539] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-08T22:22:30.743292] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-08T22:22:30.744056] [INFO ] [REMOTE ] WHG: Full fetch complete (4578 records). [2025-10-08T22:22:30.744124] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-08T22:22:31.102489] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-08T22:22:31.102580] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-08T22:22:31.102743] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-08T22:22:31.102804] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-08T22:22:31.103162] [DEBUG] [LOCAL ] WHG: Trimmed 4578 records to 3243 (keeping 200 days of data) [2025-10-08T22:22:31.123547] [DEBUG] [LOCAL ] WHG: Primary data saved (3243 records). [2025-10-08T22:22:31.123632] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-08T22:22:31.123749] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 18.6s. Estimated remaining: 10m 58s. Rate: 7.1 symbols/min [2025-10-08T22:22:31.222295] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-08T22:22:31.296438] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:31.310119] [DEBUG] [LOCAL ] WINN: Loaded 11566 existing records from primary storage. [2025-10-08T22:22:31.310361] [INFO ] [MAIN ] WINN: Loaded 11566 existing records. [2025-10-08T22:22:31.485679] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:31.485907] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-08T22:22:31.485953] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-08T22:22:31.486118] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-08T22:22:31.486175] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-08T22:22:31.841199] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:32.017556] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-10-08T22:22:32.611482] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T22:22:32.812885] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-08T22:22:32.817486] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-08T22:22:33.617534] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-08T22:22:33.708007] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T22:22:34.227787] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-08T22:22:34.417547] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-08T22:22:34.996167] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-08T22:22:35.217548] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-08T22:22:36.017590] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-08T22:22:36.378940] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-08T22:22:36.817580] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-08T22:22:37.420264] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-08T22:22:37.617563] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-08T22:22:37.696190] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T22:22:38.007585] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-08T22:22:38.417574] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-08T22:22:39.006752] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-08T22:22:39.217624] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-08T22:22:39.826254] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-08T22:22:40.017573] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-08T22:22:40.817621] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-08T22:22:41.463891] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T22:22:41.617555] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-08T22:22:42.227902] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-08T22:22:42.417554] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-08T22:22:43.052744] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-08T22:22:43.197873] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-08T22:22:43.217499] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-08T22:22:44.017591] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-08T22:22:44.065966] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-08T22:22:44.640002] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-08T22:22:44.817524] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-08T22:22:45.617569] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-08T22:22:46.422802] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-08T22:22:46.444256] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T22:22:47.155354] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:22:47.196453] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T22:22:47.217537] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-08T22:22:47.906741] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-08T22:22:48.017553] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-08T22:22:48.817589] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-08T22:22:49.045455] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T22:22:49.355321] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:22:49.357330] [INFO ] [REMOTE ] WIA: Full fetch complete (7321 records). [2025-10-08T22:22:49.357562] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-08T22:22:49.622744] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-08T22:22:49.721805] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-08T22:22:49.721891] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-08T22:22:49.722158] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-08T22:22:49.722221] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-08T22:22:49.722875] [DEBUG] [LOCAL ] WIA: Trimmed 7321 records to 4969 (keeping 200 days of data) [2025-10-08T22:22:49.752631] [DEBUG] [LOCAL ] WIA: Primary data saved (4969 records). [2025-10-08T22:22:49.752746] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-08T22:22:49.752828] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WIA took 24.3s. Estimated remaining: 10m 50s. Rate: 7.1 symbols/min [2025-10-08T22:22:49.921785] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:22:49.972573] [DEBUG] [LOCAL ] WIT: Loaded 52389 existing records from primary storage. [2025-10-08T22:22:49.972938] [INFO ] [MAIN ] WIT: Loaded 52389 existing records. [2025-10-08T22:22:50.146385] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:22:50.146614] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-08T22:22:50.146692] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-08T22:22:50.147007] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-08T22:22:50.147066] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-08T22:22:50.422547] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-08T22:22:50.502258] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:22:50.546634] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T22:22:51.217585] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-08T22:22:52.017509] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-08T22:22:52.120703] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-08T22:22:52.817601] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-10-08T22:22:53.617608] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-08T22:23:05.423470] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (13.41 seconds). [2025-10-08T22:23:05.426619] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-08T22:23:05.970955] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (14.75 seconds). [2025-10-08T22:23:05.980804] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-08T22:23:06.195554] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (13.38 seconds). [2025-10-08T22:23:06.206236] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-08T22:23:06.429486] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-08T22:23:06.432716] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-08T22:23:07.230848] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-08T22:23:07.234395] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-08T22:23:07.314119] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T22:23:07.318618] [INFO ] [REMOTE ] WHD: Full fetch complete (57568 records). [2025-10-08T22:23:07.319343] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-08T22:23:07.460789] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (13.84 seconds). [2025-10-08T22:23:07.542507] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-08T22:23:07.777192] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-08T22:23:07.777373] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-08T22:23:07.778672] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-08T22:23:07.778739] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-08T22:23:07.780203] [DEBUG] [LOCAL ] WHD: Trimmed 57568 records to 40002 (keeping 200 days of data) [2025-10-08T22:23:07.883959] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-08T22:23:07.888436] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-08T22:23:08.051034] [DEBUG] [LOCAL ] WHD: Primary data saved (40002 records). [2025-10-08T22:23:08.051190] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-08T22:23:08.051318] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WHD took 57.0s. Estimated remaining: 10m 42s. Rate: 7.1 symbols/min [2025-10-08T22:23:08.243914] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:08.267040] [DEBUG] [LOCAL ] WIW: Loaded 20492 existing records from primary storage. [2025-10-08T22:23:08.267369] [INFO ] [MAIN ] WIW: Loaded 20492 existing records. [2025-10-08T22:23:08.357038] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-08T22:23:08.404463] [INFO ] [REMOTE ] WINN: Full fetch complete (17420 records). [2025-10-08T22:23:08.404863] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-08T22:23:08.574415] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-08T22:23:08.675668] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-08T22:23:08.645986] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:08.676883] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-08T22:23:08.677247] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-08T22:23:08.717339] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-08T22:23:08.738516] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-08T22:23:09.130925] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-08T22:23:09.170992] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-08T22:23:09.207225] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-08T22:23:09.223957] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-08T22:23:09.262263] [DEBUG] [LOCAL ] WINN: Trimmed 17420 records to 11534 (keeping 200 days of data) [2025-10-08T22:23:09.369274] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:09.385224] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-10-08T22:23:09.407830] [DEBUG] [LOCAL ] WINN: Primary data saved (11534 records). [2025-10-08T22:23:09.408042] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-08T22:23:09.408139] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WINN took 38.3s. Estimated remaining: 10m 33s. Rate: 7.1 symbols/min [2025-10-08T22:23:09.578203] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:09.617495] [DEBUG] [LOCAL ] WK: Loaded 37238 existing records from primary storage. [2025-10-08T22:23:09.617831] [INFO ] [MAIN ] WK: Loaded 37238 existing records. [2025-10-08T22:23:09.803614] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:09.803997] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-08T22:23:09.804064] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-08T22:23:09.804345] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-08T22:23:09.804413] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-08T22:23:09.945305] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-08T22:23:10.009698] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-08T22:23:10.217328] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:10.217781] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-10-08T22:23:10.402332] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T22:23:10.412372] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-08T22:23:10.461870] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T22:23:10.467619] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-08T22:23:11.289631] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-08T22:23:11.296413] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-08T22:23:11.504346] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-08T22:23:11.509709] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-08T22:23:11.758200] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T22:23:11.768676] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-08T22:23:11.836894] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T22:23:11.848310] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-08T22:23:12.123393] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-08T22:23:12.127458] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-08T22:23:12.485030] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-08T22:23:12.492372] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-08T22:23:13.128873] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-08T22:23:13.169019] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-08T22:23:13.172869] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T22:23:13.183991] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-08T22:23:13.629899] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-08T22:23:13.643782] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-08T22:23:13.692346] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-08T22:23:13.700166] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-08T22:23:14.288804] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-08T22:23:14.294099] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-08T22:23:14.466354] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T22:23:14.477471] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-08T22:23:14.642161] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-08T22:23:14.649960] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-08T22:23:15.067672] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T22:23:15.071879] [INFO ] [REMOTE ] WHR: Full fetch complete (68849 records). [2025-10-08T22:23:15.072004] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-08T22:23:15.343285] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T22:23:15.414053] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-08T22:23:15.524462] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-08T22:23:15.524559] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-08T22:23:15.525614] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-08T22:23:15.525705] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-08T22:23:15.527158] [DEBUG] [LOCAL ] WHR: Trimmed 68849 records to 48375 (keeping 200 days of data) [2025-10-08T22:23:15.814537] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-08T22:23:15.855484] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-08T22:23:15.935981] [DEBUG] [LOCAL ] WHR: Primary data saved (48375 records). [2025-10-08T22:23:15.936133] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-08T22:23:15.936260] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WHR took 53.9s. Estimated remaining: 10m 25s. Rate: 7.1 symbols/min [2025-10-08T22:23:16.024490] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-08T22:23:16.110374] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:16.148571] [DEBUG] [LOCAL ] WKC: Loaded 34750 existing records from primary storage. [2025-10-08T22:23:16.148897] [INFO ] [MAIN ] WKC: Loaded 34750 existing records. [2025-10-08T22:23:16.287227] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T22:23:16.348710] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:16.348963] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-08T22:23:16.349037] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-08T22:23:16.349337] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-08T22:23:16.349397] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-08T22:23:16.705373] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:16.817550] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-10-08T22:23:17.617567] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-08T22:23:17.998502] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T22:23:18.041904] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T22:23:18.417556] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-08T22:23:19.097879] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T22:23:19.217524] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-08T22:23:19.345150] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-08T22:23:20.017619] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-08T22:23:20.563011] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-08T22:23:20.788639] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-08T22:23:20.817608] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-08T22:23:21.617706] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-08T22:23:22.208620] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T22:23:22.417556] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-08T22:23:23.062837] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-08T22:23:23.217572] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-08T22:23:23.479691] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-08T22:23:24.017671] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-08T22:23:24.096421] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-08T22:23:24.817571] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-08T22:23:25.383177] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-08T22:23:25.534002] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-08T22:23:25.535993] [INFO ] [REMOTE ] WIW: Full fetch complete (29684 records). [2025-10-08T22:23:25.536088] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-08T22:23:25.622676] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-08T22:23:25.936284] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-08T22:23:25.936445] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-08T22:23:25.937419] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-08T22:23:25.937496] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-08T22:23:25.938537] [DEBUG] [LOCAL ] WIW: Trimmed 29684 records to 20456 (keeping 200 days of data) [2025-10-08T22:23:26.068349] [DEBUG] [LOCAL ] WIW: Primary data saved (20456 records). [2025-10-08T22:23:26.068479] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-08T22:23:26.068591] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIW took 18.0s. Estimated remaining: 10m 16s. Rate: 7.1 symbols/min [2025-10-08T22:23:26.235514] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:26.279737] [DEBUG] [LOCAL ] WLK: Loaded 45565 existing records from primary storage. [2025-10-08T22:23:26.280083] [INFO ] [MAIN ] WLK: Loaded 45565 existing records. [2025-10-08T22:23:26.426114] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-08T22:23:26.457173] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:26.457683] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-08T22:23:26.457755] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-08T22:23:26.458031] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-08T22:23:26.458118] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-08T22:23:26.818854] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:27.217547] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-10-08T22:23:27.255457] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-08T22:23:28.017520] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-08T22:23:28.227215] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-08T22:23:28.761530] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-08T22:23:28.817580] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-08T22:23:29.333993] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-08T22:23:29.617560] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-08T22:23:30.295022] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:23:30.417554] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-08T22:23:31.000839] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T22:23:31.217547] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-08T22:23:31.869053] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-08T22:23:32.017599] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-08T22:23:32.590178] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T22:23:32.817596] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-08T22:23:33.550090] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-08T22:23:33.617612] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-08T22:23:34.241614] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-08T22:23:34.248121] [INFO ] [REMOTE ] WIT: Full fetch complete (75702 records). [2025-10-08T22:23:34.248394] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-08T22:23:34.428047] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-08T22:23:34.677930] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-08T22:23:34.678052] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-08T22:23:34.679280] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-08T22:23:34.679352] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-08T22:23:34.683172] [DEBUG] [LOCAL ] WIT: Trimmed 75702 records to 52402 (keeping 200 days of data) [2025-10-08T22:23:34.960087] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-08T22:23:35.089743] [DEBUG] [LOCAL ] WIT: Primary data saved (52402 records). [2025-10-08T22:23:35.089980] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-08T22:23:35.090153] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIT took 45.3s. Estimated remaining: 10m 8s. Rate: 7.1 symbols/min [2025-10-08T22:23:35.222755] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-08T22:23:35.296786] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:35.310180] [DEBUG] [LOCAL ] WLKP: Loaded 6905 existing records from primary storage. [2025-10-08T22:23:35.311273] [INFO ] [MAIN ] WLKP: Loaded 6905 existing records. [2025-10-08T22:23:35.560145] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:35.560610] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-08T22:23:35.560786] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-08T22:23:35.561084] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-08T22:23:35.561145] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-08T22:23:35.937584] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:35.970786] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-08T22:23:36.017604] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-08T22:23:36.574285] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:23:36.817701] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-08T22:23:37.144305] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-08T22:23:37.617566] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-10-08T22:23:38.343850] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T22:23:38.390811] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-08T22:23:38.417535] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-08T22:23:39.153411] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-08T22:23:39.217601] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-08T22:23:40.017595] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-08T22:23:40.504277] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-08T22:23:40.621723] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-08T22:23:40.817580] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-08T22:23:41.617634] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-08T22:23:42.134032] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-08T22:23:42.253985] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-08T22:23:42.417574] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-08T22:23:43.217608] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-08T22:23:43.571922] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T22:23:43.575147] [INFO ] [REMOTE ] WKC: Full fetch complete (50604 records). [2025-10-08T22:23:43.575296] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-08T22:23:43.952803] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-08T22:23:43.952891] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-08T22:23:43.953786] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-08T22:23:43.953848] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-08T22:23:43.954963] [DEBUG] [LOCAL ] WKC: Trimmed 50604 records to 34635 (keeping 200 days of data) [2025-10-08T22:23:44.022219] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-08T22:23:44.176573] [DEBUG] [LOCAL ] WKC: Primary data saved (34635 records). [2025-10-08T22:23:44.176752] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-08T22:23:44.176883] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WKC took 28.2s. Estimated remaining: 9m 59s. Rate: 7.1 symbols/min [2025-10-08T22:23:44.346032] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:44.346193] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-08T22:23:44.346231] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-08T22:23:44.346339] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-08T22:23:44.346380] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-08T22:23:44.346420] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-08T22:23:44.346499] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-08T22:23:44.701586] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:44.768131] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-08T22:23:44.822628] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-08T22:23:44.838558] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-08T22:23:45.601924] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-08T22:23:45.617535] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-08T22:23:46.417554] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-08T22:23:46.867995] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-08T22:23:46.871193] [INFO ] [REMOTE ] WK: Full fetch complete (52719 records). [2025-10-08T22:23:46.871301] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-08T22:23:47.183725] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-08T22:23:47.221812] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-10-08T22:23:47.341130] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-08T22:23:47.341228] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-08T22:23:47.342364] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-08T22:23:47.342428] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-08T22:23:47.343885] [DEBUG] [LOCAL ] WK: Trimmed 52719 records to 37192 (keeping 200 days of data) [2025-10-08T22:23:47.579386] [DEBUG] [LOCAL ] WK: Primary data saved (37192 records). [2025-10-08T22:23:47.579559] [INFO ] [MAIN ] WK: Full history saved. [2025-10-08T22:23:47.579673] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WK took 38.2s. Estimated remaining: 9m 51s. Rate: 7.1 symbols/min [2025-10-08T22:23:47.689323] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-08T22:23:47.762150] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:47.804123] [DEBUG] [LOCAL ] WLY: Loaded 29501 existing records from primary storage. [2025-10-08T22:23:47.804827] [INFO ] [MAIN ] WLY: Loaded 29501 existing records. [2025-10-08T22:23:47.990319] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:47.990607] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-08T22:23:47.990691] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-08T22:23:47.990956] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-08T22:23:47.991014] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-08T22:23:48.022706] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-08T22:23:48.349909] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:48.438608] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-08T22:23:48.817565] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-08T22:23:49.165343] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-08T22:23:49.617605] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-08T22:23:49.975600] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-08T22:23:50.417562] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-10-08T22:23:51.217615] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-08T22:23:51.516400] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-08T22:23:52.017607] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-08T22:23:52.522257] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-08T22:23:52.817534] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-08T22:23:52.903160] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T22:23:53.267481] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T22:23:53.617580] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-08T22:23:54.417537] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-08T22:23:54.567538] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-08T22:23:55.159024] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T22:23:55.217581] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-08T22:23:56.017619] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-08T22:23:56.237443] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-08T22:23:56.460820] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T22:23:56.462023] [INFO ] [REMOTE ] WLKP: Full fetch complete (10279 records). [2025-10-08T22:23:56.462099] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-08T22:23:56.831457] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-08T22:23:56.843946] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-08T22:23:56.844050] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-08T22:23:56.844331] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-08T22:23:56.844371] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-08T22:23:56.844953] [DEBUG] [LOCAL ] WLKP: Trimmed 10279 records to 6909 (keeping 200 days of data) [2025-10-08T22:23:56.893320] [DEBUG] [LOCAL ] WLKP: Primary data saved (6909 records). [2025-10-08T22:23:56.893516] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-08T22:23:56.893637] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 21.8s. Estimated remaining: 9m 42s. Rate: 7.1 symbols/min [2025-10-08T22:23:57.079935] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:23:57.133712] [DEBUG] [LOCAL ] WM: Loaded 50967 existing records from primary storage. [2025-10-08T22:23:57.134058] [INFO ] [MAIN ] WM: Loaded 50967 existing records. [2025-10-08T22:23:57.311540] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:23:57.311842] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-08T22:23:57.311890] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-08T22:23:57.312153] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-08T22:23:57.312209] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-08T22:23:57.622750] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-08T22:23:57.680283] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:23:58.268108] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-08T22:23:58.289718] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-08T22:23:58.417498] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-08T22:23:58.779626] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-08T22:23:59.217553] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-08T22:23:59.644732] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-08T22:24:00.017612] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-08T22:24:00.817576] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-08T22:24:01.424900] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-08T22:24:01.617597] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-08T22:24:02.248566] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-08T22:24:02.417543] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-10-08T22:24:02.664982] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-08T22:24:03.217542] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-08T22:24:04.017579] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-08T22:24:04.433262] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-08T22:24:04.787411] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-08T22:24:04.817504] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-08T22:24:05.414820] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-08T22:24:05.617595] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-08T22:24:05.801539] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-08T22:24:05.805859] [INFO ] [REMOTE ] WLK: Full fetch complete (63232 records). [2025-10-08T22:24:05.806059] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-08T22:24:05.964832] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-08T22:24:06.425600] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-08T22:24:06.426736] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-08T22:24:06.428043] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-08T22:24:06.429754] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-08T22:24:06.430053] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-08T22:24:06.431843] [DEBUG] [LOCAL ] WLK: Trimmed 63232 records to 45538 (keeping 200 days of data) [2025-10-08T22:24:06.769793] [DEBUG] [LOCAL ] WLK: Primary data saved (45538 records). [2025-10-08T22:24:06.769959] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-08T22:24:06.770054] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLK took 40.7s. Estimated remaining: 9m 34s. Rate: 7.1 symbols/min [2025-10-08T22:24:06.976817] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:07.029668] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-08T22:24:07.030005] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-08T22:24:07.204447] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:07.204683] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-08T22:24:07.204740] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-08T22:24:07.204954] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-08T22:24:07.205010] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-08T22:24:07.225331] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-08T22:24:07.557952] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:07.836562] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-08T22:24:08.017532] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-10-08T22:24:08.817612] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-08T22:24:09.171326] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-08T22:24:09.316691] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-08T22:24:09.610508] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-08T22:24:09.623537] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-08T22:24:10.417723] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-08T22:24:10.721778] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-08T22:24:11.201709] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-08T22:24:11.217495] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-08T22:24:12.017553] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-08T22:24:12.817516] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-08T22:24:13.063322] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-08T22:24:13.112207] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-08T22:24:13.617552] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-08T22:24:14.417555] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-08T22:24:14.649921] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-08T22:24:15.217523] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-08T22:24:15.460680] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T22:24:15.512223] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-08T22:24:15.593503] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-08T22:24:15.594237] [INFO ] [REMOTE ] WLTG: Full fetch complete (1673 records). [2025-10-08T22:24:15.594307] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-08T22:24:15.776678] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T22:24:15.776877] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-08T22:24:15.776923] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-08T22:24:15.776987] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-08T22:24:15.777051] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-08T22:24:15.777087] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-08T22:24:15.777126] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-08T22:24:15.777184] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLTG took 31.6s. Estimated remaining: 9m 26s. Rate: 7.1 symbols/min [2025-10-08T22:24:15.941415] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:15.956591] [DEBUG] [LOCAL ] WMK: Loaded 14558 existing records from primary storage. [2025-10-08T22:24:15.956853] [INFO ] [MAIN ] WMK: Loaded 14558 existing records. [2025-10-08T22:24:16.022807] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-08T22:24:16.137804] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:16.138078] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-08T22:24:16.138133] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-08T22:24:16.138353] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-08T22:24:16.138419] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-08T22:24:16.491338] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:16.817577] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-08T22:24:17.617276] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-08T22:24:17.626905] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-08T22:24:18.417515] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-10-08T22:24:18.569771] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-08T22:24:18.572402] [INFO ] [REMOTE ] WLY: Full fetch complete (42720 records). [2025-10-08T22:24:18.572484] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-08T22:24:18.961747] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-08T22:24:19.020253] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-08T22:24:19.020353] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-08T22:24:19.021383] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-08T22:24:19.021486] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-08T22:24:19.029118] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-08T22:24:19.032370] [DEBUG] [LOCAL ] WLY: Trimmed 42720 records to 29488 (keeping 200 days of data) [2025-10-08T22:24:19.214751] [DEBUG] [LOCAL ] WLY: Primary data saved (29488 records). [2025-10-08T22:24:19.214890] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-08T22:24:19.214971] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 31.6s. Estimated remaining: 9m 17s. Rate: 7.1 symbols/min [2025-10-08T22:24:19.225316] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-08T22:24:19.417692] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:19.475783] [DEBUG] [LOCAL ] WMS: Loaded 39589 existing records from primary storage. [2025-10-08T22:24:19.476123] [INFO ] [MAIN ] WMS: Loaded 39589 existing records. [2025-10-08T22:24:19.655174] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:19.655412] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-08T22:24:19.655458] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-08T22:24:19.655696] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-08T22:24:19.655754] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-08T22:24:20.023325] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:20.023397] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-08T22:24:20.754371] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-08T22:24:20.817508] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-10-08T22:24:21.159269] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-08T22:24:21.617549] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-08T22:24:22.036228] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T22:24:22.134345] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-08T22:24:22.417622] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-08T22:24:23.217556] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-08T22:24:24.017530] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-08T22:24:24.505840] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T22:24:24.567058] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-08T22:24:24.760543] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-08T22:24:24.817510] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-08T22:24:25.617558] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-08T22:24:26.417510] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-08T22:24:26.734584] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T22:24:26.977522] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T22:24:27.217517] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-08T22:24:27.463580] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-08T22:24:28.017564] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-08T22:24:28.822776] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-08T22:24:28.835125] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-08T22:24:29.047441] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T22:24:29.617625] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-08T22:24:30.417584] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-08T22:24:30.836979] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-08T22:24:31.217589] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-08T22:24:31.585167] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-08T22:24:31.943109] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-08T22:24:31.963761] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-08T22:24:32.017582] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-08T22:24:32.817716] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-08T22:24:33.617625] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-08T22:24:34.002674] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-08T22:24:34.417574] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-08T22:24:34.490630] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T22:24:35.121280] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-08T22:24:35.161628] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T22:24:35.217582] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-08T22:24:36.017572] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-08T22:24:36.594802] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-08T22:24:36.817570] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-08T22:24:37.286962] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-08T22:24:37.358730] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:24:37.362833] [INFO ] [REMOTE ] WM: Full fetch complete (73768 records). [2025-10-08T22:24:37.362977] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-08T22:24:37.622628] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-08T22:24:37.755258] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-08T22:24:37.755349] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-08T22:24:37.756463] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-08T22:24:37.756532] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-08T22:24:37.758198] [DEBUG] [LOCAL ] WM: Trimmed 73768 records to 50985 (keeping 200 days of data) [2025-10-08T22:24:38.086281] [DEBUG] [LOCAL ] WM: Primary data saved (50985 records). [2025-10-08T22:24:38.086426] [INFO ] [MAIN ] WM: Full history saved. [2025-10-08T22:24:38.087901] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WM took 41.2s. Estimated remaining: 9m 9s. Rate: 7.1 symbols/min [2025-10-08T22:24:38.255934] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:38.312263] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-08T22:24:38.312615] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-08T22:24:38.422584] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-08T22:24:38.490165] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:38.490362] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-08T22:24:38.490408] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-08T22:24:38.490847] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-08T22:24:38.490904] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-08T22:24:38.847365] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:39.114746] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-08T22:24:39.139581] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T22:24:39.217559] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-08T22:24:40.017601] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-08T22:24:40.817609] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-10-08T22:24:41.184560] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-08T22:24:41.617584] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-08T22:24:41.766398] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T22:24:42.417540] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-08T22:24:42.652790] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-08T22:24:43.052619] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-08T22:24:43.217576] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-08T22:24:44.017574] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-08T22:24:44.086045] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T22:24:44.608904] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T22:24:44.817552] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-08T22:24:44.833943] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-08T22:24:44.835416] [INFO ] [REMOTE ] WMK: Full fetch complete (19759 records). [2025-10-08T22:24:44.835487] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-08T22:24:45.201078] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-08T22:24:45.201177] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-08T22:24:45.201658] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-08T22:24:45.201721] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-08T22:24:45.202284] [DEBUG] [LOCAL ] WMK: Trimmed 19759 records to 14571 (keeping 200 days of data) [2025-10-08T22:24:45.296372] [DEBUG] [LOCAL ] WMK: Primary data saved (14571 records). [2025-10-08T22:24:45.296549] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-08T22:24:45.296688] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WMK took 29.5s. Estimated remaining: 9m 0s. Rate: 7.1 symbols/min [2025-10-08T22:24:45.468443] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:45.509217] [DEBUG] [LOCAL ] WNC: Loaded 38981 existing records from primary storage. [2025-10-08T22:24:45.509571] [INFO ] [MAIN ] WNC: Loaded 38981 existing records. [2025-10-08T22:24:45.622855] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-08T22:24:45.698849] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:45.699229] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-08T22:24:45.699289] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-08T22:24:45.700001] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-08T22:24:45.700064] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-08T22:24:46.074809] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:46.417588] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-10-08T22:24:46.810827] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T22:24:46.814323] [INFO ] [REMOTE ] WMS: Full fetch complete (57184 records). [2025-10-08T22:24:46.814470] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-08T22:24:47.220639] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-08T22:24:47.224319] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-08T22:24:47.224517] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-08T22:24:47.226802] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-08T22:24:47.227150] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-08T22:24:47.229248] [DEBUG] [LOCAL ] WMS: Trimmed 57184 records to 39565 (keeping 200 days of data) [2025-10-08T22:24:47.400632] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-08T22:24:47.411464] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-08T22:24:47.584322] [DEBUG] [LOCAL ] WMS: Primary data saved (39565 records). [2025-10-08T22:24:47.584491] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-08T22:24:47.584576] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMS took 28.4s. Estimated remaining: 8m 52s. Rate: 7.1 symbols/min [2025-10-08T22:24:47.757454] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:47.798915] [DEBUG] [LOCAL ] WNS: Loaded 39883 existing records from primary storage. [2025-10-08T22:24:47.799243] [INFO ] [MAIN ] WNS: Loaded 39883 existing records. [2025-10-08T22:24:47.978701] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:47.978947] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-10-08T22:24:47.979022] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-10-08T22:24:47.979364] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-10-08T22:24:47.979420] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-10-08T22:24:48.022681] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-08T22:24:48.348046] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:48.677409] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-08T22:24:48.817544] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-10-08T22:24:49.617565] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-08T22:24:50.038395] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-08T22:24:50.054524] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-08T22:24:50.059078] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-10-08T22:24:50.059198] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-08T22:24:50.429124] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-08T22:24:50.500442] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-08T22:24:50.500705] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-08T22:24:50.501973] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-08T22:24:50.502161] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-08T22:24:50.504287] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 53672 (keeping 200 days of data) [2025-10-08T22:24:50.638367] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-08T22:24:50.886881] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-08T22:24:50.887061] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-08T22:24:50.887149] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMB took 44.1s. Estimated remaining: 8m 43s. Rate: 7.1 symbols/min [2025-10-08T22:24:51.072340] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:24:51.122418] [DEBUG] [LOCAL ] WOLF: Loaded 53173 existing records from primary storage. [2025-10-08T22:24:51.122773] [INFO ] [MAIN ] WOLF: Loaded 53173 existing records. [2025-10-08T22:24:51.225767] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-10-08T22:24:51.327053] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:24:51.327298] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-08T22:24:51.327360] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-08T22:24:51.327586] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-08T22:24:51.327676] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-08T22:24:51.711068] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:24:51.978209] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-08T22:24:52.017510] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-08T22:24:52.737096] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T22:24:52.817551] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-10-08T22:24:53.536126] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-08T22:24:53.617509] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-08T22:24:53.693349] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T22:24:54.417587] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-10-08T22:24:55.181886] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T22:24:55.217498] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-08T22:24:55.883038] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-08T22:24:56.017546] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-10-08T22:24:56.798410] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T22:24:56.817521] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-08T22:24:57.593299] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T22:24:57.617527] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-10-08T22:24:58.417700] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-10-08T22:24:58.650227] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-08T22:24:59.217588] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-10-08T22:24:59.306953] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-08T22:25:00.017604] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-08T22:25:00.161307] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T22:25:00.261536] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-08T22:25:00.817609] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-08T22:25:01.617610] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-08T22:25:02.381504] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-08T22:25:02.417580] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-08T22:25:02.620351] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-08T22:25:03.217591] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-10-08T22:25:03.905403] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-08T22:25:03.941276] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-08T22:25:04.017577] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-08T22:25:04.817571] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-08T22:25:04.942327] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-08T22:25:05.617531] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-10-08T22:25:06.152483] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-08T22:25:06.250116] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-08T22:25:06.417575] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-08T22:25:06.750409] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-08T22:25:07.217553] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-10-08T22:25:08.017582] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-08T22:25:08.321878] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T22:25:08.575448] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-08T22:25:08.817620] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-10. [2025-10-08T22:25:09.259475] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-08T22:25:09.617584] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-08T22:25:09.980207] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-08T22:25:09.983373] [INFO ] [REMOTE ] WNS: Full fetch complete (55056 records). [2025-10-08T22:25:09.983541] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-10-08T22:25:10.377224] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-10-08T22:25:10.377327] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-10-08T22:25:10.378323] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-10-08T22:25:10.378388] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-10-08T22:25:10.379674] [DEBUG] [LOCAL ] WNS: Trimmed 55056 records to 39858 (keeping 200 days of data) [2025-10-08T22:25:10.430104] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-08T22:25:10.615890] [DEBUG] [LOCAL ] WNS: Primary data saved (39858 records). [2025-10-08T22:25:10.616049] [INFO ] [MAIN ] WNS: Full history saved. [2025-10-08T22:25:10.616183] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNS took 23.0s. Estimated remaining: 8m 35s. Rate: 7.1 symbols/min [2025-10-08T22:25:10.785919] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:10.810152] [DEBUG] [LOCAL ] WOR: Loaded 24817 existing records from primary storage. [2025-10-08T22:25:10.810417] [INFO ] [MAIN ] WOR: Loaded 24817 existing records. [2025-10-08T22:25:10.998010] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:11.008938] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-08T22:25:11.009622] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-08T22:25:11.015511] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-08T22:25:11.016459] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-08T22:25:11.016523] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-08T22:25:11.222750] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-08T22:25:11.367249] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:12.017554] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-10-08T22:25:12.365177] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T22:25:12.368155] [INFO ] [REMOTE ] WNC: Full fetch complete (57524 records). [2025-10-08T22:25:12.368256] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-08T22:25:12.783915] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-08T22:25:12.784073] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-08T22:25:12.785070] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-08T22:25:12.785147] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-08T22:25:12.815676] [DEBUG] [LOCAL ] WNC: Trimmed 57524 records to 38808 (keeping 200 days of data) [2025-10-08T22:25:12.816927] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-08T22:25:12.828315] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-08T22:25:12.941016] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-08T22:25:13.096726] [DEBUG] [LOCAL ] WNC: Primary data saved (38808 records). [2025-10-08T22:25:13.096893] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-08T22:25:13.097006] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNC took 27.8s. Estimated remaining: 8m 27s. Rate: 7.1 symbols/min [2025-10-08T22:25:13.264281] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:13.298447] [DEBUG] [LOCAL ] WOW: Loaded 30449 existing records from primary storage. [2025-10-08T22:25:13.298803] [INFO ] [MAIN ] WOW: Loaded 30449 existing records. [2025-10-08T22:25:13.476930] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:13.477180] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-08T22:25:13.477236] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-08T22:25:13.477473] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-08T22:25:13.477529] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-08T22:25:13.618395] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-08T22:25:13.835615] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:14.417508] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-08T22:25:14.797789] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-08T22:25:15.011342] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-08T22:25:15.217567] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-08T22:25:16.017550] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-08T22:25:16.492403] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-08T22:25:16.799061] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-08T22:25:16.817505] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-08T22:25:16.923110] [DEBUG] [REMOTE ] WOLF: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-08T22:25:16.923447] [WARN ] [REMOTE ] WOLF: No data returned for month 2025-06 [2025-10-08T22:25:16.923535] [FATAL] [REMOTE ] WOLF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:25:16.923633] [FATAL] [MAIN ] WOLF: Failed to fetch primary data. [2025-10-08T22:25:16.923736] [WARN ] [MAIN ] WOLF: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:25:16.923829] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-08T22:25:16.923922] [DEBUG] [LOCAL ] WOLF: No primary data file found to delete. [2025-10-08T22:25:16.923994] [INFO ] [LOCAL ] WOLF: Starting deletion of derivative data. [2025-10-08T22:25:16.924318] [DEBUG] [LOCAL ] WOLF: Deleted derivative data file. [2025-10-08T22:25:16.924450] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WOLF took 26.0s. Estimated remaining: 8m 18s. Rate: 7.1 symbols/min [2025-10-08T22:25:17.104062] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:17.150945] [DEBUG] [LOCAL ] WPC: Loaded 48338 existing records from primary storage. [2025-10-08T22:25:17.151473] [INFO ] [MAIN ] WPC: Loaded 48338 existing records. [2025-10-08T22:25:17.339525] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:17.339809] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-08T22:25:17.339877] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-08T22:25:17.340114] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-08T22:25:17.340172] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-08T22:25:17.622744] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-10-08T22:25:17.745845] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:18.288714] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-08T22:25:18.417604] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-08T22:25:18.927010] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-08T22:25:19.217557] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-08T22:25:19.426604] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-08T22:25:20.017559] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-10-08T22:25:20.284190] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-08T22:25:20.817568] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-08T22:25:21.617512] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-08T22:25:21.682130] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T22:25:21.943910] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-08T22:25:22.417693] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-08T22:25:22.962838] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:25:23.217511] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-08T22:25:23.631981] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-08T22:25:24.017623] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-08T22:25:24.817580] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-08T22:25:25.216484] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-08T22:25:25.617558] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-08T22:25:25.732781] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-08T22:25:25.831002] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-08T22:25:26.417515] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-08T22:25:27.060246] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-08T22:25:27.201971] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-08T22:25:27.217542] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-08T22:25:28.017587] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-08T22:25:28.554218] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T22:25:28.817634] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-08T22:25:29.617603] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-08T22:25:29.848825] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T22:25:30.417515] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-08T22:25:30.462606] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-08T22:25:31.220040] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-08T22:25:31.226038] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T22:25:31.577934] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T22:25:32.017602] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-08T22:25:32.171593] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-08T22:25:32.817528] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-08T22:25:33.617578] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-08T22:25:33.680822] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T22:25:34.417708] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-08T22:25:34.761046] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-08T22:25:34.981161] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T22:25:35.127987] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-08T22:25:35.130348] [INFO ] [REMOTE ] WOR: Full fetch complete (36493 records). [2025-10-08T22:25:35.130433] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-08T22:25:35.222745] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-08T22:25:35.527864] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-08T22:25:35.528048] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-08T22:25:35.528960] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-08T22:25:35.529150] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-08T22:25:35.530140] [DEBUG] [LOCAL ] WOR: Trimmed 36493 records to 24680 (keeping 200 days of data) [2025-10-08T22:25:35.657563] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-08T22:25:35.673179] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-10-08T22:25:35.678754] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-08T22:25:35.820355] [DEBUG] [LOCAL ] WOR: Primary data saved (24680 records). [2025-10-08T22:25:35.828548] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-08T22:25:35.831124] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOR took 25.2s. Estimated remaining: 8m 10s. Rate: 7.1 symbols/min [2025-10-08T22:25:36.048312] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-08T22:25:36.206890] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:36.325206] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-08T22:25:36.325298] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-08T22:25:36.328862] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-08T22:25:36.328931] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-08T22:25:36.334724] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 53800 (keeping 200 days of data) [2025-10-08T22:25:36.505415] [DEBUG] [LOCAL ] WPM: Loaded 52727 existing records from primary storage. [2025-10-08T22:25:36.569947] [INFO ] [MAIN ] WPM: Loaded 52727 existing records. [2025-10-08T22:25:36.829933] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-08T22:25:36.838687] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:36.842973] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-08T22:25:36.846635] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-08T22:25:36.848922] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-08T22:25:36.849787] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-08T22:25:37.234253] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-08T22:25:37.245157] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-08T22:25:37.257171] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WMT took 59.2s. Estimated remaining: 8m 1s. Rate: 7.1 symbols/min [2025-10-08T22:25:37.438021] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:37.570639] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:37.573097] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T22:25:37.612447] [DEBUG] [LOCAL ] WPP: Loaded 34096 existing records from primary storage. [2025-10-08T22:25:37.612780] [INFO ] [MAIN ] WPP: Loaded 34096 existing records. [2025-10-08T22:25:37.624425] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-10-08T22:25:37.793534] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:37.793775] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-08T22:25:37.793840] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-08T22:25:37.794089] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-08T22:25:37.794146] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-08T22:25:38.146083] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:38.417520] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-08T22:25:38.704326] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-08T22:25:39.217509] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-08T22:25:39.268571] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-08T22:25:39.679524] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-08T22:25:40.017615] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-08T22:25:40.817562] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-10-08T22:25:40.897214] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-08T22:25:41.372378] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T22:25:41.617578] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-08T22:25:41.824237] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T22:25:42.417586] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-08T22:25:42.927982] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-08T22:25:43.217611] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-08T22:25:43.932558] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-08T22:25:44.017569] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-08T22:25:44.276671] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T22:25:44.279588] [INFO ] [REMOTE ] WOW: Full fetch complete (42458 records). [2025-10-08T22:25:44.279707] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-08T22:25:44.668804] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-08T22:25:44.668900] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-08T22:25:44.669868] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-08T22:25:44.669932] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-08T22:25:44.670915] [DEBUG] [LOCAL ] WOW: Trimmed 42458 records to 30408 (keeping 200 days of data) [2025-10-08T22:25:44.824767] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-08T22:25:44.845597] [DEBUG] [LOCAL ] WOW: Primary data saved (30408 records). [2025-10-08T22:25:44.845938] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-08T22:25:44.846064] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 31.7s. Estimated remaining: 7m 53s. Rate: 7.1 symbols/min [2025-10-08T22:25:45.030065] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:45.079381] [DEBUG] [LOCAL ] WRB: Loaded 50663 existing records from primary storage. [2025-10-08T22:25:45.079795] [INFO ] [MAIN ] WRB: Loaded 50663 existing records. [2025-10-08T22:25:45.269364] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:45.269631] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-08T22:25:45.269815] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-08T22:25:45.270243] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-08T22:25:45.270319] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-08T22:25:45.621958] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-08T22:25:45.685485] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T22:25:45.689767] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:46.299619] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T22:25:46.417605] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-08T22:25:47.217513] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-08T22:25:47.342563] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T22:25:47.385620] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-08T22:25:48.017542] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-10-08T22:25:48.576966] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-08T22:25:48.817527] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-08T22:25:49.170236] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-08T22:25:49.617579] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-08T22:25:50.417596] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-08T22:25:50.597206] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-08T22:25:50.856773] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-08T22:25:51.217580] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-08T22:25:52.017619] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-08T22:25:52.236637] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-08T22:25:52.269202] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-08T22:25:52.273191] [INFO ] [REMOTE ] WPC: Full fetch complete (70691 records). [2025-10-08T22:25:52.273353] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-08T22:25:52.671896] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-08T22:25:52.671990] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-08T22:25:52.673210] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-08T22:25:52.673278] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-08T22:25:52.674815] [DEBUG] [LOCAL ] WPC: Trimmed 70691 records to 48324 (keeping 200 days of data) [2025-10-08T22:25:52.855928] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-08T22:25:52.984545] [DEBUG] [LOCAL ] WPC: Primary data saved (48324 records). [2025-10-08T22:25:52.984745] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-08T22:25:52.984851] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 36.1s. Estimated remaining: 7m 44s. Rate: 7.1 symbols/min [2025-10-08T22:25:53.155888] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:25:53.202918] [DEBUG] [LOCAL ] WRBY: Loaded 50721 existing records from primary storage. [2025-10-08T22:25:53.203248] [INFO ] [MAIN ] WRBY: Loaded 50721 existing records. [2025-10-08T22:25:53.380965] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:25:53.381211] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-08T22:25:53.381257] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-08T22:25:53.381511] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-08T22:25:53.381568] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-08T22:25:53.622223] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-08T22:25:53.751513] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:25:53.818373] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T22:25:54.258100] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-08T22:25:54.417559] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-10-08T22:25:55.217589] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-08T22:25:55.564624] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T22:25:55.991800] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-08T22:25:56.017517] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-08T22:25:56.817538] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-08T22:25:56.972992] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T22:25:57.087375] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-08T22:25:57.617538] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-08T22:25:58.413600] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-08T22:25:58.425122] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-08T22:25:58.915685] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-08T22:25:59.217586] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-08T22:26:00.017513] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-08T22:26:00.246910] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T22:26:00.785883] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-08T22:26:00.817507] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-08T22:26:01.617549] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-08T22:26:01.736848] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T22:26:02.098608] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-08T22:26:02.417572] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-08T22:26:03.217620] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-08T22:26:03.606025] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-08T22:26:04.017556] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-08T22:26:04.127740] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-08T22:26:04.286835] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-08T22:26:04.817611] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-08T22:26:05.617506] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-08T22:26:06.041754] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-08T22:26:06.417610] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-08T22:26:06.448937] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-08T22:26:07.103567] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-08T22:26:07.217596] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-08T22:26:08.017581] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-08T22:26:08.332292] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-08T22:26:08.796714] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T22:26:08.817535] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-08T22:26:09.484451] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-08T22:26:09.617601] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-08T22:26:10.115206] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-08T22:26:10.417561] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-08T22:26:11.148088] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T22:26:11.217506] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-08T22:26:12.017590] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-08T22:26:12.353259] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-08T22:26:12.601382] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-08T22:26:12.817553] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-08T22:26:13.295622] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-08T22:26:13.617612] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-08T22:26:14.244815] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-08T22:26:14.248836] [INFO ] [REMOTE ] WPM: Full fetch complete (75968 records). [2025-10-08T22:26:14.248977] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-08T22:26:14.425068] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-08T22:26:14.636070] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-08T22:26:14.636159] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-08T22:26:14.637299] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-08T22:26:14.637364] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-08T22:26:14.638812] [DEBUG] [LOCAL ] WPM: Trimmed 75968 records to 52738 (keeping 200 days of data) [2025-10-08T22:26:14.984888] [DEBUG] [LOCAL ] WPM: Primary data saved (52738 records). [2025-10-08T22:26:14.985050] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-08T22:26:14.985138] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 39.2s. Estimated remaining: 7m 36s. Rate: 7.1 symbols/min [2025-10-08T22:26:15.141281] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T22:26:15.217507] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-08T22:26:16.017515] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-08T22:26:16.420520] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-08T22:26:16.706546] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T22:26:16.817497] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-08T22:26:17.317328] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-08T22:26:17.320323] [INFO ] [REMOTE ] WPP: Full fetch complete (46070 records). [2025-10-08T22:26:17.320417] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-08T22:26:17.618531] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-08T22:26:17.707812] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-08T22:26:17.707895] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-08T22:26:17.708779] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-08T22:26:17.708840] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-08T22:26:17.709900] [DEBUG] [LOCAL ] WPP: Trimmed 46070 records to 34089 (keeping 200 days of data) [2025-10-08T22:26:17.923709] [DEBUG] [LOCAL ] WPP: Primary data saved (34089 records). [2025-10-08T22:26:17.923869] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-08T22:26:17.923961] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 40.7s. Estimated remaining: 7m 28s. Rate: 7.1 symbols/min [2025-10-08T22:26:18.460948] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T22:26:18.472128] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-08T22:26:19.293267] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T22:26:19.304367] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-08T22:26:19.842273] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-08T22:26:19.846489] [INFO ] [REMOTE ] WRB: Full fetch complete (73400 records). [2025-10-08T22:26:19.846635] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-08T22:26:19.980760] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T22:26:20.038001] [INFO ] [REMOTE ] WRBY: Full fetch complete (73556 records). [2025-10-08T22:26:20.062723] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-08T22:26:20.413771] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-08T22:26:20.428845] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-08T22:26:20.449455] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-08T22:26:20.495145] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-08T22:26:20.575779] [DEBUG] [LOCAL ] WRB: Trimmed 73400 records to 50677 (keeping 200 days of data) [2025-10-08T22:26:20.771040] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-08T22:26:20.771458] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-08T22:26:20.774555] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-08T22:26:20.774683] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-08T22:26:20.783480] [DEBUG] [LOCAL ] WRBY: Trimmed 73556 records to 50712 (keeping 200 days of data) [2025-10-08T22:26:21.311639] [DEBUG] [LOCAL ] WRB: Primary data saved (50677 records). [2025-10-08T22:26:21.312443] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-08T22:26:21.312874] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 36.5s. Estimated remaining: 7m 19s. Rate: 7.1 symbols/min [2025-10-08T22:26:21.315766] [DEBUG] [LOCAL ] WRBY: Primary data saved (50712 records). [2025-10-08T22:26:21.315836] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-08T22:26:21.315904] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 28.3s. Estimated remaining: 7m 10s. Rate: 7.1 symbols/min [2025-10-08T22:26:21.974579] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:22.048974] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:22.049993] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:22.047480] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:22.077460] [DEBUG] [LOCAL ] WSR: Loaded 22960 existing records from primary storage. [2025-10-08T22:26:22.077885] [INFO ] [MAIN ] WSR: Loaded 22960 existing records. [2025-10-08T22:26:22.162410] [DEBUG] [LOCAL ] WSO: Loaded 24962 existing records from primary storage. [2025-10-08T22:26:22.201140] [INFO ] [MAIN ] WSO: Loaded 24962 existing records. [2025-10-08T22:26:22.229281] [DEBUG] [LOCAL ] WS: Loaded 23733 existing records from primary storage. [2025-10-08T22:26:22.284731] [INFO ] [MAIN ] WS: Loaded 23733 existing records. [2025-10-08T22:26:22.447717] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:22.461958] [DEBUG] [LOCAL ] WSM: Loaded 49404 existing records from primary storage. [2025-10-08T22:26:22.490821] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-08T22:26:22.496283] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-08T22:26:22.496190] [INFO ] [MAIN ] WSM: Loaded 49404 existing records. [2025-10-08T22:26:22.573605] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-08T22:26:22.674501] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-08T22:26:22.826031] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:22.941198] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-08T22:26:23.019196] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:23.005439] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:23.023319] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-08T22:26:23.023786] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-08T22:26:23.023480] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-08T22:26:23.023845] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-08T22:26:23.024683] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-08T22:26:23.024905] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-08T22:26:23.024848] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-08T22:26:23.046201] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-08T22:26:23.035424] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-08T22:26:23.046091] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-08T22:26:23.090011] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-08T22:26:24.215961] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:24.249881] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-10-08T22:26:24.524953] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:24.598360] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-10-08T22:26:24.638080] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:24.665892] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-10-08T22:26:24.670070] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:24.670407] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-10-08T22:26:25.564785] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-08T22:26:25.570337] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-08T22:26:25.795287] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-08T22:26:25.799923] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-08T22:26:25.885203] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-08T22:26:25.891437] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-08T22:26:26.227028] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-08T22:26:26.240060] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-08T22:26:26.288861] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-08T22:26:26.417576] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-08T22:26:26.777687] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-08T22:26:26.853787] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-08T22:26:27.063888] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-08T22:26:27.217533] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-08T22:26:27.688880] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T22:26:28.017557] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-08T22:26:28.148555] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-08T22:26:28.817556] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-08T22:26:29.096773] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-08T22:26:29.617537] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-08T22:26:29.997509] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-08T22:26:30.417629] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-08T22:26:31.008298] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-08T22:26:31.217534] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-08T22:26:31.401032] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-08T22:26:32.017588] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-08T22:26:32.817540] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-08T22:26:33.113593] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-08T22:26:33.157605] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T22:26:33.617579] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-08T22:26:34.172889] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T22:26:34.417576] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-08T22:26:35.217514] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-08T22:26:35.558372] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T22:26:35.851298] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-08T22:26:36.017611] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-08T22:26:36.395698] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-08T22:26:36.817565] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-08T22:26:36.986138] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T22:26:37.617561] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-08T22:26:38.417575] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-08T22:26:38.709260] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-08T22:26:38.767702] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-08T22:26:39.217576] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-08T22:26:39.777495] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-08T22:26:40.017548] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-08T22:26:40.353334] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-08T22:26:40.817555] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-08T22:26:41.070694] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T22:26:41.617559] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-08T22:26:42.081629] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-08T22:26:42.417608] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-08T22:26:43.217566] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-08T22:26:43.384092] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-08T22:26:43.429548] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-08T22:26:44.017598] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-08T22:26:44.264394] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-08T22:26:44.817711] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-08T22:26:45.184531] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-08T22:26:45.617560] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-08T22:26:45.987634] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-08T22:26:46.416337] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-08T22:26:46.418730] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-08T22:26:46.420251] [INFO ] [REMOTE ] WSO: Full fetch complete (34855 records). [2025-10-08T22:26:46.420414] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-08T22:26:46.800595] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-08T22:26:46.800738] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-08T22:26:46.801828] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-08T22:26:46.801892] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-08T22:26:46.802885] [DEBUG] [LOCAL ] WSO: Trimmed 34855 records to 25075 (keeping 200 days of data) [2025-10-08T22:26:46.964022] [DEBUG] [LOCAL ] WSO: Primary data saved (25075 records). [2025-10-08T22:26:46.964169] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-08T22:26:46.964270] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WSO took 25.6s. Estimated remaining: 7m 2s. Rate: 7.1 symbols/min [2025-10-08T22:26:47.135439] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:47.171301] [DEBUG] [LOCAL ] WST: Loaded 36985 existing records from primary storage. [2025-10-08T22:26:47.171622] [INFO ] [MAIN ] WST: Loaded 36985 existing records. [2025-10-08T22:26:47.225028] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-08T22:26:47.354702] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:47.354916] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-08T22:26:47.354964] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-08T22:26:47.355252] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-08T22:26:47.355311] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-08T22:26:47.748404] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-08T22:26:47.780976] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:48.017561] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-10-08T22:26:48.817594] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-08T22:26:48.909073] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-08T22:26:49.480527] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-08T22:26:49.617581] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-08T22:26:49.711888] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-08T22:26:50.417608] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-08T22:26:50.823991] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T22:26:51.217622] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-08T22:26:51.900101] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-08T22:26:52.017522] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-08T22:26:52.817538] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-08T22:26:53.040050] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-08T22:26:53.617570] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-08T22:26:53.806636] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-08T22:26:53.827572] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-08T22:26:53.832719] [INFO ] [REMOTE ] WS: Full fetch complete (36619 records). [2025-10-08T22:26:53.832844] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-08T22:26:54.328856] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-08T22:26:54.328976] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-08T22:26:54.330108] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-08T22:26:54.330216] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-08T22:26:54.331361] [DEBUG] [LOCAL ] WS: Trimmed 36619 records to 23537 (keeping 200 days of data) [2025-10-08T22:26:54.424713] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-08T22:26:54.487347] [DEBUG] [LOCAL ] WS: Primary data saved (23537 records). [2025-10-08T22:26:54.487519] [INFO ] [MAIN ] WS: Full history saved. [2025-10-08T22:26:54.487698] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WS took 33.2s. Estimated remaining: 6m 54s. Rate: 7.1 symbols/min [2025-10-08T22:26:54.654100] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:54.702826] [DEBUG] [LOCAL ] WT: Loaded 47866 existing records from primary storage. [2025-10-08T22:26:54.703161] [INFO ] [MAIN ] WT: Loaded 47866 existing records. [2025-10-08T22:26:54.879909] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:54.880148] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-08T22:26:54.880195] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-08T22:26:54.880684] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-08T22:26:54.880742] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-08T22:26:55.222074] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-08T22:26:55.244609] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:55.271985] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-08T22:26:55.296206] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T22:26:56.017604] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-08T22:26:56.817571] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-08T22:26:56.909148] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T22:26:56.955309] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-08T22:26:57.007219] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-10-08T22:26:57.011712] [INFO ] [REMOTE ] WSM: Full fetch complete (71699 records). [2025-10-08T22:26:57.011837] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-08T22:26:57.395609] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-08T22:26:57.395717] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-08T22:26:57.396783] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-08T22:26:57.396848] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-08T22:26:57.398326] [DEBUG] [LOCAL ] WSM: Trimmed 71699 records to 49319 (keeping 200 days of data) [2025-10-08T22:26:57.627929] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-10-08T22:26:57.725568] [DEBUG] [LOCAL ] WSM: Primary data saved (49319 records). [2025-10-08T22:26:57.725731] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-08T22:26:57.725852] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSM took 36.4s. Estimated remaining: 6m 45s. Rate: 7.1 symbols/min [2025-10-08T22:26:57.910126] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:26:57.956078] [DEBUG] [LOCAL ] WTI: Loaded 44045 existing records from primary storage. [2025-10-08T22:26:57.956443] [INFO ] [MAIN ] WTI: Loaded 44045 existing records. [2025-10-08T22:26:58.134118] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:26:58.134342] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-08T22:26:58.134414] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-08T22:26:58.134745] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-08T22:26:58.134803] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-08T22:26:58.420880] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-08T22:26:58.500254] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:26:59.217578] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-08T22:26:59.247329] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-08T22:26:59.249770] [INFO ] [REMOTE ] WSR: Full fetch complete (32803 records). [2025-10-08T22:26:59.249961] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-08T22:26:59.344102] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T22:26:59.693328] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-08T22:26:59.693457] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-08T22:26:59.694613] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-08T22:26:59.694730] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-08T22:26:59.696118] [DEBUG] [LOCAL ] WSR: Trimmed 32803 records to 22909 (keeping 200 days of data) [2025-10-08T22:26:59.908962] [DEBUG] [LOCAL ] WSR: Primary data saved (22909 records). [2025-10-08T22:26:59.909207] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-08T22:26:59.909373] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSR took 38.6s. Estimated remaining: 6m 37s. Rate: 7.1 symbols/min [2025-10-08T22:27:00.022783] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-10-08T22:27:00.192337] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:00.192569] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-08T22:27:00.192635] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-08T22:27:00.192819] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-08T22:27:00.192886] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-08T22:27:00.192957] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-08T22:27:00.193012] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-08T22:27:00.653616] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:00.817546] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-10-08T22:27:01.227993] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-08T22:27:01.289396] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-08T22:27:01.617622] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-08T22:27:01.752802] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T22:27:02.417563] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-08T22:27:03.217506] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-08T22:27:03.306280] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-08T22:27:04.017512] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-08T22:27:04.121468] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-08T22:27:04.593547] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-08T22:27:04.640463] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T22:27:04.817554] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-08T22:27:05.617566] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-08T22:27:06.360963] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-08T22:27:06.417591] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-08T22:27:07.217572] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-08T22:27:07.542087] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-08T22:27:07.994472] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-08T22:27:08.017506] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-08T22:27:08.243351] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T22:27:08.817619] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-08T22:27:09.609852] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-08T22:27:09.617425] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-08T22:27:10.067320] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T22:27:10.331980] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-08T22:27:10.417550] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-08T22:27:11.217596] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-08T22:27:12.017590] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-08T22:27:12.255865] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-08T22:27:12.510420] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T22:27:12.768829] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-08T22:27:12.817496] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-08T22:27:13.617546] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-08T22:27:14.201363] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T22:27:14.417544] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-08T22:27:15.156388] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-08T22:27:15.217500] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-08T22:27:16.017548] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-08T22:27:16.068786] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-08T22:27:16.185212] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.17 seconds). [2025-10-08T22:27:16.189482] [INFO ] [REMOTE ] WST: Full fetch complete (53910 records). [2025-10-08T22:27:16.189665] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-08T22:27:16.575726] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-08T22:27:16.575856] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-08T22:27:16.576908] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-08T22:27:16.576996] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-08T22:27:16.578600] [DEBUG] [LOCAL ] WST: Trimmed 53910 records to 36892 (keeping 200 days of data) [2025-10-08T22:27:16.705544] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-08T22:27:16.837874] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-08T22:27:16.874886] [DEBUG] [LOCAL ] WST: Primary data saved (36892 records). [2025-10-08T22:27:16.875045] [INFO ] [MAIN ] WST: Full history saved. [2025-10-08T22:27:16.875142] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 29.9s. Estimated remaining: 6m 28s. Rate: 7.1 symbols/min [2025-10-08T22:27:17.046569] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:17.098945] [DEBUG] [LOCAL ] WTRG: Loaded 50967 existing records from primary storage. [2025-10-08T22:27:17.099360] [INFO ] [MAIN ] WTRG: Loaded 50967 existing records. [2025-10-08T22:27:17.213169] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-08T22:27:17.291195] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:27:17.291489] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-08T22:27:17.291558] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-08T22:27:17.291894] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-08T22:27:17.291953] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-08T22:27:17.630435] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-08T22:27:17.635065] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:18.417586] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-08T22:27:18.863495] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-08T22:27:19.217539] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T22:27:19.217742] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-10-08T22:27:20.017601] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-08T22:27:20.698477] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T22:27:20.817538] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-08T22:27:21.617511] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-08T22:27:21.828870] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:27:22.104366] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-08T22:27:22.417701] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-08T22:27:23.217530] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-08T22:27:23.458268] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-08T22:27:24.017609] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-08T22:27:24.333075] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T22:27:24.429225] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-08T22:27:24.817537] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-08T22:27:24.851191] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:27:25.617564] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-08T22:27:26.038031] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-08T22:27:26.183011] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-08T22:27:26.187089] [INFO ] [REMOTE ] WT: Full fetch complete (69345 records). [2025-10-08T22:27:26.187229] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-08T22:27:26.422728] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-08T22:27:26.633449] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-08T22:27:26.633568] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-08T22:27:26.635243] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-08T22:27:26.635339] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-08T22:27:26.636913] [DEBUG] [LOCAL ] WT: Trimmed 69345 records to 47891 (keeping 200 days of data) [2025-10-08T22:27:26.978144] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-08T22:27:26.989685] [DEBUG] [LOCAL ] WT: Primary data saved (47891 records). [2025-10-08T22:27:26.989842] [INFO ] [MAIN ] WT: Full history saved. [2025-10-08T22:27:26.989980] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WT took 32.5s. Estimated remaining: 6m 20s. Rate: 7.1 symbols/min [2025-10-08T22:27:27.180468] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:27.199357] [DEBUG] [LOCAL ] WTS: Loaded 17856 existing records from primary storage. [2025-10-08T22:27:27.199627] [INFO ] [MAIN ] WTS: Loaded 17856 existing records. [2025-10-08T22:27:27.222688] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-08T22:27:27.387784] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:27:27.388000] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-08T22:27:27.388064] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-08T22:27:27.388318] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-08T22:27:27.388392] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-08T22:27:27.779575] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:27.865417] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-08T22:27:28.017545] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-08T22:27:28.817551] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-08T22:27:29.617580] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-10-08T22:27:29.761450] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T22:27:30.087726] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T22:27:30.417574] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-08T22:27:30.694607] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-08T22:27:31.217549] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-08T22:27:31.996504] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-08T22:27:31.998407] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-08T22:27:32.017486] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-08T22:27:32.817622] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-08T22:27:33.510677] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-08T22:27:33.556302] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-08T22:27:33.617532] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-08T22:27:34.236562] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-08T22:27:34.237603] [INFO ] [REMOTE ] WTM: Full fetch complete (2611 records). [2025-10-08T22:27:34.237698] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-08T22:27:34.428932] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-08T22:27:34.434835] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-08T22:27:34.436044] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-08T22:27:34.436122] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-08T22:27:34.436195] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-08T22:27:34.436274] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-08T22:27:34.436328] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-08T22:27:34.436384] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-08T22:27:34.436496] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WTM took 34.5s. Estimated remaining: 6m 12s. Rate: 7.1 symbols/min [2025-10-08T22:27:34.605488] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:34.648260] [DEBUG] [LOCAL ] WTTR: Loaded 44737 existing records from primary storage. [2025-10-08T22:27:34.648570] [INFO ] [MAIN ] WTTR: Loaded 44737 existing records. [2025-10-08T22:27:34.821449] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:27:34.821667] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-08T22:27:34.821726] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-08T22:27:34.821957] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-08T22:27:34.822021] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-08T22:27:35.176783] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:35.217496] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-10-08T22:27:35.919037] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-08T22:27:35.922931] [INFO ] [REMOTE ] WTI: Full fetch complete (64044 records). [2025-10-08T22:27:35.923057] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-08T22:27:36.022711] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-08T22:27:36.317698] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-08T22:27:36.317813] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-08T22:27:36.318852] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-08T22:27:36.318916] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-08T22:27:36.320379] [DEBUG] [LOCAL ] WTI: Trimmed 64044 records to 44135 (keeping 200 days of data) [2025-10-08T22:27:36.577747] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T22:27:36.637534] [DEBUG] [LOCAL ] WTI: Primary data saved (44135 records). [2025-10-08T22:27:36.637733] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-08T22:27:36.637857] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTI took 38.9s. Estimated remaining: 6m 3s. Rate: 7.1 symbols/min [2025-10-08T22:27:36.813577] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:36.817537] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-08T22:27:36.865622] [DEBUG] [LOCAL ] WU: Loaded 53464 existing records from primary storage. [2025-10-08T22:27:36.866011] [INFO ] [MAIN ] WU: Loaded 53464 existing records. [2025-10-08T22:27:37.050354] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:27:37.050833] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-08T22:27:37.050899] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-08T22:27:37.051332] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-08T22:27:37.051392] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-08T22:27:37.190674] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-08T22:27:37.425528] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:37.617600] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-10-08T22:27:38.190432] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T22:27:38.417552] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-08T22:27:38.999033] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T22:27:39.217551] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-08T22:27:39.662053] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-08T22:27:40.017574] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-08T22:27:40.796264] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T22:27:40.817499] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-08T22:27:41.369040] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T22:27:41.617541] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-08T22:27:42.419992] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-08T22:27:42.422922] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-08T22:27:42.747708] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-08T22:27:43.217607] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-08T22:27:44.014592] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-08T22:27:44.024148] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-08T22:27:44.536595] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-08T22:27:44.817514] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-08T22:27:45.143407] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T22:27:45.617547] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-08T22:27:46.417522] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-08T22:27:46.674751] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-08T22:27:47.049804] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-08T22:27:47.217523] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-08T22:27:47.311315] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-08T22:27:48.017541] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-08T22:27:48.322407] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T22:27:48.817519] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-08T22:27:49.387517] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T22:27:49.617534] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-08T22:27:50.417523] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-08T22:27:50.606460] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-08T22:27:51.217577] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-08T22:27:51.419984] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-08T22:27:52.017672] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-08T22:27:52.149123] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-08T22:27:52.206143] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-08T22:27:52.817595] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-08T22:27:53.617532] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-08T22:27:53.744428] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T22:27:53.937003] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-08T22:27:54.417530] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-08T22:27:54.486002] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-08T22:27:55.217547] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-08T22:27:55.821959] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-08T22:27:55.823438] [INFO ] [REMOTE ] WTS: Full fetch complete (25859 records). [2025-10-08T22:27:55.823509] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-08T22:27:56.022910] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-08T22:27:56.229275] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-08T22:27:56.249622] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-08T22:27:56.249900] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-08T22:27:56.250603] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-08T22:27:56.250718] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-08T22:27:56.251798] [DEBUG] [LOCAL ] WTS: Trimmed 25859 records to 17746 (keeping 200 days of data) [2025-10-08T22:27:56.366045] [DEBUG] [LOCAL ] WTS: Primary data saved (17746 records). [2025-10-08T22:27:56.366225] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-08T22:27:56.366332] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 29.4s. Estimated remaining: 5m 55s. Rate: 7.1 symbols/min [2025-10-08T22:27:56.534274] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:27:56.578809] [DEBUG] [LOCAL ] WWW: Loaded 49242 existing records from primary storage. [2025-10-08T22:27:56.579187] [INFO ] [MAIN ] WWW: Loaded 49242 existing records. [2025-10-08T22:27:56.752696] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:27:56.752961] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-08T22:27:56.753028] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-08T22:27:56.753416] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-08T22:27:56.753495] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-08T22:27:56.825430] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-08T22:27:57.106362] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:27:57.617595] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-10-08T22:27:58.058438] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-08T22:27:58.423711] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-08T22:27:58.447155] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T22:27:59.039949] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-08T22:27:59.217573] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-08T22:28:00.017578] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-08T22:28:00.325686] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-08T22:28:00.790310] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-08T22:28:00.817500] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-08T22:28:01.526204] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-08T22:28:01.617592] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-08T22:28:02.417525] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-08T22:28:02.445471] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:28:02.761754] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-08T22:28:02.765811] [INFO ] [REMOTE ] WTRG: Full fetch complete (73514 records). [2025-10-08T22:28:02.765994] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-08T22:28:03.162730] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-08T22:28:03.162832] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-08T22:28:03.164073] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-08T22:28:03.164141] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-08T22:28:03.165634] [DEBUG] [LOCAL ] WTRG: Trimmed 73514 records to 50969 (keeping 200 days of data) [2025-10-08T22:28:03.220178] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-08T22:28:03.487809] [DEBUG] [LOCAL ] WTRG: Primary data saved (50969 records). [2025-10-08T22:28:03.487958] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-08T22:28:03.488071] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTRG took 46.6s. Estimated remaining: 5m 46s. Rate: 7.1 symbols/min [2025-10-08T22:28:03.666157] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:03.717920] [DEBUG] [LOCAL ] WY: Loaded 53141 existing records from primary storage. [2025-10-08T22:28:03.718273] [INFO ] [MAIN ] WY: Loaded 53141 existing records. [2025-10-08T22:28:03.922246] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:03.922595] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-08T22:28:03.922701] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-08T22:28:03.923029] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-08T22:28:03.923108] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-08T22:28:04.018086] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-08T22:28:04.302551] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:04.333522] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-08T22:28:04.776398] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T22:28:04.817502] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-10-08T22:28:05.617578] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-08T22:28:05.930603] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-08T22:28:06.417523] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-08T22:28:06.478003] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-08T22:28:07.000757] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-08T22:28:07.004386] [INFO ] [REMOTE ] WTTR: Full fetch complete (65516 records). [2025-10-08T22:28:07.004502] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-08T22:28:07.223524] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-08T22:28:07.410871] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-08T22:28:07.410979] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-08T22:28:07.412119] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-08T22:28:07.412187] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-08T22:28:07.413700] [DEBUG] [LOCAL ] WTTR: Trimmed 65516 records to 44656 (keeping 200 days of data) [2025-10-08T22:28:07.685090] [DEBUG] [LOCAL ] WTTR: Primary data saved (44656 records). [2025-10-08T22:28:07.685246] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-08T22:28:07.685354] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 33.2s. Estimated remaining: 5m 38s. Rate: 7.1 symbols/min [2025-10-08T22:28:07.870504] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:07.902122] [DEBUG] [LOCAL ] XFLT: Loaded 29908 existing records from primary storage. [2025-10-08T22:28:07.902405] [INFO ] [MAIN ] XFLT: Loaded 29908 existing records. [2025-10-08T22:28:08.022744] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-08T22:28:08.101226] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:08.101442] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-08T22:28:08.101490] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-08T22:28:08.101744] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-08T22:28:08.101803] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-08T22:28:08.512934] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:08.542489] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-08T22:28:08.817513] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-08T22:28:08.965804] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-08T22:28:09.623680] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-08T22:28:09.635118] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-08T22:28:10.417577] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-10-08T22:28:10.506851] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-08T22:28:11.217568] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-08T22:28:11.584104] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T22:28:11.660132] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-08T22:28:12.017566] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-08T22:28:12.817573] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-08T22:28:12.914169] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-08T22:28:13.617525] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-08T22:28:13.647724] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:28:14.417587] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-08T22:28:14.747735] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-08T22:28:15.217591] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-08T22:28:15.312690] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T22:28:16.017555] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-08T22:28:16.104484] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T22:28:16.820305] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-08T22:28:16.821302] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-08T22:28:16.826493] [INFO ] [REMOTE ] WU: Full fetch complete (77354 records). [2025-10-08T22:28:16.826639] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-08T22:28:17.225563] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-08T22:28:17.225757] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-08T22:28:17.226950] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-08T22:28:17.227019] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-08T22:28:17.228535] [DEBUG] [LOCAL ] WU: Trimmed 77354 records to 53462 (keeping 200 days of data) [2025-10-08T22:28:17.561119] [DEBUG] [LOCAL ] WU: Primary data saved (53462 records). [2025-10-08T22:28:17.561319] [INFO ] [MAIN ] WU: Full history saved. [2025-10-08T22:28:17.561474] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 40.9s. Estimated remaining: 5m 29s. Rate: 7.1 symbols/min [2025-10-08T22:28:17.625034] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-08T22:28:17.774975] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:17.827766] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:28:17.851422] [DEBUG] [LOCAL ] XHR: Loaded 43731 existing records from primary storage. [2025-10-08T22:28:17.852108] [INFO ] [MAIN ] XHR: Loaded 43731 existing records. [2025-10-08T22:28:18.029386] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:18.029767] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-08T22:28:18.029820] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-08T22:28:18.030131] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-08T22:28:18.030188] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-08T22:28:18.331137] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T22:28:18.415676] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:18.417489] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-10-08T22:28:19.217520] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-08T22:28:19.290282] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-08T22:28:19.914439] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T22:28:20.017511] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-08T22:28:20.090249] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-08T22:28:20.817733] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-08T22:28:21.373904] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-08T22:28:21.617560] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-08T22:28:22.424729] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-08T22:28:22.445773] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T22:28:22.491209] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-08T22:28:23.217570] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-08T22:28:23.800333] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-08T22:28:24.017605] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-08T22:28:24.575892] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-08T22:28:24.817618] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-08T22:28:25.584335] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-08T22:28:25.617508] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-08T22:28:26.042689] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T22:28:26.046419] [INFO ] [REMOTE ] WWW: Full fetch complete (70388 records). [2025-10-08T22:28:26.046519] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-08T22:28:26.433761] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-08T22:28:26.430138] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-08T22:28:26.434639] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-08T22:28:26.435766] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-08T22:28:26.435928] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-08T22:28:26.437449] [DEBUG] [LOCAL ] WWW: Trimmed 70388 records to 49239 (keeping 200 days of data) [2025-10-08T22:28:26.765837] [DEBUG] [LOCAL ] WWW: Primary data saved (49239 records). [2025-10-08T22:28:26.766004] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-08T22:28:26.766096] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. WWW took 30.4s. Estimated remaining: 5m 21s. Rate: 7.1 symbols/min [2025-10-08T22:28:26.954478] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:26.954669] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-08T22:28:26.954725] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-08T22:28:26.954879] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-08T22:28:26.954923] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-08T22:28:26.954978] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-08T22:28:26.955012] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-08T22:28:27.219858] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-08T22:28:27.329770] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:27.436273] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T22:28:27.559395] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-08T22:28:28.017624] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-10-08T22:28:28.223851] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:28:28.224184] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-10-08T22:28:28.224273] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:28:28.224323] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-08T22:28:28.224361] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:28:28.224422] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-08T22:28:28.224488] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-08T22:28:28.224523] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-08T22:28:28.224618] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-08T22:28:28.224716] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. XIFR took 1.5s. Estimated remaining: 5m 12s. Rate: 7.1 symbols/min [2025-10-08T22:28:28.398324] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:28.458830] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-08T22:28:28.459276] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-08T22:28:28.640701] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:28.641025] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-08T22:28:28.641080] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-08T22:28:28.641665] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-08T22:28:28.641726] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-08T22:28:28.818732] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-08T22:28:29.042559] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:29.045407] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T22:28:29.617549] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-08T22:28:30.417543] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-10-08T22:28:30.848449] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T22:28:30.972397] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:28:31.217611] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-08T22:28:32.017601] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-08T22:28:32.444534] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-08T22:28:32.660715] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-08T22:28:32.817595] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-08T22:28:33.563256] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-08T22:28:33.617499] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-08T22:28:34.417710] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-08T22:28:34.990405] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-08T22:28:35.064116] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T22:28:35.217560] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-08T22:28:35.368319] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-08T22:28:36.017624] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-08T22:28:36.817557] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-08T22:28:36.907965] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T22:28:37.507992] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T22:28:37.617525] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-08T22:28:37.707430] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-08T22:28:38.417562] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-08T22:28:38.852335] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-08T22:28:39.217608] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-08T22:28:40.017526] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-08T22:28:40.499042] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-08T22:28:40.666759] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-08T22:28:40.817612] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-08T22:28:41.251065] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-08T22:28:41.617594] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-08T22:28:42.417710] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-08T22:28:42.809609] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T22:28:42.812542] [INFO ] [REMOTE ] XFLT: Full fetch complete (44057 records). [2025-10-08T22:28:42.812697] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-08T22:28:43.220932] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-08T22:28:43.237805] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-08T22:28:43.238241] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-08T22:28:43.239547] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-08T22:28:43.240027] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-08T22:28:43.268825] [DEBUG] [LOCAL ] XFLT: Trimmed 44057 records to 29925 (keeping 200 days of data) [2025-10-08T22:28:43.288290] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-08T22:28:43.406008] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-08T22:28:43.512020] [DEBUG] [LOCAL ] XFLT: Primary data saved (29925 records). [2025-10-08T22:28:43.512181] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-08T22:28:43.512292] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. XFLT took 35.8s. Estimated remaining: 5m 4s. Rate: 7.1 symbols/min [2025-10-08T22:28:43.685583] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:43.718357] [DEBUG] [LOCAL ] XPER: Loaded 30096 existing records from primary storage. [2025-10-08T22:28:43.718665] [INFO ] [MAIN ] XPER: Loaded 30096 existing records. [2025-10-08T22:28:43.903189] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:43.903415] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-08T22:28:43.903462] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-08T22:28:43.903699] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-08T22:28:43.903757] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-08T22:28:44.022712] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-08T22:28:44.327913] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:44.502028] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-08T22:28:44.511094] [INFO ] [REMOTE ] XHR: Full fetch complete (61797 records). [2025-10-08T22:28:44.511417] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-08T22:28:44.822899] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-10-08T22:28:45.097673] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-08T22:28:45.097839] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-08T22:28:45.100805] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-08T22:28:45.101025] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-08T22:28:45.107353] [DEBUG] [LOCAL ] XHR: Trimmed 61797 records to 43665 (keeping 200 days of data) [2025-10-08T22:28:45.454657] [DEBUG] [LOCAL ] XHR: Primary data saved (43665 records). [2025-10-08T22:28:45.454849] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-08T22:28:45.454995] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XHR took 27.9s. Estimated remaining: 4m 55s. Rate: 7.1 symbols/min [2025-10-08T22:28:45.620413] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-08T22:28:45.643318] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:45.700885] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-08T22:28:45.701307] [INFO ] [MAIN ] XPEV: Loaded 53634 existing records. [2025-10-08T22:28:45.890905] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:45.891163] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-08T22:28:45.891213] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-08T22:28:45.891699] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-08T22:28:45.891759] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-08T22:28:46.296025] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T22:28:46.295185] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:46.303153] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T22:28:46.301839] [INFO ] [REMOTE ] WY: Full fetch complete (76852 records). [2025-10-08T22:28:46.310162] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-08T22:28:46.418896] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-08T22:28:46.614821] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-08T22:28:46.758261] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-08T22:28:46.758348] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-08T22:28:46.762903] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-08T22:28:46.763023] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-08T22:28:46.764948] [DEBUG] [LOCAL ] WY: Trimmed 76852 records to 53138 (keeping 200 days of data) [2025-10-08T22:28:47.108222] [DEBUG] [LOCAL ] WY: Primary data saved (53138 records). [2025-10-08T22:28:47.108383] [INFO ] [MAIN ] WY: Full history saved. [2025-10-08T22:28:47.108488] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. WY took 43.6s. Estimated remaining: 4m 47s. Rate: 7.1 symbols/min [2025-10-08T22:28:47.222672] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-10-08T22:28:47.282961] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:28:47.329795] [DEBUG] [LOCAL ] XPO: Loaded 47792 existing records from primary storage. [2025-10-08T22:28:47.330147] [INFO ] [MAIN ] XPO: Loaded 47792 existing records. [2025-10-08T22:28:47.550336] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:28:47.551861] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-08T22:28:47.552177] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-08T22:28:47.552363] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-08T22:28:47.559361] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-08T22:28:47.559437] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-08T22:28:47.924619] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:28:48.017565] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-10-08T22:28:48.817580] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-08T22:28:49.531493] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-08T22:28:49.600406] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-08T22:28:49.617519] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-08T22:28:49.962191] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T22:28:50.417558] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-08T22:28:51.217601] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-08T22:28:51.678595] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-08T22:28:52.017562] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-08T22:28:52.715281] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-08T22:28:52.817548] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-08T22:28:52.888035] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-08T22:28:53.617614] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-08T22:28:54.112378] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-08T22:28:54.417557] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-08T22:28:54.659200] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-08T22:28:54.720609] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-08T22:28:55.217576] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-08T22:28:56.017575] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-08T22:28:56.104945] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-08T22:28:56.595175] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-08T22:28:56.817557] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-08T22:28:57.617566] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-08T22:28:58.417523] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-08T22:28:58.524879] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-08T22:28:58.603533] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-08T22:28:59.217553] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-08T22:28:59.265675] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-08T22:28:59.777794] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-08T22:29:00.017574] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-08T22:29:00.817557] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-08T22:29:01.627875] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-08T22:29:01.656034] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-08T22:29:01.823590] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-08T22:29:02.417570] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-08T22:29:02.494948] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-08T22:29:02.982940] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T22:29:03.217603] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-08T22:29:03.852900] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-08T22:29:04.017534] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-08T22:29:04.817534] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-08T22:29:05.160052] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-08T22:29:05.617569] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-08T22:29:05.684774] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-08T22:29:06.363938] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-08T22:29:06.417519] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-08T22:29:06.933289] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T22:29:07.217551] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-08T22:29:08.017560] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-08T22:29:08.461071] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-08T22:29:08.817516] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-08T22:29:08.919314] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-08T22:29:09.617583] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-08T22:29:10.154905] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-08T22:29:10.417573] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-08T22:29:10.984191] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T22:29:11.022955] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T22:29:11.027548] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-10-08T22:29:11.027751] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-08T22:29:11.231920] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-08T22:29:11.362066] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-08T22:29:11.488661] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-08T22:29:11.488769] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-08T22:29:11.493662] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-08T22:29:11.493870] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-08T22:29:11.496032] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 53793 (keeping 200 days of data) [2025-10-08T22:29:11.840877] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-08T22:29:11.841039] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-08T22:29:11.841151] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XOM took 43.6s. Estimated remaining: 4m 39s. Rate: 7.1 symbols/min [2025-10-08T22:29:12.010436] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:12.017544] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-08T22:29:12.046706] [DEBUG] [LOCAL ] XPOF: Loaded 37710 existing records from primary storage. [2025-10-08T22:29:12.047064] [INFO ] [MAIN ] XPOF: Loaded 37710 existing records. [2025-10-08T22:29:12.225011] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:12.225292] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-08T22:29:12.225354] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-08T22:29:12.225615] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-08T22:29:12.225704] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-08T22:29:12.654243] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:12.817529] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-10-08T22:29:12.976629] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-08T22:29:13.617560] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-08T22:29:14.066246] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-08T22:29:14.096818] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-08T22:29:14.417553] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-08T22:29:14.677998] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-08T22:29:14.680891] [INFO ] [REMOTE ] XPER: Full fetch complete (43258 records). [2025-10-08T22:29:14.680982] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-08T22:29:15.053869] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-08T22:29:15.053971] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-08T22:29:15.054864] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-08T22:29:15.054926] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-08T22:29:15.056090] [DEBUG] [LOCAL ] XPER: Trimmed 43258 records to 30107 (keeping 200 days of data) [2025-10-08T22:29:15.217973] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-08T22:29:15.225239] [DEBUG] [LOCAL ] XPER: Primary data saved (30107 records). [2025-10-08T22:29:15.225459] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-08T22:29:15.225579] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XPER took 31.7s. Estimated remaining: 4m 30s. Rate: 7.1 symbols/min [2025-10-08T22:29:15.398230] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:15.440977] [DEBUG] [LOCAL ] XPRO: Loaded 45854 existing records from primary storage. [2025-10-08T22:29:15.441308] [INFO ] [MAIN ] XPRO: Loaded 45854 existing records. [2025-10-08T22:29:15.626300] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:15.626703] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-08T22:29:15.626869] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-08T22:29:15.627112] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-08T22:29:15.627173] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-08T22:29:15.751444] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-08T22:29:16.007215] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:16.017491] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-10-08T22:29:16.817604] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-08T22:29:17.617591] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-08T22:29:17.687226] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-08T22:29:17.728591] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-08T22:29:18.420193] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-08T22:29:18.441671] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-08T22:29:18.493264] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-08T22:29:19.217574] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-08T22:29:20.017595] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-08T22:29:20.484870] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-08T22:29:20.580773] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-08T22:29:20.585715] [INFO ] [REMOTE ] XPEV: Full fetch complete (77678 records). [2025-10-08T22:29:20.585856] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-08T22:29:20.826547] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-08T22:29:21.064313] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-08T22:29:21.064419] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-08T22:29:21.065607] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-08T22:29:21.065709] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-08T22:29:21.067311] [DEBUG] [LOCAL ] XPEV: Trimmed 77678 records to 53634 (keeping 200 days of data) [2025-10-08T22:29:21.336210] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-08T22:29:21.443414] [DEBUG] [LOCAL ] XPEV: Primary data saved (53634 records). [2025-10-08T22:29:21.443591] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-08T22:29:21.443727] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPEV took 36.0s. Estimated remaining: 4m 22s. Rate: 7.1 symbols/min [2025-10-08T22:29:21.628764] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-08T22:29:21.631852] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:21.663752] [DEBUG] [LOCAL ] XYF: Loaded 28404 existing records from primary storage. [2025-10-08T22:29:21.664053] [INFO ] [MAIN ] XYF: Loaded 28404 existing records. [2025-10-08T22:29:21.845509] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:21.845823] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-08T22:29:21.845882] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-08T22:29:21.846130] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-08T22:29:21.846186] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-08T22:29:22.179549] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-08T22:29:22.198823] [INFO ] [REMOTE ] XPO: Full fetch complete (69824 records). [2025-10-08T22:29:22.214450] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-08T22:29:22.220355] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:22.425442] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-10-08T22:29:22.611139] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-08T22:29:22.611266] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-08T22:29:22.612381] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-08T22:29:22.612446] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-08T22:29:22.613968] [DEBUG] [LOCAL ] XPO: Trimmed 69824 records to 47785 (keeping 200 days of data) [2025-10-08T22:29:22.866414] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T22:29:22.949531] [DEBUG] [LOCAL ] XPO: Primary data saved (47785 records). [2025-10-08T22:29:22.949703] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-08T22:29:22.949824] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPO took 35.8s. Estimated remaining: 4m 13s. Rate: 7.1 symbols/min [2025-10-08T22:29:23.147273] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-08T22:29:23.156471] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:23.200889] [DEBUG] [LOCAL ] XYL: Loaded 47930 existing records from primary storage. [2025-10-08T22:29:23.201230] [INFO ] [MAIN ] XYL: Loaded 47930 existing records. [2025-10-08T22:29:23.222831] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-08T22:29:23.415299] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:23.415551] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-08T22:29:23.415611] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-08T22:29:23.415911] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-08T22:29:23.415971] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-08T22:29:23.868610] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:24.017548] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-08T22:29:24.503106] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-08T22:29:24.581622] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-08T22:29:24.817564] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-08T22:29:25.617556] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-08T22:29:26.422707] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-10-08T22:29:26.438268] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-08T22:29:26.809520] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-08T22:29:27.217572] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-08T22:29:27.791308] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-08T22:29:28.017559] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-08T22:29:28.680505] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-08T22:29:28.817534] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-08T22:29:29.617574] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-08T22:29:29.684884] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-08T22:29:30.272880] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-08T22:29:30.404421] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-08T22:29:30.417503] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-08T22:29:31.217521] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-08T22:29:31.558143] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-08T22:29:32.017592] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-08T22:29:32.817537] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-08T22:29:32.948290] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T22:29:33.382695] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-08T22:29:33.617565] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-08T22:29:34.417602] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-08T22:29:34.566692] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-08T22:29:35.217578] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-08T22:29:35.343125] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T22:29:35.592811] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-08T22:29:36.017599] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-08T22:29:36.809494] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-08T22:29:36.821163] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-08T22:29:37.269966] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-08T22:29:37.617629] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-08T22:29:38.417596] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-08T22:29:38.582317] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-08T22:29:38.628238] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-08T22:29:39.217549] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-08T22:29:39.571251] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-08T22:29:39.574601] [INFO ] [REMOTE ] XPOF: Full fetch complete (52452 records). [2025-10-08T22:29:39.574805] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-08T22:29:39.974477] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-08T22:29:39.974594] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-08T22:29:39.975769] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-08T22:29:39.975833] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-08T22:29:39.976981] [DEBUG] [LOCAL ] XPOF: Trimmed 52452 records to 37639 (keeping 200 days of data) [2025-10-08T22:29:40.024994] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-08T22:29:40.194218] [DEBUG] [LOCAL ] XPOF: Primary data saved (37639 records). [2025-10-08T22:29:40.194502] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-08T22:29:40.194710] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPOF took 28.4s. Estimated remaining: 4m 5s. Rate: 7.1 symbols/min [2025-10-08T22:29:40.340018] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-08T22:29:40.394546] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:40.394772] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-08T22:29:40.394831] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-08T22:29:40.394944] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-08T22:29:40.394987] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-08T22:29:40.395028] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-08T22:29:40.395060] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-08T22:29:40.740713] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:40.817583] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-08T22:29:41.499590] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-08T22:29:41.617514] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-08T22:29:41.851215] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-08T22:29:42.417562] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-10-08T22:29:42.661163] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-08T22:29:42.661538] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-10-08T22:29:42.661608] [FATAL] [REMOTE ] XYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-08T22:29:42.661685] [FATAL] [MAIN ] XYZ: Failed to fetch primary data. [2025-10-08T22:29:42.661748] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-08T22:29:42.661790] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-08T22:29:42.661846] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-08T22:29:42.661879] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-08T22:29:42.661932] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-08T22:29:42.662001] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XYZ took 2.5s. Estimated remaining: 3m 56s. Rate: 7.1 symbols/min [2025-10-08T22:29:42.839662] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:42.874003] [DEBUG] [LOCAL ] YALA: Loaded 37001 existing records from primary storage. [2025-10-08T22:29:42.874312] [INFO ] [MAIN ] YALA: Loaded 37001 existing records. [2025-10-08T22:29:43.062920] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:43.063167] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-08T22:29:43.063213] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-08T22:29:43.063448] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-08T22:29:43.063505] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-08T22:29:43.222673] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-08T22:29:43.470876] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:43.559801] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-08T22:29:44.017536] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-10-08T22:29:44.625419] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-08T22:29:44.817530] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-08T22:29:45.182606] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-08T22:29:45.617578] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-08T22:29:46.313400] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-08T22:29:46.417536] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-08T22:29:46.941284] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-08T22:29:46.945373] [INFO ] [REMOTE ] XPRO: Full fetch complete (66389 records). [2025-10-08T22:29:46.945586] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-08T22:29:47.218179] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-08T22:29:47.389075] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-08T22:29:47.416920] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-08T22:29:47.417042] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-08T22:29:47.418378] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-08T22:29:47.418463] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-08T22:29:47.420441] [DEBUG] [LOCAL ] XPRO: Trimmed 66389 records to 45859 (keeping 200 days of data) [2025-10-08T22:29:47.696738] [DEBUG] [LOCAL ] XPRO: Primary data saved (45859 records). [2025-10-08T22:29:47.696893] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-08T22:29:47.696986] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XPRO took 32.5s. Estimated remaining: 3m 48s. Rate: 7.1 symbols/min [2025-10-08T22:29:47.865795] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:29:47.906894] [DEBUG] [LOCAL ] YELP: Loaded 45418 existing records from primary storage. [2025-10-08T22:29:47.907244] [INFO ] [MAIN ] YELP: Loaded 45418 existing records. [2025-10-08T22:29:48.022751] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-08T22:29:48.095837] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:29:48.096070] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-08T22:29:48.096119] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-08T22:29:48.096345] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-08T22:29:48.096405] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-08T22:29:48.457592] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:29:48.484426] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-08T22:29:48.817550] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-08T22:29:49.617570] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-10-08T22:29:49.758924] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-08T22:29:49.815433] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T22:29:50.417553] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-08T22:29:50.999386] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-08T22:29:51.217572] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-08T22:29:52.017612] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-08T22:29:52.127386] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-08T22:29:52.516176] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-08T22:29:52.817550] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-08T22:29:53.103079] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-08T22:29:53.617599] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-08T22:29:54.417573] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-08T22:29:54.478049] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T22:29:54.643002] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-08T22:29:55.217565] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-08T22:29:55.911723] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-08T22:29:56.017556] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-08T22:29:56.371524] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-08T22:29:56.817552] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-08T22:29:57.164316] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-08T22:29:57.617562] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-08T22:29:58.423166] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-08T22:29:58.425812] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T22:29:58.928153] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-08T22:29:59.217562] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-08T22:29:59.351384] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-08T22:29:59.353418] [INFO ] [REMOTE ] XYF: Full fetch complete (32447 records). [2025-10-08T22:29:59.353558] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-08T22:29:59.721351] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-08T22:29:59.721442] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-08T22:29:59.722114] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-08T22:29:59.722175] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-08T22:29:59.722982] [DEBUG] [LOCAL ] XYF: Trimmed 32447 records to 28288 (keeping 200 days of data) [2025-10-08T22:29:59.905195] [DEBUG] [LOCAL ] XYF: Primary data saved (28288 records). [2025-10-08T22:29:59.905357] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-08T22:29:59.905448] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. XYF took 38.5s. Estimated remaining: 3m 39s. Rate: 7.1 symbols/min [2025-10-08T22:30:00.022619] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-08T22:30:00.080696] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:00.138267] [DEBUG] [LOCAL ] YETI: Loaded 52471 existing records from primary storage. [2025-10-08T22:30:00.138691] [INFO ] [MAIN ] YETI: Loaded 52471 existing records. [2025-10-08T22:30:00.327825] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:00.328147] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-08T22:30:00.328222] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-08T22:30:00.328681] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-08T22:30:00.328744] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-08T22:30:00.750916] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:00.822688] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-10-08T22:30:00.844907] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-08T22:30:01.617552] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-08T22:30:02.045006] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-08T22:30:02.417563] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-08T22:30:02.631149] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-08T22:30:02.989529] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-08T22:30:03.001119] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-08T22:30:03.008203] [INFO ] [REMOTE ] XYL: Full fetch complete (69701 records). [2025-10-08T22:30:03.008492] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-08T22:30:03.225753] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-08T22:30:03.423288] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-08T22:30:03.423375] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-08T22:30:03.424554] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-08T22:30:03.424624] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-08T22:30:03.426120] [DEBUG] [LOCAL ] XYL: Trimmed 69701 records to 47900 (keeping 200 days of data) [2025-10-08T22:30:03.741250] [DEBUG] [LOCAL ] XYL: Primary data saved (47900 records). [2025-10-08T22:30:03.741684] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-08T22:30:03.741788] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYL took 40.8s. Estimated remaining: 3m 31s. Rate: 7.1 symbols/min [2025-10-08T22:30:03.912294] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:03.954842] [DEBUG] [LOCAL ] YEXT: Loaded 43125 existing records from primary storage. [2025-10-08T22:30:03.955148] [INFO ] [MAIN ] YEXT: Loaded 43125 existing records. [2025-10-08T22:30:04.022751] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-08T22:30:04.140261] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:04.140514] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-08T22:30:04.140565] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-08T22:30:04.141222] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-08T22:30:04.141284] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-08T22:30:04.510016] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:04.817547] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-08T22:30:04.983403] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-08T22:30:05.617475] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-08T22:30:06.007221] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-08T22:30:06.084715] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-08T22:30:06.417611] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-08T22:30:06.964820] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-08T22:30:07.217702] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-10-08T22:30:07.890013] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T22:30:08.017535] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-08T22:30:08.817565] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-08T22:30:08.951084] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-08T22:30:09.617582] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-08T22:30:09.744254] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-08T22:30:10.069457] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-08T22:30:10.417557] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-08T22:30:10.791489] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-08T22:30:11.217566] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-08T22:30:11.947746] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-08T22:30:12.017593] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-08T22:30:12.635672] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-08T22:30:12.817560] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-08T22:30:13.617531] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-08T22:30:13.647140] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-08T22:30:14.257772] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-08T22:30:14.417546] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-08T22:30:14.460785] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T22:30:15.217575] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-08T22:30:16.017523] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-08T22:30:16.104017] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-08T22:30:16.572412] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-08T22:30:16.817510] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-08T22:30:17.126908] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T22:30:17.133216] [INFO ] [REMOTE ] YALA: Full fetch complete (46784 records). [2025-10-08T22:30:17.133456] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-08T22:30:17.523079] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-08T22:30:17.523159] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-08T22:30:17.524022] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-08T22:30:17.524085] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-08T22:30:17.525076] [DEBUG] [LOCAL ] YALA: Trimmed 46784 records to 37037 (keeping 200 days of data) [2025-10-08T22:30:17.618552] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-08T22:30:17.740550] [DEBUG] [LOCAL ] YALA: Primary data saved (37037 records). [2025-10-08T22:30:17.740799] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-08T22:30:17.740917] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 35.1s. Estimated remaining: 3m 23s. Rate: 7.1 symbols/min [2025-10-08T22:30:17.914412] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:17.966088] [DEBUG] [LOCAL ] YMM: Loaded 52632 existing records from primary storage. [2025-10-08T22:30:17.966491] [INFO ] [MAIN ] YMM: Loaded 52632 existing records. [2025-10-08T22:30:18.152836] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:18.153176] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-08T22:30:18.153250] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-08T22:30:18.153533] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-08T22:30:18.153615] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-08T22:30:18.430310] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-08T22:30:18.428387] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-08T22:30:18.608351] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:19.075738] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-08T22:30:19.080023] [INFO ] [REMOTE ] YELP: Full fetch complete (64633 records). [2025-10-08T22:30:19.080141] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-08T22:30:19.233474] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-08T22:30:19.499479] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-08T22:30:19.499565] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-08T22:30:19.500720] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-08T22:30:19.500787] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-08T22:30:19.502124] [DEBUG] [LOCAL ] YELP: Trimmed 64633 records to 45425 (keeping 200 days of data) [2025-10-08T22:30:19.780030] [DEBUG] [LOCAL ] YELP: Primary data saved (45425 records). [2025-10-08T22:30:19.780182] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-08T22:30:19.780296] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. YELP took 32.1s. Estimated remaining: 3m 14s. Rate: 7.1 symbols/min [2025-10-08T22:30:19.965893] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:20.011499] [DEBUG] [LOCAL ] YOU: Loaded 49694 existing records from primary storage. [2025-10-08T22:30:20.011897] [INFO ] [MAIN ] YOU: Loaded 49694 existing records. [2025-10-08T22:30:20.042718] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-10-08T22:30:20.194209] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:20.194529] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-08T22:30:20.194665] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-08T22:30:20.195000] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-08T22:30:20.195134] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-08T22:30:20.586260] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:20.590268] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-08T22:30:20.817528] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-08T22:30:20.844545] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-08T22:30:21.537896] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-08T22:30:21.617564] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-08T22:30:22.352098] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-08T22:30:22.417535] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-10-08T22:30:22.966388] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-08T22:30:23.217597] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-08T22:30:24.017541] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-08T22:30:24.135391] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-08T22:30:24.674320] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-08T22:30:24.817565] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-08T22:30:25.617557] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-08T22:30:25.661754] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-08T22:30:25.981803] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-08T22:30:26.417561] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-08T22:30:27.217556] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-08T22:30:27.445464] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-08T22:30:27.724690] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-08T22:30:28.017583] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-08T22:30:28.768850] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T22:30:28.817548] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-08T22:30:29.617600] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-08T22:30:29.913926] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-08T22:30:30.417571] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-08T22:30:30.501462] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-08T22:30:31.113935] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-08T22:30:31.217551] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-08T22:30:32.017563] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-08T22:30:32.370760] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-08T22:30:32.817520] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-08T22:30:32.954201] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-08T22:30:33.101730] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T22:30:33.617582] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-08T22:30:34.296455] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-08T22:30:34.417554] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-08T22:30:35.217602] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-08T22:30:35.255100] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-08T22:30:35.541072] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-08T22:30:35.545985] [INFO ] [REMOTE ] YETI: Full fetch complete (75421 records). [2025-10-08T22:30:35.546165] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-08T22:30:35.955230] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-08T22:30:35.955357] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-08T22:30:35.956638] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-08T22:30:35.956727] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-08T22:30:35.958322] [DEBUG] [LOCAL ] YETI: Trimmed 75421 records to 52467 (keeping 200 days of data) [2025-10-08T22:30:36.021108] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-08T22:30:36.296417] [DEBUG] [LOCAL ] YETI: Primary data saved (52467 records). [2025-10-08T22:30:36.296560] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-08T22:30:36.296670] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 36.4s. Estimated remaining: 3m 6s. Rate: 7.1 symbols/min [2025-10-08T22:30:36.464562] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:36.516249] [DEBUG] [LOCAL ] YPF: Loaded 50491 existing records from primary storage. [2025-10-08T22:30:36.516607] [INFO ] [MAIN ] YPF: Loaded 50491 existing records. [2025-10-08T22:30:36.706912] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:36.707243] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-08T22:30:36.707299] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-08T22:30:36.707706] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-08T22:30:36.707764] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-08T22:30:36.823786] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-08T22:30:37.095134] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:37.097683] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-08T22:30:37.617513] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-08T22:30:37.718729] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-08T22:30:38.417584] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-08T22:30:38.669766] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-08T22:30:38.945096] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T22:30:38.948554] [INFO ] [REMOTE ] YEXT: Full fetch complete (63158 records). [2025-10-08T22:30:38.948712] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-08T22:30:39.226237] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-10-08T22:30:39.379856] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-08T22:30:39.379967] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-08T22:30:39.381451] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-08T22:30:39.381516] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-08T22:30:39.382972] [DEBUG] [LOCAL ] YEXT: Trimmed 63158 records to 43106 (keeping 200 days of data) [2025-10-08T22:30:39.637016] [DEBUG] [LOCAL ] YEXT: Primary data saved (43106 records). [2025-10-08T22:30:39.637172] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-08T22:30:39.637264] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YEXT took 35.9s. Estimated remaining: 2m 57s. Rate: 7.1 symbols/min [2025-10-08T22:30:39.812598] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:39.825888] [DEBUG] [LOCAL ] YRD: Loaded 12101 existing records from primary storage. [2025-10-08T22:30:39.826108] [INFO ] [MAIN ] YRD: Loaded 12101 existing records. [2025-10-08T22:30:40.022074] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-08T22:30:40.044197] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:40.045967] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-08T22:30:40.046053] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-08T22:30:40.046392] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-08T22:30:40.046478] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-08T22:30:40.445780] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-08T22:30:40.451772] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:40.817538] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-10-08T22:30:41.130258] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T22:30:41.617537] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-08T22:30:41.646594] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-08T22:30:41.730133] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-08T22:30:42.417564] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-08T22:30:43.202123] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-08T22:30:43.217502] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-08T22:30:43.784442] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-08T22:30:44.017580] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-08T22:30:44.457554] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-08T22:30:44.817616] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-08T22:30:45.323208] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-08T22:30:45.617698] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-08T22:30:45.643288] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-08T22:30:46.417638] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-08T22:30:47.187010] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-08T22:30:47.191253] [INFO ] [REMOTE ] YMM: Full fetch complete (76337 records). [2025-10-08T22:30:47.191396] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-08T22:30:47.222875] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-08T22:30:47.590118] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-08T22:30:47.590218] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-08T22:30:47.591471] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-08T22:30:47.591545] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-08T22:30:47.593161] [DEBUG] [LOCAL ] YMM: Trimmed 76337 records to 52596 (keeping 200 days of data) [2025-10-08T22:30:47.940029] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-08T22:30:47.966036] [DEBUG] [LOCAL ] YMM: Primary data saved (52596 records). [2025-10-08T22:30:47.966207] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-08T22:30:47.966344] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YMM took 30.2s. Estimated remaining: 2m 49s. Rate: 7.1 symbols/min [2025-10-08T22:30:48.022699] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-08T22:30:48.142830] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:30:48.169131] [DEBUG] [LOCAL ] YSG: Loaded 25368 existing records from primary storage. [2025-10-08T22:30:48.169435] [INFO ] [MAIN ] YSG: Loaded 25368 existing records. [2025-10-08T22:30:48.362882] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:30:48.363586] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T22:30:48.368498] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-08T22:30:48.368581] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-08T22:30:48.368842] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-08T22:30:48.368901] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-08T22:30:48.735231] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:30:48.817500] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-10-08T22:30:49.617532] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-08T22:30:49.834445] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-08T22:30:50.069707] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-08T22:30:50.417557] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-08T22:30:51.217596] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-08T22:30:51.316994] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-08T22:30:52.017561] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-08T22:30:52.208133] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-08T22:30:52.321109] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-08T22:30:52.817552] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-08T22:30:53.617572] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-08T22:30:53.683064] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-08T22:30:54.314127] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-08T22:30:54.417535] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-08T22:30:54.564990] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-08T22:30:55.217600] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-08T22:30:55.337439] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-08T22:30:56.017553] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-08T22:30:56.712622] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T22:30:56.731750] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-08T22:30:56.817585] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-08T22:30:57.617565] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-08T22:30:58.417515] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-08T22:30:58.508052] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-08T22:30:58.508367] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-08T22:30:58.979266] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-08T22:30:59.217564] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-08T22:31:00.017585] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-08T22:31:00.817534] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-08T22:31:00.846159] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-08T22:31:00.850184] [INFO ] [REMOTE ] YOU: Full fetch complete (72187 records). [2025-10-08T22:31:00.850310] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-08T22:31:01.251143] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-08T22:31:01.278774] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-08T22:31:01.278842] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-08T22:31:01.280092] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-08T22:31:01.280159] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-08T22:31:01.281497] [DEBUG] [LOCAL ] YOU: Trimmed 72187 records to 49690 (keeping 200 days of data) [2025-10-08T22:31:01.583752] [DEBUG] [LOCAL ] YOU: Primary data saved (49690 records). [2025-10-08T22:31:01.583883] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-08T22:31:01.583968] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 41.8s. Estimated remaining: 2m 40s. Rate: 7.1 symbols/min [2025-10-08T22:31:01.622662] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-08T22:31:01.767202] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:31:01.828657] [DEBUG] [LOCAL ] YUM: Loaded 51221 existing records from primary storage. [2025-10-08T22:31:01.829846] [INFO ] [MAIN ] YUM: Loaded 51221 existing records. [2025-10-08T22:31:02.010580] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:31:02.010847] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-08T22:31:02.010955] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-08T22:31:02.011616] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-08T22:31:02.011729] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-08T22:31:02.404660] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:31:02.431949] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-10-08T22:31:02.435022] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-08T22:31:02.470542] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-08T22:31:03.217543] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-08T22:31:03.873379] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-08T22:31:04.017566] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-08T22:31:04.817702] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-08T22:31:05.050630] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-08T22:31:05.060869] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-08T22:31:05.617593] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-08T22:31:06.417536] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-08T22:31:06.625427] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-08T22:31:06.661252] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-08T22:31:07.217528] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-08T22:31:07.498699] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-08T22:31:08.017578] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-08T22:31:08.667741] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-08T22:31:08.671753] [INFO ] [REMOTE ] YPF: Full fetch complete (73465 records). [2025-10-08T22:31:08.671912] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-08T22:31:08.824985] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-08T22:31:08.986468] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-08T22:31:09.131295] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-08T22:31:09.131404] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-08T22:31:09.132669] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-08T22:31:09.132741] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-08T22:31:09.134256] [DEBUG] [LOCAL ] YPF: Trimmed 73465 records to 50525 (keeping 200 days of data) [2025-10-08T22:31:09.443425] [DEBUG] [LOCAL ] YPF: Primary data saved (50525 records). [2025-10-08T22:31:09.443587] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-08T22:31:09.443714] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YPF took 33.1s. Estimated remaining: 2m 32s. Rate: 7.1 symbols/min [2025-10-08T22:31:09.610558] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:31:09.617608] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-08T22:31:09.660111] [DEBUG] [LOCAL ] YUMC: Loaded 52606 existing records from primary storage. [2025-10-08T22:31:09.660509] [INFO ] [MAIN ] YUMC: Loaded 52606 existing records. [2025-10-08T22:31:09.838598] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:31:09.838914] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-08T22:31:09.838963] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-08T22:31:09.839237] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-08T22:31:09.839294] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-08T22:31:10.193532] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:31:10.293905] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-08T22:31:10.295375] [INFO ] [REMOTE ] YRD: Full fetch complete (19093 records). [2025-10-08T22:31:10.295450] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-08T22:31:10.420116] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-10-08T22:31:10.677927] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-08T22:31:10.678027] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-08T22:31:10.678440] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-08T22:31:10.678583] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-08T22:31:10.679530] [DEBUG] [LOCAL ] YRD: Trimmed 19093 records to 11994 (keeping 200 days of data) [2025-10-08T22:31:10.757254] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-08T22:31:10.788601] [DEBUG] [LOCAL ] YRD: Primary data saved (11994 records). [2025-10-08T22:31:10.788769] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-08T22:31:10.788861] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YRD took 31.2s. Estimated remaining: 2m 23s. Rate: 7.1 symbols/min [2025-10-08T22:31:10.955768] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:31:11.002635] [DEBUG] [LOCAL ] ZBH: Loaded 50905 existing records from primary storage. [2025-10-08T22:31:11.003032] [INFO ] [MAIN ] ZBH: Loaded 50905 existing records. [2025-10-08T22:31:11.177437] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:31:11.177629] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-08T22:31:11.177709] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-08T22:31:11.177943] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-08T22:31:11.178001] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-08T22:31:11.222790] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-08T22:31:11.530826] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:31:12.017518] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-08T22:31:12.319263] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-08T22:31:12.704344] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-08T22:31:12.817553] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-10-08T22:31:13.605223] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-08T22:31:13.617498] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-08T22:31:14.417504] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-08T22:31:15.086163] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-08T22:31:15.112150] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-08T22:31:15.217510] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-08T22:31:16.017598] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-08T22:31:16.817518] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-08T22:31:16.876114] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-08T22:31:17.210059] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-08T22:31:17.623562] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-08T22:31:17.630253] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-08T22:31:18.417576] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-08T22:31:18.549559] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T22:31:19.217576] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-08T22:31:19.265719] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-08T22:31:20.017574] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-08T22:31:20.196543] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-08T22:31:20.786119] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-08T22:31:20.817551] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-08T22:31:20.942278] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-08T22:31:21.599718] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-08T22:31:21.602080] [INFO ] [REMOTE ] YSG: Full fetch complete (32300 records). [2025-10-08T22:31:21.602154] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-08T22:31:21.622806] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-08T22:31:21.979531] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-08T22:31:21.979639] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-08T22:31:21.980344] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-08T22:31:21.980388] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-08T22:31:21.981181] [DEBUG] [LOCAL ] YSG: Trimmed 32300 records to 25279 (keeping 200 days of data) [2025-10-08T22:31:22.125563] [DEBUG] [LOCAL ] YSG: Primary data saved (25279 records). [2025-10-08T22:31:22.125738] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-08T22:31:22.125838] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YSG took 34.2s. Estimated remaining: 2m 15s. Rate: 7.1 symbols/min [2025-10-08T22:31:22.296421] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:31:22.318827] [DEBUG] [LOCAL ] ZEPP: Loaded 18118 existing records from primary storage. [2025-10-08T22:31:22.319139] [INFO ] [MAIN ] ZEPP: Loaded 18118 existing records. [2025-10-08T22:31:22.418022] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-08T22:31:22.496552] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:31:22.496791] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-08T22:31:22.496841] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-08T22:31:22.497036] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-08T22:31:22.497093] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-08T22:31:22.850270] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:31:23.217574] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-08T22:31:23.594989] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-08T22:31:24.017531] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-08T22:31:24.075172] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T22:31:24.817531] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-10-08T22:31:25.007381] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-08T22:31:25.299528] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-08T22:31:25.617518] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-08T22:31:25.734599] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-08T22:31:26.138811] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-08T22:31:26.417686] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-08T22:31:27.217623] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-08T22:31:28.017604] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-08T22:31:28.233607] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-08T22:31:28.669884] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-08T22:31:28.817558] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-08T22:31:29.497875] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-08T22:31:29.617587] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-08T22:31:30.104877] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-08T22:31:30.417585] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-08T22:31:30.639354] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-08T22:31:31.217589] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-08T22:31:31.733113] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-08T22:31:31.914277] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T22:31:32.017551] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-08T22:31:32.551164] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-08T22:31:32.817558] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-08T22:31:33.617614] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-08T22:31:34.099776] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-08T22:31:34.417598] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-08T22:31:34.565550] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-08T22:31:35.217570] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-08T22:31:36.017519] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-08T22:31:36.238333] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-08T22:31:36.747303] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-08T22:31:36.817502] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-08T22:31:37.185354] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-08T22:31:37.617611] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-08T22:31:38.417615] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-08T22:31:38.658478] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-08T22:31:39.217720] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-08T22:31:39.345800] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:31:39.520930] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-08T22:31:40.017566] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-08T22:31:40.817605] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-08T22:31:41.029788] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:31:41.617535] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-08T22:31:41.751761] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-08T22:31:41.798490] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.18 seconds). [2025-10-08T22:31:41.803199] [INFO ] [REMOTE ] YUM: Full fetch complete (74468 records). [2025-10-08T22:31:41.803369] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-08T22:31:42.221249] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-08T22:31:42.221401] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-08T22:31:42.222778] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-08T22:31:42.222949] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-08T22:31:42.224789] [DEBUG] [LOCAL ] YUM: Trimmed 74468 records to 51198 (keeping 200 days of data) [2025-10-08T22:31:42.436140] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-08T22:31:42.510225] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-08T22:31:42.627387] [DEBUG] [LOCAL ] YUM: Primary data saved (51198 records). [2025-10-08T22:31:42.627607] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-08T22:31:42.627761] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 41.0s. Estimated remaining: 2m 7s. Rate: 7.1 symbols/min [2025-10-08T22:31:42.824483] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:31:42.877712] [DEBUG] [LOCAL ] ZETA: Loaded 53603 existing records from primary storage. [2025-10-08T22:31:42.878053] [INFO ] [MAIN ] ZETA: Loaded 53603 existing records. [2025-10-08T22:31:43.085442] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:31:43.085739] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-08T22:31:43.085797] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-08T22:31:43.086013] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-08T22:31:43.086070] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-08T22:31:43.222802] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-08T22:31:43.535852] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:31:44.017520] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-08T22:31:44.064954] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-08T22:31:44.119750] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-08T22:31:44.817542] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-10-08T22:31:45.567592] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-08T22:31:45.617495] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-08T22:31:46.417554] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-08T22:31:46.729614] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-08T22:31:46.731978] [INFO ] [REMOTE ] ZEPP: Full fetch complete (19761 records). [2025-10-08T22:31:46.732067] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-08T22:31:47.178306] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-08T22:31:47.178399] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-08T22:31:47.178919] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-08T22:31:47.178981] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-08T22:31:47.179762] [DEBUG] [LOCAL ] ZEPP: Trimmed 19761 records to 18238 (keeping 200 days of data) [2025-10-08T22:31:47.227714] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-08T22:31:47.305765] [DEBUG] [LOCAL ] ZEPP: Primary data saved (18238 records). [2025-10-08T22:31:47.305969] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-08T22:31:47.306147] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. ZEPP took 25.2s. Estimated remaining: 1m 58s. Rate: 7.1 symbols/min [2025-10-08T22:31:47.384832] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-08T22:31:47.813562] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-08T22:31:47.817579] [INFO ] [REMOTE ] ZBH: Full fetch complete (73725 records). [2025-10-08T22:31:47.817755] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-08T22:31:47.926953] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-08T22:31:47.957178] [INFO ] [REMOTE ] YUMC: Full fetch complete (76155 records). [2025-10-08T22:31:47.983029] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-08T22:31:48.027461] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-08T22:31:48.502118] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-08T22:31:48.518584] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-08T22:31:48.541550] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-08T22:31:48.547466] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-08T22:31:48.618692] [DEBUG] [LOCAL ] ZBH: Trimmed 73725 records to 50845 (keeping 200 days of data) [2025-10-08T22:31:48.641250] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-08T22:31:48.641637] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-08T22:31:48.642353] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-08T22:31:48.642427] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-08T22:31:48.644076] [DEBUG] [LOCAL ] YUMC: Trimmed 76155 records to 52603 (keeping 200 days of data) [2025-10-08T22:31:49.316324] [DEBUG] [LOCAL ] YUMC: Primary data saved (52603 records). [2025-10-08T22:31:49.317116] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-08T22:31:49.322178] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. YUMC took 39.9s. Estimated remaining: 1m 50s. Rate: 7.1 symbols/min [2025-10-08T22:31:49.328971] [DEBUG] [LOCAL ] ZBH: Primary data saved (50845 records). [2025-10-08T22:31:49.329170] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-08T22:31:49.329266] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 38.5s. Estimated remaining: 1m 41s. Rate: 7.1 symbols/min [2025-10-08T22:31:50.326448] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-08T22:31:50.338172] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-08T22:31:52.658188] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-08T22:31:52.668724] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-08T22:31:54.825866] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-08T22:31:54.837215] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-08T22:31:56.852204] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-08T22:31:56.863616] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-08T22:31:58.898043] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-08T22:31:58.909958] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-08T22:32:01.154930] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-08T22:32:01.166361] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-08T22:32:03.727261] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-08T22:32:03.739379] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-08T22:32:06.124148] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-08T22:32:06.139592] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-08T22:32:08.673468] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-08T22:32:08.685197] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-08T22:32:10.974999] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-08T22:32:10.979126] [INFO ] [REMOTE ] ZETA: Full fetch complete (77680 records). [2025-10-08T22:32:10.979261] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-08T22:32:11.371917] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-08T22:32:11.372012] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-08T22:32:11.373158] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-08T22:32:11.373233] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-08T22:32:11.374893] [DEBUG] [LOCAL ] ZETA: Trimmed 77680 records to 53609 (keeping 200 days of data) [2025-10-08T22:32:11.711892] [DEBUG] [LOCAL ] ZETA: Primary data saved (53609 records). [2025-10-08T22:32:11.712318] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-08T22:32:11.712416] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 29.1s. Estimated remaining: 1m 33s. Rate: 7.1 symbols/min [2025-10-08T22:32:12.366918] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:12.411066] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:12.458419] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:12.467612] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:12.499223] [DEBUG] [LOCAL ] ZH: Loaded 26008 existing records from primary storage. [2025-10-08T22:32:12.509162] [INFO ] [MAIN ] ZH: Loaded 26008 existing records. [2025-10-08T22:32:12.637854] [DEBUG] [LOCAL ] ZIP: Loaded 43958 existing records from primary storage. [2025-10-08T22:32:12.692094] [DEBUG] [LOCAL ] ZGN: Loaded 40715 existing records from primary storage. [2025-10-08T22:32:12.693056] [DEBUG] [LOCAL ] ZIM: Loaded 53506 existing records from primary storage. [2025-10-08T22:32:12.692341] [INFO ] [MAIN ] ZIP: Loaded 43958 existing records. [2025-10-08T22:32:12.699166] [INFO ] [MAIN ] ZGN: Loaded 40715 existing records. [2025-10-08T22:32:12.719427] [INFO ] [MAIN ] ZIM: Loaded 53506 existing records. [2025-10-08T22:32:12.948517] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:13.044669] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-08T22:32:13.092195] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-08T22:32:13.235249] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:13.243884] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-08T22:32:13.254154] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-08T22:32:13.230000] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-08T22:32:13.318551] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-08T22:32:13.318456] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:13.337023] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-08T22:32:13.338463] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-08T22:32:13.338537] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-08T22:32:13.361412] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-08T22:32:13.380192] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:13.392011] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-08T22:32:13.447370] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-08T22:32:13.465036] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-08T22:32:13.452595] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-08T22:32:13.559227] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-08T22:32:13.586794] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-08T22:32:14.641017] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:14.724932] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:14.709807] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-10-08T22:32:14.732911] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-10-08T22:32:14.757232] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:14.776263] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-10-08T22:32:14.835510] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:14.835954] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-10-08T22:32:15.613535] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-08T22:32:15.618695] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-08T22:32:16.013971] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-08T22:32:16.022319] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-08T22:32:16.066205] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-08T22:32:16.072995] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-08T22:32:16.701287] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-08T22:32:16.706048] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-08T22:32:17.116269] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-08T22:32:17.127429] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-08T22:32:17.343932] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-08T22:32:17.351636] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-08T22:32:17.472561] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-08T22:32:17.481063] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-08T22:32:17.930837] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-08T22:32:17.939378] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-08T22:32:18.351371] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-08T22:32:18.358201] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-08T22:32:18.839322] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-08T22:32:18.846356] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-08T22:32:18.929105] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-08T22:32:18.940063] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-08T22:32:18.991454] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-08T22:32:18.999782] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-08T22:32:19.610531] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-08T22:32:19.620919] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-08T22:32:20.367977] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-08T22:32:20.376199] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-08T22:32:20.410381] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-08T22:32:20.419433] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-08T22:32:20.569865] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-08T22:32:20.580424] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-08T22:32:20.715050] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-08T22:32:20.730285] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-08T22:32:21.348152] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-08T22:32:21.357009] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-08T22:32:22.003695] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-08T22:32:22.014266] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-08T22:32:22.160041] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-08T22:32:22.171036] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-08T22:32:22.420292] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-08T22:32:22.426827] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-08T22:32:22.497224] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-08T22:32:22.508908] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-08T22:32:23.423586] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-08T22:32:23.433849] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-08T22:32:23.455561] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-08T22:32:23.464571] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-08T22:32:23.549242] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-08T22:32:23.560440] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-08T22:32:24.612775] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-08T22:32:24.618711] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-08T22:32:24.678863] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-08T22:32:24.690446] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-08T22:32:24.772100] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-08T22:32:24.781208] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-08T22:32:25.062009] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T22:32:25.070458] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-08T22:32:25.780907] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-08T22:32:25.788266] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-08T22:32:26.391121] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-08T22:32:26.401248] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-08T22:32:26.449771] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-08T22:32:26.460168] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-08T22:32:26.666110] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T22:32:26.677451] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-08T22:32:26.685095] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-08T22:32:26.687381] [INFO ] [REMOTE ] ZH: Full fetch complete (40030 records). [2025-10-08T22:32:26.687472] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-08T22:32:27.091421] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-08T22:32:27.091528] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-08T22:32:27.092381] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-08T22:32:27.092445] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-08T22:32:27.093773] [DEBUG] [LOCAL ] ZH: Trimmed 40030 records to 25762 (keeping 200 days of data) [2025-10-08T22:32:27.244304] [DEBUG] [LOCAL ] ZH: Primary data saved (25762 records). [2025-10-08T22:32:27.244475] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-08T22:32:27.244596] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 15.5s. Estimated remaining: 1m 24s. Rate: 7.1 symbols/min [2025-10-08T22:32:27.430407] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:27.470947] [DEBUG] [LOCAL ] ZK: Loaded 39203 existing records from primary storage. [2025-10-08T22:32:27.471301] [INFO ] [MAIN ] ZK: Loaded 39203 existing records. [2025-10-08T22:32:27.658533] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:27.658956] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-08T22:32:27.659062] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-08T22:32:27.679850] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-08T22:32:27.682560] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-08T22:32:27.717072] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-08T22:32:27.772963] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-08T22:32:28.092597] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:28.095758] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-10-08T22:32:28.098561] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-08T22:32:28.108444] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-08T22:32:28.908188] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-08T22:32:28.919768] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-08T22:32:28.982251] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-08T22:32:28.991397] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-08T22:32:29.298599] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-08T22:32:29.302090] [INFO ] [REMOTE ] ZIP: Full fetch complete (59917 records). [2025-10-08T22:32:29.302196] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-08T22:32:29.888982] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-08T22:32:29.908412] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-08T22:32:29.939566] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-08T22:32:29.945403] [INFO ] [REMOTE ] ZGN: Full fetch complete (57977 records). [2025-10-08T22:32:29.945620] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-08T22:32:29.945166] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-08T22:32:29.946012] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-08T22:32:29.967441] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-08T22:32:30.007618] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-08T22:32:30.078629] [DEBUG] [LOCAL ] ZIP: Trimmed 59917 records to 43870 (keeping 200 days of data) [2025-10-08T22:32:30.593365] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-08T22:32:30.595712] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-08T22:32:30.599114] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-08T22:32:30.599204] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-08T22:32:30.605521] [DEBUG] [LOCAL ] ZGN: Trimmed 57977 records to 40720 (keeping 200 days of data) [2025-10-08T22:32:30.892059] [DEBUG] [LOCAL ] ZIP: Primary data saved (43870 records). [2025-10-08T22:32:30.913710] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-08T22:32:30.934082] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 19.2s. Estimated remaining: 1m 16s. Rate: 7.1 symbols/min [2025-10-08T22:32:30.944845] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-08T22:32:31.021868] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-08T22:32:31.235277] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:31.253374] [DEBUG] [LOCAL ] ZKH: Loaded 7612 existing records from primary storage. [2025-10-08T22:32:31.254855] [INFO ] [MAIN ] ZKH: Loaded 7612 existing records. [2025-10-08T22:32:31.320057] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-08T22:32:31.362979] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-08T22:32:31.479637] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:31.480785] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-08T22:32:31.481681] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-08T22:32:31.482618] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-08T22:32:31.482932] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-08T22:32:31.760572] [DEBUG] [LOCAL ] ZGN: Primary data saved (40720 records). [2025-10-08T22:32:31.785624] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-08T22:32:31.788193] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 20.1s. Estimated remaining: 1m 8s. Rate: 7.1 symbols/min [2025-10-08T22:32:31.997247] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:32.022706] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-10-08T22:32:32.076403] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:32.128492] [DEBUG] [LOCAL ] ZTO: Loaded 49596 existing records from primary storage. [2025-10-08T22:32:32.128939] [INFO ] [MAIN ] ZTO: Loaded 49596 existing records. [2025-10-08T22:32:32.305231] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:32.305512] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-08T22:32:32.305570] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-08T22:32:32.305817] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-08T22:32:32.305876] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-08T22:32:32.701688] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-08T22:32:32.707516] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:32.817525] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-08T22:32:32.912256] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-08T22:32:33.200522] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-08T22:32:33.230195] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-08T22:32:33.617586] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-10-08T22:32:34.417587] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-08T22:32:35.216831] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-08T22:32:35.219566] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-08T22:32:35.269548] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-08T22:32:36.017515] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-08T22:32:36.599826] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-08T22:32:36.817577] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-08T22:32:37.377816] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-08T22:32:37.617554] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-08T22:32:38.209975] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-08T22:32:38.224737] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-08T22:32:38.417560] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-08T22:32:38.994043] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-08T22:32:39.217602] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-08T22:32:39.860229] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-08T22:32:40.017545] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-08T22:32:40.817566] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-08T22:32:41.617526] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-08T22:32:41.680709] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-08T22:32:41.740417] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-08T22:32:42.417741] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-08T22:32:43.208371] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-08T22:32:43.212593] [INFO ] [REMOTE ] ZIM: Full fetch complete (77497 records). [2025-10-08T22:32:43.212775] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-08T22:32:43.226163] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-08T22:32:43.629664] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-08T22:32:43.629848] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-08T22:32:43.631365] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-08T22:32:43.631586] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-08T22:32:43.633771] [DEBUG] [LOCAL ] ZIM: Trimmed 77497 records to 53502 (keeping 200 days of data) [2025-10-08T22:32:43.979094] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-08T22:32:44.012314] [DEBUG] [LOCAL ] ZIM: Primary data saved (53502 records). [2025-10-08T22:32:44.012437] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-08T22:32:44.012515] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 32.3s. Estimated remaining: 59.1s. Rate: 7.1 symbols/min [2025-10-08T22:32:44.023409] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-08T22:32:44.187322] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:44.209594] [DEBUG] [LOCAL ] ZTR: Loaded 16783 existing records from primary storage. [2025-10-08T22:32:44.210000] [INFO ] [MAIN ] ZTR: Loaded 16783 existing records. [2025-10-08T22:32:44.393611] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:44.393887] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-08T22:32:44.393946] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-08T22:32:44.394174] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-08T22:32:44.394231] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-08T22:32:44.751663] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:44.817499] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-10-08T22:32:44.980038] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-08T22:32:45.617525] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-08T22:32:45.743754] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-08T22:32:45.825614] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-08T22:32:46.071627] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-08T22:32:46.417573] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-08T22:32:47.217557] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-08T22:32:47.809491] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-08T22:32:48.017521] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-08T22:32:48.367894] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-08T22:32:48.505443] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-08T22:32:48.817548] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-08T22:32:49.617562] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-08T22:32:50.047809] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-08T22:32:50.417607] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-08T22:32:50.991185] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-08T22:32:50.992224] [INFO ] [REMOTE ] ZKH: Full fetch complete (11969 records). [2025-10-08T22:32:50.992296] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-08T22:32:51.228712] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-08T22:32:51.364778] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-08T22:32:51.364971] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-08T22:32:51.365496] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-08T22:32:51.365613] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-08T22:32:51.366498] [DEBUG] [LOCAL ] ZKH: Trimmed 11969 records to 7652 (keeping 200 days of data) [2025-10-08T22:32:51.410020] [DEBUG] [LOCAL ] ZKH: Primary data saved (7652 records). [2025-10-08T22:32:51.410172] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-08T22:32:51.410259] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 20.5s. Estimated remaining: 50.7s. Rate: 7.1 symbols/min [2025-10-08T22:32:51.587455] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:51.617436] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-08T22:32:51.685694] [DEBUG] [LOCAL ] ZTS: Loaded 53058 existing records from primary storage. [2025-10-08T22:32:51.686210] [INFO ] [MAIN ] ZTS: Loaded 53058 existing records. [2025-10-08T22:32:51.899258] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:51.899571] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-08T22:32:51.899625] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-08T22:32:51.899853] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-08T22:32:51.899909] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-08T22:32:52.022675] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-08T22:32:52.290129] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:32:52.750125] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-08T22:32:52.817559] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-10-08T22:32:53.617594] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-08T22:32:53.841280] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-08T22:32:54.300094] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-08T22:32:54.417550] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-08T22:32:55.098000] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-08T22:32:55.152120] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-08T22:32:55.217493] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-08T22:32:56.017522] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-08T22:32:56.081978] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-08T22:32:56.817555] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-08T22:32:57.617519] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-08T22:32:57.680174] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-08T22:32:58.049400] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-08T22:32:58.052707] [INFO ] [REMOTE ] ZK: Full fetch complete (56833 records). [2025-10-08T22:32:58.052882] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-08T22:32:58.422296] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-08T22:32:58.459750] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-08T22:32:58.459845] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-08T22:32:58.460843] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-08T22:32:58.460914] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-08T22:32:58.462406] [DEBUG] [LOCAL ] ZK: Trimmed 56833 records to 39135 (keeping 200 days of data) [2025-10-08T22:32:58.699819] [DEBUG] [LOCAL ] ZK: Primary data saved (39135 records). [2025-10-08T22:32:58.700045] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-08T22:32:58.700196] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 31.5s. Estimated remaining: 42.2s. Rate: 7.1 symbols/min [2025-10-08T22:32:58.899115] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:32:58.935178] [DEBUG] [LOCAL ] ZVIA: Loaded 35376 existing records from primary storage. [2025-10-08T22:32:58.935525] [INFO ] [MAIN ] ZVIA: Loaded 35376 existing records. [2025-10-08T22:32:59.124635] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:32:59.125089] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-08T22:32:59.125202] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-08T22:32:59.125534] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-08T22:32:59.125619] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-08T22:32:59.219627] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-08T22:32:59.342870] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-08T22:32:59.562587] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-08T22:32:59.643550] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:33:00.017541] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-10-08T22:33:00.817567] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-08T22:33:01.034624] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-08T22:33:01.111363] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-08T22:33:01.390743] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-08T22:33:01.617584] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-08T22:33:02.417601] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-08T22:33:03.217508] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-08T22:33:03.415759] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-08T22:33:04.017549] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-08T22:33:04.145589] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-08T22:33:04.730499] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-08T22:33:04.817536] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-08T22:33:04.954900] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-08T22:33:05.617629] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-08T22:33:05.955750] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-08T22:33:06.417558] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-08T22:33:07.217566] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-08T22:33:07.373789] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-08T22:33:07.422701] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-08T22:33:08.017594] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-08T22:33:08.817584] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-08T22:33:09.091477] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-08T22:33:09.140694] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-08T22:33:09.617512] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-08T22:33:09.851016] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-08T22:33:10.417698] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-08T22:33:11.217507] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-08T22:33:11.482078] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-08T22:33:12.017495] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-08T22:33:12.072163] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-08T22:33:12.107575] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-08T22:33:12.817618] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-08T22:33:13.494336] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-08T22:33:13.617587] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-08T22:33:13.997888] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-08T22:33:14.225609] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-08T22:33:14.227458] [INFO ] [REMOTE ] ZTR: Full fetch complete (26959 records). [2025-10-08T22:33:14.227530] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-08T22:33:14.422727] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-08T22:33:14.597500] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-08T22:33:14.597597] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-08T22:33:14.598190] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-08T22:33:14.598251] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-08T22:33:14.599132] [DEBUG] [LOCAL ] ZTR: Trimmed 26959 records to 16796 (keeping 200 days of data) [2025-10-08T22:33:14.700416] [DEBUG] [LOCAL ] ZTR: Primary data saved (16796 records). [2025-10-08T22:33:14.700573] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-08T22:33:14.700691] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTR took 30.7s. Estimated remaining: 33.8s. Rate: 7.1 symbols/min [2025-10-08T22:33:14.865562] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-30 to 2025-10-08. [2025-10-08T22:33:14.904231] [DEBUG] [LOCAL ] ZWS: Loaded 42335 existing records from primary storage. [2025-10-08T22:33:14.904513] [INFO ] [MAIN ] ZWS: Loaded 42335 existing records. [2025-10-08T22:33:15.079093] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-21, but need from 2024-12-19 for 200 day retention. Performing full refresh. [2025-10-08T22:33:15.079321] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-08T22:33:15.079367] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-08T22:33:15.079614] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-08T22:33:15.079708] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-08T22:33:15.220751] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-08T22:33:15.436882] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-19 to 2025-10-08 (requires 11 months of data pull). [2025-10-08T22:33:15.938562] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-08T22:33:16.017545] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-08T22:33:16.547630] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-08T22:33:16.551843] [INFO ] [REMOTE ] ZTO: Full fetch complete (72728 records). [2025-10-08T22:33:16.552040] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-08T22:33:16.827974] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-10-08T22:33:16.984752] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-08T22:33:16.984911] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-08T22:33:16.986155] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-08T22:33:16.986387] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-08T22:33:16.988165] [DEBUG] [LOCAL ] ZTO: Trimmed 72728 records to 49554 (keeping 200 days of data) [2025-10-08T22:33:17.113532] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-08T22:33:17.335110] [DEBUG] [LOCAL ] ZTO: Primary data saved (49554 records). [2025-10-08T22:33:17.335256] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-08T22:33:17.335337] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZTO took 45.5s. Estimated remaining: 25.3s. Rate: 7.1 symbols/min [2025-10-08T22:33:17.617621] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-08T22:33:17.987707] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-08T22:33:18.417553] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-08T22:33:19.064306] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-08T22:33:19.217580] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-08T22:33:19.647856] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-08T22:33:20.017609] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-08T22:33:20.817568] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-08T22:33:20.884706] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-08T22:33:21.207395] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-08T22:33:21.617565] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-08T22:33:22.317416] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-08T22:33:22.417625] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-08T22:33:23.217529] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-08T22:33:23.426226] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-08T22:33:23.991987] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-08T22:33:24.017523] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-08T22:33:24.373361] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-08T22:33:24.817555] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-08T22:33:25.347407] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-08T22:33:25.617620] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-08T22:33:26.417580] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-08T22:33:26.477189] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-08T22:33:27.217515] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-08T22:33:27.598666] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-08T22:33:27.779576] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-08T22:33:27.782476] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52721 records). [2025-10-08T22:33:27.782577] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-08T22:33:28.030146] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-08T22:33:28.158548] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-08T22:33:28.158659] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-08T22:33:28.159802] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-08T22:33:28.159879] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-08T22:33:28.161204] [DEBUG] [LOCAL ] ZVIA: Trimmed 52721 records to 35417 (keeping 200 days of data) [2025-10-08T22:33:28.371706] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35417 records). [2025-10-08T22:33:28.371899] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-08T22:33:28.372003] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZVIA took 29.7s. Estimated remaining: 16.9s. Rate: 7.1 symbols/min [2025-10-08T22:33:28.632544] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-08T22:33:28.679406] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-08T22:33:28.683516] [INFO ] [REMOTE ] ZTS: Full fetch complete (76719 records). [2025-10-08T22:33:28.683691] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-08T22:33:28.835555] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-08T22:33:29.149566] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-08T22:33:29.149712] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-08T22:33:29.151046] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-08T22:33:29.151172] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-08T22:33:29.152980] [DEBUG] [LOCAL ] ZTS: Trimmed 76719 records to 53076 (keeping 200 days of data) [2025-10-08T22:33:29.517294] [DEBUG] [LOCAL ] ZTS: Primary data saved (53076 records). [2025-10-08T22:33:29.517447] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-08T22:33:29.518327] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZTS took 38.1s. Estimated remaining: 8.4s. Rate: 7.1 symbols/min [2025-10-08T22:33:30.337528] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-08T22:33:30.345904] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-08T22:33:31.900066] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-08T22:33:31.909987] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-08T22:33:33.460048] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-08T22:33:33.470110] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-08T22:33:35.244882] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-08T22:33:35.255498] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-08T22:33:36.494799] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-08T22:33:36.498089] [INFO ] [REMOTE ] ZWS: Full fetch complete (62014 records). [2025-10-08T22:33:36.498201] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-08T22:33:36.878428] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-08T22:33:36.878503] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-08T22:33:36.879508] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-08T22:33:36.879571] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-08T22:33:36.880783] [DEBUG] [LOCAL ] ZWS: Trimmed 62014 records to 42273 (keeping 200 days of data) [2025-10-08T22:33:37.135101] [DEBUG] [LOCAL ] ZWS: Primary data saved (42273 records). [2025-10-08T22:33:37.135235] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-08T22:33:37.135332] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZWS took 22.4s. Estimated remaining: 0.0s. Rate: 7.1 symbols/min [2025-10-08T22:33:37.137432] [INFO ] [MAIN ] Parallel update completed in 5h 33m 33s [2025-10-08T22:33:37.137520] [WARN ] [MAIN ] Failed symbols (600): AAMI, AAM, AAUC, AB, ABCB, ACA, ACEL, ACI, ACM, AD... [2025-10-08T22:33:37.137593] [INFO ] [MAIN ] Update success rate: 74.7% (1771/2371 symbols) [2025-10-08T22:33:37.833955] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (1771/2371 @ 74.69%)' [2025-10-08T22:33:37.834455] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-08T22:33:37.834548] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-08T22:33:37.834606] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-08T22:33:37.834760] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-08T22:33:37.834817] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-08T22:33:38.666608] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-10-08T22:33:38.666898] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-08T22:33:38.667140] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-08T22:33:38.667894] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-10-08T22:33:38.667955] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-08T22:33:38.667992] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-08T22:33:38.668059] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-08T22:33:38.668095] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-08T22:33:38.668123] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-08T22:33:38.668562] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-10-08T22:33:38.668607] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-08T22:33:38.668841] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-08T22:33:38.668904] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-10-08T22:33:38.668946] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-08T22:33:38.668982] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-08T22:33:38.691934] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-08T22:33:38.716121] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-08T22:33:38.716437] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-08T22:33:38.716499] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-08T22:33:38.716534] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-08T22:33:38.716596] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-08T22:33:38.716632] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-08T22:33:38.716712] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-08T22:33:38.718368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-08T22:33:38.718891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-08T22:33:38.719119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-08T22:33:38.719333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-08T22:33:38.719498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-08T22:33:38.719719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-08T22:33:38.719929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-08T22:33:38.720089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-08T22:33:38.720280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-08T22:33:38.720462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-08T22:33:38.720666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-08T22:33:38.720838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-08T22:33:38.721014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-08T22:33:38.721181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-08T22:33:38.721353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-08T22:33:38.721531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-08T22:33:38.721758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-08T22:33:38.721926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-08T22:33:38.722090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-08T22:33:38.722262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-08T22:33:38.722421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-08T22:33:38.722595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-08T22:33:38.722772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-08T22:33:38.722910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-08T22:33:38.723071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-08T22:33:38.723244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-08T22:33:38.723391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-08T22:33:38.723546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-08T22:33:38.723745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-08T22:33:38.723905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-08T22:33:38.724050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-08T22:33:38.724180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-08T22:33:38.724331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-08T22:33:38.724467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-08T22:33:38.724634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-08T22:33:38.724799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-08T22:33:38.724921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-08T22:33:38.725069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-08T22:33:38.725218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-08T22:33:38.725360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-08T22:33:38.725517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-10-08T22:33:38.725672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-08T22:33:38.725843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-08T22:33:38.725994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-08T22:33:38.726139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-08T22:33:38.726255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-08T22:33:38.726375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-08T22:33:38.726509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-08T22:33:38.726733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-08T22:33:38.726863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-08T22:33:38.727054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-08T22:33:38.727209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-08T22:33:38.727351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-08T22:33:38.727529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-08T22:33:38.727729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-08T22:33:38.727892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-08T22:33:38.728034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-08T22:33:38.728176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-08T22:33:38.728314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-08T22:33:38.728469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-08T22:33:38.728604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-08T22:33:38.728779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-08T22:33:38.728928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-08T22:33:38.729123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-08T22:33:38.729292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-08T22:33:38.729423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-08T22:33:38.729594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-08T22:33:38.729796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-08T22:33:38.729903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-08T22:33:38.730046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-08T22:33:38.730208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-08T22:33:38.730347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-08T22:33:38.730464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-08T22:33:38.730683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-08T22:33:38.730828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-08T22:33:38.730974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-08T22:33:38.731076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-08T22:33:38.731212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-08T22:33:38.731361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-08T22:33:38.731496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-08T22:33:38.731631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-08T22:33:38.731811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-08T22:33:38.731958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-08T22:33:38.732078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-08T22:33:38.732218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-08T22:33:38.732335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-08T22:33:38.732453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-08T22:33:38.732589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-08T22:33:38.732771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-08T22:33:38.732894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-08T22:33:38.733038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-08T22:33:38.733224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-08T22:33:38.733354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-08T22:33:38.733472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-08T22:33:38.733636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-08T22:33:38.733812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-08T22:33:38.733937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-08T22:33:38.734102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-08T22:33:38.734224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-08T22:33:38.734359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-08T22:33:38.734498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-08T22:33:38.734630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-08T22:33:38.734826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-08T22:33:38.735002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-08T22:33:38.735145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-08T22:33:38.735313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-08T22:33:38.735436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-08T22:33:38.735573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-08T22:33:38.735774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-08T22:33:38.735948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-08T22:33:38.736122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-08T22:33:38.736293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-08T22:33:38.736449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-08T22:33:38.736596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-08T22:33:38.736765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-08T22:33:38.736902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-08T22:33:38.737040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-08T22:33:38.737198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-08T22:33:38.737331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-08T22:33:38.737455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-08T22:33:38.737574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-08T22:33:38.737720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-08T22:33:38.737855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-08T22:33:38.737995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-08T22:33:38.738114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-08T22:33:38.738234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-08T22:33:38.738361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-08T22:33:38.738528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-08T22:33:38.738690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-08T22:33:38.738823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-08T22:33:38.738933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-08T22:33:38.739086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-08T22:33:38.739218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-08T22:33:38.739331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-08T22:33:38.739474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-08T22:33:38.739575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-08T22:33:38.739719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-08T22:33:38.739845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-08T22:33:38.739970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-08T22:33:38.740094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-08T22:33:38.740268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-08T22:33:38.740399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-08T22:33:38.740536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-08T22:33:38.740671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-08T22:33:38.740833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-08T22:33:38.740940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-08T22:33:38.741072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-08T22:33:38.741210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-08T22:33:38.741322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-08T22:33:38.741435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-08T22:33:38.741541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-08T22:33:38.741678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-08T22:33:38.741804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-08T22:33:38.741931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-08T22:33:38.742050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-08T22:33:38.742177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-08T22:33:38.742285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-08T22:33:38.742392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-08T22:33:38.742532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-08T22:33:38.742623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-08T22:33:38.742806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-08T22:33:38.742914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-08T22:33:38.743033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-08T22:33:38.743179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-08T22:33:38.743303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-08T22:33:38.743397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-08T22:33:38.743484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-08T22:33:38.743606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-08T22:33:38.744074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-08T22:33:38.744194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-08T22:33:38.744306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-08T22:33:38.744444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-08T22:33:38.744571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-08T22:33:38.744722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-08T22:33:38.744838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-08T22:33:38.744934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-08T22:33:38.745033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-08T22:33:38.745181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-08T22:33:38.745341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-08T22:33:38.745448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-08T22:33:38.745567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-08T22:33:38.745693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-08T22:33:38.745843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-08T22:33:38.745949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-08T22:33:38.746093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-08T22:33:38.746210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-08T22:33:38.746328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-08T22:33:38.746451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-08T22:33:38.746588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-08T22:33:38.746737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-08T22:33:38.746898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-08T22:33:38.746996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-08T22:33:38.747118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-08T22:33:38.747235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-08T22:33:38.747398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-08T22:33:38.747555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-08T22:33:38.747905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-08T22:33:38.748037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-08T22:33:38.748153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-08T22:33:38.748248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-08T22:33:38.748339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-08T22:33:38.748433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-08T22:33:38.748546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-08T22:33:38.748724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-10-08T22:33:38.748835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-08T22:33:38.748970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-08T22:33:38.749139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-08T22:33:38.749259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-08T22:33:38.749372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-08T22:33:38.749492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-08T22:33:38.749601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-08T22:33:38.749763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-08T22:33:38.749887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-08T22:33:38.750035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-08T22:33:38.750150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-08T22:33:38.750291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-08T22:33:38.750446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-08T22:33:38.750562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-08T22:33:38.750725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-08T22:33:38.750823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-08T22:33:38.750931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-08T22:33:38.751029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-08T22:33:38.751135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-08T22:33:38.751262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-08T22:33:38.751371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-08T22:33:38.751477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-08T22:33:38.751592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-08T22:33:38.751734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-08T22:33:38.751867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-08T22:33:38.751983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-10-08T22:33:38.752124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-08T22:33:38.752251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-08T22:33:38.752366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-08T22:33:38.752472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-08T22:33:38.752608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-08T22:33:38.752744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-08T22:33:38.752871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-08T22:33:38.752997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-08T22:33:38.753123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-08T22:33:38.753235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-08T22:33:38.753365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-08T22:33:38.753483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-08T22:33:38.753593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-08T22:33:38.753733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-08T22:33:38.753858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-08T22:33:38.753981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-08T22:33:38.754109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-08T22:33:38.754225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-08T22:33:38.754349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-08T22:33:38.754455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-08T22:33:38.754608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-08T22:33:38.754773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-08T22:33:38.754930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-08T22:33:38.755106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-08T22:33:38.755219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-08T22:33:38.755357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-08T22:33:38.755474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-08T22:33:38.755591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-08T22:33:38.755884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-08T22:33:38.756023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-08T22:33:38.756121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-08T22:33:38.756197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-08T22:33:38.756281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-08T22:33:38.756420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-08T22:33:38.756543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-08T22:33:38.756715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-10-08T22:33:38.756816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-08T22:33:38.756911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-08T22:33:38.757033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-08T22:33:38.757149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-08T22:33:38.757260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-08T22:33:38.757394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-08T22:33:38.757487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-08T22:33:38.757573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-08T22:33:38.757705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-08T22:33:38.757823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-08T22:33:38.757968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-08T22:33:38.758070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-08T22:33:38.758160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-08T22:33:38.758268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-08T22:33:38.758387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-08T22:33:38.758506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-08T22:33:38.758636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-08T22:33:38.758786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-08T22:33:38.758919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-08T22:33:38.759048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-08T22:33:38.759160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-08T22:33:38.759296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-08T22:33:38.759413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-08T22:33:38.759509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-08T22:33:38.759602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-08T22:33:38.759742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-08T22:33:38.759833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-08T22:33:38.759945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-08T22:33:38.760039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-08T22:33:38.760132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-08T22:33:38.760256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-08T22:33:38.760377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-08T22:33:38.760505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-08T22:33:38.760627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-08T22:33:38.760833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-08T22:33:38.760931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-08T22:33:38.760997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-08T22:33:38.761081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-08T22:33:38.761172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-08T22:33:38.761266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-08T22:33:38.761380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-08T22:33:38.761498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-08T22:33:38.761633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-08T22:33:38.761780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-08T22:33:38.761889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-08T22:33:38.762012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-08T22:33:38.762121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-08T22:33:38.762214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-08T22:33:38.762282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-08T22:33:38.762379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-08T22:33:38.762471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-08T22:33:38.762579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-08T22:33:38.762733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-08T22:33:38.762859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-08T22:33:38.763016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-08T22:33:38.763124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-10-08T22:33:38.763220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-08T22:33:38.763340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-08T22:33:38.763469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-08T22:33:38.763546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-08T22:33:38.763630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-08T22:33:38.763825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-08T22:33:38.763900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-08T22:33:38.763967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-08T22:33:38.764065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-08T22:33:38.764228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-08T22:33:38.764362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-08T22:33:38.764459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-08T22:33:38.764559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-08T22:33:38.764680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-08T22:33:38.764774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-08T22:33:38.764859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-08T22:33:38.764978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-08T22:33:38.765084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-08T22:33:38.765218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-08T22:33:38.765332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-08T22:33:38.765426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-08T22:33:38.765541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-08T22:33:38.765670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-08T22:33:38.765793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-08T22:33:38.765921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-08T22:33:38.766035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-08T22:33:38.766132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-08T22:33:38.766225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-08T22:33:38.766319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-08T22:33:38.766398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-08T22:33:38.766503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-08T22:33:38.766608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-08T22:33:38.766763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-08T22:33:38.766901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-08T22:33:38.767016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-08T22:33:38.767107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-08T22:33:38.767196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-08T22:33:38.767299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-08T22:33:38.767417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-08T22:33:38.767522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-08T22:33:38.767636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-08T22:33:38.767903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-08T22:33:38.767995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-08T22:33:38.768063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-08T22:33:38.768145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-08T22:33:38.768256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-08T22:33:38.768368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-08T22:33:38.768503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-08T22:33:38.768598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-08T22:33:38.768705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-08T22:33:38.768814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-08T22:33:38.768939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-08T22:33:38.769070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-08T22:33:38.769169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-08T22:33:38.769294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-08T22:33:38.769404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-08T22:33:38.769497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-08T22:33:38.769584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-08T22:33:38.769726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-08T22:33:38.769861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-08T22:33:38.769958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-08T22:33:38.770052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-08T22:33:38.770170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-08T22:33:38.770262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-08T22:33:38.770346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-08T22:33:38.770456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-08T22:33:38.770563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-08T22:33:38.770699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-08T22:33:38.770809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-08T22:33:38.770932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-08T22:33:38.771080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-08T22:33:38.771184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-08T22:33:38.771283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-08T22:33:38.771429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-08T22:33:38.771548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-08T22:33:38.771670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-08T22:33:38.771765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-08T22:33:38.771853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-08T22:33:38.771998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-08T22:33:38.772126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-08T22:33:38.772232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-08T22:33:38.772329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-10-08T22:33:38.772423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-08T22:33:38.772513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-08T22:33:38.772598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-08T22:33:38.772751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-08T22:33:38.772875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-08T22:33:38.772980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-08T22:33:38.773100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-08T22:33:38.773222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-08T22:33:38.773361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-08T22:33:38.773499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-08T22:33:38.773630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-08T22:33:38.773762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-08T22:33:38.773870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-08T22:33:38.773976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-08T22:33:38.774071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-08T22:33:38.774196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-10-08T22:33:38.774297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-08T22:33:38.774370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-08T22:33:38.774451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-10-08T22:33:38.774575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-08T22:33:38.774719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-08T22:33:38.774829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-08T22:33:38.774938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-08T22:33:38.775032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-08T22:33:38.775112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-08T22:33:38.775217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-08T22:33:38.775308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-08T22:33:38.775394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-08T22:33:38.775507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-08T22:33:38.775639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-08T22:33:38.776006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-08T22:33:38.776091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-10-08T22:33:38.776185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-08T22:33:38.776257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-08T22:33:38.776324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-08T22:33:38.776398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-08T22:33:38.776514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-08T22:33:38.776606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-08T22:33:38.776714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-08T22:33:38.776808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-08T22:33:38.776875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-08T22:33:38.776957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-08T22:33:38.777076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-08T22:33:38.777177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-08T22:33:38.777295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-08T22:33:38.777400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-08T22:33:38.777509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-08T22:33:38.777603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-08T22:33:38.777710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-08T22:33:38.777802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-08T22:33:38.777886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-08T22:33:38.777977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-08T22:33:38.778076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-08T22:33:38.778183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-08T22:33:38.778271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-08T22:33:38.778339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-08T22:33:38.778427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-08T22:33:38.778532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-10-08T22:33:38.778639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-08T22:33:38.778766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-08T22:33:38.778857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-08T22:33:38.778964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-08T22:33:38.779116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-08T22:33:38.779207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-08T22:33:38.779332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-08T22:33:38.779445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-08T22:33:38.779539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-08T22:33:38.779660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-08T22:33:38.779769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-08T22:33:38.779873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-08T22:33:38.779972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-08T22:33:38.780041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-08T22:33:38.780106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-08T22:33:38.780173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-08T22:33:38.780287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-08T22:33:38.780392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-08T22:33:38.780485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-08T22:33:38.780578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-08T22:33:38.780706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-08T22:33:38.780814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-08T22:33:38.780988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-08T22:33:38.781084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-08T22:33:38.781173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-08T22:33:38.781286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-08T22:33:38.781396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-08T22:33:38.781535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-08T22:33:38.781695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-08T22:33:38.781796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-08T22:33:38.781872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-08T22:33:38.781966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-08T22:33:38.782063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-08T22:33:38.782138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-10-08T22:33:38.782211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-08T22:33:38.782279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-08T22:33:38.782349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-08T22:33:38.782452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-08T22:33:38.782561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-08T22:33:38.782719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-08T22:33:38.782832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-08T22:33:38.782940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-08T22:33:38.783079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-08T22:33:38.783193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-08T22:33:38.783290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-08T22:33:38.783372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-08T22:33:38.783481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-08T22:33:38.783572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-08T22:33:38.783748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-08T22:33:38.783843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-08T22:33:38.783912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-08T22:33:38.783989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-08T22:33:38.784087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-08T22:33:38.784181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-08T22:33:38.784298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-08T22:33:38.784390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-08T22:33:38.784466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-08T22:33:38.784547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-08T22:33:38.784661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-08T22:33:38.784760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-08T22:33:38.784865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-08T22:33:38.784965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-08T22:33:38.785076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-08T22:33:38.785194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-08T22:33:38.785289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-08T22:33:38.785357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-10-08T22:33:38.785437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-08T22:33:38.785544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-08T22:33:38.785673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-08T22:33:38.785779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-08T22:33:38.785896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-08T22:33:38.786011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-08T22:33:38.786134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-08T22:33:38.786227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-08T22:33:38.786297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-08T22:33:38.786454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-08T22:33:38.786549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-08T22:33:38.786681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-08T22:33:38.786797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-08T22:33:38.786892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-08T22:33:38.787000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-08T22:33:38.787096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-08T22:33:38.787185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-08T22:33:38.787293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-08T22:33:38.787408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-08T22:33:38.787510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-08T22:33:38.787583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-08T22:33:38.787706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-08T22:33:38.787826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-08T22:33:38.787937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-08T22:33:38.788043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-08T22:33:38.788139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-08T22:33:38.788209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-08T22:33:38.788284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-08T22:33:38.788353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-08T22:33:38.788418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-08T22:33:38.788498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-08T22:33:38.788592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-08T22:33:38.788707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-08T22:33:38.788861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-08T22:33:38.788982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-08T22:33:38.789102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-08T22:33:38.789206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-08T22:33:38.789313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-08T22:33:38.789404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-08T22:33:38.789500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-08T22:33:38.789616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-08T22:33:38.789763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-08T22:33:38.789875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-08T22:33:38.789984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-08T22:33:38.790076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-08T22:33:38.790158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-08T22:33:38.790271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-08T22:33:38.790404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-08T22:33:38.790531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-08T22:33:38.790638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-08T22:33:38.790761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-08T22:33:38.790854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-08T22:33:38.790962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-08T22:33:38.791077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-08T22:33:38.791177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-08T22:33:38.791262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-08T22:33:38.791370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-08T22:33:38.791463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-08T22:33:38.791530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-08T22:33:38.791612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-08T22:33:38.791936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-08T22:33:38.792043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-08T22:33:38.792170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-08T22:33:38.792286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-08T22:33:38.792377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-08T22:33:38.792474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-08T22:33:38.792581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-08T22:33:38.792714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-08T22:33:38.792810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-08T22:33:38.792919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-08T22:33:38.793054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-08T22:33:38.793162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-08T22:33:38.793251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-08T22:33:38.793316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-08T22:33:38.793399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-08T22:33:38.793556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-08T22:33:38.793685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-08T22:33:38.793796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-08T22:33:38.793892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-08T22:33:38.793977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-08T22:33:38.794113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-08T22:33:38.794194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-08T22:33:38.794266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-08T22:33:38.794337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-08T22:33:38.794406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-08T22:33:38.794472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-08T22:33:38.794537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-08T22:33:38.794603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-08T22:33:38.794705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-08T22:33:38.794814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-08T22:33:38.794910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-08T22:33:38.794990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-08T22:33:38.795093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-08T22:33:38.795166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-10-08T22:33:38.795254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-08T22:33:38.795364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-08T22:33:38.795474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-08T22:33:38.795582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-08T22:33:38.795715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-08T22:33:38.795821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-08T22:33:38.795912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-08T22:33:38.796007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-08T22:33:38.796078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-08T22:33:38.796149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-08T22:33:38.796234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-08T22:33:38.796335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-08T22:33:38.796474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-08T22:33:38.796567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-08T22:33:38.796895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-08T22:33:38.797026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-08T22:33:38.797121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-08T22:33:38.797192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-08T22:33:38.797279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-08T22:33:38.797374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-10-08T22:33:38.797467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-08T22:33:38.797561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-10-08T22:33:38.797635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-08T22:33:38.797853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-08T22:33:38.797963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-08T22:33:38.798060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-08T22:33:38.798128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-08T22:33:38.798213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-08T22:33:38.798306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-08T22:33:38.798373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-08T22:33:38.798440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-10-08T22:33:38.798536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-08T22:33:38.798630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-08T22:33:38.798742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-08T22:33:38.798819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-08T22:33:38.798885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-08T22:33:38.798981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-08T22:33:38.799112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-08T22:33:38.799201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-08T22:33:38.799317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-08T22:33:38.799411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-08T22:33:38.799480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-10-08T22:33:38.799559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-08T22:33:38.799691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-10-08T22:33:38.799786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-08T22:33:38.799871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-08T22:33:38.799960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-08T22:33:38.800046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-08T22:33:38.800138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-08T22:33:38.800207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-08T22:33:38.800275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-08T22:33:38.800340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-08T22:33:38.800440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-08T22:33:38.800546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-08T22:33:38.800616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-08T22:33:38.800893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-08T22:33:38.800978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-08T22:33:38.801129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-08T22:33:38.801232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-08T22:33:38.801310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-08T22:33:38.801382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-08T22:33:38.801453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-08T22:33:38.801521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-08T22:33:38.801588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-08T22:33:38.801687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-08T22:33:38.801782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-08T22:33:38.801869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-08T22:33:38.801965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-08T22:33:38.802035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-08T22:33:38.802102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-08T22:33:38.802167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-08T22:33:38.802233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-08T22:33:38.802297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-10-08T22:33:38.802380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-10-08T22:33:38.802473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-08T22:33:38.802546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-08T22:33:38.802614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-08T22:33:38.802736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-08T22:33:38.802828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-08T22:33:38.802912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-08T22:33:38.803005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-08T22:33:38.803075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-08T22:33:38.803164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-08T22:33:38.803275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-08T22:33:38.803392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-08T22:33:38.803511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-08T22:33:38.803633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-08T22:33:38.803770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-08T22:33:38.803843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-08T22:33:38.803927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-08T22:33:38.804024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-08T22:33:38.804102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-08T22:33:38.804169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-08T22:33:38.804238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-08T22:33:38.804303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-08T22:33:38.804384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-08T22:33:38.804477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-08T22:33:38.804558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-08T22:33:38.804874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-08T22:33:38.804988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-08T22:33:38.805097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-08T22:33:38.805189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-08T22:33:38.805275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-08T22:33:38.805384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-08T22:33:38.805477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-08T22:33:38.805547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-08T22:33:38.805616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-08T22:33:38.805738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-10-08T22:33:38.805846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-08T22:33:38.805939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-08T22:33:38.806010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-08T22:33:38.806079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-08T22:33:38.806144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-08T22:33:38.806229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-08T22:33:38.806336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-08T22:33:38.806409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-08T22:33:38.806500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-08T22:33:38.806594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-08T22:33:38.806701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-08T22:33:38.806796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-08T22:33:38.806871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-08T22:33:38.806946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-08T22:33:38.807017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-08T22:33:38.807088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-08T22:33:38.807151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-08T22:33:38.807239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-08T22:33:38.807332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-08T22:33:38.807418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-08T22:33:38.807546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-08T22:33:38.807702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-08T22:33:38.807802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-08T22:33:38.807904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-08T22:33:38.807999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-10-08T22:33:38.808070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-08T22:33:38.808139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-08T22:33:38.808204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-08T22:33:38.808274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-08T22:33:38.808360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-08T22:33:38.808452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-08T22:33:38.808520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-08T22:33:38.808591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-08T22:33:38.808695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-08T22:33:38.808792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-08T22:33:38.808885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-08T22:33:38.812515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-08T22:33:38.812954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-08T22:33:38.813075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-08T22:33:38.813172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-08T22:33:38.813242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-08T22:33:38.813334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-08T22:33:38.813475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-08T22:33:38.813583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-08T22:33:38.813709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-10-08T22:33:38.813802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-08T22:33:38.813903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-08T22:33:38.813999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-08T22:33:38.814068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-08T22:33:38.814165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-08T22:33:38.814287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-08T22:33:38.814387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-08T22:33:38.814491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-08T22:33:38.814610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-08T22:33:38.814766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-08T22:33:38.814861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-08T22:33:38.814933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-08T22:33:38.814999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-08T22:33:38.815118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-08T22:33:38.815260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-08T22:33:38.815354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-08T22:33:38.815439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-08T22:33:38.815547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-08T22:33:38.815682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-08T22:33:38.815789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-08T22:33:38.815910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-08T22:33:38.816017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-08T22:33:38.816125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-08T22:33:38.816243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-08T22:33:38.816363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-08T22:33:38.816483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-08T22:33:38.816589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-08T22:33:38.817062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-08T22:33:38.817151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-10-08T22:33:38.817258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-08T22:33:38.817405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-08T22:33:38.817503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-08T22:33:38.817574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-08T22:33:38.817668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-08T22:33:38.817771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-08T22:33:38.817871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-08T22:33:38.817965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-08T22:33:38.818049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-08T22:33:38.818147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-08T22:33:38.818221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-08T22:33:38.818308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-08T22:33:38.818440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-08T22:33:38.818548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-08T22:33:38.818674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-08T22:33:38.818805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-08T22:33:38.818927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-08T22:33:38.819095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-08T22:33:38.819218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-08T22:33:38.819314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-08T22:33:38.819403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-08T22:33:38.819529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-10-08T22:33:38.819679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-08T22:33:38.819796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-08T22:33:38.819944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-08T22:33:38.820041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-08T22:33:38.820115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-08T22:33:38.820183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-10-08T22:33:38.820251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-08T22:33:38.820320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-08T22:33:38.820391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-08T22:33:38.820470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-08T22:33:38.820540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-08T22:33:38.820609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-08T22:33:38.820715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-08T22:33:38.820807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-08T22:33:38.820879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-08T22:33:38.820979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-08T22:33:38.821112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-08T22:33:38.821210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-08T22:33:38.821301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-08T22:33:38.821395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-08T22:33:38.821466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-08T22:33:38.821538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-08T22:33:38.821623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-08T22:33:38.821855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-08T22:33:38.821935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-08T22:33:38.822002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-08T22:33:38.822067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-08T22:33:38.822156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-08T22:33:38.822262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-08T22:33:38.822361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-08T22:33:38.822434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-08T22:33:38.822527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-08T22:33:38.822635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-08T22:33:38.822879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-08T22:33:38.823002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-08T22:33:38.823075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-08T22:33:38.823157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-08T22:33:38.823266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-08T22:33:38.823354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-10-08T22:33:38.823424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-08T22:33:38.823557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-08T22:33:38.823686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-08T22:33:38.823780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-08T22:33:38.823849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-08T22:33:38.823915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-08T22:33:38.824000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-08T22:33:38.824092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-08T22:33:38.824163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-08T22:33:38.824235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-08T22:33:38.824342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-08T22:33:38.824473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-08T22:33:38.824566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-08T22:33:38.824683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-08T22:33:38.824834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-08T22:33:38.824941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-08T22:33:38.825051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-08T22:33:38.825141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-08T22:33:38.825210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-08T22:33:38.825276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-08T22:33:38.825355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-08T22:33:38.825452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-08T22:33:38.825523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-08T22:33:38.825590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-08T22:33:38.825686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-08T22:33:38.825779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-08T22:33:38.825845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-08T22:33:38.825969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-08T22:33:38.826096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-08T22:33:38.826193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-08T22:33:38.826286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-08T22:33:38.826397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-08T22:33:38.826533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-08T22:33:38.826630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-08T22:33:38.826777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-08T22:33:38.826887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-08T22:33:38.826998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-08T22:33:38.827089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-08T22:33:38.827157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-08T22:33:38.827260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-08T22:33:38.827344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-08T22:33:38.827413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-08T22:33:38.827494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-08T22:33:38.827605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-08T22:33:38.827725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-08T22:33:38.827827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-08T22:33:38.827921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-08T22:33:38.827991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-08T22:33:38.828070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-08T22:33:38.828180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-08T22:33:38.828274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-08T22:33:38.828365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-08T22:33:38.828462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-08T22:33:38.828530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-08T22:33:38.828615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-08T22:33:38.828755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-08T22:33:38.828833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-08T22:33:38.828907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-08T22:33:38.828972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-08T22:33:38.829123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-08T22:33:38.829222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-08T22:33:38.829295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-08T22:33:38.829377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-08T22:33:38.829498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-08T22:33:38.829595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-08T22:33:38.829823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-08T22:33:38.829937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-08T22:33:38.830035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-08T22:33:38.830107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-08T22:33:38.830186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-08T22:33:38.830281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-08T22:33:38.830351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-08T22:33:38.830439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-08T22:33:38.830534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-08T22:33:38.830606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-08T22:33:38.830723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-08T22:33:38.830841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-08T22:33:38.830958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-08T22:33:38.831058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-08T22:33:38.831145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-08T22:33:38.831242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-08T22:33:38.831322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-08T22:33:38.831394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-10-08T22:33:38.831468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-08T22:33:38.831566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-08T22:33:38.831695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-08T22:33:38.831792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-08T22:33:38.831861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-08T22:33:38.831951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-08T22:33:38.832057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-08T22:33:38.832189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-08T22:33:38.832313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-08T22:33:38.832406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-08T22:33:38.832488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-08T22:33:38.832584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-08T22:33:38.832708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-08T22:33:38.832802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-08T22:33:38.832887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-08T22:33:38.833016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-08T22:33:38.833108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-08T22:33:38.833203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-08T22:33:38.833290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-08T22:33:38.833384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-08T22:33:38.833456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-08T22:33:38.833542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-08T22:33:38.833636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-08T22:33:38.833763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-08T22:33:38.833838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-08T22:33:38.833942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-08T22:33:38.834041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-08T22:33:38.834129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-08T22:33:38.834240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-08T22:33:38.834390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-08T22:33:38.834508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-08T22:33:38.834608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-08T22:33:38.834714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-08T22:33:38.834811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-08T22:33:38.834880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-08T22:33:38.834948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-08T22:33:38.835016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-08T22:33:38.835085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-08T22:33:38.835150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-08T22:33:38.835216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-08T22:33:38.835282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-08T22:33:38.835347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-08T22:33:38.835415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-08T22:33:38.835513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-08T22:33:38.835607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-08T22:33:38.835717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-08T22:33:38.835808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-08T22:33:38.835898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-08T22:33:38.836009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-08T22:33:38.836103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-08T22:33:38.836189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-08T22:33:38.836303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-08T22:33:38.836399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-08T22:33:38.836469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-08T22:33:38.836534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-08T22:33:38.836598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-08T22:33:38.836695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-08T22:33:38.836787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-08T22:33:38.836856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-08T22:33:38.836921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-08T22:33:38.837000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-08T22:33:38.837092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-08T22:33:38.837160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-08T22:33:38.837249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-08T22:33:38.837343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-08T22:33:38.837411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-08T22:33:38.837476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-08T22:33:38.837559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-08T22:33:38.837879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-08T22:33:38.837983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-08T22:33:38.838052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-08T22:33:38.838129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-08T22:33:38.838199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-08T22:33:38.838268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-08T22:33:38.838353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-08T22:33:38.838449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-08T22:33:38.838518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-08T22:33:38.838585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-08T22:33:38.838677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-08T22:33:38.838780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-08T22:33:38.838853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-08T22:33:38.838922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-08T22:33:38.839011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-08T22:33:38.839111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-10-08T22:33:38.839184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-08T22:33:38.839252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-08T22:33:38.839405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-08T22:33:38.839490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-08T22:33:38.839566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-08T22:33:38.839662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-08T22:33:38.839768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-08T22:33:38.839840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-08T22:33:38.839928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-08T22:33:38.840022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-08T22:33:38.840093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-08T22:33:38.840184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-08T22:33:38.840279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-08T22:33:38.840354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-08T22:33:38.840429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-08T22:33:38.840495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-08T22:33:38.840563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-10-08T22:33:38.840686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-08T22:33:38.840788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-08T22:33:38.840860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-08T22:33:38.840929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-08T22:33:38.840998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-08T22:33:38.841085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-08T22:33:38.841179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-08T22:33:38.841250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-08T22:33:38.841332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-08T22:33:38.841401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-08T22:33:38.841535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-08T22:33:38.841678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-08T22:33:38.841804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-08T22:33:38.841949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-08T22:33:38.842047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-08T22:33:38.842141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-08T22:33:38.842235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-08T22:33:38.842304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-08T22:33:38.842372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-08T22:33:38.842439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-08T22:33:38.842505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-08T22:33:38.842605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-08T22:33:38.843012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-08T22:33:38.843125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-08T22:33:38.843233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-08T22:33:38.843330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-08T22:33:38.843401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-08T22:33:38.843471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-08T22:33:38.843538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-08T22:33:38.843605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-08T22:33:38.843701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-08T22:33:38.843791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-08T22:33:38.843864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-08T22:33:38.843932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-08T22:33:38.844027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-08T22:33:38.844153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-08T22:33:38.844248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-08T22:33:38.844317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-08T22:33:38.844386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-08T22:33:38.844460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-08T22:33:38.844526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-08T22:33:38.844592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-08T22:33:38.844685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-08T22:33:38.844778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-08T22:33:38.844879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-08T22:33:38.844988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-08T22:33:38.845088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-08T22:33:38.845160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-10-08T22:33:38.845253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-08T22:33:38.845346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-08T22:33:38.845414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-08T22:33:38.845480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-08T22:33:38.845547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-08T22:33:38.845628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-08T22:33:38.845762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-10-08T22:33:38.845834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-08T22:33:38.845973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-08T22:33:38.846074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-08T22:33:38.846145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-08T22:33:38.846214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-08T22:33:38.846281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-08T22:33:38.846350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-08T22:33:38.846438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-08T22:33:38.846534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-08T22:33:38.846605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-08T22:33:38.846704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-08T22:33:38.846794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-08T22:33:38.846865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-08T22:33:38.846935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-08T22:33:38.847002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-08T22:33:38.847068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-08T22:33:38.847134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-08T22:33:38.847242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-08T22:33:38.847338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-08T22:33:38.847435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-08T22:33:38.847532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-08T22:33:38.847660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-08T22:33:38.847759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-10-08T22:33:38.847832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-08T22:33:38.847941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-08T22:33:38.848056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-08T22:33:38.848151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-08T22:33:38.848222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-08T22:33:38.848291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-08T22:33:38.848369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-08T22:33:38.848442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-08T22:33:38.848513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-10-08T22:33:38.848577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-08T22:33:38.848662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-08T22:33:38.848760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-08T22:33:38.848830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-08T22:33:38.848897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-10-08T22:33:38.848959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-08T22:33:38.849070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-08T22:33:38.849169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-08T22:33:38.849238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-08T22:33:38.849305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-08T22:33:38.849371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-08T22:33:38.849438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-08T22:33:38.849503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-08T22:33:38.849567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-08T22:33:38.849638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-08T22:33:38.849776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-08T22:33:38.849846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-08T22:33:38.849914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-08T22:33:38.849983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-08T22:33:38.850050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-08T22:33:38.850123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-08T22:33:38.850193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-08T22:33:38.850265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-08T22:33:38.850345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-08T22:33:38.850447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-08T22:33:38.850519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-08T22:33:38.850593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-08T22:33:38.850978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-08T22:33:38.851081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-08T22:33:38.851160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-08T22:33:38.851233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-08T22:33:38.851367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-08T22:33:38.851465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-08T22:33:38.851557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-08T22:33:38.851687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-08T22:33:38.851804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-08T22:33:38.851916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-08T22:33:38.852011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-08T22:33:38.852135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-08T22:33:38.852232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-08T22:33:38.852373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-08T22:33:38.852486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-08T22:33:38.852621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-08T22:33:38.852747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-08T22:33:38.852824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-08T22:33:38.852921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-08T22:33:38.853021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-08T22:33:38.853093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-08T22:33:38.853165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-08T22:33:38.853237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-08T22:33:38.853327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-08T22:33:38.853421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-08T22:33:38.853512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-08T22:33:38.853607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-08T22:33:38.853735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-08T22:33:38.853828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-08T22:33:38.853920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-08T22:33:38.854017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-08T22:33:38.854092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-08T22:33:38.854196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-08T22:33:38.854296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-08T22:33:38.854371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-08T22:33:38.854443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-08T22:33:38.854536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-08T22:33:38.854882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-08T22:33:38.854987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-08T22:33:38.855062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-08T22:33:38.855134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-08T22:33:38.855205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-08T22:33:38.855287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-08T22:33:38.855386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-08T22:33:38.855455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-08T22:33:38.855523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-08T22:33:38.855591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-08T22:33:38.855720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-08T22:33:38.855808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-08T22:33:38.855893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-08T22:33:38.855989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-08T22:33:38.856084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-08T22:33:38.856174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-08T22:33:38.856246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-08T22:33:38.856332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-08T22:33:38.856423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-08T22:33:38.856490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-08T22:33:38.856570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-08T22:33:38.856687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-08T22:33:38.856783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-08T22:33:38.856853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-08T22:33:38.856920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-08T22:33:38.856986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-08T22:33:38.857053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-08T22:33:38.857138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-08T22:33:38.857230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-08T22:33:38.857298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-08T22:33:38.857368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-08T22:33:38.857434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-08T22:33:38.857513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-08T22:33:38.857608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-08T22:33:38.857723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-08T22:33:38.857813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-08T22:33:38.857881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-08T22:33:38.857973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-08T22:33:38.858095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-08T22:33:38.858182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-08T22:33:38.858254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-08T22:33:38.858320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-08T22:33:38.858399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-08T22:33:38.858501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-08T22:33:38.858572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-08T22:33:38.858639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-08T22:33:38.858761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-08T22:33:38.858897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-08T22:33:38.859035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-08T22:33:38.859134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-08T22:33:38.859207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-08T22:33:38.859371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-08T22:33:38.859470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-08T22:33:38.859539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-08T22:33:38.859623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-08T22:33:38.859747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-08T22:33:38.859824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-08T22:33:38.859912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-08T22:33:38.860015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-08T22:33:38.860121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-08T22:33:38.860197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-08T22:33:38.860263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-08T22:33:38.860331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-08T22:33:38.860398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-08T22:33:38.860462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-08T22:33:38.860527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-08T22:33:38.860594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-10-08T22:33:38.860690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-08T22:33:38.860788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-08T22:33:38.860860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-08T22:33:38.860927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-08T22:33:38.860997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-08T22:33:38.861080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-08T22:33:38.861180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-08T22:33:38.861300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-08T22:33:38.861404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-08T22:33:38.861517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-08T22:33:38.861612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-08T22:33:38.861741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-08T22:33:38.861834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-08T22:33:38.861904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-08T22:33:38.861998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-08T22:33:38.862089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-08T22:33:38.862160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-08T22:33:38.862246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-08T22:33:38.862372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-08T22:33:38.862481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-08T22:33:38.862554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-08T22:33:38.862621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-08T22:33:38.863008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-08T22:33:38.863093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-08T22:33:38.863164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-08T22:33:38.863231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-08T22:33:38.863300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-08T22:33:38.863383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-08T22:33:38.863490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-08T22:33:38.863589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-08T22:33:38.863688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-08T22:33:38.863784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-08T22:33:38.863855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-08T22:33:38.863921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-08T22:33:38.863990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-08T22:33:38.864056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-08T22:33:38.864123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-08T22:33:38.864190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-08T22:33:38.864259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-08T22:33:38.864326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-08T22:33:38.864389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-08T22:33:38.864460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-08T22:33:38.864525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-08T22:33:38.864589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-08T22:33:38.864699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-08T22:33:38.864828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-08T22:33:38.864898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-08T22:33:38.864963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-08T22:33:38.865031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-08T22:33:38.865099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-08T22:33:38.865184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-08T22:33:38.865304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-08T22:33:38.865393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-08T22:33:38.865490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-08T22:33:38.865590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-08T22:33:38.865720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-08T22:33:38.865812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-08T22:33:38.865881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-08T22:33:38.865958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-08T22:33:38.866027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-08T22:33:38.866093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-08T22:33:38.866159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-08T22:33:38.866226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-08T22:33:38.866293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-08T22:33:38.866359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-08T22:33:38.866426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-08T22:33:38.866491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-08T22:33:38.866556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-08T22:33:38.866619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-08T22:33:38.866723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-08T22:33:38.866824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-08T22:33:38.866934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-08T22:33:38.867026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-08T22:33:38.867094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-08T22:33:38.867162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-08T22:33:38.867240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-08T22:33:38.867339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-08T22:33:38.867408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-10-08T22:33:38.867473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-08T22:33:38.867537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-08T22:33:38.867683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-08T22:33:38.867777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-08T22:33:38.867843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-08T22:33:38.867909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-08T22:33:38.867973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-08T22:33:38.868036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-08T22:33:38.868127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-08T22:33:38.868231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-08T22:33:38.868302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-08T22:33:38.868386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-08T22:33:38.868475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-08T22:33:38.868541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-08T22:33:38.868622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-08T22:33:38.868740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-08T22:33:38.868815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-08T22:33:38.868880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-08T22:33:38.868952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-08T22:33:38.869055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-08T22:33:38.869145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-08T22:33:38.869218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-08T22:33:38.869287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-08T22:33:38.869351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-08T22:33:38.869417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-08T22:33:38.869486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-10-08T22:33:38.869549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-08T22:33:38.869617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-08T22:33:38.869732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-08T22:33:38.869817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-08T22:33:38.869885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-08T22:33:38.869949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-08T22:33:38.870015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-08T22:33:38.870081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-08T22:33:38.870152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-08T22:33:38.870221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-08T22:33:38.870288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-08T22:33:38.870385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-08T22:33:38.870492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-08T22:33:38.870602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-08T22:33:38.870818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-08T22:33:38.870903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-08T22:33:38.870970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-08T22:33:38.871037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-08T22:33:38.871158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-10-08T22:33:38.871232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-08T22:33:38.871304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-08T22:33:38.871371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-08T22:33:38.871436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-08T22:33:38.871504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-08T22:33:38.871569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-08T22:33:38.871634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-08T22:33:38.871767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-08T22:33:38.871857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-08T22:33:38.871925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-08T22:33:38.872006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-08T22:33:38.872109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-08T22:33:38.872181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-08T22:33:38.872251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-08T22:33:38.872317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-08T22:33:38.872385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-08T22:33:38.872469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-08T22:33:38.872560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-08T22:33:38.872628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-08T22:33:38.872773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-08T22:33:38.872868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-08T22:33:38.872939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-08T22:33:38.873005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-08T22:33:38.873091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-08T22:33:38.873181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-08T22:33:38.873248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-08T22:33:38.873316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-08T22:33:38.873394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-08T22:33:38.873490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-08T22:33:38.873557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-08T22:33:38.873622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-08T22:33:38.873745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-08T22:33:38.873831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-08T22:33:38.873923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-08T22:33:38.874012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-08T22:33:38.874080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-08T22:33:38.874146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-08T22:33:38.874210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-08T22:33:38.874275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-08T22:33:38.874358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-08T22:33:38.874488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-10-08T22:33:38.874589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-08T22:33:38.874693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-08T22:33:38.874786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-08T22:33:38.874855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-08T22:33:38.874938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-08T22:33:38.875028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-08T22:33:38.875093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-08T22:33:38.875156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-08T22:33:38.875253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-08T22:33:38.875337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-08T22:33:38.875404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-08T22:33:38.875467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-08T22:33:38.875531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-08T22:33:38.875594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-08T22:33:38.875686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-08T22:33:38.875778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-08T22:33:38.875844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-08T22:33:38.875909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-08T22:33:38.875973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-08T22:33:38.876070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-08T22:33:38.876164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-08T22:33:38.876232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-08T22:33:38.876316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-08T22:33:38.876404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-08T22:33:38.876472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-08T22:33:38.876537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-08T22:33:38.876602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-08T22:33:38.876718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-08T22:33:38.876827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-08T22:33:38.876953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-08T22:33:38.877029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-08T22:33:38.877101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-08T22:33:38.877166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-10-08T22:33:38.877247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-08T22:33:38.877338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-08T22:33:38.877406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-08T22:33:38.877471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-08T22:33:38.877554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-08T22:33:38.877676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-10-08T22:33:38.877788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-08T22:33:38.877923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-08T22:33:38.878018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-08T22:33:38.878091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-08T22:33:38.878159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-08T22:33:38.878253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-08T22:33:38.878351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-08T22:33:38.878457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-08T22:33:38.878545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-08T22:33:38.878612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-08T22:33:38.878884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-08T22:33:38.878972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-08T22:33:38.879084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-08T22:33:38.879163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-08T22:33:38.879227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-08T22:33:38.879311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-08T22:33:38.879413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-08T22:33:38.879485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-08T22:33:38.879554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-08T22:33:38.879619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-08T22:33:38.879721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-08T22:33:38.879804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-08T22:33:38.879871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-08T22:33:38.879938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-08T22:33:38.880011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-08T22:33:38.880076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-08T22:33:38.880141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-08T22:33:38.880204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-08T22:33:38.880266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-08T22:33:38.880329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-08T22:33:38.880411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-08T22:33:38.880511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-08T22:33:38.880603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-08T22:33:38.880709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-08T22:33:38.880801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-08T22:33:38.880867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-08T22:33:38.880952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-08T22:33:38.881043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-08T22:33:38.881115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-08T22:33:38.881187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-08T22:33:38.881254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-08T22:33:38.881317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-08T22:33:38.881382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-08T22:33:38.881445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-08T22:33:38.881534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-08T22:33:38.881634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-08T22:33:38.881764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-08T22:33:38.881857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-08T22:33:38.881926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-08T22:33:38.881991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-08T22:33:38.882056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-08T22:33:38.882120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-08T22:33:38.882182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-08T22:33:38.882259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-08T22:33:38.882324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-08T22:33:38.882387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-08T22:33:38.882449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-08T22:33:38.882512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-08T22:33:38.882577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-08T22:33:38.882806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-08T22:33:38.882905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-08T22:33:38.883026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-08T22:33:38.883100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-08T22:33:38.883169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-08T22:33:38.883234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-08T22:33:38.883300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-10-08T22:33:38.883366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-08T22:33:38.883430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-08T22:33:38.883493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-08T22:33:38.883555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-08T22:33:38.883620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-08T22:33:38.883739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-08T22:33:38.883831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-08T22:33:38.883899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-08T22:33:38.883963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-10-08T22:33:38.884027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-08T22:33:38.884092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-08T22:33:38.884156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-08T22:33:38.884258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-08T22:33:38.884352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-08T22:33:38.884418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-10-08T22:33:38.884501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-10-08T22:33:38.884591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-08T22:33:38.884687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-08T22:33:38.884810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-08T22:33:38.884893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-08T22:33:38.884962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-08T22:33:38.885029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-08T22:33:38.885094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-08T22:33:38.885172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-08T22:33:38.885267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-08T22:33:38.885334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-08T22:33:38.885398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-08T22:33:38.885468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-08T22:33:38.885530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-08T22:33:38.885590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-08T22:33:38.885690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-08T22:33:38.885781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-08T22:33:38.885849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-08T22:33:38.885922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-08T22:33:38.885993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-08T22:33:38.886058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-08T22:33:38.886122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-08T22:33:38.886208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-08T22:33:38.886303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-08T22:33:38.886375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-08T22:33:38.886440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-08T22:33:38.886505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-08T22:33:38.886571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-08T22:33:38.886634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-08T22:33:38.886758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-08T22:33:38.886833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-08T22:33:38.886899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-08T22:33:38.886965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-08T22:33:38.887030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-08T22:33:38.887097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-10-08T22:33:38.887159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-10-08T22:33:38.887225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-08T22:33:38.887289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-08T22:33:38.887354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-08T22:33:38.887435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-08T22:33:38.887532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-08T22:33:38.887608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-08T22:33:38.887708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-08T22:33:38.887795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-08T22:33:38.887862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-08T22:33:38.887926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-08T22:33:38.888024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-08T22:33:38.888118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-08T22:33:38.888184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-08T22:33:38.888264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-08T22:33:38.888380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-08T22:33:38.888510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-10-08T22:33:38.888591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-08T22:33:38.888687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-08T22:33:38.888780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-08T22:33:38.888850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-08T22:33:38.888915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-08T22:33:38.888984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-08T22:33:38.889099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-08T22:33:38.889173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-08T22:33:38.889241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-08T22:33:38.889309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-08T22:33:38.889395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-10-08T22:33:38.889489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-08T22:33:38.889556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-08T22:33:38.889620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-08T22:33:38.889743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-08T22:33:38.889839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-08T22:33:38.889912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-08T22:33:38.889987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-08T22:33:38.890053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-08T22:33:38.890117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-08T22:33:38.890183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-08T22:33:38.890246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-08T22:33:38.890313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-08T22:33:38.890376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-08T22:33:38.890440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-08T22:33:38.890522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-08T22:33:38.890611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-08T22:33:38.890859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-08T22:33:38.890947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-08T22:33:38.891012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-08T22:33:38.891076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-08T22:33:38.891140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-08T22:33:38.891204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-08T22:33:38.891285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-08T22:33:38.891376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-08T22:33:38.891442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-08T22:33:38.891508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-08T22:33:38.891573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-08T22:33:38.891635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-08T22:33:38.891757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-08T22:33:38.891827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-08T22:33:38.891891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-08T22:33:38.891975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-08T22:33:38.892065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-08T22:33:38.892141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-08T22:33:38.892235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-08T22:33:38.892318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-08T22:33:38.892408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-08T22:33:38.892478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-08T22:33:38.892543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-08T22:33:38.892606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-08T22:33:38.892708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-08T22:33:38.892802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-08T22:33:38.892870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-08T22:33:38.892935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-08T22:33:38.892998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-08T22:33:38.893061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-08T22:33:38.893144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-08T22:33:38.893242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-08T22:33:38.893309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-08T22:33:38.893373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-08T22:33:38.893505] [INFO ] [LOCAL ] Deleted 1664 derivative data files. [2025-10-08T22:33:38.893540] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-08T22:33:38.895455] [INFO ] [LOCAL ] Found 1771 symbols with primary data. [2025-10-08T22:33:38.895893] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 1771 symbols [2025-10-08T22:33:38.896872] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:38.897211] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:38.898637] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:38.998310] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-08T22:33:38.998604] [INFO ] [MAIN ] AA: Loaded 53620 primary data records. [2025-10-08T22:33:38.999452] [DEBUG] [LOCAL ] A: Loaded 50744 existing records from primary storage. [2025-10-08T22:33:39.000244] [INFO ] [MAIN ] A: Loaded 50744 primary data records. [2025-10-08T22:33:39.130326] [DEBUG] [LOCAL ] AAP: Loaded 51882 existing records from primary storage. [2025-10-08T22:33:39.185824] [INFO ] [MAIN ] AAP: Loaded 51882 primary data records. [2025-10-08T22:33:40.083164] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:40.084374] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53620 primary records. [2025-10-08T22:33:40.084824] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-08T22:33:40.126922] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:40.128414] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-08T22:33:40.130023] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-08T22:33:40.132712] [INFO ] [MAIN ] Derivative Progress: 1/1771 symbols completed. AA took 1.2s. Estimated remaining: 36m 30s. Rate: 48.5 symbols/min [2025-10-08T22:33:40.129419] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51882 primary records. [2025-10-08T22:33:40.146866] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-08T22:33:40.146759] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:40.148231] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:40.150200] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50744 primary records. [2025-10-08T22:33:40.150331] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-08T22:33:40.180695] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-08T22:33:40.180941] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-08T22:33:40.182912] [INFO ] [MAIN ] Derivative Progress: 2/1771 symbols completed. A took 1.3s. Estimated remaining: 18m 59s. Rate: 93.2 symbols/min [2025-10-08T22:33:40.183816] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:40.186971] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-08T22:33:40.187136] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-08T22:33:40.190251] [INFO ] [MAIN ] Derivative Progress: 3/1771 symbols completed. AAP took 1.3s. Estimated remaining: 12m 43s. Rate: 139.0 symbols/min [2025-10-08T22:33:40.190493] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:40.219257] [DEBUG] [LOCAL ] AAT: Loaded 30285 existing records from primary storage. [2025-10-08T22:33:40.219704] [INFO ] [MAIN ] AAT: Loaded 30285 primary data records. [2025-10-08T22:33:40.439318] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-10-08T22:33:40.468332] [INFO ] [MAIN ] ABBV: Loaded 53686 primary data records. [2025-10-08T22:33:40.692476] [DEBUG] [LOCAL ] ABEV: Loaded 53281 existing records from primary storage. [2025-10-08T22:33:40.704197] [INFO ] [MAIN ] ABEV: Loaded 53281 primary data records. [2025-10-08T22:33:41.285325] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:33:41.287199] [INFO ] [MAIN ] AAT: Generated 1793 derivative records from 30285 primary records. [2025-10-08T22:33:41.287403] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-08T22:33:41.309885] [DEBUG] [LOCAL ] AAT: Derivative data saved (1793 records). [2025-10-08T22:33:41.311838] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-08T22:33:41.314495] [INFO ] [MAIN ] Derivative Progress: 4/1771 symbols completed. AAT took 1.2s. Estimated remaining: 17m 49s. Rate: 99.2 symbols/min [2025-10-08T22:33:41.315008] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:41.330481] [DEBUG] [MAIN ] ABBV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:41.332979] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53686 primary records. [2025-10-08T22:33:41.333092] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-08T22:33:41.359546] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:41.363257] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53281 primary records. [2025-10-08T22:33:41.363403] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-08T22:33:41.387276] [DEBUG] [LOCAL ] ABG: Loaded 18494 existing records from primary storage. [2025-10-08T22:33:41.386927] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-10-08T22:33:41.387924] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-08T22:33:41.387676] [INFO ] [MAIN ] ABG: Loaded 18494 primary data records. [2025-10-08T22:33:41.390878] [INFO ] [MAIN ] Derivative Progress: 5/1771 symbols completed. ABBV took 1.2s. Estimated remaining: 14m 41s. Rate: 120.2 symbols/min [2025-10-08T22:33:41.398744] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:41.495904] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-08T22:33:41.496289] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-08T22:33:41.503702] [INFO ] [MAIN ] Derivative Progress: 6/1771 symbols completed. ABEV took 1.3s. Estimated remaining: 12m 47s. Rate: 138.0 symbols/min [2025-10-08T22:33:41.509077] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:41.742389] [DEBUG] [LOCAL ] ABM: Loaded 31947 existing records from primary storage. [2025-10-08T22:33:41.743867] [INFO ] [MAIN ] ABM: Loaded 31947 primary data records. [2025-10-08T22:33:42.080888] [DEBUG] [LOCAL ] ABR: Loaded 51958 existing records from primary storage. [2025-10-08T22:33:42.093581] [INFO ] [MAIN ] ABR: Loaded 51958 primary data records. [2025-10-08T22:33:42.093901] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:42.094766] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18494 primary records. [2025-10-08T22:33:42.106303] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-08T22:33:42.297018] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-08T22:33:42.341844] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-08T22:33:42.415220] [INFO ] [MAIN ] Derivative Progress: 7/1771 symbols completed. ABG took 1.1s. Estimated remaining: 14m 47s. Rate: 119.3 symbols/min [2025-10-08T22:33:42.415887] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:42.435898] [DEBUG] [MAIN ] ABM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:42.436799] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 31947 primary records. [2025-10-08T22:33:42.437274] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-08T22:33:42.455903] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-10-08T22:33:42.456232] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-08T22:33:42.458420] [INFO ] [MAIN ] Derivative Progress: 8/1771 symbols completed. ABM took 1.1s. Estimated remaining: 13m 5s. Rate: 134.7 symbols/min [2025-10-08T22:33:42.460299] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:42.489233] [DEBUG] [MAIN ] ABR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:42.491933] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51958 primary records. [2025-10-08T22:33:42.492139] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-08T22:33:42.513875] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-08T22:33:42.514222] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-08T22:33:42.517995] [INFO ] [MAIN ] Derivative Progress: 9/1771 symbols completed. ABR took 1.0s. Estimated remaining: 11m 49s. Rate: 149.1 symbols/min [2025-10-08T22:33:42.518381] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:42.543153] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-08T22:33:42.543554] [INFO ] [MAIN ] ABT: Loaded 53623 primary data records. [2025-10-08T22:33:42.639847] [DEBUG] [LOCAL ] ACCO: Loaded 37076 existing records from primary storage. [2025-10-08T22:33:42.664148] [INFO ] [MAIN ] ACCO: Loaded 37076 primary data records. [2025-10-08T22:33:43.193428] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-08T22:33:43.193918] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-08T22:33:43.572057] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:43.574200] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53623 primary records. [2025-10-08T22:33:43.574744] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-08T22:33:43.593776] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-10-08T22:33:43.607214] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-08T22:33:43.607625] [DEBUG] [MAIN ] ACCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:43.609701] [INFO ] [MAIN ] Derivative Progress: 10/1771 symbols completed. ABT took 1.2s. Estimated remaining: 13m 50s. Rate: 127.3 symbols/min [2025-10-08T22:33:43.609987] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:43.611035] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 37076 primary records. [2025-10-08T22:33:43.611149] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-08T22:33:43.630152] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-10-08T22:33:43.631899] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-08T22:33:43.633980] [INFO ] [MAIN ] Derivative Progress: 11/1771 symbols completed. ACCO took 1.2s. Estimated remaining: 12m 38s. Rate: 139.3 symbols/min [2025-10-08T22:33:43.634258] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:43.648176] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:43.649365] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-08T22:33:43.649548] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-08T22:33:43.666555] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-08T22:33:43.666922] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-08T22:33:43.669295] [INFO ] [MAIN ] Derivative Progress: 12/1771 symbols completed. ACHR took 1.2s. Estimated remaining: 11m 40s. Rate: 150.8 symbols/min [2025-10-08T22:33:43.669637] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:43.696620] [DEBUG] [LOCAL ] ACR: Loaded 5619 existing records from primary storage. [2025-10-08T22:33:43.696846] [INFO ] [MAIN ] ACR: Loaded 5619 primary data records. [2025-10-08T22:33:43.780003] [DEBUG] [LOCAL ] ACP: Loaded 31022 existing records from primary storage. [2025-10-08T22:33:43.817579] [INFO ] [MAIN ] ACP: Loaded 31022 primary data records. [2025-10-08T22:33:43.847612] [DEBUG] [LOCAL ] ACN: Loaded 53428 existing records from primary storage. [2025-10-08T22:33:43.863710] [INFO ] [MAIN ] ACN: Loaded 53428 primary data records. [2025-10-08T22:33:44.766340] [DEBUG] [MAIN ] ACP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:44.780416] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31022 primary records. [2025-10-08T22:33:44.782192] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:44.782299] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-08T22:33:44.784308] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5619 primary records. [2025-10-08T22:33:44.785405] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-08T22:33:44.813631] [DEBUG] [MAIN ] ACN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:44.825460] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53428 primary records. [2025-10-08T22:33:44.830153] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-08T22:33:44.836679] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-08T22:33:44.844501] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-08T22:33:44.835841] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-08T22:33:44.850423] [INFO ] [MAIN ] Derivative Progress: 13/1771 symbols completed. ACP took 1.2s. Estimated remaining: 13m 25s. Rate: 131.0 symbols/min [2025-10-08T22:33:44.850960] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-08T22:33:44.853674] [INFO ] [MAIN ] Derivative Progress: 14/1771 symbols completed. ACR took 1.2s. Estimated remaining: 12m 28s. Rate: 141.0 symbols/min [2025-10-08T22:33:44.858109] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-08T22:33:44.858189] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-08T22:33:44.860461] [INFO ] [MAIN ] Derivative Progress: 15/1771 symbols completed. ACN took 1.3s. Estimated remaining: 11m 38s. Rate: 150.9 symbols/min [2025-10-08T22:33:44.860982] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:44.860903] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:44.861063] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:44.920141] [DEBUG] [LOCAL ] ACRE: Loaded 33676 existing records from primary storage. [2025-10-08T22:33:44.930051] [INFO ] [MAIN ] ACRE: Loaded 33676 primary data records. [2025-10-08T22:33:44.930716] [DEBUG] [LOCAL ] ADCT: Loaded 35096 existing records from primary storage. [2025-10-08T22:33:44.931106] [INFO ] [MAIN ] ADCT: Loaded 35096 primary data records. [2025-10-08T22:33:45.118913] [DEBUG] [LOCAL ] ADC: Loaded 46168 existing records from primary storage. [2025-10-08T22:33:45.138390] [INFO ] [MAIN ] ADC: Loaded 46168 primary data records. [2025-10-08T22:33:45.992691] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:45.994402] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33676 primary records. [2025-10-08T22:33:46.007315] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-08T22:33:46.008132] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:46.011310] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 35096 primary records. [2025-10-08T22:33:46.011567] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-08T22:33:46.052896] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-08T22:33:46.051328] [DEBUG] [MAIN ] ADC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:46.053229] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-08T22:33:46.056866] [INFO ] [MAIN ] Derivative Progress: 16/1771 symbols completed. ADCT took 1.2s. Estimated remaining: 13m 6s. Rate: 134.1 symbols/min [2025-10-08T22:33:46.054237] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46168 primary records. [2025-10-08T22:33:46.058446] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-08T22:33:46.058304] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:46.058386] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-08T22:33:46.060167] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-08T22:33:46.069164] [INFO ] [MAIN ] Derivative Progress: 17/1771 symbols completed. ACRE took 1.2s. Estimated remaining: 12m 20s. Rate: 142.2 symbols/min [2025-10-08T22:33:46.069422] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:46.077864] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-08T22:33:46.078029] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-08T22:33:46.080361] [INFO ] [MAIN ] Derivative Progress: 18/1771 symbols completed. ADC took 1.2s. Estimated remaining: 11m 40s. Rate: 150.3 symbols/min [2025-10-08T22:33:46.080826] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:46.152245] [DEBUG] [LOCAL ] ADNT: Loaded 47191 existing records from primary storage. [2025-10-08T22:33:46.167037] [INFO ] [MAIN ] ADNT: Loaded 47191 primary data records. [2025-10-08T22:33:46.179390] [DEBUG] [LOCAL ] ADM: Loaded 53388 existing records from primary storage. [2025-10-08T22:33:46.194860] [INFO ] [MAIN ] ADM: Loaded 53388 primary data records. [2025-10-08T22:33:46.315376] [DEBUG] [LOCAL ] ADT: Loaded 53446 existing records from primary storage. [2025-10-08T22:33:46.343696] [INFO ] [MAIN ] ADT: Loaded 53446 primary data records. [2025-10-08T22:33:47.094205] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:47.108139] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53388 primary records. [2025-10-08T22:33:47.107184] [DEBUG] [MAIN ] ADNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:47.108355] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-08T22:33:47.109282] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47191 primary records. [2025-10-08T22:33:47.110051] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-10-08T22:33:47.156404] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-10-08T22:33:47.157719] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:47.158938] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53446 primary records. [2025-10-08T22:33:47.157408] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-10-08T22:33:47.159572] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-08T22:33:47.162244] [INFO ] [MAIN ] Derivative Progress: 19/1771 symbols completed. ADNT took 1.1s. Estimated remaining: 12m 42s. Rate: 137.9 symbols/min [2025-10-08T22:33:47.162361] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-08T22:33:47.163255] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-08T22:33:47.165085] [INFO ] [MAIN ] Derivative Progress: 20/1771 symbols completed. ADM took 1.1s. Estimated remaining: 12m 4s. Rate: 145.1 symbols/min [2025-10-08T22:33:47.162536] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:47.172290] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:47.181356] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-08T22:33:47.181567] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-08T22:33:47.185025] [INFO ] [MAIN ] Derivative Progress: 21/1771 symbols completed. ADT took 1.1s. Estimated remaining: 11m 31s. Rate: 152.0 symbols/min [2025-10-08T22:33:47.185474] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:47.195328] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-08T22:33:47.195541] [INFO ] [MAIN ] AEFC: Loaded 8446 primary data records. [2025-10-08T22:33:47.318555] [DEBUG] [LOCAL ] ADX: Loaded 27572 existing records from primary storage. [2025-10-08T22:33:47.319042] [INFO ] [MAIN ] ADX: Loaded 27572 primary data records. [2025-10-08T22:33:47.680104] [DEBUG] [LOCAL ] AEM: Loaded 53466 existing records from primary storage. [2025-10-08T22:33:47.743195] [INFO ] [MAIN ] AEM: Loaded 53466 primary data records. [2025-10-08T22:33:48.242029] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:48.248569] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8446 primary records. [2025-10-08T22:33:48.249059] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:48.249192] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-08T22:33:48.250350] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27572 primary records. [2025-10-08T22:33:48.250963] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-08T22:33:48.282466] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-08T22:33:48.285077] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-08T22:33:48.287239] [INFO ] [MAIN ] Derivative Progress: 22/1771 symbols completed. AEFC took 1.1s. Estimated remaining: 12m 27s. Rate: 140.5 symbols/min [2025-10-08T22:33:48.287699] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:48.298040] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-08T22:33:48.298167] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-08T22:33:48.305240] [INFO ] [MAIN ] Derivative Progress: 23/1771 symbols completed. ADX took 1.1s. Estimated remaining: 11m 55s. Rate: 146.7 symbols/min [2025-10-08T22:33:48.305792] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:48.306729] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:48.307040] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53466 primary records. [2025-10-08T22:33:48.307364] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-08T22:33:48.324773] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-08T22:33:48.324961] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-08T22:33:48.327302] [INFO ] [MAIN ] Derivative Progress: 24/1771 symbols completed. AEM took 1.1s. Estimated remaining: 11m 27s. Rate: 152.7 symbols/min [2025-10-08T22:33:48.327767] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:48.382637] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-08T22:33:48.382999] [INFO ] [MAIN ] AEO: Loaded 53563 primary data records. [2025-10-08T22:33:48.454779] [DEBUG] [LOCAL ] AER: Loaded 48212 existing records from primary storage. [2025-10-08T22:33:48.485076] [INFO ] [MAIN ] AER: Loaded 48212 primary data records. [2025-10-08T22:33:48.729700] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-08T22:33:48.863595] [INFO ] [MAIN ] AES: Loaded 53671 primary data records. [2025-10-08T22:33:49.403904] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:49.407051] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53563 primary records. [2025-10-08T22:33:49.407210] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-08T22:33:49.436338] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:49.440620] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48212 primary records. [2025-10-08T22:33:49.440839] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-08T22:33:49.442597] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-08T22:33:49.443328] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-08T22:33:49.445557] [INFO ] [MAIN ] Derivative Progress: 25/1771 symbols completed. AEO took 1.2s. Estimated remaining: 12m 17s. Rate: 142.2 symbols/min [2025-10-08T22:33:49.453295] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:49.462550] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-08T22:33:49.462830] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-08T22:33:49.465453] [INFO ] [MAIN ] Derivative Progress: 26/1771 symbols completed. AER took 1.2s. Estimated remaining: 11m 49s. Rate: 147.6 symbols/min [2025-10-08T22:33:49.465611] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:49.484337] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:49.485113] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53671 primary records. [2025-10-08T22:33:49.485283] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-08T22:33:49.508167] [DEBUG] [LOCAL ] AFB: Loaded 11448 existing records from primary storage. [2025-10-08T22:33:49.509027] [INFO ] [MAIN ] AFB: Loaded 11448 primary data records. [2025-10-08T22:33:49.540844] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-08T22:33:49.606887] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-08T22:33:49.614635] [INFO ] [MAIN ] Derivative Progress: 27/1771 symbols completed. AES took 1.3s. Estimated remaining: 11m 32s. Rate: 151.1 symbols/min [2025-10-08T22:33:49.617743] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:49.841325] [DEBUG] [LOCAL ] AESI: Loaded 49557 existing records from primary storage. [2025-10-08T22:33:49.860398] [INFO ] [MAIN ] AESI: Loaded 49557 primary data records. [2025-10-08T22:33:49.976335] [DEBUG] [LOCAL ] AFG: Loaded 32197 existing records from primary storage. [2025-10-08T22:33:50.005379] [INFO ] [MAIN ] AFG: Loaded 32197 primary data records. [2025-10-08T22:33:50.550502] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:50.551584] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11448 primary records. [2025-10-08T22:33:50.551801] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-08T22:33:50.569602] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-08T22:33:50.570735] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-08T22:33:50.573752] [INFO ] [MAIN ] Derivative Progress: 28/1771 symbols completed. AFB took 1.1s. Estimated remaining: 12m 7s. Rate: 143.9 symbols/min [2025-10-08T22:33:50.587753] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:50.588574] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49557 primary records. [2025-10-08T22:33:50.588894] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-08T22:33:50.621148] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-08T22:33:50.620785] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:50.621368] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-08T22:33:50.623530] [INFO ] [MAIN ] Derivative Progress: 29/1771 symbols completed. AESI took 1.2s. Estimated remaining: 11m 44s. Rate: 148.4 symbols/min [2025-10-08T22:33:50.624379] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32197 primary records. [2025-10-08T22:33:50.624638] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-08T22:33:50.641755] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-08T22:33:50.641845] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-08T22:33:50.644099] [INFO ] [MAIN ] Derivative Progress: 30/1771 symbols completed. AFG took 1.0s. Estimated remaining: 11m 22s. Rate: 153.2 symbols/min [2025-10-08T22:33:50.644594] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:50.644546] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:50.644774] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:50.650395] [DEBUG] [LOCAL ] AFGD: Loaded 1807 existing records from primary storage. [2025-10-08T22:33:50.651391] [INFO ] [MAIN ] AFGD: Loaded 1807 primary data records. [2025-10-08T22:33:50.690133] [DEBUG] [LOCAL ] AFGB: Loaded 2309 existing records from primary storage. [2025-10-08T22:33:50.706755] [DEBUG] [LOCAL ] AFGC: Loaded 2549 existing records from primary storage. [2025-10-08T22:33:50.720560] [INFO ] [MAIN ] AFGB: Loaded 2309 primary data records. [2025-10-08T22:33:50.730879] [INFO ] [MAIN ] AFGC: Loaded 2549 primary data records. [2025-10-08T22:33:51.687621] [DEBUG] [MAIN ] AFGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:51.688706] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1807 primary records. [2025-10-08T22:33:51.688811] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-08T22:33:51.710101] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-10-08T22:33:51.723135] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:33:51.722774] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-08T22:33:51.726172] [INFO ] [MAIN ] Derivative Progress: 31/1771 symbols completed. AFGD took 1.1s. Estimated remaining: 12m 0s. Rate: 145.0 symbols/min [2025-10-08T22:33:51.726702] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:51.740162] [INFO ] [MAIN ] AFGB: Generated 1793 derivative records from 2309 primary records. [2025-10-08T22:33:51.740754] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-08T22:33:51.741044] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:51.743094] [INFO ] [MAIN ] AFGC: Generated 1794 derivative records from 2549 primary records. [2025-10-08T22:33:51.749766] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-08T22:33:51.760353] [DEBUG] [LOCAL ] AFGE: Loaded 2427 existing records from primary storage. [2025-10-08T22:33:51.760782] [INFO ] [MAIN ] AFGE: Loaded 2427 primary data records. [2025-10-08T22:33:51.838420] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1793 records). [2025-10-08T22:33:51.861099] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-08T22:33:51.869825] [INFO ] [MAIN ] Derivative Progress: 32/1771 symbols completed. AFGB took 1.2s. Estimated remaining: 11m 45s. Rate: 148.0 symbols/min [2025-10-08T22:33:51.877697] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:51.912795] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-10-08T22:33:51.935584] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-08T22:33:52.122458] [INFO ] [MAIN ] Derivative Progress: 33/1771 symbols completed. AFGC took 1.5s. Estimated remaining: 11m 37s. Rate: 149.7 symbols/min [2025-10-08T22:33:52.131011] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:52.187877] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:33:52.204710] [DEBUG] [LOCAL ] AFL: Loaded 53161 existing records from primary storage. [2025-10-08T22:33:52.205921] [INFO ] [MAIN ] AFGE: Generated 1793 derivative records from 2427 primary records. [2025-10-08T22:33:52.206189] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-08T22:33:52.206785] [INFO ] [MAIN ] AFL: Loaded 53161 primary data records. [2025-10-08T22:33:52.325670] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1793 records). [2025-10-08T22:33:52.337227] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-08T22:33:52.337385] [INFO ] [MAIN ] AG: Loaded 53642 primary data records. [2025-10-08T22:33:52.333336] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-08T22:33:52.339618] [INFO ] [MAIN ] Derivative Progress: 34/1771 symbols completed. AFGE took 0.6s. Estimated remaining: 11m 27s. Rate: 151.7 symbols/min [2025-10-08T22:33:52.351299] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:52.868766] [DEBUG] [LOCAL ] AGCO: Loaded 42343 existing records from primary storage. [2025-10-08T22:33:52.869327] [INFO ] [MAIN ] AGCO: Loaded 42343 primary data records. [2025-10-08T22:33:52.966383] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:52.989984] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53161 primary records. [2025-10-08T22:33:53.008169] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-08T22:33:53.219774] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:53.222987] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53642 primary records. [2025-10-08T22:33:53.224902] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-08T22:33:53.226385] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-08T22:33:53.227124] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-08T22:33:53.241132] [INFO ] [MAIN ] Derivative Progress: 35/1771 symbols completed. AFL took 1.4s. Estimated remaining: 11m 52s. Rate: 146.4 symbols/min [2025-10-08T22:33:53.242296] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:53.247024] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-08T22:33:53.247250] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-08T22:33:53.249285] [INFO ] [MAIN ] Derivative Progress: 36/1771 symbols completed. AG took 1.1s. Estimated remaining: 11m 32s. Rate: 150.5 symbols/min [2025-10-08T22:33:53.251068] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:53.275964] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:53.276911] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42343 primary records. [2025-10-08T22:33:53.277079] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-08T22:33:53.300970] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-08T22:33:53.301093] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-08T22:33:53.299786] [DEBUG] [LOCAL ] AGD: Loaded 18490 existing records from primary storage. [2025-10-08T22:33:53.301215] [INFO ] [MAIN ] AGD: Loaded 18490 primary data records. [2025-10-08T22:33:53.303500] [INFO ] [MAIN ] Derivative Progress: 37/1771 symbols completed. AGCO took 1.0s. Estimated remaining: 11m 15s. Rate: 154.1 symbols/min [2025-10-08T22:33:53.326052] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:53.682667] [DEBUG] [LOCAL ] AGI: Loaded 53420 existing records from primary storage. [2025-10-08T22:33:53.693099] [INFO ] [MAIN ] AGI: Loaded 53420 primary data records. [2025-10-08T22:33:53.853318] [DEBUG] [LOCAL ] AGL: Loaded 52495 existing records from primary storage. [2025-10-08T22:33:53.906919] [INFO ] [MAIN ] AGL: Loaded 52495 primary data records. [2025-10-08T22:33:54.385809] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:54.400750] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 18490 primary records. [2025-10-08T22:33:54.400911] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-08T22:33:54.420218] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-08T22:33:54.420827] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-08T22:33:54.422985] [INFO ] [MAIN ] Derivative Progress: 38/1771 symbols completed. AGD took 1.2s. Estimated remaining: 11m 48s. Rate: 146.8 symbols/min [2025-10-08T22:33:54.423482] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:54.442737] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:54.443704] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53420 primary records. [2025-10-08T22:33:54.446435] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-08T22:33:54.468108] [DEBUG] [LOCAL ] AGM: Loaded 10458 existing records from primary storage. [2025-10-08T22:33:54.468741] [INFO ] [MAIN ] AGM: Loaded 10458 primary data records. [2025-10-08T22:33:54.468542] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-08T22:33:54.480134] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-08T22:33:54.501881] [INFO ] [MAIN ] Derivative Progress: 39/1771 symbols completed. AGI took 1.3s. Estimated remaining: 11m 33s. Rate: 149.9 symbols/min [2025-10-08T22:33:54.527824] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:54.590369] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:54.596887] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52495 primary records. [2025-10-08T22:33:54.607300] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-08T22:33:54.813675] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-08T22:33:54.814560] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-08T22:33:54.817618] [INFO ] [MAIN ] Derivative Progress: 40/1771 symbols completed. AGL took 1.5s. Estimated remaining: 11m 29s. Rate: 150.7 symbols/min [2025-10-08T22:33:54.818463] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:54.829467] [DEBUG] [LOCAL ] AGO: Loaded 27924 existing records from primary storage. [2025-10-08T22:33:54.829700] [INFO ] [MAIN ] AGO: Loaded 27924 primary data records. [2025-10-08T22:33:55.156343] [DEBUG] [LOCAL ] AGX: Loaded 33176 existing records from primary storage. [2025-10-08T22:33:55.156728] [INFO ] [MAIN ] AGX: Loaded 33176 primary data records. [2025-10-08T22:33:55.256139] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:55.278748] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10458 primary records. [2025-10-08T22:33:55.279123] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-08T22:33:55.372571] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-08T22:33:55.376501] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-08T22:33:55.379514] [INFO ] [MAIN ] Derivative Progress: 41/1771 symbols completed. AGM took 1.0s. Estimated remaining: 11m 36s. Rate: 149.2 symbols/min [2025-10-08T22:33:55.379760] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:55.514446] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:55.515495] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27924 primary records. [2025-10-08T22:33:55.515908] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-08T22:33:55.536045] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-08T22:33:55.536452] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-08T22:33:55.538553] [INFO ] [MAIN ] Derivative Progress: 42/1771 symbols completed. AGO took 1.0s. Estimated remaining: 11m 25s. Rate: 151.4 symbols/min [2025-10-08T22:33:55.539083] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:55.565966] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:55.566874] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33176 primary records. [2025-10-08T22:33:55.567056] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-08T22:33:55.596003] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-08T22:33:55.594296] [DEBUG] [LOCAL ] AHH: Loaded 40772 existing records from primary storage. [2025-10-08T22:33:55.596290] [INFO ] [MAIN ] AHH: Loaded 40772 primary data records. [2025-10-08T22:33:55.596525] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-08T22:33:55.613303] [INFO ] [MAIN ] Derivative Progress: 43/1771 symbols completed. AGX took 0.8s. Estimated remaining: 11m 12s. Rate: 154.3 symbols/min [2025-10-08T22:33:55.963025] [DEBUG] [LOCAL ] AHR: Loaded 49109 existing records from primary storage. [2025-10-08T22:33:55.971535] [INFO ] [MAIN ] AHR: Loaded 49109 primary data records. [2025-10-08T22:33:56.304213] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:56.305284] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40772 primary records. [2025-10-08T22:33:56.305407] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-08T22:33:56.323866] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-08T22:33:56.324102] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-08T22:33:56.327863] [INFO ] [MAIN ] Derivative Progress: 44/1771 symbols completed. AHH took 0.9s. Estimated remaining: 11m 24s. Rate: 151.4 symbols/min [2025-10-08T22:33:56.341223] [DEBUG] [MAIN ] AHR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:33:56.341922] [INFO ] [MAIN ] AHR: Generated 1793 derivative records from 49109 primary records. [2025-10-08T22:33:56.341987] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-08T22:33:56.358366] [DEBUG] [LOCAL ] AHR: Derivative data saved (1793 records). [2025-10-08T22:33:56.358435] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-08T22:33:56.360386] [INFO ] [MAIN ] Derivative Progress: 45/1771 symbols completed. AHR took 0.8s. Estimated remaining: 11m 10s. Rate: 154.6 symbols/min [2025-10-08T22:33:56.360919] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:56.360818] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:56.361085] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:56.371985] [DEBUG] [LOCAL ] AHT: Loaded 6227 existing records from primary storage. [2025-10-08T22:33:56.372188] [INFO ] [MAIN ] AHT: Loaded 6227 primary data records. [2025-10-08T22:33:56.758599] [DEBUG] [LOCAL ] AI: Loaded 53755 existing records from primary storage. [2025-10-08T22:33:56.760037] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-08T22:33:56.760147] [INFO ] [MAIN ] AIG: Loaded 53474 primary data records. [2025-10-08T22:33:56.760301] [INFO ] [MAIN ] AI: Loaded 53755 primary data records. [2025-10-08T22:33:57.393442] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:57.396754] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6227 primary records. [2025-10-08T22:33:57.398514] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-08T22:33:57.419611] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-08T22:33:57.419973] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-08T22:33:57.422789] [INFO ] [MAIN ] Derivative Progress: 46/1771 symbols completed. AHT took 1.1s. Estimated remaining: 11m 35s. Rate: 149.0 symbols/min [2025-10-08T22:33:57.422990] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:57.455787] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:57.456800] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53474 primary records. [2025-10-08T22:33:57.456997] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-08T22:33:57.480078] [DEBUG] [LOCAL ] AIN: Loaded 24522 existing records from primary storage. [2025-10-08T22:33:57.487998] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:57.488310] [INFO ] [MAIN ] AIN: Loaded 24522 primary data records. [2025-10-08T22:33:57.494504] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53755 primary records. [2025-10-08T22:33:57.500707] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-08T22:33:57.582755] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-08T22:33:57.595252] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-08T22:33:57.598255] [INFO ] [MAIN ] Derivative Progress: 47/1771 symbols completed. AI took 1.2s. Estimated remaining: 11m 26s. Rate: 150.8 symbols/min [2025-10-08T22:33:57.603668] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:57.656356] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-08T22:33:57.674126] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-08T22:33:57.685054] [INFO ] [MAIN ] Derivative Progress: 48/1771 symbols completed. AIG took 1.3s. Estimated remaining: 11m 14s. Rate: 153.3 symbols/min [2025-10-08T22:33:57.715174] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:57.839689] [DEBUG] [LOCAL ] AIO: Loaded 13421 existing records from primary storage. [2025-10-08T22:33:57.840186] [INFO ] [MAIN ] AIO: Loaded 13421 primary data records. [2025-10-08T22:33:58.098635] [DEBUG] [LOCAL ] AIR: Loaded 28818 existing records from primary storage. [2025-10-08T22:33:58.226357] [INFO ] [MAIN ] AIR: Loaded 28818 primary data records. [2025-10-08T22:33:58.542140] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:58.543184] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24522 primary records. [2025-10-08T22:33:58.543304] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-08T22:33:58.565132] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-08T22:33:58.566743] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-08T22:33:58.568899] [INFO ] [MAIN ] Derivative Progress: 49/1771 symbols completed. AIN took 1.1s. Estimated remaining: 11m 31s. Rate: 149.4 symbols/min [2025-10-08T22:33:58.569427] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:58.584060] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:58.584849] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13421 primary records. [2025-10-08T22:33:58.584946] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-08T22:33:58.601932] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-08T22:33:58.602236] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-08T22:33:58.604334] [INFO ] [MAIN ] Derivative Progress: 50/1771 symbols completed. AIO took 1.0s. Estimated remaining: 11m 18s. Rate: 152.2 symbols/min [2025-10-08T22:33:58.604522] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:58.642419] [DEBUG] [LOCAL ] AIT: Loaded 27109 existing records from primary storage. [2025-10-08T22:33:58.641759] [DEBUG] [MAIN ] AIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:58.643524] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 28818 primary records. [2025-10-08T22:33:58.643629] [INFO ] [MAIN ] AIT: Loaded 27109 primary data records. [2025-10-08T22:33:58.643914] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-10-08T22:33:58.782538] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-10-08T22:33:58.786489] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-10-08T22:33:58.788892] [INFO ] [MAIN ] Derivative Progress: 51/1771 symbols completed. AIR took 1.1s. Estimated remaining: 11m 11s. Rate: 153.8 symbols/min [2025-10-08T22:33:58.795114] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:58.903937] [DEBUG] [LOCAL ] AIV: Loaded 40918 existing records from primary storage. [2025-10-08T22:33:58.986723] [INFO ] [MAIN ] AIV: Loaded 40918 primary data records. [2025-10-08T22:33:59.152674] [DEBUG] [LOCAL ] AIZ: Loaded 29684 existing records from primary storage. [2025-10-08T22:33:59.153732] [INFO ] [MAIN ] AIZ: Loaded 29684 primary data records. [2025-10-08T22:33:59.687124] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:59.688352] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 27109 primary records. [2025-10-08T22:33:59.688457] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-08T22:33:59.713590] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-08T22:33:59.713943] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-08T22:33:59.715903] [INFO ] [MAIN ] Derivative Progress: 52/1771 symbols completed. AIT took 1.1s. Estimated remaining: 11m 28s. Rate: 149.9 symbols/min [2025-10-08T22:33:59.716088] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:59.730406] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:59.731426] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40918 primary records. [2025-10-08T22:33:59.732556] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-08T22:33:59.743614] [DEBUG] [LOCAL ] AIZN: Loaded 4106 existing records from primary storage. [2025-10-08T22:33:59.743865] [INFO ] [MAIN ] AIZN: Loaded 4106 primary data records. [2025-10-08T22:33:59.855613] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-08T22:33:59.867860] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-08T22:33:59.868709] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:33:59.871055] [INFO ] [MAIN ] Derivative Progress: 53/1771 symbols completed. AIV took 1.3s. Estimated remaining: 11m 20s. Rate: 151.6 symbols/min [2025-10-08T22:33:59.876525] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:33:59.882731] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29684 primary records. [2025-10-08T22:33:59.883215] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-08T22:34:00.135392] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-08T22:34:00.135525] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-08T22:34:00.137777] [INFO ] [MAIN ] Derivative Progress: 54/1771 symbols completed. AIZ took 1.3s. Estimated remaining: 11m 15s. Rate: 152.5 symbols/min [2025-10-08T22:34:00.138187] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:00.175796] [DEBUG] [LOCAL ] AJG: Loaded 46653 existing records from primary storage. [2025-10-08T22:34:00.176934] [INFO ] [MAIN ] AJG: Loaded 46653 primary data records. [2025-10-08T22:34:00.227120] [DEBUG] [MAIN ] AIZN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:00.247075] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 4106 primary records. [2025-10-08T22:34:00.305526] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-08T22:34:00.524333] [DEBUG] [LOCAL ] AKR: Loaded 45857 existing records from primary storage. [2025-10-08T22:34:00.529041] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-08T22:34:00.529182] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-08T22:34:00.531691] [INFO ] [MAIN ] AKR: Loaded 45857 primary data records. [2025-10-08T22:34:00.531605] [INFO ] [MAIN ] Derivative Progress: 55/1771 symbols completed. AIZN took 0.8s. Estimated remaining: 11m 15s. Rate: 152.5 symbols/min [2025-10-08T22:34:00.532087] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:00.875821] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:00.889192] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46653 primary records. [2025-10-08T22:34:00.890409] [DEBUG] [LOCAL ] AL: Loaded 44474 existing records from primary storage. [2025-10-08T22:34:00.890525] [INFO ] [MAIN ] AL: Loaded 44474 primary data records. [2025-10-08T22:34:00.889597] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-08T22:34:01.095822] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-08T22:34:01.213664] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-08T22:34:01.218270] [INFO ] [MAIN ] Derivative Progress: 56/1771 symbols completed. AJG took 1.3s. Estimated remaining: 11m 24s. Rate: 150.5 symbols/min [2025-10-08T22:34:01.219632] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:01.235110] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:01.236474] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45857 primary records. [2025-10-08T22:34:01.236779] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-08T22:34:01.258202] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-08T22:34:01.258754] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-08T22:34:01.262529] [INFO ] [MAIN ] Derivative Progress: 57/1771 symbols completed. AKR took 1.1s. Estimated remaining: 11m 13s. Rate: 152.9 symbols/min [2025-10-08T22:34:01.263519] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:01.280091] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:01.280830] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44474 primary records. [2025-10-08T22:34:01.281009] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-08T22:34:01.315755] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-08T22:34:01.315922] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-08T22:34:01.318678] [INFO ] [MAIN ] Derivative Progress: 58/1771 symbols completed. AL took 0.8s. Estimated remaining: 11m 2s. Rate: 155.2 symbols/min [2025-10-08T22:34:01.335825] [DEBUG] [LOCAL ] ALB: Loaded 53288 existing records from primary storage. [2025-10-08T22:34:01.336013] [INFO ] [MAIN ] ALB: Loaded 53288 primary data records. [2025-10-08T22:34:01.666791] [DEBUG] [LOCAL ] ALC: Loaded 51032 existing records from primary storage. [2025-10-08T22:34:01.667015] [INFO ] [MAIN ] ALC: Loaded 51032 primary data records. [2025-10-08T22:34:02.036012] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:02.037172] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53288 primary records. [2025-10-08T22:34:02.037390] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-08T22:34:02.055347] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-08T22:34:02.055640] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-08T22:34:02.057926] [INFO ] [MAIN ] Derivative Progress: 59/1771 symbols completed. ALB took 0.8s. Estimated remaining: 11m 12s. Rate: 152.8 symbols/min [2025-10-08T22:34:02.073839] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:02.074512] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 51032 primary records. [2025-10-08T22:34:02.074574] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-08T22:34:02.090331] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-08T22:34:02.090451] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-08T22:34:02.092559] [INFO ] [MAIN ] Derivative Progress: 60/1771 symbols completed. ALC took 0.8s. Estimated remaining: 11m 2s. Rate: 155.2 symbols/min [2025-10-08T22:34:02.093024] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:02.093155] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:02.093284] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:02.107396] [DEBUG] [LOCAL ] ALG: Loaded 9862 existing records from primary storage. [2025-10-08T22:34:02.107921] [INFO ] [MAIN ] ALG: Loaded 9862 primary data records. [2025-10-08T22:34:02.311416] [DEBUG] [LOCAL ] ALE: Loaded 31298 existing records from primary storage. [2025-10-08T22:34:02.323276] [DEBUG] [LOCAL ] ALEX: Loaded 31184 existing records from primary storage. [2025-10-08T22:34:02.323470] [INFO ] [MAIN ] ALE: Loaded 31298 primary data records. [2025-10-08T22:34:02.340514] [INFO ] [MAIN ] ALEX: Loaded 31184 primary data records. [2025-10-08T22:34:03.173546] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:03.174904] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9862 primary records. [2025-10-08T22:34:03.175136] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-08T22:34:03.197146] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-08T22:34:03.197457] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-08T22:34:03.199809] [INFO ] [MAIN ] Derivative Progress: 61/1771 symbols completed. ALG took 1.1s. Estimated remaining: 11m 21s. Rate: 150.6 symbols/min [2025-10-08T22:34:03.200143] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:03.214116] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:03.217797] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 31298 primary records. [2025-10-08T22:34:03.218159] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-08T22:34:03.243785] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:03.248446] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-08T22:34:03.247447] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31184 primary records. [2025-10-08T22:34:03.248795] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-08T22:34:03.248739] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-08T22:34:03.252523] [INFO ] [MAIN ] Derivative Progress: 62/1771 symbols completed. ALE took 1.2s. Estimated remaining: 11m 11s. Rate: 152.7 symbols/min [2025-10-08T22:34:03.253157] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:03.285033] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-08T22:34:03.285399] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-08T22:34:03.287777] [INFO ] [MAIN ] Derivative Progress: 63/1771 symbols completed. ALEX took 1.2s. Estimated remaining: 11m 1s. Rate: 155.0 symbols/min [2025-10-08T22:34:03.288066] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:03.308852] [DEBUG] [LOCAL ] ALIT: Loaded 52779 existing records from primary storage. [2025-10-08T22:34:03.309239] [INFO ] [MAIN ] ALIT: Loaded 52779 primary data records. [2025-10-08T22:34:03.464618] [DEBUG] [LOCAL ] ALK: Loaded 53058 existing records from primary storage. [2025-10-08T22:34:03.503937] [INFO ] [MAIN ] ALK: Loaded 53058 primary data records. [2025-10-08T22:34:03.791348] [DEBUG] [LOCAL ] ALL: Loaded 49900 existing records from primary storage. [2025-10-08T22:34:03.812929] [INFO ] [MAIN ] ALL: Loaded 49900 primary data records. [2025-10-08T22:34:04.395473] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:04.397022] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52779 primary records. [2025-10-08T22:34:04.397804] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-08T22:34:04.419925] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-08T22:34:04.428009] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-08T22:34:04.430687] [INFO ] [MAIN ] Derivative Progress: 64/1771 symbols completed. ALIT took 1.2s. Estimated remaining: 11m 21s. Rate: 150.4 symbols/min [2025-10-08T22:34:04.431156] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:04.437820] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:04.438505] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53058 primary records. [2025-10-08T22:34:04.438719] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-08T22:34:04.458920] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-08T22:34:04.459382] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-08T22:34:04.461700] [INFO ] [MAIN ] Derivative Progress: 65/1771 symbols completed. ALK took 1.2s. Estimated remaining: 11m 11s. Rate: 152.5 symbols/min [2025-10-08T22:34:04.461929] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:04.475283] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:04.476164] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49900 primary records. [2025-10-08T22:34:04.476303] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-08T22:34:04.509149] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-08T22:34:04.509351] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-08T22:34:04.511780] [INFO ] [MAIN ] Derivative Progress: 66/1771 symbols completed. ALL took 1.2s. Estimated remaining: 11m 2s. Rate: 154.6 symbols/min [2025-10-08T22:34:04.512693] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:04.526247] [DEBUG] [LOCAL ] ALLE: Loaded 44372 existing records from primary storage. [2025-10-08T22:34:04.526453] [INFO ] [MAIN ] ALLE: Loaded 44372 primary data records. [2025-10-08T22:34:04.680251] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-08T22:34:04.739553] [INFO ] [MAIN ] ALLY: Loaded 53228 primary data records. [2025-10-08T22:34:04.951901] [DEBUG] [LOCAL ] ALSN: Loaded 43352 existing records from primary storage. [2025-10-08T22:34:04.970680] [INFO ] [MAIN ] ALSN: Loaded 43352 primary data records. [2025-10-08T22:34:05.494731] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:05.495798] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 44372 primary records. [2025-10-08T22:34:05.496977] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-08T22:34:05.529112] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-08T22:34:05.530120] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-08T22:34:05.529956] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:05.532444] [INFO ] [MAIN ] Derivative Progress: 67/1771 symbols completed. ALLE took 1.1s. Estimated remaining: 11m 17s. Rate: 150.9 symbols/min [2025-10-08T22:34:05.532623] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:05.533895] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53228 primary records. [2025-10-08T22:34:05.535000] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-08T22:34:05.562876] [DEBUG] [MAIN ] ALSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:05.564035] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43352 primary records. [2025-10-08T22:34:05.564272] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-08T22:34:05.585910] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-08T22:34:05.586679] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-08T22:34:05.590422] [INFO ] [MAIN ] Derivative Progress: 68/1771 symbols completed. ALLY took 1.1s. Estimated remaining: 11m 9s. Rate: 152.8 symbols/min [2025-10-08T22:34:05.590920] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:05.603154] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-08T22:34:05.602546] [DEBUG] [LOCAL ] ALTG: Loaded 23572 existing records from primary storage. [2025-10-08T22:34:05.603428] [INFO ] [MAIN ] ALTG: Loaded 23572 primary data records. [2025-10-08T22:34:05.603595] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-08T22:34:05.644219] [INFO ] [MAIN ] Derivative Progress: 69/1771 symbols completed. ALSN took 1.1s. Estimated remaining: 10m 60s. Rate: 154.8 symbols/min [2025-10-08T22:34:05.663957] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:05.694488] [DEBUG] [LOCAL ] ALUR: Loaded 10405 existing records from primary storage. [2025-10-08T22:34:05.705427] [INFO ] [MAIN ] ALUR: Loaded 10405 primary data records. [2025-10-08T22:34:06.275128] [DEBUG] [LOCAL ] ALV: Loaded 42086 existing records from primary storage. [2025-10-08T22:34:06.276543] [INFO ] [MAIN ] ALV: Loaded 42086 primary data records. [2025-10-08T22:34:06.477364] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:06.598045] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23572 primary records. [2025-10-08T22:34:06.598859] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-08T22:34:06.631689] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:06.633249] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 10405 primary records. [2025-10-08T22:34:06.633707] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-08T22:34:06.634548] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-08T22:34:06.635344] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-08T22:34:06.638775] [INFO ] [MAIN ] Derivative Progress: 70/1771 symbols completed. ALTG took 1.1s. Estimated remaining: 11m 14s. Rate: 151.4 symbols/min [2025-10-08T22:34:06.639317] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:06.658435] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-08T22:34:06.658601] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-08T22:34:06.660804] [INFO ] [MAIN ] Derivative Progress: 71/1771 symbols completed. ALUR took 1.1s. Estimated remaining: 11m 5s. Rate: 153.4 symbols/min [2025-10-08T22:34:06.661108] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:06.664944] [DEBUG] [LOCAL ] ALX: Loaded 6520 existing records from primary storage. [2025-10-08T22:34:06.665383] [INFO ] [MAIN ] ALX: Loaded 6520 primary data records. [2025-10-08T22:34:06.787902] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:06.800446] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42086 primary records. [2025-10-08T22:34:06.821288] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-08T22:34:07.021411] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-08T22:34:07.021570] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-08T22:34:07.023742] [INFO ] [MAIN ] Derivative Progress: 72/1771 symbols completed. ALV took 1.4s. Estimated remaining: 11m 4s. Rate: 153.6 symbols/min [2025-10-08T22:34:07.025579] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:07.048049] [DEBUG] [LOCAL ] AM: Loaded 51994 existing records from primary storage. [2025-10-08T22:34:07.049798] [INFO ] [MAIN ] AM: Loaded 51994 primary data records. [2025-10-08T22:34:07.381956] [DEBUG] [LOCAL ] AMBC: Loaded 36338 existing records from primary storage. [2025-10-08T22:34:07.382938] [INFO ] [MAIN ] AMBC: Loaded 36338 primary data records. [2025-10-08T22:34:07.383409] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:07.422675] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 6520 primary records. [2025-10-08T22:34:07.451184] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-08T22:34:07.590367] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-08T22:34:07.590541] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-08T22:34:07.712815] [INFO ] [MAIN ] Derivative Progress: 73/1771 symbols completed. ALX took 1.1s. Estimated remaining: 11m 10s. Rate: 152.0 symbols/min [2025-10-08T22:34:07.734709] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:07.735615] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51994 primary records. [2025-10-08T22:34:07.735796] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-08T22:34:07.753516] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-08T22:34:07.753605] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-08T22:34:07.755760] [INFO ] [MAIN ] Derivative Progress: 74/1771 symbols completed. AM took 1.1s. Estimated remaining: 11m 2s. Rate: 153.8 symbols/min [2025-10-08T22:34:07.772151] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:07.772825] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36338 primary records. [2025-10-08T22:34:07.772889] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-08T22:34:07.788086] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-08T22:34:07.788149] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-08T22:34:07.790324] [INFO ] [MAIN ] Derivative Progress: 75/1771 symbols completed. AMBC took 0.8s. Estimated remaining: 10m 53s. Rate: 155.7 symbols/min [2025-10-08T22:34:07.790963] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:07.791159] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:07.791080] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:07.872623] [DEBUG] [LOCAL ] AMBP: Loaded 44668 existing records from primary storage. [2025-10-08T22:34:07.873817] [INFO ] [MAIN ] AMBP: Loaded 44668 primary data records. [2025-10-08T22:34:07.885718] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-08T22:34:07.910801] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-10-08T22:34:08.052404] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-08T22:34:08.078227] [INFO ] [MAIN ] AMC: Loaded 53761 primary data records. [2025-10-08T22:34:08.849168] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:08.849986] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44668 primary records. [2025-10-08T22:34:08.850250] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-08T22:34:08.869585] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-08T22:34:08.870022] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-08T22:34:08.880561] [INFO ] [MAIN ] Derivative Progress: 76/1771 symbols completed. AMBP took 1.1s. Estimated remaining: 11m 9s. Rate: 152.1 symbols/min [2025-10-08T22:34:08.886121] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:08.888059] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:08.889153] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-10-08T22:34:08.889340] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-08T22:34:08.902832] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:08.903866] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53761 primary records. [2025-10-08T22:34:08.904028] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-08T22:34:08.920771] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-08T22:34:08.928129] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-08T22:34:08.935905] [INFO ] [MAIN ] Derivative Progress: 77/1771 symbols completed. AMCR took 1.1s. Estimated remaining: 11m 1s. Rate: 153.8 symbols/min [2025-10-08T22:34:08.937809] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:08.940435] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-08T22:34:08.941060] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-08T22:34:08.943068] [INFO ] [MAIN ] Derivative Progress: 78/1771 symbols completed. AMC took 1.2s. Estimated remaining: 10m 52s. Rate: 155.8 symbols/min [2025-10-08T22:34:08.943328] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:08.972986] [DEBUG] [LOCAL ] AMG: Loaded 20177 existing records from primary storage. [2025-10-08T22:34:08.973246] [INFO ] [MAIN ] AMG: Loaded 20177 primary data records. [2025-10-08T22:34:09.103744] [DEBUG] [LOCAL ] AME: Loaded 48717 existing records from primary storage. [2025-10-08T22:34:09.120210] [INFO ] [MAIN ] AME: Loaded 48717 primary data records. [2025-10-08T22:34:09.384478] [DEBUG] [LOCAL ] AMH: Loaded 51757 existing records from primary storage. [2025-10-08T22:34:09.402498] [INFO ] [MAIN ] AMH: Loaded 51757 primary data records. [2025-10-08T22:34:09.960630] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:09.962142] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20177 primary records. [2025-10-08T22:34:09.962458] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-08T22:34:09.981997] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-08T22:34:09.983242] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-08T22:34:09.985257] [INFO ] [MAIN ] Derivative Progress: 79/1771 symbols completed. AMG took 1.0s. Estimated remaining: 11m 6s. Rate: 152.5 symbols/min [2025-10-08T22:34:09.985695] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:10.000291] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:10.003084] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48717 primary records. [2025-10-08T22:34:10.003299] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-08T22:34:10.031056] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:10.033543] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51757 primary records. [2025-10-08T22:34:10.034762] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-08T22:34:10.035486] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-08T22:34:10.035975] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-08T22:34:10.037920] [INFO ] [MAIN ] Derivative Progress: 80/1771 symbols completed. AME took 1.2s. Estimated remaining: 10m 58s. Rate: 154.1 symbols/min [2025-10-08T22:34:10.045560] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:10.054259] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-08T22:34:10.063821] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-08T22:34:10.066159] [INFO ] [MAIN ] Derivative Progress: 81/1771 symbols completed. AMH took 1.1s. Estimated remaining: 10m 50s. Rate: 155.9 symbols/min [2025-10-08T22:34:10.072402] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:10.091168] [DEBUG] [LOCAL ] AMN: Loaded 41756 existing records from primary storage. [2025-10-08T22:34:10.091323] [INFO ] [MAIN ] AMN: Loaded 41756 primary data records. [2025-10-08T22:34:10.342400] [DEBUG] [LOCAL ] AMP: Loaded 31938 existing records from primary storage. [2025-10-08T22:34:10.484180] [INFO ] [MAIN ] AMP: Loaded 31938 primary data records. [2025-10-08T22:34:10.490802] [DEBUG] [LOCAL ] AMPX: Loaded 52318 existing records from primary storage. [2025-10-08T22:34:10.519057] [INFO ] [MAIN ] AMPX: Loaded 52318 primary data records. [2025-10-08T22:34:11.117458] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:11.119056] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41756 primary records. [2025-10-08T22:34:11.119537] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-08T22:34:11.139382] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-08T22:34:11.140670] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-08T22:34:11.142690] [INFO ] [MAIN ] Derivative Progress: 82/1771 symbols completed. AMN took 1.2s. Estimated remaining: 11m 4s. Rate: 152.6 symbols/min [2025-10-08T22:34:11.143183] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:11.169566] [DEBUG] [MAIN ] AMPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:11.171049] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52318 primary records. [2025-10-08T22:34:11.171170] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-08T22:34:11.211675] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:34:11.213544] [INFO ] [MAIN ] AMP: Generated 1793 derivative records from 31938 primary records. [2025-10-08T22:34:11.213960] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-08T22:34:11.215817] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-08T22:34:11.227146] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-08T22:34:11.229788] [INFO ] [MAIN ] Derivative Progress: 83/1771 symbols completed. AMPX took 1.2s. Estimated remaining: 10m 58s. Rate: 154.0 symbols/min [2025-10-08T22:34:11.234357] [DEBUG] [LOCAL ] AMP: Derivative data saved (1793 records). [2025-10-08T22:34:11.234269] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:11.245904] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-08T22:34:11.248521] [INFO ] [MAIN ] Derivative Progress: 84/1771 symbols completed. AMP took 1.2s. Estimated remaining: 10m 50s. Rate: 155.8 symbols/min [2025-10-08T22:34:11.248806] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:11.249743] [DEBUG] [LOCAL ] AMPY: Loaded 38587 existing records from primary storage. [2025-10-08T22:34:11.250341] [INFO ] [MAIN ] AMPY: Loaded 38587 primary data records. [2025-10-08T22:34:11.574816] [DEBUG] [LOCAL ] AMR: Loaded 29039 existing records from primary storage. [2025-10-08T22:34:11.575750] [INFO ] [MAIN ] AMR: Loaded 29039 primary data records. [2025-10-08T22:34:11.643026] [DEBUG] [LOCAL ] AMRC: Loaded 38091 existing records from primary storage. [2025-10-08T22:34:11.652570] [INFO ] [MAIN ] AMRC: Loaded 38091 primary data records. [2025-10-08T22:34:12.271314] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:12.274270] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 38587 primary records. [2025-10-08T22:34:12.274799] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-08T22:34:12.298444] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-08T22:34:12.300285] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-08T22:34:12.302488] [INFO ] [MAIN ] Derivative Progress: 85/1771 symbols completed. AMPY took 1.2s. Estimated remaining: 11m 3s. Rate: 152.7 symbols/min [2025-10-08T22:34:12.302972] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:12.317406] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:12.319505] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29039 primary records. [2025-10-08T22:34:12.319714] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-08T22:34:12.351858] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-08T22:34:12.352617] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:12.352179] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-08T22:34:12.356825] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38091 primary records. [2025-10-08T22:34:12.359215] [INFO ] [MAIN ] Derivative Progress: 86/1771 symbols completed. AMR took 1.1s. Estimated remaining: 10m 56s. Rate: 154.2 symbols/min [2025-10-08T22:34:12.359474] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:12.359789] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-08T22:34:12.399622] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-08T22:34:12.399919] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-08T22:34:12.402128] [INFO ] [MAIN ] Derivative Progress: 87/1771 symbols completed. AMRC took 1.2s. Estimated remaining: 10m 49s. Rate: 155.8 symbols/min [2025-10-08T22:34:12.402492] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:12.413515] [DEBUG] [LOCAL ] AMTB: Loaded 20507 existing records from primary storage. [2025-10-08T22:34:12.414981] [INFO ] [MAIN ] AMTB: Loaded 20507 primary data records. [2025-10-08T22:34:12.447438] [DEBUG] [LOCAL ] AMTD: Loaded 3706 existing records from primary storage. [2025-10-08T22:34:12.498149] [INFO ] [MAIN ] AMTD: Loaded 3706 primary data records. [2025-10-08T22:34:12.558420] [DEBUG] [LOCAL ] AMT: Loaded 52439 existing records from primary storage. [2025-10-08T22:34:12.636049] [INFO ] [MAIN ] AMT: Loaded 52439 primary data records. [2025-10-08T22:34:13.428706] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:13.429077] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:13.430873] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20507 primary records. [2025-10-08T22:34:13.431744] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3706 primary records. [2025-10-08T22:34:13.431867] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-08T22:34:13.432676] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-08T22:34:13.474299] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-08T22:34:13.475256] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-08T22:34:13.474915] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:13.478332] [INFO ] [MAIN ] Derivative Progress: 88/1771 symbols completed. AMTB took 1.1s. Estimated remaining: 11m 1s. Rate: 152.7 symbols/min [2025-10-08T22:34:13.476347] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52439 primary records. [2025-10-08T22:34:13.479931] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-08T22:34:13.481117] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-08T22:34:13.481481] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-08T22:34:13.483771] [INFO ] [MAIN ] Derivative Progress: 89/1771 symbols completed. AMTD took 1.1s. Estimated remaining: 10m 54s. Rate: 154.4 symbols/min [2025-10-08T22:34:13.499177] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-08T22:34:13.499245] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-08T22:34:13.501336] [INFO ] [MAIN ] Derivative Progress: 90/1771 symbols completed. AMT took 1.2s. Estimated remaining: 10m 46s. Rate: 156.0 symbols/min [2025-10-08T22:34:13.501852] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:13.501785] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:13.502410] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:13.516054] [DEBUG] [LOCAL ] AMWL: Loaded 9214 existing records from primary storage. [2025-10-08T22:34:13.516380] [INFO ] [MAIN ] AMWL: Loaded 9214 primary data records. [2025-10-08T22:34:13.876254] [DEBUG] [LOCAL ] AMTM: Loaded 50653 existing records from primary storage. [2025-10-08T22:34:13.877702] [INFO ] [MAIN ] AMTM: Loaded 50653 primary data records. [2025-10-08T22:34:13.972759] [DEBUG] [LOCAL ] AMX: Loaded 49124 existing records from primary storage. [2025-10-08T22:34:13.983733] [INFO ] [MAIN ] AMX: Loaded 49124 primary data records. [2025-10-08T22:34:14.587522] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:14.589065] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9214 primary records. [2025-10-08T22:34:14.589991] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-08T22:34:14.610965] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-08T22:34:14.611258] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-08T22:34:14.613551] [INFO ] [MAIN ] Derivative Progress: 91/1771 symbols completed. AMWL took 1.1s. Estimated remaining: 10m 59s. Rate: 152.9 symbols/min [2025-10-08T22:34:14.614274] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:14.633025] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:14.634105] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50653 primary records. [2025-10-08T22:34:14.634780] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-08T22:34:14.653659] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-08T22:34:14.653985] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-08T22:34:14.655915] [INFO ] [MAIN ] Derivative Progress: 92/1771 symbols completed. AMTM took 1.2s. Estimated remaining: 10m 53s. Rate: 154.4 symbols/min [2025-10-08T22:34:14.667751] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:14.669572] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:14.670293] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49124 primary records. [2025-10-08T22:34:14.670356] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-08T22:34:14.687664] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-08T22:34:14.687805] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-08T22:34:14.690093] [INFO ] [MAIN ] Derivative Progress: 93/1771 symbols completed. AMX took 1.2s. Estimated remaining: 10m 46s. Rate: 155.9 symbols/min [2025-10-08T22:34:14.690316] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:14.745070] [DEBUG] [LOCAL ] ANRO: Loaded 19212 existing records from primary storage. [2025-10-08T22:34:14.771711] [INFO ] [MAIN ] ANRO: Loaded 19212 primary data records. [2025-10-08T22:34:14.793990] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-08T22:34:14.812514] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-08T22:34:14.985904] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-08T22:34:15.024567] [INFO ] [MAIN ] ANF: Loaded 52101 primary data records. [2025-10-08T22:34:15.730043] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:15.738507] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19212 primary records. [2025-10-08T22:34:15.744269] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-08T22:34:15.745243] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:15.746523] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-08T22:34:15.756760] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-08T22:34:15.788488] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-08T22:34:15.788673] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-08T22:34:15.790932] [INFO ] [MAIN ] Derivative Progress: 94/1771 symbols completed. ANRO took 1.1s. Estimated remaining: 10m 58s. Rate: 152.9 symbols/min [2025-10-08T22:34:15.791317] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:15.794091] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:15.795415] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52101 primary records. [2025-10-08T22:34:15.797248] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-08T22:34:15.808743] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-08T22:34:15.812262] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-08T22:34:15.814193] [INFO ] [MAIN ] Derivative Progress: 95/1771 symbols completed. ANET took 1.2s. Estimated remaining: 10m 51s. Rate: 154.4 symbols/min [2025-10-08T22:34:15.814697] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:15.818514] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-08T22:34:15.818836] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-08T22:34:15.821126] [INFO ] [MAIN ] Derivative Progress: 96/1771 symbols completed. ANF took 1.2s. Estimated remaining: 10m 44s. Rate: 156.0 symbols/min [2025-10-08T22:34:15.821391] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:15.836786] [DEBUG] [LOCAL ] AOMR: Loaded 16437 existing records from primary storage. [2025-10-08T22:34:15.840029] [INFO ] [MAIN ] AOMR: Loaded 16437 primary data records. [2025-10-08T22:34:15.839855] [DEBUG] [LOCAL ] AP: Loaded 7216 existing records from primary storage. [2025-10-08T22:34:15.840324] [INFO ] [MAIN ] AP: Loaded 7216 primary data records. [2025-10-08T22:34:16.336754] [DEBUG] [LOCAL ] AORT: Loaded 29234 existing records from primary storage. [2025-10-08T22:34:16.369414] [INFO ] [MAIN ] AORT: Loaded 29234 primary data records. [2025-10-08T22:34:16.832389] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:16.831999] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:16.833314] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16437 primary records. [2025-10-08T22:34:16.833977] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7216 primary records. [2025-10-08T22:34:16.834123] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-08T22:34:16.834187] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-08T22:34:16.865179] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-08T22:34:16.866397] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-08T22:34:16.866535] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-08T22:34:16.868810] [INFO ] [MAIN ] Derivative Progress: 97/1771 symbols completed. AOMR took 1.1s. Estimated remaining: 10m 55s. Rate: 153.3 symbols/min [2025-10-08T22:34:16.866619] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-08T22:34:16.871221] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:16.871333] [INFO ] [MAIN ] Derivative Progress: 98/1771 symbols completed. AP took 1.0s. Estimated remaining: 10m 48s. Rate: 154.8 symbols/min [2025-10-08T22:34:16.872132] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:16.889668] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:16.890466] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29234 primary records. [2025-10-08T22:34:16.890613] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-08T22:34:16.919776] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-08T22:34:16.920058] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-08T22:34:16.922260] [INFO ] [MAIN ] Derivative Progress: 99/1771 symbols completed. AORT took 1.1s. Estimated remaining: 10m 42s. Rate: 156.2 symbols/min [2025-10-08T22:34:16.922534] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:16.946103] [DEBUG] [LOCAL ] APAM: Loaded 36012 existing records from primary storage. [2025-10-08T22:34:16.946417] [INFO ] [MAIN ] APAM: Loaded 36012 primary data records. [2025-10-08T22:34:17.077775] [DEBUG] [LOCAL ] APD: Loaded 45285 existing records from primary storage. [2025-10-08T22:34:17.120395] [INFO ] [MAIN ] APD: Loaded 45285 primary data records. [2025-10-08T22:34:17.385704] [DEBUG] [LOCAL ] APG: Loaded 50463 existing records from primary storage. [2025-10-08T22:34:17.401738] [INFO ] [MAIN ] APG: Loaded 50463 primary data records. [2025-10-08T22:34:17.895808] [DEBUG] [MAIN ] APAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:17.896990] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36012 primary records. [2025-10-08T22:34:17.900671] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-08T22:34:17.926039] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:17.929365] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45285 primary records. [2025-10-08T22:34:17.931832] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-10-08T22:34:17.929782] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-08T22:34:17.931979] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-08T22:34:17.935228] [INFO ] [MAIN ] Derivative Progress: 100/1771 symbols completed. APAM took 1.1s. Estimated remaining: 10m 52s. Rate: 153.7 symbols/min [2025-10-08T22:34:17.935665] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:17.951512] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-08T22:34:17.952006] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-08T22:34:17.954604] [INFO ] [MAIN ] Derivative Progress: 101/1771 symbols completed. APD took 1.1s. Estimated remaining: 10m 46s. Rate: 155.1 symbols/min [2025-10-08T22:34:17.955039] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:17.972278] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:17.973039] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50463 primary records. [2025-10-08T22:34:17.973980] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-08T22:34:17.993028] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-08T22:34:17.993347] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-08T22:34:17.995785] [INFO ] [MAIN ] Derivative Progress: 102/1771 symbols completed. APG took 1.1s. Estimated remaining: 10m 40s. Rate: 156.5 symbols/min [2025-10-08T22:34:17.996126] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:18.061809] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-08T22:34:18.062093] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-08T22:34:18.099586] [DEBUG] [LOCAL ] APLE: Loaded 51926 existing records from primary storage. [2025-10-08T22:34:18.167150] [INFO ] [MAIN ] APLE: Loaded 51926 primary data records. [2025-10-08T22:34:18.342425] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-08T22:34:18.483334] [INFO ] [MAIN ] APO: Loaded 53383 primary data records. [2025-10-08T22:34:19.104840] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:19.107456] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-08T22:34:19.110098] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-08T22:34:19.141523] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-08T22:34:19.142391] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:19.142493] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-08T22:34:19.145095] [INFO ] [MAIN ] Derivative Progress: 103/1771 symbols completed. APH took 1.2s. Estimated remaining: 10m 52s. Rate: 153.5 symbols/min [2025-10-08T22:34:19.146057] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51926 primary records. [2025-10-08T22:34:19.146474] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-08T22:34:19.165764] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-08T22:34:19.167665] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-08T22:34:19.170950] [INFO ] [MAIN ] Derivative Progress: 104/1771 symbols completed. APLE took 1.2s. Estimated remaining: 10m 46s. Rate: 154.9 symbols/min [2025-10-08T22:34:19.185221] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:19.186135] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53383 primary records. [2025-10-08T22:34:19.186292] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-08T22:34:19.203076] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-08T22:34:19.203148] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-08T22:34:19.205793] [INFO ] [MAIN ] Derivative Progress: 105/1771 symbols completed. APO took 1.2s. Estimated remaining: 10m 40s. Rate: 156.3 symbols/min [2025-10-08T22:34:19.206398] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:19.206259] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:19.206524] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:19.218780] [DEBUG] [LOCAL ] APOS: Loaded 7519 existing records from primary storage. [2025-10-08T22:34:19.219104] [INFO ] [MAIN ] APOS: Loaded 7519 primary data records. [2025-10-08T22:34:19.660436] [DEBUG] [LOCAL ] AQN: Loaded 51841 existing records from primary storage. [2025-10-08T22:34:19.661692] [DEBUG] [LOCAL ] APTV: Loaded 52044 existing records from primary storage. [2025-10-08T22:34:19.662729] [INFO ] [MAIN ] AQN: Loaded 51841 primary data records. [2025-10-08T22:34:19.662946] [INFO ] [MAIN ] APTV: Loaded 52044 primary data records. [2025-10-08T22:34:20.333957] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:20.336324] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7519 primary records. [2025-10-08T22:34:20.336732] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-08T22:34:20.358082] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-10-08T22:34:20.358492] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-08T22:34:20.360986] [INFO ] [MAIN ] Derivative Progress: 106/1771 symbols completed. APOS took 1.2s. Estimated remaining: 10m 51s. Rate: 153.4 symbols/min [2025-10-08T22:34:20.361697] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:20.386364] [DEBUG] [MAIN ] AQN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:20.381233] [DEBUG] [LOCAL ] AQNB: Loaded 4147 existing records from primary storage. [2025-10-08T22:34:20.387304] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51841 primary records. [2025-10-08T22:34:20.387477] [INFO ] [MAIN ] AQNB: Loaded 4147 primary data records. [2025-10-08T22:34:20.387427] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-08T22:34:20.497539] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:20.501795] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-10-08T22:34:20.513085] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52044 primary records. [2025-10-08T22:34:20.530004] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-08T22:34:20.523710] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-08T22:34:20.540682] [INFO ] [MAIN ] Derivative Progress: 107/1771 symbols completed. AQN took 1.3s. Estimated remaining: 10m 48s. Rate: 154.2 symbols/min [2025-10-08T22:34:20.545844] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:20.584540] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-08T22:34:20.614840] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-08T22:34:20.644596] [INFO ] [MAIN ] Derivative Progress: 108/1771 symbols completed. APTV took 1.4s. Estimated remaining: 10m 43s. Rate: 155.2 symbols/min [2025-10-08T22:34:20.776062] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:20.807815] [DEBUG] [LOCAL ] ARDC: Loaded 15046 existing records from primary storage. [2025-10-08T22:34:20.808335] [INFO ] [MAIN ] ARDC: Loaded 15046 primary data records. [2025-10-08T22:34:20.932622] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-08T22:34:20.945287] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:20.945469] [INFO ] [MAIN ] AR: Loaded 53590 primary data records. [2025-10-08T22:34:20.946362] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4147 primary records. [2025-10-08T22:34:21.007216] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-08T22:34:21.317570] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-08T22:34:21.356469] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-08T22:34:21.474286] [INFO ] [MAIN ] Derivative Progress: 109/1771 symbols completed. AQNB took 1.1s. Estimated remaining: 10m 49s. Rate: 153.6 symbols/min [2025-10-08T22:34:21.476945] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:21.514797] [DEBUG] [MAIN ] ARDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:21.515867] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 15046 primary records. [2025-10-08T22:34:21.516083] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-08T22:34:21.561365] [DEBUG] [LOCAL ] ARDT: Loaded 27723 existing records from primary storage. [2025-10-08T22:34:21.569202] [INFO ] [MAIN ] ARDT: Loaded 27723 primary data records. [2025-10-08T22:34:21.575100] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-08T22:34:21.596181] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-08T22:34:21.607295] [DEBUG] [MAIN ] AR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:21.614714] [INFO ] [MAIN ] Derivative Progress: 110/1771 symbols completed. ARDC took 0.8s. Estimated remaining: 10m 45s. Rate: 154.5 symbols/min [2025-10-08T22:34:21.643157] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53590 primary records. [2025-10-08T22:34:21.660990] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-08T22:34:21.660761] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:21.727855] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-08T22:34:21.782980] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-08T22:34:21.820099] [INFO ] [MAIN ] Derivative Progress: 111/1771 symbols completed. AR took 1.3s. Estimated remaining: 10m 42s. Rate: 155.2 symbols/min [2025-10-08T22:34:21.908142] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:21.952803] [DEBUG] [LOCAL ] ARE: Loaded 50757 existing records from primary storage. [2025-10-08T22:34:21.962745] [INFO ] [MAIN ] ARE: Loaded 50757 primary data records. [2025-10-08T22:34:22.007763] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:22.033100] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27723 primary records. [2025-10-08T22:34:22.059530] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-08T22:34:22.134853] [DEBUG] [LOCAL ] ARES: Loaded 49647 existing records from primary storage. [2025-10-08T22:34:22.157314] [INFO ] [MAIN ] ARES: Loaded 49647 primary data records. [2025-10-08T22:34:22.424283] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-08T22:34:22.441758] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-08T22:34:22.455640] [INFO ] [MAIN ] Derivative Progress: 112/1771 symbols completed. ARDT took 1.0s. Estimated remaining: 10m 45s. Rate: 154.3 symbols/min [2025-10-08T22:34:22.456775] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:22.681545] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:22.683015] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50757 primary records. [2025-10-08T22:34:22.683592] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-08T22:34:22.713530] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-08T22:34:22.726273] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-08T22:34:22.729735] [INFO ] [MAIN ] Derivative Progress: 113/1771 symbols completed. ARE took 1.1s. Estimated remaining: 10m 43s. Rate: 154.7 symbols/min [2025-10-08T22:34:22.730532] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:22.731884] [DEBUG] [LOCAL ] ARI: Loaded 43669 existing records from primary storage. [2025-10-08T22:34:22.732098] [INFO ] [MAIN ] ARI: Loaded 43669 primary data records. [2025-10-08T22:34:22.849579] [DEBUG] [MAIN ] ARES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:22.850406] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49647 primary records. [2025-10-08T22:34:22.850753] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-08T22:34:22.988213] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-10-08T22:34:22.988425] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-08T22:34:23.104875] [INFO ] [MAIN ] Derivative Progress: 114/1771 symbols completed. ARES took 1.2s. Estimated remaining: 10m 43s. Rate: 154.7 symbols/min [2025-10-08T22:34:23.105372] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:23.123600] [DEBUG] [LOCAL ] ARIS: Loaded 42358 existing records from primary storage. [2025-10-08T22:34:23.124225] [INFO ] [MAIN ] ARIS: Loaded 42358 primary data records. [2025-10-08T22:34:23.466351] [DEBUG] [LOCAL ] ARMK: Loaded 50319 existing records from primary storage. [2025-10-08T22:34:23.474831] [INFO ] [MAIN ] ARMK: Loaded 50319 primary data records. [2025-10-08T22:34:23.492252] [DEBUG] [MAIN ] ARI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:23.545636] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43669 primary records. [2025-10-08T22:34:23.574977] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-10-08T22:34:23.796844] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-10-08T22:34:23.797411] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-10-08T22:34:23.801372] [INFO ] [MAIN ] Derivative Progress: 115/1771 symbols completed. ARI took 1.3s. Estimated remaining: 10m 47s. Rate: 153.7 symbols/min [2025-10-08T22:34:23.802544] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:23.819171] [DEBUG] [MAIN ] ARIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:23.820344] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42358 primary records. [2025-10-08T22:34:23.820525] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-10-08T22:34:23.840022] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-10-08T22:34:23.840453] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-10-08T22:34:23.842598] [INFO ] [MAIN ] Derivative Progress: 116/1771 symbols completed. ARIS took 1.1s. Estimated remaining: 10m 41s. Rate: 154.8 symbols/min [2025-10-08T22:34:23.843179] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:23.872037] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:23.872834] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50319 primary records. [2025-10-08T22:34:23.873018] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-08T22:34:23.913763] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-08T22:34:23.914627] [DEBUG] [LOCAL ] AROC: Loaded 48975 existing records from primary storage. [2025-10-08T22:34:23.913908] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-08T22:34:23.917113] [INFO ] [MAIN ] AROC: Loaded 48975 primary data records. [2025-10-08T22:34:23.917017] [INFO ] [MAIN ] Derivative Progress: 117/1771 symbols completed. ARMK took 0.8s. Estimated remaining: 10m 36s. Rate: 155.9 symbols/min [2025-10-08T22:34:23.917410] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:24.077455] [DEBUG] [LOCAL ] ARW: Loaded 32823 existing records from primary storage. [2025-10-08T22:34:24.110600] [INFO ] [MAIN ] ARW: Loaded 32823 primary data records. [2025-10-08T22:34:24.434983] [DEBUG] [LOCAL ] AS: Loaded 53122 existing records from primary storage. [2025-10-08T22:34:24.472547] [INFO ] [MAIN ] AS: Loaded 53122 primary data records. [2025-10-08T22:34:24.946375] [DEBUG] [MAIN ] AROC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:24.947785] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 48975 primary records. [2025-10-08T22:34:24.948063] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-10-08T22:34:24.968771] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-10-08T22:34:24.969851] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-10-08T22:34:24.971855] [INFO ] [MAIN ] Derivative Progress: 118/1771 symbols completed. AROC took 1.2s. Estimated remaining: 10m 45s. Rate: 153.7 symbols/min [2025-10-08T22:34:24.986409] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:24.987246] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 32823 primary records. [2025-10-08T22:34:24.987335] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-08T22:34:25.005345] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-08T22:34:25.005442] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-08T22:34:25.008241] [INFO ] [MAIN ] Derivative Progress: 119/1771 symbols completed. ARW took 1.2s. Estimated remaining: 10m 40s. Rate: 154.8 symbols/min [2025-10-08T22:34:25.020612] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:34:25.021202] [INFO ] [MAIN ] AS: Generated 1793 derivative records from 53122 primary records. [2025-10-08T22:34:25.021262] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-08T22:34:25.036315] [DEBUG] [LOCAL ] AS: Derivative data saved (1793 records). [2025-10-08T22:34:25.036374] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-08T22:34:25.038626] [INFO ] [MAIN ] Derivative Progress: 120/1771 symbols completed. AS took 1.1s. Estimated remaining: 10m 35s. Rate: 156.0 symbols/min [2025-10-08T22:34:25.039015] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:25.039108] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:25.039395] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:25.046516] [DEBUG] [LOCAL ] ASBA: Loaded 3456 existing records from primary storage. [2025-10-08T22:34:25.046824] [INFO ] [MAIN ] ASBA: Loaded 3456 primary data records. [2025-10-08T22:34:25.384473] [DEBUG] [LOCAL ] ASB: Loaded 49541 existing records from primary storage. [2025-10-08T22:34:25.384776] [INFO ] [MAIN ] ASB: Loaded 49541 primary data records. [2025-10-08T22:34:25.491746] [DEBUG] [LOCAL ] ASAN: Loaded 52721 existing records from primary storage. [2025-10-08T22:34:25.503134] [INFO ] [MAIN ] ASAN: Loaded 52721 primary data records. [2025-10-08T22:34:25.848910] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:26.004922] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3456 primary records. [2025-10-08T22:34:26.005692] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-08T22:34:26.024959] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-08T22:34:26.025443] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-08T22:34:26.027779] [INFO ] [MAIN ] Derivative Progress: 121/1771 symbols completed. ASBA took 1.0s. Estimated remaining: 10m 43s. Rate: 154.0 symbols/min [2025-10-08T22:34:26.027934] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:26.046725] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:26.047760] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49541 primary records. [2025-10-08T22:34:26.047904] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-08T22:34:26.067836] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-08T22:34:26.088293] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-08T22:34:26.088864] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:26.091492] [INFO ] [MAIN ] Derivative Progress: 122/1771 symbols completed. ASB took 1.1s. Estimated remaining: 10m 38s. Rate: 155.1 symbols/min [2025-10-08T22:34:26.089605] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52721 primary records. [2025-10-08T22:34:26.091731] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-08T22:34:26.092293] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:26.108840] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-08T22:34:26.119735] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-08T22:34:26.123383] [DEBUG] [LOCAL ] ASC: Loaded 37471 existing records from primary storage. [2025-10-08T22:34:26.122249] [INFO ] [MAIN ] Derivative Progress: 123/1771 symbols completed. ASAN took 1.1s. Estimated remaining: 10m 33s. Rate: 156.3 symbols/min [2025-10-08T22:34:26.123699] [INFO ] [MAIN ] ASC: Loaded 37471 primary data records. [2025-10-08T22:34:26.123817] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:26.243237] [DEBUG] [LOCAL ] ASG: Loaded 19553 existing records from primary storage. [2025-10-08T22:34:26.243885] [INFO ] [MAIN ] ASG: Loaded 19553 primary data records. [2025-10-08T22:34:26.418403] [DEBUG] [LOCAL ] ASGI: Loaded 22731 existing records from primary storage. [2025-10-08T22:34:26.587696] [INFO ] [MAIN ] ASGI: Loaded 22731 primary data records. [2025-10-08T22:34:27.109780] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:27.111195] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37471 primary records. [2025-10-08T22:34:27.111466] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-08T22:34:27.129198] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-08T22:34:27.130339] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-08T22:34:27.132291] [INFO ] [MAIN ] Derivative Progress: 124/1771 symbols completed. ASC took 1.1s. Estimated remaining: 10m 41s. Rate: 154.2 symbols/min [2025-10-08T22:34:27.132451] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:27.148132] [DEBUG] [MAIN ] ASG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:27.148902] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19553 primary records. [2025-10-08T22:34:27.149082] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-08T22:34:27.170824] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-08T22:34:27.184151] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-08T22:34:27.196299] [INFO ] [MAIN ] Derivative Progress: 125/1771 symbols completed. ASG took 1.1s. Estimated remaining: 10m 36s. Rate: 155.3 symbols/min [2025-10-08T22:34:27.193969] [DEBUG] [MAIN ] ASGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:27.197827] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22731 primary records. [2025-10-08T22:34:27.196606] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:27.198028] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-08T22:34:27.225875] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-08T22:34:27.227180] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-08T22:34:27.229723] [INFO ] [MAIN ] Derivative Progress: 126/1771 symbols completed. ASGI took 1.1s. Estimated remaining: 10m 31s. Rate: 156.4 symbols/min [2025-10-08T22:34:27.230121] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:27.231209] [DEBUG] [LOCAL ] ASGN: Loaded 36282 existing records from primary storage. [2025-10-08T22:34:27.231907] [INFO ] [MAIN ] ASGN: Loaded 36282 primary data records. [2025-10-08T22:34:27.459959] [DEBUG] [LOCAL ] ASH: Loaded 37603 existing records from primary storage. [2025-10-08T22:34:27.466468] [DEBUG] [LOCAL ] ASIX: Loaded 22842 existing records from primary storage. [2025-10-08T22:34:27.466803] [INFO ] [MAIN ] ASIX: Loaded 22842 primary data records. [2025-10-08T22:34:27.466913] [INFO ] [MAIN ] ASH: Loaded 37603 primary data records. [2025-10-08T22:34:28.277384] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:28.278730] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36282 primary records. [2025-10-08T22:34:28.278912] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-08T22:34:28.297780] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-08T22:34:28.297985] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-08T22:34:28.300281] [INFO ] [MAIN ] Derivative Progress: 127/1771 symbols completed. ASGN took 1.2s. Estimated remaining: 10m 40s. Rate: 154.2 symbols/min [2025-10-08T22:34:28.301026] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:28.318357] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:28.319334] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22842 primary records. [2025-10-08T22:34:28.319446] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-08T22:34:28.338122] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-08T22:34:28.338243] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-08T22:34:28.340596] [INFO ] [MAIN ] Derivative Progress: 128/1771 symbols completed. ASIX took 1.1s. Estimated remaining: 10m 35s. Rate: 155.3 symbols/min [2025-10-08T22:34:28.340906] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:28.356242] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:28.357363] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37603 primary records. [2025-10-08T22:34:28.357526] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-08T22:34:28.389338] [DEBUG] [LOCAL ] ASR: Loaded 9328 existing records from primary storage. [2025-10-08T22:34:28.390090] [INFO ] [MAIN ] ASR: Loaded 9328 primary data records. [2025-10-08T22:34:28.520463] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-08T22:34:28.515149] [DEBUG] [LOCAL ] ASPN: Loaded 49736 existing records from primary storage. [2025-10-08T22:34:28.530945] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-08T22:34:28.531080] [INFO ] [MAIN ] ASPN: Loaded 49736 primary data records. [2025-10-08T22:34:28.534084] [INFO ] [MAIN ] Derivative Progress: 129/1771 symbols completed. ASH took 1.3s. Estimated remaining: 10m 32s. Rate: 155.9 symbols/min [2025-10-08T22:34:28.557592] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:29.066198] [DEBUG] [MAIN ] ASR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:29.067214] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9328 primary records. [2025-10-08T22:34:29.067331] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-08T22:34:29.083469] [DEBUG] [LOCAL ] ASX: Loaded 52863 existing records from primary storage. [2025-10-08T22:34:29.091677] [INFO ] [MAIN ] ASX: Loaded 52863 primary data records. [2025-10-08T22:34:29.212591] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:29.176209] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-08T22:34:29.215916] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-08T22:34:29.217911] [INFO ] [MAIN ] Derivative Progress: 130/1771 symbols completed. ASR took 0.9s. Estimated remaining: 10m 35s. Rate: 155.0 symbols/min [2025-10-08T22:34:29.218732] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49736 primary records. [2025-10-08T22:34:29.219188] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-08T22:34:29.224488] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:29.430597] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-08T22:34:29.430956] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-08T22:34:29.433780] [INFO ] [MAIN ] Derivative Progress: 131/1771 symbols completed. ASPN took 1.1s. Estimated remaining: 10m 33s. Rate: 155.5 symbols/min [2025-10-08T22:34:29.435064] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:29.485572] [DEBUG] [LOCAL ] ATEN: Loaded 38823 existing records from primary storage. [2025-10-08T22:34:29.496676] [INFO ] [MAIN ] ATEN: Loaded 38823 primary data records. [2025-10-08T22:34:29.496581] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:29.497470] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52863 primary records. [2025-10-08T22:34:29.518713] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-08T22:34:29.626284] [DEBUG] [LOCAL ] ATGE: Loaded 31120 existing records from primary storage. [2025-10-08T22:34:29.631786] [INFO ] [MAIN ] ATGE: Loaded 31120 primary data records. [2025-10-08T22:34:29.809914] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-08T22:34:29.810102] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-08T22:34:29.945188] [INFO ] [MAIN ] Derivative Progress: 132/1771 symbols completed. ASX took 1.4s. Estimated remaining: 10m 34s. Rate: 155.1 symbols/min [2025-10-08T22:34:29.964859] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:30.186262] [DEBUG] [LOCAL ] ATHM: Loaded 31820 existing records from primary storage. [2025-10-08T22:34:30.188414] [INFO ] [MAIN ] ATHM: Loaded 31820 primary data records. [2025-10-08T22:34:30.309736] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:30.316984] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 38823 primary records. [2025-10-08T22:34:30.317628] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-08T22:34:30.393480] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-08T22:34:30.419699] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-08T22:34:30.551059] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:30.551177] [INFO ] [MAIN ] Derivative Progress: 133/1771 symbols completed. ATEN took 1.3s. Estimated remaining: 10m 36s. Rate: 154.5 symbols/min [2025-10-08T22:34:30.581911] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 31120 primary records. [2025-10-08T22:34:30.582249] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-08T22:34:30.602846] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-08T22:34:30.603246] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-08T22:34:30.605353] [INFO ] [MAIN ] Derivative Progress: 134/1771 symbols completed. ATGE took 1.2s. Estimated remaining: 10m 32s. Rate: 155.5 symbols/min [2025-10-08T22:34:30.623452] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:30.624130] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31820 primary records. [2025-10-08T22:34:30.624194] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-08T22:34:30.639811] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-08T22:34:30.639882] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-08T22:34:30.642371] [INFO ] [MAIN ] Derivative Progress: 135/1771 symbols completed. ATHM took 0.7s. Estimated remaining: 10m 27s. Rate: 156.5 symbols/min [2025-10-08T22:34:30.643070] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:30.643676] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:30.643182] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:30.654624] [DEBUG] [LOCAL ] ATHS: Loaded 6780 existing records from primary storage. [2025-10-08T22:34:30.655046] [INFO ] [MAIN ] ATHS: Loaded 6780 primary data records. [2025-10-08T22:34:31.008182] [DEBUG] [LOCAL ] ATKR: Loaded 35380 existing records from primary storage. [2025-10-08T22:34:31.008677] [INFO ] [MAIN ] ATKR: Loaded 35380 primary data records. [2025-10-08T22:34:31.084255] [DEBUG] [LOCAL ] ATI: Loaded 51415 existing records from primary storage. [2025-10-08T22:34:31.117344] [INFO ] [MAIN ] ATI: Loaded 51415 primary data records. [2025-10-08T22:34:31.757846] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:31.760607] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6780 primary records. [2025-10-08T22:34:31.760914] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-08T22:34:31.793348] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-08T22:34:31.815520] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-08T22:34:31.819861] [INFO ] [MAIN ] Derivative Progress: 136/1771 symbols completed. ATHS took 1.2s. Estimated remaining: 10m 36s. Rate: 154.2 symbols/min [2025-10-08T22:34:31.820880] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:31.827405] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:31.836471] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35380 primary records. [2025-10-08T22:34:31.844693] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-08T22:34:31.854405] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:31.856443] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51415 primary records. [2025-10-08T22:34:31.868596] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-08T22:34:31.887360] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-08T22:34:31.887540] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-08T22:34:31.890670] [INFO ] [MAIN ] Derivative Progress: 137/1771 symbols completed. ATKR took 1.2s. Estimated remaining: 10m 32s. Rate: 155.1 symbols/min [2025-10-08T22:34:31.890991] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:31.931451] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-08T22:34:31.931701] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-08T22:34:31.934475] [INFO ] [MAIN ] Derivative Progress: 138/1771 symbols completed. ATI took 1.3s. Estimated remaining: 10m 28s. Rate: 156.1 symbols/min [2025-10-08T22:34:31.936807] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:31.963983] [DEBUG] [LOCAL ] ATMU: Loaded 39145 existing records from primary storage. [2025-10-08T22:34:31.964453] [INFO ] [MAIN ] ATMU: Loaded 39145 primary data records. [2025-10-08T22:34:32.184458] [DEBUG] [LOCAL ] ATO: Loaded 41855 existing records from primary storage. [2025-10-08T22:34:32.193108] [DEBUG] [LOCAL ] ATR: Loaded 30573 existing records from primary storage. [2025-10-08T22:34:32.193471] [INFO ] [MAIN ] ATR: Loaded 30573 primary data records. [2025-10-08T22:34:32.194168] [INFO ] [MAIN ] ATO: Loaded 41855 primary data records. [2025-10-08T22:34:33.155825] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:33.156764] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39145 primary records. [2025-10-08T22:34:33.156935] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-08T22:34:33.190186] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-08T22:34:33.190477] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:33.191318] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30573 primary records. [2025-10-08T22:34:33.191458] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-08T22:34:33.193504] [INFO ] [MAIN ] Derivative Progress: 139/1771 symbols completed. ATMU took 1.4s. Estimated remaining: 10m 38s. Rate: 153.6 symbols/min [2025-10-08T22:34:33.191556] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-08T22:34:33.193746] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:33.219032] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:33.223212] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41855 primary records. [2025-10-08T22:34:33.223556] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-08T22:34:33.225051] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-08T22:34:33.225351] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-08T22:34:33.234969] [INFO ] [MAIN ] Derivative Progress: 140/1771 symbols completed. ATR took 1.3s. Estimated remaining: 10m 33s. Rate: 154.6 symbols/min [2025-10-08T22:34:33.238780] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:33.253869] [DEBUG] [LOCAL ] ATS: Loaded 17730 existing records from primary storage. [2025-10-08T22:34:33.254488] [INFO ] [MAIN ] ATS: Loaded 17730 primary data records. [2025-10-08T22:34:33.266930] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-08T22:34:33.301576] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-08T22:34:33.326040] [INFO ] [MAIN ] Derivative Progress: 141/1771 symbols completed. ATO took 1.4s. Estimated remaining: 10m 29s. Rate: 155.4 symbols/min [2025-10-08T22:34:33.344220] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:33.593039] [DEBUG] [LOCAL ] ATUS: Loaded 49482 existing records from primary storage. [2025-10-08T22:34:33.594065] [INFO ] [MAIN ] ATUS: Loaded 49482 primary data records. [2025-10-08T22:34:33.830295] [DEBUG] [LOCAL ] AU: Loaded 52990 existing records from primary storage. [2025-10-08T22:34:33.960078] [INFO ] [MAIN ] AU: Loaded 52990 primary data records. [2025-10-08T22:34:34.152463] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:34.303286] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17730 primary records. [2025-10-08T22:34:34.317341] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-08T22:34:34.337739] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-08T22:34:34.338534] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-08T22:34:34.340972] [INFO ] [MAIN ] Derivative Progress: 142/1771 symbols completed. ATS took 1.1s. Estimated remaining: 10m 36s. Rate: 153.7 symbols/min [2025-10-08T22:34:34.341505] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:34.366026] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:34.367402] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49482 primary records. [2025-10-08T22:34:34.367819] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-08T22:34:34.392308] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-08T22:34:34.394859] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-08T22:34:34.397038] [INFO ] [MAIN ] Derivative Progress: 143/1771 symbols completed. ATUS took 1.2s. Estimated remaining: 10m 32s. Rate: 154.6 symbols/min [2025-10-08T22:34:34.398138] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:34.426847] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:34.427788] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52990 primary records. [2025-10-08T22:34:34.430854] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-08T22:34:34.430789] [DEBUG] [LOCAL ] AUNA: Loaded 5056 existing records from primary storage. [2025-10-08T22:34:34.431365] [INFO ] [MAIN ] AUNA: Loaded 5056 primary data records. [2025-10-08T22:34:34.563719] [DEBUG] [LOCAL ] AUB: Loaded 46185 existing records from primary storage. [2025-10-08T22:34:34.562748] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-08T22:34:34.574585] [INFO ] [MAIN ] AUB: Loaded 46185 primary data records. [2025-10-08T22:34:34.574781] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-08T22:34:34.576722] [INFO ] [MAIN ] Derivative Progress: 144/1771 symbols completed. AU took 1.2s. Estimated remaining: 10m 29s. Rate: 155.2 symbols/min [2025-10-08T22:34:34.690765] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:35.137561] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:35.138558] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 5056 primary records. [2025-10-08T22:34:35.150607] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-08T22:34:35.152149] [DEBUG] [LOCAL ] AVA: Loaded 39116 existing records from primary storage. [2025-10-08T22:34:35.153042] [INFO ] [MAIN ] AVA: Loaded 39116 primary data records. [2025-10-08T22:34:35.222392] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-08T22:34:35.231242] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-08T22:34:35.238501] [INFO ] [MAIN ] Derivative Progress: 145/1771 symbols completed. AUNA took 0.8s. Estimated remaining: 10m 32s. Rate: 154.4 symbols/min [2025-10-08T22:34:35.261568] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:35.493197] [DEBUG] [LOCAL ] AVAL: Loaded 8653 existing records from primary storage. [2025-10-08T22:34:35.494473] [INFO ] [MAIN ] AVAL: Loaded 8653 primary data records. [2025-10-08T22:34:35.494382] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:35.526429] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46185 primary records. [2025-10-08T22:34:35.532431] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-08T22:34:35.633196] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-08T22:34:35.682676] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-08T22:34:35.828117] [INFO ] [MAIN ] Derivative Progress: 146/1771 symbols completed. AUB took 1.5s. Estimated remaining: 10m 34s. Rate: 153.9 symbols/min [2025-10-08T22:34:35.828813] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:35.850629] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:35.851536] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39116 primary records. [2025-10-08T22:34:35.851803] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-08T22:34:35.875823] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-08T22:34:35.876063] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-08T22:34:35.878618] [INFO ] [MAIN ] Derivative Progress: 147/1771 symbols completed. AVA took 1.2s. Estimated remaining: 10m 30s. Rate: 154.8 symbols/min [2025-10-08T22:34:35.878956] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:35.907199] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:35.908157] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8653 primary records. [2025-10-08T22:34:35.908261] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-08T22:34:35.944639] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-08T22:34:35.945815] [DEBUG] [LOCAL ] AVB: Loaded 42092 existing records from primary storage. [2025-10-08T22:34:35.945989] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-08T22:34:35.948447] [INFO ] [MAIN ] AVB: Loaded 42092 primary data records. [2025-10-08T22:34:35.948241] [INFO ] [MAIN ] Derivative Progress: 148/1771 symbols completed. AVAL took 0.7s. Estimated remaining: 10m 26s. Rate: 155.6 symbols/min [2025-10-08T22:34:36.061135] [DEBUG] [LOCAL ] AVD: Loaded 22246 existing records from primary storage. [2025-10-08T22:34:36.061310] [INFO ] [MAIN ] AVD: Loaded 22246 primary data records. [2025-10-08T22:34:36.602405] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:36.603424] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42092 primary records. [2025-10-08T22:34:36.603639] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-08T22:34:36.622373] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-08T22:34:36.623067] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-08T22:34:36.625415] [INFO ] [MAIN ] Derivative Progress: 149/1771 symbols completed. AVB took 0.8s. Estimated remaining: 10m 28s. Rate: 154.9 symbols/min [2025-10-08T22:34:36.638240] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:36.638901] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 22246 primary records. [2025-10-08T22:34:36.638974] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-08T22:34:36.654040] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-08T22:34:36.654134] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-08T22:34:36.656334] [INFO ] [MAIN ] Derivative Progress: 150/1771 symbols completed. AVD took 0.8s. Estimated remaining: 10m 24s. Rate: 155.8 symbols/min [2025-10-08T22:34:36.656840] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:36.656991] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:36.657130] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:36.697453] [DEBUG] [LOCAL ] AVK: Loaded 18294 existing records from primary storage. [2025-10-08T22:34:36.697826] [INFO ] [MAIN ] AVK: Loaded 18294 primary data records. [2025-10-08T22:34:36.836398] [DEBUG] [LOCAL ] AVNT: Loaded 39051 existing records from primary storage. [2025-10-08T22:34:36.836819] [INFO ] [MAIN ] AVNT: Loaded 39051 primary data records. [2025-10-08T22:34:36.837467] [DEBUG] [LOCAL ] AVNS: Loaded 33577 existing records from primary storage. [2025-10-08T22:34:36.855071] [INFO ] [MAIN ] AVNS: Loaded 33577 primary data records. [2025-10-08T22:34:37.713843] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:37.715337] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18294 primary records. [2025-10-08T22:34:37.715632] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-08T22:34:37.753699] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:37.755292] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33577 primary records. [2025-10-08T22:34:37.755602] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-08T22:34:37.756350] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-08T22:34:37.770276] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-08T22:34:37.773262] [INFO ] [MAIN ] Derivative Progress: 151/1771 symbols completed. AVK took 1.1s. Estimated remaining: 10m 32s. Rate: 153.9 symbols/min [2025-10-08T22:34:37.781804] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:37.771078] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:37.790296] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39051 primary records. [2025-10-08T22:34:37.790702] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-08T22:34:37.811150] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-08T22:34:37.811957] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-08T22:34:37.811728] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-08T22:34:37.812259] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-08T22:34:37.814721] [INFO ] [MAIN ] Derivative Progress: 152/1771 symbols completed. AVNS took 1.2s. Estimated remaining: 10m 28s. Rate: 154.8 symbols/min [2025-10-08T22:34:37.817791] [INFO ] [MAIN ] Derivative Progress: 153/1771 symbols completed. AVNT took 1.2s. Estimated remaining: 10m 23s. Rate: 155.8 symbols/min [2025-10-08T22:34:37.817596] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:37.818562] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:37.861948] [DEBUG] [LOCAL ] AWF: Loaded 24261 existing records from primary storage. [2025-10-08T22:34:37.870769] [INFO ] [MAIN ] AWF: Loaded 24261 primary data records. [2025-10-08T22:34:37.871349] [DEBUG] [LOCAL ] AWI: Loaded 25305 existing records from primary storage. [2025-10-08T22:34:37.902981] [INFO ] [MAIN ] AWI: Loaded 25305 primary data records. [2025-10-08T22:34:37.959794] [DEBUG] [LOCAL ] AVTR: Loaded 53563 existing records from primary storage. [2025-10-08T22:34:38.030372] [INFO ] [MAIN ] AVTR: Loaded 53563 primary data records. [2025-10-08T22:34:38.980910] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:38.982335] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24261 primary records. [2025-10-08T22:34:38.982558] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-08T22:34:39.034140] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:39.034429] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:39.036834] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53563 primary records. [2025-10-08T22:34:39.038177] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 25305 primary records. [2025-10-08T22:34:39.038319] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-08T22:34:39.040260] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-08T22:34:39.040370] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-08T22:34:39.040511] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-08T22:34:39.043500] [INFO ] [MAIN ] Derivative Progress: 154/1771 symbols completed. AWF took 1.2s. Estimated remaining: 10m 32s. Rate: 153.6 symbols/min [2025-10-08T22:34:39.044339] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:39.076918] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-10-08T22:34:39.077856] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-08T22:34:39.080766] [INFO ] [MAIN ] Derivative Progress: 155/1771 symbols completed. AWI took 1.3s. Estimated remaining: 10m 27s. Rate: 154.5 symbols/min [2025-10-08T22:34:39.081812] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:39.085324] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-08T22:34:39.085744] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-08T22:34:39.091161] [INFO ] [MAIN ] Derivative Progress: 156/1771 symbols completed. AVTR took 1.3s. Estimated remaining: 10m 23s. Rate: 155.5 symbols/min [2025-10-08T22:34:39.091665] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:39.114631] [DEBUG] [LOCAL ] AWP: Loaded 21500 existing records from primary storage. [2025-10-08T22:34:39.114842] [INFO ] [MAIN ] AWP: Loaded 21500 primary data records. [2025-10-08T22:34:39.291076] [DEBUG] [LOCAL ] AWR: Loaded 22687 existing records from primary storage. [2025-10-08T22:34:39.317670] [INFO ] [MAIN ] AWR: Loaded 22687 primary data records. [2025-10-08T22:34:39.539621] [DEBUG] [LOCAL ] AWK: Loaded 48684 existing records from primary storage. [2025-10-08T22:34:39.581048] [INFO ] [MAIN ] AWK: Loaded 48684 primary data records. [2025-10-08T22:34:40.155728] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:40.157538] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21500 primary records. [2025-10-08T22:34:40.158000] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-08T22:34:40.180147] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-08T22:34:40.181891] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-08T22:34:40.184048] [INFO ] [MAIN ] Derivative Progress: 157/1771 symbols completed. AWP took 1.1s. Estimated remaining: 10m 30s. Rate: 153.7 symbols/min [2025-10-08T22:34:40.184371] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:40.199997] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:40.201155] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22687 primary records. [2025-10-08T22:34:40.201461] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-08T22:34:40.244678] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-08T22:34:40.244565] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:40.245573] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48684 primary records. [2025-10-08T22:34:40.245902] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-08T22:34:40.245736] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-08T22:34:40.256614] [INFO ] [MAIN ] Derivative Progress: 158/1771 symbols completed. AWR took 1.2s. Estimated remaining: 10m 26s. Rate: 154.5 symbols/min [2025-10-08T22:34:40.258439] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:40.266774] [DEBUG] [LOCAL ] AX: Loaded 28069 existing records from primary storage. [2025-10-08T22:34:40.267049] [INFO ] [MAIN ] AX: Loaded 28069 primary data records. [2025-10-08T22:34:40.390132] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-08T22:34:40.394485] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-08T22:34:40.397910] [INFO ] [MAIN ] Derivative Progress: 159/1771 symbols completed. AWK took 1.4s. Estimated remaining: 10m 24s. Rate: 155.1 symbols/min [2025-10-08T22:34:40.414571] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:40.647157] [DEBUG] [LOCAL ] AXL: Loaded 50517 existing records from primary storage. [2025-10-08T22:34:40.648047] [INFO ] [MAIN ] AXL: Loaded 50517 primary data records. [2025-10-08T22:34:41.042264] [DEBUG] [LOCAL ] AXP: Loaded 53172 existing records from primary storage. [2025-10-08T22:34:41.045623] [INFO ] [MAIN ] AXP: Loaded 53172 primary data records. [2025-10-08T22:34:41.126249] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:41.160568] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28069 primary records. [2025-10-08T22:34:41.177179] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-08T22:34:41.404932] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-08T22:34:41.406279] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-08T22:34:41.408715] [INFO ] [MAIN ] Derivative Progress: 160/1771 symbols completed. AX took 1.2s. Estimated remaining: 10m 29s. Rate: 153.6 symbols/min [2025-10-08T22:34:41.411733] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:41.429578] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:41.432101] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50517 primary records. [2025-10-08T22:34:41.432391] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-08T22:34:41.443382] [DEBUG] [LOCAL ] AXR: Loaded 2986 existing records from primary storage. [2025-10-08T22:34:41.443829] [INFO ] [MAIN ] AXR: Loaded 2986 primary data records. [2025-10-08T22:34:41.566358] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-08T22:34:41.583100] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-08T22:34:41.586105] [INFO ] [MAIN ] Derivative Progress: 161/1771 symbols completed. AXL took 1.3s. Estimated remaining: 10m 27s. Rate: 154.1 symbols/min [2025-10-08T22:34:41.592299] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:41.607979] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:41.609023] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53172 primary records. [2025-10-08T22:34:41.609616] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-08T22:34:41.809514] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-08T22:34:41.809952] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-08T22:34:41.813068] [INFO ] [MAIN ] Derivative Progress: 162/1771 symbols completed. AXP took 1.4s. Estimated remaining: 10m 25s. Rate: 154.5 symbols/min [2025-10-08T22:34:41.813418] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:41.855855] [DEBUG] [LOCAL ] AXS: Loaded 38632 existing records from primary storage. [2025-10-08T22:34:41.862674] [INFO ] [MAIN ] AXS: Loaded 38632 primary data records. [2025-10-08T22:34:41.863127] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:41.885257] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 2986 primary records. [2025-10-08T22:34:41.933432] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-08T22:34:42.211159] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-08T22:34:42.211298] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-08T22:34:42.210916] [DEBUG] [LOCAL ] AXTA: Loaded 52183 existing records from primary storage. [2025-10-08T22:34:42.213565] [INFO ] [MAIN ] Derivative Progress: 163/1771 symbols completed. AXR took 0.8s. Estimated remaining: 10m 25s. Rate: 154.5 symbols/min [2025-10-08T22:34:42.214766] [INFO ] [MAIN ] AXTA: Loaded 52183 primary data records. [2025-10-08T22:34:42.540579] [DEBUG] [MAIN ] AXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:42.542031] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38632 primary records. [2025-10-08T22:34:42.542147] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-08T22:34:42.560026] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-08T22:34:42.560235] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-08T22:34:42.562806] [INFO ] [MAIN ] Derivative Progress: 164/1771 symbols completed. AXS took 1.0s. Estimated remaining: 10m 24s. Rate: 154.6 symbols/min [2025-10-08T22:34:42.579588] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:42.580293] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52183 primary records. [2025-10-08T22:34:42.580357] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-08T22:34:42.596305] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-08T22:34:42.596384] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-08T22:34:42.598504] [INFO ] [MAIN ] Derivative Progress: 165/1771 symbols completed. AXTA took 0.8s. Estimated remaining: 10m 20s. Rate: 155.4 symbols/min [2025-10-08T22:34:42.599293] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:42.599069] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:42.599215] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:42.615502] [DEBUG] [LOCAL ] AZO: Loaded 11256 existing records from primary storage. [2025-10-08T22:34:42.615897] [INFO ] [MAIN ] AZO: Loaded 11256 primary data records. [2025-10-08T22:34:42.755402] [DEBUG] [LOCAL ] AZZ: Loaded 22128 existing records from primary storage. [2025-10-08T22:34:42.756153] [INFO ] [MAIN ] AZZ: Loaded 22128 primary data records. [2025-10-08T22:34:42.756027] [DEBUG] [LOCAL ] AYI: Loaded 25246 existing records from primary storage. [2025-10-08T22:34:42.756471] [INFO ] [MAIN ] AYI: Loaded 25246 primary data records. [2025-10-08T22:34:43.653915] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:43.654925] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11256 primary records. [2025-10-08T22:34:43.655220] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-08T22:34:43.678041] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-08T22:34:43.678244] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-08T22:34:43.680587] [INFO ] [MAIN ] Derivative Progress: 166/1771 symbols completed. AZO took 1.1s. Estimated remaining: 10m 26s. Rate: 153.7 symbols/min [2025-10-08T22:34:43.705550] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:43.705002] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:43.707116] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22128 primary records. [2025-10-08T22:34:43.707193] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-08T22:34:43.706115] [DEBUG] [MAIN ] AYI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:34:43.707825] [INFO ] [MAIN ] AYI: Generated 1793 derivative records from 25246 primary records. [2025-10-08T22:34:43.707905] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-08T22:34:43.739704] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-10-08T22:34:43.740417] [DEBUG] [LOCAL ] AYI: Derivative data saved (1793 records). [2025-10-08T22:34:43.740541] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-08T22:34:43.740597] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-08T22:34:43.743478] [INFO ] [MAIN ] Derivative Progress: 167/1771 symbols completed. AYI took 1.1s. Estimated remaining: 10m 23s. Rate: 154.5 symbols/min [2025-10-08T22:34:43.746377] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:43.746524] [INFO ] [MAIN ] Derivative Progress: 168/1771 symbols completed. AZZ took 1.1s. Estimated remaining: 10m 19s. Rate: 155.4 symbols/min [2025-10-08T22:34:43.746689] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:43.794473] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-08T22:34:43.794828] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-08T22:34:44.199839] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-08T22:34:44.198967] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-08T22:34:44.200037] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-08T22:34:44.200143] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-08T22:34:44.816974] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:44.818288] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-08T22:34:44.818527] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-08T22:34:44.837545] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-08T22:34:44.837921] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-08T22:34:44.840383] [INFO ] [MAIN ] Derivative Progress: 169/1771 symbols completed. BA took 1.1s. Estimated remaining: 10m 25s. Rate: 153.8 symbols/min [2025-10-08T22:34:44.840728] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:44.861205] [DEBUG] [MAIN ] BAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:44.863470] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-08T22:34:44.864892] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-08T22:34:44.902150] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:44.904270] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-08T22:34:44.904401] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-08T22:34:44.904472] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-08T22:34:44.904989] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-08T22:34:44.907101] [INFO ] [MAIN ] Derivative Progress: 170/1771 symbols completed. BAC took 1.2s. Estimated remaining: 10m 22s. Rate: 154.5 symbols/min [2025-10-08T22:34:44.907276] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:44.934481] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-08T22:34:44.935634] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-08T22:34:44.938027] [INFO ] [MAIN ] Derivative Progress: 171/1771 symbols completed. BABA took 1.2s. Estimated remaining: 10m 18s. Rate: 155.4 symbols/min [2025-10-08T22:34:44.938313] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:44.939310] [DEBUG] [LOCAL ] BAK: Loaded 39408 existing records from primary storage. [2025-10-08T22:34:44.939451] [INFO ] [MAIN ] BAK: Loaded 39408 primary data records. [2025-10-08T22:34:45.321169] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-10-08T22:34:45.322989] [INFO ] [MAIN ] BALL: Loaded 51825 primary data records. [2025-10-08T22:34:45.445524] [DEBUG] [LOCAL ] BAM: Loaded 52011 existing records from primary storage. [2025-10-08T22:34:45.461372] [INFO ] [MAIN ] BAM: Loaded 52011 primary data records. [2025-10-08T22:34:45.766910] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:45.783727] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39408 primary records. [2025-10-08T22:34:45.789087] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-08T22:34:45.978531] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-08T22:34:45.979037] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-08T22:34:45.981782] [INFO ] [MAIN ] Derivative Progress: 172/1771 symbols completed. BAK took 1.1s. Estimated remaining: 10m 24s. Rate: 153.8 symbols/min [2025-10-08T22:34:45.982757] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:46.018111] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:46.023738] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51825 primary records. [2025-10-08T22:34:46.023968] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:46.024675] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52011 primary records. [2025-10-08T22:34:46.024731] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-08T22:34:46.024895] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-08T22:34:46.053343] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-08T22:34:46.053855] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-08T22:34:46.071376] [INFO ] [MAIN ] Derivative Progress: 173/1771 symbols completed. BAM took 1.1s. Estimated remaining: 10m 21s. Rate: 154.5 symbols/min [2025-10-08T22:34:46.072246] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:46.076384] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-08T22:34:46.076519] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-08T22:34:46.078361] [INFO ] [MAIN ] Derivative Progress: 174/1771 symbols completed. BALL took 1.2s. Estimated remaining: 10m 17s. Rate: 155.4 symbols/min [2025-10-08T22:34:46.078715] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:46.103689] [DEBUG] [LOCAL ] BANC: Loaded 51277 existing records from primary storage. [2025-10-08T22:34:46.104015] [INFO ] [MAIN ] BANC: Loaded 51277 primary data records. [2025-10-08T22:34:46.217995] [DEBUG] [LOCAL ] BAP: Loaded 25923 existing records from primary storage. [2025-10-08T22:34:46.235367] [INFO ] [MAIN ] BAP: Loaded 25923 primary data records. [2025-10-08T22:34:46.583843] [DEBUG] [LOCAL ] BARK: Loaded 37978 existing records from primary storage. [2025-10-08T22:34:46.590586] [INFO ] [MAIN ] BARK: Loaded 37978 primary data records. [2025-10-08T22:34:47.165236] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:47.167997] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51277 primary records. [2025-10-08T22:34:47.168314] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-08T22:34:47.184276] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:47.200422] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25923 primary records. [2025-10-08T22:34:47.201858] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-08T22:34:47.202924] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-08T22:34:47.203238] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-08T22:34:47.206150] [INFO ] [MAIN ] Derivative Progress: 175/1771 symbols completed. BANC took 1.2s. Estimated remaining: 10m 23s. Rate: 153.7 symbols/min [2025-10-08T22:34:47.206395] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:47.224026] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-08T22:34:47.224269] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-08T22:34:47.226286] [INFO ] [MAIN ] Derivative Progress: 176/1771 symbols completed. BAP took 1.2s. Estimated remaining: 10m 19s. Rate: 154.5 symbols/min [2025-10-08T22:34:47.226684] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:47.244218] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:47.245003] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 37978 primary records. [2025-10-08T22:34:47.245181] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-08T22:34:47.261031] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-08T22:34:47.261230] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-08T22:34:47.264240] [INFO ] [MAIN ] Derivative Progress: 177/1771 symbols completed. BARK took 1.2s. Estimated remaining: 10m 16s. Rate: 155.3 symbols/min [2025-10-08T22:34:47.264463] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:47.311295] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-08T22:34:47.338950] [INFO ] [MAIN ] BAX: Loaded 53504 primary data records. [2025-10-08T22:34:47.485247] [DEBUG] [LOCAL ] BB: Loaded 52939 existing records from primary storage. [2025-10-08T22:34:47.505365] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-08T22:34:47.498756] [INFO ] [MAIN ] BB: Loaded 52939 primary data records. [2025-10-08T22:34:47.513964] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-08T22:34:48.403719] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:48.405539] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53504 primary records. [2025-10-08T22:34:48.405691] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-08T22:34:48.443239] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:48.462412] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-08T22:34:48.461085] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52939 primary records. [2025-10-08T22:34:48.463157] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:48.463291] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-08T22:34:48.465001] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-08T22:34:48.465140] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-08T22:34:48.465862] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-08T22:34:48.476431] [INFO ] [MAIN ] Derivative Progress: 178/1771 symbols completed. BAX took 1.3s. Estimated remaining: 10m 23s. Rate: 153.5 symbols/min [2025-10-08T22:34:48.504107] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-08T22:34:48.508971] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-08T22:34:48.511105] [INFO ] [MAIN ] Derivative Progress: 179/1771 symbols completed. BB took 1.3s. Estimated remaining: 10m 19s. Rate: 154.3 symbols/min [2025-10-08T22:34:48.512752] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-08T22:34:48.512837] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-08T22:34:48.515499] [INFO ] [MAIN ] Derivative Progress: 180/1771 symbols completed. BBAI took 1.3s. Estimated remaining: 10m 15s. Rate: 155.1 symbols/min [2025-10-08T22:34:48.516026] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:48.516141] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:48.516269] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:48.571001] [DEBUG] [LOCAL ] BBDC: Loaded 33016 existing records from primary storage. [2025-10-08T22:34:48.571184] [INFO ] [MAIN ] BBDC: Loaded 33016 primary data records. [2025-10-08T22:34:48.705906] [DEBUG] [LOCAL ] BBAR: Loaded 41817 existing records from primary storage. [2025-10-08T22:34:48.721457] [INFO ] [MAIN ] BBAR: Loaded 41817 primary data records. [2025-10-08T22:34:48.728316] [DEBUG] [LOCAL ] BBD: Loaded 53245 existing records from primary storage. [2025-10-08T22:34:48.847213] [INFO ] [MAIN ] BBD: Loaded 53245 primary data records. [2025-10-08T22:34:49.677083] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:49.681579] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33016 primary records. [2025-10-08T22:34:49.682090] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-08T22:34:49.710723] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:49.712291] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 41817 primary records. [2025-10-08T22:34:49.713250] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-08T22:34:49.729724] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-08T22:34:49.730303] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-08T22:34:49.733790] [INFO ] [MAIN ] Derivative Progress: 181/1771 symbols completed. BBDC took 1.2s. Estimated remaining: 10m 22s. Rate: 153.3 symbols/min [2025-10-08T22:34:49.734958] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:49.751484] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-08T22:34:49.751934] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-08T22:34:49.754446] [INFO ] [MAIN ] Derivative Progress: 182/1771 symbols completed. BBAR took 1.2s. Estimated remaining: 10m 19s. Rate: 154.1 symbols/min [2025-10-08T22:34:49.754890] [DEBUG] [MAIN ] BBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:49.755118] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:49.756476] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53245 primary records. [2025-10-08T22:34:49.756577] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-08T22:34:49.781142] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-08T22:34:49.781370] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-08T22:34:49.784664] [DEBUG] [LOCAL ] BBU: Loaded 5128 existing records from primary storage. [2025-10-08T22:34:49.787021] [INFO ] [MAIN ] Derivative Progress: 183/1771 symbols completed. BBD took 1.3s. Estimated remaining: 10m 15s. Rate: 154.9 symbols/min [2025-10-08T22:34:49.787502] [INFO ] [MAIN ] BBU: Loaded 5128 primary data records. [2025-10-08T22:34:49.787427] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:49.857792] [DEBUG] [LOCAL ] BBN: Loaded 18059 existing records from primary storage. [2025-10-08T22:34:49.878592] [INFO ] [MAIN ] BBN: Loaded 18059 primary data records. [2025-10-08T22:34:50.028835] [DEBUG] [LOCAL ] BBUC: Loaded 13474 existing records from primary storage. [2025-10-08T22:34:50.093088] [INFO ] [MAIN ] BBUC: Loaded 13474 primary data records. [2025-10-08T22:34:50.797478] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:50.799624] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 5128 primary records. [2025-10-08T22:34:50.800123] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-08T22:34:50.815040] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:50.816711] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18059 primary records. [2025-10-08T22:34:50.817181] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-08T22:34:50.851883] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-08T22:34:50.852901] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-08T22:34:50.853866] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-08T22:34:50.863585] [INFO ] [MAIN ] Derivative Progress: 184/1771 symbols completed. BBN took 1.1s. Estimated remaining: 10m 21s. Rate: 153.4 symbols/min [2025-10-08T22:34:50.868925] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-08T22:34:50.868730] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:50.869435] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:50.872285] [INFO ] [MAIN ] Derivative Progress: 185/1771 symbols completed. BBU took 1.1s. Estimated remaining: 10m 17s. Rate: 154.2 symbols/min [2025-10-08T22:34:50.870212] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13474 primary records. [2025-10-08T22:34:50.872798] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-08T22:34:50.872584] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:50.890231] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-08T22:34:50.890368] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-08T22:34:50.892417] [INFO ] [MAIN ] Derivative Progress: 186/1771 symbols completed. BBUC took 1.1s. Estimated remaining: 10m 14s. Rate: 155.0 symbols/min [2025-10-08T22:34:50.892714] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:50.914285] [DEBUG] [LOCAL ] BBW: Loaded 27086 existing records from primary storage. [2025-10-08T22:34:50.914561] [INFO ] [MAIN ] BBW: Loaded 27086 primary data records. [2025-10-08T22:34:51.256917] [DEBUG] [LOCAL ] BBVA: Loaded 49165 existing records from primary storage. [2025-10-08T22:34:51.270383] [INFO ] [MAIN ] BBVA: Loaded 49165 primary data records. [2025-10-08T22:34:51.305546] [DEBUG] [LOCAL ] BBWI: Loaded 53582 existing records from primary storage. [2025-10-08T22:34:51.334854] [INFO ] [MAIN ] BBWI: Loaded 53582 primary data records. [2025-10-08T22:34:52.010330] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:52.013675] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27086 primary records. [2025-10-08T22:34:52.013966] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-08T22:34:52.035087] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-08T22:34:52.035370] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-08T22:34:52.037911] [INFO ] [MAIN ] Derivative Progress: 187/1771 symbols completed. BBW took 1.2s. Estimated remaining: 10m 20s. Rate: 153.4 symbols/min [2025-10-08T22:34:52.038843] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:52.075144] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:52.081791] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49165 primary records. [2025-10-08T22:34:52.082293] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-08T22:34:52.082202] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:52.084176] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53582 primary records. [2025-10-08T22:34:52.091775] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-08T22:34:52.116398] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-08T22:34:52.117455] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-08T22:34:52.120599] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-08T22:34:52.120763] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-08T22:34:52.119961] [INFO ] [MAIN ] Derivative Progress: 188/1771 symbols completed. BBWI took 1.2s. Estimated remaining: 10m 17s. Rate: 154.0 symbols/min [2025-10-08T22:34:52.122957] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:52.123030] [INFO ] [MAIN ] Derivative Progress: 189/1771 symbols completed. BBVA took 1.3s. Estimated remaining: 10m 13s. Rate: 154.9 symbols/min [2025-10-08T22:34:52.123816] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:52.160804] [DEBUG] [LOCAL ] BBY: Loaded 53453 existing records from primary storage. [2025-10-08T22:34:52.163797] [INFO ] [MAIN ] BBY: Loaded 53453 primary data records. [2025-10-08T22:34:52.305029] [DEBUG] [LOCAL ] BCAT: Loaded 34116 existing records from primary storage. [2025-10-08T22:34:52.305321] [INFO ] [MAIN ] BCAT: Loaded 34116 primary data records. [2025-10-08T22:34:52.504526] [DEBUG] [LOCAL ] BC: Loaded 44121 existing records from primary storage. [2025-10-08T22:34:52.504831] [INFO ] [MAIN ] BC: Loaded 44121 primary data records. [2025-10-08T22:34:53.155023] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:53.156064] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53453 primary records. [2025-10-08T22:34:53.156271] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-08T22:34:53.177550] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-08T22:34:53.177796] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-08T22:34:53.180338] [INFO ] [MAIN ] Derivative Progress: 190/1771 symbols completed. BBY took 1.1s. Estimated remaining: 10m 18s. Rate: 153.5 symbols/min [2025-10-08T22:34:53.193083] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:53.193800] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:53.194985] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34116 primary records. [2025-10-08T22:34:53.195169] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-08T22:34:53.224238] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-08T22:34:53.229774] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:53.229862] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-08T22:34:53.232316] [INFO ] [MAIN ] Derivative Progress: 191/1771 symbols completed. BCAT took 1.1s. Estimated remaining: 10m 15s. Rate: 154.2 symbols/min [2025-10-08T22:34:53.233252] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44121 primary records. [2025-10-08T22:34:53.233688] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-08T22:34:53.233379] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:53.257913] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-08T22:34:53.267098] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-08T22:34:53.269510] [INFO ] [MAIN ] Derivative Progress: 192/1771 symbols completed. BC took 1.1s. Estimated remaining: 10m 12s. Rate: 154.9 symbols/min [2025-10-08T22:34:53.269786] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:53.270409] [DEBUG] [LOCAL ] BCC: Loaded 28199 existing records from primary storage. [2025-10-08T22:34:53.271050] [INFO ] [MAIN ] BCC: Loaded 28199 primary data records. [2025-10-08T22:34:53.520255] [DEBUG] [LOCAL ] BCO: Loaded 25786 existing records from primary storage. [2025-10-08T22:34:53.638683] [INFO ] [MAIN ] BCO: Loaded 25786 primary data records. [2025-10-08T22:34:53.691244] [DEBUG] [LOCAL ] BCE: Loaded 52209 existing records from primary storage. [2025-10-08T22:34:53.725775] [INFO ] [MAIN ] BCE: Loaded 52209 primary data records. [2025-10-08T22:34:54.284214] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:54.287295] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28199 primary records. [2025-10-08T22:34:54.288218] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-08T22:34:54.307688] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-10-08T22:34:54.308286] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-08T22:34:54.311693] [INFO ] [MAIN ] Derivative Progress: 193/1771 symbols completed. BCC took 1.1s. Estimated remaining: 10m 17s. Rate: 153.5 symbols/min [2025-10-08T22:34:54.332853] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:54.333790] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52209 primary records. [2025-10-08T22:34:54.333933] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-08T22:34:54.347250] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:54.348462] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25786 primary records. [2025-10-08T22:34:54.359490] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-08T22:34:54.378223] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-08T22:34:54.378833] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-08T22:34:54.382476] [INFO ] [MAIN ] Derivative Progress: 194/1771 symbols completed. BCO took 1.1s. Estimated remaining: 10m 14s. Rate: 154.2 symbols/min [2025-10-08T22:34:54.384307] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-08T22:34:54.384376] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-08T22:34:54.386838] [INFO ] [MAIN ] Derivative Progress: 195/1771 symbols completed. BCE took 1.2s. Estimated remaining: 10m 10s. Rate: 155.0 symbols/min [2025-10-08T22:34:54.387275] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:54.387491] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:54.387405] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:54.431113] [DEBUG] [LOCAL ] BCX: Loaded 21636 existing records from primary storage. [2025-10-08T22:34:54.431263] [INFO ] [MAIN ] BCX: Loaded 21636 primary data records. [2025-10-08T22:34:54.546787] [DEBUG] [LOCAL ] BCSF: Loaded 27944 existing records from primary storage. [2025-10-08T22:34:54.558733] [INFO ] [MAIN ] BCSF: Loaded 27944 primary data records. [2025-10-08T22:34:54.868460] [DEBUG] [LOCAL ] BCS: Loaded 53444 existing records from primary storage. [2025-10-08T22:34:54.891991] [INFO ] [MAIN ] BCS: Loaded 53444 primary data records. [2025-10-08T22:34:55.433051] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:55.434917] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 21636 primary records. [2025-10-08T22:34:55.435068] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-08T22:34:55.455409] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-08T22:34:55.455674] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-08T22:34:55.457786] [INFO ] [MAIN ] Derivative Progress: 196/1771 symbols completed. BCX took 1.1s. Estimated remaining: 10m 15s. Rate: 153.6 symbols/min [2025-10-08T22:34:55.473201] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:55.475030] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:55.476132] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27944 primary records. [2025-10-08T22:34:55.483732] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-08T22:34:55.490038] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:55.502870] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53444 primary records. [2025-10-08T22:34:55.507183] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-08T22:34:55.507272] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-08T22:34:55.508204] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-08T22:34:55.518349] [INFO ] [MAIN ] Derivative Progress: 197/1771 symbols completed. BCSF took 1.1s. Estimated remaining: 10m 12s. Rate: 154.3 symbols/min [2025-10-08T22:34:55.526672] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-08T22:34:55.526814] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:55.527203] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-08T22:34:55.529740] [INFO ] [MAIN ] Derivative Progress: 198/1771 symbols completed. BCS took 1.1s. Estimated remaining: 10m 9s. Rate: 155.0 symbols/min [2025-10-08T22:34:55.536497] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:55.548783] [DEBUG] [LOCAL ] BDC: Loaded 24540 existing records from primary storage. [2025-10-08T22:34:55.548990] [INFO ] [MAIN ] BDC: Loaded 24540 primary data records. [2025-10-08T22:34:55.686470] [DEBUG] [LOCAL ] BDJ: Loaded 29178 existing records from primary storage. [2025-10-08T22:34:55.778715] [INFO ] [MAIN ] BDJ: Loaded 29178 primary data records. [2025-10-08T22:34:56.018041] [DEBUG] [LOCAL ] BDN: Loaded 47560 existing records from primary storage. [2025-10-08T22:34:56.019281] [INFO ] [MAIN ] BDN: Loaded 47560 primary data records. [2025-10-08T22:34:56.540700] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:56.542121] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24540 primary records. [2025-10-08T22:34:56.542513] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-08T22:34:56.561853] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-08T22:34:56.562440] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-08T22:34:56.565300] [INFO ] [MAIN ] Derivative Progress: 199/1771 symbols completed. BDC took 1.1s. Estimated remaining: 10m 14s. Rate: 153.7 symbols/min [2025-10-08T22:34:56.566908] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:56.585863] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:56.586938] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29178 primary records. [2025-10-08T22:34:56.587082] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-08T22:34:56.615673] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-08T22:34:56.621343] [DEBUG] [MAIN ] BDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:56.622252] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47560 primary records. [2025-10-08T22:34:56.622347] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-08T22:34:56.621488] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-08T22:34:56.625265] [INFO ] [MAIN ] Derivative Progress: 200/1771 symbols completed. BDJ took 1.1s. Estimated remaining: 10m 11s. Rate: 154.4 symbols/min [2025-10-08T22:34:56.626234] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:56.641579] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-08T22:34:56.641705] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-08T22:34:56.644187] [INFO ] [MAIN ] Derivative Progress: 201/1771 symbols completed. BDN took 1.1s. Estimated remaining: 10m 7s. Rate: 155.1 symbols/min [2025-10-08T22:34:56.644313] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:56.718330] [DEBUG] [LOCAL ] BDX: Loaded 52250 existing records from primary storage. [2025-10-08T22:34:56.718724] [INFO ] [MAIN ] BDX: Loaded 52250 primary data records. [2025-10-08T22:34:57.082233] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-08T22:34:57.082678] [INFO ] [MAIN ] BE: Loaded 53659 primary data records. [2025-10-08T22:34:57.095481] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-08T22:34:57.105403] [INFO ] [MAIN ] BEKE: Loaded 53231 primary data records. [2025-10-08T22:34:57.763814] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:57.766172] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52250 primary records. [2025-10-08T22:34:57.767421] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-08T22:34:57.787690] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-08T22:34:57.789674] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-08T22:34:57.792363] [INFO ] [MAIN ] Derivative Progress: 202/1771 symbols completed. BDX took 1.2s. Estimated remaining: 10m 13s. Rate: 153.6 symbols/min [2025-10-08T22:34:57.794859] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:57.823762] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:57.824188] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:57.824910] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53231 primary records. [2025-10-08T22:34:57.825725] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53659 primary records. [2025-10-08T22:34:57.825841] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-08T22:34:57.825939] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-08T22:34:57.857183] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-08T22:34:57.857916] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-08T22:34:57.859344] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-08T22:34:57.859435] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-08T22:34:57.861701] [INFO ] [MAIN ] Derivative Progress: 203/1771 symbols completed. BEKE took 1.2s. Estimated remaining: 10m 10s. Rate: 154.2 symbols/min [2025-10-08T22:34:57.861868] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:57.864600] [INFO ] [MAIN ] Derivative Progress: 204/1771 symbols completed. BE took 1.2s. Estimated remaining: 10m 7s. Rate: 155.0 symbols/min [2025-10-08T22:34:57.864980] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:57.871586] [DEBUG] [LOCAL ] BEPH: Loaded 5349 existing records from primary storage. [2025-10-08T22:34:57.872851] [INFO ] [MAIN ] BEPH: Loaded 5349 primary data records. [2025-10-08T22:34:57.927187] [DEBUG] [LOCAL ] BEPI: Loaded 3606 existing records from primary storage. [2025-10-08T22:34:57.965140] [INFO ] [MAIN ] BEPI: Loaded 3606 primary data records. [2025-10-08T22:34:58.098699] [DEBUG] [LOCAL ] BEP: Loaded 38922 existing records from primary storage. [2025-10-08T22:34:58.266551] [INFO ] [MAIN ] BEP: Loaded 38922 primary data records. [2025-10-08T22:34:58.820739] [DEBUG] [MAIN ] BEPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:58.822070] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5349 primary records. [2025-10-08T22:34:58.822295] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-08T22:34:58.845992] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-08T22:34:58.846314] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-08T22:34:58.848703] [INFO ] [MAIN ] Derivative Progress: 205/1771 symbols completed. BEPH took 1.0s. Estimated remaining: 10m 11s. Rate: 153.8 symbols/min [2025-10-08T22:34:58.849131] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:58.862945] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:58.864063] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3606 primary records. [2025-10-08T22:34:58.864161] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-08T22:34:58.879855] [DEBUG] [LOCAL ] BEPJ: Loaded 3132 existing records from primary storage. [2025-10-08T22:34:58.881149] [INFO ] [MAIN ] BEPJ: Loaded 3132 primary data records. [2025-10-08T22:34:58.994999] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-08T22:34:58.996215] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:58.996366] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-08T22:34:59.010063] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38922 primary records. [2025-10-08T22:34:59.012929] [INFO ] [MAIN ] Derivative Progress: 206/1771 symbols completed. BEPI took 1.1s. Estimated remaining: 10m 9s. Rate: 154.3 symbols/min [2025-10-08T22:34:59.013788] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:59.025184] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-08T22:34:59.226482] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-08T22:34:59.227333] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-08T22:34:59.230877] [INFO ] [MAIN ] Derivative Progress: 207/1771 symbols completed. BEP took 1.4s. Estimated remaining: 10m 7s. Rate: 154.6 symbols/min [2025-10-08T22:34:59.231577] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:34:59.261684] [DEBUG] [LOCAL ] BFAM: Loaded 33473 existing records from primary storage. [2025-10-08T22:34:59.269560] [INFO ] [MAIN ] BFAM: Loaded 33473 primary data records. [2025-10-08T22:34:59.320792] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:59.353458] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3132 primary records. [2025-10-08T22:34:59.353597] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-08T22:34:59.427853] [DEBUG] [LOCAL ] BFH: Loaded 41446 existing records from primary storage. [2025-10-08T22:34:59.457957] [INFO ] [MAIN ] BFH: Loaded 41446 primary data records. [2025-10-08T22:34:59.503139] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-08T22:34:59.677295] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-08T22:34:59.705993] [INFO ] [MAIN ] Derivative Progress: 208/1771 symbols completed. BEPJ took 0.9s. Estimated remaining: 10m 7s. Rate: 154.4 symbols/min [2025-10-08T22:34:59.983821] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:34:59.984776] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33473 primary records. [2025-10-08T22:34:59.984994] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-08T22:35:00.001505] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-08T22:35:00.001724] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-08T22:35:00.004794] [INFO ] [MAIN ] Derivative Progress: 209/1771 symbols completed. BFAM took 1.0s. Estimated remaining: 10m 6s. Rate: 154.6 symbols/min [2025-10-08T22:35:00.019668] [DEBUG] [MAIN ] BFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:00.020278] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41446 primary records. [2025-10-08T22:35:00.020339] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-08T22:35:00.035695] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-08T22:35:00.035781] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-08T22:35:00.037812] [INFO ] [MAIN ] Derivative Progress: 210/1771 symbols completed. BFH took 0.8s. Estimated remaining: 10m 3s. Rate: 155.3 symbols/min [2025-10-08T22:35:00.038261] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:00.038358] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:00.038201] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:00.062871] [DEBUG] [LOCAL ] BFZ: Loaded 11932 existing records from primary storage. [2025-10-08T22:35:00.062553] [DEBUG] [LOCAL ] BFK: Loaded 13712 existing records from primary storage. [2025-10-08T22:35:00.063025] [INFO ] [MAIN ] BFK: Loaded 13712 primary data records. [2025-10-08T22:35:00.063119] [INFO ] [MAIN ] BFZ: Loaded 11932 primary data records. [2025-10-08T22:35:00.319615] [DEBUG] [LOCAL ] BFLY: Loaded 51825 existing records from primary storage. [2025-10-08T22:35:00.353570] [INFO ] [MAIN ] BFLY: Loaded 51825 primary data records. [2025-10-08T22:35:01.038986] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:01.039771] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:01.040675] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11932 primary records. [2025-10-08T22:35:01.041550] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-08T22:35:01.041414] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13712 primary records. [2025-10-08T22:35:01.042583] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-08T22:35:01.077004] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-08T22:35:01.077324] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-08T22:35:01.077228] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-08T22:35:01.078460] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-08T22:35:01.080945] [INFO ] [MAIN ] Derivative Progress: 211/1771 symbols completed. BFZ took 1.0s. Estimated remaining: 10m 8s. Rate: 154.0 symbols/min [2025-10-08T22:35:01.084292] [INFO ] [MAIN ] Derivative Progress: 212/1771 symbols completed. BFK took 1.0s. Estimated remaining: 10m 4s. Rate: 154.8 symbols/min [2025-10-08T22:35:01.081967] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:01.084697] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:01.100336] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:01.101201] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51825 primary records. [2025-10-08T22:35:01.101316] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-08T22:35:01.119785] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-08T22:35:01.119894] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-08T22:35:01.122725] [INFO ] [MAIN ] Derivative Progress: 213/1771 symbols completed. BFLY took 1.1s. Estimated remaining: 10m 1s. Rate: 155.4 symbols/min [2025-10-08T22:35:01.123538] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:01.144231] [DEBUG] [LOCAL ] BGB: Loaded 17893 existing records from primary storage. [2025-10-08T22:35:01.144530] [INFO ] [MAIN ] BGB: Loaded 17893 primary data records. [2025-10-08T22:35:01.241246] [DEBUG] [LOCAL ] BGH: Loaded 17188 existing records from primary storage. [2025-10-08T22:35:01.270383] [INFO ] [MAIN ] BGH: Loaded 17188 primary data records. [2025-10-08T22:35:01.449395] [DEBUG] [LOCAL ] BG: Loaded 50428 existing records from primary storage. [2025-10-08T22:35:01.595919] [INFO ] [MAIN ] BG: Loaded 50428 primary data records. [2025-10-08T22:35:02.257028] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:02.258709] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17893 primary records. [2025-10-08T22:35:02.258842] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-08T22:35:02.298198] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:02.297587] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-08T22:35:02.298403] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-08T22:35:02.301906] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17188 primary records. [2025-10-08T22:35:02.300873] [INFO ] [MAIN ] Derivative Progress: 214/1771 symbols completed. BGB took 1.2s. Estimated remaining: 10m 7s. Rate: 153.9 symbols/min [2025-10-08T22:35:02.302452] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-08T22:35:02.302357] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:02.323709] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-08T22:35:02.324021] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-08T22:35:02.326493] [INFO ] [MAIN ] Derivative Progress: 215/1771 symbols completed. BGH took 1.2s. Estimated remaining: 10m 4s. Rate: 154.6 symbols/min [2025-10-08T22:35:02.326902] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:02.346388] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:02.347532] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50428 primary records. [2025-10-08T22:35:02.347698] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-08T22:35:02.372728] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-08T22:35:02.369411] [DEBUG] [LOCAL ] BGR: Loaded 13572 existing records from primary storage. [2025-10-08T22:35:02.373036] [INFO ] [MAIN ] BGR: Loaded 13572 primary data records. [2025-10-08T22:35:02.378423] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-08T22:35:02.399740] [INFO ] [MAIN ] Derivative Progress: 216/1771 symbols completed. BG took 1.3s. Estimated remaining: 10m 1s. Rate: 155.2 symbols/min [2025-10-08T22:35:02.422210] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:02.569148] [DEBUG] [LOCAL ] BGSF: Loaded 7730 existing records from primary storage. [2025-10-08T22:35:02.637513] [INFO ] [MAIN ] BGSF: Loaded 7730 primary data records. [2025-10-08T22:35:02.782577] [DEBUG] [LOCAL ] BGS: Loaded 50497 existing records from primary storage. [2025-10-08T22:35:02.797632] [INFO ] [MAIN ] BGS: Loaded 50497 primary data records. [2025-10-08T22:35:03.494755] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:03.496287] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13572 primary records. [2025-10-08T22:35:03.496951] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-08T22:35:03.518204] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-08T22:35:03.521377] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-08T22:35:03.524542] [INFO ] [MAIN ] Derivative Progress: 217/1771 symbols completed. BGR took 1.2s. Estimated remaining: 10m 6s. Rate: 153.8 symbols/min [2025-10-08T22:35:03.524740] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:03.558723] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7728 incomplete bins [2025-10-08T22:35:03.560777] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:03.561463] [INFO ] [MAIN ] BGSF: Generated 1790 derivative records from 7730 primary records. [2025-10-08T22:35:03.561764] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-08T22:35:03.562385] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50497 primary records. [2025-10-08T22:35:03.563169] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-08T22:35:03.597186] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-08T22:35:03.599514] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-08T22:35:03.604393] [INFO ] [MAIN ] Derivative Progress: 218/1771 symbols completed. BGS took 1.3s. Estimated remaining: 10m 3s. Rate: 154.4 symbols/min [2025-10-08T22:35:03.604702] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:03.611883] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1790 records). [2025-10-08T22:35:03.612080] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-08T22:35:03.615013] [INFO ] [MAIN ] Derivative Progress: 219/1771 symbols completed. BGSF took 1.2s. Estimated remaining: 10m 0s. Rate: 155.1 symbols/min [2025-10-08T22:35:03.615212] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:03.612822] [DEBUG] [LOCAL ] BGT: Loaded 16621 existing records from primary storage. [2025-10-08T22:35:03.615972] [INFO ] [MAIN ] BGT: Loaded 16621 primary data records. [2025-10-08T22:35:03.719042] [DEBUG] [LOCAL ] BGX: Loaded 11113 existing records from primary storage. [2025-10-08T22:35:03.756519] [INFO ] [MAIN ] BGX: Loaded 11113 primary data records. [2025-10-08T22:35:03.843114] [DEBUG] [LOCAL ] BGY: Loaded 21967 existing records from primary storage. [2025-10-08T22:35:03.906757] [INFO ] [MAIN ] BGY: Loaded 21967 primary data records. [2025-10-08T22:35:04.682879] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:04.683924] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16621 primary records. [2025-10-08T22:35:04.684095] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-08T22:35:04.716975] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:04.719882] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-08T22:35:04.720843] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11113 primary records. [2025-10-08T22:35:04.721091] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-08T22:35:04.720976] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-08T22:35:04.724242] [INFO ] [MAIN ] Derivative Progress: 220/1771 symbols completed. BGT took 1.2s. Estimated remaining: 10m 5s. Rate: 153.8 symbols/min [2025-10-08T22:35:04.724619] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:04.744907] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-08T22:35:04.745308] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-08T22:35:04.747786] [INFO ] [MAIN ] Derivative Progress: 221/1771 symbols completed. BGX took 1.1s. Estimated remaining: 10m 2s. Rate: 154.5 symbols/min [2025-10-08T22:35:04.762085] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:04.761634] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:04.767505] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 21967 primary records. [2025-10-08T22:35:04.767665] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-08T22:35:04.787969] [DEBUG] [LOCAL ] BH: Loaded 16182 existing records from primary storage. [2025-10-08T22:35:04.788700] [INFO ] [MAIN ] BH: Loaded 16182 primary data records. [2025-10-08T22:35:04.914397] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-08T22:35:04.932239] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-08T22:35:04.934858] [INFO ] [MAIN ] Derivative Progress: 222/1771 symbols completed. BGY took 1.3s. Estimated remaining: 10m 0s. Rate: 154.8 symbols/min [2025-10-08T22:35:04.952373] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:05.166242] [DEBUG] [LOCAL ] BHC: Loaded 46776 existing records from primary storage. [2025-10-08T22:35:05.166494] [INFO ] [MAIN ] BHC: Loaded 46776 primary data records. [2025-10-08T22:35:05.461893] [DEBUG] [LOCAL ] BHE: Loaded 24052 existing records from primary storage. [2025-10-08T22:35:05.476282] [INFO ] [MAIN ] BHE: Loaded 24052 primary data records. [2025-10-08T22:35:05.671295] [DEBUG] [MAIN ] BH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:05.837094] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 16182 primary records. [2025-10-08T22:35:05.838221] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-10-08T22:35:05.862468] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-10-08T22:35:05.862778] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-10-08T22:35:05.875839] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:05.878442] [INFO ] [MAIN ] Derivative Progress: 223/1771 symbols completed. BH took 1.2s. Estimated remaining: 10m 4s. Rate: 153.8 symbols/min [2025-10-08T22:35:05.880213] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46776 primary records. [2025-10-08T22:35:05.880512] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-08T22:35:05.899084] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-08T22:35:05.899869] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-08T22:35:05.902154] [INFO ] [MAIN ] Derivative Progress: 224/1771 symbols completed. BHC took 1.1s. Estimated remaining: 10m 1s. Rate: 154.5 symbols/min [2025-10-08T22:35:05.914630] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:05.915275] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 24052 primary records. [2025-10-08T22:35:05.915336] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-08T22:35:05.930699] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-08T22:35:05.930768] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-08T22:35:05.932939] [INFO ] [MAIN ] Derivative Progress: 225/1771 symbols completed. BHE took 1.0s. Estimated remaining: 9m 58s. Rate: 155.1 symbols/min [2025-10-08T22:35:05.933352] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:05.933521] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:05.933451] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:05.969683] [DEBUG] [LOCAL ] BHK: Loaded 23435 existing records from primary storage. [2025-10-08T22:35:05.971111] [INFO ] [MAIN ] BHK: Loaded 23435 primary data records. [2025-10-08T22:35:05.971682] [DEBUG] [LOCAL ] BHR: Loaded 21855 existing records from primary storage. [2025-10-08T22:35:05.971864] [INFO ] [MAIN ] BHR: Loaded 21855 primary data records. [2025-10-08T22:35:06.604401] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-08T22:35:06.616092] [INFO ] [MAIN ] BHP: Loaded 53372 primary data records. [2025-10-08T22:35:07.007573] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:07.009690] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23435 primary records. [2025-10-08T22:35:07.008750] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:07.011906] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-08T22:35:07.011548] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21855 primary records. [2025-10-08T22:35:07.012062] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-08T22:35:07.042968] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-08T22:35:07.044173] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-08T22:35:07.046978] [INFO ] [MAIN ] Derivative Progress: 226/1771 symbols completed. BHR took 1.1s. Estimated remaining: 10m 3s. Rate: 153.8 symbols/min [2025-10-08T22:35:07.047780] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:07.052483] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-08T22:35:07.053358] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-08T22:35:07.055601] [INFO ] [MAIN ] Derivative Progress: 227/1771 symbols completed. BHK took 1.1s. Estimated remaining: 9m 60s. Rate: 154.5 symbols/min [2025-10-08T22:35:07.056156] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:07.093879] [DEBUG] [MAIN ] BHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:07.094787] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53372 primary records. [2025-10-08T22:35:07.094892] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-08T22:35:07.134338] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-08T22:35:07.134551] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-08T22:35:07.136715] [INFO ] [MAIN ] Derivative Progress: 228/1771 symbols completed. BHP took 1.2s. Estimated remaining: 9m 57s. Rate: 155.0 symbols/min [2025-10-08T22:35:07.137796] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:07.161024] [DEBUG] [LOCAL ] BHVN: Loaded 50190 existing records from primary storage. [2025-10-08T22:35:07.161394] [INFO ] [MAIN ] BHVN: Loaded 50190 primary data records. [2025-10-08T22:35:07.294955] [DEBUG] [LOCAL ] BILL: Loaded 52405 existing records from primary storage. [2025-10-08T22:35:07.295620] [INFO ] [MAIN ] BILL: Loaded 52405 primary data records. [2025-10-08T22:35:07.467334] [DEBUG] [LOCAL ] BIO: Loaded 24324 existing records from primary storage. [2025-10-08T22:35:07.493012] [INFO ] [MAIN ] BIO: Loaded 24324 primary data records. [2025-10-08T22:35:08.251756] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:08.253189] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50190 primary records. [2025-10-08T22:35:08.253476] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-08T22:35:08.286484] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:08.288202] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52405 primary records. [2025-10-08T22:35:08.288691] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-08T22:35:08.304738] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-08T22:35:08.305571] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-08T22:35:08.307965] [INFO ] [MAIN ] Derivative Progress: 229/1771 symbols completed. BHVN took 1.3s. Estimated remaining: 10m 2s. Rate: 153.7 symbols/min [2025-10-08T22:35:08.308378] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:08.315834] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-08T22:35:08.315952] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-08T22:35:08.318346] [INFO ] [MAIN ] Derivative Progress: 230/1771 symbols completed. BILL took 1.3s. Estimated remaining: 9m 59s. Rate: 154.3 symbols/min [2025-10-08T22:35:08.327524] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:08.333638] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:08.334608] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 24324 primary records. [2025-10-08T22:35:08.334781] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-08T22:35:08.364374] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-08T22:35:08.364613] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-08T22:35:08.367215] [INFO ] [MAIN ] Derivative Progress: 231/1771 symbols completed. BIO took 1.2s. Estimated remaining: 9m 56s. Rate: 154.9 symbols/min [2025-10-08T22:35:08.367485] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:08.410934] [DEBUG] [LOCAL ] BIP: Loaded 39333 existing records from primary storage. [2025-10-08T22:35:08.410233] [DEBUG] [LOCAL ] BIPH: Loaded 2566 existing records from primary storage. [2025-10-08T22:35:08.411154] [INFO ] [MAIN ] BIP: Loaded 39333 primary data records. [2025-10-08T22:35:08.422449] [INFO ] [MAIN ] BIPH: Loaded 2566 primary data records. [2025-10-08T22:35:08.634859] [DEBUG] [LOCAL ] BIPC: Loaded 41294 existing records from primary storage. [2025-10-08T22:35:08.662979] [INFO ] [MAIN ] BIPC: Loaded 41294 primary data records. [2025-10-08T22:35:09.441045] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:09.442103] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39333 primary records. [2025-10-08T22:35:09.442439] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-08T22:35:09.466081] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:09.469884] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2566 primary records. [2025-10-08T22:35:09.470573] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-08T22:35:09.498257] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-08T22:35:09.504109] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-08T22:35:09.506836] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-08T22:35:09.504391] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:09.506740] [INFO ] [MAIN ] Derivative Progress: 232/1771 symbols completed. BIP took 1.2s. Estimated remaining: 10m 1s. Rate: 153.6 symbols/min [2025-10-08T22:35:09.507194] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-08T22:35:09.507133] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:09.509536] [INFO ] [MAIN ] Derivative Progress: 233/1771 symbols completed. BIPH took 1.1s. Estimated remaining: 9m 58s. Rate: 154.3 symbols/min [2025-10-08T22:35:09.510731] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41294 primary records. [2025-10-08T22:35:09.511218] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-08T22:35:09.512187] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:09.531034] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-08T22:35:09.534226] [DEBUG] [LOCAL ] BIPI: Loaded 3152 existing records from primary storage. [2025-10-08T22:35:09.534419] [INFO ] [MAIN ] BIPI: Loaded 3152 primary data records. [2025-10-08T22:35:09.534548] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-08T22:35:09.539079] [INFO ] [MAIN ] Derivative Progress: 234/1771 symbols completed. BIPC took 1.2s. Estimated remaining: 9m 55s. Rate: 154.9 symbols/min [2025-10-08T22:35:09.544438] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:09.536803] [DEBUG] [LOCAL ] BIPJ: Loaded 3153 existing records from primary storage. [2025-10-08T22:35:09.566335] [INFO ] [MAIN ] BIPJ: Loaded 3153 primary data records. [2025-10-08T22:35:10.232157] [DEBUG] [LOCAL ] BIRK: Loaded 50994 existing records from primary storage. [2025-10-08T22:35:10.232783] [INFO ] [MAIN ] BIRK: Loaded 50994 primary data records. [2025-10-08T22:35:10.564704] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:10.566906] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3152 primary records. [2025-10-08T22:35:10.567032] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-08T22:35:10.565630] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:10.567959] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3153 primary records. [2025-10-08T22:35:10.568926] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-08T22:35:10.596935] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-08T22:35:10.597573] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-08T22:35:10.601312] [INFO ] [MAIN ] Derivative Progress: 235/1771 symbols completed. BIPI took 1.1s. Estimated remaining: 9m 59s. Rate: 153.8 symbols/min [2025-10-08T22:35:10.601707] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:10.604187] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-08T22:35:10.604366] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-08T22:35:10.606605] [INFO ] [MAIN ] Derivative Progress: 236/1771 symbols completed. BIPJ took 1.1s. Estimated remaining: 9m 57s. Rate: 154.4 symbols/min [2025-10-08T22:35:10.606941] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:10.637170] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:10.637980] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50994 primary records. [2025-10-08T22:35:10.638143] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-08T22:35:10.679524] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-08T22:35:10.681128] [DEBUG] [LOCAL ] BIT: Loaded 23233 existing records from primary storage. [2025-10-08T22:35:10.680750] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-08T22:35:10.683173] [INFO ] [MAIN ] Derivative Progress: 237/1771 symbols completed. BIRK took 1.1s. Estimated remaining: 9m 54s. Rate: 154.9 symbols/min [2025-10-08T22:35:10.683402] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:10.683300] [INFO ] [MAIN ] BIT: Loaded 23233 primary data records. [2025-10-08T22:35:10.874621] [DEBUG] [LOCAL ] BJ: Loaded 51508 existing records from primary storage. [2025-10-08T22:35:11.008343] [INFO ] [MAIN ] BJ: Loaded 51508 primary data records. [2025-10-08T22:35:11.167940] [DEBUG] [LOCAL ] BK: Loaded 53532 existing records from primary storage. [2025-10-08T22:35:11.184213] [INFO ] [MAIN ] BK: Loaded 53532 primary data records. [2025-10-08T22:35:11.725512] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:11.726918] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23233 primary records. [2025-10-08T22:35:11.727468] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-08T22:35:11.764639] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:11.766160] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51508 primary records. [2025-10-08T22:35:11.766296] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-08T22:35:11.765044] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-08T22:35:11.766901] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-08T22:35:11.769505] [INFO ] [MAIN ] Derivative Progress: 238/1771 symbols completed. BIT took 1.2s. Estimated remaining: 9m 58s. Rate: 153.8 symbols/min [2025-10-08T22:35:11.789123] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-08T22:35:11.789279] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-08T22:35:11.791480] [INFO ] [MAIN ] Derivative Progress: 239/1771 symbols completed. BJ took 1.2s. Estimated remaining: 9m 55s. Rate: 154.4 symbols/min [2025-10-08T22:35:11.804293] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:11.805055] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53532 primary records. [2025-10-08T22:35:11.805119] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-08T22:35:11.822184] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-08T22:35:11.822334] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-08T22:35:11.824512] [INFO ] [MAIN ] Derivative Progress: 240/1771 symbols completed. BK took 1.1s. Estimated remaining: 9m 53s. Rate: 155.0 symbols/min [2025-10-08T22:35:11.825214] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:11.825375] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:11.825491] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:11.881013] [DEBUG] [LOCAL ] BKE: Loaded 33971 existing records from primary storage. [2025-10-08T22:35:11.881195] [INFO ] [MAIN ] BKE: Loaded 33971 primary data records. [2025-10-08T22:35:12.007702] [DEBUG] [LOCAL ] BKH: Loaded 36923 existing records from primary storage. [2025-10-08T22:35:12.007958] [INFO ] [MAIN ] BKH: Loaded 36923 primary data records. [2025-10-08T22:35:12.025700] [DEBUG] [LOCAL ] BKD: Loaded 50322 existing records from primary storage. [2025-10-08T22:35:12.106605] [INFO ] [MAIN ] BKD: Loaded 50322 primary data records. [2025-10-08T22:35:12.927919] [DEBUG] [MAIN ] BKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:12.929097] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 33971 primary records. [2025-10-08T22:35:12.929231] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-08T22:35:12.959537] [DEBUG] [MAIN ] BKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:12.960635] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36923 primary records. [2025-10-08T22:35:12.961259] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-08T22:35:12.978294] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-08T22:35:12.982698] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-08T22:35:12.983570] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-08T22:35:12.987262] [INFO ] [MAIN ] Derivative Progress: 241/1771 symbols completed. BKE took 1.2s. Estimated remaining: 9m 57s. Rate: 153.7 symbols/min [2025-10-08T22:35:12.987789] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:12.987692] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-08T22:35:12.990482] [INFO ] [MAIN ] Derivative Progress: 242/1771 symbols completed. BKH took 1.2s. Estimated remaining: 9m 55s. Rate: 154.3 symbols/min [2025-10-08T22:35:12.991235] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:13.006412] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:13.007405] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50322 primary records. [2025-10-08T22:35:13.007523] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-08T22:35:13.029579] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-08T22:35:13.029957] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-08T22:35:13.032118] [INFO ] [MAIN ] Derivative Progress: 243/1771 symbols completed. BKD took 1.2s. Estimated remaining: 9m 52s. Rate: 154.9 symbols/min [2025-10-08T22:35:13.036668] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:13.037080] [DEBUG] [LOCAL ] BKN: Loaded 7681 existing records from primary storage. [2025-10-08T22:35:13.037466] [INFO ] [MAIN ] BKN: Loaded 7681 primary data records. [2025-10-08T22:35:13.190296] [DEBUG] [LOCAL ] BKKT: Loaded 35721 existing records from primary storage. [2025-10-08T22:35:13.190685] [INFO ] [MAIN ] BKKT: Loaded 35721 primary data records. [2025-10-08T22:35:13.558580] [DEBUG] [LOCAL ] BKSY: Loaded 48470 existing records from primary storage. [2025-10-08T22:35:13.570588] [INFO ] [MAIN ] BKSY: Loaded 48470 primary data records. [2025-10-08T22:35:14.170251] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:14.171749] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7681 primary records. [2025-10-08T22:35:14.172579] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-08T22:35:14.194235] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-08T22:35:14.194502] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-08T22:35:14.196936] [INFO ] [MAIN ] Derivative Progress: 244/1771 symbols completed. BKN took 1.2s. Estimated remaining: 9m 56s. Rate: 153.6 symbols/min [2025-10-08T22:35:14.197998] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:14.214698] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:14.216024] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 35721 primary records. [2025-10-08T22:35:14.216172] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-08T22:35:14.240064] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-08T22:35:14.240259] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-08T22:35:14.242895] [INFO ] [MAIN ] Derivative Progress: 245/1771 symbols completed. BKKT took 1.3s. Estimated remaining: 9m 54s. Rate: 154.2 symbols/min [2025-10-08T22:35:14.243175] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:14.257338] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:14.262445] [DEBUG] [LOCAL ] BKT: Loaded 11941 existing records from primary storage. [2025-10-08T22:35:14.263537] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48470 primary records. [2025-10-08T22:35:14.263698] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-08T22:35:14.263771] [INFO ] [MAIN ] BKT: Loaded 11941 primary data records. [2025-10-08T22:35:14.340057] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-08T22:35:14.364705] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-08T22:35:14.416773] [INFO ] [MAIN ] Derivative Progress: 246/1771 symbols completed. BKSY took 1.4s. Estimated remaining: 9m 52s. Rate: 154.5 symbols/min [2025-10-08T22:35:14.435068] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:14.503377] [DEBUG] [LOCAL ] BKU: Loaded 41680 existing records from primary storage. [2025-10-08T22:35:14.540721] [INFO ] [MAIN ] BKU: Loaded 41680 primary data records. [2025-10-08T22:35:14.858119] [DEBUG] [LOCAL ] BKV: Loaded 29885 existing records from primary storage. [2025-10-08T22:35:14.990479] [INFO ] [MAIN ] BKV: Loaded 29885 primary data records. [2025-10-08T22:35:15.323337] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:15.324570] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 11941 primary records. [2025-10-08T22:35:15.324914] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-08T22:35:15.347434] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-08T22:35:15.348028] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-08T22:35:15.350176] [INFO ] [MAIN ] Derivative Progress: 247/1771 symbols completed. BKT took 1.2s. Estimated remaining: 9m 55s. Rate: 153.6 symbols/min [2025-10-08T22:35:15.350506] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:15.364957] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:15.365776] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 41680 primary records. [2025-10-08T22:35:15.365910] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-08T22:35:15.387789] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-08T22:35:15.388094] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-08T22:35:15.390367] [INFO ] [MAIN ] Derivative Progress: 248/1771 symbols completed. BKU took 1.1s. Estimated remaining: 9m 53s. Rate: 154.2 symbols/min [2025-10-08T22:35:15.390782] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:15.430693] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:15.434866] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29885 primary records. [2025-10-08T22:35:15.436253] [DEBUG] [LOCAL ] BLCO: Loaded 35542 existing records from primary storage. [2025-10-08T22:35:15.436485] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-08T22:35:15.437017] [INFO ] [MAIN ] BLCO: Loaded 35542 primary data records. [2025-10-08T22:35:15.509992] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-08T22:35:15.510206] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-08T22:35:15.575991] [INFO ] [MAIN ] Derivative Progress: 249/1771 symbols completed. BKV took 1.1s. Estimated remaining: 9m 51s. Rate: 154.5 symbols/min [2025-10-08T22:35:15.602514] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:15.852609] [DEBUG] [LOCAL ] BLDR: Loaded 51707 existing records from primary storage. [2025-10-08T22:35:15.858190] [INFO ] [MAIN ] BLDR: Loaded 51707 primary data records. [2025-10-08T22:35:15.858573] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-08T22:35:15.858818] [INFO ] [MAIN ] BLE: Loaded 14063 primary data records. [2025-10-08T22:35:16.562345] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:16.564337] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35542 primary records. [2025-10-08T22:35:16.564595] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-08T22:35:16.583533] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-08T22:35:16.584052] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-08T22:35:16.586288] [INFO ] [MAIN ] Derivative Progress: 250/1771 symbols completed. BLCO took 1.2s. Estimated remaining: 9m 54s. Rate: 153.5 symbols/min [2025-10-08T22:35:16.586786] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:16.606710] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:16.608372] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14063 primary records. [2025-10-08T22:35:16.608711] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-08T22:35:16.623324] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:16.636517] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51707 primary records. [2025-10-08T22:35:16.637330] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-08T22:35:16.663290] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-08T22:35:16.665612] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-08T22:35:16.668388] [INFO ] [MAIN ] Derivative Progress: 251/1771 symbols completed. BLE took 1.1s. Estimated remaining: 9m 52s. Rate: 154.0 symbols/min [2025-10-08T22:35:16.668819] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:16.673094] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-08T22:35:16.682566] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-08T22:35:16.686912] [INFO ] [MAIN ] Derivative Progress: 252/1771 symbols completed. BLDR took 1.3s. Estimated remaining: 9m 49s. Rate: 154.6 symbols/min [2025-10-08T22:35:16.687202] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:16.688901] [DEBUG] [LOCAL ] BLK: Loaded 34039 existing records from primary storage. [2025-10-08T22:35:16.689028] [INFO ] [MAIN ] BLK: Loaded 34039 primary data records. [2025-10-08T22:35:16.808446] [DEBUG] [LOCAL ] BLW: Loaded 13372 existing records from primary storage. [2025-10-08T22:35:16.829918] [INFO ] [MAIN ] BLW: Loaded 13372 primary data records. [2025-10-08T22:35:17.160464] [DEBUG] [LOCAL ] BLND: Loaded 49201 existing records from primary storage. [2025-10-08T22:35:17.166540] [INFO ] [MAIN ] BLND: Loaded 49201 primary data records. [2025-10-08T22:35:17.728097] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:17.729230] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34039 primary records. [2025-10-08T22:35:17.729577] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-08T22:35:17.750867] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-08T22:35:17.751125] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-08T22:35:17.753941] [INFO ] [MAIN ] Derivative Progress: 253/1771 symbols completed. BLK took 1.2s. Estimated remaining: 9m 53s. Rate: 153.6 symbols/min [2025-10-08T22:35:17.767174] [DEBUG] [MAIN ] BLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:17.768347] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13372 primary records. [2025-10-08T22:35:17.768815] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-08T22:35:17.786248] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-08T22:35:17.786555] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-08T22:35:17.788754] [INFO ] [MAIN ] Derivative Progress: 254/1771 symbols completed. BLW took 1.1s. Estimated remaining: 9m 51s. Rate: 154.1 symbols/min [2025-10-08T22:35:17.804608] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:17.805241] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49201 primary records. [2025-10-08T22:35:17.805304] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-08T22:35:17.821477] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-08T22:35:17.821555] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-08T22:35:17.823868] [INFO ] [MAIN ] Derivative Progress: 255/1771 symbols completed. BLND took 1.2s. Estimated remaining: 9m 48s. Rate: 154.7 symbols/min [2025-10-08T22:35:17.824332] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:17.824525] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:17.824473] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:17.850957] [DEBUG] [LOCAL ] BME: Loaded 11075 existing records from primary storage. [2025-10-08T22:35:17.851328] [DEBUG] [LOCAL ] BLX: Loaded 15620 existing records from primary storage. [2025-10-08T22:35:17.851607] [INFO ] [MAIN ] BME: Loaded 11075 primary data records. [2025-10-08T22:35:17.851689] [INFO ] [MAIN ] BLX: Loaded 15620 primary data records. [2025-10-08T22:35:18.085220] [DEBUG] [LOCAL ] BMA: Loaded 35575 existing records from primary storage. [2025-10-08T22:35:18.099991] [INFO ] [MAIN ] BMA: Loaded 35575 primary data records. [2025-10-08T22:35:18.879745] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:18.886416] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15620 primary records. [2025-10-08T22:35:18.886918] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-08T22:35:18.886832] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:18.888521] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11075 primary records. [2025-10-08T22:35:18.897867] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-08T22:35:18.914802] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-08T22:35:18.928624] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-08T22:35:18.935405] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-08T22:35:18.937828] [INFO ] [MAIN ] Derivative Progress: 256/1771 symbols completed. BLX took 1.1s. Estimated remaining: 9m 52s. Rate: 153.5 symbols/min [2025-10-08T22:35:18.938517] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:18.939489] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 35575 primary records. [2025-10-08T22:35:18.939553] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-08T22:35:18.947822] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-08T22:35:18.938749] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:18.957299] [INFO ] [MAIN ] Derivative Progress: 257/1771 symbols completed. BME took 1.1s. Estimated remaining: 9m 49s. Rate: 154.1 symbols/min [2025-10-08T22:35:18.958530] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:18.963988] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-08T22:35:18.964146] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-08T22:35:18.966367] [INFO ] [MAIN ] Derivative Progress: 258/1771 symbols completed. BMA took 1.1s. Estimated remaining: 9m 47s. Rate: 154.7 symbols/min [2025-10-08T22:35:18.966569] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:18.984375] [DEBUG] [LOCAL ] BMN: Loaded 2586 existing records from primary storage. [2025-10-08T22:35:18.984555] [INFO ] [MAIN ] BMN: Loaded 2586 primary data records. [2025-10-08T22:35:19.098759] [DEBUG] [LOCAL ] BMI: Loaded 24334 existing records from primary storage. [2025-10-08T22:35:19.085426] [DEBUG] [LOCAL ] BMEZ: Loaded 26610 existing records from primary storage. [2025-10-08T22:35:19.101960] [INFO ] [MAIN ] BMI: Loaded 24334 primary data records. [2025-10-08T22:35:19.102178] [INFO ] [MAIN ] BMEZ: Loaded 26610 primary data records. [2025-10-08T22:35:19.924828] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:19.926223] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2586 primary records. [2025-10-08T22:35:19.926459] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-08T22:35:19.945377] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-08T22:35:19.964559] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-08T22:35:19.965093] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:19.967531] [INFO ] [MAIN ] Derivative Progress: 259/1771 symbols completed. BMN took 1.0s. Estimated remaining: 9m 50s. Rate: 153.8 symbols/min [2025-10-08T22:35:19.976208] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:19.968373] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24334 primary records. [2025-10-08T22:35:19.981772] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-08T22:35:19.982045] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:19.982696] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26610 primary records. [2025-10-08T22:35:19.983184] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-08T22:35:20.013763] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-08T22:35:20.015578] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-08T22:35:20.018041] [INFO ] [MAIN ] Derivative Progress: 260/1771 symbols completed. BMEZ took 1.1s. Estimated remaining: 9m 48s. Rate: 154.3 symbols/min [2025-10-08T22:35:20.015486] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-08T22:35:20.018198] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-08T22:35:20.020735] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:20.021085] [INFO ] [MAIN ] Derivative Progress: 261/1771 symbols completed. BMI took 1.1s. Estimated remaining: 9m 45s. Rate: 154.9 symbols/min [2025-10-08T22:35:20.021502] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:20.066569] [DEBUG] [LOCAL ] BMO: Loaded 41139 existing records from primary storage. [2025-10-08T22:35:20.066879] [INFO ] [MAIN ] BMO: Loaded 41139 primary data records. [2025-10-08T22:35:20.169442] [DEBUG] [LOCAL ] BNED: Loaded 29154 existing records from primary storage. [2025-10-08T22:35:20.189064] [INFO ] [MAIN ] BNED: Loaded 29154 primary data records. [2025-10-08T22:35:20.361292] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-08T22:35:20.506616] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-08T22:35:21.047259] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:21.048343] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41139 primary records. [2025-10-08T22:35:21.048636] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-08T22:35:21.069060] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-08T22:35:21.081548] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-08T22:35:21.083814] [INFO ] [MAIN ] Derivative Progress: 262/1771 symbols completed. BMO took 1.1s. Estimated remaining: 9m 49s. Rate: 153.8 symbols/min [2025-10-08T22:35:21.084237] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:21.086461] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:21.086342] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 29154 primary records. [2025-10-08T22:35:21.087035] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-08T22:35:21.108566] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:21.113084] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-08T22:35:21.113421] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-08T22:35:21.135030] [DEBUG] [LOCAL ] BNH: Loaded 5238 existing records from primary storage. [2025-10-08T22:35:21.136111] [INFO ] [MAIN ] BNH: Loaded 5238 primary data records. [2025-10-08T22:35:21.147747] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-08T22:35:21.157220] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-08T22:35:21.160083] [INFO ] [MAIN ] Derivative Progress: 263/1771 symbols completed. BNED took 1.1s. Estimated remaining: 9m 46s. Rate: 154.3 symbols/min [2025-10-08T22:35:21.160497] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:21.176607] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-08T22:35:21.176818] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-08T22:35:21.197565] [INFO ] [MAIN ] Derivative Progress: 264/1771 symbols completed. BMY took 1.2s. Estimated remaining: 9m 44s. Rate: 154.8 symbols/min [2025-10-08T22:35:21.218532] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:21.248175] [DEBUG] [LOCAL ] BNJ: Loaded 2673 existing records from primary storage. [2025-10-08T22:35:21.269202] [INFO ] [MAIN ] BNJ: Loaded 2673 primary data records. [2025-10-08T22:35:21.761112] [DEBUG] [LOCAL ] BNL: Loaded 47176 existing records from primary storage. [2025-10-08T22:35:21.761496] [INFO ] [MAIN ] BNL: Loaded 47176 primary data records. [2025-10-08T22:35:22.090524] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:22.094184] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 5238 primary records. [2025-10-08T22:35:22.094339] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-08T22:35:22.124100] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-08T22:35:22.124638] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-08T22:35:22.124458] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:22.125722] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2673 primary records. [2025-10-08T22:35:22.127844] [INFO ] [MAIN ] Derivative Progress: 265/1771 symbols completed. BNH took 1.0s. Estimated remaining: 9m 47s. Rate: 154.0 symbols/min [2025-10-08T22:35:22.128606] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-08T22:35:22.128119] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:22.149221] [DEBUG] [LOCAL ] BNT: Loaded 3347 existing records from primary storage. [2025-10-08T22:35:22.150881] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-08T22:35:22.151086] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-08T22:35:22.153502] [INFO ] [MAIN ] Derivative Progress: 266/1771 symbols completed. BNJ took 1.0s. Estimated remaining: 9m 44s. Rate: 154.6 symbols/min [2025-10-08T22:35:22.153993] [INFO ] [MAIN ] BNT: Loaded 3347 primary data records. [2025-10-08T22:35:22.153905] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:22.284020] [DEBUG] [LOCAL ] BNY: Loaded 7144 existing records from primary storage. [2025-10-08T22:35:22.274702] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:22.338916] [INFO ] [MAIN ] BNY: Loaded 7144 primary data records. [2025-10-08T22:35:22.355568] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47176 primary records. [2025-10-08T22:35:22.381892] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-08T22:35:22.710308] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-08T22:35:22.715931] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-08T22:35:22.785674] [INFO ] [MAIN ] Derivative Progress: 267/1771 symbols completed. BNL took 1.6s. Estimated remaining: 9m 45s. Rate: 154.2 symbols/min [2025-10-08T22:35:22.801790] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:22.930530] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:35:22.931337] [INFO ] [MAIN ] BNT: Generated 1793 derivative records from 3347 primary records. [2025-10-08T22:35:22.931869] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-08T22:35:22.960335] [DEBUG] [LOCAL ] BOC: Loaded 18353 existing records from primary storage. [2025-10-08T22:35:22.961162] [INFO ] [MAIN ] BOC: Loaded 18353 primary data records. [2025-10-08T22:35:22.961781] [DEBUG] [LOCAL ] BNT: Derivative data saved (1793 records). [2025-10-08T22:35:22.973212] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-08T22:35:22.995371] [INFO ] [MAIN ] Derivative Progress: 268/1771 symbols completed. BNT took 0.9s. Estimated remaining: 9m 44s. Rate: 154.5 symbols/min [2025-10-08T22:35:23.164093] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:23.189284] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7144 primary records. [2025-10-08T22:35:23.289043] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-08T22:35:23.318944] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-08T22:35:23.319561] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-08T22:35:23.321915] [INFO ] [MAIN ] Derivative Progress: 269/1771 symbols completed. BNY took 1.2s. Estimated remaining: 9m 43s. Rate: 154.6 symbols/min [2025-10-08T22:35:23.343155] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:23.344221] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18353 primary records. [2025-10-08T22:35:23.344289] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-08T22:35:23.362524] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-08T22:35:23.362676] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-08T22:35:23.365217] [INFO ] [MAIN ] Derivative Progress: 270/1771 symbols completed. BOC took 0.6s. Estimated remaining: 9m 41s. Rate: 155.1 symbols/min [2025-10-08T22:35:23.365711] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:23.366068] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:23.366751] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:23.438063] [DEBUG] [LOCAL ] BOE: Loaded 18088 existing records from primary storage. [2025-10-08T22:35:23.444927] [INFO ] [MAIN ] BOE: Loaded 18088 primary data records. [2025-10-08T22:35:23.561171] [DEBUG] [LOCAL ] BOND: Loaded 32252 existing records from primary storage. [2025-10-08T22:35:23.562237] [DEBUG] [LOCAL ] BOH: Loaded 30374 existing records from primary storage. [2025-10-08T22:35:23.577416] [INFO ] [MAIN ] BOND: Loaded 32252 primary data records. [2025-10-08T22:35:23.577313] [INFO ] [MAIN ] BOH: Loaded 30374 primary data records. [2025-10-08T22:35:24.896886] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:24.900117] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18088 primary records. [2025-10-08T22:35:24.900281] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-08T22:35:24.932324] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:24.933994] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32252 primary records. [2025-10-08T22:35:24.934968] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-08T22:35:24.963271] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:24.968168] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30374 primary records. [2025-10-08T22:35:24.970703] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-08T22:35:24.970192] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-08T22:35:24.970920] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-08T22:35:24.972978] [INFO ] [MAIN ] Derivative Progress: 271/1771 symbols completed. BOE took 1.6s. Estimated remaining: 9m 47s. Rate: 153.3 symbols/min [2025-10-08T22:35:24.975230] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:24.991187] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-08T22:35:24.996670] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-08T22:35:24.999441] [INFO ] [MAIN ] Derivative Progress: 272/1771 symbols completed. BOND took 1.6s. Estimated remaining: 9m 45s. Rate: 153.8 symbols/min [2025-10-08T22:35:25.001268] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:25.006446] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-08T22:35:25.006581] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-08T22:35:25.008936] [INFO ] [MAIN ] Derivative Progress: 273/1771 symbols completed. BOH took 1.6s. Estimated remaining: 9m 42s. Rate: 154.4 symbols/min [2025-10-08T22:35:25.009397] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:25.060265] [DEBUG] [LOCAL ] BOW: Loaded 23766 existing records from primary storage. [2025-10-08T22:35:25.060444] [INFO ] [MAIN ] BOW: Loaded 23766 primary data records. [2025-10-08T22:35:25.203504] [DEBUG] [LOCAL ] BOOT: Loaded 40139 existing records from primary storage. [2025-10-08T22:35:25.219620] [INFO ] [MAIN ] BOOT: Loaded 40139 primary data records. [2025-10-08T22:35:25.220579] [DEBUG] [LOCAL ] BORR: Loaded 51092 existing records from primary storage. [2025-10-08T22:35:25.231184] [INFO ] [MAIN ] BORR: Loaded 51092 primary data records. [2025-10-08T22:35:26.091865] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:26.092936] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23766 primary records. [2025-10-08T22:35:26.093160] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-08T22:35:26.133576] [DEBUG] [MAIN ] BORR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:26.135435] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51092 primary records. [2025-10-08T22:35:26.136187] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-08T22:35:26.138004] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-08T22:35:26.150980] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-08T22:35:26.151829] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:26.165031] [INFO ] [MAIN ] Derivative Progress: 274/1771 symbols completed. BOW took 1.2s. Estimated remaining: 9m 46s. Rate: 153.3 symbols/min [2025-10-08T22:35:26.166187] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 40139 primary records. [2025-10-08T22:35:26.166794] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:26.166592] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-08T22:35:26.188395] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-08T22:35:26.188798] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-08T22:35:26.191061] [INFO ] [MAIN ] Derivative Progress: 275/1771 symbols completed. BORR took 1.2s. Estimated remaining: 9m 44s. Rate: 153.8 symbols/min [2025-10-08T22:35:26.191682] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:26.193572] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-08T22:35:26.193783] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-08T22:35:26.196589] [INFO ] [MAIN ] Derivative Progress: 276/1771 symbols completed. BOOT took 1.2s. Estimated remaining: 9m 41s. Rate: 154.3 symbols/min [2025-10-08T22:35:26.196948] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:26.273466] [DEBUG] [LOCAL ] BOX: Loaded 50230 existing records from primary storage. [2025-10-08T22:35:26.281927] [INFO ] [MAIN ] BOX: Loaded 50230 primary data records. [2025-10-08T22:35:26.394305] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-08T22:35:26.417600] [INFO ] [MAIN ] BP: Loaded 53709 primary data records. [2025-10-08T22:35:26.418930] [DEBUG] [LOCAL ] BR: Loaded 34795 existing records from primary storage. [2025-10-08T22:35:26.424665] [INFO ] [MAIN ] BR: Loaded 34795 primary data records. [2025-10-08T22:35:27.403264] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:27.405182] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50230 primary records. [2025-10-08T22:35:27.405399] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-08T22:35:27.431828] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-08T22:35:27.444940] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:27.447143] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53709 primary records. [2025-10-08T22:35:27.448734] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-08T22:35:27.447323] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-08T22:35:27.451532] [INFO ] [MAIN ] Derivative Progress: 277/1771 symbols completed. BOX took 1.3s. Estimated remaining: 9m 45s. Rate: 153.1 symbols/min [2025-10-08T22:35:27.452625] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:27.481988] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:27.485042] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34795 primary records. [2025-10-08T22:35:27.485980] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-08T22:35:27.486091] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-08T22:35:27.487553] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-08T22:35:27.498136] [INFO ] [MAIN ] Derivative Progress: 278/1771 symbols completed. BP took 1.3s. Estimated remaining: 9m 43s. Rate: 153.6 symbols/min [2025-10-08T22:35:27.503333] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:27.509340] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-08T22:35:27.509424] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-08T22:35:27.512341] [INFO ] [MAIN ] Derivative Progress: 279/1771 symbols completed. BR took 1.3s. Estimated remaining: 9m 41s. Rate: 154.1 symbols/min [2025-10-08T22:35:27.512528] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:27.595276] [DEBUG] [LOCAL ] BRBR: Loaded 51454 existing records from primary storage. [2025-10-08T22:35:27.596338] [INFO ] [MAIN ] BRBR: Loaded 51454 primary data records. [2025-10-08T22:35:27.680458] [DEBUG] [LOCAL ] BRC: Loaded 18784 existing records from primary storage. [2025-10-08T22:35:27.702407] [DEBUG] [LOCAL ] BRCC: Loaded 40168 existing records from primary storage. [2025-10-08T22:35:27.707766] [INFO ] [MAIN ] BRC: Loaded 18784 primary data records. [2025-10-08T22:35:27.718868] [INFO ] [MAIN ] BRCC: Loaded 40168 primary data records. [2025-10-08T22:35:28.621786] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:28.623411] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51454 primary records. [2025-10-08T22:35:28.624052] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-08T22:35:28.658099] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:28.671814] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:28.673085] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18784 primary records. [2025-10-08T22:35:28.671503] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40168 primary records. [2025-10-08T22:35:28.674050] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-08T22:35:28.675785] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-08T22:35:28.676903] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-08T22:35:28.678193] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-08T22:35:28.707290] [INFO ] [MAIN ] Derivative Progress: 280/1771 symbols completed. BRBR took 1.3s. Estimated remaining: 9m 45s. Rate: 153.0 symbols/min [2025-10-08T22:35:28.708768] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:28.712094] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-08T22:35:28.713046] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-08T22:35:28.715695] [INFO ] [MAIN ] Derivative Progress: 281/1771 symbols completed. BRC took 1.2s. Estimated remaining: 9m 42s. Rate: 153.5 symbols/min [2025-10-08T22:35:28.715839] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:28.718587] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-08T22:35:28.718851] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-08T22:35:28.722728] [INFO ] [MAIN ] Derivative Progress: 282/1771 symbols completed. BRCC took 1.2s. Estimated remaining: 9m 40s. Rate: 154.1 symbols/min [2025-10-08T22:35:28.723401] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:28.739497] [DEBUG] [LOCAL ] BRT: Loaded 4995 existing records from primary storage. [2025-10-08T22:35:28.739695] [INFO ] [MAIN ] BRT: Loaded 4995 primary data records. [2025-10-08T22:35:28.901062] [DEBUG] [LOCAL ] BRSP: Loaded 36626 existing records from primary storage. [2025-10-08T22:35:28.939818] [INFO ] [MAIN ] BRSP: Loaded 36626 primary data records. [2025-10-08T22:35:29.256251] [DEBUG] [LOCAL ] BROS: Loaded 53299 existing records from primary storage. [2025-10-08T22:35:29.262529] [INFO ] [MAIN ] BROS: Loaded 53299 primary data records. [2025-10-08T22:35:29.817153] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:29.818734] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4995 primary records. [2025-10-08T22:35:29.824049] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-08T22:35:29.845238] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-08T22:35:29.847579] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-08T22:35:29.850016] [INFO ] [MAIN ] Derivative Progress: 283/1771 symbols completed. BRT took 1.1s. Estimated remaining: 9m 43s. Rate: 153.0 symbols/min [2025-10-08T22:35:29.863874] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:29.864709] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36626 primary records. [2025-10-08T22:35:29.864889] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-08T22:35:29.882935] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-08T22:35:29.895099] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-08T22:35:29.895355] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:29.896111] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53299 primary records. [2025-10-08T22:35:29.898670] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-08T22:35:29.898580] [INFO ] [MAIN ] Derivative Progress: 284/1771 symbols completed. BRSP took 1.2s. Estimated remaining: 9m 41s. Rate: 153.5 symbols/min [2025-10-08T22:35:29.914270] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-08T22:35:29.914331] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-08T22:35:29.916474] [INFO ] [MAIN ] Derivative Progress: 285/1771 symbols completed. BROS took 1.2s. Estimated remaining: 9m 39s. Rate: 154.0 symbols/min [2025-10-08T22:35:29.916980] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:29.917094] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:29.916908] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:29.961414] [DEBUG] [LOCAL ] BRW: Loaded 20738 existing records from primary storage. [2025-10-08T22:35:29.962154] [INFO ] [MAIN ] BRW: Loaded 20738 primary data records. [2025-10-08T22:35:29.962054] [DEBUG] [LOCAL ] BSAC: Loaded 32782 existing records from primary storage. [2025-10-08T22:35:29.962503] [INFO ] [MAIN ] BSAC: Loaded 32782 primary data records. [2025-10-08T22:35:30.362758] [DEBUG] [LOCAL ] BRX: Loaded 51779 existing records from primary storage. [2025-10-08T22:35:30.503546] [INFO ] [MAIN ] BRX: Loaded 51779 primary data records. [2025-10-08T22:35:30.963949] [DEBUG] [MAIN ] BSAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:30.964956] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32782 primary records. [2025-10-08T22:35:30.965064] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-08T22:35:30.979516] [DEBUG] [MAIN ] BRW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:30.980594] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 20738 primary records. [2025-10-08T22:35:30.980881] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-08T22:35:31.003559] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-08T22:35:31.003782] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-08T22:35:31.009869] [INFO ] [MAIN ] Derivative Progress: 286/1771 symbols completed. BSAC took 1.1s. Estimated remaining: 9m 42s. Rate: 153.1 symbols/min [2025-10-08T22:35:31.011286] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:31.019872] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-08T22:35:31.020213] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-08T22:35:31.022372] [INFO ] [MAIN ] Derivative Progress: 287/1771 symbols completed. BRW took 1.1s. Estimated remaining: 9m 40s. Rate: 153.6 symbols/min [2025-10-08T22:35:31.022699] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:31.036434] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:31.037228] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51779 primary records. [2025-10-08T22:35:31.037358] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-08T22:35:31.058463] [DEBUG] [LOCAL ] BSL: Loaded 8181 existing records from primary storage. [2025-10-08T22:35:31.059407] [INFO ] [MAIN ] BSL: Loaded 8181 primary data records. [2025-10-08T22:35:31.148979] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-08T22:35:31.182849] [DEBUG] [LOCAL ] BSBR: Loaded 35362 existing records from primary storage. [2025-10-08T22:35:31.183092] [INFO ] [MAIN ] BSBR: Loaded 35362 primary data records. [2025-10-08T22:35:31.178671] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-08T22:35:31.185728] [INFO ] [MAIN ] Derivative Progress: 288/1771 symbols completed. BRX took 1.3s. Estimated remaining: 9m 38s. Rate: 153.9 symbols/min [2025-10-08T22:35:31.219795] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:31.787293] [DEBUG] [LOCAL ] BSM: Loaded 32179 existing records from primary storage. [2025-10-08T22:35:31.789434] [INFO ] [MAIN ] BSM: Loaded 32179 primary data records. [2025-10-08T22:35:32.074355] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:32.136313] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8181 primary records. [2025-10-08T22:35:32.145585] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-08T22:35:32.181479] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-08T22:35:32.182248] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:32.183746] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35362 primary records. [2025-10-08T22:35:32.182910] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-08T22:35:32.186103] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-08T22:35:32.185997] [INFO ] [MAIN ] Derivative Progress: 289/1771 symbols completed. BSL took 1.2s. Estimated remaining: 9m 41s. Rate: 153.1 symbols/min [2025-10-08T22:35:32.186250] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:32.205262] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-08T22:35:32.205676] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-08T22:35:32.209497] [INFO ] [MAIN ] Derivative Progress: 290/1771 symbols completed. BSBR took 1.2s. Estimated remaining: 9m 39s. Rate: 153.6 symbols/min [2025-10-08T22:35:32.214526] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:32.227173] [DEBUG] [LOCAL ] BST: Loaded 18984 existing records from primary storage. [2025-10-08T22:35:32.227549] [INFO ] [MAIN ] BST: Loaded 18984 primary data records. [2025-10-08T22:35:32.282768] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:32.299403] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32179 primary records. [2025-10-08T22:35:32.299522] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-08T22:35:32.419378] [DEBUG] [LOCAL ] BSTZ: Loaded 24965 existing records from primary storage. [2025-10-08T22:35:32.550676] [INFO ] [MAIN ] BSTZ: Loaded 24965 primary data records. [2025-10-08T22:35:32.623220] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-08T22:35:32.631610] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-08T22:35:32.641877] [INFO ] [MAIN ] Derivative Progress: 291/1771 symbols completed. BSM took 1.4s. Estimated remaining: 9m 39s. Rate: 153.5 symbols/min [2025-10-08T22:35:32.653625] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:32.755842] [DEBUG] [LOCAL ] BTA: Loaded 5488 existing records from primary storage. [2025-10-08T22:35:32.798852] [INFO ] [MAIN ] BTA: Loaded 5488 primary data records. [2025-10-08T22:35:33.129514] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:33.256539] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18984 primary records. [2025-10-08T22:35:33.326269] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-08T22:35:33.351750] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-08T22:35:33.352344] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-08T22:35:33.354728] [INFO ] [MAIN ] Derivative Progress: 292/1771 symbols completed. BST took 1.2s. Estimated remaining: 9m 40s. Rate: 153.1 symbols/min [2025-10-08T22:35:33.355070] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:33.370187] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:33.371269] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24965 primary records. [2025-10-08T22:35:33.371601] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-08T22:35:33.392958] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-08T22:35:33.393250] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-08T22:35:33.395468] [INFO ] [MAIN ] Derivative Progress: 293/1771 symbols completed. BSTZ took 1.2s. Estimated remaining: 9m 38s. Rate: 153.5 symbols/min [2025-10-08T22:35:33.396029] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:33.406491] [DEBUG] [LOCAL ] BTCM: Loaded 16133 existing records from primary storage. [2025-10-08T22:35:33.406879] [INFO ] [MAIN ] BTCM: Loaded 16133 primary data records. [2025-10-08T22:35:33.476050] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:33.492912] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5488 primary records. [2025-10-08T22:35:33.493105] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-08T22:35:33.764879] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-08T22:35:33.765815] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-08T22:35:33.767942] [INFO ] [MAIN ] Derivative Progress: 294/1771 symbols completed. BTA took 1.1s. Estimated remaining: 9m 37s. Rate: 153.6 symbols/min [2025-10-08T22:35:33.768254] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:33.787744] [DEBUG] [LOCAL ] BTE: Loaded 52713 existing records from primary storage. [2025-10-08T22:35:33.788035] [INFO ] [MAIN ] BTE: Loaded 52713 primary data records. [2025-10-08T22:35:34.130884] [DEBUG] [MAIN ] BTCM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:35:34.132489] [DEBUG] [LOCAL ] BTI: Loaded 53576 existing records from primary storage. [2025-10-08T22:35:34.133379] [INFO ] [MAIN ] BTCM: Generated 1793 derivative records from 16133 primary records. [2025-10-08T22:35:34.133522] [INFO ] [MAIN ] BTI: Loaded 53576 primary data records. [2025-10-08T22:35:34.133678] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-10-08T22:35:34.320260] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1793 records). [2025-10-08T22:35:34.344769] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-10-08T22:35:34.466279] [INFO ] [MAIN ] Derivative Progress: 295/1771 symbols completed. BTCM took 1.1s. Estimated remaining: 9m 38s. Rate: 153.2 symbols/min [2025-10-08T22:35:34.468788] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:34.495615] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:34.500045] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52713 primary records. [2025-10-08T22:35:34.508543] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-08T22:35:34.509898] [DEBUG] [LOCAL ] BTO: Loaded 8691 existing records from primary storage. [2025-10-08T22:35:34.510848] [INFO ] [MAIN ] BTO: Loaded 8691 primary data records. [2025-10-08T22:35:34.669792] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-08T22:35:34.679993] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-08T22:35:34.685080] [INFO ] [MAIN ] Derivative Progress: 296/1771 symbols completed. BTE took 1.3s. Estimated remaining: 9m 37s. Rate: 153.4 symbols/min [2025-10-08T22:35:34.693110] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:34.840832] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:34.842218] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53576 primary records. [2025-10-08T22:35:34.842375] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-08T22:35:34.866015] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-08T22:35:34.866603] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-08T22:35:34.868911] [INFO ] [MAIN ] Derivative Progress: 297/1771 symbols completed. BTI took 1.1s. Estimated remaining: 9m 36s. Rate: 153.7 symbols/min [2025-10-08T22:35:34.869631] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:34.880523] [DEBUG] [LOCAL ] BTZ: Loaded 22689 existing records from primary storage. [2025-10-08T22:35:34.880905] [INFO ] [MAIN ] BTZ: Loaded 22689 primary data records. [2025-10-08T22:35:35.247692] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:35.262884] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8691 primary records. [2025-10-08T22:35:35.263000] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-08T22:35:35.264511] [DEBUG] [LOCAL ] BUD: Loaded 52698 existing records from primary storage. [2025-10-08T22:35:35.265343] [INFO ] [MAIN ] BUD: Loaded 52698 primary data records. [2025-10-08T22:35:35.379086] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-08T22:35:35.389915] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-08T22:35:35.392589] [INFO ] [MAIN ] Derivative Progress: 298/1771 symbols completed. BTO took 0.9s. Estimated remaining: 9m 36s. Rate: 153.5 symbols/min [2025-10-08T22:35:35.609345] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:35.610493] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22689 primary records. [2025-10-08T22:35:35.610690] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-08T22:35:35.629941] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-08T22:35:35.630135] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-08T22:35:35.633053] [INFO ] [MAIN ] Derivative Progress: 299/1771 symbols completed. BTZ took 0.9s. Estimated remaining: 9m 35s. Rate: 153.7 symbols/min [2025-10-08T22:35:35.648170] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:35.648737] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52698 primary records. [2025-10-08T22:35:35.648801] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-08T22:35:35.664002] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-08T22:35:35.664065] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-08T22:35:35.666118] [INFO ] [MAIN ] Derivative Progress: 300/1771 symbols completed. BUD took 0.8s. Estimated remaining: 9m 33s. Rate: 154.1 symbols/min [2025-10-08T22:35:35.666544] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:35.666966] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:35.666711] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:35.681208] [DEBUG] [LOCAL ] BUI: Loaded 11839 existing records from primary storage. [2025-10-08T22:35:35.681407] [INFO ] [MAIN ] BUI: Loaded 11839 primary data records. [2025-10-08T22:35:36.023165] [DEBUG] [LOCAL ] BURL: Loaded 45738 existing records from primary storage. [2025-10-08T22:35:36.023494] [INFO ] [MAIN ] BURL: Loaded 45738 primary data records. [2025-10-08T22:35:36.044799] [DEBUG] [LOCAL ] BUR: Loaded 45195 existing records from primary storage. [2025-10-08T22:35:36.067168] [INFO ] [MAIN ] BUR: Loaded 45195 primary data records. [2025-10-08T22:35:36.638388] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:36.639947] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11839 primary records. [2025-10-08T22:35:36.640515] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-08T22:35:36.665770] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-08T22:35:36.674516] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-08T22:35:36.682922] [INFO ] [MAIN ] Derivative Progress: 301/1771 symbols completed. BUI took 1.0s. Estimated remaining: 9m 35s. Rate: 153.3 symbols/min [2025-10-08T22:35:36.683499] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:36.684514] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45738 primary records. [2025-10-08T22:35:36.684675] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-08T22:35:36.685774] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:36.721896] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:36.722753] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45195 primary records. [2025-10-08T22:35:36.722904] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-08T22:35:36.721598] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-08T22:35:36.723630] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-08T22:35:36.730454] [INFO ] [MAIN ] Derivative Progress: 302/1771 symbols completed. BURL took 1.1s. Estimated remaining: 9m 33s. Rate: 153.8 symbols/min [2025-10-08T22:35:36.730963] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:36.750950] [DEBUG] [LOCAL ] BUXX: Loaded 15250 existing records from primary storage. [2025-10-08T22:35:36.752240] [INFO ] [MAIN ] BUXX: Loaded 15250 primary data records. [2025-10-08T22:35:36.787781] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-08T22:35:36.820142] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-08T22:35:36.848683] [INFO ] [MAIN ] Derivative Progress: 303/1771 symbols completed. BUR took 1.2s. Estimated remaining: 9m 31s. Rate: 154.1 symbols/min [2025-10-08T22:35:36.874860] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:37.086731] [DEBUG] [LOCAL ] BV: Loaded 38524 existing records from primary storage. [2025-10-08T22:35:37.086990] [INFO ] [MAIN ] BV: Loaded 38524 primary data records. [2025-10-08T22:35:37.353113] [DEBUG] [LOCAL ] BVN: Loaded 44059 existing records from primary storage. [2025-10-08T22:35:37.455164] [INFO ] [MAIN ] BVN: Loaded 44059 primary data records. [2025-10-08T22:35:37.668175] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:37.692619] [INFO ] [MAIN ] BUXX: Generated 1794 derivative records from 15250 primary records. [2025-10-08T22:35:37.699175] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-08T22:35:37.864688] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1794 records). [2025-10-08T22:35:37.872326] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-08T22:35:37.872969] [DEBUG] [MAIN ] BV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:37.875253] [INFO ] [MAIN ] Derivative Progress: 304/1771 symbols completed. BUXX took 1.2s. Estimated remaining: 9m 34s. Rate: 153.3 symbols/min [2025-10-08T22:35:37.876526] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38524 primary records. [2025-10-08T22:35:37.877229] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-08T22:35:37.877411] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:37.904400] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-10-08T22:35:37.904989] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-08T22:35:37.908180] [INFO ] [MAIN ] Derivative Progress: 305/1771 symbols completed. BV took 1.2s. Estimated remaining: 9m 32s. Rate: 153.8 symbols/min [2025-10-08T22:35:37.908981] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:37.926789] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:37.927481] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44059 primary records. [2025-10-08T22:35:37.927541] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-08T22:35:37.953551] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-08T22:35:37.953905] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-08T22:35:37.956213] [INFO ] [MAIN ] Derivative Progress: 306/1771 symbols completed. BVN took 1.1s. Estimated remaining: 9m 30s. Rate: 154.2 symbols/min [2025-10-08T22:35:37.956501] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:37.974638] [DEBUG] [LOCAL ] BW: Loaded 40183 existing records from primary storage. [2025-10-08T22:35:37.974899] [INFO ] [MAIN ] BW: Loaded 40183 primary data records. [2025-10-08T22:35:38.114071] [DEBUG] [LOCAL ] BWG: Loaded 12634 existing records from primary storage. [2025-10-08T22:35:38.117695] [INFO ] [MAIN ] BWG: Loaded 12634 primary data records. [2025-10-08T22:35:38.258135] [DEBUG] [LOCAL ] BWA: Loaded 52154 existing records from primary storage. [2025-10-08T22:35:38.288253] [INFO ] [MAIN ] BWA: Loaded 52154 primary data records. [2025-10-08T22:35:38.962898] [DEBUG] [MAIN ] BW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:38.964305] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40183 primary records. [2025-10-08T22:35:38.964621] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-08T22:35:38.983107] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-08T22:35:38.985607] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-08T22:35:38.988912] [INFO ] [MAIN ] Derivative Progress: 307/1771 symbols completed. BW took 1.1s. Estimated remaining: 9m 33s. Rate: 153.4 symbols/min [2025-10-08T22:35:38.989214] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:39.004068] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:39.005220] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12634 primary records. [2025-10-08T22:35:39.005704] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-08T22:35:39.024317] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-08T22:35:39.024628] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-08T22:35:39.027161] [INFO ] [MAIN ] Derivative Progress: 308/1771 symbols completed. BWG took 1.1s. Estimated remaining: 9m 31s. Rate: 153.8 symbols/min [2025-10-08T22:35:39.027599] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:39.042320] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:39.056765] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52154 primary records. [2025-10-08T22:35:39.058795] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-08T22:35:39.076628] [DEBUG] [LOCAL ] BWMX: Loaded 7690 existing records from primary storage. [2025-10-08T22:35:39.091166] [DEBUG] [LOCAL ] BWLP: Loaded 32306 existing records from primary storage. [2025-10-08T22:35:39.091278] [INFO ] [MAIN ] BWLP: Loaded 32306 primary data records. [2025-10-08T22:35:39.090598] [INFO ] [MAIN ] BWMX: Loaded 7690 primary data records. [2025-10-08T22:35:39.090454] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-08T22:35:39.091616] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-08T22:35:39.145056] [INFO ] [MAIN ] Derivative Progress: 309/1771 symbols completed. BWA took 1.2s. Estimated remaining: 9m 29s. Rate: 154.2 symbols/min [2025-10-08T22:35:39.157506] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:39.329196] [DEBUG] [LOCAL ] BWNB: Loaded 4255 existing records from primary storage. [2025-10-08T22:35:39.362044] [INFO ] [MAIN ] BWNB: Loaded 4255 primary data records. [2025-10-08T22:35:40.072431] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:40.073081] [DEBUG] [MAIN ] BWMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:40.074503] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7690 primary records. [2025-10-08T22:35:40.073921] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32306 primary records. [2025-10-08T22:35:40.074726] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-08T22:35:40.074670] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-08T22:35:40.108386] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-08T22:35:40.104609] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-08T22:35:40.109213] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-08T22:35:40.109154] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-08T22:35:40.111589] [INFO ] [MAIN ] Derivative Progress: 310/1771 symbols completed. BWMX took 1.1s. Estimated remaining: 9m 31s. Rate: 153.4 symbols/min [2025-10-08T22:35:40.113989] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:40.114143] [INFO ] [MAIN ] Derivative Progress: 311/1771 symbols completed. BWLP took 1.1s. Estimated remaining: 9m 29s. Rate: 153.9 symbols/min [2025-10-08T22:35:40.114466] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:40.128667] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:40.131126] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4255 primary records. [2025-10-08T22:35:40.131326] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-08T22:35:40.146146] [DEBUG] [LOCAL ] BWSN: Loaded 5147 existing records from primary storage. [2025-10-08T22:35:40.147001] [INFO ] [MAIN ] BWSN: Loaded 5147 primary data records. [2025-10-08T22:35:40.253987] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-08T22:35:40.254183] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-08T22:35:40.266971] [INFO ] [MAIN ] Derivative Progress: 312/1771 symbols completed. BWNB took 1.1s. Estimated remaining: 9m 28s. Rate: 154.2 symbols/min [2025-10-08T22:35:40.279136] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:40.485021] [DEBUG] [LOCAL ] BWXT: Loaded 46822 existing records from primary storage. [2025-10-08T22:35:40.485765] [INFO ] [MAIN ] BWXT: Loaded 46822 primary data records. [2025-10-08T22:35:40.837546] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-08T22:35:40.838585] [INFO ] [MAIN ] BX: Loaded 53479 primary data records. [2025-10-08T22:35:40.959237] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:40.988497] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5147 primary records. [2025-10-08T22:35:40.988992] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-08T22:35:41.082137] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-08T22:35:41.086090] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-08T22:35:41.224197] [INFO ] [MAIN ] Derivative Progress: 313/1771 symbols completed. BWSN took 1.1s. Estimated remaining: 9m 30s. Rate: 153.5 symbols/min [2025-10-08T22:35:41.272363] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:41.273487] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46822 primary records. [2025-10-08T22:35:41.273921] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-08T22:35:41.291755] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-08T22:35:41.291897] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-08T22:35:41.294963] [INFO ] [MAIN ] Derivative Progress: 314/1771 symbols completed. BWXT took 1.2s. Estimated remaining: 9m 28s. Rate: 153.9 symbols/min [2025-10-08T22:35:41.313112] [DEBUG] [MAIN ] BX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:41.313698] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53479 primary records. [2025-10-08T22:35:41.313762] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-08T22:35:41.329668] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-08T22:35:41.329737] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-08T22:35:41.331839] [INFO ] [MAIN ] Derivative Progress: 315/1771 symbols completed. BX took 1.1s. Estimated remaining: 9m 26s. Rate: 154.4 symbols/min [2025-10-08T22:35:41.332216] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:41.332325] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:41.332678] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:41.352546] [DEBUG] [LOCAL ] BXC: Loaded 13686 existing records from primary storage. [2025-10-08T22:35:41.352783] [INFO ] [MAIN ] BXC: Loaded 13686 primary data records. [2025-10-08T22:35:41.431378] [DEBUG] [LOCAL ] BXMX: Loaded 19532 existing records from primary storage. [2025-10-08T22:35:41.453613] [INFO ] [MAIN ] BXMX: Loaded 19532 primary data records. [2025-10-08T22:35:41.813762] [DEBUG] [LOCAL ] BXMT: Loaded 47172 existing records from primary storage. [2025-10-08T22:35:41.836187] [INFO ] [MAIN ] BXMT: Loaded 47172 primary data records. [2025-10-08T22:35:42.379317] [DEBUG] [MAIN ] BXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:42.380598] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13686 primary records. [2025-10-08T22:35:42.381030] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-08T22:35:42.413036] [DEBUG] [MAIN ] BXMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:42.414409] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19532 primary records. [2025-10-08T22:35:42.414564] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-08T22:35:42.416299] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-08T22:35:42.416417] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-08T22:35:42.418790] [INFO ] [MAIN ] Derivative Progress: 316/1771 symbols completed. BXC took 1.1s. Estimated remaining: 9m 29s. Rate: 153.5 symbols/min [2025-10-08T22:35:42.430297] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:42.435705] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-08T22:35:42.435920] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-08T22:35:42.438200] [INFO ] [MAIN ] Derivative Progress: 317/1771 symbols completed. BXMX took 1.1s. Estimated remaining: 9m 27s. Rate: 154.0 symbols/min [2025-10-08T22:35:42.438589] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:42.461979] [DEBUG] [MAIN ] BXMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:42.462979] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47172 primary records. [2025-10-08T22:35:42.463230] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-08T22:35:42.481824] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-08T22:35:42.482078] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-08T22:35:42.484565] [INFO ] [MAIN ] Derivative Progress: 318/1771 symbols completed. BXMT took 1.2s. Estimated remaining: 9m 25s. Rate: 154.4 symbols/min [2025-10-08T22:35:42.484842] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:42.542874] [DEBUG] [LOCAL ] BXP: Loaded 49803 existing records from primary storage. [2025-10-08T22:35:42.544062] [INFO ] [MAIN ] BXP: Loaded 49803 primary data records. [2025-10-08T22:35:42.575284] [DEBUG] [LOCAL ] BXSL: Loaded 47831 existing records from primary storage. [2025-10-08T22:35:42.623730] [DEBUG] [LOCAL ] BY: Loaded 21660 existing records from primary storage. [2025-10-08T22:35:42.623309] [INFO ] [MAIN ] BXSL: Loaded 47831 primary data records. [2025-10-08T22:35:42.635376] [INFO ] [MAIN ] BY: Loaded 21660 primary data records. [2025-10-08T22:35:43.532491] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:43.533436] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49803 primary records. [2025-10-08T22:35:43.533569] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-08T22:35:43.579090] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:43.578773] [DEBUG] [MAIN ] BXSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:43.581194] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47831 primary records. [2025-10-08T22:35:43.580196] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21660 primary records. [2025-10-08T22:35:43.581337] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-08T22:35:43.582222] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-08T22:35:43.608768] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-08T22:35:43.609847] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-08T22:35:43.611973] [INFO ] [MAIN ] Derivative Progress: 319/1771 symbols completed. BXP took 1.2s. Estimated remaining: 9m 28s. Rate: 153.5 symbols/min [2025-10-08T22:35:43.612791] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:43.618813] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-08T22:35:43.619522] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-08T22:35:43.622246] [INFO ] [MAIN ] Derivative Progress: 320/1771 symbols completed. BY took 1.1s. Estimated remaining: 9m 26s. Rate: 153.9 symbols/min [2025-10-08T22:35:43.622733] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:43.624118] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-08T22:35:43.624379] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-08T22:35:43.626747] [INFO ] [MAIN ] Derivative Progress: 321/1771 symbols completed. BXSL took 1.2s. Estimated remaining: 9m 23s. Rate: 154.4 symbols/min [2025-10-08T22:35:43.627260] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:43.637180] [DEBUG] [LOCAL ] BYM: Loaded 11961 existing records from primary storage. [2025-10-08T22:35:43.637474] [INFO ] [MAIN ] BYM: Loaded 11961 primary data records. [2025-10-08T22:35:43.834035] [DEBUG] [LOCAL ] BZH: Loaded 32393 existing records from primary storage. [2025-10-08T22:35:43.836789] [INFO ] [MAIN ] BZH: Loaded 32393 primary data records. [2025-10-08T22:35:44.091954] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-08T22:35:44.101436] [INFO ] [MAIN ] C: Loaded 53740 primary data records. [2025-10-08T22:35:44.656526] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:44.657773] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11961 primary records. [2025-10-08T22:35:44.657963] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-08T22:35:44.679536] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-08T22:35:44.680029] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-08T22:35:44.682426] [INFO ] [MAIN ] Derivative Progress: 322/1771 symbols completed. BYM took 1.1s. Estimated remaining: 9m 26s. Rate: 153.6 symbols/min [2025-10-08T22:35:44.682983] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:44.699499] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:44.700392] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32393 primary records. [2025-10-08T22:35:44.700557] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-08T22:35:44.723286] [DEBUG] [MAIN ] C: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:44.732295] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53740 primary records. [2025-10-08T22:35:44.732434] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-08T22:35:44.737516] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-08T22:35:44.755680] [DEBUG] [LOCAL ] CAAP: Loaded 19804 existing records from primary storage. [2025-10-08T22:35:44.743104] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-08T22:35:44.757762] [INFO ] [MAIN ] Derivative Progress: 323/1771 symbols completed. BZH took 1.1s. Estimated remaining: 9m 24s. Rate: 154.0 symbols/min [2025-10-08T22:35:44.758148] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:44.758940] [INFO ] [MAIN ] CAAP: Loaded 19804 primary data records. [2025-10-08T22:35:44.834155] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-08T22:35:44.849206] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-08T22:35:44.856667] [INFO ] [MAIN ] Derivative Progress: 324/1771 symbols completed. C took 1.2s. Estimated remaining: 9m 23s. Rate: 154.3 symbols/min [2025-10-08T22:35:44.870334] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:44.922227] [DEBUG] [LOCAL ] CABO: Loaded 16872 existing records from primary storage. [2025-10-08T22:35:44.957164] [INFO ] [MAIN ] CABO: Loaded 16872 primary data records. [2025-10-08T22:35:45.203937] [DEBUG] [LOCAL ] CACI: Loaded 23827 existing records from primary storage. [2025-10-08T22:35:45.252203] [INFO ] [MAIN ] CACI: Loaded 23827 primary data records. [2025-10-08T22:35:45.694209] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:45.713679] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19804 primary records. [2025-10-08T22:35:45.719994] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-08T22:35:45.877563] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-08T22:35:45.878312] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-08T22:35:45.880342] [INFO ] [MAIN ] Derivative Progress: 325/1771 symbols completed. CAAP took 1.2s. Estimated remaining: 9m 25s. Rate: 153.6 symbols/min [2025-10-08T22:35:45.880531] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:45.899603] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:45.900502] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16872 primary records. [2025-10-08T22:35:45.900770] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-08T22:35:45.918405] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-08T22:35:45.918630] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-08T22:35:45.920902] [INFO ] [MAIN ] Derivative Progress: 326/1771 symbols completed. CABO took 1.2s. Estimated remaining: 9m 23s. Rate: 154.0 symbols/min [2025-10-08T22:35:45.921472] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:45.953170] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:45.954287] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 23827 primary records. [2025-10-08T22:35:45.954508] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-08T22:35:45.974940] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-08T22:35:45.989704] [DEBUG] [LOCAL ] CADE: Loaded 49166 existing records from primary storage. [2025-10-08T22:35:45.998065] [INFO ] [MAIN ] CADE: Loaded 49166 primary data records. [2025-10-08T22:35:45.988681] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-08T22:35:46.000313] [INFO ] [MAIN ] Derivative Progress: 327/1771 symbols completed. CACI took 1.1s. Estimated remaining: 9m 21s. Rate: 154.4 symbols/min [2025-10-08T22:35:46.000721] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:46.103520] [DEBUG] [LOCAL ] CAF: Loaded 3399 existing records from primary storage. [2025-10-08T22:35:46.153155] [INFO ] [MAIN ] CAF: Loaded 3399 primary data records. [2025-10-08T22:35:46.176137] [DEBUG] [LOCAL ] CAE: Loaded 39208 existing records from primary storage. [2025-10-08T22:35:46.235440] [INFO ] [MAIN ] CAE: Loaded 39208 primary data records. [2025-10-08T22:35:46.969319] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:46.970174] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49166 primary records. [2025-10-08T22:35:46.970356] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-08T22:35:46.990828] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-08T22:35:46.992330] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-08T22:35:46.994843] [INFO ] [MAIN ] Derivative Progress: 328/1771 symbols completed. CADE took 1.1s. Estimated remaining: 9m 24s. Rate: 153.6 symbols/min [2025-10-08T22:35:47.008148] [DEBUG] [MAIN ] CAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:47.008877] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3399 primary records. [2025-10-08T22:35:47.008964] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-08T22:35:47.025912] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-08T22:35:47.026037] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-08T22:35:47.028317] [INFO ] [MAIN ] Derivative Progress: 329/1771 symbols completed. CAF took 1.0s. Estimated remaining: 9m 22s. Rate: 154.1 symbols/min [2025-10-08T22:35:47.040944] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:47.041604] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39208 primary records. [2025-10-08T22:35:47.041703] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-08T22:35:47.057201] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-08T22:35:47.057259] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-08T22:35:47.060322] [INFO ] [MAIN ] Derivative Progress: 330/1771 symbols completed. CAE took 1.1s. Estimated remaining: 9m 20s. Rate: 154.5 symbols/min [2025-10-08T22:35:47.060828] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:47.060948] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:47.061576] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:47.138727] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-08T22:35:47.151085] [INFO ] [MAIN ] CAG: Loaded 53664 primary data records. [2025-10-08T22:35:47.151851] [DEBUG] [LOCAL ] CAL: Loaded 43047 existing records from primary storage. [2025-10-08T22:35:47.165215] [INFO ] [MAIN ] CAL: Loaded 43047 primary data records. [2025-10-08T22:35:47.227914] [DEBUG] [LOCAL ] CAH: Loaded 51469 existing records from primary storage. [2025-10-08T22:35:47.264279] [INFO ] [MAIN ] CAH: Loaded 51469 primary data records. [2025-10-08T22:35:48.127500] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:48.129105] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53664 primary records. [2025-10-08T22:35:48.129822] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-08T22:35:48.159693] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-08T22:35:48.159859] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-08T22:35:48.161769] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:48.162687] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43047 primary records. [2025-10-08T22:35:48.165915] [INFO ] [MAIN ] Derivative Progress: 331/1771 symbols completed. CAG took 1.1s. Estimated remaining: 9m 22s. Rate: 153.6 symbols/min [2025-10-08T22:35:48.166180] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:48.166857] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-08T22:35:48.188457] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:48.192999] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51469 primary records. [2025-10-08T22:35:48.193168] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-08T22:35:48.212821] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-08T22:35:48.213379] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-08T22:35:48.216677] [INFO ] [MAIN ] Derivative Progress: 332/1771 symbols completed. CAL took 1.2s. Estimated remaining: 9m 21s. Rate: 154.0 symbols/min [2025-10-08T22:35:48.217347] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:48.218933] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-08T22:35:48.219038] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-08T22:35:48.226753] [INFO ] [MAIN ] Derivative Progress: 333/1771 symbols completed. CAH took 1.2s. Estimated remaining: 9m 18s. Rate: 154.5 symbols/min [2025-10-08T22:35:48.227026] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:48.252735] [DEBUG] [LOCAL ] CAPL: Loaded 5700 existing records from primary storage. [2025-10-08T22:35:48.264338] [INFO ] [MAIN ] CAPL: Loaded 5700 primary data records. [2025-10-08T22:35:48.265013] [DEBUG] [LOCAL ] CALX: Loaded 37736 existing records from primary storage. [2025-10-08T22:35:48.276506] [INFO ] [MAIN ] CALX: Loaded 37736 primary data records. [2025-10-08T22:35:48.445635] [DEBUG] [LOCAL ] CANG: Loaded 26953 existing records from primary storage. [2025-10-08T22:35:48.478697] [INFO ] [MAIN ] CANG: Loaded 26953 primary data records. [2025-10-08T22:35:49.231203] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:49.233139] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5700 primary records. [2025-10-08T22:35:49.233402] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-08T22:35:49.261579] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:49.263724] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37736 primary records. [2025-10-08T22:35:49.265571] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-08T22:35:49.297386] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:49.297826] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-08T22:35:49.299674] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26953 primary records. [2025-10-08T22:35:49.300107] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-08T22:35:49.300637] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-08T22:35:49.301261] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-08T22:35:49.303717] [INFO ] [MAIN ] Derivative Progress: 334/1771 symbols completed. CAPL took 1.1s. Estimated remaining: 9m 21s. Rate: 153.7 symbols/min [2025-10-08T22:35:49.301608] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-08T22:35:49.311444] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:49.317837] [INFO ] [MAIN ] Derivative Progress: 335/1771 symbols completed. CALX took 1.2s. Estimated remaining: 9m 19s. Rate: 154.1 symbols/min [2025-10-08T22:35:49.318232] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:49.324237] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-08T22:35:49.324416] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-08T22:35:49.327292] [INFO ] [MAIN ] Derivative Progress: 336/1771 symbols completed. CANG took 1.1s. Estimated remaining: 9m 17s. Rate: 154.6 symbols/min [2025-10-08T22:35:49.327631] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:49.397572] [DEBUG] [LOCAL ] CARS: Loaded 39698 existing records from primary storage. [2025-10-08T22:35:49.412111] [INFO ] [MAIN ] CARS: Loaded 39698 primary data records. [2025-10-08T22:35:49.426223] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-08T22:35:49.452716] [INFO ] [MAIN ] CARR: Loaded 53597 primary data records. [2025-10-08T22:35:49.575587] [DEBUG] [LOCAL ] CAT: Loaded 52918 existing records from primary storage. [2025-10-08T22:35:49.619487] [INFO ] [MAIN ] CAT: Loaded 52918 primary data records. [2025-10-08T22:35:50.419041] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:50.422461] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39698 primary records. [2025-10-08T22:35:50.422843] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-08T22:35:50.451320] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:50.453385] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53597 primary records. [2025-10-08T22:35:50.453695] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-08T22:35:50.480150] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:50.481247] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52918 primary records. [2025-10-08T22:35:50.481520] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-08T22:35:50.486757] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-08T22:35:50.487075] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-08T22:35:50.489386] [INFO ] [MAIN ] Derivative Progress: 337/1771 symbols completed. CARR took 1.2s. Estimated remaining: 9m 20s. Rate: 153.7 symbols/min [2025-10-08T22:35:50.490169] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:50.490362] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-08T22:35:50.497789] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-08T22:35:50.503684] [INFO ] [MAIN ] Derivative Progress: 338/1771 symbols completed. CARS took 1.2s. Estimated remaining: 9m 18s. Rate: 154.1 symbols/min [2025-10-08T22:35:50.503944] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:50.509572] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-08T22:35:50.511359] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-08T22:35:50.513791] [INFO ] [MAIN ] Derivative Progress: 339/1771 symbols completed. CAT took 1.2s. Estimated remaining: 9m 16s. Rate: 154.5 symbols/min [2025-10-08T22:35:50.514307] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:50.518807] [DEBUG] [LOCAL ] CATO: Loaded 6871 existing records from primary storage. [2025-10-08T22:35:50.519574] [INFO ] [MAIN ] CATO: Loaded 6871 primary data records. [2025-10-08T22:35:50.879444] [DEBUG] [LOCAL ] CAVA: Loaded 53555 existing records from primary storage. [2025-10-08T22:35:50.880151] [INFO ] [MAIN ] CAVA: Loaded 53555 primary data records. [2025-10-08T22:35:51.002961] [DEBUG] [LOCAL ] CB: Loaded 49934 existing records from primary storage. [2025-10-08T22:35:51.003710] [INFO ] [MAIN ] CB: Loaded 49934 primary data records. [2025-10-08T22:35:51.592537] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:51.594563] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6871 primary records. [2025-10-08T22:35:51.594822] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-08T22:35:51.618395] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-08T22:35:51.618805] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-08T22:35:51.621132] [INFO ] [MAIN ] Derivative Progress: 340/1771 symbols completed. CATO took 1.1s. Estimated remaining: 9m 19s. Rate: 153.7 symbols/min [2025-10-08T22:35:51.621314] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:51.643202] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:51.644497] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53555 primary records. [2025-10-08T22:35:51.644719] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-08T22:35:51.652873] [DEBUG] [LOCAL ] CBAN: Loaded 10649 existing records from primary storage. [2025-10-08T22:35:51.664254] [INFO ] [MAIN ] CBAN: Loaded 10649 primary data records. [2025-10-08T22:35:51.683421] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-08T22:35:51.688750] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-08T22:35:51.706999] [INFO ] [MAIN ] Derivative Progress: 341/1771 symbols completed. CAVA took 1.2s. Estimated remaining: 9m 17s. Rate: 154.1 symbols/min [2025-10-08T22:35:51.723464] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:51.775755] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:51.810679] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49934 primary records. [2025-10-08T22:35:51.822099] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-08T22:35:51.888417] [DEBUG] [LOCAL ] CBL: Loaded 16262 existing records from primary storage. [2025-10-08T22:35:51.932064] [INFO ] [MAIN ] CBL: Loaded 16262 primary data records. [2025-10-08T22:35:52.099702] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-08T22:35:52.139716] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-08T22:35:52.156878] [INFO ] [MAIN ] Derivative Progress: 342/1771 symbols completed. CB took 1.6s. Estimated remaining: 9m 17s. Rate: 154.0 symbols/min [2025-10-08T22:35:52.181747] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:52.397350] [DEBUG] [LOCAL ] CBNA: Loaded 2896 existing records from primary storage. [2025-10-08T22:35:52.398430] [INFO ] [MAIN ] CBNA: Loaded 2896 primary data records. [2025-10-08T22:35:52.784179] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:52.786353] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10649 primary records. [2025-10-08T22:35:52.786723] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-08T22:35:52.813538] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:52.818378] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16262 primary records. [2025-10-08T22:35:52.818862] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-08T22:35:52.824696] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-08T22:35:52.824976] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-08T22:35:52.830202] [INFO ] [MAIN ] Derivative Progress: 343/1771 symbols completed. CBAN took 1.2s. Estimated remaining: 9m 18s. Rate: 153.7 symbols/min [2025-10-08T22:35:52.850348] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-08T22:35:52.850837] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-08T22:35:52.853322] [INFO ] [MAIN ] Derivative Progress: 344/1771 symbols completed. CBL took 1.1s. Estimated remaining: 9m 16s. Rate: 154.1 symbols/min [2025-10-08T22:35:52.873284] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:52.874226] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2896 primary records. [2025-10-08T22:35:52.874296] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-08T22:35:52.889215] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-08T22:35:52.889307] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-08T22:35:52.892231] [INFO ] [MAIN ] Derivative Progress: 345/1771 symbols completed. CBNA took 0.7s. Estimated remaining: 9m 14s. Rate: 154.5 symbols/min [2025-10-08T22:35:52.893068] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:52.892988] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:52.892888] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:52.971160] [DEBUG] [LOCAL ] CBU: Loaded 22520 existing records from primary storage. [2025-10-08T22:35:52.973367] [INFO ] [MAIN ] CBU: Loaded 22520 primary data records. [2025-10-08T22:35:52.997515] [DEBUG] [LOCAL ] CBT: Loaded 30800 existing records from primary storage. [2025-10-08T22:35:52.980152] [DEBUG] [LOCAL ] CBZ: Loaded 34023 existing records from primary storage. [2025-10-08T22:35:53.014047] [INFO ] [MAIN ] CBT: Loaded 30800 primary data records. [2025-10-08T22:35:53.048363] [INFO ] [MAIN ] CBZ: Loaded 34023 primary data records. [2025-10-08T22:35:54.101822] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:54.103798] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22520 primary records. [2025-10-08T22:35:54.104613] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-08T22:35:54.134861] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-08T22:35:54.135677] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-08T22:35:54.135552] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:54.138500] [INFO ] [MAIN ] Derivative Progress: 346/1771 symbols completed. CBU took 1.2s. Estimated remaining: 9m 17s. Rate: 153.5 symbols/min [2025-10-08T22:35:54.139613] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30800 primary records. [2025-10-08T22:35:54.139881] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-08T22:35:54.140015] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:54.173969] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:54.175661] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 34023 primary records. [2025-10-08T22:35:54.174796] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-08T22:35:54.175893] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-08T22:35:54.176010] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-08T22:35:54.178467] [INFO ] [MAIN ] Derivative Progress: 347/1771 symbols completed. CBT took 1.3s. Estimated remaining: 9m 15s. Rate: 153.9 symbols/min [2025-10-08T22:35:54.179429] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:54.197036] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-08T22:35:54.197249] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-08T22:35:54.199856] [INFO ] [MAIN ] Derivative Progress: 348/1771 symbols completed. CBZ took 1.3s. Estimated remaining: 9m 13s. Rate: 154.3 symbols/min [2025-10-08T22:35:54.200156] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:54.243599] [DEBUG] [LOCAL ] CCIF: Loaded 15666 existing records from primary storage. [2025-10-08T22:35:54.259331] [INFO ] [MAIN ] CCIF: Loaded 15666 primary data records. [2025-10-08T22:35:54.281906] [DEBUG] [LOCAL ] CC: Loaded 52993 existing records from primary storage. [2025-10-08T22:35:54.304139] [INFO ] [MAIN ] CC: Loaded 52993 primary data records. [2025-10-08T22:35:54.456814] [DEBUG] [LOCAL ] CCI: Loaded 53132 existing records from primary storage. [2025-10-08T22:35:54.483945] [INFO ] [MAIN ] CCI: Loaded 53132 primary data records. [2025-10-08T22:35:55.216615] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:55.230844] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15666 primary records. [2025-10-08T22:35:55.231257] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-08T22:35:55.231579] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:55.232580] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 52993 primary records. [2025-10-08T22:35:55.233038] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-08T22:35:55.286305] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:55.290459] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-08T22:35:55.290136] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53132 primary records. [2025-10-08T22:35:55.291183] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-08T22:35:55.291557] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-08T22:35:55.292562] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-08T22:35:55.290846] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-08T22:35:55.294555] [INFO ] [MAIN ] Derivative Progress: 349/1771 symbols completed. CCIF took 1.1s. Estimated remaining: 9m 16s. Rate: 153.5 symbols/min [2025-10-08T22:35:55.305904] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:55.308772] [INFO ] [MAIN ] Derivative Progress: 350/1771 symbols completed. CC took 1.2s. Estimated remaining: 9m 14s. Rate: 153.9 symbols/min [2025-10-08T22:35:55.309461] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:55.315900] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-08T22:35:55.316115] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-08T22:35:55.318584] [INFO ] [MAIN ] Derivative Progress: 351/1771 symbols completed. CCI took 1.1s. Estimated remaining: 9m 12s. Rate: 154.4 symbols/min [2025-10-08T22:35:55.319009] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:55.406575] [DEBUG] [LOCAL ] CCK: Loaded 46300 existing records from primary storage. [2025-10-08T22:35:55.407264] [INFO ] [MAIN ] CCK: Loaded 46300 primary data records. [2025-10-08T22:35:55.408238] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-10-08T22:35:55.442311] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-10-08T22:35:55.547920] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-08T22:35:55.590168] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-08T22:35:56.466849] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:56.468075] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46300 primary records. [2025-10-08T22:35:56.468465] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-08T22:35:56.491060] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:56.495727] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-10-08T22:35:56.499102] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-08T22:35:56.501311] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-08T22:35:56.501539] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-08T22:35:56.503597] [INFO ] [MAIN ] Derivative Progress: 352/1771 symbols completed. CCK took 1.2s. Estimated remaining: 9m 15s. Rate: 153.5 symbols/min [2025-10-08T22:35:56.512295] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:56.537777] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-08T22:35:56.538507] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:56.538588] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-08T22:35:56.541042] [INFO ] [MAIN ] Derivative Progress: 353/1771 symbols completed. CCJ took 1.2s. Estimated remaining: 9m 13s. Rate: 153.9 symbols/min [2025-10-08T22:35:56.541201] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:56.543629] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-08T22:35:56.544206] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-08T22:35:56.575789] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-08T22:35:56.576094] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-08T22:35:56.578618] [INFO ] [MAIN ] Derivative Progress: 354/1771 symbols completed. CCL took 1.3s. Estimated remaining: 9m 11s. Rate: 154.3 symbols/min [2025-10-08T22:35:56.579081] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:56.584799] [DEBUG] [LOCAL ] CCRD: Loaded 9219 existing records from primary storage. [2025-10-08T22:35:56.585009] [INFO ] [MAIN ] CCRD: Loaded 9219 primary data records. [2025-10-08T22:35:56.698688] [DEBUG] [LOCAL ] CCO: Loaded 48014 existing records from primary storage. [2025-10-08T22:35:56.718782] [INFO ] [MAIN ] CCO: Loaded 48014 primary data records. [2025-10-08T22:35:57.054926] [DEBUG] [LOCAL ] CCS: Loaded 30228 existing records from primary storage. [2025-10-08T22:35:57.070408] [INFO ] [MAIN ] CCS: Loaded 30228 primary data records. [2025-10-08T22:35:57.609632] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:35:57.611161] [INFO ] [MAIN ] CCRD: Generated 1792 derivative records from 9219 primary records. [2025-10-08T22:35:57.611693] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-08T22:35:57.646750] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:57.647466] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1792 records). [2025-10-08T22:35:57.648725] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48014 primary records. [2025-10-08T22:35:57.647707] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-08T22:35:57.654552] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-08T22:35:57.654461] [INFO ] [MAIN ] Derivative Progress: 355/1771 symbols completed. CCRD took 1.1s. Estimated remaining: 9m 13s. Rate: 153.5 symbols/min [2025-10-08T22:35:57.655878] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:57.690145] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-08T22:35:57.690580] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-08T22:35:57.690510] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:57.691360] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30228 primary records. [2025-10-08T22:35:57.693610] [INFO ] [MAIN ] Derivative Progress: 356/1771 symbols completed. CCO took 1.2s. Estimated remaining: 9m 12s. Rate: 153.9 symbols/min [2025-10-08T22:35:57.693919] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:57.694397] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-08T22:35:57.716638] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-08T22:35:57.716873] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-08T22:35:57.719427] [INFO ] [MAIN ] Derivative Progress: 357/1771 symbols completed. CCS took 1.1s. Estimated remaining: 9m 10s. Rate: 154.3 symbols/min [2025-10-08T22:35:57.719798] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:57.728700] [DEBUG] [LOCAL ] CCU: Loaded 22832 existing records from primary storage. [2025-10-08T22:35:57.728845] [INFO ] [MAIN ] CCU: Loaded 22832 primary data records. [2025-10-08T22:35:57.806611] [DEBUG] [LOCAL ] CDLR: Loaded 9863 existing records from primary storage. [2025-10-08T22:35:57.863154] [INFO ] [MAIN ] CDLR: Loaded 9863 primary data records. [2025-10-08T22:35:58.197305] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-08T22:35:58.198617] [INFO ] [MAIN ] CDE: Loaded 53642 primary data records. [2025-10-08T22:35:58.737904] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:58.740956] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 22832 primary records. [2025-10-08T22:35:58.741311] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-08T22:35:58.766742] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:58.767969] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 9863 primary records. [2025-10-08T22:35:58.770252] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-08T22:35:58.773482] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-08T22:35:58.782255] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-08T22:35:58.790682] [INFO ] [MAIN ] Derivative Progress: 358/1771 symbols completed. CCU took 1.1s. Estimated remaining: 9m 12s. Rate: 153.5 symbols/min [2025-10-08T22:35:58.793381] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-08T22:35:58.805898] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-08T22:35:58.808386] [INFO ] [MAIN ] Derivative Progress: 359/1771 symbols completed. CDLR took 1.1s. Estimated remaining: 9m 10s. Rate: 154.0 symbols/min [2025-10-08T22:35:58.806249] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:58.809396] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53642 primary records. [2025-10-08T22:35:58.809514] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-08T22:35:58.824697] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-08T22:35:58.824765] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-08T22:35:58.827280] [INFO ] [MAIN ] Derivative Progress: 360/1771 symbols completed. CDE took 1.1s. Estimated remaining: 9m 8s. Rate: 154.4 symbols/min [2025-10-08T22:35:58.827740] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:58.827850] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:58.827675] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:35:58.858821] [DEBUG] [LOCAL ] CDRE: Loaded 24629 existing records from primary storage. [2025-10-08T22:35:58.858976] [INFO ] [MAIN ] CDRE: Loaded 24629 primary data records. [2025-10-08T22:35:59.041958] [DEBUG] [LOCAL ] CDP: Loaded 42533 existing records from primary storage. [2025-10-08T22:35:59.098764] [INFO ] [MAIN ] CDP: Loaded 42533 primary data records. [2025-10-08T22:35:59.220703] [DEBUG] [LOCAL ] CE: Loaded 51448 existing records from primary storage. [2025-10-08T22:35:59.269597] [INFO ] [MAIN ] CE: Loaded 51448 primary data records. [2025-10-08T22:35:59.970776] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:35:59.971867] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24629 primary records. [2025-10-08T22:35:59.972789] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-08T22:36:00.003402] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:00.005872] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42533 primary records. [2025-10-08T22:36:00.006163] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-08T22:36:00.017998] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-08T22:36:00.020714] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-08T22:36:00.027041] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-08T22:36:00.024129] [INFO ] [MAIN ] Derivative Progress: 361/1771 symbols completed. CDRE took 1.2s. Estimated remaining: 9m 11s. Rate: 153.5 symbols/min [2025-10-08T22:36:00.028303] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-08T22:36:00.028417] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:00.031914] [INFO ] [MAIN ] Derivative Progress: 362/1771 symbols completed. CDP took 1.2s. Estimated remaining: 9m 9s. Rate: 153.9 symbols/min [2025-10-08T22:36:00.033877] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:00.049217] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:00.050295] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51448 primary records. [2025-10-08T22:36:00.050469] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-08T22:36:00.076129] [DEBUG] [LOCAL ] CEE: Loaded 5614 existing records from primary storage. [2025-10-08T22:36:00.076303] [INFO ] [MAIN ] CEE: Loaded 5614 primary data records. [2025-10-08T22:36:00.165631] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-08T22:36:00.171638] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-08T22:36:00.166252] [DEBUG] [LOCAL ] CEPU: Loaded 25995 existing records from primary storage. [2025-10-08T22:36:00.177063] [INFO ] [MAIN ] CEPU: Loaded 25995 primary data records. [2025-10-08T22:36:00.228182] [INFO ] [MAIN ] Derivative Progress: 363/1771 symbols completed. CE took 1.4s. Estimated remaining: 9m 8s. Rate: 154.1 symbols/min [2025-10-08T22:36:00.291259] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:00.802628] [DEBUG] [MAIN ] CEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:00.804044] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5614 primary records. [2025-10-08T22:36:00.804188] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-08T22:36:00.806468] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-08T22:36:00.813305] [INFO ] [MAIN ] CF: Loaded 52155 primary data records. [2025-10-08T22:36:00.893404] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-08T22:36:00.915668] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-08T22:36:00.947027] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:00.946604] [INFO ] [MAIN ] Derivative Progress: 364/1771 symbols completed. CEE took 0.9s. Estimated remaining: 9m 9s. Rate: 153.7 symbols/min [2025-10-08T22:36:00.948066] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25995 primary records. [2025-10-08T22:36:00.947242] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:00.948801] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-08T22:36:01.029966] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-08T22:36:01.051861] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-08T22:36:01.061363] [INFO ] [MAIN ] Derivative Progress: 365/1771 symbols completed. CEPU took 1.0s. Estimated remaining: 9m 8s. Rate: 154.0 symbols/min [2025-10-08T22:36:01.193902] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:01.249160] [DEBUG] [MAIN ] CF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:01.273937] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52155 primary records. [2025-10-08T22:36:01.274141] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-08T22:36:01.276481] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-08T22:36:01.289317] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-08T22:36:01.312977] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-08T22:36:01.355095] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-08T22:36:01.342849] [DEBUG] [LOCAL ] CFR: Loaded 32900 existing records from primary storage. [2025-10-08T22:36:01.392962] [INFO ] [MAIN ] Derivative Progress: 366/1771 symbols completed. CF took 1.1s. Estimated remaining: 9m 7s. Rate: 154.1 symbols/min [2025-10-08T22:36:01.407678] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:01.398456] [INFO ] [MAIN ] CFR: Loaded 32900 primary data records. [2025-10-08T22:36:02.093461] [DEBUG] [LOCAL ] CGAU: Loaded 43077 existing records from primary storage. [2025-10-08T22:36:02.095088] [INFO ] [MAIN ] CGAU: Loaded 43077 primary data records. [2025-10-08T22:36:02.452922] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:02.463382] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53623 primary records. [2025-10-08T22:36:02.469217] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-08T22:36:02.468839] [DEBUG] [MAIN ] CFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:02.470235] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 32900 primary records. [2025-10-08T22:36:02.470495] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-08T22:36:02.504805] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-08T22:36:02.506720] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-08T22:36:02.506937] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-08T22:36:02.509947] [INFO ] [MAIN ] Derivative Progress: 367/1771 symbols completed. CFR took 1.3s. Estimated remaining: 9m 9s. Rate: 153.3 symbols/min [2025-10-08T22:36:02.510162] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:02.511093] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-08T22:36:02.514059] [INFO ] [MAIN ] Derivative Progress: 368/1771 symbols completed. CFG took 1.6s. Estimated remaining: 9m 8s. Rate: 153.7 symbols/min [2025-10-08T22:36:02.514733] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:02.519840] [DEBUG] [LOCAL ] CGV: Loaded 1395 existing records from primary storage. [2025-10-08T22:36:02.520604] [INFO ] [MAIN ] CGV: Loaded 1395 primary data records. [2025-10-08T22:36:02.704269] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:02.715866] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43077 primary records. [2025-10-08T22:36:02.745975] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-08T22:36:02.929504] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-08T22:36:02.929375] [DEBUG] [LOCAL ] CHD: Loaded 52208 existing records from primary storage. [2025-10-08T22:36:02.929736] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-08T22:36:02.933045] [INFO ] [MAIN ] Derivative Progress: 369/1771 symbols completed. CGAU took 1.5s. Estimated remaining: 9m 7s. Rate: 153.7 symbols/min [2025-10-08T22:36:02.933937] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:02.933791] [INFO ] [MAIN ] CHD: Loaded 52208 primary data records. [2025-10-08T22:36:03.065483] [DEBUG] [LOCAL ] CHE: Loaded 15279 existing records from primary storage. [2025-10-08T22:36:03.076951] [INFO ] [MAIN ] CHE: Loaded 15279 primary data records. [2025-10-08T22:36:03.416412] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:36:03.427897] [INFO ] [MAIN ] CGV: Generated 1792 derivative records from 1395 primary records. [2025-10-08T22:36:03.454240] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-08T22:36:03.661212] [DEBUG] [LOCAL ] CGV: Derivative data saved (1792 records). [2025-10-08T22:36:03.661901] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-08T22:36:03.664857] [INFO ] [MAIN ] Derivative Progress: 370/1771 symbols completed. CGV took 1.2s. Estimated remaining: 9m 8s. Rate: 153.3 symbols/min [2025-10-08T22:36:03.666194] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:03.706809] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:03.720930] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52208 primary records. [2025-10-08T22:36:03.722533] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-08T22:36:03.768375] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:03.769666] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-08T22:36:03.770918] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15279 primary records. [2025-10-08T22:36:03.771090] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-08T22:36:03.772689] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-08T22:36:03.775536] [INFO ] [MAIN ] Derivative Progress: 371/1771 symbols completed. CHD took 1.3s. Estimated remaining: 9m 7s. Rate: 153.6 symbols/min [2025-10-08T22:36:03.775791] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:03.771930] [DEBUG] [LOCAL ] CHH: Loaded 32293 existing records from primary storage. [2025-10-08T22:36:03.776025] [INFO ] [MAIN ] CHH: Loaded 32293 primary data records. [2025-10-08T22:36:03.854569] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-08T22:36:03.875939] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-08T22:36:03.884597] [INFO ] [MAIN ] Derivative Progress: 372/1771 symbols completed. CHE took 1.0s. Estimated remaining: 9m 5s. Rate: 153.9 symbols/min [2025-10-08T22:36:03.915696] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:04.017966] [DEBUG] [LOCAL ] CHMI: Loaded 21661 existing records from primary storage. [2025-10-08T22:36:04.150498] [INFO ] [MAIN ] CHMI: Loaded 21661 primary data records. [2025-10-08T22:36:04.150339] [DEBUG] [LOCAL ] CHN: Loaded 4753 existing records from primary storage. [2025-10-08T22:36:04.164975] [INFO ] [MAIN ] CHN: Loaded 4753 primary data records. [2025-10-08T22:36:04.940551] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:04.943062] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32293 primary records. [2025-10-08T22:36:04.943387] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-08T22:36:04.995345] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:04.998425] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4753 primary records. [2025-10-08T22:36:04.997570] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:04.998615] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-08T22:36:04.999294] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21661 primary records. [2025-10-08T22:36:05.000135] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-08T22:36:04.997208] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-08T22:36:05.000626] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-08T22:36:05.003220] [INFO ] [MAIN ] Derivative Progress: 373/1771 symbols completed. CHH took 1.3s. Estimated remaining: 9m 8s. Rate: 153.2 symbols/min [2025-10-08T22:36:05.033213] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-08T22:36:05.034327] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-08T22:36:05.036576] [INFO ] [MAIN ] Derivative Progress: 374/1771 symbols completed. CHMI took 1.3s. Estimated remaining: 9m 6s. Rate: 153.6 symbols/min [2025-10-08T22:36:05.036942] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-08T22:36:05.037196] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-08T22:36:05.039548] [INFO ] [MAIN ] Derivative Progress: 375/1771 symbols completed. CHN took 1.1s. Estimated remaining: 9m 4s. Rate: 154.0 symbols/min [2025-10-08T22:36:05.040258] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:05.040184] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:05.040073] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:05.060149] [DEBUG] [LOCAL ] CIA: Loaded 16834 existing records from primary storage. [2025-10-08T22:36:05.060306] [INFO ] [MAIN ] CIA: Loaded 16834 primary data records. [2025-10-08T22:36:05.309134] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-08T22:36:05.425767] [INFO ] [MAIN ] CHWY: Loaded 53654 primary data records. [2025-10-08T22:36:05.426594] [DEBUG] [LOCAL ] CI: Loaded 49812 existing records from primary storage. [2025-10-08T22:36:05.426908] [INFO ] [MAIN ] CI: Loaded 49812 primary data records. [2025-10-08T22:36:06.088613] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:06.090204] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16834 primary records. [2025-10-08T22:36:06.090466] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-08T22:36:06.110558] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-08T22:36:06.111080] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-08T22:36:06.113611] [INFO ] [MAIN ] Derivative Progress: 376/1771 symbols completed. CIA took 1.1s. Estimated remaining: 9m 6s. Rate: 153.2 symbols/min [2025-10-08T22:36:06.114214] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:06.135308] [DEBUG] [MAIN ] CI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:06.148487] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49812 primary records. [2025-10-08T22:36:06.148793] [DEBUG] [MAIN ] CHWY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:06.149533] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53654 primary records. [2025-10-08T22:36:06.149626] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-08T22:36:06.150213] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-08T22:36:06.187850] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-08T22:36:06.188326] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-08T22:36:06.190567] [INFO ] [MAIN ] Derivative Progress: 377/1771 symbols completed. CI took 1.2s. Estimated remaining: 9m 5s. Rate: 153.6 symbols/min [2025-10-08T22:36:06.190898] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:06.206745] [DEBUG] [LOCAL ] CIB: Loaded 30591 existing records from primary storage. [2025-10-08T22:36:06.206071] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-08T22:36:06.206989] [INFO ] [MAIN ] CIB: Loaded 30591 primary data records. [2025-10-08T22:36:06.207273] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-08T22:36:06.209361] [INFO ] [MAIN ] Derivative Progress: 378/1771 symbols completed. CHWY took 1.2s. Estimated remaining: 9m 3s. Rate: 154.0 symbols/min [2025-10-08T22:36:06.248504] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:06.238764] [DEBUG] [LOCAL ] CIF: Loaded 4097 existing records from primary storage. [2025-10-08T22:36:06.272865] [INFO ] [MAIN ] CIF: Loaded 4097 primary data records. [2025-10-08T22:36:06.932582] [DEBUG] [LOCAL ] CIG: Loaded 43848 existing records from primary storage. [2025-10-08T22:36:06.933210] [INFO ] [MAIN ] CIG: Loaded 43848 primary data records. [2025-10-08T22:36:07.275312] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:07.276752] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30591 primary records. [2025-10-08T22:36:07.277109] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-08T22:36:07.318851] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-08T22:36:07.320278] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-08T22:36:07.324915] [INFO ] [MAIN ] Derivative Progress: 379/1771 symbols completed. CIB took 1.2s. Estimated remaining: 9m 5s. Rate: 153.2 symbols/min [2025-10-08T22:36:07.320005] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:07.325350] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:07.326410] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4097 primary records. [2025-10-08T22:36:07.326914] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-08T22:36:07.347537] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-08T22:36:07.347997] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-08T22:36:07.347760] [DEBUG] [LOCAL ] CIMN: Loaded 2733 existing records from primary storage. [2025-10-08T22:36:07.352288] [INFO ] [MAIN ] Derivative Progress: 380/1771 symbols completed. CIF took 1.2s. Estimated remaining: 9m 3s. Rate: 153.6 symbols/min [2025-10-08T22:36:07.352553] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:07.352400] [INFO ] [MAIN ] CIMN: Loaded 2733 primary data records. [2025-10-08T22:36:07.530829] [DEBUG] [LOCAL ] CINT: Loaded 19416 existing records from primary storage. [2025-10-08T22:36:07.531065] [INFO ] [MAIN ] CINT: Loaded 19416 primary data records. [2025-10-08T22:36:07.524367] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:07.532832] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43848 primary records. [2025-10-08T22:36:07.570480] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-08T22:36:07.906111] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-08T22:36:07.924391] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-08T22:36:07.988990] [INFO ] [MAIN ] Derivative Progress: 381/1771 symbols completed. CIG took 1.7s. Estimated remaining: 9m 4s. Rate: 153.3 symbols/min [2025-10-08T22:36:07.996121] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:08.160607] [DEBUG] [LOCAL ] CIO: Loaded 20422 existing records from primary storage. [2025-10-08T22:36:08.161502] [INFO ] [MAIN ] CIO: Loaded 20422 primary data records. [2025-10-08T22:36:08.212940] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7729 incomplete bins [2025-10-08T22:36:08.255054] [INFO ] [MAIN ] CIMN: Generated 1789 derivative records from 2733 primary records. [2025-10-08T22:36:08.280674] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:08.287116] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 19416 primary records. [2025-10-08T22:36:08.286037] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-08T22:36:08.301830] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-08T22:36:08.405744] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-08T22:36:08.418478] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-08T22:36:08.420725] [INFO ] [MAIN ] Derivative Progress: 382/1771 symbols completed. CINT took 1.1s. Estimated remaining: 9m 4s. Rate: 153.3 symbols/min [2025-10-08T22:36:08.430369] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:08.515297] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1789 records). [2025-10-08T22:36:08.625298] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-08T22:36:08.637698] [INFO ] [MAIN ] Derivative Progress: 383/1771 symbols completed. CIMN took 1.3s. Estimated remaining: 9m 3s. Rate: 153.5 symbols/min [2025-10-08T22:36:08.638145] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:08.671247] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:08.673236] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 20422 primary records. [2025-10-08T22:36:08.673301] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-08T22:36:08.705806] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-08T22:36:08.706024] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-08T22:36:08.708612] [INFO ] [MAIN ] Derivative Progress: 384/1771 symbols completed. CIO took 0.7s. Estimated remaining: 9m 1s. Rate: 153.8 symbols/min [2025-10-08T22:36:08.709068] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:08.749975] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-08T22:36:08.750336] [INFO ] [MAIN ] CIVI: Loaded 52615 primary data records. [2025-10-08T22:36:08.884530] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-08T22:36:08.898427] [INFO ] [MAIN ] CL: Loaded 53648 primary data records. [2025-10-08T22:36:08.996533] [DEBUG] [LOCAL ] CLB: Loaded 33007 existing records from primary storage. [2025-10-08T22:36:09.067069] [INFO ] [MAIN ] CLB: Loaded 33007 primary data records. [2025-10-08T22:36:09.804516] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:09.806201] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52615 primary records. [2025-10-08T22:36:09.806517] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-08T22:36:09.838463] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:09.842015] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53648 primary records. [2025-10-08T22:36:09.842504] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-08T22:36:09.842668] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-08T22:36:09.843123] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-08T22:36:09.846390] [INFO ] [MAIN ] Derivative Progress: 385/1771 symbols completed. CIVI took 1.4s. Estimated remaining: 9m 3s. Rate: 153.0 symbols/min [2025-10-08T22:36:09.847562] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:09.867608] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-08T22:36:09.885425] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-08T22:36:09.888443] [INFO ] [MAIN ] Derivative Progress: 386/1771 symbols completed. CL took 1.3s. Estimated remaining: 9m 2s. Rate: 153.4 symbols/min [2025-10-08T22:36:09.889173] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:09.886032] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:09.894638] [DEBUG] [LOCAL ] CLCO: Loaded 12762 existing records from primary storage. [2025-10-08T22:36:09.895355] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33007 primary records. [2025-10-08T22:36:09.895457] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-08T22:36:09.895542] [INFO ] [MAIN ] CLCO: Loaded 12762 primary data records. [2025-10-08T22:36:10.084887] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-08T22:36:10.112688] [DEBUG] [LOCAL ] CLDT: Loaded 25381 existing records from primary storage. [2025-10-08T22:36:10.111927] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-08T22:36:10.114787] [INFO ] [MAIN ] Derivative Progress: 387/1771 symbols completed. CLB took 1.4s. Estimated remaining: 9m 1s. Rate: 153.6 symbols/min [2025-10-08T22:36:10.114935] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:10.164730] [INFO ] [MAIN ] CLDT: Loaded 25381 primary data records. [2025-10-08T22:36:10.494277] [DEBUG] [LOCAL ] CLH: Loaded 27621 existing records from primary storage. [2025-10-08T22:36:10.612474] [INFO ] [MAIN ] CLH: Loaded 27621 primary data records. [2025-10-08T22:36:11.056507] [DEBUG] [MAIN ] CLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:11.058337] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 12762 primary records. [2025-10-08T22:36:11.058581] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-08T22:36:11.094763] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-08T22:36:11.093583] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:11.095870] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-08T22:36:11.095672] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25381 primary records. [2025-10-08T22:36:11.097866] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-08T22:36:11.097786] [INFO ] [MAIN ] Derivative Progress: 388/1771 symbols completed. CLCO took 1.3s. Estimated remaining: 9m 3s. Rate: 153.0 symbols/min [2025-10-08T22:36:11.114931] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-08T22:36:11.115119] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-08T22:36:11.117428] [INFO ] [MAIN ] Derivative Progress: 389/1771 symbols completed. CLDT took 1.2s. Estimated remaining: 9m 1s. Rate: 153.3 symbols/min [2025-10-08T22:36:11.132745] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:11.133407] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27621 primary records. [2025-10-08T22:36:11.133469] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-08T22:36:11.149146] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-08T22:36:11.149216] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-08T22:36:11.151340] [INFO ] [MAIN ] Derivative Progress: 390/1771 symbols completed. CLH took 1.0s. Estimated remaining: 8m 59s. Rate: 153.7 symbols/min [2025-10-08T22:36:11.151806] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:11.151905] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:11.152227] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:11.167087] [DEBUG] [LOCAL ] CLPR: Loaded 10563 existing records from primary storage. [2025-10-08T22:36:11.167321] [INFO ] [MAIN ] CLPR: Loaded 10563 primary data records. [2025-10-08T22:36:11.302285] [DEBUG] [LOCAL ] CLW: Loaded 21669 existing records from primary storage. [2025-10-08T22:36:11.322081] [INFO ] [MAIN ] CLW: Loaded 21669 primary data records. [2025-10-08T22:36:11.657823] [DEBUG] [LOCAL ] CLVT: Loaded 51982 existing records from primary storage. [2025-10-08T22:36:11.679877] [INFO ] [MAIN ] CLVT: Loaded 51982 primary data records. [2025-10-08T22:36:12.276883] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:12.276581] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:12.278028] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21669 primary records. [2025-10-08T22:36:12.278796] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 10563 primary records. [2025-10-08T22:36:12.279316] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-08T22:36:12.278900] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-08T22:36:12.310541] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-08T22:36:12.311417] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-08T22:36:12.314215] [INFO ] [MAIN ] Derivative Progress: 391/1771 symbols completed. CLW took 1.2s. Estimated remaining: 9m 1s. Rate: 152.9 symbols/min [2025-10-08T22:36:12.315145] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:12.320375] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-10-08T22:36:12.320746] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-08T22:36:12.323062] [INFO ] [MAIN ] Derivative Progress: 392/1771 symbols completed. CLPR took 1.2s. Estimated remaining: 8m 60s. Rate: 153.3 symbols/min [2025-10-08T22:36:12.323345] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:12.348943] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:12.350268] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51982 primary records. [2025-10-08T22:36:12.350574] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-08T22:36:12.378619] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-08T22:36:12.392200] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-08T22:36:12.394347] [INFO ] [MAIN ] Derivative Progress: 393/1771 symbols completed. CLVT took 1.2s. Estimated remaining: 8m 58s. Rate: 153.6 symbols/min [2025-10-08T22:36:12.394777] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:12.437638] [DEBUG] [LOCAL ] CLX: Loaded 51594 existing records from primary storage. [2025-10-08T22:36:12.439186] [INFO ] [MAIN ] CLX: Loaded 51594 primary data records. [2025-10-08T22:36:12.439952] [DEBUG] [LOCAL ] CM: Loaded 48747 existing records from primary storage. [2025-10-08T22:36:12.472922] [INFO ] [MAIN ] CM: Loaded 48747 primary data records. [2025-10-08T22:36:13.063181] [DEBUG] [LOCAL ] CMA: Loaded 49919 existing records from primary storage. [2025-10-08T22:36:13.126365] [INFO ] [MAIN ] CMA: Loaded 49919 primary data records. [2025-10-08T22:36:13.473048] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:13.477988] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51594 primary records. [2025-10-08T22:36:13.487059] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-08T22:36:13.494275] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:13.509519] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48747 primary records. [2025-10-08T22:36:13.511787] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-08T22:36:13.527470] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-08T22:36:13.527863] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-08T22:36:13.531449] [INFO ] [MAIN ] Derivative Progress: 394/1771 symbols completed. CLX took 1.2s. Estimated remaining: 9m 0s. Rate: 152.9 symbols/min [2025-10-08T22:36:13.533680] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:13.540552] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-08T22:36:13.540815] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-08T22:36:13.543225] [INFO ] [MAIN ] Derivative Progress: 395/1771 symbols completed. CM took 1.2s. Estimated remaining: 8m 59s. Rate: 153.3 symbols/min [2025-10-08T22:36:13.543634] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:13.557532] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:13.558408] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 49919 primary records. [2025-10-08T22:36:13.558476] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-08T22:36:13.593954] [DEBUG] [LOCAL ] CMBT: Loaded 24761 existing records from primary storage. [2025-10-08T22:36:13.594339] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-08T22:36:13.594600] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-08T22:36:13.597566] [INFO ] [MAIN ] CMBT: Loaded 24761 primary data records. [2025-10-08T22:36:13.597430] [INFO ] [MAIN ] Derivative Progress: 396/1771 symbols completed. CMA took 1.2s. Estimated remaining: 8m 57s. Rate: 153.6 symbols/min [2025-10-08T22:36:13.611210] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:13.765728] [DEBUG] [LOCAL ] CMCM: Loaded 4735 existing records from primary storage. [2025-10-08T22:36:13.813138] [INFO ] [MAIN ] CMCM: Loaded 4735 primary data records. [2025-10-08T22:36:13.837585] [DEBUG] [LOCAL ] CMC: Loaded 45379 existing records from primary storage. [2025-10-08T22:36:13.868754] [INFO ] [MAIN ] CMC: Loaded 45379 primary data records. [2025-10-08T22:36:14.647003] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:14.648335] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 24761 primary records. [2025-10-08T22:36:14.650448] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-08T22:36:14.670938] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-08T22:36:14.671269] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-08T22:36:14.673441] [INFO ] [MAIN ] Derivative Progress: 397/1771 symbols completed. CMBT took 1.1s. Estimated remaining: 8m 59s. Rate: 152.9 symbols/min [2025-10-08T22:36:14.681308] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:14.686808] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:14.687980] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4735 primary records. [2025-10-08T22:36:14.688060] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-08T22:36:14.716819] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:14.716532] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-08T22:36:14.717731] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45379 primary records. [2025-10-08T22:36:14.717955] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-08T22:36:14.718043] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-08T22:36:14.720545] [INFO ] [MAIN ] Derivative Progress: 398/1771 symbols completed. CMCM took 1.1s. Estimated remaining: 8m 58s. Rate: 153.2 symbols/min [2025-10-08T22:36:14.723017] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:14.740168] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-08T22:36:14.754293] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-08T22:36:14.757387] [INFO ] [MAIN ] Derivative Progress: 399/1771 symbols completed. CMC took 1.2s. Estimated remaining: 8m 56s. Rate: 153.6 symbols/min [2025-10-08T22:36:14.757714] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:14.787344] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-08T22:36:14.787576] [INFO ] [MAIN ] CMG: Loaded 53721 primary data records. [2025-10-08T22:36:14.945110] [DEBUG] [LOCAL ] CMI: Loaded 41656 existing records from primary storage. [2025-10-08T22:36:14.951530] [INFO ] [MAIN ] CMI: Loaded 41656 primary data records. [2025-10-08T22:36:14.988259] [DEBUG] [LOCAL ] CMP: Loaded 36066 existing records from primary storage. [2025-10-08T22:36:15.010714] [INFO ] [MAIN ] CMP: Loaded 36066 primary data records. [2025-10-08T22:36:15.909191] [DEBUG] [MAIN ] CMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:15.910450] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53721 primary records. [2025-10-08T22:36:15.910695] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-10-08T22:36:15.956116] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:15.958123] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41656 primary records. [2025-10-08T22:36:15.955668] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-10-08T22:36:15.958370] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-08T22:36:15.958303] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-10-08T22:36:15.963478] [INFO ] [MAIN ] Derivative Progress: 400/1771 symbols completed. CMG took 1.3s. Estimated remaining: 8m 58s. Rate: 152.8 symbols/min [2025-10-08T22:36:15.963974] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:15.997181] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:16.000768] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-08T22:36:16.002381] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36066 primary records. [2025-10-08T22:36:16.002689] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-08T22:36:16.002554] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-08T22:36:16.018994] [INFO ] [MAIN ] Derivative Progress: 401/1771 symbols completed. CMI took 1.3s. Estimated remaining: 8m 57s. Rate: 153.1 symbols/min [2025-10-08T22:36:16.032161] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-08T22:36:16.032591] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-08T22:36:16.032838] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:16.035492] [INFO ] [MAIN ] Derivative Progress: 402/1771 symbols completed. CMP took 1.3s. Estimated remaining: 8m 55s. Rate: 153.5 symbols/min [2025-10-08T22:36:16.035932] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:16.055230] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-08T22:36:16.055710] [INFO ] [MAIN ] CMSA: Loaded 3509 primary data records. [2025-10-08T22:36:16.204320] [DEBUG] [LOCAL ] CMPO: Loaded 38977 existing records from primary storage. [2025-10-08T22:36:16.210884] [INFO ] [MAIN ] CMPO: Loaded 38977 primary data records. [2025-10-08T22:36:16.476953] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-08T22:36:16.522838] [INFO ] [MAIN ] CMS: Loaded 52610 primary data records. [2025-10-08T22:36:17.366349] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:36:17.367782] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3509 primary records. [2025-10-08T22:36:17.368268] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-08T22:36:17.386687] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-10-08T22:36:17.388253] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-08T22:36:17.391607] [INFO ] [MAIN ] Derivative Progress: 403/1771 symbols completed. CMSA took 1.4s. Estimated remaining: 8m 58s. Rate: 152.6 symbols/min [2025-10-08T22:36:17.409730] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:17.412583] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38977 primary records. [2025-10-08T22:36:17.412721] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-08T22:36:17.426810] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:17.427943] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52610 primary records. [2025-10-08T22:36:17.435460] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-08T22:36:17.458160] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-08T22:36:17.458878] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-08T22:36:17.462236] [INFO ] [MAIN ] Derivative Progress: 404/1771 symbols completed. CMPO took 1.5s. Estimated remaining: 8m 57s. Rate: 152.9 symbols/min [2025-10-08T22:36:17.462794] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-08T22:36:17.462927] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-08T22:36:17.465710] [INFO ] [MAIN ] Derivative Progress: 405/1771 symbols completed. CMS took 1.4s. Estimated remaining: 8m 55s. Rate: 153.2 symbols/min [2025-10-08T22:36:17.466172] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:17.466277] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:17.466674] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:17.477719] [DEBUG] [LOCAL ] CMSC: Loaded 5006 existing records from primary storage. [2025-10-08T22:36:17.477872] [INFO ] [MAIN ] CMSC: Loaded 5006 primary data records. [2025-10-08T22:36:17.597682] [DEBUG] [LOCAL ] CMSD: Loaded 8001 existing records from primary storage. [2025-10-08T22:36:17.608727] [INFO ] [MAIN ] CMSD: Loaded 8001 primary data records. [2025-10-08T22:36:17.947138] [DEBUG] [LOCAL ] CMTG: Loaded 36233 existing records from primary storage. [2025-10-08T22:36:17.968274] [INFO ] [MAIN ] CMTG: Loaded 36233 primary data records. [2025-10-08T22:36:18.530315] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:18.532409] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5006 primary records. [2025-10-08T22:36:18.533018] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-08T22:36:18.551006] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-08T22:36:18.551384] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-08T22:36:18.555994] [INFO ] [MAIN ] Derivative Progress: 406/1771 symbols completed. CMSC took 1.1s. Estimated remaining: 8m 57s. Rate: 152.6 symbols/min [2025-10-08T22:36:18.557324] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:18.573263] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:18.574247] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8001 primary records. [2025-10-08T22:36:18.574848] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-08T22:36:18.597468] [DEBUG] [LOCAL ] CMU: Loaded 6347 existing records from primary storage. [2025-10-08T22:36:18.598065] [INFO ] [MAIN ] CMU: Loaded 6347 primary data records. [2025-10-08T22:36:18.659287] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:18.683076] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 36233 primary records. [2025-10-08T22:36:18.688728] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-08T22:36:18.689553] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-08T22:36:18.689712] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-08T22:36:18.699976] [INFO ] [MAIN ] Derivative Progress: 407/1771 symbols completed. CMSD took 1.2s. Estimated remaining: 8m 56s. Rate: 152.8 symbols/min [2025-10-08T22:36:18.737806] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:18.809669] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-08T22:36:18.831791] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-08T22:36:18.951828] [INFO ] [MAIN ] Derivative Progress: 408/1771 symbols completed. CMTG took 1.5s. Estimated remaining: 8m 55s. Rate: 152.9 symbols/min [2025-10-08T22:36:18.952934] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:18.989710] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:18.990612] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6347 primary records. [2025-10-08T22:36:18.990709] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-08T22:36:19.018266] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-08T22:36:19.018535] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-08T22:36:19.020808] [INFO ] [MAIN ] Derivative Progress: 409/1771 symbols completed. CMU took 0.5s. Estimated remaining: 8m 53s. Rate: 153.3 symbols/min [2025-10-08T22:36:19.035251] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:19.038343] [DEBUG] [LOCAL ] CNA: Loaded 32849 existing records from primary storage. [2025-10-08T22:36:19.038541] [INFO ] [MAIN ] CNA: Loaded 32849 primary data records. [2025-10-08T22:36:19.138497] [DEBUG] [LOCAL ] CNC: Loaded 53755 existing records from primary storage. [2025-10-08T22:36:19.155678] [INFO ] [MAIN ] CNC: Loaded 53755 primary data records. [2025-10-08T22:36:19.197827] [DEBUG] [LOCAL ] CNF: Loaded 10508 existing records from primary storage. [2025-10-08T22:36:19.208549] [INFO ] [MAIN ] CNF: Loaded 10508 primary data records. [2025-10-08T22:36:20.078506] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:20.079794] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32849 primary records. [2025-10-08T22:36:20.080041] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-08T22:36:20.099326] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-08T22:36:20.099563] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-08T22:36:20.102856] [INFO ] [MAIN ] Derivative Progress: 410/1771 symbols completed. CNA took 1.4s. Estimated remaining: 8m 55s. Rate: 152.6 symbols/min [2025-10-08T22:36:20.103559] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:20.123125] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:20.124165] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53755 primary records. [2025-10-08T22:36:20.124263] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-08T22:36:20.147770] [DEBUG] [MAIN ] CNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:20.151258] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 10508 primary records. [2025-10-08T22:36:20.151357] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-08T22:36:20.172744] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-08T22:36:20.174488] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-08T22:36:20.174213] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-10-08T22:36:20.176572] [INFO ] [MAIN ] Derivative Progress: 411/1771 symbols completed. CNC took 1.2s. Estimated remaining: 8m 54s. Rate: 152.9 symbols/min [2025-10-08T22:36:20.176928] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:20.177145] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-08T22:36:20.179763] [INFO ] [MAIN ] Derivative Progress: 412/1771 symbols completed. CNF took 1.1s. Estimated remaining: 8m 52s. Rate: 153.3 symbols/min [2025-10-08T22:36:20.179997] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:20.250050] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-08T22:36:20.250355] [INFO ] [MAIN ] CNH: Loaded 53551 primary data records. [2025-10-08T22:36:20.390292] [DEBUG] [LOCAL ] CNK: Loaded 52888 existing records from primary storage. [2025-10-08T22:36:20.412110] [DEBUG] [LOCAL ] CNM: Loaded 51046 existing records from primary storage. [2025-10-08T22:36:20.400847] [INFO ] [MAIN ] CNK: Loaded 52888 primary data records. [2025-10-08T22:36:20.465912] [INFO ] [MAIN ] CNM: Loaded 51046 primary data records. [2025-10-08T22:36:21.212632] [DEBUG] [MAIN ] CNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:21.213509] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53551 primary records. [2025-10-08T22:36:21.213713] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-08T22:36:21.245199] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-08T22:36:21.246096] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-08T22:36:21.246044] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:21.250582] [INFO ] [MAIN ] Derivative Progress: 413/1771 symbols completed. CNH took 1.1s. Estimated remaining: 8m 54s. Rate: 152.6 symbols/min [2025-10-08T22:36:21.251750] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52888 primary records. [2025-10-08T22:36:21.252925] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-08T22:36:21.252868] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:21.284331] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-08T22:36:21.284751] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-08T22:36:21.286684] [INFO ] [MAIN ] Derivative Progress: 414/1771 symbols completed. CNK took 1.1s. Estimated remaining: 8m 52s. Rate: 153.0 symbols/min [2025-10-08T22:36:21.287234] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:21.287121] [DEBUG] [MAIN ] CNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:21.288537] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 51046 primary records. [2025-10-08T22:36:21.288721] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-08T22:36:21.308620] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-10-08T22:36:21.308794] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-08T22:36:21.311012] [INFO ] [MAIN ] Derivative Progress: 415/1771 symbols completed. CNM took 1.1s. Estimated remaining: 8m 51s. Rate: 153.3 symbols/min [2025-10-08T22:36:21.319138] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:21.336708] [DEBUG] [LOCAL ] CNMD: Loaded 32106 existing records from primary storage. [2025-10-08T22:36:21.344520] [INFO ] [MAIN ] CNMD: Loaded 32106 primary data records. [2025-10-08T22:36:21.475699] [DEBUG] [LOCAL ] CNNE: Loaded 36255 existing records from primary storage. [2025-10-08T22:36:21.476014] [INFO ] [MAIN ] CNNE: Loaded 36255 primary data records. [2025-10-08T22:36:21.771070] [DEBUG] [LOCAL ] CNO: Loaded 40837 existing records from primary storage. [2025-10-08T22:36:21.781709] [INFO ] [MAIN ] CNO: Loaded 40837 primary data records. [2025-10-08T22:36:22.361476] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:22.362595] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32106 primary records. [2025-10-08T22:36:22.362859] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-08T22:36:22.381572] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-08T22:36:22.382107] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-08T22:36:22.384069] [INFO ] [MAIN ] Derivative Progress: 416/1771 symbols completed. CNMD took 1.1s. Estimated remaining: 8m 53s. Rate: 152.7 symbols/min [2025-10-08T22:36:22.384491] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:22.398162] [DEBUG] [MAIN ] CNNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:22.399629] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36255 primary records. [2025-10-08T22:36:22.399845] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-08T22:36:22.429967] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:22.430786] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-08T22:36:22.431531] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40837 primary records. [2025-10-08T22:36:22.431624] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-08T22:36:22.432417] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-08T22:36:22.434843] [INFO ] [MAIN ] Derivative Progress: 417/1771 symbols completed. CNNE took 1.1s. Estimated remaining: 8m 51s. Rate: 153.0 symbols/min [2025-10-08T22:36:22.435477] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:22.453379] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-08T22:36:22.453520] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-08T22:36:22.455616] [INFO ] [MAIN ] Derivative Progress: 418/1771 symbols completed. CNO took 1.1s. Estimated remaining: 8m 49s. Rate: 153.3 symbols/min [2025-10-08T22:36:22.511708] [DEBUG] [LOCAL ] CNP: Loaded 53476 existing records from primary storage. [2025-10-08T22:36:22.511883] [INFO ] [MAIN ] CNP: Loaded 53476 primary data records. [2025-10-08T22:36:22.639573] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-08T22:36:22.650484] [INFO ] [MAIN ] CNQ: Loaded 53577 primary data records. [2025-10-08T22:36:23.161028] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:23.161826] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53476 primary records. [2025-10-08T22:36:23.161978] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-08T22:36:23.191051] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:23.192160] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53577 primary records. [2025-10-08T22:36:23.192671] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-08T22:36:23.194552] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-08T22:36:23.201819] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-08T22:36:23.207747] [INFO ] [MAIN ] Derivative Progress: 419/1771 symbols completed. CNP took 0.8s. Estimated remaining: 8m 50s. Rate: 153.0 symbols/min [2025-10-08T22:36:23.212063] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-08T22:36:23.212145] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-08T22:36:23.214018] [INFO ] [MAIN ] Derivative Progress: 420/1771 symbols completed. CNQ took 0.8s. Estimated remaining: 8m 49s. Rate: 153.4 symbols/min [2025-10-08T22:36:23.214735] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:23.214816] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:23.214869] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:23.239626] [DEBUG] [LOCAL ] CNS: Loaded 20802 existing records from primary storage. [2025-10-08T22:36:23.239801] [INFO ] [MAIN ] CNS: Loaded 20802 primary data records. [2025-10-08T22:36:23.430010] [DEBUG] [LOCAL ] CODI: Loaded 40636 existing records from primary storage. [2025-10-08T22:36:23.594122] [INFO ] [MAIN ] CODI: Loaded 40636 primary data records. [2025-10-08T22:36:23.601048] [DEBUG] [LOCAL ] COF: Loaded 53612 existing records from primary storage. [2025-10-08T22:36:23.634892] [INFO ] [MAIN ] COF: Loaded 53612 primary data records. [2025-10-08T22:36:24.270802] [DEBUG] [MAIN ] CNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:24.272164] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 20802 primary records. [2025-10-08T22:36:24.272354] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-10-08T22:36:24.289586] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-10-08T22:36:24.290072] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-10-08T22:36:24.292115] [INFO ] [MAIN ] Derivative Progress: 421/1771 symbols completed. CNS took 1.1s. Estimated remaining: 8m 50s. Rate: 152.7 symbols/min [2025-10-08T22:36:24.292377] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:24.319545] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:24.331184] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 40636 primary records. [2025-10-08T22:36:24.331445] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:24.331608] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-08T22:36:24.332928] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53612 primary records. [2025-10-08T22:36:24.333259] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-08T22:36:24.363225] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-08T22:36:24.363789] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-08T22:36:24.366990] [INFO ] [MAIN ] Derivative Progress: 422/1771 symbols completed. CODI took 1.2s. Estimated remaining: 8m 49s. Rate: 153.0 symbols/min [2025-10-08T22:36:24.367183] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:24.382242] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-08T22:36:24.382411] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-08T22:36:24.385297] [INFO ] [MAIN ] Derivative Progress: 423/1771 symbols completed. COF took 1.2s. Estimated remaining: 8m 47s. Rate: 153.4 symbols/min [2025-10-08T22:36:24.385682] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:24.405883] [DEBUG] [LOCAL ] COHR: Loaded 53371 existing records from primary storage. [2025-10-08T22:36:24.406115] [INFO ] [MAIN ] COHR: Loaded 53371 primary data records. [2025-10-08T22:36:24.780469] [DEBUG] [LOCAL ] COLD: Loaded 52250 existing records from primary storage. [2025-10-08T22:36:24.781381] [INFO ] [MAIN ] COLD: Loaded 52250 primary data records. [2025-10-08T22:36:24.864626] [DEBUG] [LOCAL ] COR: Loaded 46781 existing records from primary storage. [2025-10-08T22:36:24.901571] [INFO ] [MAIN ] COR: Loaded 46781 primary data records. [2025-10-08T22:36:25.426882] [DEBUG] [MAIN ] COHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:25.427852] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53371 primary records. [2025-10-08T22:36:25.427943] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-08T22:36:25.447343] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-08T22:36:25.448335] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-08T22:36:25.450710] [INFO ] [MAIN ] Derivative Progress: 424/1771 symbols completed. COHR took 1.2s. Estimated remaining: 8m 49s. Rate: 152.7 symbols/min [2025-10-08T22:36:25.451056] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:25.473468] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:25.474502] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52250 primary records. [2025-10-08T22:36:25.474856] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-08T22:36:25.524843] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-08T22:36:25.525288] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-08T22:36:25.525157] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:25.527232] [INFO ] [MAIN ] Derivative Progress: 425/1771 symbols completed. COLD took 1.2s. Estimated remaining: 8m 48s. Rate: 153.0 symbols/min [2025-10-08T22:36:25.528126] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46781 primary records. [2025-10-08T22:36:25.528270] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-08T22:36:25.529297] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:25.560196] [DEBUG] [LOCAL ] COUR: Loaded 49053 existing records from primary storage. [2025-10-08T22:36:25.560687] [INFO ] [MAIN ] COUR: Loaded 49053 primary data records. [2025-10-08T22:36:25.619429] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-08T22:36:25.619546] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-08T22:36:25.621689] [INFO ] [MAIN ] Derivative Progress: 426/1771 symbols completed. COR took 1.2s. Estimated remaining: 8m 46s. Rate: 153.3 symbols/min [2025-10-08T22:36:25.640005] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:25.902699] [DEBUG] [LOCAL ] CPA: Loaded 28240 existing records from primary storage. [2025-10-08T22:36:25.917331] [INFO ] [MAIN ] CPA: Loaded 28240 primary data records. [2025-10-08T22:36:26.055014] [DEBUG] [LOCAL ] CPAY: Loaded 30443 existing records from primary storage. [2025-10-08T22:36:26.061348] [INFO ] [MAIN ] CPAY: Loaded 30443 primary data records. [2025-10-08T22:36:26.584050] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:26.585022] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49053 primary records. [2025-10-08T22:36:26.585188] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-08T22:36:26.607602] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-08T22:36:26.607815] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-08T22:36:26.610107] [INFO ] [MAIN ] Derivative Progress: 427/1771 symbols completed. COUR took 1.2s. Estimated remaining: 8m 48s. Rate: 152.8 symbols/min [2025-10-08T22:36:26.613176] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:26.627386] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:26.628184] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 28240 primary records. [2025-10-08T22:36:26.628380] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-08T22:36:26.656049] [DEBUG] [LOCAL ] CPF: Loaded 15169 existing records from primary storage. [2025-10-08T22:36:26.657732] [INFO ] [MAIN ] CPF: Loaded 15169 primary data records. [2025-10-08T22:36:26.658757] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-08T22:36:26.658956] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-08T22:36:26.681821] [INFO ] [MAIN ] Derivative Progress: 428/1771 symbols completed. CPA took 1.2s. Estimated remaining: 8m 46s. Rate: 153.1 symbols/min [2025-10-08T22:36:26.724256] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:26.735211] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:26.763165] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30443 primary records. [2025-10-08T22:36:26.781819] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-08T22:36:27.006665] [DEBUG] [LOCAL ] CPK: Loaded 13647 existing records from primary storage. [2025-10-08T22:36:27.008447] [INFO ] [MAIN ] CPK: Loaded 13647 primary data records. [2025-10-08T22:36:27.069415] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-08T22:36:27.103391] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-08T22:36:27.112607] [INFO ] [MAIN ] Derivative Progress: 429/1771 symbols completed. CPAY took 1.5s. Estimated remaining: 8m 46s. Rate: 153.0 symbols/min [2025-10-08T22:36:27.124584] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:27.360747] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:27.361925] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15169 primary records. [2025-10-08T22:36:27.362185] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-08T22:36:27.379954] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-08T22:36:27.393307] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-08T22:36:27.395523] [INFO ] [MAIN ] Derivative Progress: 430/1771 symbols completed. CPF took 0.8s. Estimated remaining: 8m 45s. Rate: 153.1 symbols/min [2025-10-08T22:36:27.396437] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:27.433458] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:27.434782] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-10-08T22:36:27.435942] [INFO ] [MAIN ] CPNG: Loaded 53670 primary data records. [2025-10-08T22:36:27.435846] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13647 primary records. [2025-10-08T22:36:27.436216] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-08T22:36:27.828297] [DEBUG] [LOCAL ] CPRI: Loaded 52519 existing records from primary storage. [2025-10-08T22:36:27.828448] [INFO ] [MAIN ] CPRI: Loaded 52519 primary data records. [2025-10-08T22:36:27.827169] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-08T22:36:27.828716] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-08T22:36:27.831169] [INFO ] [MAIN ] Derivative Progress: 431/1771 symbols completed. CPK took 1.1s. Estimated remaining: 8m 45s. Rate: 153.1 symbols/min [2025-10-08T22:36:27.852239] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:28.162458] [DEBUG] [LOCAL ] CPS: Loaded 25526 existing records from primary storage. [2025-10-08T22:36:28.162752] [INFO ] [MAIN ] CPS: Loaded 25526 primary data records. [2025-10-08T22:36:28.364794] [DEBUG] [MAIN ] CPNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:28.473402] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53670 primary records. [2025-10-08T22:36:28.482225] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-08T22:36:28.520011] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:28.521680] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-08T22:36:28.521802] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-08T22:36:28.521612] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52519 primary records. [2025-10-08T22:36:28.523832] [INFO ] [MAIN ] Derivative Progress: 432/1771 symbols completed. CPNG took 1.4s. Estimated remaining: 8m 46s. Rate: 152.8 symbols/min [2025-10-08T22:36:28.523982] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-08T22:36:28.524146] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:28.546438] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-08T22:36:28.546728] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-08T22:36:28.548956] [INFO ] [MAIN ] Derivative Progress: 433/1771 symbols completed. CPRI took 1.2s. Estimated remaining: 8m 44s. Rate: 153.1 symbols/min [2025-10-08T22:36:28.571084] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:28.572010] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 25526 primary records. [2025-10-08T22:36:28.572120] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-08T22:36:28.599541] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-08T22:36:28.599757] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-08T22:36:28.602210] [INFO ] [MAIN ] Derivative Progress: 434/1771 symbols completed. CPS took 0.7s. Estimated remaining: 8m 43s. Rate: 153.4 symbols/min [2025-10-08T22:36:28.618240] [DEBUG] [LOCAL ] CPT: Loaded 44405 existing records from primary storage. [2025-10-08T22:36:28.618376] [INFO ] [MAIN ] CPT: Loaded 44405 primary data records. [2025-10-08T22:36:28.930776] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:28.931446] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44405 primary records. [2025-10-08T22:36:28.931528] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-08T22:36:28.947131] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-08T22:36:28.947194] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-08T22:36:28.949182] [INFO ] [MAIN ] Derivative Progress: 435/1771 symbols completed. CPT took 0.4s. Estimated remaining: 8m 42s. Rate: 153.5 symbols/min [2025-10-08T22:36:28.949586] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:28.949679] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:28.950356] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:28.963255] [DEBUG] [LOCAL ] CRBD: Loaded 9039 existing records from primary storage. [2025-10-08T22:36:28.967900] [INFO ] [MAIN ] CRBD: Loaded 9039 primary data records. [2025-10-08T22:36:29.050778] [DEBUG] [LOCAL ] CQP: Loaded 18929 existing records from primary storage. [2025-10-08T22:36:29.079532] [DEBUG] [LOCAL ] CR: Loaded 24113 existing records from primary storage. [2025-10-08T22:36:29.087292] [INFO ] [MAIN ] CQP: Loaded 18929 primary data records. [2025-10-08T22:36:29.090608] [INFO ] [MAIN ] CR: Loaded 24113 primary data records. [2025-10-08T22:36:29.967469] [DEBUG] [MAIN ] CRBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:29.969089] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 9039 primary records. [2025-10-08T22:36:29.970066] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-08T22:36:29.999164] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:30.002765] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-08T22:36:30.003550] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18929 primary records. [2025-10-08T22:36:30.003698] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-08T22:36:30.005753] [INFO ] [MAIN ] Derivative Progress: 436/1771 symbols completed. CRBD took 1.1s. Estimated remaining: 8m 44s. Rate: 152.9 symbols/min [2025-10-08T22:36:30.005943] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:30.005851] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-08T22:36:30.020258] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:30.034301] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24113 primary records. [2025-10-08T22:36:30.036033] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-08T22:36:30.046213] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-08T22:36:30.046423] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-08T22:36:30.048736] [INFO ] [MAIN ] Derivative Progress: 437/1771 symbols completed. CQP took 1.1s. Estimated remaining: 8m 42s. Rate: 153.2 symbols/min [2025-10-08T22:36:30.053385] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:30.080931] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-10-08T22:36:30.081109] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-08T22:36:30.083334] [INFO ] [MAIN ] Derivative Progress: 438/1771 symbols completed. CR took 1.1s. Estimated remaining: 8m 41s. Rate: 153.5 symbols/min [2025-10-08T22:36:30.083617] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:30.155155] [DEBUG] [LOCAL ] CRBG: Loaded 52448 existing records from primary storage. [2025-10-08T22:36:30.181023] [INFO ] [MAIN ] CRBG: Loaded 52448 primary data records. [2025-10-08T22:36:30.181725] [DEBUG] [LOCAL ] CRC: Loaded 43809 existing records from primary storage. [2025-10-08T22:36:30.205739] [INFO ] [MAIN ] CRC: Loaded 43809 primary data records. [2025-10-08T22:36:30.387751] [DEBUG] [LOCAL ] CRGY: Loaded 52481 existing records from primary storage. [2025-10-08T22:36:30.410460] [INFO ] [MAIN ] CRGY: Loaded 52481 primary data records. [2025-10-08T22:36:31.148258] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:31.149081] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:31.150511] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 43809 primary records. [2025-10-08T22:36:31.149839] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52448 primary records. [2025-10-08T22:36:31.150899] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-08T22:36:31.151015] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-08T22:36:31.185324] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-08T22:36:31.186450] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-08T22:36:31.189434] [INFO ] [MAIN ] Derivative Progress: 439/1771 symbols completed. CRBG took 1.2s. Estimated remaining: 8m 43s. Rate: 152.9 symbols/min [2025-10-08T22:36:31.197283] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:31.204772] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-08T22:36:31.204854] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-08T22:36:31.207120] [INFO ] [MAIN ] Derivative Progress: 440/1771 symbols completed. CRC took 1.2s. Estimated remaining: 8m 41s. Rate: 153.2 symbols/min [2025-10-08T22:36:31.204403] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:31.208522] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52481 primary records. [2025-10-08T22:36:31.208717] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:31.209029] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-08T22:36:31.227895] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-08T22:36:31.228146] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-08T22:36:31.230385] [INFO ] [MAIN ] Derivative Progress: 441/1771 symbols completed. CRGY took 1.1s. Estimated remaining: 8m 40s. Rate: 153.5 symbols/min [2025-10-08T22:36:31.230688] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:31.294486] [DEBUG] [LOCAL ] CRK: Loaded 52203 existing records from primary storage. [2025-10-08T22:36:31.294756] [INFO ] [MAIN ] CRK: Loaded 52203 primary data records. [2025-10-08T22:36:31.372563] [DEBUG] [LOCAL ] CRI: Loaded 49762 existing records from primary storage. [2025-10-08T22:36:31.411586] [INFO ] [MAIN ] CRI: Loaded 49762 primary data records. [2025-10-08T22:36:31.424127] [DEBUG] [LOCAL ] CRL: Loaded 42811 existing records from primary storage. [2025-10-08T22:36:31.467203] [INFO ] [MAIN ] CRL: Loaded 42811 primary data records. [2025-10-08T22:36:32.291034] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:32.293521] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52203 primary records. [2025-10-08T22:36:32.294264] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-08T22:36:32.321918] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:32.324162] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-08T22:36:32.324386] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-08T22:36:32.327007] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49762 primary records. [2025-10-08T22:36:32.326143] [INFO ] [MAIN ] Derivative Progress: 442/1771 symbols completed. CRK took 1.1s. Estimated remaining: 8m 41s. Rate: 152.9 symbols/min [2025-10-08T22:36:32.328178] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-08T22:36:32.327171] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:32.357207] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:32.358975] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42811 primary records. [2025-10-08T22:36:32.359672] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-08T22:36:32.380150] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-08T22:36:32.380435] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-08T22:36:32.383763] [INFO ] [MAIN ] Derivative Progress: 443/1771 symbols completed. CRI took 1.2s. Estimated remaining: 8m 40s. Rate: 153.2 symbols/min [2025-10-08T22:36:32.381551] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-08T22:36:32.384068] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-08T22:36:32.386744] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:32.387102] [INFO ] [MAIN ] Derivative Progress: 444/1771 symbols completed. CRL took 1.2s. Estimated remaining: 8m 39s. Rate: 153.6 symbols/min [2025-10-08T22:36:32.387579] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:32.427257] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-08T22:36:32.427538] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-08T22:36:32.624233] [DEBUG] [LOCAL ] CRS: Loaded 43154 existing records from primary storage. [2025-10-08T22:36:32.659393] [DEBUG] [LOCAL ] CSAN: Loaded 42145 existing records from primary storage. [2025-10-08T22:36:32.659527] [INFO ] [MAIN ] CSAN: Loaded 42145 primary data records. [2025-10-08T22:36:32.676897] [INFO ] [MAIN ] CRS: Loaded 43154 primary data records. [2025-10-08T22:36:33.434307] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:33.435679] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-08T22:36:33.436004] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-08T22:36:33.467112] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-08T22:36:33.479683] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-08T22:36:33.482928] [INFO ] [MAIN ] Derivative Progress: 445/1771 symbols completed. CRM took 1.2s. Estimated remaining: 8m 40s. Rate: 152.9 symbols/min [2025-10-08T22:36:33.484671] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:33.485922] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:33.486791] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42145 primary records. [2025-10-08T22:36:33.486958] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-08T22:36:33.500633] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:33.501572] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43154 primary records. [2025-10-08T22:36:33.512382] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-08T22:36:33.517344] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-08T22:36:33.525574] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-08T22:36:33.531980] [INFO ] [MAIN ] Derivative Progress: 446/1771 symbols completed. CSAN took 1.1s. Estimated remaining: 8m 39s. Rate: 153.2 symbols/min [2025-10-08T22:36:33.532977] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:33.536729] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-08T22:36:33.536973] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-08T22:36:33.539233] [INFO ] [MAIN ] Derivative Progress: 447/1771 symbols completed. CRS took 1.2s. Estimated remaining: 8m 37s. Rate: 153.6 symbols/min [2025-10-08T22:36:33.539394] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:33.560898] [DEBUG] [LOCAL ] CSR: Loaded 12972 existing records from primary storage. [2025-10-08T22:36:33.561241] [INFO ] [MAIN ] CSR: Loaded 12972 primary data records. [2025-10-08T22:36:33.681324] [DEBUG] [LOCAL ] CSL: Loaded 31443 existing records from primary storage. [2025-10-08T22:36:33.692709] [INFO ] [MAIN ] CSL: Loaded 31443 primary data records. [2025-10-08T22:36:34.012593] [DEBUG] [LOCAL ] CSTM: Loaded 47541 existing records from primary storage. [2025-10-08T22:36:34.025271] [INFO ] [MAIN ] CSTM: Loaded 47541 primary data records. [2025-10-08T22:36:34.570020] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:34.572319] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12972 primary records. [2025-10-08T22:36:34.572981] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-08T22:36:34.604215] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:34.604838] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-08T22:36:34.605212] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-08T22:36:34.607388] [INFO ] [MAIN ] Derivative Progress: 448/1771 symbols completed. CSR took 1.1s. Estimated remaining: 8m 39s. Rate: 153.0 symbols/min [2025-10-08T22:36:34.608532] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31443 primary records. [2025-10-08T22:36:34.608712] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-08T22:36:34.628065] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-10-08T22:36:34.628213] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-08T22:36:34.630290] [INFO ] [MAIN ] Derivative Progress: 449/1771 symbols completed. CSL took 1.1s. Estimated remaining: 8m 37s. Rate: 153.3 symbols/min [2025-10-08T22:36:34.643089] [DEBUG] [MAIN ] CSTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:34.643833] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47541 primary records. [2025-10-08T22:36:34.643899] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-08T22:36:34.659613] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-08T22:36:34.659746] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-08T22:36:34.662043] [INFO ] [MAIN ] Derivative Progress: 450/1771 symbols completed. CSTM took 1.1s. Estimated remaining: 8m 36s. Rate: 153.6 symbols/min [2025-10-08T22:36:34.662532] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:34.662735] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:34.662851] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:34.673879] [DEBUG] [LOCAL ] CTBB: Loaded 7044 existing records from primary storage. [2025-10-08T22:36:34.679711] [INFO ] [MAIN ] CTBB: Loaded 7044 primary data records. [2025-10-08T22:36:34.751418] [DEBUG] [LOCAL ] CSV: Loaded 12748 existing records from primary storage. [2025-10-08T22:36:34.730019] [DEBUG] [LOCAL ] CTDD: Loaded 5820 existing records from primary storage. [2025-10-08T22:36:34.774402] [INFO ] [MAIN ] CTDD: Loaded 5820 primary data records. [2025-10-08T22:36:34.774259] [INFO ] [MAIN ] CSV: Loaded 12748 primary data records. [2025-10-08T22:36:35.708308] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:35.709808] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7044 primary records. [2025-10-08T22:36:35.711860] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-08T22:36:35.757077] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:35.760055] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12748 primary records. [2025-10-08T22:36:35.761023] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-08T22:36:35.759195] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:36:35.762216] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5820 primary records. [2025-10-08T22:36:35.761401] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-08T22:36:35.762333] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-08T22:36:35.761146] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-08T22:36:35.764310] [INFO ] [MAIN ] Derivative Progress: 451/1771 symbols completed. CTBB took 1.1s. Estimated remaining: 8m 38s. Rate: 153.0 symbols/min [2025-10-08T22:36:35.765148] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:35.794578] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-10-08T22:36:35.797607] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-08T22:36:35.800434] [INFO ] [MAIN ] Derivative Progress: 452/1771 symbols completed. CTDD took 1.1s. Estimated remaining: 8m 36s. Rate: 153.3 symbols/min [2025-10-08T22:36:35.801086] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-08T22:36:35.801419] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-08T22:36:35.801535] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:35.803777] [INFO ] [MAIN ] Derivative Progress: 453/1771 symbols completed. CSV took 1.1s. Estimated remaining: 8m 35s. Rate: 153.6 symbols/min [2025-10-08T22:36:35.804342] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:35.828526] [DEBUG] [LOCAL ] CTO: Loaded 27825 existing records from primary storage. [2025-10-08T22:36:35.828697] [INFO ] [MAIN ] CTO: Loaded 27825 primary data records. [2025-10-08T22:36:36.218924] [DEBUG] [LOCAL ] CTRE: Loaded 49289 existing records from primary storage. [2025-10-08T22:36:36.219920] [INFO ] [MAIN ] CTRE: Loaded 49289 primary data records. [2025-10-08T22:36:36.220576] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-08T22:36:36.227227] [INFO ] [MAIN ] CTRA: Loaded 53646 primary data records. [2025-10-08T22:36:36.860373] [DEBUG] [MAIN ] CTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:36.861953] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27825 primary records. [2025-10-08T22:36:36.862400] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-08T22:36:36.888899] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-08T22:36:36.889405] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-08T22:36:36.891455] [INFO ] [MAIN ] Derivative Progress: 454/1771 symbols completed. CTO took 1.1s. Estimated remaining: 8m 36s. Rate: 153.0 symbols/min [2025-10-08T22:36:36.891761] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:36.930333] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:36.932156] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49289 primary records. [2025-10-08T22:36:36.931153] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:36.932920] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53646 primary records. [2025-10-08T22:36:36.932985] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-08T22:36:36.933113] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-08T22:36:36.969047] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-08T22:36:36.981177] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-08T22:36:36.983600] [INFO ] [MAIN ] Derivative Progress: 455/1771 symbols completed. CTRA took 1.2s. Estimated remaining: 8m 35s. Rate: 153.3 symbols/min [2025-10-08T22:36:36.984504] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:36.988171] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-08T22:36:36.988447] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-08T22:36:36.990345] [INFO ] [MAIN ] Derivative Progress: 456/1771 symbols completed. CTRE took 1.2s. Estimated remaining: 8m 34s. Rate: 153.6 symbols/min [2025-10-08T22:36:36.990606] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:37.010553] [DEBUG] [LOCAL ] CTRI: Loaded 39419 existing records from primary storage. [2025-10-08T22:36:37.010863] [INFO ] [MAIN ] CTRI: Loaded 39419 primary data records. [2025-10-08T22:36:37.221776] [DEBUG] [LOCAL ] CUBI: Loaded 26977 existing records from primary storage. [2025-10-08T22:36:37.361122] [INFO ] [MAIN ] CUBI: Loaded 26977 primary data records. [2025-10-08T22:36:37.388116] [DEBUG] [LOCAL ] CUBE: Loaded 50778 existing records from primary storage. [2025-10-08T22:36:37.409093] [INFO ] [MAIN ] CUBE: Loaded 50778 primary data records. [2025-10-08T22:36:38.061888] [DEBUG] [MAIN ] CTRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:38.064335] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 39419 primary records. [2025-10-08T22:36:38.065083] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-08T22:36:38.086204] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-08T22:36:38.086386] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-08T22:36:38.089993] [INFO ] [MAIN ] Derivative Progress: 457/1771 symbols completed. CTRI took 1.2s. Estimated remaining: 8m 35s. Rate: 153.0 symbols/min [2025-10-08T22:36:38.090248] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:38.106832] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:38.107716] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 26977 primary records. [2025-10-08T22:36:38.108029] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-08T22:36:38.120976] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:38.121809] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50778 primary records. [2025-10-08T22:36:38.132810] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-08T22:36:38.146619] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-08T22:36:38.151500] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-08T22:36:38.153546] [INFO ] [MAIN ] Derivative Progress: 458/1771 symbols completed. CUBI took 1.2s. Estimated remaining: 8m 34s. Rate: 153.3 symbols/min [2025-10-08T22:36:38.153741] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:38.157057] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-08T22:36:38.157212] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-08T22:36:38.159856] [INFO ] [MAIN ] Derivative Progress: 459/1771 symbols completed. CUBE took 1.2s. Estimated remaining: 8m 32s. Rate: 153.6 symbols/min [2025-10-08T22:36:38.160036] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:38.165228] [DEBUG] [LOCAL ] CULP: Loaded 2885 existing records from primary storage. [2025-10-08T22:36:38.178726] [INFO ] [MAIN ] CULP: Loaded 2885 primary data records. [2025-10-08T22:36:38.299943] [DEBUG] [LOCAL ] CUK: Loaded 50970 existing records from primary storage. [2025-10-08T22:36:38.321689] [INFO ] [MAIN ] CUK: Loaded 50970 primary data records. [2025-10-08T22:36:38.616218] [DEBUG] [LOCAL ] CURB: Loaded 32646 existing records from primary storage. [2025-10-08T22:36:38.627835] [INFO ] [MAIN ] CURB: Loaded 32646 primary data records. [2025-10-08T22:36:39.142796] [DEBUG] [MAIN ] CULP: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-08T22:36:39.144583] [INFO ] [MAIN ] CULP: Generated 1791 derivative records from 2885 primary records. [2025-10-08T22:36:39.145452] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-08T22:36:39.172301] [DEBUG] [LOCAL ] CULP: Derivative data saved (1791 records). [2025-10-08T22:36:39.172622] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-08T22:36:39.175512] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:39.174906] [INFO ] [MAIN ] Derivative Progress: 460/1771 symbols completed. CULP took 1.0s. Estimated remaining: 8m 34s. Rate: 153.1 symbols/min [2025-10-08T22:36:39.175962] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:39.177189] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 50970 primary records. [2025-10-08T22:36:39.177290] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-08T22:36:39.209224] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:39.210687] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32646 primary records. [2025-10-08T22:36:39.211070] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-08T22:36:39.212218] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-08T22:36:39.212328] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-08T22:36:39.214602] [INFO ] [MAIN ] Derivative Progress: 461/1771 symbols completed. CUK took 1.1s. Estimated remaining: 8m 32s. Rate: 153.4 symbols/min [2025-10-08T22:36:39.229263] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:39.237531] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-08T22:36:39.237851] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-08T22:36:39.239956] [INFO ] [MAIN ] Derivative Progress: 462/1771 symbols completed. CURB took 1.1s. Estimated remaining: 8m 31s. Rate: 153.7 symbols/min [2025-10-08T22:36:39.240240] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:39.250523] [DEBUG] [LOCAL ] CURV: Loaded 26786 existing records from primary storage. [2025-10-08T22:36:39.251095] [INFO ] [MAIN ] CURV: Loaded 26786 primary data records. [2025-10-08T22:36:39.365558] [DEBUG] [LOCAL ] CVEO: Loaded 15261 existing records from primary storage. [2025-10-08T22:36:39.392326] [INFO ] [MAIN ] CVEO: Loaded 15261 primary data records. [2025-10-08T22:36:39.675498] [DEBUG] [LOCAL ] CUZ: Loaded 49428 existing records from primary storage. [2025-10-08T22:36:39.693287] [INFO ] [MAIN ] CUZ: Loaded 49428 primary data records. [2025-10-08T22:36:40.255137] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:40.257087] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26786 primary records. [2025-10-08T22:36:40.257189] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-08T22:36:40.274457] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-08T22:36:40.275338] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-08T22:36:40.277475] [INFO ] [MAIN ] Derivative Progress: 463/1771 symbols completed. CURV took 1.1s. Estimated remaining: 8m 32s. Rate: 153.2 symbols/min [2025-10-08T22:36:40.298777] [DEBUG] [MAIN ] CVEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:40.300562] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15261 primary records. [2025-10-08T22:36:40.300693] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-08T22:36:40.322381] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:40.326022] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49428 primary records. [2025-10-08T22:36:40.326347] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-08T22:36:40.345791] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-08T22:36:40.346135] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-08T22:36:40.348822] [INFO ] [MAIN ] Derivative Progress: 464/1771 symbols completed. CUZ took 1.1s. Estimated remaining: 8m 31s. Rate: 153.4 symbols/min [2025-10-08T22:36:40.349699] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-08T22:36:40.349764] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-08T22:36:40.351841] [INFO ] [MAIN ] Derivative Progress: 465/1771 symbols completed. CVEO took 1.1s. Estimated remaining: 8m 30s. Rate: 153.8 symbols/min [2025-10-08T22:36:40.352426] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:40.352542] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:40.352362] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:40.374164] [DEBUG] [LOCAL ] CVLG: Loaded 15513 existing records from primary storage. [2025-10-08T22:36:40.374410] [INFO ] [MAIN ] CVLG: Loaded 15513 primary data records. [2025-10-08T22:36:40.579113] [DEBUG] [LOCAL ] CVI: Loaded 46541 existing records from primary storage. [2025-10-08T22:36:40.611866] [INFO ] [MAIN ] CVI: Loaded 46541 primary data records. [2025-10-08T22:36:40.816357] [DEBUG] [LOCAL ] CVNA: Loaded 52896 existing records from primary storage. [2025-10-08T22:36:40.833266] [INFO ] [MAIN ] CVNA: Loaded 52896 primary data records. [2025-10-08T22:36:41.364268] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:41.365317] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15513 primary records. [2025-10-08T22:36:41.365422] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-08T22:36:41.392675] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-08T22:36:41.397768] [DEBUG] [MAIN ] CVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:41.398659] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-08T22:36:41.400887] [INFO ] [MAIN ] Derivative Progress: 466/1771 symbols completed. CVLG took 1.0s. Estimated remaining: 8m 31s. Rate: 153.2 symbols/min [2025-10-08T22:36:41.398479] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46541 primary records. [2025-10-08T22:36:41.401119] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:41.401242] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-08T22:36:41.421723] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-08T22:36:41.421912] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-08T22:36:41.425241] [INFO ] [MAIN ] Derivative Progress: 467/1771 symbols completed. CVI took 1.1s. Estimated remaining: 8m 30s. Rate: 153.5 symbols/min [2025-10-08T22:36:41.425501] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:41.438731] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:41.439447] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52896 primary records. [2025-10-08T22:36:41.439612] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-08T22:36:41.456701] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-08T22:36:41.456843] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-08T22:36:41.459294] [INFO ] [MAIN ] Derivative Progress: 468/1771 symbols completed. CVNA took 1.1s. Estimated remaining: 8m 28s. Rate: 153.8 symbols/min [2025-10-08T22:36:41.459586] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:41.502557] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-08T22:36:41.522421] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-08T22:36:41.522848] [DEBUG] [LOCAL ] CW: Loaded 22225 existing records from primary storage. [2025-10-08T22:36:41.523038] [INFO ] [MAIN ] CW: Loaded 22225 primary data records. [2025-10-08T22:36:41.747159] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-08T22:36:41.753106] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-08T22:36:42.489050] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:42.502380] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-08T22:36:42.503184] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-08T22:36:42.503102] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:42.505606] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22225 primary records. [2025-10-08T22:36:42.513379] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-08T22:36:42.531498] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-08T22:36:42.534313] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-08T22:36:42.536602] [INFO ] [MAIN ] Derivative Progress: 469/1771 symbols completed. CVS took 1.1s. Estimated remaining: 8m 30s. Rate: 153.2 symbols/min [2025-10-08T22:36:42.536906] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:42.542773] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-10-08T22:36:42.543227] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-08T22:36:42.545287] [INFO ] [MAIN ] Derivative Progress: 470/1771 symbols completed. CW took 1.1s. Estimated remaining: 8m 28s. Rate: 153.6 symbols/min [2025-10-08T22:36:42.545458] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:42.563604] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:42.564428] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-08T22:36:42.564536] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-08T22:36:42.581279] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-08T22:36:42.581559] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-08T22:36:42.583864] [INFO ] [MAIN ] Derivative Progress: 471/1771 symbols completed. CVX took 1.2s. Estimated remaining: 8m 27s. Rate: 153.8 symbols/min [2025-10-08T22:36:42.584136] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:42.647089] [DEBUG] [LOCAL ] CWAN: Loaded 52465 existing records from primary storage. [2025-10-08T22:36:42.648080] [INFO ] [MAIN ] CWAN: Loaded 52465 primary data records. [2025-10-08T22:36:42.647981] [DEBUG] [LOCAL ] CWK: Loaded 49460 existing records from primary storage. [2025-10-08T22:36:42.672232] [INFO ] [MAIN ] CWK: Loaded 49460 primary data records. [2025-10-08T22:36:42.864456] [DEBUG] [LOCAL ] CX: Loaded 52821 existing records from primary storage. [2025-10-08T22:36:42.934718] [INFO ] [MAIN ] CX: Loaded 52821 primary data records. [2025-10-08T22:36:43.650253] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:43.651583] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52465 primary records. [2025-10-08T22:36:43.652181] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-08T22:36:43.652113] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:43.653889] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49460 primary records. [2025-10-08T22:36:43.654239] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-08T22:36:43.684529] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-08T22:36:43.685761] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-08T22:36:43.689679] [INFO ] [MAIN ] Derivative Progress: 472/1771 symbols completed. CWAN took 1.2s. Estimated remaining: 8m 29s. Rate: 153.3 symbols/min [2025-10-08T22:36:43.691106] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-08T22:36:43.691575] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-08T22:36:43.689904] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:43.709526] [INFO ] [MAIN ] Derivative Progress: 473/1771 symbols completed. CWK took 1.2s. Estimated remaining: 8m 27s. Rate: 153.6 symbols/min [2025-10-08T22:36:43.709833] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:43.710265] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:43.711301] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52821 primary records. [2025-10-08T22:36:43.711786] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-08T22:36:43.732252] [DEBUG] [LOCAL ] CXH: Loaded 4425 existing records from primary storage. [2025-10-08T22:36:43.732809] [INFO ] [MAIN ] CXH: Loaded 4425 primary data records. [2025-10-08T22:36:43.758775] [DEBUG] [LOCAL ] CXE: Loaded 6197 existing records from primary storage. [2025-10-08T22:36:43.760012] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-08T22:36:43.770513] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-08T22:36:43.770592] [INFO ] [MAIN ] CXE: Loaded 6197 primary data records. [2025-10-08T22:36:43.790201] [INFO ] [MAIN ] Derivative Progress: 474/1771 symbols completed. CX took 1.2s. Estimated remaining: 8m 26s. Rate: 153.8 symbols/min [2025-10-08T22:36:43.830125] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:44.401151] [DEBUG] [LOCAL ] CXM: Loaded 47580 existing records from primary storage. [2025-10-08T22:36:44.401519] [INFO ] [MAIN ] CXM: Loaded 47580 primary data records. [2025-10-08T22:36:44.726614] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:44.728956] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4425 primary records. [2025-10-08T22:36:44.730611] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-08T22:36:44.758603] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-10-08T22:36:44.759374] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:44.760322] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-08T22:36:44.760250] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6197 primary records. [2025-10-08T22:36:44.762523] [INFO ] [MAIN ] Derivative Progress: 475/1771 symbols completed. CXH took 1.1s. Estimated remaining: 8m 27s. Rate: 153.3 symbols/min [2025-10-08T22:36:44.760478] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-08T22:36:44.762750] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:44.781177] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-08T22:36:44.781421] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-08T22:36:44.783748] [INFO ] [MAIN ] Derivative Progress: 476/1771 symbols completed. CXE took 1.1s. Estimated remaining: 8m 26s. Rate: 153.6 symbols/min [2025-10-08T22:36:44.784302] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:44.814010] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:44.814982] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47580 primary records. [2025-10-08T22:36:44.815153] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-08T22:36:44.839113] [DEBUG] [LOCAL ] CXT: Loaded 30997 existing records from primary storage. [2025-10-08T22:36:44.839950] [INFO ] [MAIN ] CXT: Loaded 30997 primary data records. [2025-10-08T22:36:44.877202] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-08T22:36:44.909112] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-08T22:36:44.940451] [INFO ] [MAIN ] Derivative Progress: 477/1771 symbols completed. CXM took 1.1s. Estimated remaining: 8m 25s. Rate: 153.8 symbols/min [2025-10-08T22:36:44.952705] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:45.187035] [DEBUG] [LOCAL ] CXW: Loaded 43976 existing records from primary storage. [2025-10-08T22:36:45.187280] [INFO ] [MAIN ] CXW: Loaded 43976 primary data records. [2025-10-08T22:36:45.261598] [DEBUG] [LOCAL ] CYD: Loaded 26383 existing records from primary storage. [2025-10-08T22:36:45.279566] [INFO ] [MAIN ] CYD: Loaded 26383 primary data records. [2025-10-08T22:36:45.854063] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:45.855995] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30997 primary records. [2025-10-08T22:36:45.857206] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-08T22:36:45.875317] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-08T22:36:45.875734] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-08T22:36:45.878071] [INFO ] [MAIN ] Derivative Progress: 478/1771 symbols completed. CXT took 1.1s. Estimated remaining: 8m 26s. Rate: 153.4 symbols/min [2025-10-08T22:36:45.895796] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:45.896597] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43976 primary records. [2025-10-08T22:36:45.896718] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-08T22:36:45.927620] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-08T22:36:45.928022] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-08T22:36:45.927899] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:45.930101] [INFO ] [MAIN ] Derivative Progress: 479/1771 symbols completed. CXW took 1.1s. Estimated remaining: 8m 24s. Rate: 153.7 symbols/min [2025-10-08T22:36:45.931043] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26383 primary records. [2025-10-08T22:36:45.931196] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-08T22:36:45.946669] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-08T22:36:45.946732] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-08T22:36:45.948691] [INFO ] [MAIN ] Derivative Progress: 480/1771 symbols completed. CYD took 1.0s. Estimated remaining: 8m 23s. Rate: 154.0 symbols/min [2025-10-08T22:36:45.949333] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:45.949278] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:45.949436] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:45.965794] [DEBUG] [LOCAL ] DAC: Loaded 12578 existing records from primary storage. [2025-10-08T22:36:45.966022] [INFO ] [MAIN ] DAC: Loaded 12578 primary data records. [2025-10-08T22:36:46.248860] [DEBUG] [LOCAL ] CYH: Loaded 47641 existing records from primary storage. [2025-10-08T22:36:46.306324] [INFO ] [MAIN ] CYH: Loaded 47641 primary data records. [2025-10-08T22:36:46.369097] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-08T22:36:46.401767] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-10-08T22:36:46.985850] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:46.987629] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12578 primary records. [2025-10-08T22:36:46.988266] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-08T22:36:47.008026] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-08T22:36:47.008880] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-08T22:36:47.011261] [INFO ] [MAIN ] Derivative Progress: 481/1771 symbols completed. DAC took 1.1s. Estimated remaining: 8m 25s. Rate: 153.4 symbols/min [2025-10-08T22:36:47.011435] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:47.028512] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:47.029675] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47641 primary records. [2025-10-08T22:36:47.029891] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-08T22:36:47.061941] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-08T22:36:47.062220] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:47.062423] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-08T22:36:47.064449] [INFO ] [MAIN ] Derivative Progress: 482/1771 symbols completed. CYH took 1.1s. Estimated remaining: 8m 23s. Rate: 153.7 symbols/min [2025-10-08T22:36:47.065484] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:47.065351] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-10-08T22:36:47.065700] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-08T22:36:47.089391] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-08T22:36:47.089542] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-08T22:36:47.092045] [INFO ] [MAIN ] Derivative Progress: 483/1771 symbols completed. D took 1.1s. Estimated remaining: 8m 22s. Rate: 154.0 symbols/min [2025-10-08T22:36:47.092315] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:47.133820] [DEBUG] [LOCAL ] DAO: Loaded 20100 existing records from primary storage. [2025-10-08T22:36:47.149599] [INFO ] [MAIN ] DAO: Loaded 20100 primary data records. [2025-10-08T22:36:47.183257] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-08T22:36:47.217346] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-08T22:36:47.444723] [DEBUG] [LOCAL ] DAN: Loaded 49113 existing records from primary storage. [2025-10-08T22:36:47.463563] [INFO ] [MAIN ] DAN: Loaded 49113 primary data records. [2025-10-08T22:36:48.229569] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:48.231210] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 20100 primary records. [2025-10-08T22:36:48.231707] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-08T22:36:48.253065] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-08T22:36:48.253370] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-08T22:36:48.256527] [INFO ] [MAIN ] Derivative Progress: 484/1771 symbols completed. DAO took 1.2s. Estimated remaining: 8m 24s. Rate: 153.4 symbols/min [2025-10-08T22:36:48.258585] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:48.275055] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:48.276619] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-08T22:36:48.276794] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-08T22:36:48.316516] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:48.318364] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49113 primary records. [2025-10-08T22:36:48.319387] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-08T22:36:48.320039] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-08T22:36:48.321347] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-08T22:36:48.324070] [INFO ] [MAIN ] Derivative Progress: 485/1771 symbols completed. DAL took 1.3s. Estimated remaining: 8m 22s. Rate: 153.6 symbols/min [2025-10-08T22:36:48.339938] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:48.356698] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-08T22:36:48.356875] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-08T22:36:48.359390] [INFO ] [MAIN ] Derivative Progress: 486/1771 symbols completed. DAN took 1.3s. Estimated remaining: 8m 21s. Rate: 153.9 symbols/min [2025-10-08T22:36:48.359815] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:48.378900] [DEBUG] [LOCAL ] DAR: Loaded 51876 existing records from primary storage. [2025-10-08T22:36:48.379399] [INFO ] [MAIN ] DAR: Loaded 51876 primary data records. [2025-10-08T22:36:48.717467] [DEBUG] [LOCAL ] DAVA: Loaded 41417 existing records from primary storage. [2025-10-08T22:36:48.718234] [INFO ] [MAIN ] DAVA: Loaded 41417 primary data records. [2025-10-08T22:36:48.801857] [DEBUG] [LOCAL ] DB: Loaded 52514 existing records from primary storage. [2025-10-08T22:36:48.808690] [INFO ] [MAIN ] DB: Loaded 52514 primary data records. [2025-10-08T22:36:49.365430] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:49.367225] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51876 primary records. [2025-10-08T22:36:49.367486] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-08T22:36:49.401195] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-08T22:36:49.409778] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:49.409170] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-08T22:36:49.412681] [INFO ] [MAIN ] Derivative Progress: 487/1771 symbols completed. DAR took 1.2s. Estimated remaining: 8m 22s. Rate: 153.4 symbols/min [2025-10-08T22:36:49.413597] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41417 primary records. [2025-10-08T22:36:49.413860] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:49.426892] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-08T22:36:49.428173] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:49.429805] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52514 primary records. [2025-10-08T22:36:49.430083] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-08T22:36:49.461904] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-08T22:36:49.462495] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-08T22:36:49.465585] [INFO ] [MAIN ] Derivative Progress: 488/1771 symbols completed. DB took 1.1s. Estimated remaining: 8m 21s. Rate: 153.6 symbols/min [2025-10-08T22:36:49.466347] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:49.468530] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-08T22:36:49.468682] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-08T22:36:49.470675] [INFO ] [MAIN ] Derivative Progress: 489/1771 symbols completed. DAVA took 1.1s. Estimated remaining: 8m 20s. Rate: 154.0 symbols/min [2025-10-08T22:36:49.471056] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:49.507530] [DEBUG] [LOCAL ] DBI: Loaded 44280 existing records from primary storage. [2025-10-08T22:36:49.507778] [INFO ] [MAIN ] DBI: Loaded 44280 primary data records. [2025-10-08T22:36:49.733044] [DEBUG] [LOCAL ] DCI: Loaded 37056 existing records from primary storage. [2025-10-08T22:36:49.848255] [INFO ] [MAIN ] DCI: Loaded 37056 primary data records. [2025-10-08T22:36:49.857027] [DEBUG] [LOCAL ] DBRG: Loaded 49813 existing records from primary storage. [2025-10-08T22:36:49.857910] [INFO ] [MAIN ] DBRG: Loaded 49813 primary data records. [2025-10-08T22:36:50.534500] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:50.536862] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 44280 primary records. [2025-10-08T22:36:50.537336] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-08T22:36:50.562835] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-08T22:36:50.564685] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-08T22:36:50.575694] [INFO ] [MAIN ] Derivative Progress: 490/1771 symbols completed. DBI took 1.2s. Estimated remaining: 8m 21s. Rate: 153.4 symbols/min [2025-10-08T22:36:50.581155] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:50.590283] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:50.597851] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37056 primary records. [2025-10-08T22:36:50.598234] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:50.599483] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49813 primary records. [2025-10-08T22:36:50.598567] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-08T22:36:50.600537] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-08T22:36:50.624567] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-08T22:36:50.624746] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-08T22:36:50.634579] [INFO ] [MAIN ] Derivative Progress: 491/1771 symbols completed. DCI took 1.2s. Estimated remaining: 8m 20s. Rate: 153.6 symbols/min [2025-10-08T22:36:50.635963] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-08T22:36:50.636116] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:50.636273] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-08T22:36:50.638436] [INFO ] [MAIN ] Derivative Progress: 492/1771 symbols completed. DBRG took 1.2s. Estimated remaining: 8m 18s. Rate: 154.0 symbols/min [2025-10-08T22:36:50.639081] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:50.684773] [DEBUG] [LOCAL ] DDS: Loaded 12832 existing records from primary storage. [2025-10-08T22:36:50.684980] [INFO ] [MAIN ] DDS: Loaded 12832 primary data records. [2025-10-08T22:36:50.778204] [DEBUG] [LOCAL ] DDL: Loaded 36794 existing records from primary storage. [2025-10-08T22:36:50.816952] [INFO ] [MAIN ] DDL: Loaded 36794 primary data records. [2025-10-08T22:36:50.830121] [DEBUG] [LOCAL ] DD: Loaded 52853 existing records from primary storage. [2025-10-08T22:36:50.900120] [INFO ] [MAIN ] DD: Loaded 52853 primary data records. [2025-10-08T22:36:51.719151] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:36:51.721153] [INFO ] [MAIN ] DDS: Generated 1793 derivative records from 12832 primary records. [2025-10-08T22:36:51.721293] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-08T22:36:51.753261] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:51.754751] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36794 primary records. [2025-10-08T22:36:51.754941] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-08T22:36:51.754013] [DEBUG] [LOCAL ] DDS: Derivative data saved (1793 records). [2025-10-08T22:36:51.757070] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-08T22:36:51.767393] [INFO ] [MAIN ] Derivative Progress: 493/1771 symbols completed. DDS took 1.1s. Estimated remaining: 8m 20s. Rate: 153.4 symbols/min [2025-10-08T22:36:51.786067] [DEBUG] [MAIN ] DD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:36:51.787463] [INFO ] [MAIN ] DD: Generated 1793 derivative records from 52853 primary records. [2025-10-08T22:36:51.788207] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-08T22:36:51.791631] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-08T22:36:51.799052] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-08T22:36:51.804198] [INFO ] [MAIN ] Derivative Progress: 494/1771 symbols completed. DDL took 1.2s. Estimated remaining: 8m 19s. Rate: 153.6 symbols/min [2025-10-08T22:36:51.811984] [DEBUG] [LOCAL ] DD: Derivative data saved (1793 records). [2025-10-08T22:36:51.812054] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-08T22:36:51.813995] [INFO ] [MAIN ] Derivative Progress: 495/1771 symbols completed. DD took 1.2s. Estimated remaining: 8m 17s. Rate: 154.0 symbols/min [2025-10-08T22:36:51.814407] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:51.814587] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:51.814468] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:51.821042] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-08T22:36:51.821318] [INFO ] [MAIN ] DDT: Loaded 2086 primary data records. [2025-10-08T22:36:52.185986] [DEBUG] [LOCAL ] DEA: Loaded 40555 existing records from primary storage. [2025-10-08T22:36:52.186308] [INFO ] [MAIN ] DEA: Loaded 40555 primary data records. [2025-10-08T22:36:52.305338] [DEBUG] [LOCAL ] DE: Loaded 47554 existing records from primary storage. [2025-10-08T22:36:52.316377] [INFO ] [MAIN ] DE: Loaded 47554 primary data records. [2025-10-08T22:36:52.823388] [DEBUG] [MAIN ] DDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:52.825127] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2086 primary records. [2025-10-08T22:36:52.825956] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-10-08T22:36:52.844472] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-10-08T22:36:52.847247] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-10-08T22:36:52.850232] [INFO ] [MAIN ] Derivative Progress: 496/1771 symbols completed. DDT took 1.0s. Estimated remaining: 8m 19s. Rate: 153.4 symbols/min [2025-10-08T22:36:52.850532] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:52.865627] [DEBUG] [MAIN ] DEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:52.866403] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 40555 primary records. [2025-10-08T22:36:52.866580] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-10-08T22:36:52.883785] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-10-08T22:36:52.885081] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-10-08T22:36:52.888136] [INFO ] [MAIN ] Derivative Progress: 497/1771 symbols completed. DEA took 1.1s. Estimated remaining: 8m 17s. Rate: 153.7 symbols/min [2025-10-08T22:36:52.896129] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:52.913893] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:52.914585] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47554 primary records. [2025-10-08T22:36:52.914805] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-08T22:36:52.939233] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-08T22:36:52.940067] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-08T22:36:52.942119] [INFO ] [MAIN ] Derivative Progress: 498/1771 symbols completed. DE took 1.1s. Estimated remaining: 8m 16s. Rate: 154.0 symbols/min [2025-10-08T22:36:52.955599] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:52.957414] [DEBUG] [LOCAL ] DEC: Loaded 30453 existing records from primary storage. [2025-10-08T22:36:52.957788] [INFO ] [MAIN ] DEC: Loaded 30453 primary data records. [2025-10-08T22:36:53.288892] [DEBUG] [LOCAL ] DECK: Loaded 53291 existing records from primary storage. [2025-10-08T22:36:53.314332] [INFO ] [MAIN ] DECK: Loaded 53291 primary data records. [2025-10-08T22:36:53.463059] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-08T22:36:53.501092] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-08T22:36:54.035145] [DEBUG] [MAIN ] DEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:54.036765] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30453 primary records. [2025-10-08T22:36:54.037487] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-10-08T22:36:54.081467] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-10-08T22:36:54.082017] [DEBUG] [MAIN ] DECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:54.083142] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53291 primary records. [2025-10-08T22:36:54.081798] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-10-08T22:36:54.083363] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-08T22:36:54.086628] [INFO ] [MAIN ] Derivative Progress: 499/1771 symbols completed. DEC took 1.2s. Estimated remaining: 8m 18s. Rate: 153.4 symbols/min [2025-10-08T22:36:54.087282] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:54.107686] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-08T22:36:54.108005] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-08T22:36:54.111571] [INFO ] [MAIN ] Derivative Progress: 500/1771 symbols completed. DECK took 1.2s. Estimated remaining: 8m 16s. Rate: 153.7 symbols/min [2025-10-08T22:36:54.112995] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:54.128248] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:54.129095] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-08T22:36:54.129208] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-08T22:36:54.145486] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-08T22:36:54.145602] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-08T22:36:54.157068] [INFO ] [MAIN ] Derivative Progress: 501/1771 symbols completed. DELL took 1.2s. Estimated remaining: 8m 15s. Rate: 153.9 symbols/min [2025-10-08T22:36:54.157366] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:54.186297] [DEBUG] [LOCAL ] DFIN: Loaded 22871 existing records from primary storage. [2025-10-08T22:36:54.187400] [DEBUG] [LOCAL ] DFH: Loaded 32083 existing records from primary storage. [2025-10-08T22:36:54.187596] [INFO ] [MAIN ] DFH: Loaded 32083 primary data records. [2025-10-08T22:36:54.187848] [INFO ] [MAIN ] DFIN: Loaded 22871 primary data records. [2025-10-08T22:36:54.252986] [DEBUG] [LOCAL ] DFP: Loaded 11313 existing records from primary storage. [2025-10-08T22:36:54.312101] [INFO ] [MAIN ] DFP: Loaded 11313 primary data records. [2025-10-08T22:36:55.118982] [DEBUG] [MAIN ] DFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:55.120066] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 32083 primary records. [2025-10-08T22:36:55.121772] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-08T22:36:55.150159] [DEBUG] [MAIN ] DFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:55.164073] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 22871 primary records. [2025-10-08T22:36:55.164971] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-08T22:36:55.166870] [DEBUG] [MAIN ] DFP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:55.167169] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-08T22:36:55.167763] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11313 primary records. [2025-10-08T22:36:55.178193] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-08T22:36:55.178274] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-08T22:36:55.181904] [INFO ] [MAIN ] Derivative Progress: 502/1771 symbols completed. DFH took 1.1s. Estimated remaining: 8m 16s. Rate: 153.4 symbols/min [2025-10-08T22:36:55.182740] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:55.185397] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-10-08T22:36:55.185936] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-08T22:36:55.195154] [INFO ] [MAIN ] Derivative Progress: 503/1771 symbols completed. DFIN took 1.1s. Estimated remaining: 8m 15s. Rate: 153.7 symbols/min [2025-10-08T22:36:55.195382] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:55.205132] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-08T22:36:55.205364] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-08T22:36:55.207757] [INFO ] [MAIN ] Derivative Progress: 504/1771 symbols completed. DFP took 1.1s. Estimated remaining: 8m 14s. Rate: 154.0 symbols/min [2025-10-08T22:36:55.208223] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:55.256561] [DEBUG] [LOCAL ] DGX: Loaded 44756 existing records from primary storage. [2025-10-08T22:36:55.256852] [INFO ] [MAIN ] DGX: Loaded 44756 primary data records. [2025-10-08T22:36:55.412878] [DEBUG] [LOCAL ] DHI: Loaded 53342 existing records from primary storage. [2025-10-08T22:36:55.451728] [INFO ] [MAIN ] DHI: Loaded 53342 primary data records. [2025-10-08T22:36:55.459817] [DEBUG] [LOCAL ] DHR: Loaded 53383 existing records from primary storage. [2025-10-08T22:36:55.459941] [INFO ] [MAIN ] DHR: Loaded 53383 primary data records. [2025-10-08T22:36:56.265896] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:56.267373] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44756 primary records. [2025-10-08T22:36:56.267683] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-08T22:36:56.286893] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-08T22:36:56.287828] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-08T22:36:56.291352] [INFO ] [MAIN ] Derivative Progress: 505/1771 symbols completed. DGX took 1.1s. Estimated remaining: 8m 15s. Rate: 153.5 symbols/min [2025-10-08T22:36:56.292284] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:56.306106] [DEBUG] [MAIN ] DHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:56.322173] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53342 primary records. [2025-10-08T22:36:56.322317] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-08T22:36:56.321300] [DEBUG] [MAIN ] DHR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:36:56.323628] [INFO ] [MAIN ] DHR: Generated 1793 derivative records from 53383 primary records. [2025-10-08T22:36:56.323919] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-08T22:36:56.350662] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-08T22:36:56.353738] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-08T22:36:56.354872] [DEBUG] [LOCAL ] DHR: Derivative data saved (1793 records). [2025-10-08T22:36:56.357255] [INFO ] [MAIN ] Derivative Progress: 506/1771 symbols completed. DHI took 1.2s. Estimated remaining: 8m 14s. Rate: 153.8 symbols/min [2025-10-08T22:36:56.357388] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-08T22:36:56.359816] [INFO ] [MAIN ] Derivative Progress: 507/1771 symbols completed. DHR took 1.2s. Estimated remaining: 8m 12s. Rate: 154.1 symbols/min [2025-10-08T22:36:56.359730] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:56.360398] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:56.394283] [DEBUG] [LOCAL ] DIAX: Loaded 13144 existing records from primary storage. [2025-10-08T22:36:56.394772] [INFO ] [MAIN ] DIAX: Loaded 13144 primary data records. [2025-10-08T22:36:56.394605] [DEBUG] [LOCAL ] DHX: Loaded 12939 existing records from primary storage. [2025-10-08T22:36:56.400729] [INFO ] [MAIN ] DHX: Loaded 12939 primary data records. [2025-10-08T22:36:56.582098] [DEBUG] [LOCAL ] DHT: Loaded 47880 existing records from primary storage. [2025-10-08T22:36:56.593124] [INFO ] [MAIN ] DHT: Loaded 47880 primary data records. [2025-10-08T22:36:57.330043] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:57.330948] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 13144 primary records. [2025-10-08T22:36:57.331047] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-08T22:36:57.358210] [DEBUG] [MAIN ] DHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:57.359588] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 12939 primary records. [2025-10-08T22:36:57.362101] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-08T22:36:57.362450] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-08T22:36:57.362532] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-10-08T22:36:57.373398] [INFO ] [MAIN ] Derivative Progress: 508/1771 symbols completed. DIAX took 1.0s. Estimated remaining: 8m 13s. Rate: 153.6 symbols/min [2025-10-08T22:36:57.389462] [DEBUG] [MAIN ] DHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:57.393406] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 47880 primary records. [2025-10-08T22:36:57.393757] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-10-08T22:36:57.394507] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-10-08T22:36:57.395375] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-10-08T22:36:57.398203] [INFO ] [MAIN ] Derivative Progress: 509/1771 symbols completed. DHX took 1.0s. Estimated remaining: 8m 12s. Rate: 153.9 symbols/min [2025-10-08T22:36:57.413137] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-10-08T22:36:57.413221] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-10-08T22:36:57.415305] [INFO ] [MAIN ] Derivative Progress: 510/1771 symbols completed. DHT took 1.1s. Estimated remaining: 8m 11s. Rate: 154.1 symbols/min [2025-10-08T22:36:57.415737] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:57.415856] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:57.415971] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:57.475755] [DEBUG] [LOCAL ] DIN: Loaded 37280 existing records from primary storage. [2025-10-08T22:36:57.475908] [INFO ] [MAIN ] DIN: Loaded 37280 primary data records. [2025-10-08T22:36:57.604991] [DEBUG] [LOCAL ] DINO: Loaded 52894 existing records from primary storage. [2025-10-08T22:36:57.605176] [INFO ] [MAIN ] DINO: Loaded 52894 primary data records. [2025-10-08T22:36:57.606220] [DEBUG] [LOCAL ] DK: Loaded 49326 existing records from primary storage. [2025-10-08T22:36:57.616726] [INFO ] [MAIN ] DK: Loaded 49326 primary data records. [2025-10-08T22:36:58.449887] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:58.451079] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37280 primary records. [2025-10-08T22:36:58.451590] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-08T22:36:58.472284] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-08T22:36:58.473738] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-08T22:36:58.477084] [INFO ] [MAIN ] Derivative Progress: 511/1771 symbols completed. DIN took 1.1s. Estimated remaining: 8m 12s. Rate: 153.6 symbols/min [2025-10-08T22:36:58.477693] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:58.503052] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:58.504191] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49326 primary records. [2025-10-08T22:36:58.503424] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:58.504424] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-08T22:36:58.505318] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52894 primary records. [2025-10-08T22:36:58.506022] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-08T22:36:58.531251] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-08T22:36:58.531537] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-08T22:36:58.536402] [INFO ] [MAIN ] Derivative Progress: 512/1771 symbols completed. DK took 1.1s. Estimated remaining: 8m 11s. Rate: 153.9 symbols/min [2025-10-08T22:36:58.536844] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:58.546626] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-08T22:36:58.546776] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-08T22:36:58.549543] [INFO ] [MAIN ] Derivative Progress: 513/1771 symbols completed. DINO took 1.1s. Estimated remaining: 8m 10s. Rate: 154.2 symbols/min [2025-10-08T22:36:58.550071] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:58.558328] [DEBUG] [LOCAL ] DKL: Loaded 17900 existing records from primary storage. [2025-10-08T22:36:58.558620] [INFO ] [MAIN ] DKL: Loaded 17900 primary data records. [2025-10-08T22:36:58.904961] [DEBUG] [LOCAL ] DLB: Loaded 32096 existing records from primary storage. [2025-10-08T22:36:58.920790] [INFO ] [MAIN ] DLB: Loaded 32096 primary data records. [2025-10-08T22:36:58.937826] [DEBUG] [LOCAL ] DKS: Loaded 49707 existing records from primary storage. [2025-10-08T22:36:58.978544] [INFO ] [MAIN ] DKS: Loaded 49707 primary data records. [2025-10-08T22:36:59.553022] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:59.554415] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 17900 primary records. [2025-10-08T22:36:59.554659] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-08T22:36:59.573859] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-08T22:36:59.574482] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-08T22:36:59.576810] [INFO ] [MAIN ] Derivative Progress: 514/1771 symbols completed. DKL took 1.1s. Estimated remaining: 8m 11s. Rate: 153.7 symbols/min [2025-10-08T22:36:59.577425] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:59.595174] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:59.595942] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32096 primary records. [2025-10-08T22:36:59.596108] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-08T22:36:59.612918] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-08T22:36:59.615217] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-08T22:36:59.617519] [INFO ] [MAIN ] Derivative Progress: 515/1771 symbols completed. DLB took 1.1s. Estimated remaining: 8m 10s. Rate: 153.9 symbols/min [2025-10-08T22:36:59.617789] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:59.631426] [DEBUG] [MAIN ] DKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:36:59.632127] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49707 primary records. [2025-10-08T22:36:59.632329] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-08T22:36:59.648429] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-08T22:36:59.648525] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-08T22:36:59.650871] [INFO ] [MAIN ] Derivative Progress: 516/1771 symbols completed. DKS took 1.1s. Estimated remaining: 8m 8s. Rate: 154.2 symbols/min [2025-10-08T22:36:59.651085] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:36:59.685928] [DEBUG] [LOCAL ] DLX: Loaded 28454 existing records from primary storage. [2025-10-08T22:36:59.686940] [INFO ] [MAIN ] DLX: Loaded 28454 primary data records. [2025-10-08T22:36:59.798992] [DEBUG] [LOCAL ] DLR: Loaded 50850 existing records from primary storage. [2025-10-08T22:36:59.816303] [INFO ] [MAIN ] DLR: Loaded 50850 primary data records. [2025-10-08T22:36:59.816742] [DEBUG] [LOCAL ] DLY: Loaded 20261 existing records from primary storage. [2025-10-08T22:36:59.833098] [INFO ] [MAIN ] DLY: Loaded 20261 primary data records. [2025-10-08T22:37:00.692771] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:00.693795] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28454 primary records. [2025-10-08T22:37:00.694145] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-08T22:37:00.712403] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-08T22:37:00.714671] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-08T22:37:00.719950] [INFO ] [MAIN ] Derivative Progress: 517/1771 symbols completed. DLX took 1.1s. Estimated remaining: 8m 10s. Rate: 153.7 symbols/min [2025-10-08T22:37:00.720733] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:00.742556] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:00.750163] [DEBUG] [MAIN ] DLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:00.751204] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50850 primary records. [2025-10-08T22:37:00.751493] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-08T22:37:00.752364] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20261 primary records. [2025-10-08T22:37:00.755747] [DEBUG] [LOCAL ] DMA: Loaded 4615 existing records from primary storage. [2025-10-08T22:37:00.755516] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-08T22:37:00.756925] [INFO ] [MAIN ] DMA: Loaded 4615 primary data records. [2025-10-08T22:37:00.863361] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-08T22:37:00.874528] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-08T22:37:00.890818] [INFO ] [MAIN ] Derivative Progress: 518/1771 symbols completed. DLY took 1.2s. Estimated remaining: 8m 9s. Rate: 153.9 symbols/min [2025-10-08T22:37:00.891200] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:00.981260] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-08T22:37:01.103276] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-08T22:37:01.116890] [DEBUG] [LOCAL ] DMB: Loaded 10262 existing records from primary storage. [2025-10-08T22:37:01.115857] [INFO ] [MAIN ] Derivative Progress: 519/1771 symbols completed. DLR took 1.5s. Estimated remaining: 8m 8s. Rate: 154.0 symbols/min [2025-10-08T22:37:01.117354] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:01.117481] [INFO ] [MAIN ] DMB: Loaded 10262 primary data records. [2025-10-08T22:37:01.490473] [DEBUG] [MAIN ] DMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:01.505547] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4615 primary records. [2025-10-08T22:37:01.507225] [DEBUG] [LOCAL ] DNA: Loaded 48491 existing records from primary storage. [2025-10-08T22:37:01.507539] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-08T22:37:01.507673] [INFO ] [MAIN ] DNA: Loaded 48491 primary data records. [2025-10-08T22:37:01.635827] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-10-08T22:37:01.642131] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-08T22:37:01.654714] [INFO ] [MAIN ] Derivative Progress: 520/1771 symbols completed. DMA took 0.9s. Estimated remaining: 8m 8s. Rate: 153.9 symbols/min [2025-10-08T22:37:01.655083] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:01.904330] [DEBUG] [MAIN ] DMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:01.905154] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10262 primary records. [2025-10-08T22:37:01.905398] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-08T22:37:01.922925] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-08T22:37:01.933798] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-08T22:37:01.936108] [INFO ] [MAIN ] Derivative Progress: 521/1771 symbols completed. DMB took 1.0s. Estimated remaining: 8m 7s. Rate: 154.0 symbols/min [2025-10-08T22:37:01.936272] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:01.963441] [DEBUG] [LOCAL ] DNOW: Loaded 43622 existing records from primary storage. [2025-10-08T22:37:01.963875] [INFO ] [MAIN ] DNOW: Loaded 43622 primary data records. [2025-10-08T22:37:02.084621] [DEBUG] [MAIN ] DNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:02.094033] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48491 primary records. [2025-10-08T22:37:02.094507] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-08T22:37:02.172902] [DEBUG] [LOCAL ] DNP: Loaded 33275 existing records from primary storage. [2025-10-08T22:37:02.303391] [INFO ] [MAIN ] DNP: Loaded 33275 primary data records. [2025-10-08T22:37:02.314438] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-08T22:37:02.314528] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-08T22:37:02.317872] [INFO ] [MAIN ] Derivative Progress: 522/1771 symbols completed. DNA took 1.2s. Estimated remaining: 8m 7s. Rate: 154.0 symbols/min [2025-10-08T22:37:02.324118] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:02.720709] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:02.723927] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43622 primary records. [2025-10-08T22:37:02.724246] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-08T22:37:02.724105] [DEBUG] [LOCAL ] DOC: Loaded 53548 existing records from primary storage. [2025-10-08T22:37:02.725467] [INFO ] [MAIN ] DOC: Loaded 53548 primary data records. [2025-10-08T22:37:02.755788] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-08T22:37:02.780045] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-08T22:37:02.787694] [INFO ] [MAIN ] Derivative Progress: 523/1771 symbols completed. DNOW took 1.1s. Estimated remaining: 8m 7s. Rate: 153.9 symbols/min [2025-10-08T22:37:02.898143] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:02.909521] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33275 primary records. [2025-10-08T22:37:02.909619] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-08T22:37:02.995971] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-08T22:37:03.103795] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-08T22:37:03.119324] [INFO ] [MAIN ] Derivative Progress: 524/1771 symbols completed. DNP took 1.2s. Estimated remaining: 8m 6s. Rate: 153.9 symbols/min [2025-10-08T22:37:03.145880] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:03.146807] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53548 primary records. [2025-10-08T22:37:03.146888] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-08T22:37:03.163691] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-08T22:37:03.163806] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-08T22:37:03.166006] [INFO ] [MAIN ] Derivative Progress: 525/1771 symbols completed. DOC took 0.8s. Estimated remaining: 8m 5s. Rate: 154.2 symbols/min [2025-10-08T22:37:03.166875] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:03.166987] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:03.166754] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:03.260882] [DEBUG] [LOCAL ] DOCN: Loaded 50781 existing records from primary storage. [2025-10-08T22:37:03.261815] [DEBUG] [LOCAL ] DOCS: Loaded 50973 existing records from primary storage. [2025-10-08T22:37:03.272672] [INFO ] [MAIN ] DOCN: Loaded 50781 primary data records. [2025-10-08T22:37:03.272547] [INFO ] [MAIN ] DOCS: Loaded 50973 primary data records. [2025-10-08T22:37:03.296078] [DEBUG] [LOCAL ] DOLE: Loaded 38840 existing records from primary storage. [2025-10-08T22:37:03.332500] [INFO ] [MAIN ] DOLE: Loaded 38840 primary data records. [2025-10-08T22:37:04.283528] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:04.284592] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 50973 primary records. [2025-10-08T22:37:04.284953] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-08T22:37:04.306762] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-08T22:37:04.307169] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-08T22:37:04.309176] [INFO ] [MAIN ] Derivative Progress: 526/1771 symbols completed. DOCS took 1.1s. Estimated remaining: 8m 6s. Rate: 153.6 symbols/min [2025-10-08T22:37:04.321700] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:04.337357] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:04.338320] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50781 primary records. [2025-10-08T22:37:04.338920] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-08T22:37:04.338825] [DEBUG] [MAIN ] DOLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:04.340842] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 38840 primary records. [2025-10-08T22:37:04.341014] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-10-08T22:37:04.370481] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-08T22:37:04.372388] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-08T22:37:04.374627] [INFO ] [MAIN ] Derivative Progress: 527/1771 symbols completed. DOCN took 1.2s. Estimated remaining: 8m 5s. Rate: 153.9 symbols/min [2025-10-08T22:37:04.376318] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:04.377639] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-10-08T22:37:04.378014] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-10-08T22:37:04.380594] [INFO ] [MAIN ] Derivative Progress: 528/1771 symbols completed. DOLE took 1.2s. Estimated remaining: 8m 4s. Rate: 154.2 symbols/min [2025-10-08T22:37:04.381150] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:04.407833] [DEBUG] [LOCAL ] DOUG: Loaded 34415 existing records from primary storage. [2025-10-08T22:37:04.408034] [INFO ] [MAIN ] DOUG: Loaded 34415 primary data records. [2025-10-08T22:37:04.754237] [DEBUG] [LOCAL ] DOV: Loaded 45490 existing records from primary storage. [2025-10-08T22:37:04.755011] [INFO ] [MAIN ] DOV: Loaded 45490 primary data records. [2025-10-08T22:37:04.858945] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-08T22:37:04.865708] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-08T22:37:05.418747] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:05.420877] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34415 primary records. [2025-10-08T22:37:05.421302] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-08T22:37:05.442282] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-08T22:37:05.450479] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-08T22:37:05.457544] [INFO ] [MAIN ] Derivative Progress: 529/1771 symbols completed. DOUG took 1.1s. Estimated remaining: 8m 5s. Rate: 153.7 symbols/min [2025-10-08T22:37:05.459191] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:05.459325] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:05.461291] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45490 primary records. [2025-10-08T22:37:05.462118] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-08T22:37:05.497076] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:05.499612] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-08T22:37:05.499981] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-08T22:37:05.503378] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-08T22:37:05.503481] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-08T22:37:05.506110] [INFO ] [MAIN ] Derivative Progress: 530/1771 symbols completed. DOV took 1.1s. Estimated remaining: 8m 4s. Rate: 153.9 symbols/min [2025-10-08T22:37:05.506549] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:05.528844] [DEBUG] [LOCAL ] DPG: Loaded 13460 existing records from primary storage. [2025-10-08T22:37:05.529041] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-08T22:37:05.529283] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-08T22:37:05.531799] [INFO ] [MAIN ] DPG: Loaded 13460 primary data records. [2025-10-08T22:37:05.531698] [INFO ] [MAIN ] Derivative Progress: 531/1771 symbols completed. DOW took 1.2s. Estimated remaining: 8m 3s. Rate: 154.2 symbols/min [2025-10-08T22:37:05.532042] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:05.859411] [DEBUG] [LOCAL ] DQ: Loaded 43500 existing records from primary storage. [2025-10-08T22:37:05.869355] [INFO ] [MAIN ] DQ: Loaded 43500 primary data records. [2025-10-08T22:37:05.996165] [DEBUG] [LOCAL ] DRD: Loaded 37231 existing records from primary storage. [2025-10-08T22:37:06.000010] [INFO ] [MAIN ] DRD: Loaded 37231 primary data records. [2025-10-08T22:37:06.576320] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:06.577291] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13460 primary records. [2025-10-08T22:37:06.577393] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-08T22:37:06.598048] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-08T22:37:06.598737] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-08T22:37:06.601393] [INFO ] [MAIN ] Derivative Progress: 532/1771 symbols completed. DPG took 1.1s. Estimated remaining: 8m 4s. Rate: 153.7 symbols/min [2025-10-08T22:37:06.602172] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:06.626111] [DEBUG] [MAIN ] DQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:06.628895] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43500 primary records. [2025-10-08T22:37:06.629954] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-08T22:37:06.651326] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:06.657470] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37231 primary records. [2025-10-08T22:37:06.657931] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-08T22:37:06.686907] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-08T22:37:06.688409] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-08T22:37:06.691868] [INFO ] [MAIN ] Derivative Progress: 533/1771 symbols completed. DQ took 1.2s. Estimated remaining: 8m 3s. Rate: 153.9 symbols/min [2025-10-08T22:37:06.692108] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:06.688172] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-08T22:37:06.692781] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-08T22:37:06.695208] [INFO ] [MAIN ] Derivative Progress: 534/1771 symbols completed. DRD took 1.2s. Estimated remaining: 8m 1s. Rate: 154.2 symbols/min [2025-10-08T22:37:06.695717] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:06.714166] [DEBUG] [LOCAL ] DRH: Loaded 50450 existing records from primary storage. [2025-10-08T22:37:06.716351] [INFO ] [MAIN ] DRH: Loaded 50450 primary data records. [2025-10-08T22:37:06.790803] [DEBUG] [LOCAL ] DRLL: Loaded 9289 existing records from primary storage. [2025-10-08T22:37:06.802746] [INFO ] [MAIN ] DRLL: Loaded 9289 primary data records. [2025-10-08T22:37:07.189464] [DEBUG] [LOCAL ] DRI: Loaded 47675 existing records from primary storage. [2025-10-08T22:37:07.222677] [INFO ] [MAIN ] DRI: Loaded 47675 primary data records. [2025-10-08T22:37:07.686321] [DEBUG] [MAIN ] DRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:07.687216] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50450 primary records. [2025-10-08T22:37:07.687335] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-08T22:37:07.716812] [DEBUG] [MAIN ] DRLL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:37:07.721241] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 9289 primary records. [2025-10-08T22:37:07.724839] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-08T22:37:07.727060] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-08T22:37:07.727873] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-08T22:37:07.729992] [INFO ] [MAIN ] Derivative Progress: 535/1771 symbols completed. DRH took 1.1s. Estimated remaining: 8m 2s. Rate: 153.7 symbols/min [2025-10-08T22:37:07.730281] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:07.753666] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-10-08T22:37:07.754197] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-08T22:37:07.756955] [INFO ] [MAIN ] Derivative Progress: 536/1771 symbols completed. DRLL took 1.1s. Estimated remaining: 8m 1s. Rate: 154.0 symbols/min [2025-10-08T22:37:07.770022] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:07.770345] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:07.771839] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47675 primary records. [2025-10-08T22:37:07.771911] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-08T22:37:07.799054] [DEBUG] [LOCAL ] DSMC: Loaded 1842 existing records from primary storage. [2025-10-08T22:37:07.800327] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-08T22:37:07.800513] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-08T22:37:07.800619] [INFO ] [MAIN ] DSMC: Loaded 1842 primary data records. [2025-10-08T22:37:07.825374] [INFO ] [MAIN ] Derivative Progress: 537/1771 symbols completed. DRI took 1.1s. Estimated remaining: 8m 0s. Rate: 154.2 symbols/min [2025-10-08T22:37:07.845868] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:07.908826] [DEBUG] [LOCAL ] DSL: Loaded 28586 existing records from primary storage. [2025-10-08T22:37:07.931925] [INFO ] [MAIN ] DSL: Loaded 28586 primary data records. [2025-10-08T22:37:08.291601] [DEBUG] [LOCAL ] DSU: Loaded 22858 existing records from primary storage. [2025-10-08T22:37:08.360997] [INFO ] [MAIN ] DSU: Loaded 22858 primary data records. [2025-10-08T22:37:08.709637] [DEBUG] [MAIN ] DSMC: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-08T22:37:08.877024] [INFO ] [MAIN ] DSMC: Generated 1791 derivative records from 1842 primary records. [2025-10-08T22:37:08.901023] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-10-08T22:37:09.188174] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1791 records). [2025-10-08T22:37:09.190839] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-10-08T22:37:09.193329] [INFO ] [MAIN ] Derivative Progress: 538/1771 symbols completed. DSMC took 1.4s. Estimated remaining: 8m 2s. Rate: 153.5 symbols/min [2025-10-08T22:37:09.217467] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:09.218544] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28586 primary records. [2025-10-08T22:37:09.218670] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-08T22:37:09.241059] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-08T22:37:09.241501] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-08T22:37:09.244099] [INFO ] [MAIN ] Derivative Progress: 539/1771 symbols completed. DSL took 1.5s. Estimated remaining: 8m 1s. Rate: 153.7 symbols/min [2025-10-08T22:37:09.260521] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:09.261320] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22858 primary records. [2025-10-08T22:37:09.261392] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-08T22:37:09.276484] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-08T22:37:09.276568] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-08T22:37:09.278847] [INFO ] [MAIN ] Derivative Progress: 540/1771 symbols completed. DSU took 1.4s. Estimated remaining: 7m 60s. Rate: 154.0 symbols/min [2025-10-08T22:37:09.279353] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:09.279441] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:09.279546] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:09.288535] [DEBUG] [LOCAL ] DTB: Loaded 5032 existing records from primary storage. [2025-10-08T22:37:09.288792] [INFO ] [MAIN ] DTB: Loaded 5032 primary data records. [2025-10-08T22:37:09.635176] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-10-08T22:37:09.635515] [INFO ] [MAIN ] DT: Loaded 52944 primary data records. [2025-10-08T22:37:09.693604] [DEBUG] [LOCAL ] DTE: Loaded 47531 existing records from primary storage. [2025-10-08T22:37:09.699695] [INFO ] [MAIN ] DTE: Loaded 47531 primary data records. [2025-10-08T22:37:10.294822] [DEBUG] [MAIN ] DTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:10.296227] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 5032 primary records. [2025-10-08T22:37:10.296688] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-08T22:37:10.315086] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-10-08T22:37:10.315552] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-08T22:37:10.317957] [INFO ] [MAIN ] Derivative Progress: 541/1771 symbols completed. DTB took 1.0s. Estimated remaining: 8m 1s. Rate: 153.5 symbols/min [2025-10-08T22:37:10.318118] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:10.335887] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:10.338293] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52944 primary records. [2025-10-08T22:37:10.338479] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-08T22:37:10.344421] [DEBUG] [LOCAL ] DTG: Loaded 5856 existing records from primary storage. [2025-10-08T22:37:10.345030] [INFO ] [MAIN ] DTG: Loaded 5856 primary data records. [2025-10-08T22:37:10.398108] [DEBUG] [MAIN ] DTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:10.414879] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47531 primary records. [2025-10-08T22:37:10.420116] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-08T22:37:10.483632] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-08T22:37:10.495363] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-08T22:37:10.497837] [INFO ] [MAIN ] Derivative Progress: 542/1771 symbols completed. DTE took 1.2s. Estimated remaining: 7m 60s. Rate: 153.7 symbols/min [2025-10-08T22:37:10.498203] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:10.512856] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-08T22:37:10.523410] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-08T22:37:10.592198] [INFO ] [MAIN ] Derivative Progress: 543/1771 symbols completed. DT took 1.3s. Estimated remaining: 7m 59s. Rate: 153.9 symbols/min [2025-10-08T22:37:10.739586] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:10.791374] [DEBUG] [LOCAL ] DTM: Loaded 44082 existing records from primary storage. [2025-10-08T22:37:10.791908] [INFO ] [MAIN ] DTM: Loaded 44082 primary data records. [2025-10-08T22:37:10.791743] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:10.813705] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5856 primary records. [2025-10-08T22:37:10.829147] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-08T22:37:11.057724] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-08T22:37:11.135625] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-08T22:37:11.138051] [INFO ] [MAIN ] Derivative Progress: 544/1771 symbols completed. DTG took 0.8s. Estimated remaining: 7m 59s. Rate: 153.8 symbols/min [2025-10-08T22:37:11.138239] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:11.139775] [DEBUG] [LOCAL ] DUK: Loaded 53445 existing records from primary storage. [2025-10-08T22:37:11.142101] [INFO ] [MAIN ] DUK: Loaded 53445 primary data records. [2025-10-08T22:37:11.505064] [DEBUG] [MAIN ] DTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:11.506071] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44082 primary records. [2025-10-08T22:37:11.507425] [DEBUG] [LOCAL ] DV: Loaded 51300 existing records from primary storage. [2025-10-08T22:37:11.507674] [INFO ] [MAIN ] DV: Loaded 51300 primary data records. [2025-10-08T22:37:11.507751] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-08T22:37:11.631464] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-10-08T22:37:11.652770] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-08T22:37:11.675080] [INFO ] [MAIN ] Derivative Progress: 545/1771 symbols completed. DTM took 1.2s. Estimated remaining: 7m 59s. Rate: 153.7 symbols/min [2025-10-08T22:37:11.693660] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:11.848562] [DEBUG] [MAIN ] DUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:11.850294] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53445 primary records. [2025-10-08T22:37:11.850532] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-08T22:37:11.871450] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-10-08T22:37:11.871936] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-08T22:37:11.875989] [INFO ] [MAIN ] Derivative Progress: 546/1771 symbols completed. DUK took 1.1s. Estimated remaining: 7m 58s. Rate: 153.8 symbols/min [2025-10-08T22:37:11.876868] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:11.904165] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:11.904897] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51300 primary records. [2025-10-08T22:37:11.904959] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-08T22:37:11.926126] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-08T22:37:11.927312] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-08T22:37:11.939867] [INFO ] [MAIN ] Derivative Progress: 547/1771 symbols completed. DV took 0.8s. Estimated remaining: 7m 57s. Rate: 154.1 symbols/min [2025-10-08T22:37:11.941360] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:11.942778] [DEBUG] [LOCAL ] DVA: Loaded 41008 existing records from primary storage. [2025-10-08T22:37:11.942868] [INFO ] [MAIN ] DVA: Loaded 41008 primary data records. [2025-10-08T22:37:12.128756] [DEBUG] [LOCAL ] DXC: Loaded 49857 existing records from primary storage. [2025-10-08T22:37:12.161108] [INFO ] [MAIN ] DXC: Loaded 49857 primary data records. [2025-10-08T22:37:12.394883] [DEBUG] [LOCAL ] DXYZ: Loaded 37113 existing records from primary storage. [2025-10-08T22:37:12.410115] [INFO ] [MAIN ] DXYZ: Loaded 37113 primary data records. [2025-10-08T22:37:12.971168] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:12.973031] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41008 primary records. [2025-10-08T22:37:12.973439] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-08T22:37:12.991340] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-08T22:37:12.991910] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-08T22:37:12.994166] [INFO ] [MAIN ] Derivative Progress: 548/1771 symbols completed. DVA took 1.3s. Estimated remaining: 7m 58s. Rate: 153.6 symbols/min [2025-10-08T22:37:12.994703] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:13.014089] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:13.014879] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49857 primary records. [2025-10-08T22:37:13.015424] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-08T22:37:13.040822] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-08T22:37:13.042841] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-08T22:37:13.045982] [INFO ] [MAIN ] Derivative Progress: 549/1771 symbols completed. DXC took 1.2s. Estimated remaining: 7m 57s. Rate: 153.8 symbols/min [2025-10-08T22:37:13.046199] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:13.062040] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:13.062894] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 37113 primary records. [2025-10-08T22:37:13.063022] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-08T22:37:13.080275] [DEBUG] [LOCAL ] DY: Loaded 28554 existing records from primary storage. [2025-10-08T22:37:13.085525] [INFO ] [MAIN ] DY: Loaded 28554 primary data records. [2025-10-08T22:37:13.088112] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-08T22:37:13.088255] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-08T22:37:13.090840] [INFO ] [MAIN ] Derivative Progress: 550/1771 symbols completed. DXYZ took 1.1s. Estimated remaining: 7m 56s. Rate: 154.1 symbols/min [2025-10-08T22:37:13.096743] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:13.254123] [DEBUG] [LOCAL ] E: Loaded 33186 existing records from primary storage. [2025-10-08T22:37:13.291685] [INFO ] [MAIN ] E: Loaded 33186 primary data records. [2025-10-08T22:37:13.612492] [DEBUG] [LOCAL ] EAF: Loaded 42154 existing records from primary storage. [2025-10-08T22:37:13.727774] [INFO ] [MAIN ] EAF: Loaded 42154 primary data records. [2025-10-08T22:37:14.055569] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:14.056947] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28554 primary records. [2025-10-08T22:37:14.057204] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-08T22:37:14.077445] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-08T22:37:14.079350] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-08T22:37:14.081578] [INFO ] [MAIN ] Derivative Progress: 551/1771 symbols completed. DY took 1.1s. Estimated remaining: 7m 56s. Rate: 153.6 symbols/min [2025-10-08T22:37:14.081994] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:14.098126] [DEBUG] [MAIN ] E: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:14.099389] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33186 primary records. [2025-10-08T22:37:14.099778] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-08T22:37:14.119317] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-08T22:37:14.114725] [DEBUG] [LOCAL ] EAI: Loaded 4002 existing records from primary storage. [2025-10-08T22:37:14.119706] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-08T22:37:14.122824] [INFO ] [MAIN ] EAI: Loaded 4002 primary data records. [2025-10-08T22:37:14.122699] [INFO ] [MAIN ] Derivative Progress: 552/1771 symbols completed. E took 1.1s. Estimated remaining: 7m 55s. Rate: 153.9 symbols/min [2025-10-08T22:37:14.128764] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:14.268922] [DEBUG] [MAIN ] EAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:14.280239] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 42154 primary records. [2025-10-08T22:37:14.280342] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-10-08T22:37:14.511304] [DEBUG] [LOCAL ] EARN: Loaded 29114 existing records from primary storage. [2025-10-08T22:37:14.530961] [INFO ] [MAIN ] EARN: Loaded 29114 primary data records. [2025-10-08T22:37:14.569956] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-10-08T22:37:14.595625] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-10-08T22:37:14.618545] [INFO ] [MAIN ] Derivative Progress: 553/1771 symbols completed. EAF took 1.5s. Estimated remaining: 7m 55s. Rate: 153.8 symbols/min [2025-10-08T22:37:14.857854] [DEBUG] [MAIN ] EAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:14.859227] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 4002 primary records. [2025-10-08T22:37:14.859314] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-10-08T22:37:14.876992] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-10-08T22:37:14.877307] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-10-08T22:37:14.879768] [INFO ] [MAIN ] Derivative Progress: 554/1771 symbols completed. EAI took 0.8s. Estimated remaining: 7m 54s. Rate: 153.9 symbols/min [2025-10-08T22:37:14.894861] [DEBUG] [MAIN ] EARN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:14.895586] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 29114 primary records. [2025-10-08T22:37:14.895671] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-10-08T22:37:14.910928] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-10-08T22:37:14.911031] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-10-08T22:37:14.913597] [INFO ] [MAIN ] Derivative Progress: 555/1771 symbols completed. EARN took 0.8s. Estimated remaining: 7m 53s. Rate: 154.2 symbols/min [2025-10-08T22:37:14.914256] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:14.914451] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:14.914369] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:14.937325] [DEBUG] [LOCAL ] EBF: Loaded 19015 existing records from primary storage. [2025-10-08T22:37:14.937564] [INFO ] [MAIN ] EBF: Loaded 19015 primary data records. [2025-10-08T22:37:15.112878] [DEBUG] [LOCAL ] EBR: Loaded 43127 existing records from primary storage. [2025-10-08T22:37:15.131129] [INFO ] [MAIN ] EBR: Loaded 43127 primary data records. [2025-10-08T22:37:15.197583] [DEBUG] [LOCAL ] EAT: Loaded 49839 existing records from primary storage. [2025-10-08T22:37:15.346187] [INFO ] [MAIN ] EAT: Loaded 49839 primary data records. [2025-10-08T22:37:15.911040] [DEBUG] [MAIN ] EBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:15.911964] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19015 primary records. [2025-10-08T22:37:15.912067] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-08T22:37:15.933673] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-08T22:37:15.934104] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-08T22:37:15.936259] [INFO ] [MAIN ] Derivative Progress: 556/1771 symbols completed. EBF took 1.0s. Estimated remaining: 7m 54s. Rate: 153.7 symbols/min [2025-10-08T22:37:15.936438] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:15.949882] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:15.950563] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43127 primary records. [2025-10-08T22:37:15.950733] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-08T22:37:15.968715] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-08T22:37:15.969103] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-08T22:37:15.979020] [INFO ] [MAIN ] Derivative Progress: 557/1771 symbols completed. EBR took 1.1s. Estimated remaining: 7m 53s. Rate: 154.0 symbols/min [2025-10-08T22:37:15.984337] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:15.984548] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:15.985385] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49839 primary records. [2025-10-08T22:37:15.985758] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-08T22:37:16.013564] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-08T22:37:16.013767] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-08T22:37:16.016087] [INFO ] [MAIN ] Derivative Progress: 558/1771 symbols completed. EAT took 1.1s. Estimated remaining: 7m 52s. Rate: 154.2 symbols/min [2025-10-08T22:37:16.016512] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:16.044998] [DEBUG] [LOCAL ] EBS: Loaded 46781 existing records from primary storage. [2025-10-08T22:37:16.045244] [INFO ] [MAIN ] EBS: Loaded 46781 primary data records. [2025-10-08T22:37:16.245994] [DEBUG] [LOCAL ] EC: Loaded 49065 existing records from primary storage. [2025-10-08T22:37:16.349779] [INFO ] [MAIN ] EC: Loaded 49065 primary data records. [2025-10-08T22:37:16.369082] [DEBUG] [LOCAL ] ECAT: Loaded 29416 existing records from primary storage. [2025-10-08T22:37:16.390708] [INFO ] [MAIN ] ECAT: Loaded 29416 primary data records. [2025-10-08T22:37:17.050771] [DEBUG] [MAIN ] EBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:17.052745] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46781 primary records. [2025-10-08T22:37:17.052858] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-08T22:37:17.071627] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-08T22:37:17.071913] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-08T22:37:17.074088] [INFO ] [MAIN ] Derivative Progress: 559/1771 symbols completed. EBS took 1.1s. Estimated remaining: 7m 53s. Rate: 153.7 symbols/min [2025-10-08T22:37:17.074353] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:17.092711] [DEBUG] [MAIN ] EC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:17.094958] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49065 primary records. [2025-10-08T22:37:17.095806] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-08T22:37:17.120554] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:17.126161] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29416 primary records. [2025-10-08T22:37:17.126609] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-08T22:37:17.126347] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-08T22:37:17.127377] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-08T22:37:17.129666] [INFO ] [MAIN ] Derivative Progress: 560/1771 symbols completed. EC took 1.1s. Estimated remaining: 7m 52s. Rate: 154.0 symbols/min [2025-10-08T22:37:17.130167] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:17.158459] [DEBUG] [LOCAL ] ECCU: Loaded 2260 existing records from primary storage. [2025-10-08T22:37:17.159541] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-08T22:37:17.159486] [INFO ] [MAIN ] ECCU: Loaded 2260 primary data records. [2025-10-08T22:37:17.171221] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-08T22:37:17.199233] [INFO ] [MAIN ] Derivative Progress: 561/1771 symbols completed. ECAT took 1.2s. Estimated remaining: 7m 51s. Rate: 154.2 symbols/min [2025-10-08T22:37:17.211921] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:17.295210] [DEBUG] [LOCAL ] ECC: Loaded 43089 existing records from primary storage. [2025-10-08T22:37:17.306590] [INFO ] [MAIN ] ECC: Loaded 43089 primary data records. [2025-10-08T22:37:17.732558] [DEBUG] [LOCAL ] ECG: Loaded 33381 existing records from primary storage. [2025-10-08T22:37:17.852307] [INFO ] [MAIN ] ECG: Loaded 33381 primary data records. [2025-10-08T22:37:18.187550] [DEBUG] [MAIN ] ECCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:18.189309] [INFO ] [MAIN ] ECCU: Generated 1794 derivative records from 2260 primary records. [2025-10-08T22:37:18.189698] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-08T22:37:18.212022] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1794 records). [2025-10-08T22:37:18.212315] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-08T22:37:18.215124] [INFO ] [MAIN ] Derivative Progress: 562/1771 symbols completed. ECCU took 1.1s. Estimated remaining: 7m 52s. Rate: 153.7 symbols/min [2025-10-08T22:37:18.215792] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:18.231403] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:18.232492] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43089 primary records. [2025-10-08T22:37:18.232633] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-08T22:37:18.258627] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-08T22:37:18.259592] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-08T22:37:18.262310] [INFO ] [MAIN ] Derivative Progress: 563/1771 symbols completed. ECC took 1.2s. Estimated remaining: 7m 51s. Rate: 154.0 symbols/min [2025-10-08T22:37:18.262602] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:18.277331] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:18.278436] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 33381 primary records. [2025-10-08T22:37:18.278598] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-08T22:37:18.310900] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-08T22:37:18.330325] [DEBUG] [LOCAL ] ECO: Loaded 18349 existing records from primary storage. [2025-10-08T22:37:18.331969] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-08T22:37:18.332113] [INFO ] [MAIN ] ECO: Loaded 18349 primary data records. [2025-10-08T22:37:18.334740] [INFO ] [MAIN ] Derivative Progress: 564/1771 symbols completed. ECG took 1.1s. Estimated remaining: 7m 50s. Rate: 154.2 symbols/min [2025-10-08T22:37:18.335000] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:18.358294] [DEBUG] [LOCAL ] ECL: Loaded 46683 existing records from primary storage. [2025-10-08T22:37:18.375034] [INFO ] [MAIN ] ECL: Loaded 46683 primary data records. [2025-10-08T22:37:18.902195] [DEBUG] [LOCAL ] ECVT: Loaded 43281 existing records from primary storage. [2025-10-08T22:37:18.902708] [INFO ] [MAIN ] ECVT: Loaded 43281 primary data records. [2025-10-08T22:37:19.394552] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:19.395672] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18349 primary records. [2025-10-08T22:37:19.397192] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-08T22:37:19.426466] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:19.428504] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46683 primary records. [2025-10-08T22:37:19.429105] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-08T22:37:19.441434] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-08T22:37:19.444013] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-08T22:37:19.446269] [INFO ] [MAIN ] Derivative Progress: 565/1771 symbols completed. ECO took 1.2s. Estimated remaining: 7m 51s. Rate: 153.7 symbols/min [2025-10-08T22:37:19.446729] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:19.453277] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-08T22:37:19.453683] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-08T22:37:19.455983] [INFO ] [MAIN ] Derivative Progress: 566/1771 symbols completed. ECL took 1.2s. Estimated remaining: 7m 50s. Rate: 154.0 symbols/min [2025-10-08T22:37:19.456257] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:19.474425] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:19.475238] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43281 primary records. [2025-10-08T22:37:19.475363] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-08T22:37:19.501230] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-08T22:37:19.508946] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-08T22:37:19.511338] [INFO ] [MAIN ] Derivative Progress: 567/1771 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 48s. Rate: 154.2 symbols/min [2025-10-08T22:37:19.525722] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:19.525579] [DEBUG] [LOCAL ] EDD: Loaded 26944 existing records from primary storage. [2025-10-08T22:37:19.526455] [INFO ] [MAIN ] EDD: Loaded 26944 primary data records. [2025-10-08T22:37:19.662955] [DEBUG] [LOCAL ] EDF: Loaded 13210 existing records from primary storage. [2025-10-08T22:37:19.679353] [INFO ] [MAIN ] EDF: Loaded 13210 primary data records. [2025-10-08T22:37:19.674003] [DEBUG] [LOCAL ] ED: Loaded 52710 existing records from primary storage. [2025-10-08T22:37:19.736998] [INFO ] [MAIN ] ED: Loaded 52710 primary data records. [2025-10-08T22:37:20.540805] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:20.541936] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 26944 primary records. [2025-10-08T22:37:20.542241] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-08T22:37:20.588623] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:20.589101] [DEBUG] [MAIN ] ED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:20.589740] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-08T22:37:20.589851] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-08T22:37:20.591873] [INFO ] [MAIN ] Derivative Progress: 568/1771 symbols completed. EDD took 1.1s. Estimated remaining: 7m 50s. Rate: 153.7 symbols/min [2025-10-08T22:37:20.593367] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52710 primary records. [2025-10-08T22:37:20.592709] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13210 primary records. [2025-10-08T22:37:20.593538] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-08T22:37:20.594168] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-08T22:37:20.623510] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-08T22:37:20.623812] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-08T22:37:20.624083] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-08T22:37:20.626255] [INFO ] [MAIN ] Derivative Progress: 569/1771 symbols completed. EDF took 1.1s. Estimated remaining: 7m 48s. Rate: 154.0 symbols/min [2025-10-08T22:37:20.626359] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-08T22:37:20.628793] [INFO ] [MAIN ] Derivative Progress: 570/1771 symbols completed. ED took 1.2s. Estimated remaining: 7m 47s. Rate: 154.2 symbols/min [2025-10-08T22:37:20.629418] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:20.629361] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:20.629550] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:20.660057] [DEBUG] [LOCAL ] EDN: Loaded 18262 existing records from primary storage. [2025-10-08T22:37:20.660190] [INFO ] [MAIN ] EDN: Loaded 18262 primary data records. [2025-10-08T22:37:20.815955] [DEBUG] [LOCAL ] EE: Loaded 32798 existing records from primary storage. [2025-10-08T22:37:20.850457] [INFO ] [MAIN ] EE: Loaded 32798 primary data records. [2025-10-08T22:37:20.832296] [DEBUG] [LOCAL ] EDU: Loaded 44849 existing records from primary storage. [2025-10-08T22:37:20.859171] [INFO ] [MAIN ] EDU: Loaded 44849 primary data records. [2025-10-08T22:37:21.645162] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:21.647070] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 18262 primary records. [2025-10-08T22:37:21.647348] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-08T22:37:21.666279] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-08T22:37:21.666488] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-08T22:37:21.670038] [INFO ] [MAIN ] Derivative Progress: 571/1771 symbols completed. EDN took 1.0s. Estimated remaining: 7m 48s. Rate: 153.8 symbols/min [2025-10-08T22:37:21.671774] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:21.690611] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:21.693906] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32798 primary records. [2025-10-08T22:37:21.694106] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-08T22:37:21.713242] [DEBUG] [LOCAL ] EEX: Loaded 10841 existing records from primary storage. [2025-10-08T22:37:21.713952] [INFO ] [MAIN ] EEX: Loaded 10841 primary data records. [2025-10-08T22:37:21.763323] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:21.771071] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44849 primary records. [2025-10-08T22:37:21.778956] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-08T22:37:21.803802] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-08T22:37:21.829771] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-08T22:37:21.863789] [INFO ] [MAIN ] Derivative Progress: 572/1771 symbols completed. EE took 1.2s. Estimated remaining: 7m 47s. Rate: 153.9 symbols/min [2025-10-08T22:37:21.864885] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-08T22:37:21.865189] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-08T22:37:21.865032] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:21.867843] [INFO ] [MAIN ] Derivative Progress: 573/1771 symbols completed. EDU took 1.2s. Estimated remaining: 7m 46s. Rate: 154.2 symbols/min [2025-10-08T22:37:21.873335] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:22.089526] [DEBUG] [LOCAL ] EFT: Loaded 13144 existing records from primary storage. [2025-10-08T22:37:22.089089] [DEBUG] [LOCAL ] EFR: Loaded 14966 existing records from primary storage. [2025-10-08T22:37:22.089699] [INFO ] [MAIN ] EFR: Loaded 14966 primary data records. [2025-10-08T22:37:22.110949] [INFO ] [MAIN ] EFT: Loaded 13144 primary data records. [2025-10-08T22:37:22.756410] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:22.757771] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 10841 primary records. [2025-10-08T22:37:22.758129] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-08T22:37:22.776107] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-08T22:37:22.776340] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-08T22:37:22.778937] [INFO ] [MAIN ] Derivative Progress: 574/1771 symbols completed. EEX took 1.1s. Estimated remaining: 7m 47s. Rate: 153.8 symbols/min [2025-10-08T22:37:22.779325] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:22.812975] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:22.812705] [DEBUG] [MAIN ] EFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:22.814440] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14966 primary records. [2025-10-08T22:37:22.813847] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13144 primary records. [2025-10-08T22:37:22.814630] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-08T22:37:22.814575] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-08T22:37:22.843165] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-08T22:37:22.843323] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-08T22:37:22.845562] [INFO ] [MAIN ] Derivative Progress: 575/1771 symbols completed. EFR took 1.0s. Estimated remaining: 7m 46s. Rate: 154.1 symbols/min [2025-10-08T22:37:22.849190] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:22.860053] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-08T22:37:22.860166] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-08T22:37:22.862162] [INFO ] [MAIN ] Derivative Progress: 576/1771 symbols completed. EFT took 1.0s. Estimated remaining: 7m 45s. Rate: 154.3 symbols/min [2025-10-08T22:37:22.862386] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:22.881157] [DEBUG] [LOCAL ] EFX: Loaded 44556 existing records from primary storage. [2025-10-08T22:37:22.881421] [INFO ] [MAIN ] EFX: Loaded 44556 primary data records. [2025-10-08T22:37:23.046596] [DEBUG] [LOCAL ] EFXT: Loaded 29343 existing records from primary storage. [2025-10-08T22:37:23.053039] [INFO ] [MAIN ] EFXT: Loaded 29343 primary data records. [2025-10-08T22:37:23.052848] [DEBUG] [LOCAL ] EG: Loaded 27804 existing records from primary storage. [2025-10-08T22:37:23.070781] [INFO ] [MAIN ] EG: Loaded 27804 primary data records. [2025-10-08T22:37:23.884228] [DEBUG] [MAIN ] EFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:23.885302] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44556 primary records. [2025-10-08T22:37:23.885861] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-08T22:37:23.906009] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-08T22:37:23.907250] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-08T22:37:23.911523] [INFO ] [MAIN ] Derivative Progress: 577/1771 symbols completed. EFX took 1.1s. Estimated remaining: 7m 46s. Rate: 153.9 symbols/min [2025-10-08T22:37:23.912985] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:23.927822] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:23.930632] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29343 primary records. [2025-10-08T22:37:23.931557] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-08T22:37:23.963403] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-08T22:37:23.963837] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-08T22:37:23.963624] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:23.964626] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27804 primary records. [2025-10-08T22:37:23.964820] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-08T22:37:23.968204] [INFO ] [MAIN ] Derivative Progress: 578/1771 symbols completed. EFXT took 1.1s. Estimated remaining: 7m 45s. Rate: 154.1 symbols/min [2025-10-08T22:37:23.987196] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:23.995354] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-08T22:37:23.995611] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-08T22:37:24.008010] [INFO ] [MAIN ] Derivative Progress: 579/1771 symbols completed. EG took 1.1s. Estimated remaining: 7m 43s. Rate: 154.3 symbols/min [2025-10-08T22:37:24.008389] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:24.009597] [DEBUG] [LOCAL ] EGP: Loaded 30646 existing records from primary storage. [2025-10-08T22:37:24.009835] [INFO ] [MAIN ] EGP: Loaded 30646 primary data records. [2025-10-08T22:37:24.364860] [DEBUG] [LOCAL ] EHAB: Loaded 29327 existing records from primary storage. [2025-10-08T22:37:24.386439] [INFO ] [MAIN ] EHAB: Loaded 29327 primary data records. [2025-10-08T22:37:24.408932] [DEBUG] [LOCAL ] EGY: Loaded 41770 existing records from primary storage. [2025-10-08T22:37:24.426066] [INFO ] [MAIN ] EGY: Loaded 41770 primary data records. [2025-10-08T22:37:25.062720] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:25.064743] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30646 primary records. [2025-10-08T22:37:25.065838] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-08T22:37:25.084539] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-08T22:37:25.084794] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-08T22:37:25.087809] [INFO ] [MAIN ] Derivative Progress: 580/1771 symbols completed. EGP took 1.2s. Estimated remaining: 7m 44s. Rate: 153.9 symbols/min [2025-10-08T22:37:25.088203] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:25.107804] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:25.109573] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29327 primary records. [2025-10-08T22:37:25.110548] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-08T22:37:25.124246] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:25.136979] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41770 primary records. [2025-10-08T22:37:25.137417] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-08T22:37:25.168750] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-08T22:37:25.169728] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-08T22:37:25.172495] [INFO ] [MAIN ] Derivative Progress: 581/1771 symbols completed. EHAB took 1.2s. Estimated remaining: 7m 43s. Rate: 154.1 symbols/min [2025-10-08T22:37:25.173008] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:25.174244] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-08T22:37:25.174375] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-08T22:37:25.176496] [INFO ] [MAIN ] Derivative Progress: 582/1771 symbols completed. EGY took 1.2s. Estimated remaining: 7m 42s. Rate: 154.3 symbols/min [2025-10-08T22:37:25.176779] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:25.196369] [DEBUG] [LOCAL ] EHC: Loaded 41177 existing records from primary storage. [2025-10-08T22:37:25.196624] [INFO ] [MAIN ] EHC: Loaded 41177 primary data records. [2025-10-08T22:37:25.259670] [DEBUG] [LOCAL ] EHI: Loaded 10705 existing records from primary storage. [2025-10-08T22:37:25.277440] [INFO ] [MAIN ] EHI: Loaded 10705 primary data records. [2025-10-08T22:37:25.362943] [DEBUG] [LOCAL ] EIC: Loaded 23043 existing records from primary storage. [2025-10-08T22:37:25.413836] [INFO ] [MAIN ] EIC: Loaded 23043 primary data records. [2025-10-08T22:37:26.175214] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:26.176918] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41177 primary records. [2025-10-08T22:37:26.177025] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-08T22:37:26.201513] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-08T22:37:26.206455] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-08T22:37:26.206717] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:26.216986] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10705 primary records. [2025-10-08T22:37:26.217209] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-08T22:37:26.215797] [INFO ] [MAIN ] Derivative Progress: 583/1771 symbols completed. EHC took 1.1s. Estimated remaining: 7m 43s. Rate: 153.9 symbols/min [2025-10-08T22:37:26.247736] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-08T22:37:26.247402] [DEBUG] [MAIN ] EIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:26.247840] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-08T22:37:26.250206] [INFO ] [MAIN ] Derivative Progress: 584/1771 symbols completed. EHI took 1.1s. Estimated remaining: 7m 42s. Rate: 154.1 symbols/min [2025-10-08T22:37:26.251105] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 23043 primary records. [2025-10-08T22:37:26.251172] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-08T22:37:26.267020] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-08T22:37:26.267108] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-08T22:37:26.269552] [INFO ] [MAIN ] Derivative Progress: 585/1771 symbols completed. EIC took 1.1s. Estimated remaining: 7m 41s. Rate: 154.4 symbols/min [2025-10-08T22:37:26.270064] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:26.270114] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:26.270323] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:26.296784] [DEBUG] [LOCAL ] EIG: Loaded 20264 existing records from primary storage. [2025-10-08T22:37:26.296956] [INFO ] [MAIN ] EIG: Loaded 20264 primary data records. [2025-10-08T22:37:26.544418] [DEBUG] [LOCAL ] EIX: Loaded 53347 existing records from primary storage. [2025-10-08T22:37:26.560264] [INFO ] [MAIN ] EIX: Loaded 53347 primary data records. [2025-10-08T22:37:26.761564] [DEBUG] [LOCAL ] EL: Loaded 53372 existing records from primary storage. [2025-10-08T22:37:26.779893] [INFO ] [MAIN ] EL: Loaded 53372 primary data records. [2025-10-08T22:37:27.347883] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:27.350053] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20264 primary records. [2025-10-08T22:37:27.351266] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-08T22:37:27.364822] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:27.365773] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53347 primary records. [2025-10-08T22:37:27.366022] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-08T22:37:27.397445] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-08T22:37:27.397677] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-08T22:37:27.400629] [INFO ] [MAIN ] Derivative Progress: 586/1771 symbols completed. EIX took 1.1s. Estimated remaining: 7m 42s. Rate: 153.9 symbols/min [2025-10-08T22:37:27.401691] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:27.401512] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-08T22:37:27.402550] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-08T22:37:27.404754] [INFO ] [MAIN ] Derivative Progress: 587/1771 symbols completed. EIG took 1.1s. Estimated remaining: 7m 41s. Rate: 154.1 symbols/min [2025-10-08T22:37:27.405020] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:27.413120] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-08T22:37:27.413369] [INFO ] [MAIN ] ELC: Loaded 3504 primary data records. [2025-10-08T22:37:27.477130] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:27.509591] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53372 primary records. [2025-10-08T22:37:27.528200] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-08T22:37:27.655761] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-08T22:37:27.776501] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-08T22:37:27.779386] [INFO ] [MAIN ] Derivative Progress: 588/1771 symbols completed. EL took 1.5s. Estimated remaining: 7m 40s. Rate: 154.1 symbols/min [2025-10-08T22:37:27.779820] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:27.799495] [DEBUG] [LOCAL ] ELAN: Loaded 53293 existing records from primary storage. [2025-10-08T22:37:27.799936] [INFO ] [MAIN ] ELAN: Loaded 53293 primary data records. [2025-10-08T22:37:28.154148] [DEBUG] [LOCAL ] ELF: Loaded 52053 existing records from primary storage. [2025-10-08T22:37:28.155200] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:28.155520] [INFO ] [MAIN ] ELF: Loaded 52053 primary data records. [2025-10-08T22:37:28.156325] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3504 primary records. [2025-10-08T22:37:28.161854] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-08T22:37:28.272751] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-08T22:37:28.283733] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-08T22:37:28.286111] [INFO ] [MAIN ] Derivative Progress: 589/1771 symbols completed. ELC took 0.9s. Estimated remaining: 7m 40s. Rate: 154.1 symbols/min [2025-10-08T22:37:28.292076] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:28.546262] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:28.547576] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53293 primary records. [2025-10-08T22:37:28.548002] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-08T22:37:28.577693] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-08T22:37:28.578029] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-08T22:37:28.580296] [INFO ] [MAIN ] Derivative Progress: 590/1771 symbols completed. ELAN took 1.2s. Estimated remaining: 7m 40s. Rate: 154.1 symbols/min [2025-10-08T22:37:28.592031] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:28.593193] [DEBUG] [LOCAL ] ELME: Loaded 39293 existing records from primary storage. [2025-10-08T22:37:28.593891] [INFO ] [MAIN ] ELME: Loaded 39293 primary data records. [2025-10-08T22:37:28.785934] [DEBUG] [LOCAL ] ELP: Loaded 25619 existing records from primary storage. [2025-10-08T22:37:28.916916] [DEBUG] [MAIN ] ELF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:28.916466] [INFO ] [MAIN ] ELP: Loaded 25619 primary data records. [2025-10-08T22:37:28.918061] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52053 primary records. [2025-10-08T22:37:28.929543] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-08T22:37:29.131232] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-08T22:37:29.131668] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-08T22:37:29.249315] [INFO ] [MAIN ] Derivative Progress: 591/1771 symbols completed. ELF took 1.5s. Estimated remaining: 7m 40s. Rate: 153.9 symbols/min [2025-10-08T22:37:29.260355] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:29.285191] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:29.286984] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39293 primary records. [2025-10-08T22:37:29.287174] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-08T22:37:29.311394] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-08T22:37:29.321535] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-08T22:37:29.323892] [INFO ] [MAIN ] Derivative Progress: 592/1771 symbols completed. ELME took 1.0s. Estimated remaining: 7m 39s. Rate: 154.1 symbols/min [2025-10-08T22:37:29.326080] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:29.341608] [DEBUG] [MAIN ] ELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:29.355305] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 25619 primary records. [2025-10-08T22:37:29.355526] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-10-08T22:37:29.356571] [DEBUG] [LOCAL ] ELS: Loaded 49760 existing records from primary storage. [2025-10-08T22:37:29.356745] [INFO ] [MAIN ] ELS: Loaded 49760 primary data records. [2025-10-08T22:37:29.545971] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-10-08T22:37:29.567279] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-10-08T22:37:29.683447] [INFO ] [MAIN ] Derivative Progress: 593/1771 symbols completed. ELP took 1.1s. Estimated remaining: 7m 38s. Rate: 154.2 symbols/min [2025-10-08T22:37:29.685377] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:29.700743] [DEBUG] [LOCAL ] ELV: Loaded 50611 existing records from primary storage. [2025-10-08T22:37:29.700865] [INFO ] [MAIN ] ELV: Loaded 50611 primary data records. [2025-10-08T22:37:30.031566] [DEBUG] [LOCAL ] EMD: Loaded 21094 existing records from primary storage. [2025-10-08T22:37:30.032310] [INFO ] [MAIN ] EMD: Loaded 21094 primary data records. [2025-10-08T22:37:30.165153] [DEBUG] [MAIN ] ELS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:30.209425] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49760 primary records. [2025-10-08T22:37:30.242297] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-10-08T22:37:30.382200] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-10-08T22:37:30.383008] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-10-08T22:37:30.385272] [INFO ] [MAIN ] Derivative Progress: 594/1771 symbols completed. ELS took 1.1s. Estimated remaining: 7m 39s. Rate: 154.0 symbols/min [2025-10-08T22:37:30.385474] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:30.404795] [DEBUG] [MAIN ] ELV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:30.405622] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50611 primary records. [2025-10-08T22:37:30.405848] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-10-08T22:37:30.425220] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-10-08T22:37:30.433358] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-10-08T22:37:30.435695] [INFO ] [MAIN ] Derivative Progress: 595/1771 symbols completed. ELV took 1.1s. Estimated remaining: 7m 38s. Rate: 154.2 symbols/min [2025-10-08T22:37:30.436240] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:30.454581] [DEBUG] [MAIN ] EMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:30.464884] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21094 primary records. [2025-10-08T22:37:30.465020] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-08T22:37:30.469245] [DEBUG] [LOCAL ] EMF: Loaded 3289 existing records from primary storage. [2025-10-08T22:37:30.468590] [DEBUG] [LOCAL ] EME: Loaded 31165 existing records from primary storage. [2025-10-08T22:37:30.469545] [INFO ] [MAIN ] EMF: Loaded 3289 primary data records. [2025-10-08T22:37:30.497484] [INFO ] [MAIN ] EME: Loaded 31165 primary data records. [2025-10-08T22:37:30.720543] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-08T22:37:30.782749] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-08T22:37:30.806120] [INFO ] [MAIN ] Derivative Progress: 596/1771 symbols completed. EMD took 1.1s. Estimated remaining: 7m 37s. Rate: 154.2 symbols/min [2025-10-08T22:37:30.816557] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:31.191203] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:31.207249] [DEBUG] [LOCAL ] EMN: Loaded 50628 existing records from primary storage. [2025-10-08T22:37:31.208271] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3289 primary records. [2025-10-08T22:37:31.220814] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-08T22:37:31.221123] [INFO ] [MAIN ] EMN: Loaded 50628 primary data records. [2025-10-08T22:37:31.233994] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:31.308621] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31165 primary records. [2025-10-08T22:37:31.337374] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-08T22:37:31.387175] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-08T22:37:31.398084] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-08T22:37:31.413495] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-08T22:37:31.424966] [INFO ] [MAIN ] Derivative Progress: 597/1771 symbols completed. EME took 1.0s. Estimated remaining: 7m 37s. Rate: 154.0 symbols/min [2025-10-08T22:37:31.458546] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-08T22:37:31.486726] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:31.579820] [INFO ] [MAIN ] Derivative Progress: 598/1771 symbols completed. EMF took 1.1s. Estimated remaining: 7m 36s. Rate: 154.2 symbols/min [2025-10-08T22:37:31.596281] [DEBUG] [LOCAL ] EMO: Loaded 12883 existing records from primary storage. [2025-10-08T22:37:31.596626] [INFO ] [MAIN ] EMO: Loaded 12883 primary data records. [2025-10-08T22:37:31.770258] [DEBUG] [MAIN ] EMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:31.781388] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50628 primary records. [2025-10-08T22:37:31.810692] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-08T22:37:31.970147] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-08T22:37:31.970303] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-08T22:37:31.972382] [INFO ] [MAIN ] Derivative Progress: 599/1771 symbols completed. EMN took 1.2s. Estimated remaining: 7m 36s. Rate: 154.2 symbols/min [2025-10-08T22:37:31.992302] [DEBUG] [MAIN ] EMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:31.993077] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12883 primary records. [2025-10-08T22:37:31.993143] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-08T22:37:32.008523] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-08T22:37:32.008587] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-08T22:37:32.010702] [INFO ] [MAIN ] Derivative Progress: 600/1771 symbols completed. EMO took 0.5s. Estimated remaining: 7m 35s. Rate: 154.4 symbols/min [2025-10-08T22:37:32.011078] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:32.011183] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:32.011280] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:32.018708] [DEBUG] [LOCAL ] ENFY: Loaded 3235 existing records from primary storage. [2025-10-08T22:37:32.018897] [INFO ] [MAIN ] ENFY: Loaded 3235 primary data records. [2025-10-08T22:37:32.400079] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-08T22:37:32.401549] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-10-08T22:37:32.518688] [DEBUG] [LOCAL ] EMR: Loaded 53224 existing records from primary storage. [2025-10-08T22:37:32.523825] [INFO ] [MAIN ] EMR: Loaded 53224 primary data records. [2025-10-08T22:37:32.910343] [DEBUG] [MAIN ] ENFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:32.963211] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3235 primary records. [2025-10-08T22:37:33.082441] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-10-08T22:37:33.102002] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-10-08T22:37:33.102163] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-10-08T22:37:33.104704] [INFO ] [MAIN ] Derivative Progress: 601/1771 symbols completed. ENFY took 1.1s. Estimated remaining: 7m 36s. Rate: 154.0 symbols/min [2025-10-08T22:37:33.105948] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:33.123297] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:33.124283] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53511 primary records. [2025-10-08T22:37:33.124541] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-08T22:37:33.143195] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-08T22:37:33.143479] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-08T22:37:33.145401] [INFO ] [MAIN ] Derivative Progress: 602/1771 symbols completed. ENB took 1.1s. Estimated remaining: 7m 35s. Rate: 154.2 symbols/min [2025-10-08T22:37:33.153775] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:33.168469] [DEBUG] [MAIN ] EMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:33.169617] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53224 primary records. [2025-10-08T22:37:33.169831] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-08T22:37:33.187972] [DEBUG] [LOCAL ] ENO: Loaded 1889 existing records from primary storage. [2025-10-08T22:37:33.198377] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-08T22:37:33.199283] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-08T22:37:33.199343] [INFO ] [MAIN ] ENO: Loaded 1889 primary data records. [2025-10-08T22:37:33.231186] [DEBUG] [LOCAL ] ENIC: Loaded 36357 existing records from primary storage. [2025-10-08T22:37:33.238415] [INFO ] [MAIN ] Derivative Progress: 603/1771 symbols completed. EMR took 1.2s. Estimated remaining: 7m 34s. Rate: 154.4 symbols/min [2025-10-08T22:37:33.238575] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:33.238736] [INFO ] [MAIN ] ENIC: Loaded 36357 primary data records. [2025-10-08T22:37:33.850354] [DEBUG] [LOCAL ] ENOV: Loaded 44833 existing records from primary storage. [2025-10-08T22:37:33.851640] [INFO ] [MAIN ] ENOV: Loaded 44833 primary data records. [2025-10-08T22:37:34.197208] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:34.198723] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36357 primary records. [2025-10-08T22:37:34.197851] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:34.198877] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-08T22:37:34.199853] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1889 primary records. [2025-10-08T22:37:34.200913] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-08T22:37:34.229604] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-08T22:37:34.230459] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-08T22:37:34.232813] [INFO ] [MAIN ] Derivative Progress: 604/1771 symbols completed. ENIC took 1.1s. Estimated remaining: 7m 35s. Rate: 154.0 symbols/min [2025-10-08T22:37:34.233028] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:34.234505] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-10-08T22:37:34.236240] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-08T22:37:34.240241] [INFO ] [MAIN ] Derivative Progress: 605/1771 symbols completed. ENO took 1.1s. Estimated remaining: 7m 34s. Rate: 154.2 symbols/min [2025-10-08T22:37:34.240559] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:34.254304] [DEBUG] [MAIN ] ENOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:34.255223] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 44833 primary records. [2025-10-08T22:37:34.255405] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-10-08T22:37:34.272449] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-10-08T22:37:34.272596] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-10-08T22:37:34.274676] [INFO ] [MAIN ] Derivative Progress: 606/1771 symbols completed. ENOV took 1.0s. Estimated remaining: 7m 33s. Rate: 154.5 symbols/min [2025-10-08T22:37:34.274906] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:34.338931] [DEBUG] [LOCAL ] ENVA: Loaded 25329 existing records from primary storage. [2025-10-08T22:37:34.339484] [DEBUG] [LOCAL ] ENS: Loaded 29250 existing records from primary storage. [2025-10-08T22:37:34.339773] [INFO ] [MAIN ] ENVA: Loaded 25329 primary data records. [2025-10-08T22:37:34.352313] [DEBUG] [LOCAL ] ENR: Loaded 43238 existing records from primary storage. [2025-10-08T22:37:34.351420] [INFO ] [MAIN ] ENS: Loaded 29250 primary data records. [2025-10-08T22:37:34.362100] [INFO ] [MAIN ] ENR: Loaded 43238 primary data records. [2025-10-08T22:37:35.326913] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:35.328926] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:35.329849] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25329 primary records. [2025-10-08T22:37:35.329984] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-08T22:37:35.328474] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43238 primary records. [2025-10-08T22:37:35.343712] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-08T22:37:35.344794] [DEBUG] [MAIN ] ENS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:35.346211] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29250 primary records. [2025-10-08T22:37:35.346375] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-08T22:37:35.391623] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-08T22:37:35.393489] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-08T22:37:35.394159] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-08T22:37:35.394291] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-08T22:37:35.396490] [INFO ] [MAIN ] Derivative Progress: 607/1771 symbols completed. ENS took 1.2s. Estimated remaining: 7m 34s. Rate: 154.0 symbols/min [2025-10-08T22:37:35.396746] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:35.394424] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-08T22:37:35.396610] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-08T22:37:35.399218] [INFO ] [MAIN ] Derivative Progress: 608/1771 symbols completed. ENVA took 1.1s. Estimated remaining: 7m 32s. Rate: 154.2 symbols/min [2025-10-08T22:37:35.401719] [INFO ] [MAIN ] Derivative Progress: 609/1771 symbols completed. ENR took 1.2s. Estimated remaining: 7m 31s. Rate: 154.5 symbols/min [2025-10-08T22:37:35.401609] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:35.402052] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:35.420803] [DEBUG] [LOCAL ] EOD: Loaded 14808 existing records from primary storage. [2025-10-08T22:37:35.425811] [INFO ] [MAIN ] EOD: Loaded 14808 primary data records. [2025-10-08T22:37:35.425714] [DEBUG] [LOCAL ] EOI: Loaded 10829 existing records from primary storage. [2025-10-08T22:37:35.426068] [INFO ] [MAIN ] EOI: Loaded 10829 primary data records. [2025-10-08T22:37:35.948898] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-08T22:37:36.082891] [INFO ] [MAIN ] EOG: Loaded 53344 primary data records. [2025-10-08T22:37:36.438311] [DEBUG] [MAIN ] EOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:36.440242] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14808 primary records. [2025-10-08T22:37:36.440393] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-08T22:37:36.438720] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:36.442445] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10829 primary records. [2025-10-08T22:37:36.450487] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-08T22:37:36.478616] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-08T22:37:36.479862] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-08T22:37:36.479713] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-08T22:37:36.480147] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-08T22:37:36.482467] [INFO ] [MAIN ] Derivative Progress: 610/1771 symbols completed. EOI took 1.1s. Estimated remaining: 7m 32s. Rate: 154.0 symbols/min [2025-10-08T22:37:36.485102] [INFO ] [MAIN ] Derivative Progress: 611/1771 symbols completed. EOD took 1.1s. Estimated remaining: 7m 31s. Rate: 154.3 symbols/min [2025-10-08T22:37:36.482729] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:36.485522] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:36.506394] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:36.511177] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53344 primary records. [2025-10-08T22:37:36.515944] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-08T22:37:36.515854] [DEBUG] [LOCAL ] EOT: Loaded 6743 existing records from primary storage. [2025-10-08T22:37:36.517301] [INFO ] [MAIN ] EOT: Loaded 6743 primary data records. [2025-10-08T22:37:36.551099] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-08T22:37:36.551526] [DEBUG] [LOCAL ] EOS: Loaded 15423 existing records from primary storage. [2025-10-08T22:37:36.551238] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-08T22:37:36.556836] [INFO ] [MAIN ] EOS: Loaded 15423 primary data records. [2025-10-08T22:37:36.583091] [INFO ] [MAIN ] Derivative Progress: 612/1771 symbols completed. EOG took 1.2s. Estimated remaining: 7m 30s. Rate: 154.5 symbols/min [2025-10-08T22:37:36.592786] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:36.945581] [DEBUG] [LOCAL ] EPAC: Loaded 26691 existing records from primary storage. [2025-10-08T22:37:37.005683] [INFO ] [MAIN ] EPAC: Loaded 26691 primary data records. [2025-10-08T22:37:37.547793] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:37.548717] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15423 primary records. [2025-10-08T22:37:37.548980] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-08T22:37:37.573235] [DEBUG] [MAIN ] EOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:37.575346] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6743 primary records. [2025-10-08T22:37:37.575694] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-08T22:37:37.579011] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-08T22:37:37.579243] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-08T22:37:37.587849] [INFO ] [MAIN ] Derivative Progress: 613/1771 symbols completed. EOS took 1.1s. Estimated remaining: 7m 31s. Rate: 154.1 symbols/min [2025-10-08T22:37:37.596098] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-08T22:37:37.596318] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-08T22:37:37.599152] [INFO ] [MAIN ] Derivative Progress: 614/1771 symbols completed. EOT took 1.1s. Estimated remaining: 7m 30s. Rate: 154.3 symbols/min [2025-10-08T22:37:37.613122] [DEBUG] [MAIN ] EPAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:37.613692] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26691 primary records. [2025-10-08T22:37:37.613775] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-08T22:37:37.628429] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-08T22:37:37.628487] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-08T22:37:37.630460] [INFO ] [MAIN ] Derivative Progress: 615/1771 symbols completed. EPAC took 1.0s. Estimated remaining: 7m 29s. Rate: 154.6 symbols/min [2025-10-08T22:37:37.630965] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:37.631069] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:37.631166] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:37.682816] [DEBUG] [LOCAL ] EPC: Loaded 39795 existing records from primary storage. [2025-10-08T22:37:37.683167] [INFO ] [MAIN ] EPC: Loaded 39795 primary data records. [2025-10-08T22:37:37.801258] [DEBUG] [LOCAL ] EPAM: Loaded 39420 existing records from primary storage. [2025-10-08T22:37:37.817750] [INFO ] [MAIN ] EPAM: Loaded 39420 primary data records. [2025-10-08T22:37:38.142402] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-08T22:37:38.143834] [INFO ] [MAIN ] EPD: Loaded 53611 primary data records. [2025-10-08T22:37:38.713314] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:38.714291] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39795 primary records. [2025-10-08T22:37:38.714598] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-08T22:37:38.745004] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:38.746124] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39420 primary records. [2025-10-08T22:37:38.747064] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-08T22:37:38.758090] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-08T22:37:38.759045] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-08T22:37:38.763719] [INFO ] [MAIN ] Derivative Progress: 616/1771 symbols completed. EPC took 1.1s. Estimated remaining: 7m 30s. Rate: 154.1 symbols/min [2025-10-08T22:37:38.764189] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:38.784920] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-08T22:37:38.785035] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-08T22:37:38.786971] [INFO ] [MAIN ] Derivative Progress: 617/1771 symbols completed. EPAM took 1.2s. Estimated remaining: 7m 29s. Rate: 154.3 symbols/min [2025-10-08T22:37:38.784530] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:38.787155] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:38.788404] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53611 primary records. [2025-10-08T22:37:38.788679] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-08T22:37:38.810403] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-08T22:37:38.810664] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-08T22:37:38.813306] [INFO ] [MAIN ] Derivative Progress: 618/1771 symbols completed. EPD took 1.2s. Estimated remaining: 7m 28s. Rate: 154.6 symbols/min [2025-10-08T22:37:38.813708] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:38.836417] [DEBUG] [LOCAL ] EQBK: Loaded 10961 existing records from primary storage. [2025-10-08T22:37:38.836580] [INFO ] [MAIN ] EQBK: Loaded 10961 primary data records. [2025-10-08T22:37:38.905482] [DEBUG] [LOCAL ] EPR: Loaded 43947 existing records from primary storage. [2025-10-08T22:37:38.951789] [INFO ] [MAIN ] EPR: Loaded 43947 primary data records. [2025-10-08T22:37:39.085778] [DEBUG] [LOCAL ] EPRT: Loaded 48408 existing records from primary storage. [2025-10-08T22:37:39.140154] [INFO ] [MAIN ] EPRT: Loaded 48408 primary data records. [2025-10-08T22:37:39.804506] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:39.805360] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10961 primary records. [2025-10-08T22:37:39.805525] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-08T22:37:39.823909] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-08T22:37:39.824113] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-08T22:37:39.838075] [INFO ] [MAIN ] Derivative Progress: 619/1771 symbols completed. EQBK took 1.0s. Estimated remaining: 7m 28s. Rate: 154.1 symbols/min [2025-10-08T22:37:39.838784] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:39.838910] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:39.839998] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43947 primary records. [2025-10-08T22:37:39.841837] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-08T22:37:39.868141] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:39.869729] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48408 primary records. [2025-10-08T22:37:39.870082] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-08T22:37:39.884302] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-08T22:37:39.884824] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-08T22:37:39.887188] [INFO ] [MAIN ] Derivative Progress: 620/1771 symbols completed. EPR took 1.1s. Estimated remaining: 7m 27s. Rate: 154.4 symbols/min [2025-10-08T22:37:39.887420] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:39.893486] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-08T22:37:39.893843] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-08T22:37:39.896037] [INFO ] [MAIN ] Derivative Progress: 621/1771 symbols completed. EPRT took 1.1s. Estimated remaining: 7m 26s. Rate: 154.6 symbols/min [2025-10-08T22:37:39.896241] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:39.934304] [DEBUG] [LOCAL ] EQH: Loaded 52650 existing records from primary storage. [2025-10-08T22:37:39.934633] [INFO ] [MAIN ] EQH: Loaded 52650 primary data records. [2025-10-08T22:37:40.285595] [DEBUG] [LOCAL ] EQR: Loaded 51608 existing records from primary storage. [2025-10-08T22:37:40.286397] [INFO ] [MAIN ] EQR: Loaded 51608 primary data records. [2025-10-08T22:37:40.287707] [DEBUG] [LOCAL ] EQNR: Loaded 53032 existing records from primary storage. [2025-10-08T22:37:40.287971] [INFO ] [MAIN ] EQNR: Loaded 53032 primary data records. [2025-10-08T22:37:40.938911] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:40.939881] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52650 primary records. [2025-10-08T22:37:40.941769] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-08T22:37:40.959780] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-08T22:37:40.960166] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-08T22:37:40.962495] [INFO ] [MAIN ] Derivative Progress: 622/1771 symbols completed. EQH took 1.1s. Estimated remaining: 7m 27s. Rate: 154.2 symbols/min [2025-10-08T22:37:40.962776] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:40.981588] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:40.994182] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53032 primary records. [2025-10-08T22:37:40.994419] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:40.995071] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51608 primary records. [2025-10-08T22:37:40.995236] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-08T22:37:40.995302] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-08T22:37:41.033253] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-08T22:37:41.033943] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-08T22:37:41.036187] [INFO ] [MAIN ] Derivative Progress: 623/1771 symbols completed. EQNR took 1.1s. Estimated remaining: 7m 26s. Rate: 154.4 symbols/min [2025-10-08T22:37:41.036846] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:41.039286] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-08T22:37:41.039358] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-08T22:37:41.041193] [INFO ] [MAIN ] Derivative Progress: 624/1771 symbols completed. EQR took 1.1s. Estimated remaining: 7m 25s. Rate: 154.6 symbols/min [2025-10-08T22:37:41.042159] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:41.045679] [DEBUG] [LOCAL ] EQV: Loaded 2709 existing records from primary storage. [2025-10-08T22:37:41.045928] [INFO ] [MAIN ] EQV: Loaded 2709 primary data records. [2025-10-08T22:37:41.274915] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-08T22:37:41.280933] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-10-08T22:37:41.532194] [DEBUG] [LOCAL ] ERJ: Loaded 50464 existing records from primary storage. [2025-10-08T22:37:41.556788] [INFO ] [MAIN ] ERJ: Loaded 50464 primary data records. [2025-10-08T22:37:42.071408] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:42.072989] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2709 primary records. [2025-10-08T22:37:42.073749] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-08T22:37:42.093888] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-08T22:37:42.094262] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-08T22:37:42.096941] [INFO ] [MAIN ] Derivative Progress: 625/1771 symbols completed. EQV took 1.1s. Estimated remaining: 7m 26s. Rate: 154.2 symbols/min [2025-10-08T22:37:42.097891] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:42.111854] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:42.113081] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-10-08T22:37:42.113168] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-08T22:37:42.133310] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-08T22:37:42.135612] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-08T22:37:42.139044] [INFO ] [MAIN ] Derivative Progress: 626/1771 symbols completed. EQT took 1.2s. Estimated remaining: 7m 25s. Rate: 154.4 symbols/min [2025-10-08T22:37:42.139333] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:42.154636] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:42.155824] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50464 primary records. [2025-10-08T22:37:42.156034] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-08T22:37:42.184202] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-08T22:37:42.184352] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-08T22:37:42.186616] [INFO ] [MAIN ] Derivative Progress: 627/1771 symbols completed. ERJ took 1.1s. Estimated remaining: 7m 24s. Rate: 154.6 symbols/min [2025-10-08T22:37:42.187709] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:42.201789] [DEBUG] [LOCAL ] ERO: Loaded 41514 existing records from primary storage. [2025-10-08T22:37:42.201989] [INFO ] [MAIN ] ERO: Loaded 41514 primary data records. [2025-10-08T22:37:42.391436] [DEBUG] [LOCAL ] ESAB: Loaded 26086 existing records from primary storage. [2025-10-08T22:37:42.411019] [INFO ] [MAIN ] ESAB: Loaded 26086 primary data records. [2025-10-08T22:37:42.526267] [DEBUG] [LOCAL ] ES: Loaded 52628 existing records from primary storage. [2025-10-08T22:37:42.682900] [INFO ] [MAIN ] ES: Loaded 52628 primary data records. [2025-10-08T22:37:43.342559] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:43.343830] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41514 primary records. [2025-10-08T22:37:43.344064] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-08T22:37:43.364152] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-08T22:37:43.364406] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-08T22:37:43.366798] [INFO ] [MAIN ] Derivative Progress: 628/1771 symbols completed. ERO took 1.3s. Estimated remaining: 7m 25s. Rate: 154.1 symbols/min [2025-10-08T22:37:43.384807] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:43.387404] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52628 primary records. [2025-10-08T22:37:43.387486] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-08T22:37:43.415513] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:43.416815] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 26086 primary records. [2025-10-08T22:37:43.417142] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-08T22:37:43.430138] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-08T22:37:43.433498] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-08T22:37:43.436753] [INFO ] [MAIN ] Derivative Progress: 629/1771 symbols completed. ES took 1.3s. Estimated remaining: 7m 24s. Rate: 154.3 symbols/min [2025-10-08T22:37:43.441530] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-08T22:37:43.441626] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-08T22:37:43.444025] [INFO ] [MAIN ] Derivative Progress: 630/1771 symbols completed. ESAB took 1.3s. Estimated remaining: 7m 23s. Rate: 154.6 symbols/min [2025-10-08T22:37:43.444464] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:43.444821] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:43.444919] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:43.466075] [DEBUG] [LOCAL ] ESE: Loaded 16540 existing records from primary storage. [2025-10-08T22:37:43.466211] [INFO ] [MAIN ] ESE: Loaded 16540 primary data records. [2025-10-08T22:37:43.825140] [DEBUG] [LOCAL ] ESNT: Loaded 38246 existing records from primary storage. [2025-10-08T22:37:43.826675] [INFO ] [MAIN ] ESNT: Loaded 38246 primary data records. [2025-10-08T22:37:43.848535] [DEBUG] [LOCAL ] ESI: Loaded 50673 existing records from primary storage. [2025-10-08T22:37:43.883687] [INFO ] [MAIN ] ESI: Loaded 50673 primary data records. [2025-10-08T22:37:44.488223] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:44.489355] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16540 primary records. [2025-10-08T22:37:44.489754] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-08T22:37:44.514796] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-08T22:37:44.515114] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-08T22:37:44.517505] [INFO ] [MAIN ] Derivative Progress: 631/1771 symbols completed. ESE took 1.1s. Estimated remaining: 7m 24s. Rate: 154.1 symbols/min [2025-10-08T22:37:44.532436] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:44.518261] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:44.533292] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38246 primary records. [2025-10-08T22:37:44.535153] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-08T22:37:44.561088] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:44.562738] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50673 primary records. [2025-10-08T22:37:44.563388] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-08T22:37:44.579520] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-08T22:37:44.580192] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-08T22:37:44.582386] [INFO ] [MAIN ] Derivative Progress: 632/1771 symbols completed. ESNT took 1.1s. Estimated remaining: 7m 23s. Rate: 154.3 symbols/min [2025-10-08T22:37:44.582858] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:44.596920] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-08T22:37:44.597068] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-08T22:37:44.599371] [INFO ] [MAIN ] Derivative Progress: 633/1771 symbols completed. ESI took 1.2s. Estimated remaining: 7m 22s. Rate: 154.6 symbols/min [2025-10-08T22:37:44.599786] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:44.616377] [DEBUG] [LOCAL ] ESRT: Loaded 46356 existing records from primary storage. [2025-10-08T22:37:44.616680] [INFO ] [MAIN ] ESRT: Loaded 46356 primary data records. [2025-10-08T22:37:44.816816] [DEBUG] [LOCAL ] ESS: Loaded 29778 existing records from primary storage. [2025-10-08T22:37:44.964566] [INFO ] [MAIN ] ESS: Loaded 29778 primary data records. [2025-10-08T22:37:45.092492] [DEBUG] [LOCAL ] ESTC: Loaded 50106 existing records from primary storage. [2025-10-08T22:37:45.127201] [INFO ] [MAIN ] ESTC: Loaded 50106 primary data records. [2025-10-08T22:37:45.590480] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:45.599823] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46356 primary records. [2025-10-08T22:37:45.600467] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-08T22:37:45.618264] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-08T22:37:45.619029] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-08T22:37:45.621467] [INFO ] [MAIN ] Derivative Progress: 634/1771 symbols completed. ESRT took 1.1s. Estimated remaining: 7m 22s. Rate: 154.2 symbols/min [2025-10-08T22:37:45.621705] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:45.641878] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:45.642817] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 29778 primary records. [2025-10-08T22:37:45.643159] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-08T22:37:45.668157] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-08T22:37:45.668403] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-08T22:37:45.670741] [INFO ] [MAIN ] Derivative Progress: 635/1771 symbols completed. ESS took 1.1s. Estimated remaining: 7m 21s. Rate: 154.4 symbols/min [2025-10-08T22:37:45.671085] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:45.684337] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:45.685084] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50106 primary records. [2025-10-08T22:37:45.685146] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-08T22:37:45.726051] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-08T22:37:45.726163] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-08T22:37:45.728480] [INFO ] [MAIN ] Derivative Progress: 636/1771 symbols completed. ESTC took 1.1s. Estimated remaining: 7m 20s. Rate: 154.6 symbols/min [2025-10-08T22:37:45.725964] [DEBUG] [LOCAL ] ETB: Loaded 12203 existing records from primary storage. [2025-10-08T22:37:45.728762] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:45.728968] [INFO ] [MAIN ] ETB: Loaded 12203 primary data records. [2025-10-08T22:37:45.851597] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-08T22:37:45.857522] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-08T22:37:45.999131] [DEBUG] [LOCAL ] ETD: Loaded 27379 existing records from primary storage. [2025-10-08T22:37:46.131762] [INFO ] [MAIN ] ETD: Loaded 27379 primary data records. [2025-10-08T22:37:46.775472] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:46.775759] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:46.776965] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12203 primary records. [2025-10-08T22:37:46.777862] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-08T22:37:46.778089] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-08T22:37:46.778778] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-08T22:37:46.810178] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-08T22:37:46.811724] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-08T22:37:46.812777] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-08T22:37:46.811634] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-08T22:37:46.815119] [INFO ] [MAIN ] Derivative Progress: 637/1771 symbols completed. ET took 1.2s. Estimated remaining: 7m 21s. Rate: 154.2 symbols/min [2025-10-08T22:37:46.818107] [INFO ] [MAIN ] Derivative Progress: 638/1771 symbols completed. ETB took 1.1s. Estimated remaining: 7m 20s. Rate: 154.4 symbols/min [2025-10-08T22:37:46.818799] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:46.818034] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:46.833304] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:46.834043] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27379 primary records. [2025-10-08T22:37:46.834108] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-08T22:37:46.850892] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-08T22:37:46.850990] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-08T22:37:46.854307] [INFO ] [MAIN ] Derivative Progress: 639/1771 symbols completed. ETD took 1.1s. Estimated remaining: 7m 19s. Rate: 154.6 symbols/min [2025-10-08T22:37:46.863153] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:46.877886] [DEBUG] [LOCAL ] ETG: Loaded 16576 existing records from primary storage. [2025-10-08T22:37:46.877435] [DEBUG] [LOCAL ] ETJ: Loaded 17038 existing records from primary storage. [2025-10-08T22:37:46.878084] [INFO ] [MAIN ] ETG: Loaded 16576 primary data records. [2025-10-08T22:37:46.889748] [INFO ] [MAIN ] ETJ: Loaded 17038 primary data records. [2025-10-08T22:37:47.528763] [DEBUG] [LOCAL ] ETN: Loaded 52702 existing records from primary storage. [2025-10-08T22:37:47.529411] [INFO ] [MAIN ] ETN: Loaded 52702 primary data records. [2025-10-08T22:37:47.846338] [DEBUG] [MAIN ] ETG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:47.857269] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16576 primary records. [2025-10-08T22:37:47.865365] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-08T22:37:47.883923] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:47.890111] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 17038 primary records. [2025-10-08T22:37:47.890502] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-08T22:37:47.910362] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-08T22:37:47.914044] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-08T22:37:47.913938] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-08T22:37:47.915022] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-08T22:37:47.917246] [INFO ] [MAIN ] Derivative Progress: 640/1771 symbols completed. ETG took 1.1s. Estimated remaining: 7m 20s. Rate: 154.2 symbols/min [2025-10-08T22:37:47.920283] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:47.920375] [INFO ] [MAIN ] Derivative Progress: 641/1771 symbols completed. ETJ took 1.1s. Estimated remaining: 7m 19s. Rate: 154.4 symbols/min [2025-10-08T22:37:47.921214] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:47.933193] [DEBUG] [LOCAL ] ETO: Loaded 6764 existing records from primary storage. [2025-10-08T22:37:47.933393] [INFO ] [MAIN ] ETO: Loaded 6764 primary data records. [2025-10-08T22:37:48.016995] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:48.029727] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52702 primary records. [2025-10-08T22:37:48.029890] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-08T22:37:48.163462] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-08T22:37:48.163769] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-08T22:37:48.166830] [INFO ] [MAIN ] Derivative Progress: 642/1771 symbols completed. ETN took 1.3s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-10-08T22:37:48.283164] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:48.303833] [DEBUG] [LOCAL ] ETR: Loaded 53231 existing records from primary storage. [2025-10-08T22:37:48.304231] [INFO ] [MAIN ] ETR: Loaded 53231 primary data records. [2025-10-08T22:37:48.435099] [DEBUG] [LOCAL ] ETV: Loaded 22112 existing records from primary storage. [2025-10-08T22:37:48.446136] [INFO ] [MAIN ] ETV: Loaded 22112 primary data records. [2025-10-08T22:37:48.821779] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:48.860190] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6764 primary records. [2025-10-08T22:37:48.967013] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-08T22:37:49.000112] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-08T22:37:49.000469] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-08T22:37:49.003022] [INFO ] [MAIN ] Derivative Progress: 643/1771 symbols completed. ETO took 1.1s. Estimated remaining: 7m 19s. Rate: 154.3 symbols/min [2025-10-08T22:37:49.020283] [DEBUG] [MAIN ] ETR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:49.021235] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53231 primary records. [2025-10-08T22:37:49.021383] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-08T22:37:49.039636] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-08T22:37:49.040418] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-08T22:37:49.042633] [INFO ] [MAIN ] Derivative Progress: 644/1771 symbols completed. ETR took 1.1s. Estimated remaining: 7m 18s. Rate: 154.5 symbols/min [2025-10-08T22:37:49.055368] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:49.055966] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 22112 primary records. [2025-10-08T22:37:49.056028] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-08T22:37:49.071190] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-08T22:37:49.071250] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-08T22:37:49.073329] [INFO ] [MAIN ] Derivative Progress: 645/1771 symbols completed. ETV took 0.8s. Estimated remaining: 7m 17s. Rate: 154.7 symbols/min [2025-10-08T22:37:49.073936] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:49.074114] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:49.074048] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:49.082840] [DEBUG] [LOCAL ] ETX: Loaded 5220 existing records from primary storage. [2025-10-08T22:37:49.083033] [INFO ] [MAIN ] ETX: Loaded 5220 primary data records. [2025-10-08T22:37:49.205750] [DEBUG] [LOCAL ] ETY: Loaded 23084 existing records from primary storage. [2025-10-08T22:37:49.223733] [INFO ] [MAIN ] ETY: Loaded 23084 primary data records. [2025-10-08T22:37:49.261547] [DEBUG] [LOCAL ] ETW: Loaded 25426 existing records from primary storage. [2025-10-08T22:37:49.379741] [INFO ] [MAIN ] ETW: Loaded 25426 primary data records. [2025-10-08T22:37:50.022846] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:37:50.023738] [INFO ] [MAIN ] ETX: Generated 1792 derivative records from 5220 primary records. [2025-10-08T22:37:50.025134] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-08T22:37:50.042265] [DEBUG] [LOCAL ] ETX: Derivative data saved (1792 records). [2025-10-08T22:37:50.042609] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-08T22:37:50.044927] [INFO ] [MAIN ] Derivative Progress: 646/1771 symbols completed. ETX took 1.0s. Estimated remaining: 7m 17s. Rate: 154.3 symbols/min [2025-10-08T22:37:50.045186] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:50.063518] [DEBUG] [MAIN ] ETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:50.065749] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23084 primary records. [2025-10-08T22:37:50.070388] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-08T22:37:50.083820] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:50.104233] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25426 primary records. [2025-10-08T22:37:50.105867] [DEBUG] [LOCAL ] EVC: Loaded 18236 existing records from primary storage. [2025-10-08T22:37:50.105959] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-08T22:37:50.106066] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-08T22:37:50.106147] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-08T22:37:50.108490] [INFO ] [MAIN ] Derivative Progress: 647/1771 symbols completed. ETY took 1.0s. Estimated remaining: 7m 16s. Rate: 154.5 symbols/min [2025-10-08T22:37:50.108809] [INFO ] [MAIN ] EVC: Loaded 18236 primary data records. [2025-10-08T22:37:50.108667] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:50.228683] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-08T22:37:50.247149] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-08T22:37:50.259617] [INFO ] [MAIN ] Derivative Progress: 648/1771 symbols completed. ETW took 1.2s. Estimated remaining: 7m 16s. Rate: 154.7 symbols/min [2025-10-08T22:37:50.290756] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:50.439699] [DEBUG] [LOCAL ] EVEX: Loaded 31368 existing records from primary storage. [2025-10-08T22:37:50.440088] [INFO ] [MAIN ] EVEX: Loaded 31368 primary data records. [2025-10-08T22:37:50.563608] [DEBUG] [LOCAL ] EVF: Loaded 9735 existing records from primary storage. [2025-10-08T22:37:50.574520] [INFO ] [MAIN ] EVF: Loaded 9735 primary data records. [2025-10-08T22:37:51.110105] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:51.111409] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 18236 primary records. [2025-10-08T22:37:51.111508] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-08T22:37:51.127484] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-08T22:37:51.127621] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-08T22:37:51.129912] [INFO ] [MAIN ] Derivative Progress: 649/1771 symbols completed. EVC took 1.1s. Estimated remaining: 7m 16s. Rate: 154.4 symbols/min [2025-10-08T22:37:51.130227] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:51.150144] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:51.150946] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 31368 primary records. [2025-10-08T22:37:51.151050] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-08T22:37:51.162038] [DEBUG] [LOCAL ] EVG: Loaded 5983 existing records from primary storage. [2025-10-08T22:37:51.165583] [INFO ] [MAIN ] EVG: Loaded 5983 primary data records. [2025-10-08T22:37:51.253388] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-08T22:37:51.290918] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:51.291397] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-08T22:37:51.299359] [INFO ] [MAIN ] Derivative Progress: 650/1771 symbols completed. EVEX took 1.2s. Estimated remaining: 7m 15s. Rate: 154.5 symbols/min [2025-10-08T22:37:51.300399] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9735 primary records. [2025-10-08T22:37:51.316008] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-08T22:37:51.305631] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:51.392631] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-08T22:37:51.505213] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-08T22:37:51.508230] [INFO ] [MAIN ] Derivative Progress: 651/1771 symbols completed. EVF took 1.2s. Estimated remaining: 7m 15s. Rate: 154.6 symbols/min [2025-10-08T22:37:51.508694] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:51.535460] [DEBUG] [LOCAL ] EVN: Loaded 11115 existing records from primary storage. [2025-10-08T22:37:51.535797] [INFO ] [MAIN ] EVN: Loaded 11115 primary data records. [2025-10-08T22:37:51.677359] [DEBUG] [LOCAL ] EVH: Loaded 49565 existing records from primary storage. [2025-10-08T22:37:51.698337] [INFO ] [MAIN ] EVH: Loaded 49565 primary data records. [2025-10-08T22:37:51.702810] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:51.725417] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5983 primary records. [2025-10-08T22:37:51.766583] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-08T22:37:52.040217] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-08T22:37:52.052012] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-08T22:37:52.059820] [INFO ] [MAIN ] Derivative Progress: 652/1771 symbols completed. EVG took 0.9s. Estimated remaining: 7m 14s. Rate: 154.5 symbols/min [2025-10-08T22:37:52.060149] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:52.300004] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:52.301179] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 11115 primary records. [2025-10-08T22:37:52.301351] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-08T22:37:52.326671] [DEBUG] [LOCAL ] EVR: Loaded 34583 existing records from primary storage. [2025-10-08T22:37:52.328971] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-08T22:37:52.329483] [INFO ] [MAIN ] EVR: Loaded 34583 primary data records. [2025-10-08T22:37:52.329401] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-08T22:37:52.343012] [INFO ] [MAIN ] Derivative Progress: 653/1771 symbols completed. EVN took 0.8s. Estimated remaining: 7m 14s. Rate: 154.6 symbols/min [2025-10-08T22:37:52.343325] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:52.480668] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:52.538490] [DEBUG] [LOCAL ] EVT: Loaded 16893 existing records from primary storage. [2025-10-08T22:37:52.512256] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49565 primary records. [2025-10-08T22:37:52.644600] [INFO ] [MAIN ] EVT: Loaded 16893 primary data records. [2025-10-08T22:37:52.694103] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-08T22:37:52.804281] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-08T22:37:52.823191] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-08T22:37:52.825660] [INFO ] [MAIN ] Derivative Progress: 654/1771 symbols completed. EVH took 1.5s. Estimated remaining: 7m 14s. Rate: 154.5 symbols/min [2025-10-08T22:37:52.831631] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:53.050443] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:53.051315] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 34583 primary records. [2025-10-08T22:37:53.051466] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-08T22:37:53.061679] [DEBUG] [LOCAL ] EVTC: Loaded 26384 existing records from primary storage. [2025-10-08T22:37:53.061839] [INFO ] [MAIN ] EVTC: Loaded 26384 primary data records. [2025-10-08T22:37:53.153037] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-08T22:37:53.158547] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-08T22:37:53.166095] [INFO ] [MAIN ] Derivative Progress: 655/1771 symbols completed. EVR took 1.1s. Estimated remaining: 7m 13s. Rate: 154.6 symbols/min [2025-10-08T22:37:53.166268] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:53.391584] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:53.392470] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16893 primary records. [2025-10-08T22:37:53.392537] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-08T22:37:53.422268] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-08T22:37:53.422573] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-08T22:37:53.424933] [INFO ] [MAIN ] Derivative Progress: 656/1771 symbols completed. EVT took 1.1s. Estimated remaining: 7m 13s. Rate: 154.6 symbols/min [2025-10-08T22:37:53.425186] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:53.440127] [DEBUG] [LOCAL ] EVTL: Loaded 39239 existing records from primary storage. [2025-10-08T22:37:53.440610] [INFO ] [MAIN ] EVTL: Loaded 39239 primary data records. [2025-10-08T22:37:53.594572] [DEBUG] [LOCAL ] EVTR: Loaded 24255 existing records from primary storage. [2025-10-08T22:37:53.600388] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:53.616135] [INFO ] [MAIN ] EVTR: Loaded 24255 primary data records. [2025-10-08T22:37:53.616054] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26384 primary records. [2025-10-08T22:37:53.678619] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-08T22:37:53.937074] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-08T22:37:53.983678] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-08T22:37:54.093487] [INFO ] [MAIN ] Derivative Progress: 657/1771 symbols completed. EVTC took 1.3s. Estimated remaining: 7m 13s. Rate: 154.5 symbols/min [2025-10-08T22:37:54.094560] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:54.120446] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:54.121486] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 39239 primary records. [2025-10-08T22:37:54.121690] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-08T22:37:54.138120] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-08T22:37:54.139977] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-08T22:37:54.143009] [INFO ] [MAIN ] Derivative Progress: 658/1771 symbols completed. EVTL took 1.0s. Estimated remaining: 7m 12s. Rate: 154.7 symbols/min [2025-10-08T22:37:54.156391] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:37:54.170449] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 24255 primary records. [2025-10-08T22:37:54.170549] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-08T22:37:54.185975] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-10-08T22:37:54.186140] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-08T22:37:54.188854] [INFO ] [MAIN ] Derivative Progress: 659/1771 symbols completed. EVTR took 0.8s. Estimated remaining: 7m 11s. Rate: 154.9 symbols/min [2025-10-08T22:37:54.205185] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-08T22:37:54.205299] [INFO ] [MAIN ] EW: Loaded 53402 primary data records. [2025-10-08T22:37:54.543152] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:54.543872] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53402 primary records. [2025-10-08T22:37:54.543936] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-08T22:37:54.559095] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-08T22:37:54.559181] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-08T22:37:54.561385] [INFO ] [MAIN ] Derivative Progress: 660/1771 symbols completed. EW took 0.5s. Estimated remaining: 7m 10s. Rate: 154.9 symbols/min [2025-10-08T22:37:54.561868] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:54.562088] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:54.562023] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:54.610990] [DEBUG] [LOCAL ] EXP: Loaded 29620 existing records from primary storage. [2025-10-08T22:37:54.611751] [INFO ] [MAIN ] EXP: Loaded 29620 primary data records. [2025-10-08T22:37:54.611671] [DEBUG] [LOCAL ] EXG: Loaded 34256 existing records from primary storage. [2025-10-08T22:37:54.624776] [INFO ] [MAIN ] EXG: Loaded 34256 primary data records. [2025-10-08T22:37:54.888131] [DEBUG] [LOCAL ] EXK: Loaded 53142 existing records from primary storage. [2025-10-08T22:37:54.912594] [INFO ] [MAIN ] EXK: Loaded 53142 primary data records. [2025-10-08T22:37:55.599986] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:55.612716] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29620 primary records. [2025-10-08T22:37:55.613158] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:55.612915] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-08T22:37:55.614284] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34256 primary records. [2025-10-08T22:37:55.614775] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-08T22:37:55.643924] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-08T22:37:55.646719] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-08T22:37:55.646590] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-08T22:37:55.649299] [INFO ] [MAIN ] Derivative Progress: 661/1771 symbols completed. EXG took 1.1s. Estimated remaining: 7m 11s. Rate: 154.5 symbols/min [2025-10-08T22:37:55.649466] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-08T22:37:55.649610] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:55.653088] [INFO ] [MAIN ] Derivative Progress: 662/1771 symbols completed. EXP took 1.1s. Estimated remaining: 7m 10s. Rate: 154.7 symbols/min [2025-10-08T22:37:55.653236] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:55.668742] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:55.669613] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53142 primary records. [2025-10-08T22:37:55.669727] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-08T22:37:55.686690] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-08T22:37:55.686977] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-08T22:37:55.690781] [INFO ] [MAIN ] Derivative Progress: 663/1771 symbols completed. EXK took 1.1s. Estimated remaining: 7m 9s. Rate: 154.9 symbols/min [2025-10-08T22:37:55.691329] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:55.744732] [DEBUG] [LOCAL ] EXR: Loaded 45251 existing records from primary storage. [2025-10-08T22:37:55.745012] [INFO ] [MAIN ] EXR: Loaded 45251 primary data records. [2025-10-08T22:37:55.860884] [DEBUG] [LOCAL ] EXPD: Loaded 47841 existing records from primary storage. [2025-10-08T22:37:55.867862] [INFO ] [MAIN ] EXPD: Loaded 47841 primary data records. [2025-10-08T22:37:56.043347] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-08T22:37:56.091781] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-08T22:37:56.812286] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:56.813342] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45251 primary records. [2025-10-08T22:37:56.813570] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-08T22:37:56.836999] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:56.842003] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47841 primary records. [2025-10-08T22:37:56.844211] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-08T22:37:56.847853] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-08T22:37:56.848159] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-08T22:37:56.850639] [INFO ] [MAIN ] Derivative Progress: 664/1771 symbols completed. EXR took 1.2s. Estimated remaining: 7m 10s. Rate: 154.4 symbols/min [2025-10-08T22:37:56.862516] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:56.872751] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-08T22:37:56.873095] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-08T22:37:56.875410] [INFO ] [MAIN ] Derivative Progress: 665/1771 symbols completed. EXPD took 1.2s. Estimated remaining: 7m 9s. Rate: 154.7 symbols/min [2025-10-08T22:37:56.875682] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:56.888859] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:56.889596] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-08T22:37:56.889888] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-08T22:37:56.912352] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-08T22:37:56.912576] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-08T22:37:56.914887] [INFO ] [MAIN ] Derivative Progress: 666/1771 symbols completed. F took 1.2s. Estimated remaining: 7m 8s. Rate: 154.9 symbols/min [2025-10-08T22:37:56.915084] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:56.942763] [DEBUG] [LOCAL ] FAF: Loaded 41546 existing records from primary storage. [2025-10-08T22:37:56.943029] [INFO ] [MAIN ] FAF: Loaded 41546 primary data records. [2025-10-08T22:37:57.040720] [DEBUG] [LOCAL ] FBK: Loaded 26718 existing records from primary storage. [2025-10-08T22:37:57.052476] [INFO ] [MAIN ] FBK: Loaded 26718 primary data records. [2025-10-08T22:37:57.107058] [DEBUG] [LOCAL ] FBIN: Loaded 50379 existing records from primary storage. [2025-10-08T22:37:57.133113] [INFO ] [MAIN ] FBIN: Loaded 50379 primary data records. [2025-10-08T22:37:57.956913] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:57.959670] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41546 primary records. [2025-10-08T22:37:57.960010] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-08T22:37:57.974390] [DEBUG] [MAIN ] FBIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:57.986472] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50379 primary records. [2025-10-08T22:37:57.987670] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-08T22:37:57.990964] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-08T22:37:57.991197] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-08T22:37:57.994826] [INFO ] [MAIN ] Derivative Progress: 667/1771 symbols completed. FAF took 1.1s. Estimated remaining: 7m 9s. Rate: 154.5 symbols/min [2025-10-08T22:37:57.995188] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:58.015638] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-08T22:37:58.029384] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-08T22:37:58.031479] [INFO ] [MAIN ] Derivative Progress: 668/1771 symbols completed. FBIN took 1.2s. Estimated remaining: 7m 8s. Rate: 154.7 symbols/min [2025-10-08T22:37:58.031945] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:58.032118] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:58.033398] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 26718 primary records. [2025-10-08T22:37:58.033618] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-08T22:37:58.052452] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-08T22:37:58.063264] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-08T22:37:58.070585] [INFO ] [MAIN ] Derivative Progress: 669/1771 symbols completed. FBK took 1.2s. Estimated remaining: 7m 7s. Rate: 154.9 symbols/min [2025-10-08T22:37:58.070863] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:58.095749] [DEBUG] [LOCAL ] FBP: Loaded 45763 existing records from primary storage. [2025-10-08T22:37:58.100587] [INFO ] [MAIN ] FBP: Loaded 45763 primary data records. [2025-10-08T22:37:58.147546] [DEBUG] [LOCAL ] FBRT: Loaded 35080 existing records from primary storage. [2025-10-08T22:37:58.166145] [INFO ] [MAIN ] FBRT: Loaded 35080 primary data records. [2025-10-08T22:37:58.241242] [DEBUG] [LOCAL ] FC: Loaded 15157 existing records from primary storage. [2025-10-08T22:37:58.280046] [INFO ] [MAIN ] FC: Loaded 15157 primary data records. [2025-10-08T22:37:59.137328] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:59.140308] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45763 primary records. [2025-10-08T22:37:59.140801] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-08T22:37:59.162180] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:59.164532] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 35080 primary records. [2025-10-08T22:37:59.165196] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-08T22:37:59.191568] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-08T22:37:59.200313] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-08T22:37:59.207922] [INFO ] [MAIN ] Derivative Progress: 670/1771 symbols completed. FBRT took 1.2s. Estimated remaining: 7m 8s. Rate: 154.4 symbols/min [2025-10-08T22:37:59.209982] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:59.208572] [DEBUG] [MAIN ] FC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:37:59.211162] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15157 primary records. [2025-10-08T22:37:59.211442] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-08T22:37:59.209878] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-08T22:37:59.213173] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-08T22:37:59.222517] [INFO ] [MAIN ] Derivative Progress: 671/1771 symbols completed. FBP took 1.2s. Estimated remaining: 7m 7s. Rate: 154.7 symbols/min [2025-10-08T22:37:59.227682] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:59.233872] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-08T22:37:59.234176] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-08T22:37:59.237148] [INFO ] [MAIN ] Derivative Progress: 672/1771 symbols completed. FC took 1.2s. Estimated remaining: 7m 6s. Rate: 154.9 symbols/min [2025-10-08T22:37:59.237452] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:37:59.269116] [DEBUG] [LOCAL ] FCN: Loaded 26003 existing records from primary storage. [2025-10-08T22:37:59.269382] [INFO ] [MAIN ] FCN: Loaded 26003 primary data records. [2025-10-08T22:37:59.384093] [DEBUG] [LOCAL ] FCF: Loaded 39188 existing records from primary storage. [2025-10-08T22:37:59.402226] [INFO ] [MAIN ] FCF: Loaded 39188 primary data records. [2025-10-08T22:37:59.671603] [DEBUG] [LOCAL ] FCPT: Loaded 37317 existing records from primary storage. [2025-10-08T22:37:59.718405] [INFO ] [MAIN ] FCPT: Loaded 37317 primary data records. [2025-10-08T22:38:00.244332] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:00.245337] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26003 primary records. [2025-10-08T22:38:00.245514] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-08T22:38:00.275971] [DEBUG] [MAIN ] FCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:00.277617] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39188 primary records. [2025-10-08T22:38:00.277733] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-08T22:38:00.291771] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-08T22:38:00.293030] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-08T22:38:00.295885] [INFO ] [MAIN ] Derivative Progress: 673/1771 symbols completed. FCN took 1.1s. Estimated remaining: 7m 6s. Rate: 154.5 symbols/min [2025-10-08T22:38:00.310968] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:00.311926] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-08T22:38:00.312690] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-08T22:38:00.312579] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37317 primary records. [2025-10-08T22:38:00.314791] [INFO ] [MAIN ] Derivative Progress: 674/1771 symbols completed. FCF took 1.1s. Estimated remaining: 7m 5s. Rate: 154.7 symbols/min [2025-10-08T22:38:00.314850] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-08T22:38:00.330445] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-08T22:38:00.330504] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-08T22:38:00.333291] [INFO ] [MAIN ] Derivative Progress: 675/1771 symbols completed. FCPT took 1.1s. Estimated remaining: 7m 4s. Rate: 154.9 symbols/min [2025-10-08T22:38:00.333919] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:00.333861] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:00.334010] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:00.350882] [DEBUG] [LOCAL ] FCT: Loaded 14779 existing records from primary storage. [2025-10-08T22:38:00.351165] [INFO ] [MAIN ] FCT: Loaded 14779 primary data records. [2025-10-08T22:38:00.530637] [DEBUG] [LOCAL ] FDP: Loaded 30061 existing records from primary storage. [2025-10-08T22:38:00.560193] [INFO ] [MAIN ] FDP: Loaded 30061 primary data records. [2025-10-08T22:38:00.813605] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-08T22:38:00.814189] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-10-08T22:38:01.382726] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:01.384017] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14779 primary records. [2025-10-08T22:38:01.384317] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-08T22:38:01.403483] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-08T22:38:01.403898] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-08T22:38:01.407162] [INFO ] [MAIN ] Derivative Progress: 676/1771 symbols completed. FCT took 1.1s. Estimated remaining: 7m 5s. Rate: 154.5 symbols/min [2025-10-08T22:38:01.408303] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:01.425798] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:01.426829] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30061 primary records. [2025-10-08T22:38:01.434978] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-08T22:38:01.446388] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:01.447299] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-10-08T22:38:01.460185] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-08T22:38:01.484721] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-08T22:38:01.485503] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-08T22:38:01.489633] [INFO ] [MAIN ] Derivative Progress: 677/1771 symbols completed. FDP took 1.2s. Estimated remaining: 7m 4s. Rate: 154.7 symbols/min [2025-10-08T22:38:01.490980] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:01.502559] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-08T22:38:01.503099] [DEBUG] [LOCAL ] FDS: Loaded 26941 existing records from primary storage. [2025-10-08T22:38:01.503286] [INFO ] [MAIN ] FDS: Loaded 26941 primary data records. [2025-10-08T22:38:01.503447] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-08T22:38:01.518127] [INFO ] [MAIN ] Derivative Progress: 678/1771 symbols completed. FCX took 1.2s. Estimated remaining: 7m 3s. Rate: 154.9 symbols/min [2025-10-08T22:38:01.551398] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:01.847185] [DEBUG] [LOCAL ] FDX: Loaded 51462 existing records from primary storage. [2025-10-08T22:38:01.859700] [INFO ] [MAIN ] FDX: Loaded 51462 primary data records. [2025-10-08T22:38:02.031501] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-08T22:38:02.069705] [INFO ] [MAIN ] FE: Loaded 53433 primary data records. [2025-10-08T22:38:02.363571] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:02.393815] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 26941 primary records. [2025-10-08T22:38:02.525283] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-08T22:38:02.567985] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-08T22:38:02.568974] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-08T22:38:02.569725] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:02.574929] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51462 primary records. [2025-10-08T22:38:02.573947] [INFO ] [MAIN ] Derivative Progress: 679/1771 symbols completed. FDS took 1.2s. Estimated remaining: 7m 4s. Rate: 154.5 symbols/min [2025-10-08T22:38:02.575714] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:02.575871] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-08T22:38:02.606682] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-08T22:38:02.612263] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-08T22:38:02.612166] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:02.619264] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53433 primary records. [2025-10-08T22:38:02.619431] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-08T22:38:02.618408] [INFO ] [MAIN ] Derivative Progress: 680/1771 symbols completed. FDX took 1.1s. Estimated remaining: 7m 3s. Rate: 154.7 symbols/min [2025-10-08T22:38:02.620730] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:02.637373] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-08T22:38:02.637462] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-08T22:38:02.639577] [INFO ] [MAIN ] Derivative Progress: 681/1771 symbols completed. FE took 1.1s. Estimated remaining: 7m 2s. Rate: 154.9 symbols/min [2025-10-08T22:38:02.650878] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:02.661861] [DEBUG] [LOCAL ] FET: Loaded 12811 existing records from primary storage. [2025-10-08T22:38:02.662056] [INFO ] [MAIN ] FET: Loaded 12811 primary data records. [2025-10-08T22:38:02.783971] [DEBUG] [LOCAL ] FERG: Loaded 48754 existing records from primary storage. [2025-10-08T22:38:02.784198] [INFO ] [MAIN ] FERG: Loaded 48754 primary data records. [2025-10-08T22:38:02.880162] [DEBUG] [LOCAL ] FF: Loaded 24514 existing records from primary storage. [2025-10-08T22:38:02.906202] [INFO ] [MAIN ] FF: Loaded 24514 primary data records. [2025-10-08T22:38:03.652619] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:03.654362] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12811 primary records. [2025-10-08T22:38:03.656045] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-08T22:38:03.685032] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-08T22:38:03.686184] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:03.687131] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48754 primary records. [2025-10-08T22:38:03.687360] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-08T22:38:03.686311] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-08T22:38:03.689722] [INFO ] [MAIN ] Derivative Progress: 682/1771 symbols completed. FET took 1.1s. Estimated remaining: 7m 3s. Rate: 154.5 symbols/min [2025-10-08T22:38:03.690899] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:03.723495] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:03.725350] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 24514 primary records. [2025-10-08T22:38:03.726100] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-08T22:38:03.730757] [DEBUG] [LOCAL ] FFA: Loaded 6060 existing records from primary storage. [2025-10-08T22:38:03.730994] [INFO ] [MAIN ] FFA: Loaded 6060 primary data records. [2025-10-08T22:38:03.730896] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-08T22:38:03.731147] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-08T22:38:03.761674] [INFO ] [MAIN ] Derivative Progress: 683/1771 symbols completed. FERG took 1.2s. Estimated remaining: 7m 2s. Rate: 154.7 symbols/min [2025-10-08T22:38:03.775517] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:03.794997] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-08T22:38:03.808494] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-08T22:38:03.822843] [INFO ] [MAIN ] Derivative Progress: 684/1771 symbols completed. FF took 1.2s. Estimated remaining: 7m 1s. Rate: 154.9 symbols/min [2025-10-08T22:38:03.833344] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:04.128751] [DEBUG] [LOCAL ] FFC: Loaded 16723 existing records from primary storage. [2025-10-08T22:38:04.129135] [INFO ] [MAIN ] FFC: Loaded 16723 primary data records. [2025-10-08T22:38:04.261256] [DEBUG] [LOCAL ] FFWM: Loaded 35821 existing records from primary storage. [2025-10-08T22:38:04.275338] [INFO ] [MAIN ] FFWM: Loaded 35821 primary data records. [2025-10-08T22:38:04.884953] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:04.888797] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 6060 primary records. [2025-10-08T22:38:04.889144] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-08T22:38:04.911194] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-10-08T22:38:04.923748] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-08T22:38:04.926019] [INFO ] [MAIN ] Derivative Progress: 685/1771 symbols completed. FFA took 1.2s. Estimated remaining: 7m 2s. Rate: 154.5 symbols/min [2025-10-08T22:38:04.924030] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:04.927281] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16723 primary records. [2025-10-08T22:38:04.927374] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-08T22:38:04.928207] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:04.948856] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-08T22:38:04.961501] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-08T22:38:04.963563] [INFO ] [MAIN ] Derivative Progress: 686/1771 symbols completed. FFC took 1.2s. Estimated remaining: 7m 1s. Rate: 154.7 symbols/min [2025-10-08T22:38:04.969243] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:04.970169] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35821 primary records. [2025-10-08T22:38:04.970355] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-08T22:38:04.969368] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:04.993028] [DEBUG] [LOCAL ] FG: Loaded 22742 existing records from primary storage. [2025-10-08T22:38:04.993687] [INFO ] [MAIN ] FG: Loaded 22742 primary data records. [2025-10-08T22:38:05.007724] [DEBUG] [LOCAL ] FGN: Loaded 3793 existing records from primary storage. [2025-10-08T22:38:05.017496] [INFO ] [MAIN ] FGN: Loaded 3793 primary data records. [2025-10-08T22:38:05.092831] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-08T22:38:05.130420] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-08T22:38:05.141662] [INFO ] [MAIN ] Derivative Progress: 687/1771 symbols completed. FFWM took 1.3s. Estimated remaining: 7m 0s. Rate: 154.8 symbols/min [2025-10-08T22:38:05.141842] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:05.683086] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:05.685903] [DEBUG] [LOCAL ] FHN: Loaded 53373 existing records from primary storage. [2025-10-08T22:38:05.686976] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3793 primary records. [2025-10-08T22:38:05.687321] [INFO ] [MAIN ] FHN: Loaded 53373 primary data records. [2025-10-08T22:38:05.687540] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-08T22:38:05.745539] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:38:05.752239] [INFO ] [MAIN ] FG: Generated 1793 derivative records from 22742 primary records. [2025-10-08T22:38:05.777373] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-08T22:38:05.830053] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-08T22:38:05.841385] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-08T22:38:05.849727] [INFO ] [MAIN ] Derivative Progress: 688/1771 symbols completed. FGN took 0.9s. Estimated remaining: 7m 0s. Rate: 154.6 symbols/min [2025-10-08T22:38:05.938078] [DEBUG] [LOCAL ] FG: Derivative data saved (1793 records). [2025-10-08T22:38:05.956048] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-08T22:38:05.958799] [INFO ] [MAIN ] Derivative Progress: 689/1771 symbols completed. FG took 1.0s. Estimated remaining: 6m 59s. Rate: 154.8 symbols/min [2025-10-08T22:38:06.121868] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:06.122668] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53373 primary records. [2025-10-08T22:38:06.122739] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-08T22:38:06.139800] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-08T22:38:06.139892] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-08T22:38:06.142176] [INFO ] [MAIN ] Derivative Progress: 690/1771 symbols completed. FHN took 1.0s. Estimated remaining: 6m 59s. Rate: 154.9 symbols/min [2025-10-08T22:38:06.142892] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:06.143051] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:06.143226] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:06.168777] [DEBUG] [LOCAL ] FICO: Loaded 21409 existing records from primary storage. [2025-10-08T22:38:06.168928] [INFO ] [MAIN ] FICO: Loaded 21409 primary data records. [2025-10-08T22:38:06.352272] [DEBUG] [LOCAL ] FIGS: Loaded 48743 existing records from primary storage. [2025-10-08T22:38:06.381529] [INFO ] [MAIN ] FIGS: Loaded 48743 primary data records. [2025-10-08T22:38:06.620772] [DEBUG] [LOCAL ] FI: Loaded 53534 existing records from primary storage. [2025-10-08T22:38:06.621389] [INFO ] [MAIN ] FI: Loaded 53534 primary data records. [2025-10-08T22:38:07.200417] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:07.202264] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 21409 primary records. [2025-10-08T22:38:07.202603] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-08T22:38:07.221958] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-10-08T22:38:07.222520] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-08T22:38:07.224771] [INFO ] [MAIN ] Derivative Progress: 691/1771 symbols completed. FICO took 1.1s. Estimated remaining: 6m 59s. Rate: 154.5 symbols/min [2025-10-08T22:38:07.225261] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:07.246539] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:07.258858] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48743 primary records. [2025-10-08T22:38:07.259435] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-08T22:38:07.259696] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:07.260862] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53534 primary records. [2025-10-08T22:38:07.261219] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-08T22:38:07.292850] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-08T22:38:07.293534] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-08T22:38:07.297038] [INFO ] [MAIN ] Derivative Progress: 692/1771 symbols completed. FI took 1.2s. Estimated remaining: 6m 59s. Rate: 154.7 symbols/min [2025-10-08T22:38:07.305667] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:07.308933] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-08T22:38:07.309118] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-08T22:38:07.311102] [INFO ] [MAIN ] Derivative Progress: 693/1771 symbols completed. FIGS took 1.2s. Estimated remaining: 6m 58s. Rate: 154.9 symbols/min [2025-10-08T22:38:07.311444] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:07.330310] [DEBUG] [LOCAL ] FIHL: Loaded 39645 existing records from primary storage. [2025-10-08T22:38:07.330522] [INFO ] [MAIN ] FIHL: Loaded 39645 primary data records. [2025-10-08T22:38:07.391507] [DEBUG] [LOCAL ] FINS: Loaded 8304 existing records from primary storage. [2025-10-08T22:38:07.417780] [INFO ] [MAIN ] FINS: Loaded 8304 primary data records. [2025-10-08T22:38:07.840490] [DEBUG] [LOCAL ] FINV: Loaded 45214 existing records from primary storage. [2025-10-08T22:38:07.945921] [INFO ] [MAIN ] FINV: Loaded 45214 primary data records. [2025-10-08T22:38:08.290661] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:08.295510] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:08.296364] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8304 primary records. [2025-10-08T22:38:08.297270] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39645 primary records. [2025-10-08T22:38:08.297976] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-08T22:38:08.297919] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-08T22:38:08.326058] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-08T22:38:08.326722] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-08T22:38:08.329088] [INFO ] [MAIN ] Derivative Progress: 694/1771 symbols completed. FINS took 1.0s. Estimated remaining: 6m 58s. Rate: 154.5 symbols/min [2025-10-08T22:38:08.330624] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:08.335896] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-08T22:38:08.336718] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-08T22:38:08.338859] [INFO ] [MAIN ] Derivative Progress: 695/1771 symbols completed. FIHL took 1.1s. Estimated remaining: 6m 57s. Rate: 154.8 symbols/min [2025-10-08T22:38:08.339041] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:08.352118] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:08.352721] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45214 primary records. [2025-10-08T22:38:08.352783] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-08T22:38:08.371859] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-08T22:38:08.372010] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-08T22:38:08.374047] [INFO ] [MAIN ] Derivative Progress: 696/1771 symbols completed. FINV took 1.1s. Estimated remaining: 6m 56s. Rate: 155.0 symbols/min [2025-10-08T22:38:08.374387] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:08.402253] [DEBUG] [LOCAL ] FLC: Loaded 5366 existing records from primary storage. [2025-10-08T22:38:08.402398] [INFO ] [MAIN ] FLC: Loaded 5366 primary data records. [2025-10-08T22:38:08.507097] [DEBUG] [LOCAL ] FIX: Loaded 29294 existing records from primary storage. [2025-10-08T22:38:08.513331] [INFO ] [MAIN ] FIX: Loaded 29294 primary data records. [2025-10-08T22:38:08.513229] [DEBUG] [LOCAL ] FIS: Loaded 53350 existing records from primary storage. [2025-10-08T22:38:08.560425] [INFO ] [MAIN ] FIS: Loaded 53350 primary data records. [2025-10-08T22:38:09.375615] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:09.376708] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5366 primary records. [2025-10-08T22:38:09.377351] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-08T22:38:09.409779] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:09.410821] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-08T22:38:09.411014] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-08T22:38:09.414824] [INFO ] [MAIN ] Derivative Progress: 697/1771 symbols completed. FLC took 1.0s. Estimated remaining: 6m 57s. Rate: 154.6 symbols/min [2025-10-08T22:38:09.412346] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53350 primary records. [2025-10-08T22:38:09.415866] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-08T22:38:09.416594] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:09.443869] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:09.445779] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 29294 primary records. [2025-10-08T22:38:09.446182] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-08T22:38:09.458156] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-08T22:38:09.460967] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-08T22:38:09.464023] [INFO ] [MAIN ] Derivative Progress: 698/1771 symbols completed. FIS took 1.1s. Estimated remaining: 6m 56s. Rate: 154.8 symbols/min [2025-10-08T22:38:09.465768] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:09.468519] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-10-08T22:38:09.468852] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-08T22:38:09.471416] [INFO ] [MAIN ] Derivative Progress: 699/1771 symbols completed. FIX took 1.1s. Estimated remaining: 6m 55s. Rate: 155.0 symbols/min [2025-10-08T22:38:09.471861] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:09.525679] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-10-08T22:38:09.533062] [INFO ] [MAIN ] FLG: Loaded 53325 primary data records. [2025-10-08T22:38:09.656096] [DEBUG] [LOCAL ] FLNG: Loaded 33564 existing records from primary storage. [2025-10-08T22:38:09.667091] [INFO ] [MAIN ] FLNG: Loaded 33564 primary data records. [2025-10-08T22:38:09.957325] [DEBUG] [LOCAL ] FLO: Loaded 51950 existing records from primary storage. [2025-10-08T22:38:09.962008] [INFO ] [MAIN ] FLO: Loaded 51950 primary data records. [2025-10-08T22:38:10.500053] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:10.501448] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53325 primary records. [2025-10-08T22:38:10.501872] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-08T22:38:10.534843] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:10.537992] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33564 primary records. [2025-10-08T22:38:10.538589] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-08T22:38:10.538464] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-08T22:38:10.539441] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-08T22:38:10.550301] [INFO ] [MAIN ] Derivative Progress: 700/1771 symbols completed. FLG took 1.1s. Estimated remaining: 6m 56s. Rate: 154.6 symbols/min [2025-10-08T22:38:10.555171] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:10.570947] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:10.573539] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51950 primary records. [2025-10-08T22:38:10.574001] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-08T22:38:10.589108] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-08T22:38:10.589268] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-08T22:38:10.592577] [INFO ] [MAIN ] Derivative Progress: 701/1771 symbols completed. FLNG took 1.1s. Estimated remaining: 6m 55s. Rate: 154.8 symbols/min [2025-10-08T22:38:10.593007] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:10.602461] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-08T22:38:10.602671] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-08T22:38:10.605518] [INFO ] [MAIN ] Derivative Progress: 702/1771 symbols completed. FLO took 1.1s. Estimated remaining: 6m 54s. Rate: 155.0 symbols/min [2025-10-08T22:38:10.605868] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:10.678555] [DEBUG] [LOCAL ] FLR: Loaded 53168 existing records from primary storage. [2025-10-08T22:38:10.678996] [INFO ] [MAIN ] FLR: Loaded 53168 primary data records. [2025-10-08T22:38:10.679864] [DEBUG] [LOCAL ] FLS: Loaded 50253 existing records from primary storage. [2025-10-08T22:38:10.692326] [INFO ] [MAIN ] FLS: Loaded 50253 primary data records. [2025-10-08T22:38:11.093815] [DEBUG] [LOCAL ] FLUT: Loaded 50781 existing records from primary storage. [2025-10-08T22:38:11.230746] [INFO ] [MAIN ] FLUT: Loaded 50781 primary data records. [2025-10-08T22:38:11.723951] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:11.725149] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50253 primary records. [2025-10-08T22:38:11.724042] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:11.725273] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-08T22:38:11.727039] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53168 primary records. [2025-10-08T22:38:11.727238] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-08T22:38:11.758924] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-08T22:38:11.760210] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-08T22:38:11.762898] [INFO ] [MAIN ] Derivative Progress: 703/1771 symbols completed. FLR took 1.2s. Estimated remaining: 6m 55s. Rate: 154.6 symbols/min [2025-10-08T22:38:11.765203] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-10-08T22:38:11.765405] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-08T22:38:11.767699] [INFO ] [MAIN ] Derivative Progress: 704/1771 symbols completed. FLS took 1.2s. Estimated remaining: 6m 54s. Rate: 154.8 symbols/min [2025-10-08T22:38:11.783238] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:11.783832] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50781 primary records. [2025-10-08T22:38:11.783894] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-08T22:38:11.799243] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-08T22:38:11.799305] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-08T22:38:11.801258] [INFO ] [MAIN ] Derivative Progress: 705/1771 symbols completed. FLUT took 1.2s. Estimated remaining: 6m 53s. Rate: 155.0 symbols/min [2025-10-08T22:38:11.801928] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:11.802150] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:11.802015] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:11.817315] [DEBUG] [LOCAL ] FMN: Loaded 5285 existing records from primary storage. [2025-10-08T22:38:11.817507] [INFO ] [MAIN ] FMN: Loaded 5285 primary data records. [2025-10-08T22:38:11.935592] [DEBUG] [LOCAL ] FLXR: Loaded 20757 existing records from primary storage. [2025-10-08T22:38:11.954482] [INFO ] [MAIN ] FLXR: Loaded 20757 primary data records. [2025-10-08T22:38:12.134794] [DEBUG] [LOCAL ] FMC: Loaded 51801 existing records from primary storage. [2025-10-08T22:38:12.280426] [INFO ] [MAIN ] FMC: Loaded 51801 primary data records. [2025-10-08T22:38:12.900405] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:12.904133] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5285 primary records. [2025-10-08T22:38:12.905459] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-08T22:38:12.929711] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:12.930632] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 20757 primary records. [2025-10-08T22:38:12.932871] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-08T22:38:12.934727] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-08T22:38:12.934966] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-08T22:38:12.937612] [INFO ] [MAIN ] Derivative Progress: 706/1771 symbols completed. FMN took 1.1s. Estimated remaining: 6m 53s. Rate: 154.6 symbols/min [2025-10-08T22:38:12.945224] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:12.957251] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-10-08T22:38:12.957458] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-08T22:38:12.959917] [INFO ] [MAIN ] Derivative Progress: 707/1771 symbols completed. FLXR took 1.2s. Estimated remaining: 6m 52s. Rate: 154.8 symbols/min [2025-10-08T22:38:12.960077] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:12.973384] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:12.974342] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51801 primary records. [2025-10-08T22:38:12.974472] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-08T22:38:12.998767] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-08T22:38:12.999183] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-08T22:38:13.001364] [INFO ] [MAIN ] Derivative Progress: 708/1771 symbols completed. FMC took 1.2s. Estimated remaining: 6m 52s. Rate: 155.0 symbols/min [2025-10-08T22:38:13.001587] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:13.015481] [DEBUG] [LOCAL ] FMY: Loaded 1384 existing records from primary storage. [2025-10-08T22:38:13.015738] [INFO ] [MAIN ] FMY: Loaded 1384 primary data records. [2025-10-08T22:38:13.096367] [DEBUG] [LOCAL ] FMS: Loaded 29995 existing records from primary storage. [2025-10-08T22:38:13.108433] [INFO ] [MAIN ] FMS: Loaded 29995 primary data records. [2025-10-08T22:38:13.254450] [DEBUG] [LOCAL ] FMX: Loaded 40585 existing records from primary storage. [2025-10-08T22:38:13.288595] [INFO ] [MAIN ] FMX: Loaded 40585 primary data records. [2025-10-08T22:38:13.977266] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:38:13.979041] [INFO ] [MAIN ] FMY: Generated 1792 derivative records from 1384 primary records. [2025-10-08T22:38:13.979237] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-08T22:38:13.995981] [DEBUG] [LOCAL ] FMY: Derivative data saved (1792 records). [2025-10-08T22:38:13.996157] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-08T22:38:14.005622] [INFO ] [MAIN ] Derivative Progress: 709/1771 symbols completed. FMY took 1.0s. Estimated remaining: 6m 52s. Rate: 154.6 symbols/min [2025-10-08T22:38:14.010970] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:14.011940] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:14.011790] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 29995 primary records. [2025-10-08T22:38:14.012490] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-08T22:38:14.044053] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:14.045551] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40585 primary records. [2025-10-08T22:38:14.046009] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-08T22:38:14.048579] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-08T22:38:14.065679] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-08T22:38:14.065831] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-08T22:38:14.062777] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-08T22:38:14.068168] [INFO ] [MAIN ] Derivative Progress: 710/1771 symbols completed. FMX took 1.1s. Estimated remaining: 6m 51s. Rate: 154.8 symbols/min [2025-10-08T22:38:14.070872] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:14.071082] [INFO ] [MAIN ] Derivative Progress: 711/1771 symbols completed. FMS took 1.1s. Estimated remaining: 6m 50s. Rate: 155.0 symbols/min [2025-10-08T22:38:14.080996] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:14.098590] [DEBUG] [LOCAL ] FN: Loaded 38138 existing records from primary storage. [2025-10-08T22:38:14.098791] [INFO ] [MAIN ] FN: Loaded 38138 primary data records. [2025-10-08T22:38:14.474787] [DEBUG] [LOCAL ] FND: Loaded 52108 existing records from primary storage. [2025-10-08T22:38:14.476391] [DEBUG] [LOCAL ] FNB: Loaded 52530 existing records from primary storage. [2025-10-08T22:38:14.476671] [INFO ] [MAIN ] FND: Loaded 52108 primary data records. [2025-10-08T22:38:14.476878] [INFO ] [MAIN ] FNB: Loaded 52530 primary data records. [2025-10-08T22:38:15.153809] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:15.154938] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 38138 primary records. [2025-10-08T22:38:15.155040] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-08T22:38:15.176271] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-08T22:38:15.178835] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-08T22:38:15.195233] [INFO ] [MAIN ] Derivative Progress: 712/1771 symbols completed. FN took 1.2s. Estimated remaining: 6m 51s. Rate: 154.6 symbols/min [2025-10-08T22:38:15.195829] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:15.196801] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52108 primary records. [2025-10-08T22:38:15.195936] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:15.197035] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-08T22:38:15.211045] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:15.223502] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52530 primary records. [2025-10-08T22:38:15.223873] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-08T22:38:15.242800] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-08T22:38:15.242946] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-08T22:38:15.245377] [INFO ] [MAIN ] Derivative Progress: 713/1771 symbols completed. FNB took 1.2s. Estimated remaining: 6m 50s. Rate: 154.8 symbols/min [2025-10-08T22:38:15.245796] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:15.250008] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-08T22:38:15.250218] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-08T22:38:15.252688] [INFO ] [MAIN ] Derivative Progress: 714/1771 symbols completed. FND took 1.2s. Estimated remaining: 6m 49s. Rate: 155.0 symbols/min [2025-10-08T22:38:15.252989] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:15.277441] [DEBUG] [LOCAL ] FOA: Loaded 13062 existing records from primary storage. [2025-10-08T22:38:15.277582] [INFO ] [MAIN ] FOA: Loaded 13062 primary data records. [2025-10-08T22:38:15.418791] [DEBUG] [LOCAL ] FNF: Loaded 48933 existing records from primary storage. [2025-10-08T22:38:15.435591] [INFO ] [MAIN ] FNF: Loaded 48933 primary data records. [2025-10-08T22:38:15.670971] [DEBUG] [LOCAL ] FNV: Loaded 46166 existing records from primary storage. [2025-10-08T22:38:15.698361] [INFO ] [MAIN ] FNV: Loaded 46166 primary data records. [2025-10-08T22:38:16.281429] [DEBUG] [MAIN ] FOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:16.282299] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13062 primary records. [2025-10-08T22:38:16.282401] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-08T22:38:16.316429] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:16.317950] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-08T22:38:16.318861] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48933 primary records. [2025-10-08T22:38:16.320083] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-08T22:38:16.319054] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-08T22:38:16.323428] [INFO ] [MAIN ] Derivative Progress: 715/1771 symbols completed. FOA took 1.1s. Estimated remaining: 6m 50s. Rate: 154.6 symbols/min [2025-10-08T22:38:16.323981] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:16.351586] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:16.353742] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46166 primary records. [2025-10-08T22:38:16.354100] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-08T22:38:16.357855] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-08T22:38:16.369269] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-08T22:38:16.372969] [INFO ] [MAIN ] Derivative Progress: 716/1771 symbols completed. FNF took 1.2s. Estimated remaining: 6m 49s. Rate: 154.8 symbols/min [2025-10-08T22:38:16.373149] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:16.380058] [DEBUG] [LOCAL ] FOF: Loaded 8522 existing records from primary storage. [2025-10-08T22:38:16.381471] [INFO ] [MAIN ] FOF: Loaded 8522 primary data records. [2025-10-08T22:38:16.442937] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-08T22:38:16.463407] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-08T22:38:16.470805] [INFO ] [MAIN ] Derivative Progress: 717/1771 symbols completed. FNV took 1.2s. Estimated remaining: 6m 48s. Rate: 155.0 symbols/min [2025-10-08T22:38:16.500209] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:16.501133] [DEBUG] [LOCAL ] FOR: Loaded 19696 existing records from primary storage. [2025-10-08T22:38:16.501892] [INFO ] [MAIN ] FOR: Loaded 19696 primary data records. [2025-10-08T22:38:17.072178] [DEBUG] [LOCAL ] FOUR: Loaded 49586 existing records from primary storage. [2025-10-08T22:38:17.072500] [INFO ] [MAIN ] FOUR: Loaded 49586 primary data records. [2025-10-08T22:38:17.411340] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:17.413160] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8522 primary records. [2025-10-08T22:38:17.414082] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-08T22:38:17.435993] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-08T22:38:17.436458] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-08T22:38:17.438634] [INFO ] [MAIN ] Derivative Progress: 718/1771 symbols completed. FOF took 1.1s. Estimated remaining: 6m 49s. Rate: 154.7 symbols/min [2025-10-08T22:38:17.452239] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:17.453149] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19696 primary records. [2025-10-08T22:38:17.453244] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-08T22:38:17.470724] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-08T22:38:17.471047] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-08T22:38:17.474330] [INFO ] [MAIN ] Derivative Progress: 719/1771 symbols completed. FOR took 1.1s. Estimated remaining: 6m 48s. Rate: 154.9 symbols/min [2025-10-08T22:38:17.490523] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:17.491498] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49586 primary records. [2025-10-08T22:38:17.491569] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-08T22:38:17.507559] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-08T22:38:17.507631] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-08T22:38:17.509831] [INFO ] [MAIN ] Derivative Progress: 720/1771 symbols completed. FOUR took 1.0s. Estimated remaining: 6m 47s. Rate: 155.1 symbols/min [2025-10-08T22:38:17.510444] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:17.510509] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:17.510359] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:17.549360] [DEBUG] [LOCAL ] FPH: Loaded 19300 existing records from primary storage. [2025-10-08T22:38:17.549913] [DEBUG] [LOCAL ] FPF: Loaded 18595 existing records from primary storage. [2025-10-08T22:38:17.550013] [INFO ] [MAIN ] FPH: Loaded 19300 primary data records. [2025-10-08T22:38:17.550177] [INFO ] [MAIN ] FPF: Loaded 18595 primary data records. [2025-10-08T22:38:17.699122] [DEBUG] [LOCAL ] FPI: Loaded 31074 existing records from primary storage. [2025-10-08T22:38:17.732193] [INFO ] [MAIN ] FPI: Loaded 31074 primary data records. [2025-10-08T22:38:18.574312] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:18.595541] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19300 primary records. [2025-10-08T22:38:18.595968] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:18.597079] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18595 primary records. [2025-10-08T22:38:18.597339] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-08T22:38:18.599119] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-08T22:38:18.644157] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-08T22:38:18.658908] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-08T22:38:18.661932] [INFO ] [MAIN ] Derivative Progress: 721/1771 symbols completed. FPF took 1.2s. Estimated remaining: 6m 47s. Rate: 154.6 symbols/min [2025-10-08T22:38:18.671209] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:18.670100] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:18.673728] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31074 primary records. [2025-10-08T22:38:18.672236] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-08T22:38:18.674138] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-08T22:38:18.674950] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-08T22:38:18.677901] [INFO ] [MAIN ] Derivative Progress: 722/1771 symbols completed. FPH took 1.2s. Estimated remaining: 6m 46s. Rate: 154.8 symbols/min [2025-10-08T22:38:18.679399] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:18.711072] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-08T22:38:18.711412] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-08T22:38:18.714212] [INFO ] [MAIN ] Derivative Progress: 723/1771 symbols completed. FPI took 1.2s. Estimated remaining: 6m 46s. Rate: 155.0 symbols/min [2025-10-08T22:38:18.714890] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:18.738840] [DEBUG] [LOCAL ] FRA: Loaded 14561 existing records from primary storage. [2025-10-08T22:38:18.739499] [INFO ] [MAIN ] FRA: Loaded 14561 primary data records. [2025-10-08T22:38:18.894476] [DEBUG] [LOCAL ] FR: Loaded 46358 existing records from primary storage. [2025-10-08T22:38:18.894767] [INFO ] [MAIN ] FR: Loaded 46358 primary data records. [2025-10-08T22:38:19.142322] [DEBUG] [LOCAL ] FRO: Loaded 51674 existing records from primary storage. [2025-10-08T22:38:19.153102] [INFO ] [MAIN ] FRO: Loaded 51674 primary data records. [2025-10-08T22:38:20.030100] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:20.033466] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46358 primary records. [2025-10-08T22:38:20.034249] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-08T22:38:20.030581] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:20.035148] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14561 primary records. [2025-10-08T22:38:20.043576] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-08T22:38:20.058840] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:20.062718] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51674 primary records. [2025-10-08T22:38:20.063598] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-08T22:38:20.096264] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-08T22:38:20.099551] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-08T22:38:20.099241] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-08T22:38:20.102040] [INFO ] [MAIN ] Derivative Progress: 724/1771 symbols completed. FR took 1.4s. Estimated remaining: 6m 47s. Rate: 154.5 symbols/min [2025-10-08T22:38:20.102714] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:20.102257] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-08T22:38:20.105584] [INFO ] [MAIN ] Derivative Progress: 725/1771 symbols completed. FRA took 1.4s. Estimated remaining: 6m 46s. Rate: 154.7 symbols/min [2025-10-08T22:38:20.106011] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-08T22:38:20.106491] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:20.106633] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-08T22:38:20.108870] [INFO ] [MAIN ] Derivative Progress: 726/1771 symbols completed. FRO took 1.4s. Estimated remaining: 6m 45s. Rate: 154.9 symbols/min [2025-10-08T22:38:20.109211] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:20.178037] [DEBUG] [LOCAL ] FRT: Loaded 41872 existing records from primary storage. [2025-10-08T22:38:20.178721] [DEBUG] [LOCAL ] FSCO: Loaded 38029 existing records from primary storage. [2025-10-08T22:38:20.179092] [INFO ] [MAIN ] FRT: Loaded 41872 primary data records. [2025-10-08T22:38:20.179308] [INFO ] [MAIN ] FSCO: Loaded 38029 primary data records. [2025-10-08T22:38:20.385307] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-08T22:38:20.397346] [INFO ] [MAIN ] FSK: Loaded 49404 primary data records. [2025-10-08T22:38:21.132396] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:21.132762] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:21.134249] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38029 primary records. [2025-10-08T22:38:21.133628] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41872 primary records. [2025-10-08T22:38:21.134482] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-08T22:38:21.134342] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-08T22:38:21.171198] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-08T22:38:21.172002] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-08T22:38:21.181438] [INFO ] [MAIN ] Derivative Progress: 727/1771 symbols completed. FRT took 1.1s. Estimated remaining: 6m 45s. Rate: 154.5 symbols/min [2025-10-08T22:38:21.187762] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:21.191479] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:21.192344] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-08T22:38:21.193289] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49404 primary records. [2025-10-08T22:38:21.193388] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-08T22:38:21.193469] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-08T22:38:21.195327] [INFO ] [MAIN ] Derivative Progress: 728/1771 symbols completed. FSCO took 1.1s. Estimated remaining: 6m 44s. Rate: 154.7 symbols/min [2025-10-08T22:38:21.196468] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:21.221985] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-08T22:38:21.222158] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-08T22:38:21.224918] [INFO ] [MAIN ] Derivative Progress: 729/1771 symbols completed. FSK took 1.1s. Estimated remaining: 6m 44s. Rate: 154.9 symbols/min [2025-10-08T22:38:21.225203] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:21.276000] [DEBUG] [LOCAL ] FSLY: Loaded 51235 existing records from primary storage. [2025-10-08T22:38:21.276288] [INFO ] [MAIN ] FSLY: Loaded 51235 primary data records. [2025-10-08T22:38:21.402852] [DEBUG] [LOCAL ] FSM: Loaded 53296 existing records from primary storage. [2025-10-08T22:38:21.477403] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-08T22:38:21.476246] [INFO ] [MAIN ] FSM: Loaded 53296 primary data records. [2025-10-08T22:38:21.486225] [INFO ] [MAIN ] FSS: Loaded 33877 primary data records. [2025-10-08T22:38:22.309351] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:22.310613] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51235 primary records. [2025-10-08T22:38:22.310981] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-08T22:38:22.328829] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-08T22:38:22.331813] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-08T22:38:22.334217] [INFO ] [MAIN ] Derivative Progress: 730/1771 symbols completed. FSLY took 1.1s. Estimated remaining: 6m 44s. Rate: 154.5 symbols/min [2025-10-08T22:38:22.334784] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:22.348680] [DEBUG] [MAIN ] FSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:22.351376] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53296 primary records. [2025-10-08T22:38:22.352286] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-08T22:38:22.381081] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:22.385474] [DEBUG] [LOCAL ] FT: Loaded 6607 existing records from primary storage. [2025-10-08T22:38:22.385817] [INFO ] [MAIN ] FT: Loaded 6607 primary data records. [2025-10-08T22:38:22.418374] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-08T22:38:22.407302] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33877 primary records. [2025-10-08T22:38:22.423634] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-08T22:38:22.430864] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-08T22:38:22.453550] [INFO ] [MAIN ] Derivative Progress: 731/1771 symbols completed. FSM took 1.3s. Estimated remaining: 6m 43s. Rate: 154.7 symbols/min [2025-10-08T22:38:22.505322] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:22.703199] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-08T22:38:22.703519] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-08T22:38:22.705842] [INFO ] [MAIN ] Derivative Progress: 732/1771 symbols completed. FSS took 1.5s. Estimated remaining: 6m 43s. Rate: 154.8 symbols/min [2025-10-08T22:38:22.711871] [DEBUG] [LOCAL ] FTHY: Loaded 12273 existing records from primary storage. [2025-10-08T22:38:22.706742] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:22.712563] [INFO ] [MAIN ] FTHY: Loaded 12273 primary data records. [2025-10-08T22:38:23.066460] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:23.068145] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6607 primary records. [2025-10-08T22:38:23.069071] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-08T22:38:23.099410] [DEBUG] [LOCAL ] FTI: Loaded 53294 existing records from primary storage. [2025-10-08T22:38:23.100185] [INFO ] [MAIN ] FTI: Loaded 53294 primary data records. [2025-10-08T22:38:23.176013] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-08T22:38:23.194366] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-08T22:38:23.196958] [INFO ] [MAIN ] Derivative Progress: 733/1771 symbols completed. FT took 0.9s. Estimated remaining: 6m 43s. Rate: 154.7 symbols/min [2025-10-08T22:38:23.304898] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:23.416521] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12273 primary records. [2025-10-08T22:38:23.465361] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-08T22:38:23.488631] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-08T22:38:23.488800] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-08T22:38:23.491149] [INFO ] [MAIN ] Derivative Progress: 734/1771 symbols completed. FTHY took 1.0s. Estimated remaining: 6m 42s. Rate: 154.7 symbols/min [2025-10-08T22:38:23.510227] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:23.510880] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53294 primary records. [2025-10-08T22:38:23.510942] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-08T22:38:23.526245] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-08T22:38:23.526325] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-08T22:38:23.528267] [INFO ] [MAIN ] Derivative Progress: 735/1771 symbols completed. FTI took 0.8s. Estimated remaining: 6m 41s. Rate: 154.9 symbols/min [2025-10-08T22:38:23.528797] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:23.528913] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:23.529638] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:23.581169] [DEBUG] [LOCAL ] FTK: Loaded 32569 existing records from primary storage. [2025-10-08T22:38:23.581501] [INFO ] [MAIN ] FTK: Loaded 32569 primary data records. [2025-10-08T22:38:23.713980] [DEBUG] [LOCAL ] FTS: Loaded 42429 existing records from primary storage. [2025-10-08T22:38:23.742228] [INFO ] [MAIN ] FTS: Loaded 42429 primary data records. [2025-10-08T22:38:23.763491] [DEBUG] [LOCAL ] FTV: Loaded 52988 existing records from primary storage. [2025-10-08T22:38:23.904112] [INFO ] [MAIN ] FTV: Loaded 52988 primary data records. [2025-10-08T22:38:24.595291] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:24.596150] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32569 primary records. [2025-10-08T22:38:24.596343] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-08T22:38:24.617458] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-08T22:38:24.617767] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-08T22:38:24.620013] [INFO ] [MAIN ] Derivative Progress: 736/1771 symbols completed. FTK took 1.1s. Estimated remaining: 6m 42s. Rate: 154.6 symbols/min [2025-10-08T22:38:24.634166] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:24.635111] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:24.636280] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42429 primary records. [2025-10-08T22:38:24.636395] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-08T22:38:24.649915] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:24.659185] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52988 primary records. [2025-10-08T22:38:24.667011] [DEBUG] [LOCAL ] FTWO: Loaded 1882 existing records from primary storage. [2025-10-08T22:38:24.667534] [INFO ] [MAIN ] FTWO: Loaded 1882 primary data records. [2025-10-08T22:38:24.663084] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-08T22:38:24.739979] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-08T22:38:24.749552] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-08T22:38:24.758192] [INFO ] [MAIN ] Derivative Progress: 737/1771 symbols completed. FTS took 1.2s. Estimated remaining: 6m 41s. Rate: 154.7 symbols/min [2025-10-08T22:38:24.771213] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:24.840581] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-08T22:38:24.880226] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-08T22:38:24.993022] [INFO ] [MAIN ] Derivative Progress: 738/1771 symbols completed. FTV took 1.5s. Estimated remaining: 6m 40s. Rate: 154.8 symbols/min [2025-10-08T22:38:25.002520] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:25.077982] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:38:25.079963] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1882 primary records. [2025-10-08T22:38:25.081295] [DEBUG] [LOCAL ] FUBO: Loaded 53705 existing records from primary storage. [2025-10-08T22:38:25.080065] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-08T22:38:25.082584] [DEBUG] [LOCAL ] FUL: Loaded 32850 existing records from primary storage. [2025-10-08T22:38:25.082728] [INFO ] [MAIN ] FUL: Loaded 32850 primary data records. [2025-10-08T22:38:25.082177] [INFO ] [MAIN ] FUBO: Loaded 53705 primary data records. [2025-10-08T22:38:25.289555] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-08T22:38:25.316053] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-08T22:38:25.395239] [INFO ] [MAIN ] Derivative Progress: 739/1771 symbols completed. FTWO took 0.8s. Estimated remaining: 6m 40s. Rate: 154.8 symbols/min [2025-10-08T22:38:25.425352] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:25.782284] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:25.791305] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53705 primary records. [2025-10-08T22:38:25.796736] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-08T22:38:25.796610] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:25.797589] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32850 primary records. [2025-10-08T22:38:25.798520] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-08T22:38:25.843502] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-08T22:38:25.847098] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-08T22:38:25.845821] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-08T22:38:25.848203] [DEBUG] [LOCAL ] FUN: Loaded 51776 existing records from primary storage. [2025-10-08T22:38:25.850316] [INFO ] [MAIN ] Derivative Progress: 740/1771 symbols completed. FUBO took 1.1s. Estimated remaining: 6m 40s. Rate: 154.7 symbols/min [2025-10-08T22:38:25.850715] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:25.850602] [INFO ] [MAIN ] FUN: Loaded 51776 primary data records. [2025-10-08T22:38:25.850476] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-08T22:38:25.853407] [INFO ] [MAIN ] Derivative Progress: 741/1771 symbols completed. FUL took 0.9s. Estimated remaining: 6m 39s. Rate: 154.9 symbols/min [2025-10-08T22:38:25.853859] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:26.060267] [DEBUG] [LOCAL ] FVR: Loaded 21569 existing records from primary storage. [2025-10-08T22:38:26.071047] [INFO ] [MAIN ] FVR: Loaded 21569 primary data records. [2025-10-08T22:38:26.337358] [DEBUG] [LOCAL ] FVRR: Loaded 40243 existing records from primary storage. [2025-10-08T22:38:26.343279] [INFO ] [MAIN ] FVRR: Loaded 40243 primary data records. [2025-10-08T22:38:26.867139] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:26.868772] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51776 primary records. [2025-10-08T22:38:26.869039] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-08T22:38:26.894942] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:26.900065] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 21569 primary records. [2025-10-08T22:38:26.900398] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-08T22:38:26.900344] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-08T22:38:26.900678] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-08T22:38:26.903024] [INFO ] [MAIN ] Derivative Progress: 742/1771 symbols completed. FUN took 1.5s. Estimated remaining: 6m 39s. Rate: 154.6 symbols/min [2025-10-08T22:38:26.903603] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:26.923678] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-08T22:38:26.937002] [INFO ] [MAIN ] FXED: Loaded 1252 primary data records. [2025-10-08T22:38:26.937093] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-08T22:38:26.937373] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:26.958735] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40243 primary records. [2025-10-08T22:38:26.980750] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-08T22:38:26.937496] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-08T22:38:26.982694] [INFO ] [MAIN ] Derivative Progress: 743/1771 symbols completed. FVR took 1.1s. Estimated remaining: 6m 39s. Rate: 154.7 symbols/min [2025-10-08T22:38:27.009680] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:27.168411] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-08T22:38:27.242795] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-08T22:38:27.329119] [INFO ] [MAIN ] Derivative Progress: 744/1771 symbols completed. FVRR took 1.5s. Estimated remaining: 6m 38s. Rate: 154.8 symbols/min [2025-10-08T22:38:27.339974] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:27.362435] [DEBUG] [LOCAL ] G: Loaded 49981 existing records from primary storage. [2025-10-08T22:38:27.363061] [INFO ] [MAIN ] G: Loaded 49981 primary data records. [2025-10-08T22:38:27.489089] [DEBUG] [LOCAL ] GAB: Loaded 27641 existing records from primary storage. [2025-10-08T22:38:27.505858] [INFO ] [MAIN ] GAB: Loaded 27641 primary data records. [2025-10-08T22:38:27.790196] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:38:27.808440] [INFO ] [MAIN ] FXED: Generated 1792 derivative records from 1252 primary records. [2025-10-08T22:38:27.814750] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-08T22:38:27.896038] [DEBUG] [LOCAL ] FXED: Derivative data saved (1792 records). [2025-10-08T22:38:28.013884] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-08T22:38:28.016558] [INFO ] [MAIN ] Derivative Progress: 745/1771 symbols completed. FXED took 1.1s. Estimated remaining: 6m 38s. Rate: 154.6 symbols/min [2025-10-08T22:38:28.016893] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:28.025802] [DEBUG] [LOCAL ] GAM: Loaded 4028 existing records from primary storage. [2025-10-08T22:38:28.026161] [INFO ] [MAIN ] GAM: Loaded 4028 primary data records. [2025-10-08T22:38:28.241253] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:28.242398] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49981 primary records. [2025-10-08T22:38:28.242763] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-08T22:38:28.391030] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-08T22:38:28.391400] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-08T22:38:28.393378] [INFO ] [MAIN ] Derivative Progress: 746/1771 symbols completed. G took 1.4s. Estimated remaining: 6m 38s. Rate: 154.6 symbols/min [2025-10-08T22:38:28.402267] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:28.409325] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:28.410214] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27641 primary records. [2025-10-08T22:38:28.410416] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-08T22:38:28.428390] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-08T22:38:28.428687] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-08T22:38:28.431330] [INFO ] [MAIN ] Derivative Progress: 747/1771 symbols completed. GAB took 1.1s. Estimated remaining: 6m 37s. Rate: 154.8 symbols/min [2025-10-08T22:38:28.433367] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:28.462074] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:28.463220] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4028 primary records. [2025-10-08T22:38:28.469118] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-08T22:38:28.472076] [DEBUG] [LOCAL ] GATX: Loaded 18143 existing records from primary storage. [2025-10-08T22:38:28.472380] [INFO ] [MAIN ] GATX: Loaded 18143 primary data records. [2025-10-08T22:38:28.641471] [DEBUG] [LOCAL ] GAP: Loaded 53652 existing records from primary storage. [2025-10-08T22:38:28.661125] [INFO ] [MAIN ] GAP: Loaded 53652 primary data records. [2025-10-08T22:38:28.647557] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-08T22:38:28.873720] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-08T22:38:28.935058] [INFO ] [MAIN ] Derivative Progress: 748/1771 symbols completed. GAM took 0.9s. Estimated remaining: 6m 37s. Rate: 154.7 symbols/min [2025-10-08T22:38:29.153389] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:29.154531] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18143 primary records. [2025-10-08T22:38:29.154810] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-08T22:38:29.173935] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-08T22:38:29.186276] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-08T22:38:29.188370] [INFO ] [MAIN ] Derivative Progress: 749/1771 symbols completed. GATX took 0.8s. Estimated remaining: 6m 36s. Rate: 154.8 symbols/min [2025-10-08T22:38:29.188668] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:29.189521] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53652 primary records. [2025-10-08T22:38:29.189591] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-08T22:38:29.205211] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-08T22:38:29.205277] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-08T22:38:29.207513] [INFO ] [MAIN ] Derivative Progress: 750/1771 symbols completed. GAP took 0.8s. Estimated remaining: 6m 35s. Rate: 155.0 symbols/min [2025-10-08T22:38:29.208017] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:29.208187] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:29.208941] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:29.224284] [DEBUG] [LOCAL ] GBAB: Loaded 13043 existing records from primary storage. [2025-10-08T22:38:29.224428] [INFO ] [MAIN ] GBAB: Loaded 13043 primary data records. [2025-10-08T22:38:29.460101] [DEBUG] [LOCAL ] GBTG: Loaded 40036 existing records from primary storage. [2025-10-08T22:38:29.608803] [INFO ] [MAIN ] GBTG: Loaded 40036 primary data records. [2025-10-08T22:38:29.622025] [DEBUG] [LOCAL ] GBCI: Loaded 40512 existing records from primary storage. [2025-10-08T22:38:29.643055] [INFO ] [MAIN ] GBCI: Loaded 40512 primary data records. [2025-10-08T22:38:30.266175] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:30.267815] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13043 primary records. [2025-10-08T22:38:30.268281] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-08T22:38:30.325175] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:30.324904] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:30.326069] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40512 primary records. [2025-10-08T22:38:30.326281] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-08T22:38:30.324510] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-08T22:38:30.327356] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-08T22:38:30.327285] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40036 primary records. [2025-10-08T22:38:30.329509] [INFO ] [MAIN ] Derivative Progress: 751/1771 symbols completed. GBAB took 1.1s. Estimated remaining: 6m 36s. Rate: 154.6 symbols/min [2025-10-08T22:38:30.330251] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-08T22:38:30.331943] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:30.359743] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-08T22:38:30.360537] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-08T22:38:30.362776] [INFO ] [MAIN ] Derivative Progress: 752/1771 symbols completed. GBCI took 1.2s. Estimated remaining: 6m 35s. Rate: 154.8 symbols/min [2025-10-08T22:38:30.363465] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:30.367325] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-08T22:38:30.367521] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-08T22:38:30.370435] [INFO ] [MAIN ] Derivative Progress: 753/1771 symbols completed. GBTG took 1.2s. Estimated remaining: 6m 34s. Rate: 155.0 symbols/min [2025-10-08T22:38:30.370730] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:30.398003] [DEBUG] [LOCAL ] GBX: Loaded 29122 existing records from primary storage. [2025-10-08T22:38:30.398248] [INFO ] [MAIN ] GBX: Loaded 29122 primary data records. [2025-10-08T22:38:30.530720] [DEBUG] [LOCAL ] GCO: Loaded 24065 existing records from primary storage. [2025-10-08T22:38:30.547831] [INFO ] [MAIN ] GCO: Loaded 24065 primary data records. [2025-10-08T22:38:30.598404] [DEBUG] [LOCAL ] GCI: Loaded 44080 existing records from primary storage. [2025-10-08T22:38:30.644412] [INFO ] [MAIN ] GCI: Loaded 44080 primary data records. [2025-10-08T22:38:31.453422] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:31.454443] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29122 primary records. [2025-10-08T22:38:31.456038] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-08T22:38:31.477855] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-08T22:38:31.478236] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-08T22:38:31.480250] [INFO ] [MAIN ] Derivative Progress: 754/1771 symbols completed. GBX took 1.1s. Estimated remaining: 6m 35s. Rate: 154.6 symbols/min [2025-10-08T22:38:31.480787] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:31.503110] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:31.504384] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44080 primary records. [2025-10-08T22:38:31.516354] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-08T22:38:31.527835] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:31.529398] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 24065 primary records. [2025-10-08T22:38:31.537155] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-08T22:38:31.558222] [DEBUG] [LOCAL ] GCTS: Loaded 20353 existing records from primary storage. [2025-10-08T22:38:31.560341] [INFO ] [MAIN ] GCTS: Loaded 20353 primary data records. [2025-10-08T22:38:31.600772] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-10-08T22:38:31.610628] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-08T22:38:31.617922] [INFO ] [MAIN ] Derivative Progress: 755/1771 symbols completed. GCO took 1.2s. Estimated remaining: 6m 34s. Rate: 154.8 symbols/min [2025-10-08T22:38:31.627414] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:31.632703] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-08T22:38:31.653611] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-08T22:38:31.688381] [INFO ] [MAIN ] Derivative Progress: 756/1771 symbols completed. GCI took 1.3s. Estimated remaining: 6m 33s. Rate: 154.9 symbols/min [2025-10-08T22:38:31.694127] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:31.725266] [DEBUG] [LOCAL ] GCV: Loaded 7565 existing records from primary storage. [2025-10-08T22:38:31.735928] [INFO ] [MAIN ] GCV: Loaded 7565 primary data records. [2025-10-08T22:38:32.263915] [DEBUG] [LOCAL ] GD: Loaded 46879 existing records from primary storage. [2025-10-08T22:38:32.264892] [INFO ] [MAIN ] GD: Loaded 46879 primary data records. [2025-10-08T22:38:32.586006] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:32.587123] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20353 primary records. [2025-10-08T22:38:32.587420] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-08T22:38:32.612636] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:32.616887] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7565 primary records. [2025-10-08T22:38:32.617723] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-08T22:38:32.637837] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-08T22:38:32.639278] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-08T22:38:32.641586] [INFO ] [MAIN ] Derivative Progress: 757/1771 symbols completed. GCV took 1.0s. Estimated remaining: 6m 33s. Rate: 154.6 symbols/min [2025-10-08T22:38:32.641968] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:32.639385] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-08T22:38:32.642685] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-08T22:38:32.644900] [INFO ] [MAIN ] Derivative Progress: 758/1771 symbols completed. GCTS took 1.2s. Estimated remaining: 6m 33s. Rate: 154.8 symbols/min [2025-10-08T22:38:32.645203] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:32.652198] [DEBUG] [LOCAL ] GDIV: Loaded 3609 existing records from primary storage. [2025-10-08T22:38:32.652786] [INFO ] [MAIN ] GDIV: Loaded 3609 primary data records. [2025-10-08T22:38:32.793289] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:32.871074] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46879 primary records. [2025-10-08T22:38:32.892478] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-08T22:38:33.047357] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-08T22:38:33.049725] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-08T22:38:33.052325] [INFO ] [MAIN ] Derivative Progress: 759/1771 symbols completed. GD took 1.4s. Estimated remaining: 6m 32s. Rate: 154.8 symbols/min [2025-10-08T22:38:33.049540] [DEBUG] [LOCAL ] GDDY: Loaded 49785 existing records from primary storage. [2025-10-08T22:38:33.052801] [INFO ] [MAIN ] GDDY: Loaded 49785 primary data records. [2025-10-08T22:38:33.053810] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:33.177959] [DEBUG] [LOCAL ] GDL: Loaded 2553 existing records from primary storage. [2025-10-08T22:38:33.183267] [INFO ] [MAIN ] GDL: Loaded 2553 primary data records. [2025-10-08T22:38:33.766682] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-08T22:38:33.790191] [INFO ] [MAIN ] GDIV: Generated 1791 derivative records from 3609 primary records. [2025-10-08T22:38:33.791285] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-08T22:38:33.819726] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1791 records). [2025-10-08T22:38:33.820311] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-08T22:38:33.822637] [INFO ] [MAIN ] Derivative Progress: 760/1771 symbols completed. GDIV took 1.2s. Estimated remaining: 6m 32s. Rate: 154.6 symbols/min [2025-10-08T22:38:33.822871] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:33.833420] [DEBUG] [LOCAL ] GDO: Loaded 5927 existing records from primary storage. [2025-10-08T22:38:33.834326] [INFO ] [MAIN ] GDO: Loaded 5927 primary data records. [2025-10-08T22:38:34.010127] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:34.019548] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:34.158206] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2553 primary records. [2025-10-08T22:38:34.157896] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49785 primary records. [2025-10-08T22:38:34.167934] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-08T22:38:34.167809] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-08T22:38:34.199421] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-08T22:38:34.203109] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-08T22:38:34.206078] [INFO ] [MAIN ] Derivative Progress: 761/1771 symbols completed. GDDY took 1.6s. Estimated remaining: 6m 32s. Rate: 154.6 symbols/min [2025-10-08T22:38:34.207095] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:34.208838] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-08T22:38:34.209496] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-08T22:38:34.211872] [INFO ] [MAIN ] Derivative Progress: 762/1771 symbols completed. GDL took 1.2s. Estimated remaining: 6m 31s. Rate: 154.8 symbols/min [2025-10-08T22:38:34.212420] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:34.240341] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:34.241171] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5927 primary records. [2025-10-08T22:38:34.249883] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-08T22:38:34.260194] [DEBUG] [LOCAL ] GDV: Loaded 19517 existing records from primary storage. [2025-10-08T22:38:34.260372] [INFO ] [MAIN ] GDV: Loaded 19517 primary data records. [2025-10-08T22:38:34.357698] [DEBUG] [LOCAL ] GDOT: Loaded 37785 existing records from primary storage. [2025-10-08T22:38:34.374981] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-08T22:38:34.383107] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-08T22:38:34.375234] [INFO ] [MAIN ] GDOT: Loaded 37785 primary data records. [2025-10-08T22:38:34.390575] [INFO ] [MAIN ] Derivative Progress: 763/1771 symbols completed. GDO took 0.6s. Estimated remaining: 6m 30s. Rate: 154.9 symbols/min [2025-10-08T22:38:34.976943] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:34.978309] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19517 primary records. [2025-10-08T22:38:34.978613] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-08T22:38:35.007472] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:35.010349] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37785 primary records. [2025-10-08T22:38:35.011718] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-08T22:38:35.011844] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-08T22:38:35.012635] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-08T22:38:35.014880] [INFO ] [MAIN ] Derivative Progress: 764/1771 symbols completed. GDV took 0.8s. Estimated remaining: 6m 30s. Rate: 154.8 symbols/min [2025-10-08T22:38:35.029977] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-08T22:38:35.030046] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-08T22:38:35.032844] [INFO ] [MAIN ] Derivative Progress: 765/1771 symbols completed. GDOT took 0.8s. Estimated remaining: 6m 29s. Rate: 155.0 symbols/min [2025-10-08T22:38:35.033468] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:35.033398] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:35.033795] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:35.057205] [DEBUG] [LOCAL ] GEF: Loaded 20665 existing records from primary storage. [2025-10-08T22:38:35.057397] [INFO ] [MAIN ] GEF: Loaded 20665 primary data records. [2025-10-08T22:38:35.412794] [DEBUG] [LOCAL ] GENI: Loaded 52944 existing records from primary storage. [2025-10-08T22:38:35.411392] [DEBUG] [LOCAL ] GE: Loaded 53706 existing records from primary storage. [2025-10-08T22:38:35.413690] [INFO ] [MAIN ] GE: Loaded 53706 primary data records. [2025-10-08T22:38:35.413781] [INFO ] [MAIN ] GENI: Loaded 52944 primary data records. [2025-10-08T22:38:36.132031] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:36.134122] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20665 primary records. [2025-10-08T22:38:36.134320] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-08T22:38:36.151841] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-08T22:38:36.152076] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-08T22:38:36.155612] [INFO ] [MAIN ] Derivative Progress: 766/1771 symbols completed. GEF took 1.1s. Estimated remaining: 6m 30s. Rate: 154.6 symbols/min [2025-10-08T22:38:36.157717] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:36.172138] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:36.173169] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53706 primary records. [2025-10-08T22:38:36.173329] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-08T22:38:36.204170] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:36.206503] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52944 primary records. [2025-10-08T22:38:36.208086] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-08T22:38:36.207902] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-08T22:38:36.209204] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-08T22:38:36.211830] [INFO ] [MAIN ] Derivative Progress: 767/1771 symbols completed. GE took 1.2s. Estimated remaining: 6m 29s. Rate: 154.8 symbols/min [2025-10-08T22:38:36.224120] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:36.244139] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-08T22:38:36.244469] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-08T22:38:36.246725] [INFO ] [MAIN ] Derivative Progress: 768/1771 symbols completed. GENI took 1.2s. Estimated remaining: 6m 28s. Rate: 155.0 symbols/min [2025-10-08T22:38:36.247112] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:36.270038] [DEBUG] [LOCAL ] GEO: Loaded 51887 existing records from primary storage. [2025-10-08T22:38:36.270351] [INFO ] [MAIN ] GEO: Loaded 51887 primary data records. [2025-10-08T22:38:36.438050] [DEBUG] [LOCAL ] GETY: Loaded 35367 existing records from primary storage. [2025-10-08T22:38:36.449291] [INFO ] [MAIN ] GETY: Loaded 35367 primary data records. [2025-10-08T22:38:36.449960] [DEBUG] [LOCAL ] GES: Loaded 38643 existing records from primary storage. [2025-10-08T22:38:36.476133] [INFO ] [MAIN ] GES: Loaded 38643 primary data records. [2025-10-08T22:38:37.272369] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:37.273158] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51887 primary records. [2025-10-08T22:38:37.273318] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-08T22:38:37.290595] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-08T22:38:37.290791] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-08T22:38:37.293723] [INFO ] [MAIN ] Derivative Progress: 769/1771 symbols completed. GEO took 1.1s. Estimated remaining: 6m 29s. Rate: 154.6 symbols/min [2025-10-08T22:38:37.294697] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:37.322928] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:37.323315] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:37.324058] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 38643 primary records. [2025-10-08T22:38:37.324692] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35367 primary records. [2025-10-08T22:38:37.324855] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-08T22:38:37.324910] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-08T22:38:37.356396] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-08T22:38:37.355884] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-08T22:38:37.356549] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-08T22:38:37.358441] [INFO ] [MAIN ] Derivative Progress: 770/1771 symbols completed. GETY took 1.1s. Estimated remaining: 6m 28s. Rate: 154.8 symbols/min [2025-10-08T22:38:37.358668] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-08T22:38:37.360935] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:37.361185] [INFO ] [MAIN ] Derivative Progress: 771/1771 symbols completed. GES took 1.1s. Estimated remaining: 6m 27s. Rate: 155.0 symbols/min [2025-10-08T22:38:37.361860] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:37.366788] [DEBUG] [LOCAL ] GF: Loaded 2781 existing records from primary storage. [2025-10-08T22:38:37.367055] [INFO ] [MAIN ] GF: Loaded 2781 primary data records. [2025-10-08T22:38:37.716782] [DEBUG] [LOCAL ] GEV: Loaded 53015 existing records from primary storage. [2025-10-08T22:38:37.730709] [INFO ] [MAIN ] GEV: Loaded 53015 primary data records. [2025-10-08T22:38:37.731683] [DEBUG] [LOCAL ] GFF: Loaded 30233 existing records from primary storage. [2025-10-08T22:38:37.743175] [INFO ] [MAIN ] GFF: Loaded 30233 primary data records. [2025-10-08T22:38:38.358828] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:38.360498] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2781 primary records. [2025-10-08T22:38:38.361213] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-08T22:38:38.378046] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-08T22:38:38.378610] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-08T22:38:38.380724] [INFO ] [MAIN ] Derivative Progress: 772/1771 symbols completed. GF took 1.0s. Estimated remaining: 6m 28s. Rate: 154.7 symbols/min [2025-10-08T22:38:38.381000] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:38.412611] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:38.413825] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 30233 primary records. [2025-10-08T22:38:38.413079] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:38.414550] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53015 primary records. [2025-10-08T22:38:38.414758] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-08T22:38:38.414717] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-08T22:38:38.445891] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-08T22:38:38.447668] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-08T22:38:38.449850] [INFO ] [MAIN ] Derivative Progress: 773/1771 symbols completed. GFF took 1.1s. Estimated remaining: 6m 27s. Rate: 154.8 symbols/min [2025-10-08T22:38:38.451213] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-08T22:38:38.450252] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:38.451411] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-08T22:38:38.453565] [INFO ] [MAIN ] Derivative Progress: 774/1771 symbols completed. GEV took 1.2s. Estimated remaining: 6m 26s. Rate: 155.0 symbols/min [2025-10-08T22:38:38.454061] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:38.478024] [DEBUG] [LOCAL ] GFR: Loaded 7915 existing records from primary storage. [2025-10-08T22:38:38.478172] [INFO ] [MAIN ] GFR: Loaded 7915 primary data records. [2025-10-08T22:38:38.602434] [DEBUG] [LOCAL ] GFI: Loaded 53098 existing records from primary storage. [2025-10-08T22:38:38.606563] [INFO ] [MAIN ] GFI: Loaded 53098 primary data records. [2025-10-08T22:38:38.996036] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-08T22:38:39.020805] [INFO ] [MAIN ] GFL: Loaded 47875 primary data records. [2025-10-08T22:38:39.511418] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:39.512521] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 7915 primary records. [2025-10-08T22:38:39.512826] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-08T22:38:39.530673] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-08T22:38:39.531146] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-08T22:38:39.533860] [INFO ] [MAIN ] Derivative Progress: 775/1771 symbols completed. GFR took 1.1s. Estimated remaining: 6m 26s. Rate: 154.7 symbols/min [2025-10-08T22:38:39.535841] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:39.551311] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:39.552975] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53098 primary records. [2025-10-08T22:38:39.553087] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-08T22:38:39.571764] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-08T22:38:39.572195] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-08T22:38:39.575393] [INFO ] [MAIN ] Derivative Progress: 776/1771 symbols completed. GFI took 1.2s. Estimated remaining: 6m 26s. Rate: 154.8 symbols/min [2025-10-08T22:38:39.575699] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:39.592729] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:39.607876] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47875 primary records. [2025-10-08T22:38:39.608103] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-08T22:38:39.644231] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-08T22:38:39.644409] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-08T22:38:39.646529] [INFO ] [MAIN ] Derivative Progress: 777/1771 symbols completed. GFL took 1.2s. Estimated remaining: 6m 25s. Rate: 155.0 symbols/min [2025-10-08T22:38:39.646784] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:39.648163] [DEBUG] [LOCAL ] GGB: Loaded 51174 existing records from primary storage. [2025-10-08T22:38:39.648541] [INFO ] [MAIN ] GGB: Loaded 51174 primary data records. [2025-10-08T22:38:39.805027] [DEBUG] [LOCAL ] GGG: Loaded 40765 existing records from primary storage. [2025-10-08T22:38:39.821332] [INFO ] [MAIN ] GGG: Loaded 40765 primary data records. [2025-10-08T22:38:39.969989] [DEBUG] [LOCAL ] GGT: Loaded 14116 existing records from primary storage. [2025-10-08T22:38:39.989796] [INFO ] [MAIN ] GGT: Loaded 14116 primary data records. [2025-10-08T22:38:40.604896] [DEBUG] [MAIN ] GGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:40.605957] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51174 primary records. [2025-10-08T22:38:40.606148] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-08T22:38:40.628546] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-08T22:38:40.641466] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:40.643045] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40765 primary records. [2025-10-08T22:38:40.643146] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-08T22:38:40.642370] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-08T22:38:40.647230] [INFO ] [MAIN ] Derivative Progress: 778/1771 symbols completed. GGB took 1.1s. Estimated remaining: 6m 25s. Rate: 154.7 symbols/min [2025-10-08T22:38:40.671707] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:40.672856] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14116 primary records. [2025-10-08T22:38:40.673381] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-08T22:38:40.676995] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-08T22:38:40.677229] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-08T22:38:40.686788] [INFO ] [MAIN ] Derivative Progress: 779/1771 symbols completed. GGG took 1.1s. Estimated remaining: 6m 24s. Rate: 154.9 symbols/min [2025-10-08T22:38:40.694432] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-08T22:38:40.694493] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-08T22:38:40.696581] [INFO ] [MAIN ] Derivative Progress: 780/1771 symbols completed. GGT took 1.0s. Estimated remaining: 6m 23s. Rate: 155.1 symbols/min [2025-10-08T22:38:40.696939] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:40.697037] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:40.697080] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:40.707426] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-08T22:38:40.707590] [INFO ] [MAIN ] GGZ: Loaded 2428 primary data records. [2025-10-08T22:38:40.707236] [DEBUG] [LOCAL ] GHC: Loaded 2780 existing records from primary storage. [2025-10-08T22:38:40.740544] [DEBUG] [LOCAL ] GHG: Loaded 3211 existing records from primary storage. [2025-10-08T22:38:40.738432] [INFO ] [MAIN ] GHC: Loaded 2780 primary data records. [2025-10-08T22:38:40.752713] [INFO ] [MAIN ] GHG: Loaded 3211 primary data records. [2025-10-08T22:38:41.680942] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:41.684159] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:38:41.683855] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2428 primary records. [2025-10-08T22:38:41.685031] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-08T22:38:41.684964] [INFO ] [MAIN ] GHG: Generated 1793 derivative records from 3211 primary records. [2025-10-08T22:38:41.709933] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-08T22:38:41.717869] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:41.724215] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2780 primary records. [2025-10-08T22:38:41.725683] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-08T22:38:41.729512] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-08T22:38:41.730013] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-08T22:38:41.742175] [INFO ] [MAIN ] Derivative Progress: 781/1771 symbols completed. GGZ took 1.0s. Estimated remaining: 6m 24s. Rate: 154.7 symbols/min [2025-10-08T22:38:41.742940] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:41.748705] [DEBUG] [LOCAL ] GHG: Derivative data saved (1793 records). [2025-10-08T22:38:41.749305] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-10-08T22:38:41.749704] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-08T22:38:41.751759] [INFO ] [MAIN ] Derivative Progress: 782/1771 symbols completed. GHC took 1.1s. Estimated remaining: 6m 23s. Rate: 154.9 symbols/min [2025-10-08T22:38:41.752018] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:41.751906] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-08T22:38:41.754732] [INFO ] [MAIN ] Derivative Progress: 783/1771 symbols completed. GHG took 1.1s. Estimated remaining: 6m 22s. Rate: 155.1 symbols/min [2025-10-08T22:38:41.755364] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:41.767923] [DEBUG] [LOCAL ] GHI: Loaded 7185 existing records from primary storage. [2025-10-08T22:38:41.764996] [DEBUG] [LOCAL ] GHLD: Loaded 4184 existing records from primary storage. [2025-10-08T22:38:41.768166] [INFO ] [MAIN ] GHLD: Loaded 4184 primary data records. [2025-10-08T22:38:41.784708] [INFO ] [MAIN ] GHI: Loaded 7185 primary data records. [2025-10-08T22:38:41.910314] [DEBUG] [LOCAL ] GHM: Loaded 14150 existing records from primary storage. [2025-10-08T22:38:41.926243] [INFO ] [MAIN ] GHM: Loaded 14150 primary data records. [2025-10-08T22:38:42.748510] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:42.751125] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4184 primary records. [2025-10-08T22:38:42.751222] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-08T22:38:42.750079] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:42.754363] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7185 primary records. [2025-10-08T22:38:42.764283] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-08T22:38:42.800158] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:42.802927] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14150 primary records. [2025-10-08T22:38:42.803481] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-08T22:38:42.803305] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-10-08T22:38:42.803966] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-08T22:38:42.806726] [INFO ] [MAIN ] Derivative Progress: 784/1771 symbols completed. GHLD took 1.1s. Estimated remaining: 6m 23s. Rate: 154.8 symbols/min [2025-10-08T22:38:42.808308] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:42.819331] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-08T22:38:42.819446] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-08T22:38:42.821679] [INFO ] [MAIN ] Derivative Progress: 785/1771 symbols completed. GHI took 1.1s. Estimated remaining: 6m 22s. Rate: 155.0 symbols/min [2025-10-08T22:38:42.826600] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:42.832690] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-08T22:38:42.832949] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-08T22:38:42.835464] [INFO ] [MAIN ] Derivative Progress: 786/1771 symbols completed. GHM took 1.1s. Estimated remaining: 6m 21s. Rate: 155.2 symbols/min [2025-10-08T22:38:42.836844] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:42.853769] [DEBUG] [LOCAL ] GHY: Loaded 20935 existing records from primary storage. [2025-10-08T22:38:42.857866] [INFO ] [MAIN ] GHY: Loaded 20935 primary data records. [2025-10-08T22:38:42.951146] [DEBUG] [LOCAL ] GIC: Loaded 13439 existing records from primary storage. [2025-10-08T22:38:42.969758] [INFO ] [MAIN ] GIC: Loaded 13439 primary data records. [2025-10-08T22:38:43.039925] [DEBUG] [LOCAL ] GIB: Loaded 31842 existing records from primary storage. [2025-10-08T22:38:43.060400] [INFO ] [MAIN ] GIB: Loaded 31842 primary data records. [2025-10-08T22:38:43.921575] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:43.936396] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20935 primary records. [2025-10-08T22:38:43.938549] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:43.938732] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-08T22:38:43.939600] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13439 primary records. [2025-10-08T22:38:43.940753] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-08T22:38:43.969877] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:43.982270] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31842 primary records. [2025-10-08T22:38:43.987999] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-08T22:38:43.984016] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-08T22:38:43.989928] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-08T22:38:43.992346] [INFO ] [MAIN ] Derivative Progress: 787/1771 symbols completed. GHY took 1.2s. Estimated remaining: 6m 21s. Rate: 154.8 symbols/min [2025-10-08T22:38:43.993273] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:44.013379] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-08T22:38:44.012993] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-08T22:38:44.013528] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-08T22:38:44.015947] [INFO ] [MAIN ] Derivative Progress: 788/1771 symbols completed. GIC took 1.2s. Estimated remaining: 6m 21s. Rate: 155.0 symbols/min [2025-10-08T22:38:44.016108] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-08T22:38:44.018548] [INFO ] [MAIN ] Derivative Progress: 789/1771 symbols completed. GIB took 1.2s. Estimated remaining: 6m 20s. Rate: 155.2 symbols/min [2025-10-08T22:38:44.018478] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:44.018809] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:44.089861] [DEBUG] [LOCAL ] GKOS: Loaded 42550 existing records from primary storage. [2025-10-08T22:38:44.105173] [INFO ] [MAIN ] GKOS: Loaded 42550 primary data records. [2025-10-08T22:38:44.206531] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-08T22:38:44.206721] [INFO ] [MAIN ] GIS: Loaded 53672 primary data records. [2025-10-08T22:38:44.200785] [DEBUG] [LOCAL ] GIL: Loaded 43687 existing records from primary storage. [2025-10-08T22:38:44.222601] [INFO ] [MAIN ] GIL: Loaded 43687 primary data records. [2025-10-08T22:38:45.040247] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:45.041338] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42550 primary records. [2025-10-08T22:38:45.041627] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-08T22:38:45.063885] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-08T22:38:45.065413] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-08T22:38:45.067905] [INFO ] [MAIN ] Derivative Progress: 790/1771 symbols completed. GKOS took 1.0s. Estimated remaining: 6m 20s. Rate: 154.8 symbols/min [2025-10-08T22:38:45.068251] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:45.089849] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:45.095664] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43687 primary records. [2025-10-08T22:38:45.094952] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:45.095802] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-08T22:38:45.096397] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53672 primary records. [2025-10-08T22:38:45.097248] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-08T22:38:45.137151] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-08T22:38:45.137802] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-08T22:38:45.140287] [INFO ] [MAIN ] Derivative Progress: 791/1771 symbols completed. GIL took 1.1s. Estimated remaining: 6m 19s. Rate: 155.0 symbols/min [2025-10-08T22:38:45.138156] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-08T22:38:45.140626] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-08T22:38:45.140490] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:45.143779] [INFO ] [MAIN ] Derivative Progress: 792/1771 symbols completed. GIS took 1.1s. Estimated remaining: 6m 19s. Rate: 155.2 symbols/min [2025-10-08T22:38:45.144394] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:45.158765] [DEBUG] [LOCAL ] GL: Loaded 37792 existing records from primary storage. [2025-10-08T22:38:45.161043] [INFO ] [MAIN ] GL: Loaded 37792 primary data records. [2025-10-08T22:38:45.230381] [DEBUG] [LOCAL ] GLP: Loaded 9242 existing records from primary storage. [2025-10-08T22:38:45.258514] [INFO ] [MAIN ] GLP: Loaded 9242 primary data records. [2025-10-08T22:38:45.693518] [DEBUG] [LOCAL ] GLOB: Loaded 47776 existing records from primary storage. [2025-10-08T22:38:45.714570] [INFO ] [MAIN ] GLOB: Loaded 47776 primary data records. [2025-10-08T22:38:46.227488] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:46.228867] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37792 primary records. [2025-10-08T22:38:46.228963] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-08T22:38:46.262077] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:46.264051] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9242 primary records. [2025-10-08T22:38:46.264821] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-08T22:38:46.264630] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-08T22:38:46.266243] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-08T22:38:46.281853] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-08T22:38:46.283863] [INFO ] [MAIN ] Derivative Progress: 793/1771 symbols completed. GL took 1.2s. Estimated remaining: 6m 19s. Rate: 154.8 symbols/min [2025-10-08T22:38:46.284151] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-08T22:38:46.298981] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:46.301253] [INFO ] [MAIN ] Derivative Progress: 794/1771 symbols completed. GLP took 1.2s. Estimated remaining: 6m 18s. Rate: 155.0 symbols/min [2025-10-08T22:38:46.302319] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47776 primary records. [2025-10-08T22:38:46.302399] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-08T22:38:46.318599] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-08T22:38:46.318759] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-08T22:38:46.322330] [INFO ] [MAIN ] Derivative Progress: 795/1771 symbols completed. GLOB took 1.2s. Estimated remaining: 6m 17s. Rate: 155.2 symbols/min [2025-10-08T22:38:46.322834] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:46.322952] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:46.323067] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:46.428013] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-08T22:38:46.443274] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-08T22:38:46.443128] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-08T22:38:46.443448] [INFO ] [MAIN ] GLW: Loaded 53636 primary data records. [2025-10-08T22:38:46.444259] [DEBUG] [LOCAL ] GME: Loaded 53783 existing records from primary storage. [2025-10-08T22:38:46.465174] [INFO ] [MAIN ] GME: Loaded 53783 primary data records. [2025-10-08T22:38:47.380858] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:47.393706] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:47.394556] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53636 primary records. [2025-10-08T22:38:47.407322] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-08T22:38:47.407572] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-08T22:38:47.407873] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:47.407503] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-08T22:38:47.409250] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53783 primary records. [2025-10-08T22:38:47.409346] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-08T22:38:47.454674] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-08T22:38:47.453221] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-08T22:38:47.455090] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-08T22:38:47.455392] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-08T22:38:47.457722] [INFO ] [MAIN ] Derivative Progress: 796/1771 symbols completed. GM took 1.1s. Estimated remaining: 6m 18s. Rate: 154.8 symbols/min [2025-10-08T22:38:47.460315] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:47.460710] [INFO ] [MAIN ] Derivative Progress: 797/1771 symbols completed. GME took 1.1s. Estimated remaining: 6m 17s. Rate: 155.0 symbols/min [2025-10-08T22:38:47.461552] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:47.464750] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-08T22:38:47.464951] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-08T22:38:47.466794] [INFO ] [MAIN ] Derivative Progress: 798/1771 symbols completed. GLW took 1.1s. Estimated remaining: 6m 16s. Rate: 155.2 symbols/min [2025-10-08T22:38:47.467022] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:47.503807] [DEBUG] [LOCAL ] GNE: Loaded 17869 existing records from primary storage. [2025-10-08T22:38:47.503951] [INFO ] [MAIN ] GNE: Loaded 17869 primary data records. [2025-10-08T22:38:47.630431] [DEBUG] [LOCAL ] GMRE: Loaded 37133 existing records from primary storage. [2025-10-08T22:38:47.632116] [INFO ] [MAIN ] GMRE: Loaded 37133 primary data records. [2025-10-08T22:38:47.658605] [DEBUG] [LOCAL ] GMED: Loaded 48352 existing records from primary storage. [2025-10-08T22:38:47.709749] [INFO ] [MAIN ] GMED: Loaded 48352 primary data records. [2025-10-08T22:38:48.490772] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:48.491604] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17869 primary records. [2025-10-08T22:38:48.491750] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-08T22:38:48.512033] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-08T22:38:48.512409] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-08T22:38:48.514380] [INFO ] [MAIN ] Derivative Progress: 799/1771 symbols completed. GNE took 1.0s. Estimated remaining: 6m 17s. Rate: 154.8 symbols/min [2025-10-08T22:38:48.514551] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:48.544523] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:48.545259] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:48.545969] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37133 primary records. [2025-10-08T22:38:48.546679] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48352 primary records. [2025-10-08T22:38:48.546810] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-08T22:38:48.546767] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-08T22:38:48.575025] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-08T22:38:48.575453] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-08T22:38:48.578134] [INFO ] [MAIN ] Derivative Progress: 800/1771 symbols completed. GMED took 1.1s. Estimated remaining: 6m 16s. Rate: 155.0 symbols/min [2025-10-08T22:38:48.579086] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:48.591037] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-08T22:38:48.591177] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-08T22:38:48.593282] [INFO ] [MAIN ] Derivative Progress: 801/1771 symbols completed. GMRE took 1.1s. Estimated remaining: 6m 15s. Rate: 155.2 symbols/min [2025-10-08T22:38:48.593532] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:48.607391] [DEBUG] [LOCAL ] GNK: Loaded 40257 existing records from primary storage. [2025-10-08T22:38:48.607636] [INFO ] [MAIN ] GNK: Loaded 40257 primary data records. [2025-10-08T22:38:48.951071] [DEBUG] [LOCAL ] GNL: Loaded 46764 existing records from primary storage. [2025-10-08T22:38:48.952145] [INFO ] [MAIN ] GNL: Loaded 46764 primary data records. [2025-10-08T22:38:48.973476] [DEBUG] [LOCAL ] GNRC: Loaded 45257 existing records from primary storage. [2025-10-08T22:38:48.996497] [INFO ] [MAIN ] GNRC: Loaded 45257 primary data records. [2025-10-08T22:38:49.607300] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:49.608119] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40257 primary records. [2025-10-08T22:38:49.608304] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-08T22:38:49.629532] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-08T22:38:49.629858] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-08T22:38:49.632098] [INFO ] [MAIN ] Derivative Progress: 802/1771 symbols completed. GNK took 1.1s. Estimated remaining: 6m 15s. Rate: 154.9 symbols/min [2025-10-08T22:38:49.632348] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:49.645483] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:49.647162] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46764 primary records. [2025-10-08T22:38:49.648702] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-08T22:38:49.679477] [DEBUG] [LOCAL ] GNT: Loaded 8298 existing records from primary storage. [2025-10-08T22:38:49.675723] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:49.680513] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45257 primary records. [2025-10-08T22:38:49.679618] [INFO ] [MAIN ] GNT: Loaded 8298 primary data records. [2025-10-08T22:38:49.691864] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-08T22:38:49.807874] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-08T22:38:49.819039] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-08T22:38:49.840146] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-08T22:38:49.826418] [INFO ] [MAIN ] Derivative Progress: 803/1771 symbols completed. GNL took 1.2s. Estimated remaining: 6m 15s. Rate: 155.0 symbols/min [2025-10-08T22:38:49.855982] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:49.872881] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-08T22:38:49.984891] [INFO ] [MAIN ] Derivative Progress: 804/1771 symbols completed. GNRC took 1.4s. Estimated remaining: 6m 14s. Rate: 155.1 symbols/min [2025-10-08T22:38:49.994179] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:50.031539] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:50.044324] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8298 primary records. [2025-10-08T22:38:50.044477] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-08T22:38:50.073484] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-08T22:38:50.074225] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-08T22:38:50.076281] [INFO ] [MAIN ] Derivative Progress: 805/1771 symbols completed. GNT took 0.4s. Estimated remaining: 6m 13s. Rate: 155.2 symbols/min [2025-10-08T22:38:50.077215] [DEBUG] [LOCAL ] GNW: Loaded 51342 existing records from primary storage. [2025-10-08T22:38:50.077350] [INFO ] [MAIN ] GNW: Loaded 51342 primary data records. [2025-10-08T22:38:50.076500] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:50.153794] [DEBUG] [LOCAL ] GOF: Loaded 42523 existing records from primary storage. [2025-10-08T22:38:50.165583] [INFO ] [MAIN ] GOF: Loaded 42523 primary data records. [2025-10-08T22:38:50.529459] [DEBUG] [LOCAL ] GOLF: Loaded 31026 existing records from primary storage. [2025-10-08T22:38:50.542706] [INFO ] [MAIN ] GOLF: Loaded 31026 primary data records. [2025-10-08T22:38:51.013225] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:51.014139] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51342 primary records. [2025-10-08T22:38:51.016614] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-08T22:38:51.045527] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:51.046667] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-08T22:38:51.047326] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42523 primary records. [2025-10-08T22:38:51.047618] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-08T22:38:51.047743] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-08T22:38:51.049768] [INFO ] [MAIN ] Derivative Progress: 806/1771 symbols completed. GNW took 1.2s. Estimated remaining: 6m 14s. Rate: 154.9 symbols/min [2025-10-08T22:38:51.050867] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:51.069260] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-08T22:38:51.077073] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-08T22:38:51.082270] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:51.083067] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 31026 primary records. [2025-10-08T22:38:51.085213] [INFO ] [MAIN ] Derivative Progress: 807/1771 symbols completed. GOF took 1.1s. Estimated remaining: 6m 13s. Rate: 155.1 symbols/min [2025-10-08T22:38:51.085311] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-08T22:38:51.086032] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:51.113028] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-08T22:38:51.113296] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-08T22:38:51.118027] [INFO ] [MAIN ] Derivative Progress: 808/1771 symbols completed. GOLF took 1.0s. Estimated remaining: 6m 12s. Rate: 155.3 symbols/min [2025-10-08T22:38:51.153434] [DEBUG] [LOCAL ] GOOS: Loaded 44801 existing records from primary storage. [2025-10-08T22:38:51.154037] [DEBUG] [LOCAL ] GOTU: Loaded 37800 existing records from primary storage. [2025-10-08T22:38:51.154137] [INFO ] [MAIN ] GOOS: Loaded 44801 primary data records. [2025-10-08T22:38:51.154298] [INFO ] [MAIN ] GOTU: Loaded 37800 primary data records. [2025-10-08T22:38:51.780242] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:51.781103] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44801 primary records. [2025-10-08T22:38:51.781860] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-08T22:38:51.809435] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:51.811297] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37800 primary records. [2025-10-08T22:38:51.811946] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-08T22:38:51.812163] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-08T22:38:51.812746] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-08T22:38:51.814722] [INFO ] [MAIN ] Derivative Progress: 809/1771 symbols completed. GOOS took 0.8s. Estimated remaining: 6m 12s. Rate: 155.1 symbols/min [2025-10-08T22:38:51.830165] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-08T22:38:51.830225] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-08T22:38:51.832135] [INFO ] [MAIN ] Derivative Progress: 810/1771 symbols completed. GOTU took 0.7s. Estimated remaining: 6m 11s. Rate: 155.3 symbols/min [2025-10-08T22:38:51.833010] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:51.833168] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:51.833068] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:51.840536] [DEBUG] [LOCAL ] GPJA: Loaded 4265 existing records from primary storage. [2025-10-08T22:38:51.840908] [INFO ] [MAIN ] GPJA: Loaded 4265 primary data records. [2025-10-08T22:38:51.951619] [DEBUG] [LOCAL ] GPI: Loaded 14622 existing records from primary storage. [2025-10-08T22:38:51.951804] [INFO ] [MAIN ] GPI: Loaded 14622 primary data records. [2025-10-08T22:38:52.460808] [DEBUG] [LOCAL ] GPC: Loaded 46159 existing records from primary storage. [2025-10-08T22:38:52.461976] [INFO ] [MAIN ] GPC: Loaded 46159 primary data records. [2025-10-08T22:38:52.783268] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:38:52.792114] [INFO ] [MAIN ] GPJA: Generated 1793 derivative records from 4265 primary records. [2025-10-08T22:38:52.796775] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-08T22:38:52.798852] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:38:52.799633] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14622 primary records. [2025-10-08T22:38:52.800054] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-08T22:38:52.815045] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1793 records). [2025-10-08T22:38:52.822135] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-08T22:38:52.824160] [INFO ] [MAIN ] Derivative Progress: 811/1771 symbols completed. GPJA took 1.0s. Estimated remaining: 6m 12s. Rate: 155.0 symbols/min [2025-10-08T22:38:52.828097] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:52.836468] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-10-08T22:38:52.848812] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-08T22:38:52.851469] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:52.852381] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46159 primary records. [2025-10-08T22:38:52.852483] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-08T22:38:52.851206] [INFO ] [MAIN ] Derivative Progress: 812/1771 symbols completed. GPI took 1.0s. Estimated remaining: 6m 11s. Rate: 155.2 symbols/min [2025-10-08T22:38:52.852743] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:52.870253] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-08T22:38:52.870535] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-08T22:38:52.872427] [INFO ] [MAIN ] Derivative Progress: 813/1771 symbols completed. GPC took 1.0s. Estimated remaining: 6m 10s. Rate: 155.4 symbols/min [2025-10-08T22:38:52.872668] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:52.905737] [DEBUG] [LOCAL ] GPMT: Loaded 25869 existing records from primary storage. [2025-10-08T22:38:52.905884] [INFO ] [MAIN ] GPMT: Loaded 25869 primary data records. [2025-10-08T22:38:53.023679] [DEBUG] [LOCAL ] GPK: Loaded 52672 existing records from primary storage. [2025-10-08T22:38:53.039759] [INFO ] [MAIN ] GPK: Loaded 52672 primary data records. [2025-10-08T22:38:53.434931] [DEBUG] [LOCAL ] GPN: Loaded 52027 existing records from primary storage. [2025-10-08T22:38:53.547737] [INFO ] [MAIN ] GPN: Loaded 52027 primary data records. [2025-10-08T22:38:53.914140] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:53.915518] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25869 primary records. [2025-10-08T22:38:53.915618] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-08T22:38:53.951524] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:53.953828] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52672 primary records. [2025-10-08T22:38:53.954235] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-08T22:38:53.956855] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-08T22:38:53.957170] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-08T22:38:53.966585] [INFO ] [MAIN ] Derivative Progress: 814/1771 symbols completed. GPMT took 1.1s. Estimated remaining: 6m 10s. Rate: 155.0 symbols/min [2025-10-08T22:38:53.970486] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:53.975758] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-08T22:38:53.975927] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-08T22:38:53.978104] [INFO ] [MAIN ] Derivative Progress: 815/1771 symbols completed. GPK took 1.1s. Estimated remaining: 6m 10s. Rate: 155.2 symbols/min [2025-10-08T22:38:53.978832] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:53.995261] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:53.996213] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52027 primary records. [2025-10-08T22:38:53.996279] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-08T22:38:54.017808] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-08T22:38:54.017984] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-08T22:38:54.019934] [INFO ] [MAIN ] Derivative Progress: 816/1771 symbols completed. GPN took 1.1s. Estimated remaining: 6m 9s. Rate: 155.4 symbols/min [2025-10-08T22:38:54.020161] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:54.031742] [DEBUG] [LOCAL ] GPOR: Loaded 23230 existing records from primary storage. [2025-10-08T22:38:54.031893] [INFO ] [MAIN ] GPOR: Loaded 23230 primary data records. [2025-10-08T22:38:54.175589] [DEBUG] [LOCAL ] GRBK: Loaded 26912 existing records from primary storage. [2025-10-08T22:38:54.187281] [DEBUG] [LOCAL ] GPRK: Loaded 39463 existing records from primary storage. [2025-10-08T22:38:54.192515] [INFO ] [MAIN ] GRBK: Loaded 26912 primary data records. [2025-10-08T22:38:54.197897] [INFO ] [MAIN ] GPRK: Loaded 39463 primary data records. [2025-10-08T22:38:55.018664] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:55.019798] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23230 primary records. [2025-10-08T22:38:55.020047] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-08T22:38:55.055368] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:55.055095] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-10-08T22:38:55.057152] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26912 primary records. [2025-10-08T22:38:55.057260] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-08T22:38:55.057324] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-08T22:38:55.059297] [INFO ] [MAIN ] Derivative Progress: 817/1771 symbols completed. GPOR took 1.1s. Estimated remaining: 6m 9s. Rate: 155.0 symbols/min [2025-10-08T22:38:55.061211] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:55.087850] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:55.093095] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39463 primary records. [2025-10-08T22:38:55.093856] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-08T22:38:55.098843] [DEBUG] [LOCAL ] GRC: Loaded 9202 existing records from primary storage. [2025-10-08T22:38:55.109898] [INFO ] [MAIN ] GRC: Loaded 9202 primary data records. [2025-10-08T22:38:55.106365] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-08T22:38:55.122667] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-08T22:38:55.124978] [INFO ] [MAIN ] Derivative Progress: 818/1771 symbols completed. GRBK took 1.1s. Estimated remaining: 6m 8s. Rate: 155.2 symbols/min [2025-10-08T22:38:55.135212] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:55.200498] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-08T22:38:55.210921] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-08T22:38:55.228977] [INFO ] [MAIN ] Derivative Progress: 819/1771 symbols completed. GPRK took 1.3s. Estimated remaining: 6m 8s. Rate: 155.3 symbols/min [2025-10-08T22:38:55.256040] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:55.311335] [DEBUG] [LOCAL ] GRDN: Loaded 20937 existing records from primary storage. [2025-10-08T22:38:55.311564] [INFO ] [MAIN ] GRDN: Loaded 20937 primary data records. [2025-10-08T22:38:55.794992] [DEBUG] [LOCAL ] GRMN: Loaded 40656 existing records from primary storage. [2025-10-08T22:38:55.795383] [INFO ] [MAIN ] GRMN: Loaded 40656 primary data records. [2025-10-08T22:38:55.879229] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:55.900772] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9202 primary records. [2025-10-08T22:38:55.928733] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-08T22:38:56.164036] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-08T22:38:56.164843] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:56.165907] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 20937 primary records. [2025-10-08T22:38:56.167009] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-08T22:38:56.167410] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-08T22:38:56.169463] [INFO ] [MAIN ] Derivative Progress: 820/1771 symbols completed. GRC took 1.1s. Estimated remaining: 6m 8s. Rate: 155.1 symbols/min [2025-10-08T22:38:56.171150] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:56.190802] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-08T22:38:56.190903] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-08T22:38:56.193036] [INFO ] [MAIN ] Derivative Progress: 821/1771 symbols completed. GRDN took 1.1s. Estimated remaining: 6m 7s. Rate: 155.2 symbols/min [2025-10-08T22:38:56.193356] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:56.215361] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:56.216454] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 40656 primary records. [2025-10-08T22:38:56.216693] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-08T22:38:56.284636] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-08T22:38:56.284932] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-08T22:38:56.285492] [DEBUG] [LOCAL ] GRNT: Loaded 33908 existing records from primary storage. [2025-10-08T22:38:56.289473] [INFO ] [MAIN ] GRNT: Loaded 33908 primary data records. [2025-10-08T22:38:56.289319] [INFO ] [MAIN ] Derivative Progress: 822/1771 symbols completed. GRMN took 1.0s. Estimated remaining: 6m 6s. Rate: 155.4 symbols/min [2025-10-08T22:38:56.291017] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:56.290861] [DEBUG] [LOCAL ] GRND: Loaded 49969 existing records from primary storage. [2025-10-08T22:38:56.348261] [INFO ] [MAIN ] GRND: Loaded 49969 primary data records. [2025-10-08T22:38:56.450625] [DEBUG] [LOCAL ] GROV: Loaded 8857 existing records from primary storage. [2025-10-08T22:38:56.474746] [INFO ] [MAIN ] GROV: Loaded 8857 primary data records. [2025-10-08T22:38:57.338285] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:57.339513] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33908 primary records. [2025-10-08T22:38:57.339927] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-08T22:38:57.373834] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:57.374897] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-08T22:38:57.387980] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 49969 primary records. [2025-10-08T22:38:57.388198] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-08T22:38:57.388771] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-08T22:38:57.388687] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:57.391635] [INFO ] [MAIN ] Derivative Progress: 823/1771 symbols completed. GRNT took 1.2s. Estimated remaining: 6m 7s. Rate: 155.0 symbols/min [2025-10-08T22:38:57.392749] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8857 primary records. [2025-10-08T22:38:57.392841] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-08T22:38:57.421358] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-08T22:38:57.421733] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-08T22:38:57.424199] [INFO ] [MAIN ] Derivative Progress: 824/1771 symbols completed. GROV took 1.1s. Estimated remaining: 6m 6s. Rate: 155.2 symbols/min [2025-10-08T22:38:57.427427] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-08T22:38:57.427540] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-08T22:38:57.429685] [INFO ] [MAIN ] Derivative Progress: 825/1771 symbols completed. GRND took 1.3s. Estimated remaining: 6m 5s. Rate: 155.4 symbols/min [2025-10-08T22:38:57.430385] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:57.430522] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:57.430308] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:57.439049] [DEBUG] [LOCAL ] GRX: Loaded 4764 existing records from primary storage. [2025-10-08T22:38:57.439252] [INFO ] [MAIN ] GRX: Loaded 4764 primary data records. [2025-10-08T22:38:57.756133] [DEBUG] [LOCAL ] GSBD: Loaded 39374 existing records from primary storage. [2025-10-08T22:38:57.756483] [INFO ] [MAIN ] GSBD: Loaded 39374 primary data records. [2025-10-08T22:38:57.904592] [DEBUG] [LOCAL ] GS: Loaded 51771 existing records from primary storage. [2025-10-08T22:38:57.911322] [INFO ] [MAIN ] GS: Loaded 51771 primary data records. [2025-10-08T22:38:58.368240] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:58.445572] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4764 primary records. [2025-10-08T22:38:58.448366] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-08T22:38:58.474971] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-08T22:38:58.476999] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-08T22:38:58.480302] [INFO ] [MAIN ] Derivative Progress: 826/1771 symbols completed. GRX took 1.0s. Estimated remaining: 6m 6s. Rate: 155.1 symbols/min [2025-10-08T22:38:58.481060] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:58.496409] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:58.497873] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39374 primary records. [2025-10-08T22:38:58.498142] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-08T22:38:58.521554] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-08T22:38:58.534692] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-08T22:38:58.534600] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:58.535492] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51771 primary records. [2025-10-08T22:38:58.537696] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-08T22:38:58.537599] [INFO ] [MAIN ] Derivative Progress: 827/1771 symbols completed. GSBD took 1.1s. Estimated remaining: 6m 5s. Rate: 155.2 symbols/min [2025-10-08T22:38:58.538819] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:58.555915] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-08T22:38:58.556177] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-08T22:38:58.558415] [INFO ] [MAIN ] Derivative Progress: 828/1771 symbols completed. GS took 1.1s. Estimated remaining: 6m 4s. Rate: 155.4 symbols/min [2025-10-08T22:38:58.558636] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:58.611240] [DEBUG] [LOCAL ] GSK: Loaded 53500 existing records from primary storage. [2025-10-08T22:38:58.611595] [INFO ] [MAIN ] GSK: Loaded 53500 primary data records. [2025-10-08T22:38:58.769192] [DEBUG] [LOCAL ] GSL: Loaded 33224 existing records from primary storage. [2025-10-08T22:38:58.787150] [INFO ] [MAIN ] GSL: Loaded 33224 primary data records. [2025-10-08T22:38:58.776596] [DEBUG] [LOCAL ] GTES: Loaded 50433 existing records from primary storage. [2025-10-08T22:38:58.787347] [INFO ] [MAIN ] GTES: Loaded 50433 primary data records. [2025-10-08T22:38:59.673700] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:59.674971] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53500 primary records. [2025-10-08T22:38:59.675344] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-08T22:38:59.709187] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:59.714007] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-08T22:38:59.713400] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33224 primary records. [2025-10-08T22:38:59.714216] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-08T22:38:59.714681] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-08T22:38:59.717187] [INFO ] [MAIN ] Derivative Progress: 829/1771 symbols completed. GSK took 1.2s. Estimated remaining: 6m 5s. Rate: 155.0 symbols/min [2025-10-08T22:38:59.724911] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:59.742634] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:38:59.744090] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50433 primary records. [2025-10-08T22:38:59.744615] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-08T22:38:59.763179] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-08T22:38:59.763348] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-08T22:38:59.765549] [INFO ] [MAIN ] Derivative Progress: 830/1771 symbols completed. GTES took 1.2s. Estimated remaining: 6m 4s. Rate: 155.2 symbols/min [2025-10-08T22:38:59.766014] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-08T22:38:59.766173] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-08T22:38:59.766298] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:59.768608] [INFO ] [MAIN ] Derivative Progress: 831/1771 symbols completed. GSL took 1.2s. Estimated remaining: 6m 3s. Rate: 155.4 symbols/min [2025-10-08T22:38:59.769192] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:38:59.811273] [DEBUG] [LOCAL ] GTLS: Loaded 42973 existing records from primary storage. [2025-10-08T22:38:59.811579] [INFO ] [MAIN ] GTLS: Loaded 42973 primary data records. [2025-10-08T22:38:59.899791] [DEBUG] [LOCAL ] GTY: Loaded 30191 existing records from primary storage. [2025-10-08T22:38:59.912767] [INFO ] [MAIN ] GTY: Loaded 30191 primary data records. [2025-10-08T22:39:00.060128] [DEBUG] [LOCAL ] GTN: Loaded 45251 existing records from primary storage. [2025-10-08T22:39:00.086469] [INFO ] [MAIN ] GTN: Loaded 45251 primary data records. [2025-10-08T22:39:00.922766] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:00.938947] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 42973 primary records. [2025-10-08T22:39:00.939456] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-08T22:39:00.939813] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:00.941579] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30191 primary records. [2025-10-08T22:39:00.942149] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-08T22:39:00.981311] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-08T22:39:00.989533] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-08T22:39:00.997338] [INFO ] [MAIN ] Derivative Progress: 832/1771 symbols completed. GTY took 1.2s. Estimated remaining: 6m 4s. Rate: 155.0 symbols/min [2025-10-08T22:39:00.997795] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:01.000953] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:01.002547] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-08T22:39:01.004394] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-08T22:39:01.004086] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45251 primary records. [2025-10-08T22:39:01.006717] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-08T22:39:01.006589] [INFO ] [MAIN ] Derivative Progress: 833/1771 symbols completed. GTLS took 1.3s. Estimated remaining: 6m 3s. Rate: 155.2 symbols/min [2025-10-08T22:39:01.008480] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:01.042240] [DEBUG] [LOCAL ] GUG: Loaded 12241 existing records from primary storage. [2025-10-08T22:39:01.044067] [INFO ] [MAIN ] GUG: Loaded 12241 primary data records. [2025-10-08T22:39:01.066450] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-08T22:39:01.094280] [DEBUG] [LOCAL ] GUT: Loaded 15479 existing records from primary storage. [2025-10-08T22:39:01.132497] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-08T22:39:01.140684] [INFO ] [MAIN ] Derivative Progress: 834/1771 symbols completed. GTN took 1.4s. Estimated remaining: 6m 2s. Rate: 155.3 symbols/min [2025-10-08T22:39:01.138063] [INFO ] [MAIN ] GUT: Loaded 15479 primary data records. [2025-10-08T22:39:01.160842] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:01.749905] [DEBUG] [LOCAL ] GVA: Loaded 32831 existing records from primary storage. [2025-10-08T22:39:01.750748] [INFO ] [MAIN ] GVA: Loaded 32831 primary data records. [2025-10-08T22:39:02.080407] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:02.082230] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12241 primary records. [2025-10-08T22:39:02.083344] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-08T22:39:02.111179] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-08T22:39:02.112685] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-08T22:39:02.116259] [INFO ] [MAIN ] Derivative Progress: 835/1771 symbols completed. GUG took 1.1s. Estimated remaining: 6m 2s. Rate: 155.0 symbols/min [2025-10-08T22:39:02.118005] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:02.136461] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:02.137601] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15479 primary records. [2025-10-08T22:39:02.137837] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-08T22:39:02.171775] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-08T22:39:02.172258] [DEBUG] [LOCAL ] GWH: Loaded 17046 existing records from primary storage. [2025-10-08T22:39:02.172711] [INFO ] [MAIN ] GWH: Loaded 17046 primary data records. [2025-10-08T22:39:02.190851] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:02.198321] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 32831 primary records. [2025-10-08T22:39:02.185258] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-08T22:39:02.208472] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-08T22:39:02.222329] [INFO ] [MAIN ] Derivative Progress: 836/1771 symbols completed. GUT took 1.2s. Estimated remaining: 6m 2s. Rate: 155.1 symbols/min [2025-10-08T22:39:02.229105] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:02.383958] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-08T22:39:02.414556] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-08T22:39:02.535951] [INFO ] [MAIN ] Derivative Progress: 837/1771 symbols completed. GVA took 1.4s. Estimated remaining: 6m 1s. Rate: 155.2 symbols/min [2025-10-08T22:39:02.536588] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:02.555384] [DEBUG] [LOCAL ] GWRE: Loaded 40142 existing records from primary storage. [2025-10-08T22:39:02.556139] [INFO ] [MAIN ] GWRE: Loaded 40142 primary data records. [2025-10-08T22:39:02.662005] [DEBUG] [LOCAL ] GWW: Loaded 19426 existing records from primary storage. [2025-10-08T22:39:02.685107] [INFO ] [MAIN ] GWW: Loaded 19426 primary data records. [2025-10-08T22:39:03.043025] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:03.083556] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 17046 primary records. [2025-10-08T22:39:03.108560] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-08T22:39:03.256190] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-08T22:39:03.256828] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-08T22:39:03.258806] [INFO ] [MAIN ] Derivative Progress: 838/1771 symbols completed. GWH took 1.1s. Estimated remaining: 6m 1s. Rate: 155.0 symbols/min [2025-10-08T22:39:03.276202] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:03.277037] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 40142 primary records. [2025-10-08T22:39:03.277125] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-08T22:39:03.296505] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-08T22:39:03.296698] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-08T22:39:03.298818] [INFO ] [MAIN ] Derivative Progress: 839/1771 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 0s. Rate: 155.2 symbols/min [2025-10-08T22:39:03.311545] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:03.312160] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19426 primary records. [2025-10-08T22:39:03.312221] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-08T22:39:03.327428] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-08T22:39:03.327501] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-08T22:39:03.329864] [INFO ] [MAIN ] Derivative Progress: 840/1771 symbols completed. GWW took 0.8s. Estimated remaining: 5m 60s. Rate: 155.3 symbols/min [2025-10-08T22:39:03.330333] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:03.330543] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:03.330464] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:03.335835] [DEBUG] [LOCAL ] GYLD: Loaded 1535 existing records from primary storage. [2025-10-08T22:39:03.336062] [INFO ] [MAIN ] GYLD: Loaded 1535 primary data records. [2025-10-08T22:39:03.712510] [DEBUG] [LOCAL ] GXO: Loaded 47078 existing records from primary storage. [2025-10-08T22:39:03.727238] [INFO ] [MAIN ] GXO: Loaded 47078 primary data records. [2025-10-08T22:39:03.732157] [DEBUG] [LOCAL ] H: Loaded 44514 existing records from primary storage. [2025-10-08T22:39:03.745417] [INFO ] [MAIN ] H: Loaded 44514 primary data records. [2025-10-08T22:39:04.385031] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:04.399182] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1535 primary records. [2025-10-08T22:39:04.399311] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-08T22:39:04.415087] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-08T22:39:04.417038] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-08T22:39:04.419613] [INFO ] [MAIN ] Derivative Progress: 841/1771 symbols completed. GYLD took 1.1s. Estimated remaining: 5m 60s. Rate: 155.0 symbols/min [2025-10-08T22:39:04.421212] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:04.458850] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:04.468146] [DEBUG] [MAIN ] H: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:04.469181] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44514 primary records. [2025-10-08T22:39:04.470114] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47078 primary records. [2025-10-08T22:39:04.470207] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-08T22:39:04.470787] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-08T22:39:04.500206] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-08T22:39:04.500709] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-08T22:39:04.512828] [INFO ] [MAIN ] Derivative Progress: 842/1771 symbols completed. H took 1.2s. Estimated remaining: 5m 59s. Rate: 155.2 symbols/min [2025-10-08T22:39:04.514031] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:04.518461] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-08T22:39:04.519049] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-08T22:39:04.515930] [DEBUG] [LOCAL ] HAE: Loaded 39439 existing records from primary storage. [2025-10-08T22:39:04.521042] [INFO ] [MAIN ] Derivative Progress: 843/1771 symbols completed. GXO took 1.2s. Estimated remaining: 5m 58s. Rate: 155.3 symbols/min [2025-10-08T22:39:04.521316] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:04.521775] [INFO ] [MAIN ] HAE: Loaded 39439 primary data records. [2025-10-08T22:39:04.864441] [DEBUG] [LOCAL ] HAFN: Loaded 43141 existing records from primary storage. [2025-10-08T22:39:04.865210] [INFO ] [MAIN ] HAFN: Loaded 43141 primary data records. [2025-10-08T22:39:04.983686] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-08T22:39:04.985322] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-08T22:39:05.560484] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:05.561795] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39439 primary records. [2025-10-08T22:39:05.562401] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-08T22:39:05.581689] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-08T22:39:05.582251] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-08T22:39:05.584245] [INFO ] [MAIN ] Derivative Progress: 844/1771 symbols completed. HAE took 1.2s. Estimated remaining: 5m 59s. Rate: 155.0 symbols/min [2025-10-08T22:39:05.584687] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:05.605105] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:05.606048] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43141 primary records. [2025-10-08T22:39:05.606168] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-08T22:39:05.638892] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:05.639532] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-08T22:39:05.639802] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-08T22:39:05.641769] [INFO ] [MAIN ] Derivative Progress: 845/1771 symbols completed. HAFN took 1.1s. Estimated remaining: 5m 58s. Rate: 155.2 symbols/min [2025-10-08T22:39:05.642692] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-08T22:39:05.642889] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-08T22:39:05.643298] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:05.671230] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-08T22:39:05.671526] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-08T22:39:05.673562] [INFO ] [MAIN ] Derivative Progress: 846/1771 symbols completed. HAL took 1.2s. Estimated remaining: 5m 57s. Rate: 155.3 symbols/min [2025-10-08T22:39:05.673955] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:05.683415] [DEBUG] [LOCAL ] HBB: Loaded 6485 existing records from primary storage. [2025-10-08T22:39:05.684363] [INFO ] [MAIN ] HBB: Loaded 6485 primary data records. [2025-10-08T22:39:05.769328] [DEBUG] [LOCAL ] HASI: Loaded 47306 existing records from primary storage. [2025-10-08T22:39:05.796956] [INFO ] [MAIN ] HASI: Loaded 47306 primary data records. [2025-10-08T22:39:06.021100] [DEBUG] [LOCAL ] HAYW: Loaded 48747 existing records from primary storage. [2025-10-08T22:39:06.150346] [INFO ] [MAIN ] HAYW: Loaded 48747 primary data records. [2025-10-08T22:39:06.713268] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:06.714248] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:06.715046] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47306 primary records. [2025-10-08T22:39:06.715257] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-08T22:39:06.715899] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6485 primary records. [2025-10-08T22:39:06.716187] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-08T22:39:06.746304] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-08T22:39:06.746635] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-08T22:39:06.748657] [INFO ] [MAIN ] Derivative Progress: 847/1771 symbols completed. HBB took 1.1s. Estimated remaining: 5m 58s. Rate: 155.0 symbols/min [2025-10-08T22:39:06.748831] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:06.752411] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-08T22:39:06.752608] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-08T22:39:06.754750] [INFO ] [MAIN ] Derivative Progress: 848/1771 symbols completed. HASI took 1.2s. Estimated remaining: 5m 57s. Rate: 155.2 symbols/min [2025-10-08T22:39:06.756517] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:06.772379] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:06.773223] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48747 primary records. [2025-10-08T22:39:06.773377] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-08T22:39:06.794787] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-08T22:39:06.794926] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-08T22:39:06.797035] [INFO ] [MAIN ] Derivative Progress: 849/1771 symbols completed. HAYW took 1.2s. Estimated remaining: 5m 56s. Rate: 155.4 symbols/min [2025-10-08T22:39:06.797350] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:06.850374] [DEBUG] [LOCAL ] HBI: Loaded 52987 existing records from primary storage. [2025-10-08T22:39:06.865289] [INFO ] [MAIN ] HBI: Loaded 52987 primary data records. [2025-10-08T22:39:06.897131] [DEBUG] [LOCAL ] HBM: Loaded 52928 existing records from primary storage. [2025-10-08T22:39:06.920828] [INFO ] [MAIN ] HBM: Loaded 52928 primary data records. [2025-10-08T22:39:07.367848] [DEBUG] [LOCAL ] HCA: Loaded 46889 existing records from primary storage. [2025-10-08T22:39:07.399474] [INFO ] [MAIN ] HCA: Loaded 46889 primary data records. [2025-10-08T22:39:07.891367] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:07.894701] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52987 primary records. [2025-10-08T22:39:07.896186] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-08T22:39:07.911376] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:07.920226] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52928 primary records. [2025-10-08T22:39:07.920602] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-08T22:39:07.935908] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-08T22:39:07.936310] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-08T22:39:07.941331] [INFO ] [MAIN ] Derivative Progress: 850/1771 symbols completed. HBI took 1.2s. Estimated remaining: 5m 57s. Rate: 155.0 symbols/min [2025-10-08T22:39:07.941870] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:07.961587] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:07.962849] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46889 primary records. [2025-10-08T22:39:07.963518] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-08T22:39:07.963298] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-08T22:39:07.964064] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-08T22:39:07.966541] [INFO ] [MAIN ] Derivative Progress: 851/1771 symbols completed. HBM took 1.2s. Estimated remaining: 5m 56s. Rate: 155.2 symbols/min [2025-10-08T22:39:07.966943] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:07.982954] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-08T22:39:07.983038] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-08T22:39:07.985130] [INFO ] [MAIN ] Derivative Progress: 852/1771 symbols completed. HCA took 1.2s. Estimated remaining: 5m 55s. Rate: 155.3 symbols/min [2025-10-08T22:39:07.985334] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:08.010194] [DEBUG] [LOCAL ] HCI: Loaded 14077 existing records from primary storage. [2025-10-08T22:39:08.010423] [INFO ] [MAIN ] HCI: Loaded 14077 primary data records. [2025-10-08T22:39:08.158996] [DEBUG] [LOCAL ] HCC: Loaded 45290 existing records from primary storage. [2025-10-08T22:39:08.169585] [INFO ] [MAIN ] HCC: Loaded 45290 primary data records. [2025-10-08T22:39:08.483057] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-08T22:39:08.495358] [INFO ] [MAIN ] HD: Loaded 53492 primary data records. [2025-10-08T22:39:09.048083] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:09.049071] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14077 primary records. [2025-10-08T22:39:09.050515] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-08T22:39:09.086780] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:09.089258] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45290 primary records. [2025-10-08T22:39:09.089707] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-08T22:39:09.093035] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-08T22:39:09.101675] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-08T22:39:09.109553] [INFO ] [MAIN ] Derivative Progress: 853/1771 symbols completed. HCI took 1.1s. Estimated remaining: 5m 55s. Rate: 155.0 symbols/min [2025-10-08T22:39:09.114368] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-08T22:39:09.114584] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-08T22:39:09.116589] [INFO ] [MAIN ] Derivative Progress: 854/1771 symbols completed. HCC took 1.2s. Estimated remaining: 5m 55s. Rate: 155.2 symbols/min [2025-10-08T22:39:09.129909] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:09.130597] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53492 primary records. [2025-10-08T22:39:09.130707] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-08T22:39:09.147059] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-08T22:39:09.147157] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-08T22:39:09.149301] [INFO ] [MAIN ] Derivative Progress: 855/1771 symbols completed. HD took 1.2s. Estimated remaining: 5m 54s. Rate: 155.3 symbols/min [2025-10-08T22:39:09.149756] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:09.149856] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:09.149943] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:09.226987] [DEBUG] [LOCAL ] HEI: Loaded 31659 existing records from primary storage. [2025-10-08T22:39:09.226393] [DEBUG] [LOCAL ] HE: Loaded 48999 existing records from primary storage. [2025-10-08T22:39:09.227373] [INFO ] [MAIN ] HEI: Loaded 31659 primary data records. [2025-10-08T22:39:09.227894] [INFO ] [MAIN ] HE: Loaded 48999 primary data records. [2025-10-08T22:39:09.355437] [DEBUG] [LOCAL ] HDB: Loaded 51940 existing records from primary storage. [2025-10-08T22:39:09.411185] [INFO ] [MAIN ] HDB: Loaded 51940 primary data records. [2025-10-08T22:39:10.242949] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:10.245757] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48999 primary records. [2025-10-08T22:39:10.245933] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-08T22:39:10.272254] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:10.277134] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-08T22:39:10.278204] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 31659 primary records. [2025-10-08T22:39:10.279189] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-08T22:39:10.281663] [INFO ] [MAIN ] Derivative Progress: 856/1771 symbols completed. HE took 1.1s. Estimated remaining: 5m 54s. Rate: 155.0 symbols/min [2025-10-08T22:39:10.282920] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:10.279300] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-08T22:39:10.316256] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-08T22:39:10.316955] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-08T22:39:10.319985] [INFO ] [MAIN ] Derivative Progress: 857/1771 symbols completed. HEI took 1.2s. Estimated remaining: 5m 53s. Rate: 155.1 symbols/min [2025-10-08T22:39:10.320212] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:10.316828] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:10.324626] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51940 primary records. [2025-10-08T22:39:10.324900] [DEBUG] [LOCAL ] HEQ: Loaded 6596 existing records from primary storage. [2025-10-08T22:39:10.325087] [INFO ] [MAIN ] HEQ: Loaded 6596 primary data records. [2025-10-08T22:39:10.330330] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-08T22:39:10.494394] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-08T22:39:10.548193] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-08T22:39:10.551356] [INFO ] [MAIN ] Derivative Progress: 858/1771 symbols completed. HDB took 1.4s. Estimated remaining: 5m 53s. Rate: 155.2 symbols/min [2025-10-08T22:39:10.708101] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:10.749232] [DEBUG] [LOCAL ] HESM: Loaded 48300 existing records from primary storage. [2025-10-08T22:39:10.750289] [INFO ] [MAIN ] HESM: Loaded 48300 primary data records. [2025-10-08T22:39:10.899780] [DEBUG] [LOCAL ] HFRO: Loaded 17481 existing records from primary storage. [2025-10-08T22:39:10.918045] [INFO ] [MAIN ] HFRO: Loaded 17481 primary data records. [2025-10-08T22:39:11.161737] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:11.243753] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6596 primary records. [2025-10-08T22:39:11.383095] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-08T22:39:11.652299] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-08T22:39:11.653292] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-08T22:39:11.655630] [INFO ] [MAIN ] Derivative Progress: 859/1771 symbols completed. HEQ took 1.4s. Estimated remaining: 5m 53s. Rate: 154.9 symbols/min [2025-10-08T22:39:11.657278] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:11.694507] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:11.693805] [DEBUG] [LOCAL ] HGLB: Loaded 9688 existing records from primary storage. [2025-10-08T22:39:11.695690] [INFO ] [MAIN ] HGLB: Loaded 9688 primary data records. [2025-10-08T22:39:11.696449] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48300 primary records. [2025-10-08T22:39:11.714695] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-08T22:39:11.799298] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:11.816941] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17481 primary records. [2025-10-08T22:39:11.834480] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-08T22:39:11.843915] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-08T22:39:11.849671] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-08T22:39:11.853007] [INFO ] [MAIN ] Derivative Progress: 860/1771 symbols completed. HESM took 1.5s. Estimated remaining: 5m 53s. Rate: 155.0 symbols/min [2025-10-08T22:39:11.860855] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:12.128406] [DEBUG] [LOCAL ] HGTY: Loaded 13249 existing records from primary storage. [2025-10-08T22:39:12.130697] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-08T22:39:12.129486] [INFO ] [MAIN ] HGTY: Loaded 13249 primary data records. [2025-10-08T22:39:12.142151] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-08T22:39:12.144518] [INFO ] [MAIN ] Derivative Progress: 861/1771 symbols completed. HFRO took 1.4s. Estimated remaining: 5m 52s. Rate: 155.0 symbols/min [2025-10-08T22:39:12.161285] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:12.507807] [DEBUG] [LOCAL ] HGV: Loaded 46408 existing records from primary storage. [2025-10-08T22:39:12.508537] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:12.509361] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9688 primary records. [2025-10-08T22:39:12.509577] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-08T22:39:12.508212] [INFO ] [MAIN ] HGV: Loaded 46408 primary data records. [2025-10-08T22:39:12.632587] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-08T22:39:12.633432] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-08T22:39:12.651466] [INFO ] [MAIN ] Derivative Progress: 862/1771 symbols completed. HGLB took 1.0s. Estimated remaining: 5m 52s. Rate: 155.0 symbols/min [2025-10-08T22:39:12.676284] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:12.854231] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:12.856545] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13249 primary records. [2025-10-08T22:39:12.857150] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-08T22:39:12.885292] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-08T22:39:12.885891] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-08T22:39:12.888125] [INFO ] [MAIN ] Derivative Progress: 863/1771 symbols completed. HGTY took 1.0s. Estimated remaining: 5m 51s. Rate: 155.0 symbols/min [2025-10-08T22:39:12.888608] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:12.902943] [DEBUG] [LOCAL ] HHH: Loaded 32955 existing records from primary storage. [2025-10-08T22:39:12.903187] [INFO ] [MAIN ] HHH: Loaded 32955 primary data records. [2025-10-08T22:39:13.030103] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:13.046575] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46408 primary records. [2025-10-08T22:39:13.066469] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-08T22:39:13.109025] [DEBUG] [LOCAL ] HI: Loaded 35330 existing records from primary storage. [2025-10-08T22:39:13.160723] [INFO ] [MAIN ] HI: Loaded 35330 primary data records. [2025-10-08T22:39:13.398317] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-08T22:39:13.404118] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-08T22:39:13.406150] [INFO ] [MAIN ] Derivative Progress: 864/1771 symbols completed. HGV took 1.2s. Estimated remaining: 5m 51s. Rate: 155.0 symbols/min [2025-10-08T22:39:13.432267] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:13.653413] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:13.654521] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32955 primary records. [2025-10-08T22:39:13.654749] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-08T22:39:13.691365] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-08T22:39:13.691831] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-08T22:39:13.694151] [INFO ] [MAIN ] Derivative Progress: 865/1771 symbols completed. HHH took 1.0s. Estimated remaining: 5m 51s. Rate: 155.0 symbols/min [2025-10-08T22:39:13.694466] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:13.727816] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:13.728876] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35330 primary records. [2025-10-08T22:39:13.730126] [DEBUG] [LOCAL ] HIG: Loaded 51163 existing records from primary storage. [2025-10-08T22:39:13.730273] [INFO ] [MAIN ] HIG: Loaded 51163 primary data records. [2025-10-08T22:39:13.730541] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-08T22:39:13.888014] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-08T22:39:13.947575] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-08T22:39:13.988791] [DEBUG] [LOCAL ] HII: Loaded 34069 existing records from primary storage. [2025-10-08T22:39:14.123872] [INFO ] [MAIN ] Derivative Progress: 866/1771 symbols completed. HI took 1.2s. Estimated remaining: 5m 50s. Rate: 155.0 symbols/min [2025-10-08T22:39:14.125175] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:14.125043] [INFO ] [MAIN ] HII: Loaded 34069 primary data records. [2025-10-08T22:39:14.567028] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:14.582977] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51163 primary records. [2025-10-08T22:39:14.583659] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-08T22:39:14.585329] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-08T22:39:14.585890] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-08T22:39:14.760539] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-08T22:39:14.910813] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-08T22:39:14.913305] [INFO ] [MAIN ] Derivative Progress: 867/1771 symbols completed. HIG took 1.5s. Estimated remaining: 5m 50s. Rate: 154.8 symbols/min [2025-10-08T22:39:14.927116] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:14.928012] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:14.929599] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 34069 primary records. [2025-10-08T22:39:14.932545] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-08T22:39:14.951836] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-08T22:39:14.958013] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-08T22:39:14.960584] [INFO ] [MAIN ] Derivative Progress: 868/1771 symbols completed. HII took 1.3s. Estimated remaining: 5m 50s. Rate: 155.0 symbols/min [2025-10-08T22:39:14.974132] [DEBUG] [LOCAL ] HIO: Loaded 24054 existing records from primary storage. [2025-10-08T22:39:14.974380] [INFO ] [MAIN ] HIO: Loaded 24054 primary data records. [2025-10-08T22:39:15.051392] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:15.063727] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-08T22:39:15.079246] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-08T22:39:15.148430] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-08T22:39:15.166301] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-08T22:39:15.191546] [INFO ] [MAIN ] Derivative Progress: 869/1771 symbols completed. HIMS took 1.1s. Estimated remaining: 5m 49s. Rate: 155.0 symbols/min [2025-10-08T22:39:15.335322] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:15.336054] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24054 primary records. [2025-10-08T22:39:15.336118] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-08T22:39:15.351330] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-08T22:39:15.351389] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-08T22:39:15.353452] [INFO ] [MAIN ] Derivative Progress: 870/1771 symbols completed. HIO took 0.4s. Estimated remaining: 5m 48s. Rate: 155.1 symbols/min [2025-10-08T22:39:15.353980] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:15.354107] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:15.354235] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:15.380059] [DEBUG] [LOCAL ] HIX: Loaded 20688 existing records from primary storage. [2025-10-08T22:39:15.380273] [INFO ] [MAIN ] HIX: Loaded 20688 primary data records. [2025-10-08T22:39:15.442960] [DEBUG] [LOCAL ] HIPO: Loaded 21980 existing records from primary storage. [2025-10-08T22:39:15.468404] [INFO ] [MAIN ] HIPO: Loaded 21980 primary data records. [2025-10-08T22:39:15.723134] [DEBUG] [LOCAL ] HIW: Loaded 44497 existing records from primary storage. [2025-10-08T22:39:15.873592] [INFO ] [MAIN ] HIW: Loaded 44497 primary data records. [2025-10-08T22:39:16.485464] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:16.490863] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:16.491695] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20688 primary records. [2025-10-08T22:39:16.492962] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21980 primary records. [2025-10-08T22:39:16.493037] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-08T22:39:16.493114] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-08T22:39:16.524628] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-08T22:39:16.525206] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-08T22:39:16.527896] [INFO ] [MAIN ] Derivative Progress: 871/1771 symbols completed. HIPO took 1.2s. Estimated remaining: 5m 49s. Rate: 154.8 symbols/min [2025-10-08T22:39:16.530561] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-08T22:39:16.530695] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:16.531464] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-08T22:39:16.533544] [INFO ] [MAIN ] Derivative Progress: 872/1771 symbols completed. HIX took 1.2s. Estimated remaining: 5m 48s. Rate: 155.0 symbols/min [2025-10-08T22:39:16.534064] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:16.552583] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:16.557963] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44497 primary records. [2025-10-08T22:39:16.558138] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-08T22:39:16.581027] [DEBUG] [LOCAL ] HKD: Loaded 18518 existing records from primary storage. [2025-10-08T22:39:16.582320] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-08T22:39:16.582548] [INFO ] [MAIN ] HKD: Loaded 18518 primary data records. [2025-10-08T22:39:16.582639] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-08T22:39:16.585052] [INFO ] [MAIN ] Derivative Progress: 873/1771 symbols completed. HIW took 1.2s. Estimated remaining: 5m 47s. Rate: 155.1 symbols/min [2025-10-08T22:39:16.585342] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:16.775421] [DEBUG] [LOCAL ] HL: Loaded 53672 existing records from primary storage. [2025-10-08T22:39:16.809185] [INFO ] [MAIN ] HL: Loaded 53672 primary data records. [2025-10-08T22:39:17.066126] [DEBUG] [LOCAL ] HLF: Loaded 48417 existing records from primary storage. [2025-10-08T22:39:17.081878] [INFO ] [MAIN ] HLF: Loaded 48417 primary data records. [2025-10-08T22:39:17.593585] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:17.594498] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18518 primary records. [2025-10-08T22:39:17.594787] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-08T22:39:17.626184] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-08T22:39:17.632482] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-08T22:39:17.635292] [INFO ] [MAIN ] Derivative Progress: 874/1771 symbols completed. HKD took 1.1s. Estimated remaining: 5m 48s. Rate: 154.8 symbols/min [2025-10-08T22:39:17.636049] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:17.636661] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:17.637929] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53672 primary records. [2025-10-08T22:39:17.638115] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-08T22:39:17.655628] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-08T22:39:17.656085] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-08T22:39:17.658138] [INFO ] [MAIN ] Derivative Progress: 875/1771 symbols completed. HL took 1.1s. Estimated remaining: 5m 47s. Rate: 155.0 symbols/min [2025-10-08T22:39:17.658451] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:17.674879] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:17.675787] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48417 primary records. [2025-10-08T22:39:17.675881] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-08T22:39:17.717041] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-08T22:39:17.717350] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-08T22:39:17.721044] [INFO ] [MAIN ] Derivative Progress: 876/1771 symbols completed. HLF took 1.1s. Estimated remaining: 5m 46s. Rate: 155.1 symbols/min [2025-10-08T22:39:17.718410] [DEBUG] [LOCAL ] HLI: Loaded 30808 existing records from primary storage. [2025-10-08T22:39:17.721414] [INFO ] [MAIN ] HLI: Loaded 30808 primary data records. [2025-10-08T22:39:17.721555] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:17.799308] [DEBUG] [LOCAL ] HLIO: Loaded 27907 existing records from primary storage. [2025-10-08T22:39:17.811346] [INFO ] [MAIN ] HLIO: Loaded 27907 primary data records. [2025-10-08T22:39:18.198888] [DEBUG] [LOCAL ] HLLY: Loaded 33454 existing records from primary storage. [2025-10-08T22:39:18.200080] [INFO ] [MAIN ] HLLY: Loaded 33454 primary data records. [2025-10-08T22:39:18.806934] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:18.808183] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30808 primary records. [2025-10-08T22:39:18.808429] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-08T22:39:18.830520] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-08T22:39:18.830778] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-08T22:39:18.832907] [INFO ] [MAIN ] Derivative Progress: 877/1771 symbols completed. HLI took 1.2s. Estimated remaining: 5m 47s. Rate: 154.8 symbols/min [2025-10-08T22:39:18.833062] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:18.847253] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:18.848404] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 27907 primary records. [2025-10-08T22:39:18.848755] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-08T22:39:18.879839] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:18.881818] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33454 primary records. [2025-10-08T22:39:18.882752] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-08T22:39:18.882843] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-08T22:39:18.884051] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-08T22:39:18.897194] [INFO ] [MAIN ] Derivative Progress: 878/1771 symbols completed. HLIO took 1.2s. Estimated remaining: 5m 46s. Rate: 154.9 symbols/min [2025-10-08T22:39:18.898146] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:18.917747] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-08T22:39:18.918049] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-08T22:39:18.920439] [INFO ] [MAIN ] Derivative Progress: 879/1771 symbols completed. HLLY took 1.2s. Estimated remaining: 5m 45s. Rate: 155.1 symbols/min [2025-10-08T22:39:18.920802] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:18.943969] [DEBUG] [LOCAL ] HLN: Loaded 53097 existing records from primary storage. [2025-10-08T22:39:18.944382] [INFO ] [MAIN ] HLN: Loaded 53097 primary data records. [2025-10-08T22:39:19.174012] [DEBUG] [LOCAL ] HLX: Loaded 47588 existing records from primary storage. [2025-10-08T22:39:19.174211] [INFO ] [MAIN ] HLX: Loaded 47588 primary data records. [2025-10-08T22:39:19.339755] [DEBUG] [LOCAL ] HLT: Loaded 50612 existing records from primary storage. [2025-10-08T22:39:19.365761] [INFO ] [MAIN ] HLT: Loaded 50612 primary data records. [2025-10-08T22:39:19.997347] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:19.998842] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53097 primary records. [2025-10-08T22:39:20.000441] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-08T22:39:20.027940] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-08T22:39:20.028182] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-08T22:39:20.030367] [INFO ] [MAIN ] Derivative Progress: 880/1771 symbols completed. HLN took 1.2s. Estimated remaining: 5m 45s. Rate: 154.8 symbols/min [2025-10-08T22:39:20.030697] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:20.063544] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:20.063180] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:20.064589] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50612 primary records. [2025-10-08T22:39:20.065357] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47588 primary records. [2025-10-08T22:39:20.065477] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-08T22:39:20.065609] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-08T22:39:20.106055] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-08T22:39:20.106768] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-08T22:39:20.109269] [INFO ] [MAIN ] Derivative Progress: 881/1771 symbols completed. HLT took 1.2s. Estimated remaining: 5m 45s. Rate: 154.9 symbols/min [2025-10-08T22:39:20.109887] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:20.112972] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-08T22:39:20.113113] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-08T22:39:20.115352] [INFO ] [MAIN ] Derivative Progress: 882/1771 symbols completed. HLX took 1.2s. Estimated remaining: 5m 44s. Rate: 155.1 symbols/min [2025-10-08T22:39:20.115697] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:20.133347] [DEBUG] [LOCAL ] HMC: Loaded 46543 existing records from primary storage. [2025-10-08T22:39:20.133501] [INFO ] [MAIN ] HMC: Loaded 46543 primary data records. [2025-10-08T22:39:20.268586] [DEBUG] [LOCAL ] HMN: Loaded 23391 existing records from primary storage. [2025-10-08T22:39:20.279207] [INFO ] [MAIN ] HMN: Loaded 23391 primary data records. [2025-10-08T22:39:20.614929] [DEBUG] [LOCAL ] HMY: Loaded 53135 existing records from primary storage. [2025-10-08T22:39:20.639249] [INFO ] [MAIN ] HMY: Loaded 53135 primary data records. [2025-10-08T22:39:21.178898] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:21.180391] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46543 primary records. [2025-10-08T22:39:21.181058] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-08T22:39:21.217526] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:21.219220] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23391 primary records. [2025-10-08T22:39:21.219419] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-08T22:39:21.221345] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-08T22:39:21.221751] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-08T22:39:21.223748] [INFO ] [MAIN ] Derivative Progress: 883/1771 symbols completed. HMC took 1.2s. Estimated remaining: 5m 44s. Rate: 154.8 symbols/min [2025-10-08T22:39:21.239383] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-08T22:39:21.239456] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-08T22:39:21.241606] [INFO ] [MAIN ] Derivative Progress: 884/1771 symbols completed. HMN took 1.1s. Estimated remaining: 5m 44s. Rate: 154.9 symbols/min [2025-10-08T22:39:21.256305] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:21.256876] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53135 primary records. [2025-10-08T22:39:21.256937] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-08T22:39:21.272427] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-08T22:39:21.272485] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-08T22:39:21.274902] [INFO ] [MAIN ] Derivative Progress: 885/1771 symbols completed. HMY took 1.2s. Estimated remaining: 5m 43s. Rate: 155.1 symbols/min [2025-10-08T22:39:21.275257] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:21.275398] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:21.275730] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:21.336422] [DEBUG] [LOCAL ] HNI: Loaded 29303 existing records from primary storage. [2025-10-08T22:39:21.336792] [INFO ] [MAIN ] HNI: Loaded 29303 primary data records. [2025-10-08T22:39:21.372280] [DEBUG] [LOCAL ] HOG: Loaded 51002 existing records from primary storage. [2025-10-08T22:39:21.394915] [INFO ] [MAIN ] HOG: Loaded 51002 primary data records. [2025-10-08T22:39:21.518500] [DEBUG] [LOCAL ] HOMB: Loaded 43436 existing records from primary storage. [2025-10-08T22:39:21.551441] [INFO ] [MAIN ] HOMB: Loaded 43436 primary data records. [2025-10-08T22:39:22.278855] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:22.279908] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29303 primary records. [2025-10-08T22:39:22.280104] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-08T22:39:22.326009] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-08T22:39:22.326394] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:22.325896] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:22.327190] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43436 primary records. [2025-10-08T22:39:22.327887] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51002 primary records. [2025-10-08T22:39:22.326450] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-08T22:39:22.328090] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-08T22:39:22.328011] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-08T22:39:22.331445] [INFO ] [MAIN ] Derivative Progress: 886/1771 symbols completed. HNI took 1.1s. Estimated remaining: 5m 43s. Rate: 154.8 symbols/min [2025-10-08T22:39:22.349898] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:22.363530] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-08T22:39:22.363615] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-08T22:39:22.362860] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-08T22:39:22.366785] [INFO ] [MAIN ] Derivative Progress: 887/1771 symbols completed. HOMB took 1.1s. Estimated remaining: 5m 42s. Rate: 154.9 symbols/min [2025-10-08T22:39:22.367011] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-08T22:39:22.367116] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:22.369818] [INFO ] [MAIN ] Derivative Progress: 888/1771 symbols completed. HOG took 1.1s. Estimated remaining: 5m 42s. Rate: 155.1 symbols/min [2025-10-08T22:39:22.370739] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:22.387430] [DEBUG] [LOCAL ] HOV: Loaded 13912 existing records from primary storage. [2025-10-08T22:39:22.387638] [INFO ] [MAIN ] HOV: Loaded 13912 primary data records. [2025-10-08T22:39:22.552413] [DEBUG] [LOCAL ] HOUS: Loaded 44857 existing records from primary storage. [2025-10-08T22:39:22.568672] [INFO ] [MAIN ] HOUS: Loaded 44857 primary data records. [2025-10-08T22:39:22.893144] [DEBUG] [LOCAL ] HP: Loaded 51643 existing records from primary storage. [2025-10-08T22:39:22.922361] [INFO ] [MAIN ] HP: Loaded 51643 primary data records. [2025-10-08T22:39:23.393926] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:23.395888] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13912 primary records. [2025-10-08T22:39:23.396012] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-08T22:39:23.426816] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:23.428717] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 44857 primary records. [2025-10-08T22:39:23.428992] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-08T22:39:23.430352] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-10-08T22:39:23.430550] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-08T22:39:23.433677] [INFO ] [MAIN ] Derivative Progress: 889/1771 symbols completed. HOV took 1.1s. Estimated remaining: 5m 42s. Rate: 154.8 symbols/min [2025-10-08T22:39:23.434193] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:23.452669] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-08T22:39:23.453077] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-08T22:39:23.455025] [INFO ] [MAIN ] Derivative Progress: 890/1771 symbols completed. HOUS took 1.1s. Estimated remaining: 5m 41s. Rate: 155.0 symbols/min [2025-10-08T22:39:23.455318] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:23.468586] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:23.469380] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51643 primary records. [2025-10-08T22:39:23.469577] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-08T22:39:23.489418] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-08T22:39:23.489560] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-08T22:39:23.491713] [INFO ] [MAIN ] Derivative Progress: 891/1771 symbols completed. HP took 1.1s. Estimated remaining: 5m 40s. Rate: 155.1 symbols/min [2025-10-08T22:39:23.491942] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:23.496232] [DEBUG] [LOCAL ] HPF: Loaded 7485 existing records from primary storage. [2025-10-08T22:39:23.496323] [INFO ] [MAIN ] HPF: Loaded 7485 primary data records. [2025-10-08T22:39:23.646133] [DEBUG] [LOCAL ] HPI: Loaded 10608 existing records from primary storage. [2025-10-08T22:39:23.648394] [INFO ] [MAIN ] HPI: Loaded 10608 primary data records. [2025-10-08T22:39:23.758411] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-08T22:39:23.824864] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-08T22:39:24.634089] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:24.635175] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7485 primary records. [2025-10-08T22:39:24.635517] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-08T22:39:24.672170] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:24.685139] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10608 primary records. [2025-10-08T22:39:24.685271] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-08T22:39:24.685892] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-08T22:39:24.685825] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-08T22:39:24.688227] [INFO ] [MAIN ] Derivative Progress: 892/1771 symbols completed. HPF took 1.2s. Estimated remaining: 5m 41s. Rate: 154.8 symbols/min [2025-10-08T22:39:24.688699] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:24.689678] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:24.689517] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-08T22:39:24.690343] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-08T22:39:24.710628] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-08T22:39:24.710824] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-08T22:39:24.720493] [INFO ] [MAIN ] Derivative Progress: 893/1771 symbols completed. HPI took 1.2s. Estimated remaining: 5m 40s. Rate: 154.9 symbols/min [2025-10-08T22:39:24.720697] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:24.732562] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-08T22:39:24.733166] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-08T22:39:24.735270] [INFO ] [MAIN ] Derivative Progress: 894/1771 symbols completed. HPE took 1.3s. Estimated remaining: 5m 39s. Rate: 155.1 symbols/min [2025-10-08T22:39:24.735714] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:24.761873] [DEBUG] [LOCAL ] HPS: Loaded 10270 existing records from primary storage. [2025-10-08T22:39:24.762027] [INFO ] [MAIN ] HPS: Loaded 10270 primary data records. [2025-10-08T22:39:24.908347] [DEBUG] [LOCAL ] HPP: Loaded 51041 existing records from primary storage. [2025-10-08T22:39:24.984949] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-08T22:39:24.959840] [INFO ] [MAIN ] HPP: Loaded 51041 primary data records. [2025-10-08T22:39:24.989786] [INFO ] [MAIN ] HPQ: Loaded 53668 primary data records. [2025-10-08T22:39:25.749823] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:25.751385] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10270 primary records. [2025-10-08T22:39:25.751692] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-08T22:39:25.776412] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:25.781184] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51041 primary records. [2025-10-08T22:39:25.784730] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-08T22:39:25.786304] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-08T22:39:25.788347] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-08T22:39:25.790425] [INFO ] [MAIN ] Derivative Progress: 895/1771 symbols completed. HPS took 1.1s. Estimated remaining: 5m 40s. Rate: 154.8 symbols/min [2025-10-08T22:39:25.790911] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:25.816524] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:25.818166] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53668 primary records. [2025-10-08T22:39:25.818441] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-08T22:39:25.834354] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-08T22:39:25.834928] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-08T22:39:25.837362] [INFO ] [MAIN ] Derivative Progress: 896/1771 symbols completed. HPP took 1.1s. Estimated remaining: 5m 39s. Rate: 155.0 symbols/min [2025-10-08T22:39:25.837523] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:25.848425] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-08T22:39:25.848695] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-08T22:39:25.850909] [INFO ] [MAIN ] Derivative Progress: 897/1771 symbols completed. HPQ took 1.1s. Estimated remaining: 5m 38s. Rate: 155.1 symbols/min [2025-10-08T22:39:25.851129] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:25.861171] [DEBUG] [LOCAL ] HQH: Loaded 25511 existing records from primary storage. [2025-10-08T22:39:25.864754] [INFO ] [MAIN ] HQH: Loaded 25511 primary data records. [2025-10-08T22:39:25.982158] [DEBUG] [LOCAL ] HQL: Loaded 16673 existing records from primary storage. [2025-10-08T22:39:25.991512] [INFO ] [MAIN ] HQL: Loaded 16673 primary data records. [2025-10-08T22:39:26.538240] [DEBUG] [LOCAL ] HR: Loaded 51997 existing records from primary storage. [2025-10-08T22:39:26.538472] [INFO ] [MAIN ] HR: Loaded 51997 primary data records. [2025-10-08T22:39:26.923849] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:26.925136] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25511 primary records. [2025-10-08T22:39:26.925248] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-08T22:39:26.944251] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-08T22:39:26.944468] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-08T22:39:26.947296] [INFO ] [MAIN ] Derivative Progress: 898/1771 symbols completed. HQH took 1.2s. Estimated remaining: 5m 38s. Rate: 154.8 symbols/min [2025-10-08T22:39:26.962826] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:26.963513] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16673 primary records. [2025-10-08T22:39:26.963694] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-08T22:39:26.980429] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-08T22:39:26.980528] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-08T22:39:26.982787] [INFO ] [MAIN ] Derivative Progress: 899/1771 symbols completed. HQL took 1.1s. Estimated remaining: 5m 38s. Rate: 155.0 symbols/min [2025-10-08T22:39:26.998212] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:26.998803] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51997 primary records. [2025-10-08T22:39:26.998869] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-08T22:39:27.015434] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-08T22:39:27.015536] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-08T22:39:27.017858] [INFO ] [MAIN ] Derivative Progress: 900/1771 symbols completed. HR took 1.2s. Estimated remaining: 5m 37s. Rate: 155.1 symbols/min [2025-10-08T22:39:27.018365] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:27.018954] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:27.018472] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:27.080105] [DEBUG] [LOCAL ] HRB: Loaded 48391 existing records from primary storage. [2025-10-08T22:39:27.093682] [INFO ] [MAIN ] HRB: Loaded 48391 primary data records. [2025-10-08T22:39:27.148083] [DEBUG] [LOCAL ] HRI: Loaded 32605 existing records from primary storage. [2025-10-08T22:39:27.170638] [INFO ] [MAIN ] HRI: Loaded 32605 primary data records. [2025-10-08T22:39:27.263969] [DEBUG] [LOCAL ] HRL: Loaded 53097 existing records from primary storage. [2025-10-08T22:39:27.295293] [INFO ] [MAIN ] HRL: Loaded 53097 primary data records. [2025-10-08T22:39:28.100361] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:28.105898] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:28.107222] [INFO ] [MAIN ] HRI: Generated 1793 derivative records from 32605 primary records. [2025-10-08T22:39:28.109119] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48391 primary records. [2025-10-08T22:39:28.108335] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-08T22:39:28.111658] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-08T22:39:28.153449] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:28.155186] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53097 primary records. [2025-10-08T22:39:28.156829] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-08T22:39:28.171667] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-08T22:39:28.171969] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-08T22:39:28.174126] [INFO ] [MAIN ] Derivative Progress: 901/1771 symbols completed. HRB took 1.2s. Estimated remaining: 5m 37s. Rate: 154.8 symbols/min [2025-10-08T22:39:28.174755] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:28.179964] [DEBUG] [LOCAL ] HRI: Derivative data saved (1793 records). [2025-10-08T22:39:28.181078] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-08T22:39:28.183411] [INFO ] [MAIN ] Derivative Progress: 902/1771 symbols completed. HRI took 1.2s. Estimated remaining: 5m 37s. Rate: 154.9 symbols/min [2025-10-08T22:39:28.184032] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-08T22:39:28.184293] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-08T22:39:28.184434] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:28.187558] [INFO ] [MAIN ] Derivative Progress: 903/1771 symbols completed. HRL took 1.2s. Estimated remaining: 5m 36s. Rate: 155.1 symbols/min [2025-10-08T22:39:28.188176] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:28.207804] [DEBUG] [LOCAL ] HSHP: Loaded 15044 existing records from primary storage. [2025-10-08T22:39:28.207939] [INFO ] [MAIN ] HSHP: Loaded 15044 primary data records. [2025-10-08T22:39:28.324471] [DEBUG] [LOCAL ] HRTG: Loaded 33817 existing records from primary storage. [2025-10-08T22:39:28.358955] [INFO ] [MAIN ] HRTG: Loaded 33817 primary data records. [2025-10-08T22:39:28.674438] [DEBUG] [LOCAL ] HSBC: Loaded 50946 existing records from primary storage. [2025-10-08T22:39:28.685723] [INFO ] [MAIN ] HSBC: Loaded 50946 primary data records. [2025-10-08T22:39:29.243951] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:29.247274] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15044 primary records. [2025-10-08T22:39:29.248184] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-08T22:39:29.281729] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:29.284203] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 33817 primary records. [2025-10-08T22:39:29.284586] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-08T22:39:29.310931] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-08T22:39:29.311338] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-08T22:39:29.316922] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:29.320920] [INFO ] [MAIN ] Derivative Progress: 904/1771 symbols completed. HRTG took 1.1s. Estimated remaining: 5m 36s. Rate: 154.8 symbols/min [2025-10-08T22:39:29.322519] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50946 primary records. [2025-10-08T22:39:29.322716] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-08T22:39:29.322851] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-08T22:39:29.323955] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:29.324030] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-08T22:39:29.338578] [INFO ] [MAIN ] Derivative Progress: 905/1771 symbols completed. HSHP took 1.2s. Estimated remaining: 5m 35s. Rate: 154.9 symbols/min [2025-10-08T22:39:29.339355] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:29.345792] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-08T22:39:29.350199] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-08T22:39:29.352582] [INFO ] [MAIN ] Derivative Progress: 906/1771 symbols completed. HSBC took 1.2s. Estimated remaining: 5m 35s. Rate: 155.1 symbols/min [2025-10-08T22:39:29.352836] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:29.360358] [DEBUG] [LOCAL ] HTD: Loaded 13925 existing records from primary storage. [2025-10-08T22:39:29.360514] [INFO ] [MAIN ] HTD: Loaded 13925 primary data records. [2025-10-08T22:39:29.699458] [DEBUG] [LOCAL ] HSY: Loaded 50345 existing records from primary storage. [2025-10-08T22:39:29.699933] [INFO ] [MAIN ] HSY: Loaded 50345 primary data records. [2025-10-08T22:39:29.773356] [DEBUG] [LOCAL ] HTGC: Loaded 47466 existing records from primary storage. [2025-10-08T22:39:29.799857] [INFO ] [MAIN ] HTGC: Loaded 47466 primary data records. [2025-10-08T22:39:30.372067] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:30.374412] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13925 primary records. [2025-10-08T22:39:30.374531] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-08T22:39:30.403397] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-08T22:39:30.404886] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-08T22:39:30.408017] [INFO ] [MAIN ] Derivative Progress: 907/1771 symbols completed. HTD took 1.1s. Estimated remaining: 5m 35s. Rate: 154.8 symbols/min [2025-10-08T22:39:30.408378] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:30.430214] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:30.431952] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50345 primary records. [2025-10-08T22:39:30.432169] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-08T22:39:30.468696] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:30.479909] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47466 primary records. [2025-10-08T22:39:30.480080] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-08T22:39:30.481274] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-08T22:39:30.482340] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-08T22:39:30.497494] [INFO ] [MAIN ] Derivative Progress: 908/1771 symbols completed. HSY took 1.2s. Estimated remaining: 5m 34s. Rate: 154.9 symbols/min [2025-10-08T22:39:30.507582] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:30.510362] [DEBUG] [LOCAL ] HTH: Loaded 32417 existing records from primary storage. [2025-10-08T22:39:30.514485] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-08T22:39:30.514861] [INFO ] [MAIN ] HTH: Loaded 32417 primary data records. [2025-10-08T22:39:30.515096] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-08T22:39:30.522539] [INFO ] [MAIN ] Derivative Progress: 909/1771 symbols completed. HTGC took 1.2s. Estimated remaining: 5m 33s. Rate: 155.1 symbols/min [2025-10-08T22:39:30.531045] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:30.923166] [DEBUG] [LOCAL ] HUBS: Loaded 39673 existing records from primary storage. [2025-10-08T22:39:30.925933] [INFO ] [MAIN ] HUBS: Loaded 39673 primary data records. [2025-10-08T22:39:30.926264] [DEBUG] [LOCAL ] HUBB: Loaded 36591 existing records from primary storage. [2025-10-08T22:39:30.958906] [INFO ] [MAIN ] HUBB: Loaded 36591 primary data records. [2025-10-08T22:39:31.499418] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:31.580009] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32417 primary records. [2025-10-08T22:39:31.581345] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-08T22:39:31.610896] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-08T22:39:31.611371] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-08T22:39:31.613558] [INFO ] [MAIN ] Derivative Progress: 910/1771 symbols completed. HTH took 1.2s. Estimated remaining: 5m 34s. Rate: 154.8 symbols/min [2025-10-08T22:39:31.613871] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:31.627767] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:31.629530] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39673 primary records. [2025-10-08T22:39:31.629806] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-08T22:39:31.663681] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:31.663359] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-10-08T22:39:31.664495] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36591 primary records. [2025-10-08T22:39:31.664552] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-08T22:39:31.666871] [INFO ] [MAIN ] Derivative Progress: 911/1771 symbols completed. HUBS took 1.1s. Estimated remaining: 5m 33s. Rate: 154.9 symbols/min [2025-10-08T22:39:31.667240] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-08T22:39:31.667108] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:31.695169] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-08T22:39:31.695330] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-08T22:39:31.697514] [INFO ] [MAIN ] Derivative Progress: 912/1771 symbols completed. HUBB took 1.2s. Estimated remaining: 5m 32s. Rate: 155.1 symbols/min [2025-10-08T22:39:31.697832] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:31.716730] [DEBUG] [LOCAL ] HUM: Loaded 49032 existing records from primary storage. [2025-10-08T22:39:31.716966] [INFO ] [MAIN ] HUM: Loaded 49032 primary data records. [2025-10-08T22:39:32.064508] [DEBUG] [LOCAL ] HUYA: Loaded 43890 existing records from primary storage. [2025-10-08T22:39:32.064810] [INFO ] [MAIN ] HUYA: Loaded 43890 primary data records. [2025-10-08T22:39:32.065636] [DEBUG] [LOCAL ] HUN: Loaded 53202 existing records from primary storage. [2025-10-08T22:39:32.070964] [INFO ] [MAIN ] HUN: Loaded 53202 primary data records. [2025-10-08T22:39:32.735464] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:32.736554] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 49032 primary records. [2025-10-08T22:39:32.736712] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-08T22:39:32.756744] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-08T22:39:32.756855] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-08T22:39:32.759147] [INFO ] [MAIN ] Derivative Progress: 913/1771 symbols completed. HUM took 1.1s. Estimated remaining: 5m 33s. Rate: 154.8 symbols/min [2025-10-08T22:39:32.775625] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:32.777086] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43890 primary records. [2025-10-08T22:39:32.777823] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-08T22:39:32.802199] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:32.804892] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53202 primary records. [2025-10-08T22:39:32.805573] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-08T22:39:32.807354] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-08T22:39:32.807811] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-08T22:39:32.809958] [INFO ] [MAIN ] Derivative Progress: 914/1771 symbols completed. HUYA took 1.1s. Estimated remaining: 5m 32s. Rate: 155.0 symbols/min [2025-10-08T22:39:32.824956] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-08T22:39:32.825020] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-08T22:39:32.827178] [INFO ] [MAIN ] Derivative Progress: 915/1771 symbols completed. HUN took 1.2s. Estimated remaining: 5m 31s. Rate: 155.1 symbols/min [2025-10-08T22:39:32.827582] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:32.827701] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:32.827769] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:32.846272] [DEBUG] [LOCAL ] HVT: Loaded 15297 existing records from primary storage. [2025-10-08T22:39:32.851243] [INFO ] [MAIN ] HVT: Loaded 15297 primary data records. [2025-10-08T22:39:33.208405] [DEBUG] [LOCAL ] HXL: Loaded 45893 existing records from primary storage. [2025-10-08T22:39:33.216969] [INFO ] [MAIN ] HXL: Loaded 45893 primary data records. [2025-10-08T22:39:33.338824] [DEBUG] [LOCAL ] HWM: Loaded 52895 existing records from primary storage. [2025-10-08T22:39:33.365773] [INFO ] [MAIN ] HWM: Loaded 52895 primary data records. [2025-10-08T22:39:33.852288] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:33.854013] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 15297 primary records. [2025-10-08T22:39:33.854197] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-08T22:39:33.873778] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-08T22:39:33.875225] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-08T22:39:33.877565] [INFO ] [MAIN ] Derivative Progress: 916/1771 symbols completed. HVT took 1.0s. Estimated remaining: 5m 31s. Rate: 154.8 symbols/min [2025-10-08T22:39:33.877963] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:33.901355] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:33.902526] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45893 primary records. [2025-10-08T22:39:33.902700] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-08T22:39:33.934301] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:33.934552] [DEBUG] [LOCAL ] HY: Loaded 9989 existing records from primary storage. [2025-10-08T22:39:33.939674] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52895 primary records. [2025-10-08T22:39:33.939733] [INFO ] [MAIN ] HY: Loaded 9989 primary data records. [2025-10-08T22:39:33.953134] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-08T22:39:33.973957] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-08T22:39:33.974134] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-08T22:39:33.981852] [INFO ] [MAIN ] Derivative Progress: 917/1771 symbols completed. HXL took 1.2s. Estimated remaining: 5m 31s. Rate: 154.9 symbols/min [2025-10-08T22:39:33.982304] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:34.073992] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-08T22:39:34.085130] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-08T22:39:34.123559] [INFO ] [MAIN ] Derivative Progress: 918/1771 symbols completed. HWM took 1.3s. Estimated remaining: 5m 30s. Rate: 155.1 symbols/min [2025-10-08T22:39:34.132207] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:34.142538] [DEBUG] [LOCAL ] HYI: Loaded 9914 existing records from primary storage. [2025-10-08T22:39:34.167422] [INFO ] [MAIN ] HYI: Loaded 9914 primary data records. [2025-10-08T22:39:34.326597] [DEBUG] [LOCAL ] HYTR: Loaded 3113 existing records from primary storage. [2025-10-08T22:39:34.339831] [INFO ] [MAIN ] HYTR: Loaded 3113 primary data records. [2025-10-08T22:39:34.976880] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:34.978087] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9989 primary records. [2025-10-08T22:39:34.978451] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-08T22:39:35.001864] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-08T22:39:35.014990] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-08T22:39:35.017414] [INFO ] [MAIN ] Derivative Progress: 919/1771 symbols completed. HY took 1.1s. Estimated remaining: 5m 30s. Rate: 154.8 symbols/min [2025-10-08T22:39:35.017919] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:35.017784] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:35.019294] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9914 primary records. [2025-10-08T22:39:35.026691] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-08T22:39:35.031997] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:35.033399] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3113 primary records. [2025-10-08T22:39:35.042047] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-08T22:39:35.071453] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-08T22:39:35.071375] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-08T22:39:35.071672] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-08T22:39:35.071609] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-08T22:39:35.073751] [INFO ] [MAIN ] Derivative Progress: 920/1771 symbols completed. HYI took 1.1s. Estimated remaining: 5m 29s. Rate: 155.0 symbols/min [2025-10-08T22:39:35.076772] [INFO ] [MAIN ] Derivative Progress: 921/1771 symbols completed. HYTR took 0.9s. Estimated remaining: 5m 29s. Rate: 155.1 symbols/min [2025-10-08T22:39:35.076558] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:35.076966] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:35.090722] [DEBUG] [LOCAL ] HZO: Loaded 29050 existing records from primary storage. [2025-10-08T22:39:35.092292] [INFO ] [MAIN ] HZO: Loaded 29050 primary data records. [2025-10-08T22:39:35.134464] [DEBUG] [LOCAL ] IAE: Loaded 6125 existing records from primary storage. [2025-10-08T22:39:35.170274] [INFO ] [MAIN ] IAE: Loaded 6125 primary data records. [2025-10-08T22:39:35.598129] [DEBUG] [LOCAL ] IAG: Loaded 53473 existing records from primary storage. [2025-10-08T22:39:35.629777] [INFO ] [MAIN ] IAG: Loaded 53473 primary data records. [2025-10-08T22:39:36.067373] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:36.070108] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29050 primary records. [2025-10-08T22:39:36.070529] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-08T22:39:36.084366] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:36.097578] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6125 primary records. [2025-10-08T22:39:36.098279] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-08T22:39:36.116193] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-08T22:39:36.116386] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-08T22:39:36.119087] [INFO ] [MAIN ] Derivative Progress: 922/1771 symbols completed. IAE took 1.0s. Estimated remaining: 5m 29s. Rate: 154.9 symbols/min [2025-10-08T22:39:36.119409] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:36.121414] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-08T22:39:36.121528] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-08T22:39:36.124037] [INFO ] [MAIN ] Derivative Progress: 923/1771 symbols completed. HZO took 1.1s. Estimated remaining: 5m 28s. Rate: 155.0 symbols/min [2025-10-08T22:39:36.124286] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:36.141148] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:36.141950] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53473 primary records. [2025-10-08T22:39:36.142152] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-08T22:39:36.159514] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-08T22:39:36.159811] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-08T22:39:36.162304] [INFO ] [MAIN ] Derivative Progress: 924/1771 symbols completed. IAG took 1.1s. Estimated remaining: 5m 27s. Rate: 155.2 symbols/min [2025-10-08T22:39:36.162498] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:36.237087] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-08T22:39:36.237853] [DEBUG] [LOCAL ] IBN: Loaded 52860 existing records from primary storage. [2025-10-08T22:39:36.246953] [INFO ] [MAIN ] IBM: Loaded 53631 primary data records. [2025-10-08T22:39:36.247098] [INFO ] [MAIN ] IBN: Loaded 52860 primary data records. [2025-10-08T22:39:36.259501] [DEBUG] [LOCAL ] IBP: Loaded 28771 existing records from primary storage. [2025-10-08T22:39:36.269930] [INFO ] [MAIN ] IBP: Loaded 28771 primary data records. [2025-10-08T22:39:37.253664] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:37.256324] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28771 primary records. [2025-10-08T22:39:37.269146] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-08T22:39:37.284056] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:37.283977] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:37.292604] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53631 primary records. [2025-10-08T22:39:37.293844] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-08T22:39:37.294679] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52860 primary records. [2025-10-08T22:39:37.297773] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-08T22:39:37.324098] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-08T22:39:37.329510] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-08T22:39:37.335868] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-08T22:39:37.336009] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-08T22:39:37.335209] [INFO ] [MAIN ] Derivative Progress: 925/1771 symbols completed. IBP took 1.2s. Estimated remaining: 5m 28s. Rate: 154.8 symbols/min [2025-10-08T22:39:37.340789] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:37.341344] [INFO ] [MAIN ] Derivative Progress: 926/1771 symbols completed. IBM took 1.2s. Estimated remaining: 5m 27s. Rate: 155.0 symbols/min [2025-10-08T22:39:37.342477] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:37.345901] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-08T22:39:37.346100] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-08T22:39:37.348369] [INFO ] [MAIN ] Derivative Progress: 927/1771 symbols completed. IBN took 1.2s. Estimated remaining: 5m 26s. Rate: 155.2 symbols/min [2025-10-08T22:39:37.348749] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:37.420348] [DEBUG] [LOCAL ] IBTA: Loaded 37145 existing records from primary storage. [2025-10-08T22:39:37.420674] [INFO ] [MAIN ] IBTA: Loaded 37145 primary data records. [2025-10-08T22:39:37.489639] [DEBUG] [LOCAL ] ICL: Loaded 38375 existing records from primary storage. [2025-10-08T22:39:37.510812] [INFO ] [MAIN ] ICL: Loaded 38375 primary data records. [2025-10-08T22:39:37.619892] [DEBUG] [LOCAL ] ICE: Loaded 53012 existing records from primary storage. [2025-10-08T22:39:37.656989] [INFO ] [MAIN ] ICE: Loaded 53012 primary data records. [2025-10-08T22:39:38.367592] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:38.370470] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 37145 primary records. [2025-10-08T22:39:38.371630] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-08T22:39:38.396098] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:38.401397] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38375 primary records. [2025-10-08T22:39:38.402911] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-08T22:39:38.403918] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-08T22:39:38.404352] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-08T22:39:38.414217] [INFO ] [MAIN ] Derivative Progress: 928/1771 symbols completed. IBTA took 1.1s. Estimated remaining: 5m 27s. Rate: 154.9 symbols/min [2025-10-08T22:39:38.420196] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:38.427553] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53012 primary records. [2025-10-08T22:39:38.428619] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-08T22:39:38.446681] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-08T22:39:38.450842] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-08T22:39:38.449938] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-08T22:39:38.453048] [INFO ] [MAIN ] Derivative Progress: 929/1771 symbols completed. ICL took 1.1s. Estimated remaining: 5m 26s. Rate: 155.0 symbols/min [2025-10-08T22:39:38.453135] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-08T22:39:38.455350] [INFO ] [MAIN ] Derivative Progress: 930/1771 symbols completed. ICE took 1.1s. Estimated remaining: 5m 25s. Rate: 155.2 symbols/min [2025-10-08T22:39:38.455789] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:38.455886] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:38.455982] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:38.468418] [DEBUG] [LOCAL ] IDE: Loaded 8882 existing records from primary storage. [2025-10-08T22:39:38.468550] [INFO ] [MAIN ] IDE: Loaded 8882 primary data records. [2025-10-08T22:39:38.565101] [DEBUG] [LOCAL ] IDT: Loaded 18163 existing records from primary storage. [2025-10-08T22:39:38.583983] [INFO ] [MAIN ] IDT: Loaded 18163 primary data records. [2025-10-08T22:39:38.942860] [DEBUG] [LOCAL ] IDA: Loaded 32579 existing records from primary storage. [2025-10-08T22:39:38.967546] [INFO ] [MAIN ] IDA: Loaded 32579 primary data records. [2025-10-08T22:39:39.492192] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:39.493525] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8882 primary records. [2025-10-08T22:39:39.493747] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-08T22:39:39.515853] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-08T22:39:39.516304] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-08T22:39:39.518411] [INFO ] [MAIN ] Derivative Progress: 931/1771 symbols completed. IDE took 1.1s. Estimated remaining: 5m 25s. Rate: 154.9 symbols/min [2025-10-08T22:39:39.518697] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:39.533610] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:39.535039] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18163 primary records. [2025-10-08T22:39:39.535172] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-08T22:39:39.554957] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-08T22:39:39.555167] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-08T22:39:39.557326] [INFO ] [MAIN ] Derivative Progress: 932/1771 symbols completed. IDT took 1.1s. Estimated remaining: 5m 25s. Rate: 155.0 symbols/min [2025-10-08T22:39:39.557632] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:39.570767] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:39.571992] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32579 primary records. [2025-10-08T22:39:39.572224] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-08T22:39:39.598068] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-08T22:39:39.598311] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-08T22:39:39.601111] [INFO ] [MAIN ] Derivative Progress: 933/1771 symbols completed. IDA took 1.1s. Estimated remaining: 5m 24s. Rate: 155.2 symbols/min [2025-10-08T22:39:39.601554] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:39.617908] [DEBUG] [LOCAL ] IEX: Loaded 38329 existing records from primary storage. [2025-10-08T22:39:39.618172] [INFO ] [MAIN ] IEX: Loaded 38329 primary data records. [2025-10-08T22:39:39.750760] [DEBUG] [LOCAL ] IFN: Loaded 18362 existing records from primary storage. [2025-10-08T22:39:39.751288] [INFO ] [MAIN ] IFN: Loaded 18362 primary data records. [2025-10-08T22:39:40.054036] [DEBUG] [LOCAL ] IFF: Loaded 51052 existing records from primary storage. [2025-10-08T22:39:40.073242] [INFO ] [MAIN ] IFF: Loaded 51052 primary data records. [2025-10-08T22:39:40.596081] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:40.609685] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38329 primary records. [2025-10-08T22:39:40.610830] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:40.611837] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18362 primary records. [2025-10-08T22:39:40.612122] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-08T22:39:40.610499] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-08T22:39:40.639361] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-08T22:39:40.639516] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-08T22:39:40.651291] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-08T22:39:40.642389] [INFO ] [MAIN ] Derivative Progress: 934/1771 symbols completed. IFN took 1.0s. Estimated remaining: 5m 24s. Rate: 154.9 symbols/min [2025-10-08T22:39:40.651721] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-08T22:39:40.654209] [INFO ] [MAIN ] Derivative Progress: 935/1771 symbols completed. IEX took 1.1s. Estimated remaining: 5m 23s. Rate: 155.1 symbols/min [2025-10-08T22:39:40.654150] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:40.667520] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:40.666885] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:40.668388] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51052 primary records. [2025-10-08T22:39:40.668488] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-08T22:39:40.686101] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-08T22:39:40.688352] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-08T22:39:40.690470] [INFO ] [MAIN ] Derivative Progress: 936/1771 symbols completed. IFF took 1.1s. Estimated remaining: 5m 23s. Rate: 155.2 symbols/min [2025-10-08T22:39:40.690853] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:40.702193] [DEBUG] [LOCAL ] IGA: Loaded 10005 existing records from primary storage. [2025-10-08T22:39:40.702348] [INFO ] [MAIN ] IGA: Loaded 10005 primary data records. [2025-10-08T22:39:40.782389] [DEBUG] [LOCAL ] IFS: Loaded 22937 existing records from primary storage. [2025-10-08T22:39:40.804718] [INFO ] [MAIN ] IFS: Loaded 22937 primary data records. [2025-10-08T22:39:40.907327] [DEBUG] [LOCAL ] IGD: Loaded 19218 existing records from primary storage. [2025-10-08T22:39:40.949160] [INFO ] [MAIN ] IGD: Loaded 19218 primary data records. [2025-10-08T22:39:41.743464] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:41.743119] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:41.745239] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10005 primary records. [2025-10-08T22:39:41.744592] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22937 primary records. [2025-10-08T22:39:41.745549] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-08T22:39:41.745605] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-08T22:39:41.773386] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-08T22:39:41.773717] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-08T22:39:41.775674] [INFO ] [MAIN ] Derivative Progress: 937/1771 symbols completed. IGA took 1.1s. Estimated remaining: 5m 23s. Rate: 154.9 symbols/min [2025-10-08T22:39:41.775851] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:41.795772] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:41.797144] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19218 primary records. [2025-10-08T22:39:41.797544] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-08T22:39:41.801227] [DEBUG] [LOCAL ] IGI: Loaded 3787 existing records from primary storage. [2025-10-08T22:39:41.802459] [INFO ] [MAIN ] IGI: Loaded 3787 primary data records. [2025-10-08T22:39:41.802302] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-08T22:39:41.802668] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-08T22:39:41.815850] [INFO ] [MAIN ] Derivative Progress: 938/1771 symbols completed. IFS took 1.2s. Estimated remaining: 5m 22s. Rate: 155.1 symbols/min [2025-10-08T22:39:41.845978] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:41.901248] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-08T22:39:41.913987] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-08T22:39:41.927671] [INFO ] [MAIN ] Derivative Progress: 939/1771 symbols completed. IGD took 1.2s. Estimated remaining: 5m 22s. Rate: 155.2 symbols/min [2025-10-08T22:39:41.928215] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:42.137965] [DEBUG] [LOCAL ] IH: Loaded 2853 existing records from primary storage. [2025-10-08T22:39:42.147019] [INFO ] [MAIN ] IH: Loaded 2853 primary data records. [2025-10-08T22:39:42.185025] [DEBUG] [LOCAL ] IGR: Loaded 30399 existing records from primary storage. [2025-10-08T22:39:42.192687] [INFO ] [MAIN ] IGR: Loaded 30399 primary data records. [2025-10-08T22:39:42.816756] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:42.817859] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3787 primary records. [2025-10-08T22:39:42.818045] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-08T22:39:42.834166] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-08T22:39:42.834508] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-08T22:39:42.837314] [INFO ] [MAIN ] Derivative Progress: 940/1771 symbols completed. IGI took 1.1s. Estimated remaining: 5m 22s. Rate: 155.0 symbols/min [2025-10-08T22:39:42.838578] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:42.859554] [DEBUG] [LOCAL ] IHD: Loaded 7064 existing records from primary storage. [2025-10-08T22:39:42.866250] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:42.866368] [INFO ] [MAIN ] IHD: Loaded 7064 primary data records. [2025-10-08T22:39:42.880276] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2853 primary records. [2025-10-08T22:39:42.890275] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-08T22:39:42.977079] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:42.996702] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30399 primary records. [2025-10-08T22:39:43.011503] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-08T22:39:42.988187] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-08T22:39:43.011754] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-08T22:39:43.037994] [INFO ] [MAIN ] Derivative Progress: 941/1771 symbols completed. IH took 1.1s. Estimated remaining: 5m 21s. Rate: 155.0 symbols/min [2025-10-08T22:39:43.050024] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:43.234292] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-08T22:39:43.234727] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-08T22:39:43.237023] [INFO ] [MAIN ] Derivative Progress: 942/1771 symbols completed. IGR took 1.4s. Estimated remaining: 5m 21s. Rate: 155.1 symbols/min [2025-10-08T22:39:43.237912] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:43.258857] [DEBUG] [LOCAL ] IHG: Loaded 24221 existing records from primary storage. [2025-10-08T22:39:43.259195] [INFO ] [MAIN ] IHG: Loaded 24221 primary data records. [2025-10-08T22:39:43.466833] [DEBUG] [LOCAL ] IHS: Loaded 38329 existing records from primary storage. [2025-10-08T22:39:43.491719] [INFO ] [MAIN ] IHS: Loaded 38329 primary data records. [2025-10-08T22:39:43.491625] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:43.639734] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7064 primary records. [2025-10-08T22:39:43.652891] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-08T22:39:43.743164] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-08T22:39:43.781888] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-08T22:39:43.816470] [INFO ] [MAIN ] Derivative Progress: 943/1771 symbols completed. IHD took 1.0s. Estimated remaining: 5m 20s. Rate: 155.0 symbols/min [2025-10-08T22:39:43.951790] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:43.952665] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24221 primary records. [2025-10-08T22:39:43.952741] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-08T22:39:43.970403] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-08T22:39:43.970518] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-08T22:39:43.972499] [INFO ] [MAIN ] Derivative Progress: 944/1771 symbols completed. IHG took 0.9s. Estimated remaining: 5m 20s. Rate: 155.1 symbols/min [2025-10-08T22:39:43.988495] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:43.989114] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 38329 primary records. [2025-10-08T22:39:43.989175] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-08T22:39:44.003911] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-08T22:39:44.003979] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-08T22:39:44.006135] [INFO ] [MAIN ] Derivative Progress: 945/1771 symbols completed. IHS took 0.8s. Estimated remaining: 5m 19s. Rate: 155.3 symbols/min [2025-10-08T22:39:44.006668] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:44.006785] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:44.006888] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:44.016485] [DEBUG] [LOCAL ] IIF: Loaded 5659 existing records from primary storage. [2025-10-08T22:39:44.016868] [INFO ] [MAIN ] IIF: Loaded 5659 primary data records. [2025-10-08T22:39:44.135487] [DEBUG] [LOCAL ] IIIN: Loaded 16149 existing records from primary storage. [2025-10-08T22:39:44.141229] [INFO ] [MAIN ] IIIN: Loaded 16149 primary data records. [2025-10-08T22:39:44.205245] [DEBUG] [LOCAL ] IIM: Loaded 15846 existing records from primary storage. [2025-10-08T22:39:44.307769] [INFO ] [MAIN ] IIM: Loaded 15846 primary data records. [2025-10-08T22:39:45.007367] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:45.020145] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5659 primary records. [2025-10-08T22:39:45.020968] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:45.021839] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16149 primary records. [2025-10-08T22:39:45.021252] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-08T22:39:45.022021] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-08T22:39:45.055845] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-08T22:39:45.054609] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-08T22:39:45.056023] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-08T22:39:45.056242] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-08T22:39:45.058439] [INFO ] [MAIN ] Derivative Progress: 946/1771 symbols completed. IIF took 1.1s. Estimated remaining: 5m 19s. Rate: 155.0 symbols/min [2025-10-08T22:39:45.060795] [INFO ] [MAIN ] Derivative Progress: 947/1771 symbols completed. IIIN took 1.1s. Estimated remaining: 5m 19s. Rate: 155.2 symbols/min [2025-10-08T22:39:45.058627] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:45.060920] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:45.074531] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:45.075332] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15846 primary records. [2025-10-08T22:39:45.075895] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-08T22:39:45.094164] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-08T22:39:45.094372] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-08T22:39:45.096508] [INFO ] [MAIN ] Derivative Progress: 948/1771 symbols completed. IIM took 1.1s. Estimated remaining: 5m 18s. Rate: 155.3 symbols/min [2025-10-08T22:39:45.096946] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:45.126081] [DEBUG] [LOCAL ] IIPR: Loaded 29456 existing records from primary storage. [2025-10-08T22:39:45.126230] [INFO ] [MAIN ] IIPR: Loaded 29456 primary data records. [2025-10-08T22:39:45.242682] [DEBUG] [LOCAL ] IMAX: Loaded 42877 existing records from primary storage. [2025-10-08T22:39:45.243236] [INFO ] [MAIN ] IMAX: Loaded 42877 primary data records. [2025-10-08T22:39:45.567824] [DEBUG] [LOCAL ] INFA: Loaded 49319 existing records from primary storage. [2025-10-08T22:39:45.574759] [INFO ] [MAIN ] INFA: Loaded 49319 primary data records. [2025-10-08T22:39:46.077520] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:46.078711] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29456 primary records. [2025-10-08T22:39:46.078905] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-08T22:39:46.107356] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-08T22:39:46.112745] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:46.112451] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-08T22:39:46.113479] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42877 primary records. [2025-10-08T22:39:46.113573] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-08T22:39:46.116491] [INFO ] [MAIN ] Derivative Progress: 949/1771 symbols completed. IIPR took 1.1s. Estimated remaining: 5m 18s. Rate: 155.1 symbols/min [2025-10-08T22:39:46.116704] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:46.148299] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-08T22:39:46.147835] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:46.148439] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-08T22:39:46.149153] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 49319 primary records. [2025-10-08T22:39:46.151294] [INFO ] [MAIN ] Derivative Progress: 950/1771 symbols completed. IMAX took 1.1s. Estimated remaining: 5m 17s. Rate: 155.2 symbols/min [2025-10-08T22:39:46.151611] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:46.151369] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-08T22:39:46.168379] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-08T22:39:46.168515] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-08T22:39:46.171334] [INFO ] [MAIN ] Derivative Progress: 951/1771 symbols completed. INFA took 1.1s. Estimated remaining: 5m 17s. Rate: 155.4 symbols/min [2025-10-08T22:39:46.171757] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:46.224372] [DEBUG] [LOCAL ] INGM: Loaded 28664 existing records from primary storage. [2025-10-08T22:39:46.224564] [INFO ] [MAIN ] INGM: Loaded 28664 primary data records. [2025-10-08T22:39:46.358954] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-08T22:39:46.359671] [DEBUG] [LOCAL ] ING: Loaded 50706 existing records from primary storage. [2025-10-08T22:39:46.360119] [INFO ] [MAIN ] INFY: Loaded 53594 primary data records. [2025-10-08T22:39:46.365450] [INFO ] [MAIN ] ING: Loaded 50706 primary data records. [2025-10-08T22:39:47.200877] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:47.202113] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28664 primary records. [2025-10-08T22:39:47.202607] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-08T22:39:47.247262] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:47.249410] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:47.250249] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50706 primary records. [2025-10-08T22:39:47.248981] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53594 primary records. [2025-10-08T22:39:47.250972] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-08T22:39:47.251299] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-08T22:39:47.251381] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-08T22:39:47.252405] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-08T22:39:47.270557] [INFO ] [MAIN ] Derivative Progress: 952/1771 symbols completed. INGM took 1.1s. Estimated remaining: 5m 17s. Rate: 155.1 symbols/min [2025-10-08T22:39:47.278838] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:47.287702] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-08T22:39:47.288202] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-08T22:39:47.291223] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-08T22:39:47.291049] [INFO ] [MAIN ] Derivative Progress: 953/1771 symbols completed. ING took 1.1s. Estimated remaining: 5m 16s. Rate: 155.2 symbols/min [2025-10-08T22:39:47.291399] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:47.291591] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-08T22:39:47.293663] [INFO ] [MAIN ] Derivative Progress: 954/1771 symbols completed. INFY took 1.2s. Estimated remaining: 5m 15s. Rate: 155.4 symbols/min [2025-10-08T22:39:47.294129] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:47.324043] [DEBUG] [LOCAL ] INGR: Loaded 33594 existing records from primary storage. [2025-10-08T22:39:47.324217] [INFO ] [MAIN ] INGR: Loaded 33594 primary data records. [2025-10-08T22:39:47.492379] [DEBUG] [LOCAL ] INSP: Loaded 37638 existing records from primary storage. [2025-10-08T22:39:47.486232] [DEBUG] [LOCAL ] INN: Loaded 41765 existing records from primary storage. [2025-10-08T22:39:47.505429] [INFO ] [MAIN ] INSP: Loaded 37638 primary data records. [2025-10-08T22:39:47.538176] [INFO ] [MAIN ] INN: Loaded 41765 primary data records. [2025-10-08T22:39:48.274733] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:48.277221] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33594 primary records. [2025-10-08T22:39:48.278160] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-08T22:39:48.307512] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-08T22:39:48.320894] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-08T22:39:48.321546] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:48.324131] [INFO ] [MAIN ] Derivative Progress: 955/1771 symbols completed. INGR took 1.0s. Estimated remaining: 5m 16s. Rate: 155.1 symbols/min [2025-10-08T22:39:48.325152] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:48.325047] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 37638 primary records. [2025-10-08T22:39:48.333029] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-08T22:39:48.338859] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:48.339520] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41765 primary records. [2025-10-08T22:39:48.346825] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-08T22:39:48.370718] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-08T22:39:48.370990] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-08T22:39:48.373279] [INFO ] [MAIN ] Derivative Progress: 956/1771 symbols completed. INN took 1.1s. Estimated remaining: 5m 15s. Rate: 155.2 symbols/min [2025-10-08T22:39:48.373503] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:48.378785] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-08T22:39:48.378988] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-08T22:39:48.381629] [INFO ] [MAIN ] Derivative Progress: 957/1771 symbols completed. INSP took 1.1s. Estimated remaining: 5m 14s. Rate: 155.4 symbols/min [2025-10-08T22:39:48.381908] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:48.428927] [DEBUG] [LOCAL ] INSW: Loaded 39755 existing records from primary storage. [2025-10-08T22:39:48.437197] [INFO ] [MAIN ] INSW: Loaded 39755 primary data records. [2025-10-08T22:39:48.536426] [DEBUG] [LOCAL ] INVH: Loaded 53162 existing records from primary storage. [2025-10-08T22:39:48.535689] [DEBUG] [LOCAL ] INVX: Loaded 29189 existing records from primary storage. [2025-10-08T22:39:48.547192] [INFO ] [MAIN ] INVX: Loaded 29189 primary data records. [2025-10-08T22:39:48.547100] [INFO ] [MAIN ] INVH: Loaded 53162 primary data records. [2025-10-08T22:39:49.429766] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:49.430220] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:49.431343] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29189 primary records. [2025-10-08T22:39:49.431598] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-08T22:39:49.432511] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39755 primary records. [2025-10-08T22:39:49.432958] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-08T22:39:49.466754] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-08T22:39:49.467780] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-08T22:39:49.467690] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-08T22:39:49.467994] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-08T22:39:49.470322] [INFO ] [MAIN ] Derivative Progress: 958/1771 symbols completed. INVX took 1.1s. Estimated remaining: 5m 14s. Rate: 155.1 symbols/min [2025-10-08T22:39:49.486935] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:49.487949] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53162 primary records. [2025-10-08T22:39:49.488050] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-08T22:39:49.487141] [INFO ] [MAIN ] Derivative Progress: 959/1771 symbols completed. INSW took 1.2s. Estimated remaining: 5m 14s. Rate: 155.3 symbols/min [2025-10-08T22:39:49.504037] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-08T22:39:49.504101] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-08T22:39:49.506154] [INFO ] [MAIN ] Derivative Progress: 960/1771 symbols completed. INVH took 1.1s. Estimated remaining: 5m 13s. Rate: 155.4 symbols/min [2025-10-08T22:39:49.507014] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:49.506960] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:49.507139] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:49.618576] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-08T22:39:49.619466] [DEBUG] [LOCAL ] IP: Loaded 53317 existing records from primary storage. [2025-10-08T22:39:49.619715] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-08T22:39:49.619623] [INFO ] [MAIN ] IP: Loaded 53317 primary data records. [2025-10-08T22:39:49.733079] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-08T22:39:49.763054] [INFO ] [MAIN ] IOT: Loaded 53475 primary data records. [2025-10-08T22:39:50.638423] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:50.651219] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:50.653186] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53317 primary records. [2025-10-08T22:39:50.653917] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-08T22:39:50.653847] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-08T22:39:50.655327] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-08T22:39:50.696856] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-08T22:39:50.700119] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-08T22:39:50.701163] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-08T22:39:50.696476] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:50.703987] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53475 primary records. [2025-10-08T22:39:50.704132] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-08T22:39:50.703048] [INFO ] [MAIN ] Derivative Progress: 961/1771 symbols completed. IONQ took 1.2s. Estimated remaining: 5m 13s. Rate: 155.1 symbols/min [2025-10-08T22:39:50.706790] [INFO ] [MAIN ] Derivative Progress: 962/1771 symbols completed. IP took 1.2s. Estimated remaining: 5m 13s. Rate: 155.2 symbols/min [2025-10-08T22:39:50.704461] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-08T22:39:50.704323] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:50.707445] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:50.724365] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-08T22:39:50.724559] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-08T22:39:50.727559] [INFO ] [MAIN ] Derivative Progress: 963/1771 symbols completed. IOT took 1.2s. Estimated remaining: 5m 12s. Rate: 155.4 symbols/min [2025-10-08T22:39:50.727855] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:50.751568] [DEBUG] [LOCAL ] IPI: Loaded 21556 existing records from primary storage. [2025-10-08T22:39:50.751843] [INFO ] [MAIN ] IPI: Loaded 21556 primary data records. [2025-10-08T22:39:50.813091] [DEBUG] [LOCAL ] IQI: Loaded 17978 existing records from primary storage. [2025-10-08T22:39:50.869812] [INFO ] [MAIN ] IQI: Loaded 17978 primary data records. [2025-10-08T22:39:51.050134] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-08T22:39:51.166889] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-08T22:39:51.738730] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:51.739791] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21556 primary records. [2025-10-08T22:39:51.740047] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-08T22:39:51.778862] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-08T22:39:51.779272] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:51.780549] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-08T22:39:51.781493] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17978 primary records. [2025-10-08T22:39:51.783571] [INFO ] [MAIN ] Derivative Progress: 964/1771 symbols completed. IPI took 1.1s. Estimated remaining: 5m 12s. Rate: 155.1 symbols/min [2025-10-08T22:39:51.786213] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:51.783800] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-08T22:39:51.818924] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:51.822572] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-08T22:39:51.824468] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-08T22:39:51.827166] [INFO ] [MAIN ] Derivative Progress: 965/1771 symbols completed. IQI took 1.1s. Estimated remaining: 5m 11s. Rate: 155.3 symbols/min [2025-10-08T22:39:51.824116] [INFO ] [MAIN ] IPG: Generated 1793 derivative records from 53330 primary records. [2025-10-08T22:39:51.827384] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:51.828615] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-08T22:39:51.847592] [DEBUG] [LOCAL ] IPG: Derivative data saved (1793 records). [2025-10-08T22:39:51.847727] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-08T22:39:51.850202] [INFO ] [MAIN ] Derivative Progress: 966/1771 symbols completed. IPG took 1.1s. Estimated remaining: 5m 11s. Rate: 155.4 symbols/min [2025-10-08T22:39:51.862185] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:51.885538] [DEBUG] [LOCAL ] IQV: Loaded 50072 existing records from primary storage. [2025-10-08T22:39:51.885885] [INFO ] [MAIN ] IQV: Loaded 50072 primary data records. [2025-10-08T22:39:52.125948] [DEBUG] [LOCAL ] IR: Loaded 52750 existing records from primary storage. [2025-10-08T22:39:52.134584] [INFO ] [MAIN ] IR: Loaded 52750 primary data records. [2025-10-08T22:39:52.241617] [DEBUG] [LOCAL ] IRM: Loaded 49267 existing records from primary storage. [2025-10-08T22:39:52.262015] [INFO ] [MAIN ] IRM: Loaded 49267 primary data records. [2025-10-08T22:39:52.903068] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:52.904980] [INFO ] [MAIN ] IQV: Generated 1793 derivative records from 50072 primary records. [2025-10-08T22:39:52.905123] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-08T22:39:52.925889] [DEBUG] [LOCAL ] IQV: Derivative data saved (1793 records). [2025-10-08T22:39:52.927588] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-08T22:39:52.931727] [INFO ] [MAIN ] Derivative Progress: 967/1771 symbols completed. IQV took 1.1s. Estimated remaining: 5m 11s. Rate: 155.1 symbols/min [2025-10-08T22:39:52.933082] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:52.946420] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:52.947603] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52750 primary records. [2025-10-08T22:39:52.960618] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-08T22:39:52.960529] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:52.962781] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49267 primary records. [2025-10-08T22:39:52.963161] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-08T22:39:52.999067] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-08T22:39:53.007364] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-08T22:39:53.007903] [DEBUG] [LOCAL ] IRS: Loaded 22476 existing records from primary storage. [2025-10-08T22:39:53.010017] [INFO ] [MAIN ] Derivative Progress: 968/1771 symbols completed. IR took 1.2s. Estimated remaining: 5m 10s. Rate: 155.2 symbols/min [2025-10-08T22:39:53.010429] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:53.011531] [INFO ] [MAIN ] IRS: Loaded 22476 primary data records. [2025-10-08T22:39:53.012399] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-08T22:39:53.034145] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-08T22:39:53.052074] [INFO ] [MAIN ] Derivative Progress: 969/1771 symbols completed. IRM took 1.2s. Estimated remaining: 5m 10s. Rate: 155.4 symbols/min [2025-10-08T22:39:53.071733] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:53.213490] [DEBUG] [LOCAL ] ISD: Loaded 15838 existing records from primary storage. [2025-10-08T22:39:53.328787] [INFO ] [MAIN ] ISD: Loaded 15838 primary data records. [2025-10-08T22:39:53.538479] [DEBUG] [LOCAL ] IRT: Loaded 50424 existing records from primary storage. [2025-10-08T22:39:53.629740] [INFO ] [MAIN ] IRT: Loaded 50424 primary data records. [2025-10-08T22:39:53.983101] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:53.984981] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 22476 primary records. [2025-10-08T22:39:53.985864] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-08T22:39:54.020872] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-08T22:39:54.021781] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-08T22:39:54.021705] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:54.024123] [INFO ] [MAIN ] Derivative Progress: 970/1771 symbols completed. IRS took 1.1s. Estimated remaining: 5m 10s. Rate: 155.1 symbols/min [2025-10-08T22:39:54.025043] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15838 primary records. [2025-10-08T22:39:54.025220] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:54.025350] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-08T22:39:54.058793] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-08T22:39:54.058906] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-08T22:39:54.058471] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:54.061152] [INFO ] [MAIN ] Derivative Progress: 971/1771 symbols completed. ISD took 1.0s. Estimated remaining: 5m 9s. Rate: 155.3 symbols/min [2025-10-08T22:39:54.062211] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50424 primary records. [2025-10-08T22:39:54.061382] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:54.062557] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-08T22:39:54.079248] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-08T22:39:54.089258] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-08T22:39:54.091627] [INFO ] [MAIN ] Derivative Progress: 972/1771 symbols completed. IRT took 1.1s. Estimated remaining: 5m 8s. Rate: 155.4 symbols/min [2025-10-08T22:39:54.091858] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:54.115784] [DEBUG] [LOCAL ] IT: Loaded 42164 existing records from primary storage. [2025-10-08T22:39:54.116055] [INFO ] [MAIN ] IT: Loaded 42164 primary data records. [2025-10-08T22:39:54.192866] [DEBUG] [LOCAL ] ITGR: Loaded 31212 existing records from primary storage. [2025-10-08T22:39:54.237339] [INFO ] [MAIN ] ITGR: Loaded 31212 primary data records. [2025-10-08T22:39:54.344394] [DEBUG] [LOCAL ] ITT: Loaded 32595 existing records from primary storage. [2025-10-08T22:39:54.379242] [INFO ] [MAIN ] ITT: Loaded 32595 primary data records. [2025-10-08T22:39:55.102430] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:39:55.104253] [INFO ] [MAIN ] IT: Generated 1793 derivative records from 42164 primary records. [2025-10-08T22:39:55.104466] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-08T22:39:55.133348] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:55.134480] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31212 primary records. [2025-10-08T22:39:55.134586] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-08T22:39:55.167265] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:55.168433] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32595 primary records. [2025-10-08T22:39:55.168531] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-08T22:39:55.166989] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-08T22:39:55.169329] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-08T22:39:55.172195] [INFO ] [MAIN ] Derivative Progress: 973/1771 symbols completed. ITGR took 1.1s. Estimated remaining: 5m 9s. Rate: 155.2 symbols/min [2025-10-08T22:39:55.172522] [DEBUG] [LOCAL ] IT: Derivative data saved (1793 records). [2025-10-08T22:39:55.172765] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-08T22:39:55.181820] [INFO ] [MAIN ] Derivative Progress: 974/1771 symbols completed. IT took 1.2s. Estimated remaining: 5m 8s. Rate: 155.3 symbols/min [2025-10-08T22:39:55.189582] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-08T22:39:55.189666] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-08T22:39:55.192396] [INFO ] [MAIN ] Derivative Progress: 975/1771 symbols completed. ITT took 1.1s. Estimated remaining: 5m 7s. Rate: 155.5 symbols/min [2025-10-08T22:39:55.192828] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:55.192773] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:55.192909] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:55.266003] [DEBUG] [LOCAL ] IVR: Loaded 48111 existing records from primary storage. [2025-10-08T22:39:55.266318] [INFO ] [MAIN ] IVR: Loaded 48111 primary data records. [2025-10-08T22:39:55.404006] [DEBUG] [LOCAL ] ITW: Loaded 45750 existing records from primary storage. [2025-10-08T22:39:55.404220] [INFO ] [MAIN ] ITW: Loaded 45750 primary data records. [2025-10-08T22:39:55.404922] [DEBUG] [LOCAL ] ITUB: Loaded 53313 existing records from primary storage. [2025-10-08T22:39:55.446495] [INFO ] [MAIN ] ITUB: Loaded 53313 primary data records. [2025-10-08T22:39:56.220215] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:56.222537] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 48111 primary records. [2025-10-08T22:39:56.223699] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-08T22:39:56.248980] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:56.253140] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45750 primary records. [2025-10-08T22:39:56.253910] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-08T22:39:56.254279] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-08T22:39:56.254008] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-08T22:39:56.256834] [INFO ] [MAIN ] Derivative Progress: 976/1771 symbols completed. IVR took 1.1s. Estimated remaining: 5m 7s. Rate: 155.2 symbols/min [2025-10-08T22:39:56.259504] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:56.288441] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-08T22:39:56.288765] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:56.289745] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53313 primary records. [2025-10-08T22:39:56.289839] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-08T22:39:56.288980] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-08T22:39:56.292034] [INFO ] [MAIN ] Derivative Progress: 977/1771 symbols completed. ITW took 1.1s. Estimated remaining: 5m 7s. Rate: 155.3 symbols/min [2025-10-08T22:39:56.292178] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:56.319883] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-08T22:39:56.320031] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-08T22:39:56.322537] [INFO ] [MAIN ] Derivative Progress: 978/1771 symbols completed. ITUB took 1.1s. Estimated remaining: 5m 6s. Rate: 155.5 symbols/min [2025-10-08T22:39:56.322754] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:56.335582] [DEBUG] [LOCAL ] IVT: Loaded 30981 existing records from primary storage. [2025-10-08T22:39:56.335893] [INFO ] [MAIN ] IVT: Loaded 30981 primary data records. [2025-10-08T22:39:56.511251] [DEBUG] [LOCAL ] IX: Loaded 22302 existing records from primary storage. [2025-10-08T22:39:56.542120] [INFO ] [MAIN ] IX: Loaded 22302 primary data records. [2025-10-08T22:39:56.763381] [DEBUG] [LOCAL ] IVZ: Loaded 53114 existing records from primary storage. [2025-10-08T22:39:56.794163] [INFO ] [MAIN ] IVZ: Loaded 53114 primary data records. [2025-10-08T22:39:57.349864] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:57.351581] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 30981 primary records. [2025-10-08T22:39:57.354835] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-08T22:39:57.374699] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-08T22:39:57.377073] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-08T22:39:57.379189] [INFO ] [MAIN ] Derivative Progress: 979/1771 symbols completed. IVT took 1.1s. Estimated remaining: 5m 6s. Rate: 155.2 symbols/min [2025-10-08T22:39:57.380130] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:57.394222] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:57.395588] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22302 primary records. [2025-10-08T22:39:57.396548] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-08T22:39:57.424006] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:57.425340] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53114 primary records. [2025-10-08T22:39:57.426184] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-08T22:39:57.442174] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-08T22:39:57.447982] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-08T22:39:57.451347] [INFO ] [MAIN ] Derivative Progress: 980/1771 symbols completed. IX took 1.1s. Estimated remaining: 5m 6s. Rate: 155.3 symbols/min [2025-10-08T22:39:57.453390] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:57.456481] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-08T22:39:57.456734] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-08T22:39:57.459432] [INFO ] [MAIN ] Derivative Progress: 981/1771 symbols completed. IVZ took 1.2s. Estimated remaining: 5m 5s. Rate: 155.5 symbols/min [2025-10-08T22:39:57.459722] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:57.489045] [DEBUG] [LOCAL ] J: Loaded 40192 existing records from primary storage. [2025-10-08T22:39:57.489316] [INFO ] [MAIN ] J: Loaded 40192 primary data records. [2025-10-08T22:39:57.828261] [DEBUG] [LOCAL ] JBI: Loaded 43319 existing records from primary storage. [2025-10-08T22:39:57.821847] [DEBUG] [LOCAL ] JBGS: Loaded 42213 existing records from primary storage. [2025-10-08T22:39:57.836727] [INFO ] [MAIN ] JBGS: Loaded 42213 primary data records. [2025-10-08T22:39:57.836575] [INFO ] [MAIN ] JBI: Loaded 43319 primary data records. [2025-10-08T22:39:58.530879] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:58.532377] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40192 primary records. [2025-10-08T22:39:58.532520] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-08T22:39:58.551531] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-08T22:39:58.551819] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-08T22:39:58.553906] [INFO ] [MAIN ] Derivative Progress: 982/1771 symbols completed. J took 1.2s. Estimated remaining: 5m 5s. Rate: 155.2 symbols/min [2025-10-08T22:39:58.554238] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:58.582769] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:58.588391] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 43319 primary records. [2025-10-08T22:39:58.588735] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:58.589467] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42213 primary records. [2025-10-08T22:39:58.588884] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-08T22:39:58.589686] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-08T22:39:58.617662] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-08T22:39:58.617825] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-08T22:39:58.620392] [INFO ] [MAIN ] Derivative Progress: 983/1771 symbols completed. JBI took 1.2s. Estimated remaining: 5m 4s. Rate: 155.3 symbols/min [2025-10-08T22:39:58.620798] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:58.635460] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-08T22:39:58.635691] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-08T22:39:58.637810] [INFO ] [MAIN ] Derivative Progress: 984/1771 symbols completed. JBGS took 1.2s. Estimated remaining: 5m 4s. Rate: 155.5 symbols/min [2025-10-08T22:39:58.638164] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:58.664123] [DEBUG] [LOCAL ] JBL: Loaded 48364 existing records from primary storage. [2025-10-08T22:39:58.667696] [INFO ] [MAIN ] JBL: Loaded 48364 primary data records. [2025-10-08T22:39:58.667589] [DEBUG] [LOCAL ] JCE: Loaded 7134 existing records from primary storage. [2025-10-08T22:39:58.667869] [INFO ] [MAIN ] JCE: Loaded 7134 primary data records. [2025-10-08T22:39:58.835799] [DEBUG] [LOCAL ] JBND: Loaded 26515 existing records from primary storage. [2025-10-08T22:39:58.859071] [INFO ] [MAIN ] JBND: Loaded 26515 primary data records. [2025-10-08T22:39:59.626943] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:59.627637] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:59.628477] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48364 primary records. [2025-10-08T22:39:59.629149] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7134 primary records. [2025-10-08T22:39:59.629249] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-08T22:39:59.629724] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-08T22:39:59.672529] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:39:59.675379] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 26515 primary records. [2025-10-08T22:39:59.676160] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-08T22:39:59.679472] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-08T22:39:59.680074] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-08T22:39:59.680130] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-08T22:39:59.689570] [INFO ] [MAIN ] Derivative Progress: 985/1771 symbols completed. JCE took 1.1s. Estimated remaining: 5m 4s. Rate: 155.2 symbols/min [2025-10-08T22:39:59.680261] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-08T22:39:59.691990] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:59.696299] [INFO ] [MAIN ] Derivative Progress: 986/1771 symbols completed. JBL took 1.1s. Estimated remaining: 5m 3s. Rate: 155.4 symbols/min [2025-10-08T22:39:59.699240] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:59.700763] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-08T22:39:59.701120] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-08T22:39:59.703694] [INFO ] [MAIN ] Derivative Progress: 987/1771 symbols completed. JBND took 1.1s. Estimated remaining: 5m 2s. Rate: 155.5 symbols/min [2025-10-08T22:39:59.703964] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:39:59.788069] [DEBUG] [LOCAL ] JELD: Loaded 46112 existing records from primary storage. [2025-10-08T22:39:59.789979] [INFO ] [MAIN ] JELD: Loaded 46112 primary data records. [2025-10-08T22:39:59.827704] [DEBUG] [LOCAL ] JEF: Loaded 50129 existing records from primary storage. [2025-10-08T22:39:59.844146] [INFO ] [MAIN ] JEF: Loaded 50129 primary data records. [2025-10-08T22:39:59.910771] [DEBUG] [LOCAL ] JCI: Loaded 53539 existing records from primary storage. [2025-10-08T22:39:59.962901] [INFO ] [MAIN ] JCI: Loaded 53539 primary data records. [2025-10-08T22:40:00.783476] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:00.784873] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46112 primary records. [2025-10-08T22:40:00.798373] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-08T22:40:00.799498] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:00.802068] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50129 primary records. [2025-10-08T22:40:00.802575] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-08T22:40:00.845193] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-08T22:40:00.835002] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:00.845956] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-08T22:40:00.847229] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53539 primary records. [2025-10-08T22:40:00.848056] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-08T22:40:00.850904] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-08T22:40:00.851016] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-08T22:40:00.850762] [INFO ] [MAIN ] Derivative Progress: 988/1771 symbols completed. JEF took 1.2s. Estimated remaining: 5m 3s. Rate: 155.2 symbols/min [2025-10-08T22:40:00.854117] [INFO ] [MAIN ] Derivative Progress: 989/1771 symbols completed. JELD took 1.2s. Estimated remaining: 5m 2s. Rate: 155.4 symbols/min [2025-10-08T22:40:00.869144] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-08T22:40:00.869212] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-08T22:40:00.871810] [INFO ] [MAIN ] Derivative Progress: 990/1771 symbols completed. JCI took 1.2s. Estimated remaining: 5m 1s. Rate: 155.5 symbols/min [2025-10-08T22:40:00.872306] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:00.872238] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:00.872166] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:00.890398] [DEBUG] [LOCAL ] JEQ: Loaded 8667 existing records from primary storage. [2025-10-08T22:40:00.890576] [INFO ] [MAIN ] JEQ: Loaded 8667 primary data records. [2025-10-08T22:40:00.935425] [DEBUG] [LOCAL ] JGH: Loaded 11365 existing records from primary storage. [2025-10-08T22:40:00.971799] [INFO ] [MAIN ] JGH: Loaded 11365 primary data records. [2025-10-08T22:40:01.123930] [DEBUG] [LOCAL ] JFR: Loaded 31030 existing records from primary storage. [2025-10-08T22:40:01.134447] [INFO ] [MAIN ] JFR: Loaded 31030 primary data records. [2025-10-08T22:40:01.995605] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:02.011149] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 11365 primary records. [2025-10-08T22:40:02.011859] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-08T22:40:02.011737] [DEBUG] [MAIN ] JEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:02.026398] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8667 primary records. [2025-10-08T22:40:02.030110] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-10-08T22:40:02.048020] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:02.063385] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 31030 primary records. [2025-10-08T22:40:02.069551] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-10-08T22:40:02.068418] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-08T22:40:02.070091] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-10-08T22:40:02.074343] [INFO ] [MAIN ] Derivative Progress: 991/1771 symbols completed. JEQ took 1.2s. Estimated remaining: 5m 2s. Rate: 155.2 symbols/min [2025-10-08T22:40:02.091252] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:02.094497] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-08T22:40:02.094739] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-08T22:40:02.097185] [INFO ] [MAIN ] Derivative Progress: 992/1771 symbols completed. JGH took 1.2s. Estimated remaining: 5m 1s. Rate: 155.3 symbols/min [2025-10-08T22:40:02.099970] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:02.101703] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-08T22:40:02.101780] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-08T22:40:02.104208] [INFO ] [MAIN ] Derivative Progress: 993/1771 symbols completed. JFR took 1.2s. Estimated remaining: 5m 0s. Rate: 155.5 symbols/min [2025-10-08T22:40:02.104354] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:02.112492] [DEBUG] [LOCAL ] JHS: Loaded 2900 existing records from primary storage. [2025-10-08T22:40:02.115434] [DEBUG] [LOCAL ] JHI: Loaded 3717 existing records from primary storage. [2025-10-08T22:40:02.115745] [INFO ] [MAIN ] JHI: Loaded 3717 primary data records. [2025-10-08T22:40:02.115621] [INFO ] [MAIN ] JHS: Loaded 2900 primary data records. [2025-10-08T22:40:02.849725] [DEBUG] [LOCAL ] JHG: Loaded 47568 existing records from primary storage. [2025-10-08T22:40:02.850217] [INFO ] [MAIN ] JHG: Loaded 47568 primary data records. [2025-10-08T22:40:03.304550] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:03.339992] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2900 primary records. [2025-10-08T22:40:03.346913] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-08T22:40:03.404982] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:03.406617] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3717 primary records. [2025-10-08T22:40:03.406792] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-08T22:40:03.443267] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-08T22:40:03.443483] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-08T22:40:03.446282] [INFO ] [MAIN ] Derivative Progress: 994/1771 symbols completed. JHS took 1.3s. Estimated remaining: 5m 1s. Rate: 155.1 symbols/min [2025-10-08T22:40:03.448794] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:03.455730] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-08T22:40:03.455937] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-08T22:40:03.459890] [INFO ] [MAIN ] Derivative Progress: 995/1771 symbols completed. JHI took 1.4s. Estimated remaining: 4m 60s. Rate: 155.2 symbols/min [2025-10-08T22:40:03.460237] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:03.486808] [DEBUG] [LOCAL ] JILL: Loaded 16249 existing records from primary storage. [2025-10-08T22:40:03.486962] [INFO ] [MAIN ] JILL: Loaded 16249 primary data records. [2025-10-08T22:40:03.621168] [DEBUG] [MAIN ] JHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:03.622899] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47568 primary records. [2025-10-08T22:40:03.643424] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-08T22:40:03.861366] [DEBUG] [LOCAL ] JHX: Loaded 53151 existing records from primary storage. [2025-10-08T22:40:03.861960] [INFO ] [MAIN ] JHX: Loaded 53151 primary data records. [2025-10-08T22:40:04.017814] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-08T22:40:04.041632] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-08T22:40:04.067558] [INFO ] [MAIN ] Derivative Progress: 996/1771 symbols completed. JHG took 2.0s. Estimated remaining: 4m 60s. Rate: 155.2 symbols/min [2025-10-08T22:40:04.126820] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:04.388905] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:04.389995] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16249 primary records. [2025-10-08T22:40:04.390248] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-08T22:40:04.427253] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-08T22:40:04.427137] [DEBUG] [LOCAL ] JKS: Loaded 39841 existing records from primary storage. [2025-10-08T22:40:04.427434] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-08T22:40:04.427530] [INFO ] [MAIN ] JKS: Loaded 39841 primary data records. [2025-10-08T22:40:04.430075] [INFO ] [MAIN ] Derivative Progress: 997/1771 symbols completed. JILL took 1.0s. Estimated remaining: 4m 59s. Rate: 155.2 symbols/min [2025-10-08T22:40:04.448698] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:04.613806] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:04.620808] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53151 primary records. [2025-10-08T22:40:04.646336] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-08T22:40:04.784055] [DEBUG] [LOCAL ] JLL: Loaded 31422 existing records from primary storage. [2025-10-08T22:40:04.788025] [INFO ] [MAIN ] JLL: Loaded 31422 primary data records. [2025-10-08T22:40:04.853799] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-08T22:40:04.869088] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-08T22:40:04.898182] [INFO ] [MAIN ] Derivative Progress: 998/1771 symbols completed. JHX took 1.4s. Estimated remaining: 4m 59s. Rate: 155.1 symbols/min [2025-10-08T22:40:04.910178] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:04.995630] [DEBUG] [LOCAL ] JLS: Loaded 4144 existing records from primary storage. [2025-10-08T22:40:05.148590] [INFO ] [MAIN ] JLS: Loaded 4144 primary data records. [2025-10-08T22:40:05.466176] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:05.475975] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39841 primary records. [2025-10-08T22:40:05.476421] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-08T22:40:05.494418] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-08T22:40:05.494910] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-08T22:40:05.497492] [INFO ] [MAIN ] Derivative Progress: 999/1771 symbols completed. JKS took 1.4s. Estimated remaining: 4m 59s. Rate: 155.0 symbols/min [2025-10-08T22:40:05.498768] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:05.515676] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:05.516459] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31422 primary records. [2025-10-08T22:40:05.516634] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-08T22:40:05.533609] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-08T22:40:05.533735] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-08T22:40:05.536210] [INFO ] [MAIN ] Derivative Progress: 1000/1771 symbols completed. JLL took 1.1s. Estimated remaining: 4m 58s. Rate: 155.2 symbols/min [2025-10-08T22:40:05.537053] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:05.553675] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:05.554544] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4144 primary records. [2025-10-08T22:40:05.554849] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-08T22:40:05.584521] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-08T22:40:05.584883] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-08T22:40:05.587410] [INFO ] [MAIN ] Derivative Progress: 1001/1771 symbols completed. JLS took 0.7s. Estimated remaining: 4m 57s. Rate: 155.3 symbols/min [2025-10-08T22:40:05.587811] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:05.602734] [DEBUG] [LOCAL ] JMIA: Loaded 50849 existing records from primary storage. [2025-10-08T22:40:05.602941] [INFO ] [MAIN ] JMIA: Loaded 50849 primary data records. [2025-10-08T22:40:05.929890] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-08T22:40:05.930699] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-08T22:40:06.067130] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-08T22:40:06.073420] [INFO ] [MAIN ] JOBY: Loaded 53801 primary data records. [2025-10-08T22:40:06.597744] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:06.598702] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50849 primary records. [2025-10-08T22:40:06.598879] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-08T22:40:06.618953] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-08T22:40:06.620879] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-08T22:40:06.624159] [INFO ] [MAIN ] Derivative Progress: 1002/1771 symbols completed. JMIA took 1.1s. Estimated remaining: 4m 58s. Rate: 155.1 symbols/min [2025-10-08T22:40:06.625302] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:06.638722] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:06.639565] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-08T22:40:06.639799] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-08T22:40:06.658902] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-08T22:40:06.664889] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-08T22:40:06.667031] [INFO ] [MAIN ] Derivative Progress: 1003/1771 symbols completed. JNJ took 1.1s. Estimated remaining: 4m 57s. Rate: 155.2 symbols/min [2025-10-08T22:40:06.680078] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:06.680817] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53801 primary records. [2025-10-08T22:40:06.687321] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-08T22:40:06.688934] [DEBUG] [LOCAL ] JOE: Loaded 23935 existing records from primary storage. [2025-10-08T22:40:06.689319] [INFO ] [MAIN ] JOE: Loaded 23935 primary data records. [2025-10-08T22:40:06.857529] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-08T22:40:06.865297] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-08T22:40:06.881902] [INFO ] [MAIN ] Derivative Progress: 1004/1771 symbols completed. JOBY took 1.3s. Estimated remaining: 4m 56s. Rate: 155.3 symbols/min [2025-10-08T22:40:07.027482] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:07.028150] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23935 primary records. [2025-10-08T22:40:07.028214] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-08T22:40:07.043856] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-08T22:40:07.043918] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-08T22:40:07.045950] [INFO ] [MAIN ] Derivative Progress: 1005/1771 symbols completed. JOE took 0.4s. Estimated remaining: 4m 56s. Rate: 155.4 symbols/min [2025-10-08T22:40:07.046745] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:07.046547] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:07.046600] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:07.057708] [DEBUG] [LOCAL ] JOF: Loaded 6878 existing records from primary storage. [2025-10-08T22:40:07.057842] [INFO ] [MAIN ] JOF: Loaded 6878 primary data records. [2025-10-08T22:40:07.272364] [DEBUG] [LOCAL ] JPC: Loaded 37230 existing records from primary storage. [2025-10-08T22:40:07.416638] [INFO ] [MAIN ] JPC: Loaded 37230 primary data records. [2025-10-08T22:40:07.576738] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-08T22:40:07.595229] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-08T22:40:08.095170] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:08.097211] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6878 primary records. [2025-10-08T22:40:08.097511] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-08T22:40:08.120550] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-08T22:40:08.133752] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-08T22:40:08.136305] [INFO ] [MAIN ] Derivative Progress: 1006/1771 symbols completed. JOF took 1.1s. Estimated remaining: 4m 56s. Rate: 155.1 symbols/min [2025-10-08T22:40:08.136588] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:08.137773] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37230 primary records. [2025-10-08T22:40:08.136913] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:08.138350] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-08T22:40:08.170526] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-08T22:40:08.171064] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-08T22:40:08.175692] [INFO ] [MAIN ] Derivative Progress: 1007/1771 symbols completed. JPC took 1.1s. Estimated remaining: 4m 55s. Rate: 155.2 symbols/min [2025-10-08T22:40:08.170984] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:08.176873] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-08T22:40:08.175888] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:08.177040] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-08T22:40:08.208856] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-08T22:40:08.209195] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-08T22:40:08.216912] [INFO ] [MAIN ] Derivative Progress: 1008/1771 symbols completed. JPM took 1.2s. Estimated remaining: 4m 55s. Rate: 155.3 symbols/min [2025-10-08T22:40:08.221192] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:08.233582] [DEBUG] [LOCAL ] JQC: Loaded 34236 existing records from primary storage. [2025-10-08T22:40:08.234021] [INFO ] [MAIN ] JQC: Loaded 34236 primary data records. [2025-10-08T22:40:08.285175] [DEBUG] [LOCAL ] JRI: Loaded 15167 existing records from primary storage. [2025-10-08T22:40:08.320739] [INFO ] [MAIN ] JRI: Loaded 15167 primary data records. [2025-10-08T22:40:08.352878] [DEBUG] [LOCAL ] JRS: Loaded 11551 existing records from primary storage. [2025-10-08T22:40:08.409509] [INFO ] [MAIN ] JRS: Loaded 11551 primary data records. [2025-10-08T22:40:09.265577] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:09.266551] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 34236 primary records. [2025-10-08T22:40:09.266673] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-08T22:40:09.288057] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-08T22:40:09.288252] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-08T22:40:09.290530] [INFO ] [MAIN ] Derivative Progress: 1009/1771 symbols completed. JQC took 1.2s. Estimated remaining: 4m 55s. Rate: 155.1 symbols/min [2025-10-08T22:40:09.290818] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:09.316701] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:09.316506] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:09.317466] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15167 primary records. [2025-10-08T22:40:09.317661] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-08T22:40:09.318241] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11551 primary records. [2025-10-08T22:40:09.318761] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-08T22:40:09.348981] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-08T22:40:09.349740] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-08T22:40:09.352715] [INFO ] [MAIN ] Derivative Progress: 1010/1771 symbols completed. JRI took 1.2s. Estimated remaining: 4m 54s. Rate: 155.2 symbols/min [2025-10-08T22:40:09.354031] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:09.353920] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-08T22:40:09.354634] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-08T22:40:09.357168] [INFO ] [MAIN ] Derivative Progress: 1011/1771 symbols completed. JRS took 1.1s. Estimated remaining: 4m 54s. Rate: 155.4 symbols/min [2025-10-08T22:40:09.357610] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:09.391964] [DEBUG] [LOCAL ] JXN: Loaded 45065 existing records from primary storage. [2025-10-08T22:40:09.397146] [DEBUG] [LOCAL ] KAI: Loaded 13277 existing records from primary storage. [2025-10-08T22:40:09.397291] [INFO ] [MAIN ] KAI: Loaded 13277 primary data records. [2025-10-08T22:40:09.396920] [INFO ] [MAIN ] JXN: Loaded 45065 primary data records. [2025-10-08T22:40:09.677931] [DEBUG] [LOCAL ] K: Loaded 50112 existing records from primary storage. [2025-10-08T22:40:09.711538] [INFO ] [MAIN ] K: Loaded 50112 primary data records. [2025-10-08T22:40:10.387630] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:10.391886] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13277 primary records. [2025-10-08T22:40:10.392427] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-08T22:40:10.413299] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:10.414158] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 45065 primary records. [2025-10-08T22:40:10.415264] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-08T22:40:10.436803] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-08T22:40:10.439401] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-08T22:40:10.441523] [INFO ] [MAIN ] Derivative Progress: 1012/1771 symbols completed. KAI took 1.1s. Estimated remaining: 4m 54s. Rate: 155.1 symbols/min [2025-10-08T22:40:10.441777] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:10.457358] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:10.458901] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50112 primary records. [2025-10-08T22:40:10.459114] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-08T22:40:10.459203] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-08T22:40:10.459979] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-08T22:40:10.462462] [INFO ] [MAIN ] Derivative Progress: 1013/1771 symbols completed. JXN took 1.2s. Estimated remaining: 4m 53s. Rate: 155.2 symbols/min [2025-10-08T22:40:10.473846] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:10.479449] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-08T22:40:10.479891] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-08T22:40:10.482350] [INFO ] [MAIN ] Derivative Progress: 1014/1771 symbols completed. K took 1.1s. Estimated remaining: 4m 52s. Rate: 155.4 symbols/min [2025-10-08T22:40:10.482596] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:10.511597] [DEBUG] [LOCAL ] KB: Loaded 23644 existing records from primary storage. [2025-10-08T22:40:10.527471] [INFO ] [MAIN ] KB: Loaded 23644 primary data records. [2025-10-08T22:40:10.528569] [DEBUG] [LOCAL ] KAR: Loaded 40090 existing records from primary storage. [2025-10-08T22:40:10.540738] [INFO ] [MAIN ] KAR: Loaded 40090 primary data records. [2025-10-08T22:40:10.690086] [DEBUG] [LOCAL ] KBDC: Loaded 21569 existing records from primary storage. [2025-10-08T22:40:10.751258] [INFO ] [MAIN ] KBDC: Loaded 21569 primary data records. [2025-10-08T22:40:11.527004] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:11.528014] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23644 primary records. [2025-10-08T22:40:11.528274] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-08T22:40:11.542301] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:11.554519] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40090 primary records. [2025-10-08T22:40:11.555733] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-08T22:40:11.583777] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-08T22:40:11.589768] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-08T22:40:11.592237] [INFO ] [MAIN ] Derivative Progress: 1015/1771 symbols completed. KB took 1.1s. Estimated remaining: 4m 52s. Rate: 155.1 symbols/min [2025-10-08T22:40:11.593251] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:11.593705] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:11.595427] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 21569 primary records. [2025-10-08T22:40:11.595713] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-08T22:40:11.605214] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-08T22:40:11.608868] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-08T22:40:11.614424] [INFO ] [MAIN ] Derivative Progress: 1016/1771 symbols completed. KAR took 1.2s. Estimated remaining: 4m 52s. Rate: 155.2 symbols/min [2025-10-08T22:40:11.615611] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-08T22:40:11.615729] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:11.616071] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-08T22:40:11.618836] [INFO ] [MAIN ] Derivative Progress: 1017/1771 symbols completed. KBDC took 1.1s. Estimated remaining: 4m 51s. Rate: 155.4 symbols/min [2025-10-08T22:40:11.619140] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:11.712429] [DEBUG] [LOCAL ] KBH: Loaded 48855 existing records from primary storage. [2025-10-08T22:40:11.713613] [DEBUG] [LOCAL ] KBR: Loaded 47850 existing records from primary storage. [2025-10-08T22:40:11.714488] [INFO ] [MAIN ] KBH: Loaded 48855 primary data records. [2025-10-08T22:40:11.714424] [INFO ] [MAIN ] KBR: Loaded 47850 primary data records. [2025-10-08T22:40:11.822482] [DEBUG] [LOCAL ] KD: Loaded 52320 existing records from primary storage. [2025-10-08T22:40:11.892229] [INFO ] [MAIN ] KD: Loaded 52320 primary data records. [2025-10-08T22:40:12.703236] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:12.717355] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 47850 primary records. [2025-10-08T22:40:12.718217] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-08T22:40:12.718508] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:12.721981] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48855 primary records. [2025-10-08T22:40:12.722187] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-08T22:40:12.748549] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:12.759085] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52320 primary records. [2025-10-08T22:40:12.763555] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-08T22:40:12.763874] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-08T22:40:12.767122] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-08T22:40:12.768704] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-08T22:40:12.769177] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-08T22:40:12.771377] [INFO ] [MAIN ] Derivative Progress: 1018/1771 symbols completed. KBR took 1.2s. Estimated remaining: 4m 51s. Rate: 155.1 symbols/min [2025-10-08T22:40:12.773634] [INFO ] [MAIN ] Derivative Progress: 1019/1771 symbols completed. KBH took 1.2s. Estimated remaining: 4m 51s. Rate: 155.2 symbols/min [2025-10-08T22:40:12.788520] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-08T22:40:12.788591] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-08T22:40:12.790815] [INFO ] [MAIN ] Derivative Progress: 1020/1771 symbols completed. KD took 1.2s. Estimated remaining: 4m 50s. Rate: 155.4 symbols/min [2025-10-08T22:40:12.791233] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:12.791350] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:12.791853] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:12.798632] [DEBUG] [LOCAL ] KEN: Loaded 4677 existing records from primary storage. [2025-10-08T22:40:12.798789] [INFO ] [MAIN ] KEN: Loaded 4677 primary data records. [2025-10-08T22:40:13.158519] [DEBUG] [LOCAL ] KEP: Loaded 31433 existing records from primary storage. [2025-10-08T22:40:13.159331] [INFO ] [MAIN ] KEP: Loaded 31433 primary data records. [2025-10-08T22:40:13.192035] [DEBUG] [LOCAL ] KEX: Loaded 38497 existing records from primary storage. [2025-10-08T22:40:13.205247] [INFO ] [MAIN ] KEX: Loaded 38497 primary data records. [2025-10-08T22:40:13.802589] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:13.804673] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4677 primary records. [2025-10-08T22:40:13.805146] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-08T22:40:13.821495] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-08T22:40:13.821781] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-08T22:40:13.823806] [INFO ] [MAIN ] Derivative Progress: 1021/1771 symbols completed. KEN took 1.0s. Estimated remaining: 4m 50s. Rate: 155.1 symbols/min [2025-10-08T22:40:13.824308] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:13.858015] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:13.858366] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:13.859378] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38497 primary records. [2025-10-08T22:40:13.859492] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-08T22:40:13.860380] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 31433 primary records. [2025-10-08T22:40:13.861377] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-08T22:40:13.886560] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-08T22:40:13.886818] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-08T22:40:13.891926] [INFO ] [MAIN ] Derivative Progress: 1022/1771 symbols completed. KEX took 1.1s. Estimated remaining: 4m 49s. Rate: 155.2 symbols/min [2025-10-08T22:40:13.895766] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:13.897332] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-08T22:40:13.897513] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-08T22:40:13.899718] [INFO ] [MAIN ] Derivative Progress: 1023/1771 symbols completed. KEP took 1.1s. Estimated remaining: 4m 49s. Rate: 155.4 symbols/min [2025-10-08T22:40:13.909876] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:13.913631] [DEBUG] [LOCAL ] KF: Loaded 2375 existing records from primary storage. [2025-10-08T22:40:13.913926] [INFO ] [MAIN ] KF: Loaded 2375 primary data records. [2025-10-08T22:40:14.049493] [DEBUG] [LOCAL ] KFRC: Loaded 20015 existing records from primary storage. [2025-10-08T22:40:14.056028] [DEBUG] [LOCAL ] KEYS: Loaded 43126 existing records from primary storage. [2025-10-08T22:40:14.066392] [INFO ] [MAIN ] KFRC: Loaded 20015 primary data records. [2025-10-08T22:40:14.093281] [INFO ] [MAIN ] KEYS: Loaded 43126 primary data records. [2025-10-08T22:40:14.902433] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:14.904485] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2375 primary records. [2025-10-08T22:40:14.904701] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-08T22:40:14.926075] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-08T22:40:14.939328] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-08T22:40:14.942423] [INFO ] [MAIN ] Derivative Progress: 1024/1771 symbols completed. KF took 1.0s. Estimated remaining: 4m 49s. Rate: 155.1 symbols/min [2025-10-08T22:40:14.942896] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:14.940143] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:14.944254] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20015 primary records. [2025-10-08T22:40:14.944998] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-08T22:40:14.982673] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-08T22:40:14.986332] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-08T22:40:14.981879] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:14.989307] [INFO ] [MAIN ] Derivative Progress: 1025/1771 symbols completed. KFRC took 1.1s. Estimated remaining: 4m 48s. Rate: 155.3 symbols/min [2025-10-08T22:40:14.989574] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:14.986612] [DEBUG] [LOCAL ] KFS: Loaded 8566 existing records from primary storage. [2025-10-08T22:40:14.991088] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43126 primary records. [2025-10-08T22:40:14.991183] [INFO ] [MAIN ] KFS: Loaded 8566 primary data records. [2025-10-08T22:40:15.022810] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-08T22:40:15.120010] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-08T22:40:15.182085] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-08T22:40:15.217169] [INFO ] [MAIN ] Derivative Progress: 1026/1771 symbols completed. KEYS took 1.4s. Estimated remaining: 4m 48s. Rate: 155.3 symbols/min [2025-10-08T22:40:15.366867] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:15.368335] [DEBUG] [LOCAL ] KFY: Loaded 29870 existing records from primary storage. [2025-10-08T22:40:15.368972] [INFO ] [MAIN ] KFY: Loaded 29870 primary data records. [2025-10-08T22:40:15.710105] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:15.711920] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8566 primary records. [2025-10-08T22:40:15.712159] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-08T22:40:15.729717] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-08T22:40:15.730179] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-08T22:40:15.746717] [INFO ] [MAIN ] Derivative Progress: 1027/1771 symbols completed. KFS took 0.8s. Estimated remaining: 4m 47s. Rate: 155.3 symbols/min [2025-10-08T22:40:15.747469] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:15.748915] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-08T22:40:15.750483] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-10-08T22:40:15.878487] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:15.895506] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29870 primary records. [2025-10-08T22:40:15.935952] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-08T22:40:16.116057] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-08T22:40:16.116468] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-08T22:40:16.120190] [DEBUG] [LOCAL ] KGS: Loaded 45924 existing records from primary storage. [2025-10-08T22:40:16.118951] [INFO ] [MAIN ] Derivative Progress: 1028/1771 symbols completed. KFY took 1.1s. Estimated remaining: 4m 47s. Rate: 155.3 symbols/min [2025-10-08T22:40:16.120822] [INFO ] [MAIN ] KGS: Loaded 45924 primary data records. [2025-10-08T22:40:16.121057] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:16.454234] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:16.455111] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-10-08T22:40:16.455888] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-08T22:40:16.488463] [DEBUG] [LOCAL ] KIM: Loaded 53001 existing records from primary storage. [2025-10-08T22:40:16.489364] [INFO ] [MAIN ] KIM: Loaded 53001 primary data records. [2025-10-08T22:40:16.546692] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-08T22:40:16.567123] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-08T22:40:16.584950] [INFO ] [MAIN ] Derivative Progress: 1029/1771 symbols completed. KGC took 1.2s. Estimated remaining: 4m 47s. Rate: 155.2 symbols/min [2025-10-08T22:40:16.585115] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:16.813424] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:16.824384] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45924 primary records. [2025-10-08T22:40:16.824587] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-08T22:40:16.850430] [DEBUG] [LOCAL ] KIO: Loaded 21461 existing records from primary storage. [2025-10-08T22:40:16.849660] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-08T22:40:16.850580] [INFO ] [MAIN ] KIO: Loaded 21461 primary data records. [2025-10-08T22:40:16.851171] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-08T22:40:16.858764] [INFO ] [MAIN ] Derivative Progress: 1030/1771 symbols completed. KGS took 1.1s. Estimated remaining: 4m 46s. Rate: 155.3 symbols/min [2025-10-08T22:40:16.871695] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:17.287830] [DEBUG] [MAIN ] KIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:17.289399] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53001 primary records. [2025-10-08T22:40:17.289733] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-08T22:40:17.325756] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-08T22:40:17.326803] [INFO ] [MAIN ] KKR: Loaded 53502 primary data records. [2025-10-08T22:40:17.328805] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-08T22:40:17.334505] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-08T22:40:17.336844] [INFO ] [MAIN ] Derivative Progress: 1031/1771 symbols completed. KIM took 1.2s. Estimated remaining: 4m 46s. Rate: 155.3 symbols/min [2025-10-08T22:40:17.343396] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:17.444626] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-08T22:40:17.445674] [INFO ] [MAIN ] KKRS: Loaded 5729 primary data records. [2025-10-08T22:40:17.536388] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:17.594534] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21461 primary records. [2025-10-08T22:40:17.753220] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-08T22:40:17.989557] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-08T22:40:17.990812] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-08T22:40:17.993249] [INFO ] [MAIN ] Derivative Progress: 1032/1771 symbols completed. KIO took 1.4s. Estimated remaining: 4m 46s. Rate: 155.1 symbols/min [2025-10-08T22:40:17.994344] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:18.018186] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:18.019615] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53502 primary records. [2025-10-08T22:40:18.021625] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-08T22:40:18.060826] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:18.076305] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-08T22:40:18.076600] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-08T22:40:18.077992] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5729 primary records. [2025-10-08T22:40:18.078170] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-08T22:40:18.077180] [DEBUG] [LOCAL ] KLC: Loaded 36726 existing records from primary storage. [2025-10-08T22:40:18.081967] [INFO ] [MAIN ] KLC: Loaded 36726 primary data records. [2025-10-08T22:40:18.081258] [INFO ] [MAIN ] Derivative Progress: 1033/1771 symbols completed. KKR took 1.2s. Estimated remaining: 4m 45s. Rate: 155.3 symbols/min [2025-10-08T22:40:18.234618] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-08T22:40:18.257214] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-08T22:40:18.259405] [INFO ] [MAIN ] Derivative Progress: 1034/1771 symbols completed. KKRS took 0.9s. Estimated remaining: 4m 45s. Rate: 155.3 symbols/min [2025-10-08T22:40:18.440342] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:18.441110] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36726 primary records. [2025-10-08T22:40:18.441174] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-08T22:40:18.457390] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-08T22:40:18.457505] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-08T22:40:18.459587] [INFO ] [MAIN ] Derivative Progress: 1035/1771 symbols completed. KLC took 0.5s. Estimated remaining: 4m 44s. Rate: 155.4 symbols/min [2025-10-08T22:40:18.460207] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:18.460423] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:18.461055] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:18.470253] [DEBUG] [LOCAL ] KMPB: Loaded 3832 existing records from primary storage. [2025-10-08T22:40:18.472800] [INFO ] [MAIN ] KMPB: Loaded 3832 primary data records. [2025-10-08T22:40:18.693700] [DEBUG] [LOCAL ] KMPR: Loaded 39350 existing records from primary storage. [2025-10-08T22:40:18.820007] [INFO ] [MAIN ] KMPR: Loaded 39350 primary data records. [2025-10-08T22:40:18.919921] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-08T22:40:18.931735] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-08T22:40:19.517498] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:19.518446] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3832 primary records. [2025-10-08T22:40:19.518876] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-08T22:40:19.551379] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-10-08T22:40:19.552425] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-08T22:40:19.554756] [INFO ] [MAIN ] Derivative Progress: 1036/1771 symbols completed. KMPB took 1.1s. Estimated remaining: 4m 44s. Rate: 155.1 symbols/min [2025-10-08T22:40:19.552233] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:19.555045] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:19.556102] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 39350 primary records. [2025-10-08T22:40:19.556946] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-08T22:40:19.575252] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-08T22:40:19.575395] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-08T22:40:19.577242] [INFO ] [MAIN ] Derivative Progress: 1037/1771 symbols completed. KMPR took 1.1s. Estimated remaining: 4m 44s. Rate: 155.3 symbols/min [2025-10-08T22:40:19.577813] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:19.591536] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:19.592343] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-08T22:40:19.592490] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-08T22:40:19.620901] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-08T22:40:19.621080] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-08T22:40:19.623257] [INFO ] [MAIN ] Derivative Progress: 1038/1771 symbols completed. KMI took 1.2s. Estimated remaining: 4m 43s. Rate: 155.4 symbols/min [2025-10-08T22:40:19.623460] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:19.653051] [DEBUG] [LOCAL ] KMT: Loaded 42969 existing records from primary storage. [2025-10-08T22:40:19.653208] [INFO ] [MAIN ] KMT: Loaded 42969 primary data records. [2025-10-08T22:40:19.744696] [DEBUG] [LOCAL ] KMX: Loaded 53215 existing records from primary storage. [2025-10-08T22:40:19.756312] [INFO ] [MAIN ] KMX: Loaded 53215 primary data records. [2025-10-08T22:40:19.943219] [DEBUG] [LOCAL ] KN: Loaded 38528 existing records from primary storage. [2025-10-08T22:40:19.982256] [INFO ] [MAIN ] KN: Loaded 38528 primary data records. [2025-10-08T22:40:20.638800] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:20.643886] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42969 primary records. [2025-10-08T22:40:20.644349] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-08T22:40:20.674003] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:20.675274] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53215 primary records. [2025-10-08T22:40:20.675828] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-08T22:40:20.694979] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-08T22:40:20.695094] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-08T22:40:20.708943] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:20.709780] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-08T22:40:20.713027] [INFO ] [MAIN ] Derivative Progress: 1039/1771 symbols completed. KMT took 1.2s. Estimated remaining: 4m 43s. Rate: 155.1 symbols/min [2025-10-08T22:40:20.713190] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:20.713431] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-08T22:40:20.716086] [INFO ] [MAIN ] Derivative Progress: 1040/1771 symbols completed. KMX took 1.1s. Estimated remaining: 4m 42s. Rate: 155.3 symbols/min [2025-10-08T22:40:20.711109] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38528 primary records. [2025-10-08T22:40:20.716419] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-08T22:40:20.716610] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:20.743482] [DEBUG] [LOCAL ] KNOP: Loaded 10498 existing records from primary storage. [2025-10-08T22:40:20.744048] [INFO ] [MAIN ] KNOP: Loaded 10498 primary data records. [2025-10-08T22:40:20.789115] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-08T22:40:20.808164] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-08T22:40:20.845670] [INFO ] [MAIN ] Derivative Progress: 1041/1771 symbols completed. KN took 1.2s. Estimated remaining: 4m 42s. Rate: 155.4 symbols/min [2025-10-08T22:40:20.864519] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:20.869109] [DEBUG] [LOCAL ] KNF: Loaded 36214 existing records from primary storage. [2025-10-08T22:40:20.885180] [INFO ] [MAIN ] KNF: Loaded 36214 primary data records. [2025-10-08T22:40:21.188935] [DEBUG] [LOCAL ] KNSL: Loaded 18414 existing records from primary storage. [2025-10-08T22:40:21.210742] [INFO ] [MAIN ] KNSL: Loaded 18414 primary data records. [2025-10-08T22:40:21.762523] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:21.764393] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10498 primary records. [2025-10-08T22:40:21.765685] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-08T22:40:21.796414] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:21.797945] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36214 primary records. [2025-10-08T22:40:21.798325] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-08T22:40:21.815613] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-08T22:40:21.817081] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-08T22:40:21.819311] [INFO ] [MAIN ] Derivative Progress: 1042/1771 symbols completed. KNOP took 1.1s. Estimated remaining: 4m 42s. Rate: 155.2 symbols/min [2025-10-08T22:40:21.827512] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:21.834122] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:21.835390] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18414 primary records. [2025-10-08T22:40:21.836062] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-08T22:40:21.837569] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-08T22:40:21.838162] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-08T22:40:21.840432] [INFO ] [MAIN ] Derivative Progress: 1043/1771 symbols completed. KNF took 1.1s. Estimated remaining: 4m 41s. Rate: 155.3 symbols/min [2025-10-08T22:40:21.840860] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:21.857269] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-08T22:40:21.857399] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-08T22:40:21.859492] [INFO ] [MAIN ] Derivative Progress: 1044/1771 symbols completed. KNSL took 1.0s. Estimated remaining: 4m 41s. Rate: 155.4 symbols/min [2025-10-08T22:40:21.859744] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:21.922119] [DEBUG] [LOCAL ] KNTK: Loaded 46585 existing records from primary storage. [2025-10-08T22:40:21.922286] [INFO ] [MAIN ] KNTK: Loaded 46585 primary data records. [2025-10-08T22:40:22.053005] [DEBUG] [LOCAL ] KODK: Loaded 43452 existing records from primary storage. [2025-10-08T22:40:22.053181] [INFO ] [MAIN ] KODK: Loaded 43452 primary data records. [2025-10-08T22:40:22.052430] [DEBUG] [LOCAL ] KNX: Loaded 52596 existing records from primary storage. [2025-10-08T22:40:22.053516] [INFO ] [MAIN ] KNX: Loaded 52596 primary data records. [2025-10-08T22:40:22.912357] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:22.913488] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46585 primary records. [2025-10-08T22:40:22.913775] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-08T22:40:22.932339] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-08T22:40:22.933606] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-08T22:40:22.936427] [INFO ] [MAIN ] Derivative Progress: 1045/1771 symbols completed. KNTK took 1.1s. Estimated remaining: 4m 41s. Rate: 155.2 symbols/min [2025-10-08T22:40:22.937251] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:22.950702] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:22.953751] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43452 primary records. [2025-10-08T22:40:22.954690] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-08T22:40:22.981422] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:22.982950] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52596 primary records. [2025-10-08T22:40:22.984907] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-08T22:40:22.992326] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-08T22:40:22.985098] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-08T22:40:22.994435] [INFO ] [MAIN ] Derivative Progress: 1046/1771 symbols completed. KODK took 1.1s. Estimated remaining: 4m 40s. Rate: 155.3 symbols/min [2025-10-08T22:40:22.995981] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:23.019419] [DEBUG] [LOCAL ] KOF: Loaded 26540 existing records from primary storage. [2025-10-08T22:40:23.021162] [INFO ] [MAIN ] KOF: Loaded 26540 primary data records. [2025-10-08T22:40:23.059249] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-08T22:40:23.064685] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-08T22:40:23.066998] [INFO ] [MAIN ] Derivative Progress: 1047/1771 symbols completed. KNX took 1.2s. Estimated remaining: 4m 39s. Rate: 155.4 symbols/min [2025-10-08T22:40:23.094967] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:23.106242] [DEBUG] [LOCAL ] KOP: Loaded 17423 existing records from primary storage. [2025-10-08T22:40:23.130167] [INFO ] [MAIN ] KOP: Loaded 17423 primary data records. [2025-10-08T22:40:23.179588] [DEBUG] [LOCAL ] KORE: Loaded 2116 existing records from primary storage. [2025-10-08T22:40:23.234597] [INFO ] [MAIN ] KORE: Loaded 2116 primary data records. [2025-10-08T22:40:24.023404] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:24.023763] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:24.026131] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17423 primary records. [2025-10-08T22:40:24.027097] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-08T22:40:24.026983] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26540 primary records. [2025-10-08T22:40:24.027281] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-08T22:40:24.070581] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-08T22:40:24.066500] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:24.070726] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-08T22:40:24.073773] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2116 primary records. [2025-10-08T22:40:24.076184] [INFO ] [MAIN ] Derivative Progress: 1048/1771 symbols completed. KOP took 1.1s. Estimated remaining: 4m 40s. Rate: 155.2 symbols/min [2025-10-08T22:40:24.076396] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-08T22:40:24.095954] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-08T22:40:24.097161] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-08T22:40:24.100784] [INFO ] [MAIN ] Derivative Progress: 1049/1771 symbols completed. KOF took 1.2s. Estimated remaining: 4m 39s. Rate: 155.3 symbols/min [2025-10-08T22:40:24.103028] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-08T22:40:24.103173] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-08T22:40:24.105664] [INFO ] [MAIN ] Derivative Progress: 1050/1771 symbols completed. KORE took 1.0s. Estimated remaining: 4m 38s. Rate: 155.5 symbols/min [2025-10-08T22:40:24.106217] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:24.106127] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:24.106359] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:24.196077] [DEBUG] [LOCAL ] KOS: Loaded 53075 existing records from primary storage. [2025-10-08T22:40:24.198261] [INFO ] [MAIN ] KOS: Loaded 53075 primary data records. [2025-10-08T22:40:24.232285] [DEBUG] [LOCAL ] KRC: Loaded 48354 existing records from primary storage. [2025-10-08T22:40:24.285947] [INFO ] [MAIN ] KRC: Loaded 48354 primary data records. [2025-10-08T22:40:24.503124] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-08T22:40:24.631756] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-08T22:40:25.241570] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:25.242364] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53075 primary records. [2025-10-08T22:40:25.242570] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-08T22:40:25.262045] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-08T22:40:25.274929] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-08T22:40:25.278207] [INFO ] [MAIN ] Derivative Progress: 1051/1771 symbols completed. KOS took 1.2s. Estimated remaining: 4m 38s. Rate: 155.2 symbols/min [2025-10-08T22:40:25.278737] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:25.278547] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:25.280169] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48354 primary records. [2025-10-08T22:40:25.280393] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-08T22:40:25.304846] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:25.306205] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-08T22:40:25.306313] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-08T22:40:25.310235] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-08T22:40:25.310526] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-08T22:40:25.312861] [INFO ] [MAIN ] Derivative Progress: 1052/1771 symbols completed. KRC took 1.2s. Estimated remaining: 4m 38s. Rate: 155.3 symbols/min [2025-10-08T22:40:25.313084] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:25.329687] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-08T22:40:25.329849] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-08T22:40:25.332719] [INFO ] [MAIN ] Derivative Progress: 1053/1771 symbols completed. KR took 1.2s. Estimated remaining: 4m 37s. Rate: 155.4 symbols/min [2025-10-08T22:40:25.332987] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:25.358429] [DEBUG] [LOCAL ] KREF: Loaded 37756 existing records from primary storage. [2025-10-08T22:40:25.358671] [INFO ] [MAIN ] KREF: Loaded 37756 primary data records. [2025-10-08T22:40:25.505346] [DEBUG] [LOCAL ] KRO: Loaded 26221 existing records from primary storage. [2025-10-08T22:40:25.538693] [INFO ] [MAIN ] KRO: Loaded 26221 primary data records. [2025-10-08T22:40:25.539437] [DEBUG] [LOCAL ] KRG: Loaded 49171 existing records from primary storage. [2025-10-08T22:40:25.548037] [INFO ] [MAIN ] KRG: Loaded 49171 primary data records. [2025-10-08T22:40:26.334182] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:26.335525] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 37756 primary records. [2025-10-08T22:40:26.335855] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-08T22:40:26.354870] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-08T22:40:26.355167] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-08T22:40:26.357395] [INFO ] [MAIN ] Derivative Progress: 1054/1771 symbols completed. KREF took 1.1s. Estimated remaining: 4m 37s. Rate: 155.2 symbols/min [2025-10-08T22:40:26.357767] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:26.384435] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:26.390236] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:26.391013] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49171 primary records. [2025-10-08T22:40:26.391095] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-08T22:40:26.391907] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26221 primary records. [2025-10-08T22:40:26.392406] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-08T22:40:26.421639] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-08T22:40:26.422717] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-08T22:40:26.434790] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-08T22:40:26.437161] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-08T22:40:26.436935] [INFO ] [MAIN ] Derivative Progress: 1055/1771 symbols completed. KRG took 1.1s. Estimated remaining: 4m 37s. Rate: 155.3 symbols/min [2025-10-08T22:40:26.439743] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:26.440040] [INFO ] [MAIN ] Derivative Progress: 1056/1771 symbols completed. KRO took 1.1s. Estimated remaining: 4m 36s. Rate: 155.5 symbols/min [2025-10-08T22:40:26.440498] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:26.455254] [DEBUG] [LOCAL ] KRP: Loaded 36701 existing records from primary storage. [2025-10-08T22:40:26.455561] [INFO ] [MAIN ] KRP: Loaded 36701 primary data records. [2025-10-08T22:40:26.801729] [DEBUG] [LOCAL ] KT: Loaded 45551 existing records from primary storage. [2025-10-08T22:40:26.816414] [INFO ] [MAIN ] KT: Loaded 45551 primary data records. [2025-10-08T22:40:26.855419] [DEBUG] [LOCAL ] KSS: Loaded 53597 existing records from primary storage. [2025-10-08T22:40:26.901323] [INFO ] [MAIN ] KSS: Loaded 53597 primary data records. [2025-10-08T22:40:27.530371] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:27.532366] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36701 primary records. [2025-10-08T22:40:27.532709] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-08T22:40:27.570057] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:27.571822] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45551 primary records. [2025-10-08T22:40:27.572080] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-08T22:40:27.570901] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-08T22:40:27.572787] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-08T22:40:27.575866] [INFO ] [MAIN ] Derivative Progress: 1057/1771 symbols completed. KRP took 1.2s. Estimated remaining: 4m 36s. Rate: 155.2 symbols/min [2025-10-08T22:40:27.576458] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:27.614291] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-08T22:40:27.614834] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-08T22:40:27.614751] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:27.617293] [INFO ] [MAIN ] Derivative Progress: 1058/1771 symbols completed. KT took 1.2s. Estimated remaining: 4m 35s. Rate: 155.3 symbols/min [2025-10-08T22:40:27.618337] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53597 primary records. [2025-10-08T22:40:27.618557] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:27.618425] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-08T22:40:27.650415] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-08T22:40:27.650588] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-08T22:40:27.652739] [INFO ] [MAIN ] Derivative Progress: 1059/1771 symbols completed. KSS took 1.2s. Estimated remaining: 4m 35s. Rate: 155.4 symbols/min [2025-10-08T22:40:27.652913] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:27.658396] [DEBUG] [LOCAL ] KTF: Loaded 12064 existing records from primary storage. [2025-10-08T22:40:27.658552] [INFO ] [MAIN ] KTF: Loaded 12064 primary data records. [2025-10-08T22:40:27.775130] [DEBUG] [LOCAL ] KTB: Loaded 40584 existing records from primary storage. [2025-10-08T22:40:27.775808] [INFO ] [MAIN ] KTB: Loaded 40584 primary data records. [2025-10-08T22:40:28.228479] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-08T22:40:28.349866] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-08T22:40:28.686883] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:28.689073] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 12064 primary records. [2025-10-08T22:40:28.689414] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-08T22:40:28.717311] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:28.719041] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40584 primary records. [2025-10-08T22:40:28.719423] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-08T22:40:28.737292] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-08T22:40:28.740848] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-08T22:40:28.743183] [INFO ] [MAIN ] Derivative Progress: 1060/1771 symbols completed. KTF took 1.1s. Estimated remaining: 4m 35s. Rate: 155.2 symbols/min [2025-10-08T22:40:28.744127] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:28.744610] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-08T22:40:28.745436] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-08T22:40:28.747919] [INFO ] [MAIN ] Derivative Progress: 1061/1771 symbols completed. KTB took 1.2s. Estimated remaining: 4m 34s. Rate: 155.3 symbols/min [2025-10-08T22:40:28.748472] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:28.766609] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:28.767336] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-08T22:40:28.767506] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-08T22:40:28.784302] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-08T22:40:28.784453] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-08T22:40:28.786754] [INFO ] [MAIN ] Derivative Progress: 1062/1771 symbols completed. KVUE took 1.1s. Estimated remaining: 4m 34s. Rate: 155.5 symbols/min [2025-10-08T22:40:28.787038] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:28.843806] [DEBUG] [LOCAL ] KW: Loaded 40373 existing records from primary storage. [2025-10-08T22:40:28.844825] [INFO ] [MAIN ] KW: Loaded 40373 primary data records. [2025-10-08T22:40:28.844635] [DEBUG] [LOCAL ] KVYO: Loaded 50429 existing records from primary storage. [2025-10-08T22:40:28.856600] [INFO ] [MAIN ] KVYO: Loaded 50429 primary data records. [2025-10-08T22:40:28.894957] [DEBUG] [LOCAL ] KWR: Loaded 16250 existing records from primary storage. [2025-10-08T22:40:28.953571] [INFO ] [MAIN ] KWR: Loaded 16250 primary data records. [2025-10-08T22:40:29.892698] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:29.906385] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40373 primary records. [2025-10-08T22:40:29.906906] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-08T22:40:29.908018] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:29.923627] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50429 primary records. [2025-10-08T22:40:29.939120] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-08T22:40:29.940848] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:29.944342] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16250 primary records. [2025-10-08T22:40:29.961243] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-08T22:40:29.961129] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-08T22:40:29.963221] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-08T22:40:29.972511] [INFO ] [MAIN ] Derivative Progress: 1063/1771 symbols completed. KW took 1.2s. Estimated remaining: 4m 34s. Rate: 155.2 symbols/min [2025-10-08T22:40:29.983572] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-10-08T22:40:29.984192] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-08T22:40:29.986877] [INFO ] [MAIN ] Derivative Progress: 1064/1771 symbols completed. KVYO took 1.2s. Estimated remaining: 4m 33s. Rate: 155.3 symbols/min [2025-10-08T22:40:29.988574] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-08T22:40:29.988675] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-08T22:40:29.990748] [INFO ] [MAIN ] Derivative Progress: 1065/1771 symbols completed. KWR took 1.2s. Estimated remaining: 4m 33s. Rate: 155.4 symbols/min [2025-10-08T22:40:29.991296] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:29.991219] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:29.991413] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:30.025274] [DEBUG] [LOCAL ] LAD: Loaded 23558 existing records from primary storage. [2025-10-08T22:40:30.025410] [INFO ] [MAIN ] LAD: Loaded 23558 primary data records. [2025-10-08T22:40:30.157472] [DEBUG] [LOCAL ] KYN: Loaded 30062 existing records from primary storage. [2025-10-08T22:40:30.157764] [INFO ] [MAIN ] KYN: Loaded 30062 primary data records. [2025-10-08T22:40:30.326872] [DEBUG] [LOCAL ] LAC: Loaded 52443 existing records from primary storage. [2025-10-08T22:40:30.375632] [INFO ] [MAIN ] LAC: Loaded 52443 primary data records. [2025-10-08T22:40:31.072999] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:40:31.075611] [INFO ] [MAIN ] LAD: Generated 1793 derivative records from 23558 primary records. [2025-10-08T22:40:31.075874] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-08T22:40:31.107502] [DEBUG] [LOCAL ] LAD: Derivative data saved (1793 records). [2025-10-08T22:40:31.114506] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-08T22:40:31.114417] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:31.115670] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30062 primary records. [2025-10-08T22:40:31.115892] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-08T22:40:31.118274] [INFO ] [MAIN ] Derivative Progress: 1066/1771 symbols completed. LAD took 1.1s. Estimated remaining: 4m 33s. Rate: 155.2 symbols/min [2025-10-08T22:40:31.127110] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:31.144776] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:31.145852] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52443 primary records. [2025-10-08T22:40:31.145944] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-08T22:40:31.165672] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-08T22:40:31.166670] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-08T22:40:31.169872] [INFO ] [MAIN ] Derivative Progress: 1067/1771 symbols completed. KYN took 1.2s. Estimated remaining: 4m 32s. Rate: 155.3 symbols/min [2025-10-08T22:40:31.171158] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-08T22:40:31.171369] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:31.172016] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-08T22:40:31.174882] [INFO ] [MAIN ] Derivative Progress: 1068/1771 symbols completed. LAC took 1.2s. Estimated remaining: 4m 31s. Rate: 155.4 symbols/min [2025-10-08T22:40:31.175154] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:31.180790] [DEBUG] [LOCAL ] LANV: Loaded 2763 existing records from primary storage. [2025-10-08T22:40:31.181013] [INFO ] [MAIN ] LANV: Loaded 2763 primary data records. [2025-10-08T22:40:31.330200] [DEBUG] [LOCAL ] LAW: Loaded 14259 existing records from primary storage. [2025-10-08T22:40:31.372719] [INFO ] [MAIN ] LAW: Loaded 14259 primary data records. [2025-10-08T22:40:31.397914] [DEBUG] [LOCAL ] LADR: Loaded 39156 existing records from primary storage. [2025-10-08T22:40:31.423701] [INFO ] [MAIN ] LADR: Loaded 39156 primary data records. [2025-10-08T22:40:32.179169] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:40:32.184974] [INFO ] [MAIN ] LANV: Generated 1792 derivative records from 2763 primary records. [2025-10-08T22:40:32.185470] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-08T22:40:32.204592] [DEBUG] [LOCAL ] LANV: Derivative data saved (1792 records). [2025-10-08T22:40:32.204774] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-08T22:40:32.206940] [INFO ] [MAIN ] Derivative Progress: 1069/1771 symbols completed. LANV took 1.0s. Estimated remaining: 4m 31s. Rate: 155.2 symbols/min [2025-10-08T22:40:32.207262] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:32.220775] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:32.221693] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14259 primary records. [2025-10-08T22:40:32.221999] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-08T22:40:32.253731] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:32.253400] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-08T22:40:32.253878] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-08T22:40:32.254696] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39156 primary records. [2025-10-08T22:40:32.256946] [INFO ] [MAIN ] Derivative Progress: 1070/1771 symbols completed. LAW took 1.1s. Estimated remaining: 4m 31s. Rate: 155.3 symbols/min [2025-10-08T22:40:32.257271] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-08T22:40:32.257121] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:32.284437] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-08T22:40:32.284585] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-08T22:40:32.286778] [INFO ] [MAIN ] Derivative Progress: 1071/1771 symbols completed. LADR took 1.2s. Estimated remaining: 4m 30s. Rate: 155.4 symbols/min [2025-10-08T22:40:32.287144] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:32.305383] [DEBUG] [LOCAL ] LAZ: Loaded 44782 existing records from primary storage. [2025-10-08T22:40:32.305582] [INFO ] [MAIN ] LAZ: Loaded 44782 primary data records. [2025-10-08T22:40:32.488208] [DEBUG] [LOCAL ] LB: Loaded 37667 existing records from primary storage. [2025-10-08T22:40:32.509893] [INFO ] [MAIN ] LB: Loaded 37667 primary data records. [2025-10-08T22:40:32.768891] [DEBUG] [LOCAL ] LBRT: Loaded 52937 existing records from primary storage. [2025-10-08T22:40:32.786791] [INFO ] [MAIN ] LBRT: Loaded 52937 primary data records. [2025-10-08T22:40:33.327339] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:33.328264] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44782 primary records. [2025-10-08T22:40:33.328766] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-08T22:40:33.349109] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-08T22:40:33.349427] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-08T22:40:33.353487] [INFO ] [MAIN ] Derivative Progress: 1072/1771 symbols completed. LAZ took 1.1s. Estimated remaining: 4m 30s. Rate: 155.2 symbols/min [2025-10-08T22:40:33.353724] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:33.370902] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:33.372019] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37667 primary records. [2025-10-08T22:40:33.372236] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-08T22:40:33.392882] [DEBUG] [MAIN ] LBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:33.399082] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52937 primary records. [2025-10-08T22:40:33.400669] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-08T22:40:33.401793] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-08T22:40:33.402137] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-08T22:40:33.404328] [INFO ] [MAIN ] Derivative Progress: 1073/1771 symbols completed. LB took 1.1s. Estimated remaining: 4m 30s. Rate: 155.3 symbols/min [2025-10-08T22:40:33.404783] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:33.422093] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-08T22:40:33.422230] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-08T22:40:33.425265] [INFO ] [MAIN ] Derivative Progress: 1074/1771 symbols completed. LBRT took 1.1s. Estimated remaining: 4m 29s. Rate: 155.5 symbols/min [2025-10-08T22:40:33.425474] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:33.465104] [DEBUG] [LOCAL ] LC: Loaded 47939 existing records from primary storage. [2025-10-08T22:40:33.467708] [INFO ] [MAIN ] LC: Loaded 47939 primary data records. [2025-10-08T22:40:33.577741] [DEBUG] [LOCAL ] LCII: Loaded 27674 existing records from primary storage. [2025-10-08T22:40:33.588961] [INFO ] [MAIN ] LCII: Loaded 27674 primary data records. [2025-10-08T22:40:33.837362] [DEBUG] [LOCAL ] LDI: Loaded 44485 existing records from primary storage. [2025-10-08T22:40:33.851949] [INFO ] [MAIN ] LDI: Loaded 44485 primary data records. [2025-10-08T22:40:34.467721] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:34.469959] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 47939 primary records. [2025-10-08T22:40:34.470442] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-08T22:40:34.489811] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-08T22:40:34.490311] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-08T22:40:34.499823] [INFO ] [MAIN ] Derivative Progress: 1075/1771 symbols completed. LC took 1.1s. Estimated remaining: 4m 29s. Rate: 155.2 symbols/min [2025-10-08T22:40:34.504774] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:34.505221] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:34.506172] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 27674 primary records. [2025-10-08T22:40:34.506504] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-08T22:40:34.525435] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-10-08T22:40:34.525760] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-08T22:40:34.528059] [INFO ] [MAIN ] Derivative Progress: 1076/1771 symbols completed. LCII took 1.1s. Estimated remaining: 4m 28s. Rate: 155.3 symbols/min [2025-10-08T22:40:34.528287] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:34.541316] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:34.542319] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 44485 primary records. [2025-10-08T22:40:34.542529] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-08T22:40:34.563477] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-08T22:40:34.568587] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-08T22:40:34.568849] [DEBUG] [LOCAL ] LDP: Loaded 12929 existing records from primary storage. [2025-10-08T22:40:34.568968] [INFO ] [MAIN ] LDP: Loaded 12929 primary data records. [2025-10-08T22:40:34.571083] [INFO ] [MAIN ] Derivative Progress: 1077/1771 symbols completed. LDI took 1.1s. Estimated remaining: 4m 28s. Rate: 155.5 symbols/min [2025-10-08T22:40:34.571282] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:34.805501] [DEBUG] [LOCAL ] LDOS: Loaded 45346 existing records from primary storage. [2025-10-08T22:40:34.823776] [INFO ] [MAIN ] LDOS: Loaded 45346 primary data records. [2025-10-08T22:40:35.025526] [DEBUG] [LOCAL ] LEA: Loaded 41557 existing records from primary storage. [2025-10-08T22:40:35.036708] [INFO ] [MAIN ] LEA: Loaded 41557 primary data records. [2025-10-08T22:40:35.599962] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:35.601160] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12929 primary records. [2025-10-08T22:40:35.601483] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-08T22:40:35.621966] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-08T22:40:35.623385] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-08T22:40:35.625561] [INFO ] [MAIN ] Derivative Progress: 1078/1771 symbols completed. LDP took 1.1s. Estimated remaining: 4m 28s. Rate: 155.2 symbols/min [2025-10-08T22:40:35.642339] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:35.643445] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 45346 primary records. [2025-10-08T22:40:35.643584] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-08T22:40:35.660326] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-08T22:40:35.660420] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-08T22:40:35.662690] [INFO ] [MAIN ] Derivative Progress: 1079/1771 symbols completed. LDOS took 1.2s. Estimated remaining: 4m 27s. Rate: 155.3 symbols/min [2025-10-08T22:40:35.677255] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:35.677863] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41557 primary records. [2025-10-08T22:40:35.677927] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-08T22:40:35.693666] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-08T22:40:35.693731] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-08T22:40:35.695887] [INFO ] [MAIN ] Derivative Progress: 1080/1771 symbols completed. LEA took 1.1s. Estimated remaining: 4m 27s. Rate: 155.5 symbols/min [2025-10-08T22:40:35.696519] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:35.696674] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:35.696449] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:35.722436] [DEBUG] [LOCAL ] LEO: Loaded 16882 existing records from primary storage. [2025-10-08T22:40:35.722736] [INFO ] [MAIN ] LEO: Loaded 16882 primary data records. [2025-10-08T22:40:36.061884] [DEBUG] [LOCAL ] LEN: Loaded 53170 existing records from primary storage. [2025-10-08T22:40:36.084201] [INFO ] [MAIN ] LEN: Loaded 53170 primary data records. [2025-10-08T22:40:36.096469] [DEBUG] [LOCAL ] LEG: Loaded 50168 existing records from primary storage. [2025-10-08T22:40:36.121354] [INFO ] [MAIN ] LEG: Loaded 50168 primary data records. [2025-10-08T22:40:36.696783] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:36.698762] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16882 primary records. [2025-10-08T22:40:36.699343] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-08T22:40:36.729813] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-08T22:40:36.730449] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-08T22:40:36.732930] [INFO ] [MAIN ] Derivative Progress: 1081/1771 symbols completed. LEO took 1.0s. Estimated remaining: 4m 27s. Rate: 155.2 symbols/min [2025-10-08T22:40:36.730386] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:36.734821] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53170 primary records. [2025-10-08T22:40:36.734923] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-08T22:40:36.738267] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:36.767964] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:36.769582] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50168 primary records. [2025-10-08T22:40:36.769932] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-08T22:40:36.786231] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-08T22:40:36.786671] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-08T22:40:36.788671] [INFO ] [MAIN ] Derivative Progress: 1082/1771 symbols completed. LEN took 1.1s. Estimated remaining: 4m 26s. Rate: 155.4 symbols/min [2025-10-08T22:40:36.789156] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:36.792634] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-08T22:40:36.792778] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-08T22:40:36.794976] [INFO ] [MAIN ] Derivative Progress: 1083/1771 symbols completed. LEG took 1.1s. Estimated remaining: 4m 25s. Rate: 155.5 symbols/min [2025-10-08T22:40:36.795203] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:36.829638] [DEBUG] [LOCAL ] LGI: Loaded 9878 existing records from primary storage. [2025-10-08T22:40:36.829425] [DEBUG] [LOCAL ] LFT: Loaded 18400 existing records from primary storage. [2025-10-08T22:40:36.829886] [INFO ] [MAIN ] LGI: Loaded 9878 primary data records. [2025-10-08T22:40:36.829826] [INFO ] [MAIN ] LFT: Loaded 18400 primary data records. [2025-10-08T22:40:37.041508] [DEBUG] [LOCAL ] LEVI: Loaded 51674 existing records from primary storage. [2025-10-08T22:40:37.055173] [INFO ] [MAIN ] LEVI: Loaded 51674 primary data records. [2025-10-08T22:40:37.866405] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:37.877187] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9878 primary records. [2025-10-08T22:40:37.883236] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-08T22:40:37.884175] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:37.885141] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18400 primary records. [2025-10-08T22:40:37.885707] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-08T22:40:37.918731] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:37.926071] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51674 primary records. [2025-10-08T22:40:37.927205] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-08T22:40:37.944430] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-08T22:40:37.946247] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-08T22:40:37.949053] [INFO ] [MAIN ] Derivative Progress: 1084/1771 symbols completed. LGI took 1.2s. Estimated remaining: 4m 26s. Rate: 155.2 symbols/min [2025-10-08T22:40:37.950242] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:37.952720] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-08T22:40:37.952854] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-08T22:40:37.955256] [INFO ] [MAIN ] Derivative Progress: 1085/1771 symbols completed. LFT took 1.2s. Estimated remaining: 4m 25s. Rate: 155.3 symbols/min [2025-10-08T22:40:37.955933] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:37.958404] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-08T22:40:37.958551] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-08T22:40:37.960890] [INFO ] [MAIN ] Derivative Progress: 1086/1771 symbols completed. LEVI took 1.2s. Estimated remaining: 4m 24s. Rate: 155.5 symbols/min [2025-10-08T22:40:37.961251] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:37.999829] [DEBUG] [LOCAL ] LII: Loaded 28016 existing records from primary storage. [2025-10-08T22:40:38.000041] [INFO ] [MAIN ] LII: Loaded 28016 primary data records. [2025-10-08T22:40:38.107698] [DEBUG] [LOCAL ] LH: Loaded 37766 existing records from primary storage. [2025-10-08T22:40:38.120135] [INFO ] [MAIN ] LH: Loaded 37766 primary data records. [2025-10-08T22:40:38.207703] [DEBUG] [LOCAL ] LHX: Loaded 48559 existing records from primary storage. [2025-10-08T22:40:38.227971] [INFO ] [MAIN ] LHX: Loaded 48559 primary data records. [2025-10-08T22:40:39.112669] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:39.113588] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28016 primary records. [2025-10-08T22:40:39.114064] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-08T22:40:39.148755] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:39.150214] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37766 primary records. [2025-10-08T22:40:39.150562] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-08T22:40:39.152937] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-08T22:40:39.160312] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-08T22:40:39.162431] [INFO ] [MAIN ] Derivative Progress: 1087/1771 symbols completed. LII took 1.2s. Estimated remaining: 4m 24s. Rate: 155.2 symbols/min [2025-10-08T22:40:39.162601] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:39.190159] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:39.193049] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48559 primary records. [2025-10-08T22:40:39.193162] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-08T22:40:39.193281] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-08T22:40:39.194766] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-08T22:40:39.196954] [INFO ] [MAIN ] Derivative Progress: 1088/1771 symbols completed. LH took 1.2s. Estimated remaining: 4m 24s. Rate: 155.3 symbols/min [2025-10-08T22:40:39.209034] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:39.227114] [DEBUG] [LOCAL ] LITB: Loaded 4249 existing records from primary storage. [2025-10-08T22:40:39.228127] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-08T22:40:39.228458] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-08T22:40:39.228585] [INFO ] [MAIN ] LITB: Loaded 4249 primary data records. [2025-10-08T22:40:39.277057] [INFO ] [MAIN ] Derivative Progress: 1089/1771 symbols completed. LHX took 1.3s. Estimated remaining: 4m 23s. Rate: 155.4 symbols/min [2025-10-08T22:40:39.316336] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:39.377830] [DEBUG] [LOCAL ] LION: Loaded 45437 existing records from primary storage. [2025-10-08T22:40:39.389254] [INFO ] [MAIN ] LION: Loaded 45437 primary data records. [2025-10-08T22:40:39.946971] [DEBUG] [LOCAL ] LLY: Loaded 53293 existing records from primary storage. [2025-10-08T22:40:39.948898] [INFO ] [MAIN ] LLY: Loaded 53293 primary data records. [2025-10-08T22:40:40.017452] [DEBUG] [MAIN ] LITB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:40.032166] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4249 primary records. [2025-10-08T22:40:40.038629] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-08T22:40:40.197180] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-08T22:40:40.274838] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-08T22:40:40.291378] [INFO ] [MAIN ] Derivative Progress: 1090/1771 symbols completed. LITB took 1.1s. Estimated remaining: 4m 23s. Rate: 155.2 symbols/min [2025-10-08T22:40:40.292945] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:40.293591] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:40.296168] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 45437 primary records. [2025-10-08T22:40:40.297018] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-08T22:40:40.323030] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-08T22:40:40.323306] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-08T22:40:40.325811] [INFO ] [MAIN ] Derivative Progress: 1091/1771 symbols completed. LION took 1.2s. Estimated remaining: 4m 23s. Rate: 155.3 symbols/min [2025-10-08T22:40:40.326868] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:40.345388] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:40.359459] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53293 primary records. [2025-10-08T22:40:40.359531] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-08T22:40:40.376834] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-08T22:40:40.389996] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-08T22:40:40.393187] [INFO ] [MAIN ] Derivative Progress: 1092/1771 symbols completed. LLY took 1.1s. Estimated remaining: 4m 22s. Rate: 155.4 symbols/min [2025-10-08T22:40:40.393360] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:40.394972] [DEBUG] [LOCAL ] LMND: Loaded 51987 existing records from primary storage. [2025-10-08T22:40:40.395276] [INFO ] [MAIN ] LMND: Loaded 51987 primary data records. [2025-10-08T22:40:40.595518] [DEBUG] [LOCAL ] LMT: Loaded 49773 existing records from primary storage. [2025-10-08T22:40:40.711954] [INFO ] [MAIN ] LMT: Loaded 49773 primary data records. [2025-10-08T22:40:40.920403] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-08T22:40:41.029781] [INFO ] [MAIN ] LNC: Loaded 51610 primary data records. [2025-10-08T22:40:41.235161] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:41.260114] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51987 primary records. [2025-10-08T22:40:41.260331] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-08T22:40:41.397477] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-08T22:40:41.398368] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-08T22:40:41.400740] [INFO ] [MAIN ] Derivative Progress: 1093/1771 symbols completed. LMND took 1.1s. Estimated remaining: 4m 22s. Rate: 155.2 symbols/min [2025-10-08T22:40:41.414216] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:41.415465] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49773 primary records. [2025-10-08T22:40:41.416423] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-08T22:40:41.433365] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-08T22:40:41.433559] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-08T22:40:41.435714] [INFO ] [MAIN ] Derivative Progress: 1094/1771 symbols completed. LMT took 1.1s. Estimated remaining: 4m 21s. Rate: 155.3 symbols/min [2025-10-08T22:40:41.451775] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:41.452441] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51610 primary records. [2025-10-08T22:40:41.452504] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-08T22:40:41.468299] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-08T22:40:41.468373] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-08T22:40:41.470535] [INFO ] [MAIN ] Derivative Progress: 1095/1771 symbols completed. LNC took 1.1s. Estimated remaining: 4m 21s. Rate: 155.5 symbols/min [2025-10-08T22:40:41.471162] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:41.471384] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:41.471303] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:41.479171] [DEBUG] [LOCAL ] LND: Loaded 4976 existing records from primary storage. [2025-10-08T22:40:41.479332] [INFO ] [MAIN ] LND: Loaded 4976 primary data records. [2025-10-08T22:40:41.591187] [DEBUG] [LOCAL ] LNN: Loaded 11300 existing records from primary storage. [2025-10-08T22:40:41.591606] [INFO ] [MAIN ] LNN: Loaded 11300 primary data records. [2025-10-08T22:40:41.975391] [DEBUG] [LOCAL ] LNG: Loaded 51319 existing records from primary storage. [2025-10-08T22:40:42.022201] [INFO ] [MAIN ] LNG: Loaded 51319 primary data records. [2025-10-08T22:40:42.472021] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:42.476733] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4976 primary records. [2025-10-08T22:40:42.477701] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-08T22:40:42.505897] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:42.508227] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11300 primary records. [2025-10-08T22:40:42.509102] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-08T22:40:42.511884] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-08T22:40:42.513776] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-08T22:40:42.516373] [INFO ] [MAIN ] Derivative Progress: 1096/1771 symbols completed. LND took 1.0s. Estimated remaining: 4m 21s. Rate: 155.2 symbols/min [2025-10-08T22:40:42.523845] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:42.544792] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:42.546299] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51319 primary records. [2025-10-08T22:40:42.546399] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-08T22:40:42.560981] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-08T22:40:42.570278] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-08T22:40:42.573109] [INFO ] [MAIN ] Derivative Progress: 1097/1771 symbols completed. LNN took 1.1s. Estimated remaining: 4m 20s. Rate: 155.4 symbols/min [2025-10-08T22:40:42.573663] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:42.579086] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-08T22:40:42.579368] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-08T22:40:42.581527] [INFO ] [MAIN ] Derivative Progress: 1098/1771 symbols completed. LNG took 1.1s. Estimated remaining: 4m 20s. Rate: 155.5 symbols/min [2025-10-08T22:40:42.591780] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:42.600193] [DEBUG] [LOCAL ] LOCL: Loaded 3627 existing records from primary storage. [2025-10-08T22:40:42.600418] [INFO ] [MAIN ] LOCL: Loaded 3627 primary data records. [2025-10-08T22:40:42.638942] [DEBUG] [LOCAL ] LOAR: Loaded 42082 existing records from primary storage. [2025-10-08T22:40:42.690495] [INFO ] [MAIN ] LOAR: Loaded 42082 primary data records. [2025-10-08T22:40:42.850026] [DEBUG] [LOCAL ] LOB: Loaded 27185 existing records from primary storage. [2025-10-08T22:40:42.878879] [INFO ] [MAIN ] LOB: Loaded 27185 primary data records. [2025-10-08T22:40:43.717581] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:43.719464] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3627 primary records. [2025-10-08T22:40:43.719576] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-08T22:40:43.718422] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:43.721327] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42082 primary records. [2025-10-08T22:40:43.721854] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-08T22:40:43.760917] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-08T22:40:43.766680] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-08T22:40:43.769404] [INFO ] [MAIN ] Derivative Progress: 1099/1771 symbols completed. LOCL took 1.2s. Estimated remaining: 4m 20s. Rate: 155.2 symbols/min [2025-10-08T22:40:43.770126] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:43.770565] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:43.772277] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27185 primary records. [2025-10-08T22:40:43.773037] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-08T22:40:43.773914] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-08T22:40:43.774292] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-08T22:40:43.777074] [INFO ] [MAIN ] Derivative Progress: 1100/1771 symbols completed. LOAR took 1.3s. Estimated remaining: 4m 19s. Rate: 155.3 symbols/min [2025-10-08T22:40:43.777954] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:43.795470] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-08T22:40:43.795565] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-08T22:40:43.797853] [INFO ] [MAIN ] Derivative Progress: 1101/1771 symbols completed. LOB took 1.2s. Estimated remaining: 4m 19s. Rate: 155.5 symbols/min [2025-10-08T22:40:43.798130] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:43.824812] [DEBUG] [LOCAL ] LOMA: Loaded 32180 existing records from primary storage. [2025-10-08T22:40:43.825101] [INFO ] [MAIN ] LOMA: Loaded 32180 primary data records. [2025-10-08T22:40:43.987047] [DEBUG] [LOCAL ] LPG: Loaded 39690 existing records from primary storage. [2025-10-08T22:40:44.024975] [INFO ] [MAIN ] LPG: Loaded 39690 primary data records. [2025-10-08T22:40:44.084897] [DEBUG] [LOCAL ] LOW: Loaded 52977 existing records from primary storage. [2025-10-08T22:40:44.206328] [INFO ] [MAIN ] LOW: Loaded 52977 primary data records. [2025-10-08T22:40:44.829278] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:44.831010] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32180 primary records. [2025-10-08T22:40:44.831193] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-08T22:40:44.865845] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-08T22:40:44.865984] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-08T22:40:44.866259] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:44.868268] [INFO ] [MAIN ] Derivative Progress: 1102/1771 symbols completed. LOMA took 1.1s. Estimated remaining: 4m 19s. Rate: 155.2 symbols/min [2025-10-08T22:40:44.869356] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39690 primary records. [2025-10-08T22:40:44.869631] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-08T22:40:44.869516] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:44.902704] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:44.904586] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52977 primary records. [2025-10-08T22:40:44.904966] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-08T22:40:44.906731] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-08T22:40:44.906942] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-08T22:40:44.925514] [INFO ] [MAIN ] Derivative Progress: 1103/1771 symbols completed. LPG took 1.1s. Estimated remaining: 4m 18s. Rate: 155.3 symbols/min [2025-10-08T22:40:44.925834] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:44.944412] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-08T22:40:44.944751] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-08T22:40:44.945245] [DEBUG] [LOCAL ] LPL: Loaded 27378 existing records from primary storage. [2025-10-08T22:40:44.947612] [INFO ] [MAIN ] Derivative Progress: 1104/1771 symbols completed. LOW took 1.2s. Estimated remaining: 4m 17s. Rate: 155.5 symbols/min [2025-10-08T22:40:44.947883] [INFO ] [MAIN ] LPL: Loaded 27378 primary data records. [2025-10-08T22:40:44.948028] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:45.278758] [DEBUG] [LOCAL ] LPX: Loaded 39813 existing records from primary storage. [2025-10-08T22:40:45.280234] [INFO ] [MAIN ] LPX: Loaded 39813 primary data records. [2025-10-08T22:40:45.399176] [DEBUG] [LOCAL ] LRN: Loaded 39676 existing records from primary storage. [2025-10-08T22:40:45.420478] [INFO ] [MAIN ] LRN: Loaded 39676 primary data records. [2025-10-08T22:40:45.957623] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:45.971840] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 27378 primary records. [2025-10-08T22:40:45.972596] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-08T22:40:45.990293] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-08T22:40:45.991292] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-08T22:40:45.993613] [INFO ] [MAIN ] Derivative Progress: 1105/1771 symbols completed. LPL took 1.1s. Estimated remaining: 4m 17s. Rate: 155.2 symbols/min [2025-10-08T22:40:45.994796] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:46.015393] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:46.016280] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39813 primary records. [2025-10-08T22:40:46.016695] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-08T22:40:46.045817] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-08T22:40:46.058136] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-08T22:40:46.060756] [INFO ] [MAIN ] Derivative Progress: 1106/1771 symbols completed. LPX took 1.1s. Estimated remaining: 4m 17s. Rate: 155.3 symbols/min [2025-10-08T22:40:46.061033] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:46.058771] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:46.062246] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39676 primary records. [2025-10-08T22:40:46.062429] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-08T22:40:46.081639] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-08T22:40:46.095053] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-08T22:40:46.097419] [INFO ] [MAIN ] Derivative Progress: 1107/1771 symbols completed. LRN took 1.1s. Estimated remaining: 4m 16s. Rate: 155.5 symbols/min [2025-10-08T22:40:46.098548] [DEBUG] [LOCAL ] LSPD: Loaded 42846 existing records from primary storage. [2025-10-08T22:40:46.097672] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:46.099160] [INFO ] [MAIN ] LSPD: Loaded 42846 primary data records. [2025-10-08T22:40:46.303361] [DEBUG] [LOCAL ] LTC: Loaded 30272 existing records from primary storage. [2025-10-08T22:40:46.303593] [INFO ] [MAIN ] LTC: Loaded 30272 primary data records. [2025-10-08T22:40:46.556027] [DEBUG] [LOCAL ] LTH: Loaded 51722 existing records from primary storage. [2025-10-08T22:40:46.560479] [INFO ] [MAIN ] LTH: Loaded 51722 primary data records. [2025-10-08T22:40:47.072280] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:47.075406] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42846 primary records. [2025-10-08T22:40:47.075830] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-08T22:40:47.094567] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-08T22:40:47.094952] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-08T22:40:47.096978] [INFO ] [MAIN ] Derivative Progress: 1108/1771 symbols completed. LSPD took 1.1s. Estimated remaining: 4m 16s. Rate: 155.3 symbols/min [2025-10-08T22:40:47.115182] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:47.115981] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30272 primary records. [2025-10-08T22:40:47.116139] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-08T22:40:47.147132] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:47.148068] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51722 primary records. [2025-10-08T22:40:47.148311] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-08T22:40:47.148427] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-08T22:40:47.148497] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-08T22:40:47.150794] [INFO ] [MAIN ] Derivative Progress: 1109/1771 symbols completed. LTC took 1.1s. Estimated remaining: 4m 16s. Rate: 155.4 symbols/min [2025-10-08T22:40:47.166779] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-08T22:40:47.166842] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-08T22:40:47.169159] [INFO ] [MAIN ] Derivative Progress: 1110/1771 symbols completed. LTH took 1.1s. Estimated remaining: 4m 15s. Rate: 155.5 symbols/min [2025-10-08T22:40:47.169509] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:47.169604] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:47.169799] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:47.197163] [DEBUG] [LOCAL ] LUCK: Loaded 24438 existing records from primary storage. [2025-10-08T22:40:47.205296] [INFO ] [MAIN ] LUCK: Loaded 24438 primary data records. [2025-10-08T22:40:47.331599] [DEBUG] [LOCAL ] LTM: Loaded 37874 existing records from primary storage. [2025-10-08T22:40:47.370747] [INFO ] [MAIN ] LTM: Loaded 37874 primary data records. [2025-10-08T22:40:47.421838] [DEBUG] [LOCAL ] LU: Loaded 48971 existing records from primary storage. [2025-10-08T22:40:47.522306] [INFO ] [MAIN ] LU: Loaded 48971 primary data records. [2025-10-08T22:40:48.218548] [DEBUG] [MAIN ] LUCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:48.220059] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 24438 primary records. [2025-10-08T22:40:48.220927] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-08T22:40:48.238431] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-08T22:40:48.238717] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-08T22:40:48.242195] [INFO ] [MAIN ] Derivative Progress: 1111/1771 symbols completed. LUCK took 1.1s. Estimated remaining: 4m 15s. Rate: 155.3 symbols/min [2025-10-08T22:40:48.242809] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:48.261809] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:48.262893] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 37874 primary records. [2025-10-08T22:40:48.263324] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-08T22:40:48.294789] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:48.309441] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48971 primary records. [2025-10-08T22:40:48.310185] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-08T22:40:48.312774] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-08T22:40:48.313127] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-08T22:40:48.322489] [INFO ] [MAIN ] Derivative Progress: 1112/1771 symbols completed. LTM took 1.2s. Estimated remaining: 4m 14s. Rate: 155.4 symbols/min [2025-10-08T22:40:48.326728] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:48.345564] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-08T22:40:48.347008] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-08T22:40:48.349461] [INFO ] [MAIN ] Derivative Progress: 1113/1771 symbols completed. LU took 1.2s. Estimated remaining: 4m 14s. Rate: 155.5 symbols/min [2025-10-08T22:40:48.349678] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:48.350945] [DEBUG] [LOCAL ] LUMN: Loaded 53641 existing records from primary storage. [2025-10-08T22:40:48.351461] [INFO ] [MAIN ] LUMN: Loaded 53641 primary data records. [2025-10-08T22:40:48.711306] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-08T22:40:48.714096] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-08T22:40:48.714985] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-08T22:40:48.730187] [INFO ] [MAIN ] LVS: Loaded 53569 primary data records. [2025-10-08T22:40:49.088736] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:49.121164] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53641 primary records. [2025-10-08T22:40:49.275713] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-08T22:40:49.373112] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-08T22:40:49.373862] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-08T22:40:49.376041] [INFO ] [MAIN ] Derivative Progress: 1114/1771 symbols completed. LUMN took 1.1s. Estimated remaining: 4m 14s. Rate: 155.3 symbols/min [2025-10-08T22:40:49.376519] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:49.400761] [DEBUG] [LOCAL ] LVWR: Loaded 18174 existing records from primary storage. [2025-10-08T22:40:49.402864] [INFO ] [MAIN ] LVWR: Loaded 18174 primary data records. [2025-10-08T22:40:49.451460] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:49.470409] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53569 primary records. [2025-10-08T22:40:49.513638] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-08T22:40:49.520374] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:49.542999] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-08T22:40:49.544719] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-08T22:40:49.582304] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-08T22:40:49.607733] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-08T22:40:49.613577] [INFO ] [MAIN ] Derivative Progress: 1115/1771 symbols completed. LVS took 1.3s. Estimated remaining: 4m 13s. Rate: 155.3 symbols/min [2025-10-08T22:40:49.636724] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:49.796127] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-08T22:40:49.805046] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-08T22:40:49.806847] [INFO ] [MAIN ] Derivative Progress: 1116/1771 symbols completed. LUV took 1.5s. Estimated remaining: 4m 13s. Rate: 155.4 symbols/min [2025-10-08T22:40:49.807177] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:49.832948] [DEBUG] [LOCAL ] LXFR: Loaded 16738 existing records from primary storage. [2025-10-08T22:40:49.833416] [INFO ] [MAIN ] LXFR: Loaded 16738 primary data records. [2025-10-08T22:40:49.996418] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:50.061800] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18174 primary records. [2025-10-08T22:40:50.061904] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-08T22:40:50.167772] [DEBUG] [LOCAL ] LW: Loaded 51218 existing records from primary storage. [2025-10-08T22:40:50.177002] [INFO ] [MAIN ] LW: Loaded 51218 primary data records. [2025-10-08T22:40:50.292523] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-08T22:40:50.301732] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-08T22:40:50.314354] [INFO ] [MAIN ] Derivative Progress: 1117/1771 symbols completed. LVWR took 0.9s. Estimated remaining: 4m 13s. Rate: 155.3 symbols/min [2025-10-08T22:40:50.324869] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:50.518497] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:50.519615] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16738 primary records. [2025-10-08T22:40:50.519821] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-08T22:40:50.549308] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-08T22:40:50.549790] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-08T22:40:50.551712] [INFO ] [MAIN ] Derivative Progress: 1118/1771 symbols completed. LXFR took 0.7s. Estimated remaining: 4m 12s. Rate: 155.4 symbols/min [2025-10-08T22:40:50.551922] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:50.569208] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:50.570730] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51218 primary records. [2025-10-08T22:40:50.584939] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-08T22:40:50.586842] [DEBUG] [LOCAL ] LXP: Loaded 50725 existing records from primary storage. [2025-10-08T22:40:50.587386] [INFO ] [MAIN ] LXP: Loaded 50725 primary data records. [2025-10-08T22:40:50.654111] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-08T22:40:50.675156] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-08T22:40:50.689135] [INFO ] [MAIN ] Derivative Progress: 1119/1771 symbols completed. LW took 1.1s. Estimated remaining: 4m 12s. Rate: 155.5 symbols/min [2025-10-08T22:40:50.694461] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:50.775938] [DEBUG] [LOCAL ] LXU: Loaded 31834 existing records from primary storage. [2025-10-08T22:40:50.805570] [INFO ] [MAIN ] LXU: Loaded 31834 primary data records. [2025-10-08T22:40:51.257351] [DEBUG] [LOCAL ] LYB: Loaded 53610 existing records from primary storage. [2025-10-08T22:40:51.257992] [INFO ] [MAIN ] LYB: Loaded 53610 primary data records. [2025-10-08T22:40:51.433044] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:51.459998] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50725 primary records. [2025-10-08T22:40:51.465792] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-08T22:40:51.604298] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-08T22:40:51.605553] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-08T22:40:51.608681] [INFO ] [MAIN ] Derivative Progress: 1120/1771 symbols completed. LXP took 1.3s. Estimated remaining: 4m 12s. Rate: 155.3 symbols/min [2025-10-08T22:40:51.610351] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:51.625352] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:51.626195] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31834 primary records. [2025-10-08T22:40:51.626399] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-08T22:40:51.647185] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-08T22:40:51.647519] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-08T22:40:51.649563] [INFO ] [MAIN ] Derivative Progress: 1121/1771 symbols completed. LXU took 1.1s. Estimated remaining: 4m 11s. Rate: 155.4 symbols/min [2025-10-08T22:40:51.650074] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:51.669778] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:51.670746] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53610 primary records. [2025-10-08T22:40:51.670951] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-08T22:40:51.703765] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-08T22:40:51.703929] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-08T22:40:51.706236] [INFO ] [MAIN ] Derivative Progress: 1122/1771 symbols completed. LYB took 1.0s. Estimated remaining: 4m 10s. Rate: 155.5 symbols/min [2025-10-08T22:40:51.706610] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:51.723839] [DEBUG] [LOCAL ] LYG: Loaded 52778 existing records from primary storage. [2025-10-08T22:40:51.724022] [INFO ] [MAIN ] LYG: Loaded 52778 primary data records. [2025-10-08T22:40:51.898746] [DEBUG] [LOCAL ] LYV: Loaded 51124 existing records from primary storage. [2025-10-08T22:40:51.957322] [INFO ] [MAIN ] LYV: Loaded 51124 primary data records. [2025-10-08T22:40:52.215562] [DEBUG] [LOCAL ] LZB: Loaded 35057 existing records from primary storage. [2025-10-08T22:40:52.216376] [INFO ] [MAIN ] LZB: Loaded 35057 primary data records. [2025-10-08T22:40:52.751315] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:52.752629] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52778 primary records. [2025-10-08T22:40:52.753257] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-08T22:40:52.787885] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:52.788442] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-08T22:40:52.789415] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-08T22:40:52.789315] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51124 primary records. [2025-10-08T22:40:52.792568] [INFO ] [MAIN ] Derivative Progress: 1123/1771 symbols completed. LYG took 1.2s. Estimated remaining: 4m 10s. Rate: 155.3 symbols/min [2025-10-08T22:40:52.793282] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-08T22:40:52.823120] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:52.824232] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35057 primary records. [2025-10-08T22:40:52.824336] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-08T22:40:52.839135] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-08T22:40:52.839475] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-08T22:40:52.841707] [INFO ] [MAIN ] Derivative Progress: 1124/1771 symbols completed. LYV took 1.2s. Estimated remaining: 4m 10s. Rate: 155.4 symbols/min [2025-10-08T22:40:52.845305] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-08T22:40:52.845396] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-08T22:40:52.847542] [INFO ] [MAIN ] Derivative Progress: 1125/1771 symbols completed. LZB took 1.1s. Estimated remaining: 4m 9s. Rate: 155.5 symbols/min [2025-10-08T22:40:52.847905] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:52.847984] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:52.848349] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:52.866379] [DEBUG] [LOCAL ] LZM: Loaded 14323 existing records from primary storage. [2025-10-08T22:40:52.866522] [INFO ] [MAIN ] LZM: Loaded 14323 primary data records. [2025-10-08T22:40:53.265607] [DEBUG] [LOCAL ] MA: Loaded 52489 existing records from primary storage. [2025-10-08T22:40:53.265927] [INFO ] [MAIN ] MA: Loaded 52489 primary data records. [2025-10-08T22:40:53.267405] [DEBUG] [LOCAL ] M: Loaded 53540 existing records from primary storage. [2025-10-08T22:40:53.304586] [INFO ] [MAIN ] M: Loaded 53540 primary data records. [2025-10-08T22:40:53.780623] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:53.878788] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14323 primary records. [2025-10-08T22:40:53.950300] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-08T22:40:53.970633] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-08T22:40:53.971128] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-08T22:40:53.973414] [INFO ] [MAIN ] Derivative Progress: 1126/1771 symbols completed. LZM took 1.1s. Estimated remaining: 4m 9s. Rate: 155.3 symbols/min [2025-10-08T22:40:53.974513] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:53.996357] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:53.997604] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52489 primary records. [2025-10-08T22:40:53.998009] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-08T22:40:54.025149] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-08T22:40:54.030194] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-08T22:40:54.034777] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:54.034219] [INFO ] [MAIN ] Derivative Progress: 1127/1771 symbols completed. MA took 1.2s. Estimated remaining: 4m 9s. Rate: 155.4 symbols/min [2025-10-08T22:40:54.034999] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:54.036223] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53540 primary records. [2025-10-08T22:40:54.036286] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-08T22:40:54.053283] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-08T22:40:54.053426] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-08T22:40:54.055503] [INFO ] [MAIN ] Derivative Progress: 1128/1771 symbols completed. M took 1.2s. Estimated remaining: 4m 8s. Rate: 155.5 symbols/min [2025-10-08T22:40:54.055879] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:54.107984] [DEBUG] [LOCAL ] MAA: Loaded 42651 existing records from primary storage. [2025-10-08T22:40:54.108281] [INFO ] [MAIN ] MAA: Loaded 42651 primary data records. [2025-10-08T22:40:54.241578] [DEBUG] [LOCAL ] MAC: Loaded 49609 existing records from primary storage. [2025-10-08T22:40:54.237386] [DEBUG] [LOCAL ] MAGN: Loaded 35662 existing records from primary storage. [2025-10-08T22:40:54.241850] [INFO ] [MAIN ] MAC: Loaded 49609 primary data records. [2025-10-08T22:40:54.242313] [INFO ] [MAIN ] MAGN: Loaded 35662 primary data records. [2025-10-08T22:40:55.094741] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:55.100187] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42651 primary records. [2025-10-08T22:40:55.101105] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-08T22:40:55.144992] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:55.146106] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-08T22:40:55.145373] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:55.147177] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49609 primary records. [2025-10-08T22:40:55.146379] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-08T22:40:55.150799] [INFO ] [MAIN ] Derivative Progress: 1129/1771 symbols completed. MAA took 1.2s. Estimated remaining: 4m 8s. Rate: 155.3 symbols/min [2025-10-08T22:40:55.148068] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35662 primary records. [2025-10-08T22:40:55.148221] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-08T22:40:55.151070] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:55.151737] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-08T22:40:55.182689] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-08T22:40:55.183285] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-08T22:40:55.185329] [INFO ] [MAIN ] Derivative Progress: 1130/1771 symbols completed. MAC took 1.2s. Estimated remaining: 4m 7s. Rate: 155.4 symbols/min [2025-10-08T22:40:55.186077] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:55.192759] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-08T22:40:55.192924] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-08T22:40:55.195404] [INFO ] [MAIN ] Derivative Progress: 1131/1771 symbols completed. MAGN took 1.1s. Estimated remaining: 4m 7s. Rate: 155.5 symbols/min [2025-10-08T22:40:55.195787] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:55.230810] [DEBUG] [LOCAL ] MAIN: Loaded 41339 existing records from primary storage. [2025-10-08T22:40:55.231152] [INFO ] [MAIN ] MAIN: Loaded 41339 primary data records. [2025-10-08T22:40:55.400582] [DEBUG] [LOCAL ] MANU: Loaded 26742 existing records from primary storage. [2025-10-08T22:40:55.391262] [DEBUG] [LOCAL ] MAN: Loaded 43573 existing records from primary storage. [2025-10-08T22:40:55.405123] [INFO ] [MAIN ] MANU: Loaded 26742 primary data records. [2025-10-08T22:40:55.411249] [INFO ] [MAIN ] MAN: Loaded 43573 primary data records. [2025-10-08T22:40:56.528543] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:56.531096] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41339 primary records. [2025-10-08T22:40:56.531453] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-08T22:40:56.551623] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-08T22:40:56.552053] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-08T22:40:56.554039] [INFO ] [MAIN ] Derivative Progress: 1132/1771 symbols completed. MAIN took 1.4s. Estimated remaining: 4m 7s. Rate: 155.2 symbols/min [2025-10-08T22:40:56.566727] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:56.567627] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:56.569270] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26742 primary records. [2025-10-08T22:40:56.569351] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-08T22:40:56.600556] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-08T22:40:56.600483] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:56.600787] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-08T22:40:56.603082] [INFO ] [MAIN ] Derivative Progress: 1133/1771 symbols completed. MANU took 1.4s. Estimated remaining: 4m 6s. Rate: 155.3 symbols/min [2025-10-08T22:40:56.603269] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:56.604540] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43573 primary records. [2025-10-08T22:40:56.604736] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-08T22:40:56.621998] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-08T22:40:56.622301] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-08T22:40:56.624562] [INFO ] [MAIN ] Derivative Progress: 1134/1771 symbols completed. MAN took 1.4s. Estimated remaining: 4m 6s. Rate: 155.4 symbols/min [2025-10-08T22:40:56.624786] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:56.686702] [DEBUG] [LOCAL ] MATV: Loaded 35918 existing records from primary storage. [2025-10-08T22:40:56.688141] [DEBUG] [LOCAL ] MAS: Loaded 52277 existing records from primary storage. [2025-10-08T22:40:56.686941] [INFO ] [MAIN ] MATV: Loaded 35918 primary data records. [2025-10-08T22:40:56.688442] [INFO ] [MAIN ] MAS: Loaded 52277 primary data records. [2025-10-08T22:40:56.838039] [DEBUG] [LOCAL ] MATX: Loaded 31313 existing records from primary storage. [2025-10-08T22:40:56.922447] [INFO ] [MAIN ] MATX: Loaded 31313 primary data records. [2025-10-08T22:40:57.663493] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:57.657267] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:40:57.664386] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52277 primary records. [2025-10-08T22:40:57.665493] [INFO ] [MAIN ] MATV: Generated 1793 derivative records from 35918 primary records. [2025-10-08T22:40:57.664624] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-08T22:40:57.666146] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-08T22:40:57.692544] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-08T22:40:57.695491] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-08T22:40:57.701274] [INFO ] [MAIN ] Derivative Progress: 1135/1771 symbols completed. MAS took 1.1s. Estimated remaining: 4m 6s. Rate: 155.2 symbols/min [2025-10-08T22:40:57.702430] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:57.703804] [DEBUG] [LOCAL ] MATV: Derivative data saved (1793 records). [2025-10-08T22:40:57.704025] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-08T22:40:57.706115] [INFO ] [MAIN ] Derivative Progress: 1136/1771 symbols completed. MATV took 1.1s. Estimated remaining: 4m 5s. Rate: 155.3 symbols/min [2025-10-08T22:40:57.708991] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:57.725865] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:57.726751] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31313 primary records. [2025-10-08T22:40:57.726917] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-08T22:40:57.751505] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-08T22:40:57.751740] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-08T22:40:57.753831] [INFO ] [MAIN ] Derivative Progress: 1137/1771 symbols completed. MATX took 1.1s. Estimated remaining: 4m 5s. Rate: 155.4 symbols/min [2025-10-08T22:40:57.754090] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:57.764478] [DEBUG] [LOCAL ] MAX: Loaded 30989 existing records from primary storage. [2025-10-08T22:40:57.764683] [INFO ] [MAIN ] MAX: Loaded 30989 primary data records. [2025-10-08T22:40:58.065986] [DEBUG] [LOCAL ] MBC: Loaded 43559 existing records from primary storage. [2025-10-08T22:40:58.097871] [DEBUG] [LOCAL ] MBI: Loaded 24241 existing records from primary storage. [2025-10-08T22:40:58.097071] [INFO ] [MAIN ] MBC: Loaded 43559 primary data records. [2025-10-08T22:40:58.098067] [INFO ] [MAIN ] MBI: Loaded 24241 primary data records. [2025-10-08T22:40:58.779753] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:58.780795] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30989 primary records. [2025-10-08T22:40:58.780972] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-08T22:40:58.799545] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-08T22:40:58.801099] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-08T22:40:58.803261] [INFO ] [MAIN ] Derivative Progress: 1138/1771 symbols completed. MAX took 1.1s. Estimated remaining: 4m 5s. Rate: 155.2 symbols/min [2025-10-08T22:40:58.824124] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:58.824948] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24241 primary records. [2025-10-08T22:40:58.825100] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-08T22:40:58.837679] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:40:58.838530] [INFO ] [MAIN ] MBC: Generated 1793 derivative records from 43559 primary records. [2025-10-08T22:40:58.838684] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-08T22:40:58.866678] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-08T22:40:58.867019] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-08T22:40:58.871271] [INFO ] [MAIN ] Derivative Progress: 1139/1771 symbols completed. MBI took 1.1s. Estimated remaining: 4m 4s. Rate: 155.3 symbols/min [2025-10-08T22:40:58.869168] [DEBUG] [LOCAL ] MBC: Derivative data saved (1793 records). [2025-10-08T22:40:58.871394] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-08T22:40:58.873956] [INFO ] [MAIN ] Derivative Progress: 1140/1771 symbols completed. MBC took 1.2s. Estimated remaining: 4m 4s. Rate: 155.5 symbols/min [2025-10-08T22:40:58.874761] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:58.874623] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:58.874495] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:58.885362] [DEBUG] [LOCAL ] MCI: Loaded 6483 existing records from primary storage. [2025-10-08T22:40:58.885601] [INFO ] [MAIN ] MCI: Loaded 6483 primary data records. [2025-10-08T22:40:58.989498] [DEBUG] [LOCAL ] MCB: Loaded 11261 existing records from primary storage. [2025-10-08T22:40:59.011058] [INFO ] [MAIN ] MCB: Loaded 11261 primary data records. [2025-10-08T22:40:59.541190] [DEBUG] [LOCAL ] MC: Loaded 43924 existing records from primary storage. [2025-10-08T22:40:59.541951] [INFO ] [MAIN ] MC: Loaded 43924 primary data records. [2025-10-08T22:40:59.871816] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:59.873589] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11261 primary records. [2025-10-08T22:40:59.873919] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-08T22:40:59.900765] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:59.904067] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6483 primary records. [2025-10-08T22:40:59.904579] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-08T22:40:59.923534] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-08T22:40:59.923781] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-08T22:40:59.923672] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-08T22:40:59.926155] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-08T22:40:59.925987] [INFO ] [MAIN ] Derivative Progress: 1141/1771 symbols completed. MCI took 1.1s. Estimated remaining: 4m 4s. Rate: 155.2 symbols/min [2025-10-08T22:40:59.929829] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:59.929947] [INFO ] [MAIN ] Derivative Progress: 1142/1771 symbols completed. MCB took 1.1s. Estimated remaining: 4m 3s. Rate: 155.4 symbols/min [2025-10-08T22:40:59.931353] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:40:59.947187] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:40:59.948018] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43924 primary records. [2025-10-08T22:40:59.948134] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-08T22:40:59.966749] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-08T22:40:59.966891] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-08T22:40:59.973066] [DEBUG] [LOCAL ] MCN: Loaded 8177 existing records from primary storage. [2025-10-08T22:40:59.973249] [INFO ] [MAIN ] MCN: Loaded 8177 primary data records. [2025-10-08T22:40:59.972750] [INFO ] [MAIN ] Derivative Progress: 1143/1771 symbols completed. MC took 1.1s. Estimated remaining: 4m 2s. Rate: 155.5 symbols/min [2025-10-08T22:40:59.978802] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:00.123855] [DEBUG] [LOCAL ] MCK: Loaded 38873 existing records from primary storage. [2025-10-08T22:41:00.189802] [INFO ] [MAIN ] MCK: Loaded 38873 primary data records. [2025-10-08T22:41:00.412889] [DEBUG] [LOCAL ] MCO: Loaded 39229 existing records from primary storage. [2025-10-08T22:41:00.423379] [INFO ] [MAIN ] MCO: Loaded 39229 primary data records. [2025-10-08T22:41:00.997031] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:00.998146] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8177 primary records. [2025-10-08T22:41:00.998361] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-08T22:41:01.033232] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:01.033734] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-08T22:41:01.035520] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38873 primary records. [2025-10-08T22:41:01.037225] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-08T22:41:01.036496] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-08T22:41:01.039592] [INFO ] [MAIN ] Derivative Progress: 1144/1771 symbols completed. MCN took 1.1s. Estimated remaining: 4m 2s. Rate: 155.2 symbols/min [2025-10-08T22:41:01.040726] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:01.067621] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:01.070832] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39229 primary records. [2025-10-08T22:41:01.070970] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-08T22:41:01.069898] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-08T22:41:01.071107] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-08T22:41:01.073561] [INFO ] [MAIN ] Derivative Progress: 1145/1771 symbols completed. MCK took 1.1s. Estimated remaining: 4m 2s. Rate: 155.4 symbols/min [2025-10-08T22:41:01.076874] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:01.097413] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-08T22:41:01.096310] [DEBUG] [LOCAL ] MCR: Loaded 8911 existing records from primary storage. [2025-10-08T22:41:01.097892] [INFO ] [MAIN ] MCR: Loaded 8911 primary data records. [2025-10-08T22:41:01.097576] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-08T22:41:01.105867] [INFO ] [MAIN ] Derivative Progress: 1146/1771 symbols completed. MCO took 1.1s. Estimated remaining: 4m 1s. Rate: 155.5 symbols/min [2025-10-08T22:41:01.121381] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:01.296887] [DEBUG] [LOCAL ] MCS: Loaded 20952 existing records from primary storage. [2025-10-08T22:41:01.307778] [INFO ] [MAIN ] MCS: Loaded 20952 primary data records. [2025-10-08T22:41:01.308445] [DEBUG] [LOCAL ] MCY: Loaded 23972 existing records from primary storage. [2025-10-08T22:41:01.316313] [INFO ] [MAIN ] MCY: Loaded 23972 primary data records. [2025-10-08T22:41:02.127612] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:02.129339] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8911 primary records. [2025-10-08T22:41:02.129886] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-08T22:41:02.156878] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-08T22:41:02.157471] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-08T22:41:02.160551] [INFO ] [MAIN ] Derivative Progress: 1147/1771 symbols completed. MCR took 1.1s. Estimated remaining: 4m 1s. Rate: 155.3 symbols/min [2025-10-08T22:41:02.174951] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:02.174733] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:02.177020] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 20952 primary records. [2025-10-08T22:41:02.178006] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-08T22:41:02.211250] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:02.212792] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 23972 primary records. [2025-10-08T22:41:02.215670] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-08T22:41:02.234792] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-08T22:41:02.236117] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-08T22:41:02.239068] [INFO ] [MAIN ] Derivative Progress: 1148/1771 symbols completed. MCS took 1.2s. Estimated remaining: 4m 1s. Rate: 155.4 symbols/min [2025-10-08T22:41:02.235925] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-08T22:41:02.239314] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-08T22:41:02.241572] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:02.241996] [INFO ] [MAIN ] Derivative Progress: 1149/1771 symbols completed. MCY took 1.1s. Estimated remaining: 4m 0s. Rate: 155.5 symbols/min [2025-10-08T22:41:02.251526] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:02.271015] [DEBUG] [LOCAL ] MD: Loaded 38488 existing records from primary storage. [2025-10-08T22:41:02.271325] [INFO ] [MAIN ] MD: Loaded 38488 primary data records. [2025-10-08T22:41:02.307900] [DEBUG] [LOCAL ] MDST: Loaded 5734 existing records from primary storage. [2025-10-08T22:41:02.359623] [INFO ] [MAIN ] MDST: Loaded 5734 primary data records. [2025-10-08T22:41:02.782584] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-08T22:41:02.823505] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-08T22:41:03.275510] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:03.277206] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38488 primary records. [2025-10-08T22:41:03.277614] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-08T22:41:03.298233] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-08T22:41:03.306867] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-08T22:41:03.313540] [INFO ] [MAIN ] Derivative Progress: 1150/1771 symbols completed. MD took 1.1s. Estimated remaining: 3m 60s. Rate: 155.3 symbols/min [2025-10-08T22:41:03.314426] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:03.315739] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:03.316671] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5734 primary records. [2025-10-08T22:41:03.316819] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-08T22:41:03.337988] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-08T22:41:03.338973] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-08T22:41:03.341236] [INFO ] [MAIN ] Derivative Progress: 1151/1771 symbols completed. MDST took 1.1s. Estimated remaining: 3m 59s. Rate: 155.4 symbols/min [2025-10-08T22:41:03.341543] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:03.355368] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:03.356087] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-08T22:41:03.356283] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-08T22:41:03.388029] [DEBUG] [LOCAL ] MDV: Loaded 8529 existing records from primary storage. [2025-10-08T22:41:03.389407] [INFO ] [MAIN ] MDV: Loaded 8529 primary data records. [2025-10-08T22:41:03.390217] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-08T22:41:03.390302] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-08T22:41:03.403913] [INFO ] [MAIN ] Derivative Progress: 1152/1771 symbols completed. MDT took 1.2s. Estimated remaining: 3m 59s. Rate: 155.5 symbols/min [2025-10-08T22:41:03.436560] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:03.538828] [DEBUG] [LOCAL ] MDU: Loaded 47997 existing records from primary storage. [2025-10-08T22:41:03.586686] [INFO ] [MAIN ] MDU: Loaded 47997 primary data records. [2025-10-08T22:41:03.790799] [DEBUG] [LOCAL ] MEC: Loaded 16257 existing records from primary storage. [2025-10-08T22:41:03.824338] [INFO ] [MAIN ] MEC: Loaded 16257 primary data records. [2025-10-08T22:41:04.422806] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:04.426704] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8529 primary records. [2025-10-08T22:41:04.427477] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-08T22:41:04.447444] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-08T22:41:04.448066] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-08T22:41:04.450580] [INFO ] [MAIN ] Derivative Progress: 1153/1771 symbols completed. MDV took 1.1s. Estimated remaining: 3m 59s. Rate: 155.3 symbols/min [2025-10-08T22:41:04.467723] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:04.468477] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47997 primary records. [2025-10-08T22:41:04.468689] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-08T22:41:04.496388] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:04.497549] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16257 primary records. [2025-10-08T22:41:04.497812] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-08T22:41:04.514863] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-08T22:41:04.515150] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-08T22:41:04.515909] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-08T22:41:04.518287] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-08T22:41:04.518213] [INFO ] [MAIN ] Derivative Progress: 1154/1771 symbols completed. MDU took 1.2s. Estimated remaining: 3m 58s. Rate: 155.4 symbols/min [2025-10-08T22:41:04.520682] [INFO ] [MAIN ] Derivative Progress: 1155/1771 symbols completed. MEC took 1.1s. Estimated remaining: 3m 58s. Rate: 155.5 symbols/min [2025-10-08T22:41:04.521180] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:04.521117] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:04.521255] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:04.560029] [DEBUG] [LOCAL ] MEGI: Loaded 20022 existing records from primary storage. [2025-10-08T22:41:04.573284] [INFO ] [MAIN ] MEGI: Loaded 20022 primary data records. [2025-10-08T22:41:04.606950] [DEBUG] [LOCAL ] MED: Loaded 21379 existing records from primary storage. [2025-10-08T22:41:04.678022] [INFO ] [MAIN ] MED: Loaded 21379 primary data records. [2025-10-08T22:41:04.689981] [DEBUG] [LOCAL ] MEG: Loaded 31440 existing records from primary storage. [2025-10-08T22:41:04.690287] [INFO ] [MAIN ] MEG: Loaded 31440 primary data records. [2025-10-08T22:41:05.563376] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:05.564720] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20022 primary records. [2025-10-08T22:41:05.565012] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-08T22:41:05.589740] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:05.594712] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21379 primary records. [2025-10-08T22:41:05.595061] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-08T22:41:05.620058] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:05.628332] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31440 primary records. [2025-10-08T22:41:05.629116] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-08T22:41:05.632598] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-08T22:41:05.633984] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-08T22:41:05.637468] [INFO ] [MAIN ] Derivative Progress: 1156/1771 symbols completed. MED took 1.1s. Estimated remaining: 3m 58s. Rate: 155.3 symbols/min [2025-10-08T22:41:05.646753] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:05.650941] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-08T22:41:05.652917] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-08T22:41:05.655829] [INFO ] [MAIN ] Derivative Progress: 1157/1771 symbols completed. MEGI took 1.1s. Estimated remaining: 3m 57s. Rate: 155.4 symbols/min [2025-10-08T22:41:05.656290] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:05.659563] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-08T22:41:05.659732] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-08T22:41:05.662357] [INFO ] [MAIN ] Derivative Progress: 1158/1771 symbols completed. MEG took 1.1s. Estimated remaining: 3m 57s. Rate: 155.5 symbols/min [2025-10-08T22:41:05.662737] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:05.691085] [DEBUG] [LOCAL ] MEI: Loaded 31802 existing records from primary storage. [2025-10-08T22:41:05.691374] [INFO ] [MAIN ] MEI: Loaded 31802 primary data records. [2025-10-08T22:41:06.024813] [DEBUG] [LOCAL ] MET: Loaded 53326 existing records from primary storage. [2025-10-08T22:41:06.037399] [INFO ] [MAIN ] MET: Loaded 53326 primary data records. [2025-10-08T22:41:06.058936] [DEBUG] [LOCAL ] MFA: Loaded 45676 existing records from primary storage. [2025-10-08T22:41:06.094079] [INFO ] [MAIN ] MFA: Loaded 45676 primary data records. [2025-10-08T22:41:06.685594] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:06.687856] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31802 primary records. [2025-10-08T22:41:06.688016] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-08T22:41:06.705204] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-08T22:41:06.705895] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-08T22:41:06.709081] [INFO ] [MAIN ] Derivative Progress: 1159/1771 symbols completed. MEI took 1.1s. Estimated remaining: 3m 56s. Rate: 155.3 symbols/min [2025-10-08T22:41:06.709757] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:06.732424] [DEBUG] [LOCAL ] MFAN: Loaded 4377 existing records from primary storage. [2025-10-08T22:41:06.732860] [INFO ] [MAIN ] MFAN: Loaded 4377 primary data records. [2025-10-08T22:41:06.729780] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:06.754246] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53326 primary records. [2025-10-08T22:41:06.764621] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-08T22:41:06.868755] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:06.880289] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45676 primary records. [2025-10-08T22:41:06.885916] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-08T22:41:06.954355] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-08T22:41:07.025448] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-08T22:41:07.080722] [INFO ] [MAIN ] Derivative Progress: 1160/1771 symbols completed. MET took 1.4s. Estimated remaining: 3m 56s. Rate: 155.3 symbols/min [2025-10-08T22:41:07.081837] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:07.090815] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-08T22:41:07.091731] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-08T22:41:07.094053] [INFO ] [MAIN ] Derivative Progress: 1161/1771 symbols completed. MFA took 1.4s. Estimated remaining: 3m 55s. Rate: 155.4 symbols/min [2025-10-08T22:41:07.097433] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:07.097270] [DEBUG] [LOCAL ] MFAO: Loaded 3946 existing records from primary storage. [2025-10-08T22:41:07.098985] [INFO ] [MAIN ] MFAO: Loaded 3946 primary data records. [2025-10-08T22:41:07.409895] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:07.424367] [INFO ] [MAIN ] MFAN: Generated 1793 derivative records from 4377 primary records. [2025-10-08T22:41:07.424615] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-08T22:41:07.441700] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1793 records). [2025-10-08T22:41:07.442066] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-08T22:41:07.457097] [INFO ] [MAIN ] Derivative Progress: 1162/1771 symbols completed. MFAN took 0.7s. Estimated remaining: 3m 55s. Rate: 155.4 symbols/min [2025-10-08T22:41:07.459854] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:07.460857] [DEBUG] [LOCAL ] MFC: Loaded 51103 existing records from primary storage. [2025-10-08T22:41:07.461114] [INFO ] [MAIN ] MFC: Loaded 51103 primary data records. [2025-10-08T22:41:07.780325] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7730 incomplete bins [2025-10-08T22:41:07.781715] [INFO ] [MAIN ] MFAO: Generated 1788 derivative records from 3946 primary records. [2025-10-08T22:41:07.781865] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-08T22:41:07.797452] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1788 records). [2025-10-08T22:41:07.798785] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-08T22:41:07.801049] [INFO ] [MAIN ] Derivative Progress: 1163/1771 symbols completed. MFAO took 0.7s. Estimated remaining: 3m 55s. Rate: 155.4 symbols/min [2025-10-08T22:41:07.815050] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:07.817438] [DEBUG] [LOCAL ] MFG: Loaded 49362 existing records from primary storage. [2025-10-08T22:41:07.817677] [INFO ] [MAIN ] MFG: Loaded 49362 primary data records. [2025-10-08T22:41:07.931037] [DEBUG] [LOCAL ] MFM: Loaded 14800 existing records from primary storage. [2025-10-08T22:41:07.931501] [INFO ] [MAIN ] MFM: Loaded 14800 primary data records. [2025-10-08T22:41:08.282008] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:08.294056] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51103 primary records. [2025-10-08T22:41:08.324890] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-08T22:41:08.492669] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-08T22:41:08.492986] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-08T22:41:08.495891] [INFO ] [MAIN ] Derivative Progress: 1164/1771 symbols completed. MFC took 1.4s. Estimated remaining: 3m 54s. Rate: 155.3 symbols/min [2025-10-08T22:41:08.497970] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:08.507898] [DEBUG] [LOCAL ] MFSG: Loaded 5540 existing records from primary storage. [2025-10-08T22:41:08.508401] [INFO ] [MAIN ] MFSG: Loaded 5540 primary data records. [2025-10-08T22:41:08.639491] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:08.670319] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49362 primary records. [2025-10-08T22:41:08.830328] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:08.720931] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-08T22:41:08.840335] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14800 primary records. [2025-10-08T22:41:08.842028] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-08T22:41:08.871569] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-08T22:41:08.872390] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-08T22:41:08.876374] [INFO ] [MAIN ] Derivative Progress: 1165/1771 symbols completed. MFM took 1.1s. Estimated remaining: 3m 54s. Rate: 155.3 symbols/min [2025-10-08T22:41:08.876629] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:08.879265] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-08T22:41:08.879497] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-08T22:41:08.881899] [INFO ] [MAIN ] Derivative Progress: 1166/1771 symbols completed. MFG took 1.4s. Estimated remaining: 3m 53s. Rate: 155.5 symbols/min [2025-10-08T22:41:08.883614] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:08.892093] [DEBUG] [LOCAL ] MFSV: Loaded 2679 existing records from primary storage. [2025-10-08T22:41:08.892460] [INFO ] [MAIN ] MFSV: Loaded 2679 primary data records. [2025-10-08T22:41:08.933324] [DEBUG] [LOCAL ] MFSI: Loaded 11732 existing records from primary storage. [2025-10-08T22:41:08.961864] [INFO ] [MAIN ] MFSI: Loaded 11732 primary data records. [2025-10-08T22:41:09.112060] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:09.116031] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5540 primary records. [2025-10-08T22:41:09.116145] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-08T22:41:09.546330] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-08T22:41:09.547191] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-08T22:41:09.556177] [INFO ] [MAIN ] Derivative Progress: 1167/1771 symbols completed. MFSG took 1.1s. Estimated remaining: 3m 53s. Rate: 155.4 symbols/min [2025-10-08T22:41:09.556910] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:09.580233] [DEBUG] [LOCAL ] MG: Loaded 16154 existing records from primary storage. [2025-10-08T22:41:09.580969] [INFO ] [MAIN ] MG: Loaded 16154 primary data records. [2025-10-08T22:41:09.650031] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:41:09.688498] [INFO ] [MAIN ] MFSV: Generated 1792 derivative records from 2679 primary records. [2025-10-08T22:41:09.696204] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-08T22:41:09.722876] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:09.734514] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 11732 primary records. [2025-10-08T22:41:09.734615] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-08T22:41:09.797454] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-08T22:41:09.797569] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-08T22:41:09.800500] [INFO ] [MAIN ] Derivative Progress: 1168/1771 symbols completed. MFSI took 0.9s. Estimated remaining: 3m 53s. Rate: 155.4 symbols/min [2025-10-08T22:41:09.822600] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1792 records). [2025-10-08T22:41:09.826814] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-08T22:41:09.981810] [INFO ] [MAIN ] Derivative Progress: 1169/1771 symbols completed. MFSV took 1.1s. Estimated remaining: 3m 52s. Rate: 155.5 symbols/min [2025-10-08T22:41:10.028072] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:10.028724] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16154 primary records. [2025-10-08T22:41:10.028789] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-08T22:41:10.043814] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-08T22:41:10.043873] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-08T22:41:10.046348] [INFO ] [MAIN ] Derivative Progress: 1170/1771 symbols completed. MG took 0.5s. Estimated remaining: 3m 52s. Rate: 155.6 symbols/min [2025-10-08T22:41:10.047004] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:10.046935] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:10.047088] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:10.055281] [DEBUG] [LOCAL ] MGF: Loaded 4286 existing records from primary storage. [2025-10-08T22:41:10.055551] [INFO ] [MAIN ] MGF: Loaded 4286 primary data records. [2025-10-08T22:41:10.415811] [DEBUG] [LOCAL ] MGA: Loaded 50675 existing records from primary storage. [2025-10-08T22:41:10.417062] [INFO ] [MAIN ] MGA: Loaded 50675 primary data records. [2025-10-08T22:41:10.509976] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-08T22:41:10.536906] [INFO ] [MAIN ] MGM: Loaded 53607 primary data records. [2025-10-08T22:41:11.058993] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:11.060587] [INFO ] [MAIN ] MGF: Generated 1793 derivative records from 4286 primary records. [2025-10-08T22:41:11.063041] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-08T22:41:11.084285] [DEBUG] [LOCAL ] MGF: Derivative data saved (1793 records). [2025-10-08T22:41:11.084619] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-08T22:41:11.087201] [INFO ] [MAIN ] Derivative Progress: 1171/1771 symbols completed. MGF took 1.0s. Estimated remaining: 3m 52s. Rate: 155.4 symbols/min [2025-10-08T22:41:11.087468] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:11.100882] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:11.101679] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50675 primary records. [2025-10-08T22:41:11.101754] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-08T22:41:11.134823] [DEBUG] [LOCAL ] MGR: Loaded 5606 existing records from primary storage. [2025-10-08T22:41:11.136490] [INFO ] [MAIN ] MGR: Loaded 5606 primary data records. [2025-10-08T22:41:11.136598] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-08T22:41:11.147784] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-08T22:41:11.159087] [INFO ] [MAIN ] Derivative Progress: 1172/1771 symbols completed. MGA took 1.1s. Estimated remaining: 3m 51s. Rate: 155.5 symbols/min [2025-10-08T22:41:11.174700] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:11.175041] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:11.182493] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53607 primary records. [2025-10-08T22:41:11.194479] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-08T22:41:11.277632] [DEBUG] [LOCAL ] MGRB: Loaded 4067 existing records from primary storage. [2025-10-08T22:41:11.301493] [INFO ] [MAIN ] MGRB: Loaded 4067 primary data records. [2025-10-08T22:41:11.532206] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-08T22:41:11.543870] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-08T22:41:11.558170] [INFO ] [MAIN ] Derivative Progress: 1173/1771 symbols completed. MGM took 1.5s. Estimated remaining: 3m 51s. Rate: 155.5 symbols/min [2025-10-08T22:41:11.558812] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:11.756322] [DEBUG] [LOCAL ] MGRD: Loaded 2240 existing records from primary storage. [2025-10-08T22:41:11.756721] [INFO ] [MAIN ] MGRD: Loaded 2240 primary data records. [2025-10-08T22:41:11.952604] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:12.084942] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5606 primary records. [2025-10-08T22:41:12.106174] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-08T22:41:12.136947] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-08T22:41:12.149084] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-08T22:41:12.153817] [INFO ] [MAIN ] Derivative Progress: 1174/1771 symbols completed. MGR took 1.1s. Estimated remaining: 3m 50s. Rate: 155.4 symbols/min [2025-10-08T22:41:12.154663] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:12.154549] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:12.155786] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4067 primary records. [2025-10-08T22:41:12.156321] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-08T22:41:12.175630] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-08T22:41:12.181087] [DEBUG] [LOCAL ] MGRE: Loaded 6697 existing records from primary storage. [2025-10-08T22:41:12.177133] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-08T22:41:12.181517] [INFO ] [MAIN ] MGRE: Loaded 6697 primary data records. [2025-10-08T22:41:12.184265] [INFO ] [MAIN ] Derivative Progress: 1175/1771 symbols completed. MGRB took 1.0s. Estimated remaining: 3m 50s. Rate: 155.5 symbols/min [2025-10-08T22:41:12.213056] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:12.232778] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:12.241973] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2240 primary records. [2025-10-08T22:41:12.254411] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-08T22:41:12.316369] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-08T22:41:12.327150] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-08T22:41:12.345150] [INFO ] [MAIN ] Derivative Progress: 1176/1771 symbols completed. MGRD took 0.8s. Estimated remaining: 3m 49s. Rate: 155.6 symbols/min [2025-10-08T22:41:12.345320] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:12.522035] [DEBUG] [LOCAL ] MHD: Loaded 12479 existing records from primary storage. [2025-10-08T22:41:12.522375] [INFO ] [MAIN ] MHD: Loaded 12479 primary data records. [2025-10-08T22:41:12.847335] [DEBUG] [LOCAL ] MGY: Loaded 52395 existing records from primary storage. [2025-10-08T22:41:12.847832] [INFO ] [MAIN ] MGY: Loaded 52395 primary data records. [2025-10-08T22:41:12.970622] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:13.000448] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6697 primary records. [2025-10-08T22:41:13.066608] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-08T22:41:13.212907] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-08T22:41:13.213617] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-08T22:41:13.218008] [INFO ] [MAIN ] Derivative Progress: 1177/1771 symbols completed. MGRE took 1.1s. Estimated remaining: 3m 49s. Rate: 155.4 symbols/min [2025-10-08T22:41:13.219588] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:13.237118] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:13.238103] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12479 primary records. [2025-10-08T22:41:13.238329] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-08T22:41:13.263085] [DEBUG] [LOCAL ] MHF: Loaded 8688 existing records from primary storage. [2025-10-08T22:41:13.267935] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-08T22:41:13.268786] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-08T22:41:13.268892] [INFO ] [MAIN ] MHF: Loaded 8688 primary data records. [2025-10-08T22:41:13.279063] [INFO ] [MAIN ] Derivative Progress: 1178/1771 symbols completed. MHD took 0.9s. Estimated remaining: 3m 49s. Rate: 155.6 symbols/min [2025-10-08T22:41:13.317439] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:13.379937] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:13.391556] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52395 primary records. [2025-10-08T22:41:13.391813] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-08T22:41:13.613113] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-08T22:41:13.613259] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-08T22:41:13.616304] [INFO ] [MAIN ] Derivative Progress: 1179/1771 symbols completed. MGY took 1.4s. Estimated remaining: 3m 48s. Rate: 155.6 symbols/min [2025-10-08T22:41:13.616630] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:13.637347] [DEBUG] [LOCAL ] MHK: Loaded 42238 existing records from primary storage. [2025-10-08T22:41:13.638893] [INFO ] [MAIN ] MHK: Loaded 42238 primary data records. [2025-10-08T22:41:13.686865] [DEBUG] [LOCAL ] MHN: Loaded 7586 existing records from primary storage. [2025-10-08T22:41:13.727628] [INFO ] [MAIN ] MHN: Loaded 7586 primary data records. [2025-10-08T22:41:14.364141] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:14.378342] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8688 primary records. [2025-10-08T22:41:14.378486] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-08T22:41:14.398925] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-08T22:41:14.399344] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-08T22:41:14.401898] [INFO ] [MAIN ] Derivative Progress: 1180/1771 symbols completed. MHF took 1.2s. Estimated remaining: 3m 48s. Rate: 155.4 symbols/min [2025-10-08T22:41:14.402060] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:14.423734] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:14.425517] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42238 primary records. [2025-10-08T22:41:14.425686] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-08T22:41:14.458751] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:14.459991] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7586 primary records. [2025-10-08T22:41:14.460091] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-08T22:41:14.469713] [DEBUG] [LOCAL ] MHO: Loaded 23737 existing records from primary storage. [2025-10-08T22:41:14.470237] [INFO ] [MAIN ] MHO: Loaded 23737 primary data records. [2025-10-08T22:41:14.540162] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-08T22:41:14.540283] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-08T22:41:14.527513] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-08T22:41:14.551221] [INFO ] [MAIN ] Derivative Progress: 1181/1771 symbols completed. MHN took 0.9s. Estimated remaining: 3m 48s. Rate: 155.5 symbols/min [2025-10-08T22:41:14.551380] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:14.561830] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-08T22:41:14.570193] [INFO ] [MAIN ] Derivative Progress: 1182/1771 symbols completed. MHK took 1.3s. Estimated remaining: 3m 47s. Rate: 155.6 symbols/min [2025-10-08T22:41:14.590953] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:14.658578] [DEBUG] [LOCAL ] MIN: Loaded 13585 existing records from primary storage. [2025-10-08T22:41:14.687808] [INFO ] [MAIN ] MIN: Loaded 13585 primary data records. [2025-10-08T22:41:15.146596] [DEBUG] [LOCAL ] MIR: Loaded 51139 existing records from primary storage. [2025-10-08T22:41:15.147074] [INFO ] [MAIN ] MIR: Loaded 51139 primary data records. [2025-10-08T22:41:15.472722] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:15.474106] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23737 primary records. [2025-10-08T22:41:15.474381] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-08T22:41:15.502393] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:15.505816] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13585 primary records. [2025-10-08T22:41:15.506464] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-08T22:41:15.527159] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-08T22:41:15.524953] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-08T22:41:15.528353] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-08T22:41:15.528438] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-08T22:41:15.530791] [INFO ] [MAIN ] Derivative Progress: 1183/1771 symbols completed. MIN took 1.0s. Estimated remaining: 3m 47s. Rate: 155.4 symbols/min [2025-10-08T22:41:15.533341] [INFO ] [MAIN ] Derivative Progress: 1184/1771 symbols completed. MHO took 1.1s. Estimated remaining: 3m 46s. Rate: 155.6 symbols/min [2025-10-08T22:41:15.551052] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:15.551589] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51139 primary records. [2025-10-08T22:41:15.551670] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-08T22:41:15.567864] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-08T22:41:15.567943] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-08T22:41:15.570137] [INFO ] [MAIN ] Derivative Progress: 1185/1771 symbols completed. MIR took 1.0s. Estimated remaining: 3m 46s. Rate: 155.7 symbols/min [2025-10-08T22:41:15.570850] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:15.570782] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:15.571276] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:15.576334] [DEBUG] [LOCAL ] MITP: Loaded 2361 existing records from primary storage. [2025-10-08T22:41:15.576624] [INFO ] [MAIN ] MITP: Loaded 2361 primary data records. [2025-10-08T22:41:15.690782] [DEBUG] [LOCAL ] MIY: Loaded 6115 existing records from primary storage. [2025-10-08T22:41:15.701549] [INFO ] [MAIN ] MIY: Loaded 6115 primary data records. [2025-10-08T22:41:15.730084] [DEBUG] [LOCAL ] MITT: Loaded 22667 existing records from primary storage. [2025-10-08T22:41:15.761604] [INFO ] [MAIN ] MITT: Loaded 22667 primary data records. [2025-10-08T22:41:16.603513] [DEBUG] [MAIN ] MITP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:16.606277] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2361 primary records. [2025-10-08T22:41:16.607068] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-08T22:41:16.628157] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:16.632035] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6115 primary records. [2025-10-08T22:41:16.633123] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-08T22:41:16.650685] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-10-08T22:41:16.654527] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-08T22:41:16.654718] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-08T22:41:16.656939] [INFO ] [MAIN ] Derivative Progress: 1186/1771 symbols completed. MITP took 1.1s. Estimated remaining: 3m 46s. Rate: 155.5 symbols/min [2025-10-08T22:41:16.657333] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:16.657021] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-08T22:41:16.659900] [INFO ] [MAIN ] Derivative Progress: 1187/1771 symbols completed. MIY took 1.1s. Estimated remaining: 3m 45s. Rate: 155.6 symbols/min [2025-10-08T22:41:16.672817] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:16.673116] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:16.674236] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22667 primary records. [2025-10-08T22:41:16.674407] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-08T22:41:16.691318] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-08T22:41:16.691590] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-08T22:41:16.693878] [INFO ] [MAIN ] Derivative Progress: 1188/1771 symbols completed. MITT took 1.1s. Estimated remaining: 3m 45s. Rate: 155.7 symbols/min [2025-10-08T22:41:16.694049] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:16.756427] [DEBUG] [LOCAL ] MKL: Loaded 34148 existing records from primary storage. [2025-10-08T22:41:16.756760] [INFO ] [MAIN ] MKL: Loaded 34148 primary data records. [2025-10-08T22:41:16.842380] [DEBUG] [LOCAL ] MKC: Loaded 52525 existing records from primary storage. [2025-10-08T22:41:16.876929] [INFO ] [MAIN ] MKC: Loaded 52525 primary data records. [2025-10-08T22:41:16.877513] [DEBUG] [LOCAL ] MLI: Loaded 43470 existing records from primary storage. [2025-10-08T22:41:16.907140] [INFO ] [MAIN ] MLI: Loaded 43470 primary data records. [2025-10-08T22:41:17.735238] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:17.748681] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:17.748350] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34148 primary records. [2025-10-08T22:41:17.749621] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-08T22:41:17.749481] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43470 primary records. [2025-10-08T22:41:17.749746] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-08T22:41:17.769204] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-08T22:41:17.769332] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-08T22:41:17.791511] [INFO ] [MAIN ] Derivative Progress: 1189/1771 symbols completed. MKL took 1.1s. Estimated remaining: 3m 45s. Rate: 155.5 symbols/min [2025-10-08T22:41:17.796868] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:17.794501] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:17.798816] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52525 primary records. [2025-10-08T22:41:17.798912] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-08T22:41:17.809334] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-08T22:41:17.813216] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-08T22:41:17.815526] [INFO ] [MAIN ] Derivative Progress: 1190/1771 symbols completed. MLI took 1.1s. Estimated remaining: 3m 44s. Rate: 155.6 symbols/min [2025-10-08T22:41:17.815771] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:17.830786] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-08T22:41:17.830951] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-08T22:41:17.833063] [INFO ] [MAIN ] Derivative Progress: 1191/1771 symbols completed. MKC took 1.2s. Estimated remaining: 3m 43s. Rate: 155.7 symbols/min [2025-10-08T22:41:17.833392] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:17.852048] [DEBUG] [LOCAL ] MLM: Loaded 29400 existing records from primary storage. [2025-10-08T22:41:17.852349] [INFO ] [MAIN ] MLM: Loaded 29400 primary data records. [2025-10-08T22:41:17.875833] [DEBUG] [LOCAL ] MLP: Loaded 3000 existing records from primary storage. [2025-10-08T22:41:17.933011] [DEBUG] [LOCAL ] MLNK: Loaded 25802 existing records from primary storage. [2025-10-08T22:41:17.944663] [INFO ] [MAIN ] MLNK: Loaded 25802 primary data records. [2025-10-08T22:41:17.906254] [INFO ] [MAIN ] MLP: Loaded 3000 primary data records. [2025-10-08T22:41:18.821413] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:18.823825] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 29400 primary records. [2025-10-08T22:41:18.824026] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-08T22:41:18.862754] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:18.863021] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:18.864394] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3000 primary records. [2025-10-08T22:41:18.865352] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25802 primary records. [2025-10-08T22:41:18.865784] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-08T22:41:18.865424] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-08T22:41:18.892523] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-08T22:41:18.893863] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-08T22:41:18.896193] [INFO ] [MAIN ] Derivative Progress: 1192/1771 symbols completed. MLM took 1.1s. Estimated remaining: 3m 43s. Rate: 155.5 symbols/min [2025-10-08T22:41:18.897200] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:18.898793] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-10-08T22:41:18.899232] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-08T22:41:18.901509] [INFO ] [MAIN ] Derivative Progress: 1193/1771 symbols completed. MLP took 1.1s. Estimated remaining: 3m 43s. Rate: 155.6 symbols/min [2025-10-08T22:41:18.901752] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:18.905870] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-08T22:41:18.906039] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-08T22:41:18.908425] [INFO ] [MAIN ] Derivative Progress: 1194/1771 symbols completed. MLNK took 1.1s. Estimated remaining: 3m 42s. Rate: 155.7 symbols/min [2025-10-08T22:41:18.908737] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:18.920261] [DEBUG] [LOCAL ] MLR: Loaded 12370 existing records from primary storage. [2025-10-08T22:41:18.920414] [INFO ] [MAIN ] MLR: Loaded 12370 primary data records. [2025-10-08T22:41:19.015147] [DEBUG] [LOCAL ] MMD: Loaded 11207 existing records from primary storage. [2025-10-08T22:41:19.020868] [INFO ] [MAIN ] MMD: Loaded 11207 primary data records. [2025-10-08T22:41:19.434450] [DEBUG] [LOCAL ] MMC: Loaded 51871 existing records from primary storage. [2025-10-08T22:41:19.466251] [INFO ] [MAIN ] MMC: Loaded 51871 primary data records. [2025-10-08T22:41:19.994699] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:19.996052] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12370 primary records. [2025-10-08T22:41:19.996470] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-08T22:41:20.010546] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:20.019783] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11207 primary records. [2025-10-08T22:41:20.020047] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-08T22:41:20.043563] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-08T22:41:20.043915] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-08T22:41:20.046331] [INFO ] [MAIN ] Derivative Progress: 1195/1771 symbols completed. MMD took 1.1s. Estimated remaining: 3m 42s. Rate: 155.5 symbols/min [2025-10-08T22:41:20.047917] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:20.058136] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-08T22:41:20.063369] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-08T22:41:20.065810] [INFO ] [MAIN ] Derivative Progress: 1196/1771 symbols completed. MLR took 1.2s. Estimated remaining: 3m 42s. Rate: 155.6 symbols/min [2025-10-08T22:41:20.065961] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:20.063745] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:20.067302] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51871 primary records. [2025-10-08T22:41:20.067383] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-08T22:41:20.094269] [DEBUG] [LOCAL ] MMI: Loaded 15200 existing records from primary storage. [2025-10-08T22:41:20.095507] [INFO ] [MAIN ] MMI: Loaded 15200 primary data records. [2025-10-08T22:41:20.096067] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-08T22:41:20.117852] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-08T22:41:20.136164] [INFO ] [MAIN ] Derivative Progress: 1197/1771 symbols completed. MMC took 1.2s. Estimated remaining: 3m 41s. Rate: 155.7 symbols/min [2025-10-08T22:41:20.156481] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:20.461452] [DEBUG] [LOCAL ] MMS: Loaded 33877 existing records from primary storage. [2025-10-08T22:41:20.462314] [INFO ] [MAIN ] MMS: Loaded 33877 primary data records. [2025-10-08T22:41:20.475588] [DEBUG] [LOCAL ] MMM: Loaded 53127 existing records from primary storage. [2025-10-08T22:41:20.500607] [INFO ] [MAIN ] MMM: Loaded 53127 primary data records. [2025-10-08T22:41:21.083376] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:21.085285] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15200 primary records. [2025-10-08T22:41:21.085407] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-08T22:41:21.107551] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-08T22:41:21.107782] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-08T22:41:21.110139] [INFO ] [MAIN ] Derivative Progress: 1198/1771 symbols completed. MMI took 1.1s. Estimated remaining: 3m 41s. Rate: 155.5 symbols/min [2025-10-08T22:41:21.127784] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:21.128519] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33877 primary records. [2025-10-08T22:41:21.128703] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-08T22:41:21.158182] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:21.159428] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53127 primary records. [2025-10-08T22:41:21.159761] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-08T22:41:21.161298] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-08T22:41:21.161730] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-08T22:41:21.164751] [INFO ] [MAIN ] Derivative Progress: 1199/1771 symbols completed. MMS took 1.0s. Estimated remaining: 3m 41s. Rate: 155.6 symbols/min [2025-10-08T22:41:21.184010] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-08T22:41:21.184124] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-08T22:41:21.186518] [INFO ] [MAIN ] Derivative Progress: 1200/1771 symbols completed. MMM took 1.1s. Estimated remaining: 3m 40s. Rate: 155.7 symbols/min [2025-10-08T22:41:21.187347] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:21.187201] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:21.187086] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:21.210163] [DEBUG] [LOCAL ] MMT: Loaded 10386 existing records from primary storage. [2025-10-08T22:41:21.210386] [INFO ] [MAIN ] MMT: Loaded 10386 primary data records. [2025-10-08T22:41:21.326427] [DEBUG] [LOCAL ] MNR: Loaded 24555 existing records from primary storage. [2025-10-08T22:41:21.326592] [INFO ] [MAIN ] MNR: Loaded 24555 primary data records. [2025-10-08T22:41:21.304867] [DEBUG] [LOCAL ] MMU: Loaded 16804 existing records from primary storage. [2025-10-08T22:41:21.326762] [INFO ] [MAIN ] MMU: Loaded 16804 primary data records. [2025-10-08T22:41:22.196378] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:22.197222] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10386 primary records. [2025-10-08T22:41:22.197535] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-08T22:41:22.215627] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-08T22:41:22.215795] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-08T22:41:22.219692] [INFO ] [MAIN ] Derivative Progress: 1201/1771 symbols completed. MMT took 1.0s. Estimated remaining: 3m 40s. Rate: 155.5 symbols/min [2025-10-08T22:41:22.220227] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:22.241066] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:22.246374] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24555 primary records. [2025-10-08T22:41:22.246577] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-08T22:41:22.247225] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:22.248092] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16804 primary records. [2025-10-08T22:41:22.248339] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-08T22:41:22.278337] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-08T22:41:22.278922] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-08T22:41:22.286364] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-08T22:41:22.286291] [INFO ] [MAIN ] Derivative Progress: 1202/1771 symbols completed. MMU took 1.1s. Estimated remaining: 3m 39s. Rate: 155.6 symbols/min [2025-10-08T22:41:22.286607] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:22.286737] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-08T22:41:22.289078] [INFO ] [MAIN ] Derivative Progress: 1203/1771 symbols completed. MNR took 1.1s. Estimated remaining: 3m 39s. Rate: 155.8 symbols/min [2025-10-08T22:41:22.289750] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:22.331147] [DEBUG] [LOCAL ] MNSO: Loaded 44259 existing records from primary storage. [2025-10-08T22:41:22.331413] [INFO ] [MAIN ] MNSO: Loaded 44259 primary data records. [2025-10-08T22:41:22.514083] [DEBUG] [LOCAL ] MODG: Loaded 51570 existing records from primary storage. [2025-10-08T22:41:22.546253] [INFO ] [MAIN ] MODG: Loaded 51570 primary data records. [2025-10-08T22:41:22.595826] [DEBUG] [LOCAL ] MOD: Loaded 44995 existing records from primary storage. [2025-10-08T22:41:22.768832] [INFO ] [MAIN ] MOD: Loaded 44995 primary data records. [2025-10-08T22:41:23.352536] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:23.353504] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44259 primary records. [2025-10-08T22:41:23.353887] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-08T22:41:23.372593] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-08T22:41:23.372985] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-08T22:41:23.375029] [INFO ] [MAIN ] Derivative Progress: 1204/1771 symbols completed. MNSO took 1.2s. Estimated remaining: 3m 39s. Rate: 155.5 symbols/min [2025-10-08T22:41:23.375180] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:23.388410] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:23.390850] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44995 primary records. [2025-10-08T22:41:23.391683] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-08T22:41:23.423177] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:23.422695] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-08T22:41:23.424169] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51570 primary records. [2025-10-08T22:41:23.424333] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-08T22:41:23.424441] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-08T22:41:23.427738] [INFO ] [MAIN ] Derivative Progress: 1205/1771 symbols completed. MOD took 1.1s. Estimated remaining: 3m 38s. Rate: 155.6 symbols/min [2025-10-08T22:41:23.428199] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:23.444204] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-08T22:41:23.453164] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-08T22:41:23.455541] [INFO ] [MAIN ] Derivative Progress: 1206/1771 symbols completed. MODG took 1.2s. Estimated remaining: 3m 38s. Rate: 155.8 symbols/min [2025-10-08T22:41:23.455897] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:23.473945] [DEBUG] [LOCAL ] MOH: Loaded 42118 existing records from primary storage. [2025-10-08T22:41:23.474271] [INFO ] [MAIN ] MOH: Loaded 42118 primary data records. [2025-10-08T22:41:23.587360] [DEBUG] [LOCAL ] MOV: Loaded 21793 existing records from primary storage. [2025-10-08T22:41:23.603451] [INFO ] [MAIN ] MOV: Loaded 21793 primary data records. [2025-10-08T22:41:23.923326] [DEBUG] [LOCAL ] MOS: Loaded 53504 existing records from primary storage. [2025-10-08T22:41:23.934772] [INFO ] [MAIN ] MOS: Loaded 53504 primary data records. [2025-10-08T22:41:24.479440] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:24.480349] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 42118 primary records. [2025-10-08T22:41:24.480557] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-08T22:41:24.515417] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-08T22:41:24.516277] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-08T22:41:24.516063] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:24.519874] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21793 primary records. [2025-10-08T22:41:24.520050] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-08T22:41:24.519722] [INFO ] [MAIN ] Derivative Progress: 1207/1771 symbols completed. MOH took 1.1s. Estimated remaining: 3m 38s. Rate: 155.5 symbols/min [2025-10-08T22:41:24.521802] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:24.555430] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-08T22:41:24.556141] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-08T22:41:24.556001] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:24.558722] [INFO ] [MAIN ] Derivative Progress: 1208/1771 symbols completed. MOV took 1.1s. Estimated remaining: 3m 37s. Rate: 155.6 symbols/min [2025-10-08T22:41:24.559940] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53504 primary records. [2025-10-08T22:41:24.560236] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-08T22:41:24.559147] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:24.578780] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-08T22:41:24.579060] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-08T22:41:24.581638] [INFO ] [MAIN ] Derivative Progress: 1209/1771 symbols completed. MOS took 1.2s. Estimated remaining: 3m 36s. Rate: 155.8 symbols/min [2025-10-08T22:41:24.581984] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:24.586798] [DEBUG] [LOCAL ] MPA: Loaded 5322 existing records from primary storage. [2025-10-08T22:41:24.587128] [INFO ] [MAIN ] MPA: Loaded 5322 primary data records. [2025-10-08T22:41:24.762121] [DEBUG] [LOCAL ] MP: Loaded 53691 existing records from primary storage. [2025-10-08T22:41:24.778007] [INFO ] [MAIN ] MP: Loaded 53691 primary data records. [2025-10-08T22:41:25.275292] [DEBUG] [LOCAL ] MPC: Loaded 52062 existing records from primary storage. [2025-10-08T22:41:25.284234] [INFO ] [MAIN ] MPC: Loaded 52062 primary data records. [2025-10-08T22:41:25.597734] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:25.607070] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5322 primary records. [2025-10-08T22:41:25.607305] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-08T22:41:25.630389] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-08T22:41:25.630639] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-08T22:41:25.633447] [INFO ] [MAIN ] Derivative Progress: 1210/1771 symbols completed. MPA took 1.1s. Estimated remaining: 3m 36s. Rate: 155.5 symbols/min [2025-10-08T22:41:25.633678] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:25.649167] [DEBUG] [MAIN ] MP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:25.650149] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53691 primary records. [2025-10-08T22:41:25.650284] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-08T22:41:25.670386] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-08T22:41:25.670636] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-08T22:41:25.673683] [INFO ] [MAIN ] Derivative Progress: 1211/1771 symbols completed. MP took 1.2s. Estimated remaining: 3m 36s. Rate: 155.7 symbols/min [2025-10-08T22:41:25.673960] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:25.691504] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:25.704945] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52062 primary records. [2025-10-08T22:41:25.705032] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-08T22:41:25.717011] [DEBUG] [LOCAL ] MPV: Loaded 4885 existing records from primary storage. [2025-10-08T22:41:25.721834] [INFO ] [MAIN ] MPV: Loaded 4885 primary data records. [2025-10-08T22:41:25.795847] [DEBUG] [LOCAL ] MPLX: Loaded 50718 existing records from primary storage. [2025-10-08T22:41:25.812521] [INFO ] [MAIN ] MPLX: Loaded 50718 primary data records. [2025-10-08T22:41:25.832019] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-08T22:41:25.869530] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-08T22:41:25.892347] [INFO ] [MAIN ] Derivative Progress: 1212/1771 symbols completed. MPC took 1.3s. Estimated remaining: 3m 35s. Rate: 155.7 symbols/min [2025-10-08T22:41:25.940528] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:26.401811] [DEBUG] [LOCAL ] MQT: Loaded 8683 existing records from primary storage. [2025-10-08T22:41:26.403044] [INFO ] [MAIN ] MQT: Loaded 8683 primary data records. [2025-10-08T22:41:26.734960] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:26.743730] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4885 primary records. [2025-10-08T22:41:26.749927] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-08T22:41:26.750302] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:26.751619] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50718 primary records. [2025-10-08T22:41:26.751796] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-08T22:41:26.787731] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-08T22:41:26.789445] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-08T22:41:26.789797] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-08T22:41:26.789604] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-08T22:41:26.799743] [INFO ] [MAIN ] Derivative Progress: 1213/1771 symbols completed. MPV took 1.1s. Estimated remaining: 3m 35s. Rate: 155.5 symbols/min [2025-10-08T22:41:26.807419] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:26.808509] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8683 primary records. [2025-10-08T22:41:26.808719] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-08T22:41:26.808574] [INFO ] [MAIN ] Derivative Progress: 1214/1771 symbols completed. MPLX took 1.2s. Estimated remaining: 3m 35s. Rate: 155.7 symbols/min [2025-10-08T22:41:26.824001] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-08T22:41:26.824088] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-08T22:41:26.826230] [INFO ] [MAIN ] Derivative Progress: 1215/1771 symbols completed. MQT took 0.9s. Estimated remaining: 3m 34s. Rate: 155.8 symbols/min [2025-10-08T22:41:26.826836] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:26.827012] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:26.827118] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:26.850283] [DEBUG] [LOCAL ] MUA: Loaded 11795 existing records from primary storage. [2025-10-08T22:41:26.861581] [INFO ] [MAIN ] MUA: Loaded 11795 primary data records. [2025-10-08T22:41:26.862094] [DEBUG] [LOCAL ] MQY: Loaded 16861 existing records from primary storage. [2025-10-08T22:41:26.874303] [DEBUG] [LOCAL ] MSD: Loaded 16093 existing records from primary storage. [2025-10-08T22:41:26.899414] [INFO ] [MAIN ] MQY: Loaded 16861 primary data records. [2025-10-08T22:41:26.911790] [INFO ] [MAIN ] MSD: Loaded 16093 primary data records. [2025-10-08T22:41:27.911790] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:27.927142] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11795 primary records. [2025-10-08T22:41:27.926250] [DEBUG] [MAIN ] MQY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:27.927921] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16861 primary records. [2025-10-08T22:41:27.928082] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-08T22:41:27.929199] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-08T22:41:27.972862] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-10-08T22:41:27.973807] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-08T22:41:27.969459] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:27.974955] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16093 primary records. [2025-10-08T22:41:27.975057] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-08T22:41:27.975151] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-08T22:41:27.978083] [INFO ] [MAIN ] Derivative Progress: 1216/1771 symbols completed. MUA took 1.2s. Estimated remaining: 3m 34s. Rate: 155.5 symbols/min [2025-10-08T22:41:27.973972] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-08T22:41:27.978565] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:27.980804] [INFO ] [MAIN ] Derivative Progress: 1217/1771 symbols completed. MQY took 1.2s. Estimated remaining: 3m 34s. Rate: 155.7 symbols/min [2025-10-08T22:41:27.996953] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:28.009388] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-08T22:41:28.009726] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-08T22:41:28.012615] [INFO ] [MAIN ] Derivative Progress: 1218/1771 symbols completed. MSD took 1.2s. Estimated remaining: 3m 33s. Rate: 155.8 symbols/min [2025-10-08T22:41:28.017886] [DEBUG] [LOCAL ] MUE: Loaded 12015 existing records from primary storage. [2025-10-08T22:41:28.017612] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:28.022505] [INFO ] [MAIN ] MUE: Loaded 12015 primary data records. [2025-10-08T22:41:28.128691] [DEBUG] [LOCAL ] MUC: Loaded 20555 existing records from primary storage. [2025-10-08T22:41:28.128837] [INFO ] [MAIN ] MUC: Loaded 20555 primary data records. [2025-10-08T22:41:28.204973] [DEBUG] [LOCAL ] MUJ: Loaded 13610 existing records from primary storage. [2025-10-08T22:41:28.234773] [INFO ] [MAIN ] MUJ: Loaded 13610 primary data records. [2025-10-08T22:41:29.008958] [DEBUG] [MAIN ] MUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:29.009246] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:29.010873] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 12015 primary records. [2025-10-08T22:41:29.010228] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20555 primary records. [2025-10-08T22:41:29.011036] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-08T22:41:29.012518] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-08T22:41:29.045601] [DEBUG] [MAIN ] MUJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:29.051619] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13610 primary records. [2025-10-08T22:41:29.055509] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-08T22:41:29.056444] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-08T22:41:29.059901] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-08T22:41:29.063034] [INFO ] [MAIN ] Derivative Progress: 1219/1771 symbols completed. MUE took 1.1s. Estimated remaining: 3m 33s. Rate: 155.6 symbols/min [2025-10-08T22:41:29.070284] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:29.071496] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-10-08T22:41:29.075521] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-08T22:41:29.079384] [INFO ] [MAIN ] Derivative Progress: 1220/1771 symbols completed. MUC took 1.1s. Estimated remaining: 3m 32s. Rate: 155.7 symbols/min [2025-10-08T22:41:29.079662] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:29.081984] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-10-08T22:41:29.082063] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-08T22:41:29.084119] [INFO ] [MAIN ] Derivative Progress: 1221/1771 symbols completed. MUJ took 1.1s. Estimated remaining: 3m 32s. Rate: 155.8 symbols/min [2025-10-08T22:41:29.084436] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:29.097091] [DEBUG] [LOCAL ] MVF: Loaded 13200 existing records from primary storage. [2025-10-08T22:41:29.099726] [INFO ] [MAIN ] MVF: Loaded 13200 primary data records. [2025-10-08T22:41:29.149422] [DEBUG] [LOCAL ] MXF: Loaded 5687 existing records from primary storage. [2025-10-08T22:41:29.181214] [INFO ] [MAIN ] MXF: Loaded 5687 primary data records. [2025-10-08T22:41:29.200952] [DEBUG] [LOCAL ] MVT: Loaded 10214 existing records from primary storage. [2025-10-08T22:41:29.244072] [INFO ] [MAIN ] MVT: Loaded 10214 primary data records. [2025-10-08T22:41:30.174252] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:30.175339] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 13200 primary records. [2025-10-08T22:41:30.175610] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-08T22:41:30.215336] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:30.215007] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-08T22:41:30.231237] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5687 primary records. [2025-10-08T22:41:30.231356] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-08T22:41:30.232061] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:30.231713] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-08T22:41:30.236330] [INFO ] [MAIN ] Derivative Progress: 1222/1771 symbols completed. MVF took 1.2s. Estimated remaining: 3m 32s. Rate: 155.6 symbols/min [2025-10-08T22:41:30.237860] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:30.239475] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10214 primary records. [2025-10-08T22:41:30.246070] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-08T22:41:30.282200] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-08T22:41:30.282957] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-08T22:41:30.288152] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-08T22:41:30.288068] [INFO ] [MAIN ] Derivative Progress: 1223/1771 symbols completed. MVT took 1.2s. Estimated remaining: 3m 31s. Rate: 155.7 symbols/min [2025-10-08T22:41:30.281080] [DEBUG] [LOCAL ] MYD: Loaded 13378 existing records from primary storage. [2025-10-08T22:41:30.288445] [INFO ] [MAIN ] MYD: Loaded 13378 primary data records. [2025-10-08T22:41:30.288806] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:30.301272] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-08T22:41:30.349177] [INFO ] [MAIN ] Derivative Progress: 1224/1771 symbols completed. MXF took 1.3s. Estimated remaining: 3m 31s. Rate: 155.8 symbols/min [2025-10-08T22:41:30.363520] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:30.455981] [DEBUG] [LOCAL ] MYN: Loaded 9882 existing records from primary storage. [2025-10-08T22:41:30.472857] [INFO ] [MAIN ] MYN: Loaded 9882 primary data records. [2025-10-08T22:41:30.473484] [DEBUG] [LOCAL ] MYI: Loaded 19085 existing records from primary storage. [2025-10-08T22:41:30.473591] [INFO ] [MAIN ] MYI: Loaded 19085 primary data records. [2025-10-08T22:41:31.259095] [DEBUG] [MAIN ] MYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:31.259911] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13378 primary records. [2025-10-08T22:41:31.260342] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-08T22:41:31.295486] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-10-08T22:41:31.294707] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:31.308239] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9882 primary records. [2025-10-08T22:41:31.308674] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-08T22:41:31.308331] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-08T22:41:31.311329] [INFO ] [MAIN ] Derivative Progress: 1225/1771 symbols completed. MYD took 1.1s. Estimated remaining: 3m 31s. Rate: 155.6 symbols/min [2025-10-08T22:41:31.311794] [DEBUG] [MAIN ] MYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:31.311935] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:31.313161] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19085 primary records. [2025-10-08T22:41:31.313865] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-08T22:41:31.345398] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-10-08T22:41:31.344158] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-08T22:41:31.345712] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-08T22:41:31.345544] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-08T22:41:31.348036] [INFO ] [MAIN ] Derivative Progress: 1226/1771 symbols completed. MYN took 1.0s. Estimated remaining: 3m 30s. Rate: 155.7 symbols/min [2025-10-08T22:41:31.350676] [INFO ] [MAIN ] Derivative Progress: 1227/1771 symbols completed. MYI took 1.1s. Estimated remaining: 3m 29s. Rate: 155.8 symbols/min [2025-10-08T22:41:31.350604] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:31.350877] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:31.373055] [DEBUG] [LOCAL ] NAC: Loaded 24576 existing records from primary storage. [2025-10-08T22:41:31.373236] [INFO ] [MAIN ] NAC: Loaded 24576 primary data records. [2025-10-08T22:41:31.398791] [DEBUG] [LOCAL ] NAN: Loaded 8428 existing records from primary storage. [2025-10-08T22:41:31.422594] [INFO ] [MAIN ] NAN: Loaded 8428 primary data records. [2025-10-08T22:41:31.648352] [DEBUG] [LOCAL ] NAD: Loaded 33875 existing records from primary storage. [2025-10-08T22:41:31.664825] [INFO ] [MAIN ] NAD: Loaded 33875 primary data records. [2025-10-08T22:41:32.391929] [DEBUG] [MAIN ] NAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:32.393042] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24576 primary records. [2025-10-08T22:41:32.393298] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-08T22:41:32.420484] [DEBUG] [MAIN ] NAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:32.423491] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8428 primary records. [2025-10-08T22:41:32.423688] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-08T22:41:32.425572] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-10-08T22:41:32.433136] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-08T22:41:32.435403] [INFO ] [MAIN ] Derivative Progress: 1228/1771 symbols completed. NAC took 1.1s. Estimated remaining: 3m 29s. Rate: 155.6 symbols/min [2025-10-08T22:41:32.457787] [DEBUG] [MAIN ] NAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:32.458935] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33875 primary records. [2025-10-08T22:41:32.459389] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-10-08T22:41:32.459444] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-08T22:41:32.459838] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-08T22:41:32.462066] [INFO ] [MAIN ] Derivative Progress: 1229/1771 symbols completed. NAN took 1.1s. Estimated remaining: 3m 29s. Rate: 155.7 symbols/min [2025-10-08T22:41:32.477221] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-10-08T22:41:32.477320] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-08T22:41:32.479566] [INFO ] [MAIN ] Derivative Progress: 1230/1771 symbols completed. NAD took 1.1s. Estimated remaining: 3m 28s. Rate: 155.8 symbols/min [2025-10-08T22:41:32.479952] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:32.480167] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:32.480062] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:32.486485] [DEBUG] [LOCAL ] NAZ: Loaded 2649 existing records from primary storage. [2025-10-08T22:41:32.486847] [INFO ] [MAIN ] NAZ: Loaded 2649 primary data records. [2025-10-08T22:41:32.579348] [DEBUG] [LOCAL ] NCA: Loaded 10027 existing records from primary storage. [2025-10-08T22:41:32.579062] [DEBUG] [LOCAL ] NBB: Loaded 9080 existing records from primary storage. [2025-10-08T22:41:32.584756] [INFO ] [MAIN ] NCA: Loaded 10027 primary data records. [2025-10-08T22:41:32.584869] [INFO ] [MAIN ] NBB: Loaded 9080 primary data records. [2025-10-08T22:41:33.436029] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:33.437788] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2649 primary records. [2025-10-08T22:41:33.437934] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-08T22:41:33.474696] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-08T22:41:33.480074] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-08T22:41:33.482388] [INFO ] [MAIN ] Derivative Progress: 1231/1771 symbols completed. NAZ took 1.0s. Estimated remaining: 3m 28s. Rate: 155.6 symbols/min [2025-10-08T22:41:33.487224] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:33.489188] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 10027 primary records. [2025-10-08T22:41:33.487348] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:33.489321] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-08T22:41:33.488257] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:33.491506] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9080 primary records. [2025-10-08T22:41:33.491612] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-08T22:41:33.519319] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-08T22:41:33.522628] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-08T22:41:33.525265] [INFO ] [MAIN ] Derivative Progress: 1232/1771 symbols completed. NCA took 1.0s. Estimated remaining: 3m 28s. Rate: 155.7 symbols/min [2025-10-08T22:41:33.525775] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:33.532868] [DEBUG] [LOCAL ] NCV: Loaded 13909 existing records from primary storage. [2025-10-08T22:41:33.533478] [INFO ] [MAIN ] NCV: Loaded 13909 primary data records. [2025-10-08T22:41:33.623885] [DEBUG] [LOCAL ] NCZ: Loaded 12196 existing records from primary storage. [2025-10-08T22:41:33.629500] [INFO ] [MAIN ] NCZ: Loaded 12196 primary data records. [2025-10-08T22:41:33.630028] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-08T22:41:33.635734] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-08T22:41:33.679368] [INFO ] [MAIN ] Derivative Progress: 1233/1771 symbols completed. NBB took 1.2s. Estimated remaining: 3m 27s. Rate: 155.8 symbols/min [2025-10-08T22:41:33.718336] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:34.220063] [DEBUG] [LOCAL ] NEA: Loaded 35470 existing records from primary storage. [2025-10-08T22:41:34.220503] [INFO ] [MAIN ] NEA: Loaded 35470 primary data records. [2025-10-08T22:41:34.354431] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:34.396046] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13909 primary records. [2025-10-08T22:41:34.548868] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-08T22:41:34.599403] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:34.602676] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12196 primary records. [2025-10-08T22:41:34.604131] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-08T22:41:34.621137] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-08T22:41:34.621572] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-08T22:41:34.624386] [INFO ] [MAIN ] Derivative Progress: 1234/1771 symbols completed. NCV took 1.1s. Estimated remaining: 3m 27s. Rate: 155.6 symbols/min [2025-10-08T22:41:34.625072] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:34.630606] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-08T22:41:34.630899] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-08T22:41:34.633222] [INFO ] [MAIN ] Derivative Progress: 1235/1771 symbols completed. NCZ took 1.1s. Estimated remaining: 3m 26s. Rate: 155.8 symbols/min [2025-10-08T22:41:34.633563] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:34.656811] [DEBUG] [MAIN ] NEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:34.657626] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35470 primary records. [2025-10-08T22:41:34.657817] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-08T22:41:34.684621] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-10-08T22:41:34.685080] [DEBUG] [LOCAL ] NFJ: Loaded 20463 existing records from primary storage. [2025-10-08T22:41:34.685259] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-08T22:41:34.692339] [INFO ] [MAIN ] Derivative Progress: 1236/1771 symbols completed. NEA took 1.0s. Estimated remaining: 3m 26s. Rate: 155.9 symbols/min [2025-10-08T22:41:34.689976] [INFO ] [MAIN ] NFJ: Loaded 20463 primary data records. [2025-10-08T22:41:34.692510] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:34.693502] [DEBUG] [LOCAL ] NIE: Loaded 11989 existing records from primary storage. [2025-10-08T22:41:34.699078] [INFO ] [MAIN ] NIE: Loaded 11989 primary data records. [2025-10-08T22:41:34.832075] [DEBUG] [LOCAL ] NIM: Loaded 3906 existing records from primary storage. [2025-10-08T22:41:34.849842] [INFO ] [MAIN ] NIM: Loaded 3906 primary data records. [2025-10-08T22:41:35.821784] [DEBUG] [MAIN ] NFJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:35.823236] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20463 primary records. [2025-10-08T22:41:35.823610] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-08T22:41:35.873421] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:35.875057] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11989 primary records. [2025-10-08T22:41:35.875574] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-08T22:41:35.874143] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:35.878754] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3906 primary records. [2025-10-08T22:41:35.889685] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-08T22:41:35.889582] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-10-08T22:41:35.893403] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-08T22:41:35.896351] [INFO ] [MAIN ] Derivative Progress: 1237/1771 symbols completed. NFJ took 1.3s. Estimated remaining: 3m 26s. Rate: 155.6 symbols/min [2025-10-08T22:41:35.897250] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:35.919493] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-08T22:41:35.921028] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-08T22:41:35.921234] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-08T22:41:35.923568] [INFO ] [MAIN ] Derivative Progress: 1238/1771 symbols completed. NIM took 1.2s. Estimated remaining: 3m 25s. Rate: 155.7 symbols/min [2025-10-08T22:41:35.923824] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:35.920449] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-08T22:41:35.926732] [INFO ] [MAIN ] Derivative Progress: 1239/1771 symbols completed. NIE took 1.3s. Estimated remaining: 3m 25s. Rate: 155.8 symbols/min [2025-10-08T22:41:35.927131] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:35.936081] [DEBUG] [LOCAL ] NKX: Loaded 13662 existing records from primary storage. [2025-10-08T22:41:35.936441] [INFO ] [MAIN ] NKX: Loaded 13662 primary data records. [2025-10-08T22:41:35.944743] [DEBUG] [LOCAL ] NMS: Loaded 2822 existing records from primary storage. [2025-10-08T22:41:35.986389] [INFO ] [MAIN ] NMS: Loaded 2822 primary data records. [2025-10-08T22:41:36.055344] [DEBUG] [LOCAL ] NMI: Loaded 4065 existing records from primary storage. [2025-10-08T22:41:36.075166] [INFO ] [MAIN ] NMI: Loaded 4065 primary data records. [2025-10-08T22:41:36.980174] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:36.995794] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13662 primary records. [2025-10-08T22:41:36.996439] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-08T22:41:36.996349] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:37.012999] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4065 primary records. [2025-10-08T22:41:37.025035] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-08T22:41:37.021940] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:41:37.030101] [INFO ] [MAIN ] NMS: Generated 1792 derivative records from 2822 primary records. [2025-10-08T22:41:37.036897] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-08T22:41:37.041129] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-08T22:41:37.041713] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-08T22:41:37.048204] [INFO ] [MAIN ] Derivative Progress: 1240/1771 symbols completed. NKX took 1.2s. Estimated remaining: 3m 25s. Rate: 155.6 symbols/min [2025-10-08T22:41:37.045792] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-08T22:41:37.048507] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:37.048998] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-08T22:41:37.064139] [INFO ] [MAIN ] Derivative Progress: 1241/1771 symbols completed. NMI took 1.1s. Estimated remaining: 3m 24s. Rate: 155.7 symbols/min [2025-10-08T22:41:37.065708] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:37.072056] [DEBUG] [LOCAL ] NMT: Loaded 2866 existing records from primary storage. [2025-10-08T22:41:37.072881] [INFO ] [MAIN ] NMT: Loaded 2866 primary data records. [2025-10-08T22:41:37.095035] [DEBUG] [LOCAL ] NMS: Derivative data saved (1792 records). [2025-10-08T22:41:37.144369] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-08T22:41:37.177031] [INFO ] [MAIN ] Derivative Progress: 1242/1771 symbols completed. NMS took 1.2s. Estimated remaining: 3m 24s. Rate: 155.8 symbols/min [2025-10-08T22:41:37.189838] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:37.289569] [DEBUG] [LOCAL ] NMZ: Loaded 21658 existing records from primary storage. [2025-10-08T22:41:37.423036] [INFO ] [MAIN ] NMZ: Loaded 21658 primary data records. [2025-10-08T22:41:37.426530] [DEBUG] [LOCAL ] NNY: Loaded 5633 existing records from primary storage. [2025-10-08T22:41:37.427811] [INFO ] [MAIN ] NNY: Loaded 5633 primary data records. [2025-10-08T22:41:38.100590] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:38.101859] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2866 primary records. [2025-10-08T22:41:38.102227] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-08T22:41:38.123065] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-10-08T22:41:38.135961] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:38.136141] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-08T22:41:38.138712] [INFO ] [MAIN ] Derivative Progress: 1243/1771 symbols completed. NMT took 1.1s. Estimated remaining: 3m 24s. Rate: 155.6 symbols/min [2025-10-08T22:41:38.139739] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5633 primary records. [2025-10-08T22:41:38.140001] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-08T22:41:38.158114] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-08T22:41:38.158254] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-08T22:41:38.160623] [INFO ] [MAIN ] Derivative Progress: 1244/1771 symbols completed. NNY took 1.0s. Estimated remaining: 3m 23s. Rate: 155.7 symbols/min [2025-10-08T22:41:38.172821] [DEBUG] [MAIN ] NMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:38.173410] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21658 primary records. [2025-10-08T22:41:38.173471] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-08T22:41:38.189428] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-10-08T22:41:38.189490] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-08T22:41:38.191946] [INFO ] [MAIN ] Derivative Progress: 1245/1771 symbols completed. NMZ took 1.1s. Estimated remaining: 3m 22s. Rate: 155.9 symbols/min [2025-10-08T22:41:38.192334] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:38.192448] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:38.192513] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:38.201274] [DEBUG] [LOCAL ] NPV: Loaded 5226 existing records from primary storage. [2025-10-08T22:41:38.201538] [INFO ] [MAIN ] NPV: Loaded 5226 primary data records. [2025-10-08T22:41:38.296854] [DEBUG] [LOCAL ] NQP: Loaded 9263 existing records from primary storage. [2025-10-08T22:41:38.322574] [DEBUG] [LOCAL ] NRK: Loaded 20037 existing records from primary storage. [2025-10-08T22:41:38.308292] [INFO ] [MAIN ] NQP: Loaded 9263 primary data records. [2025-10-08T22:41:38.346828] [INFO ] [MAIN ] NRK: Loaded 20037 primary data records. [2025-10-08T22:41:39.195242] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:39.197638] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5226 primary records. [2025-10-08T22:41:39.196251] [DEBUG] [MAIN ] NQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:39.197841] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-08T22:41:39.198765] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9263 primary records. [2025-10-08T22:41:39.212570] [DEBUG] [MAIN ] NRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:39.213771] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-08T22:41:39.213699] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 20037 primary records. [2025-10-08T22:41:39.227748] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-08T22:41:39.262493] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-08T22:41:39.263237] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-08T22:41:39.266571] [INFO ] [MAIN ] Derivative Progress: 1246/1771 symbols completed. NPV took 1.1s. Estimated remaining: 3m 22s. Rate: 155.6 symbols/min [2025-10-08T22:41:39.263601] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-08T22:41:39.266869] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-08T22:41:39.269699] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-10-08T22:41:39.269862] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:39.270053] [INFO ] [MAIN ] Derivative Progress: 1247/1771 symbols completed. NQP took 1.1s. Estimated remaining: 3m 22s. Rate: 155.8 symbols/min [2025-10-08T22:41:39.270209] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:39.270436] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-08T22:41:39.273138] [INFO ] [MAIN ] Derivative Progress: 1248/1771 symbols completed. NRK took 1.1s. Estimated remaining: 3m 21s. Rate: 155.9 symbols/min [2025-10-08T22:41:39.273693] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:39.284872] [DEBUG] [LOCAL ] NUW: Loaded 7156 existing records from primary storage. [2025-10-08T22:41:39.291501] [INFO ] [MAIN ] NUW: Loaded 7156 primary data records. [2025-10-08T22:41:39.380841] [DEBUG] [LOCAL ] NUV: Loaded 23707 existing records from primary storage. [2025-10-08T22:41:39.402708] [INFO ] [MAIN ] NUV: Loaded 23707 primary data records. [2025-10-08T22:41:39.470562] [DEBUG] [LOCAL ] NVG: Loaded 27460 existing records from primary storage. [2025-10-08T22:41:39.493415] [INFO ] [MAIN ] NVG: Loaded 27460 primary data records. [2025-10-08T22:41:40.301339] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:40.303200] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7156 primary records. [2025-10-08T22:41:40.303446] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-08T22:41:40.335375] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:40.337951] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23707 primary records. [2025-10-08T22:41:40.339111] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-08T22:41:40.342456] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-08T22:41:40.342735] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-08T22:41:40.345444] [INFO ] [MAIN ] Derivative Progress: 1249/1771 symbols completed. NUW took 1.1s. Estimated remaining: 3m 21s. Rate: 155.7 symbols/min [2025-10-08T22:41:40.366722] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:40.371765] [DEBUG] [MAIN ] NVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:40.372920] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27460 primary records. [2025-10-08T22:41:40.373687] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-08T22:41:40.391490] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-08T22:41:40.395945] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-08T22:41:40.398557] [INFO ] [MAIN ] Derivative Progress: 1250/1771 symbols completed. NUV took 1.1s. Estimated remaining: 3m 21s. Rate: 155.8 symbols/min [2025-10-08T22:41:40.398980] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:40.394812] [DEBUG] [LOCAL ] NXC: Loaded 4129 existing records from primary storage. [2025-10-08T22:41:40.399323] [INFO ] [MAIN ] NXC: Loaded 4129 primary data records. [2025-10-08T22:41:40.511376] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-10-08T22:41:40.511668] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-08T22:41:40.519668] [INFO ] [MAIN ] Derivative Progress: 1251/1771 symbols completed. NVG took 1.2s. Estimated remaining: 3m 20s. Rate: 155.8 symbols/min [2025-10-08T22:41:40.525250] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:40.536782] [DEBUG] [LOCAL ] NXJ: Loaded 15003 existing records from primary storage. [2025-10-08T22:41:40.562790] [INFO ] [MAIN ] NXJ: Loaded 15003 primary data records. [2025-10-08T22:41:40.753176] [DEBUG] [LOCAL ] NXN: Loaded 2310 existing records from primary storage. [2025-10-08T22:41:40.788361] [INFO ] [MAIN ] NXN: Loaded 2310 primary data records. [2025-10-08T22:41:41.365364] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:41.368222] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4129 primary records. [2025-10-08T22:41:41.369300] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-08T22:41:41.395040] [DEBUG] [MAIN ] NXJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:41.396348] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 15003 primary records. [2025-10-08T22:41:41.397171] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-08T22:41:41.413028] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-08T22:41:41.413907] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-08T22:41:41.416726] [INFO ] [MAIN ] Derivative Progress: 1252/1771 symbols completed. NXC took 1.0s. Estimated remaining: 3m 20s. Rate: 155.7 symbols/min [2025-10-08T22:41:41.424699] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:41.430472] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:41.433032] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2310 primary records. [2025-10-08T22:41:41.433637] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-08T22:41:41.434467] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-10-08T22:41:41.435176] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-08T22:41:41.437761] [INFO ] [MAIN ] Derivative Progress: 1253/1771 symbols completed. NXJ took 1.0s. Estimated remaining: 3m 19s. Rate: 155.8 symbols/min [2025-10-08T22:41:41.437935] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:41.456513] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-08T22:41:41.456692] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-08T22:41:41.459068] [INFO ] [MAIN ] Derivative Progress: 1254/1771 symbols completed. NXN took 0.9s. Estimated remaining: 3m 19s. Rate: 155.9 symbols/min [2025-10-08T22:41:41.459315] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:41.468965] [DEBUG] [LOCAL ] NXP: Loaded 12465 existing records from primary storage. [2025-10-08T22:41:41.469399] [INFO ] [MAIN ] NXP: Loaded 12465 primary data records. [2025-10-08T22:41:41.591296] [DEBUG] [LOCAL ] NZF: Loaded 29053 existing records from primary storage. [2025-10-08T22:41:41.610015] [INFO ] [MAIN ] NZF: Loaded 29053 primary data records. [2025-10-08T22:41:41.610284] [DEBUG] [LOCAL ] OIA: Loaded 13570 existing records from primary storage. [2025-10-08T22:41:41.610528] [INFO ] [MAIN ] OIA: Loaded 13570 primary data records. [2025-10-08T22:41:42.454145] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:42.466809] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12465 primary records. [2025-10-08T22:41:42.466910] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-08T22:41:42.467550] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:42.468201] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13570 primary records. [2025-10-08T22:41:42.468292] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-08T22:41:42.513025] [DEBUG] [MAIN ] NZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:42.514703] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29053 primary records. [2025-10-08T22:41:42.515190] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-08T22:41:42.524486] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-08T22:41:42.524827] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-08T22:41:42.531861] [INFO ] [MAIN ] Derivative Progress: 1255/1771 symbols completed. OIA took 1.1s. Estimated remaining: 3m 19s. Rate: 155.7 symbols/min [2025-10-08T22:41:42.532230] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:42.533455] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-08T22:41:42.533601] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-08T22:41:42.536212] [INFO ] [MAIN ] Derivative Progress: 1256/1771 symbols completed. NXP took 1.1s. Estimated remaining: 3m 18s. Rate: 155.8 symbols/min [2025-10-08T22:41:42.536973] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:42.541277] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-10-08T22:41:42.541418] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-08T22:41:42.544163] [INFO ] [MAIN ] Derivative Progress: 1257/1771 symbols completed. NZF took 1.1s. Estimated remaining: 3m 18s. Rate: 155.9 symbols/min [2025-10-08T22:41:42.546827] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:42.552498] [DEBUG] [LOCAL ] PAI: Loaded 2658 existing records from primary storage. [2025-10-08T22:41:42.552806] [INFO ] [MAIN ] PAI: Loaded 2658 primary data records. [2025-10-08T22:41:42.634021] [DEBUG] [LOCAL ] OPP: Loaded 11993 existing records from primary storage. [2025-10-08T22:41:42.658136] [INFO ] [MAIN ] OPP: Loaded 11993 primary data records. [2025-10-08T22:41:42.959221] [DEBUG] [LOCAL ] PAM: Loaded 28118 existing records from primary storage. [2025-10-08T22:41:42.978599] [INFO ] [MAIN ] PAM: Loaded 28118 primary data records. [2025-10-08T22:41:43.484032] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:43.487907] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2658 primary records. [2025-10-08T22:41:43.488487] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-08T22:41:43.513804] [DEBUG] [MAIN ] OPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:43.516134] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11993 primary records. [2025-10-08T22:41:43.516449] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-08T22:41:43.516565] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-08T22:41:43.516797] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-08T22:41:43.519873] [INFO ] [MAIN ] Derivative Progress: 1258/1771 symbols completed. PAI took 1.0s. Estimated remaining: 3m 18s. Rate: 155.7 symbols/min [2025-10-08T22:41:43.547215] [DEBUG] [MAIN ] PAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:43.548579] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 28118 primary records. [2025-10-08T22:41:43.549141] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-08T22:41:43.550515] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-08T22:41:43.550833] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-08T22:41:43.553473] [INFO ] [MAIN ] Derivative Progress: 1259/1771 symbols completed. OPP took 1.0s. Estimated remaining: 3m 17s. Rate: 155.9 symbols/min [2025-10-08T22:41:43.568192] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-10-08T22:41:43.568254] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-08T22:41:43.570519] [INFO ] [MAIN ] Derivative Progress: 1260/1771 symbols completed. PAM took 1.0s. Estimated remaining: 3m 17s. Rate: 156.0 symbols/min [2025-10-08T22:41:43.571043] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:43.571103] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:43.571480] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:43.583563] [DEBUG] [LOCAL ] PCM: Loaded 6743 existing records from primary storage. [2025-10-08T22:41:43.587088] [INFO ] [MAIN ] PCM: Loaded 6743 primary data records. [2025-10-08T22:41:43.587356] [DEBUG] [LOCAL ] PCF: Loaded 9021 existing records from primary storage. [2025-10-08T22:41:43.598718] [INFO ] [MAIN ] PCF: Loaded 9021 primary data records. [2025-10-08T22:41:43.772028] [DEBUG] [LOCAL ] PCN: Loaded 24722 existing records from primary storage. [2025-10-08T22:41:43.782821] [INFO ] [MAIN ] PCN: Loaded 24722 primary data records. [2025-10-08T22:41:44.561867] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:44.563022] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6743 primary records. [2025-10-08T22:41:44.563430] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-08T22:41:44.595595] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:44.598928] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 9021 primary records. [2025-10-08T22:41:44.599870] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-08T22:41:44.614044] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-08T22:41:44.614752] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-08T22:41:44.615118] [DEBUG] [MAIN ] PCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:44.626429] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24722 primary records. [2025-10-08T22:41:44.624393] [INFO ] [MAIN ] Derivative Progress: 1261/1771 symbols completed. PCM took 1.1s. Estimated remaining: 3m 16s. Rate: 155.8 symbols/min [2025-10-08T22:41:44.629330] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-08T22:41:44.632089] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:44.649297] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-08T22:41:44.650773] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-08T22:41:44.653415] [INFO ] [MAIN ] Derivative Progress: 1262/1771 symbols completed. PCF took 1.1s. Estimated remaining: 3m 16s. Rate: 155.9 symbols/min [2025-10-08T22:41:44.658712] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:44.654817] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-10-08T22:41:44.659581] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-08T22:41:44.662258] [INFO ] [MAIN ] Derivative Progress: 1263/1771 symbols completed. PCN took 1.1s. Estimated remaining: 3m 15s. Rate: 156.0 symbols/min [2025-10-08T22:41:44.662522] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:44.669061] [DEBUG] [LOCAL ] PCQ: Loaded 12096 existing records from primary storage. [2025-10-08T22:41:44.669343] [INFO ] [MAIN ] PCQ: Loaded 12096 primary data records. [2025-10-08T22:41:45.012122] [DEBUG] [LOCAL ] PDO: Loaded 31294 existing records from primary storage. [2025-10-08T22:41:45.012349] [INFO ] [MAIN ] PDO: Loaded 31294 primary data records. [2025-10-08T22:41:45.132877] [DEBUG] [LOCAL ] PDI: Loaded 50091 existing records from primary storage. [2025-10-08T22:41:45.133325] [INFO ] [MAIN ] PDI: Loaded 50091 primary data records. [2025-10-08T22:41:45.702564] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:45.704029] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12096 primary records. [2025-10-08T22:41:45.704262] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-08T22:41:45.730206] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-08T22:41:45.730409] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-08T22:41:45.733606] [INFO ] [MAIN ] Derivative Progress: 1264/1771 symbols completed. PCQ took 1.1s. Estimated remaining: 3m 15s. Rate: 155.8 symbols/min [2025-10-08T22:41:45.734548] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:45.749223] [DEBUG] [MAIN ] PDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:45.750370] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31294 primary records. [2025-10-08T22:41:45.750596] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-08T22:41:45.782482] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-10-08T22:41:45.779253] [DEBUG] [LOCAL ] PDT: Loaded 17424 existing records from primary storage. [2025-10-08T22:41:45.783453] [INFO ] [MAIN ] PDT: Loaded 17424 primary data records. [2025-10-08T22:41:45.783353] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-08T22:41:45.790973] [INFO ] [MAIN ] Derivative Progress: 1265/1771 symbols completed. PDO took 1.1s. Estimated remaining: 3m 15s. Rate: 155.9 symbols/min [2025-10-08T22:41:45.823821] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:45.880791] [DEBUG] [MAIN ] PDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:45.895999] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50091 primary records. [2025-10-08T22:41:45.901350] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-08T22:41:46.022013] [DEBUG] [LOCAL ] PEO: Loaded 11184 existing records from primary storage. [2025-10-08T22:41:46.050940] [INFO ] [MAIN ] PEO: Loaded 11184 primary data records. [2025-10-08T22:41:46.124911] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-10-08T22:41:46.173446] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-08T22:41:46.200164] [INFO ] [MAIN ] Derivative Progress: 1266/1771 symbols completed. PDI took 1.5s. Estimated remaining: 3m 14s. Rate: 155.9 symbols/min [2025-10-08T22:41:46.227044] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:46.461021] [DEBUG] [LOCAL ] PFL: Loaded 13952 existing records from primary storage. [2025-10-08T22:41:46.462026] [INFO ] [MAIN ] PFL: Loaded 13952 primary data records. [2025-10-08T22:41:46.658408] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:46.664945] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17424 primary records. [2025-10-08T22:41:46.769608] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-08T22:41:46.813764] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-08T22:41:46.814056] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:46.815080] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11184 primary records. [2025-10-08T22:41:46.814204] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-08T22:41:46.818220] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-08T22:41:46.818118] [INFO ] [MAIN ] Derivative Progress: 1267/1771 symbols completed. PDT took 1.1s. Estimated remaining: 3m 14s. Rate: 155.8 symbols/min [2025-10-08T22:41:46.826700] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:46.838683] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-08T22:41:46.839450] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-08T22:41:46.842003] [INFO ] [MAIN ] Derivative Progress: 1268/1771 symbols completed. PEO took 1.0s. Estimated remaining: 3m 14s. Rate: 155.9 symbols/min [2025-10-08T22:41:46.842262] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:46.855952] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:46.862293] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13952 primary records. [2025-10-08T22:41:46.864254] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-08T22:41:46.883817] [DEBUG] [LOCAL ] PFO: Loaded 6048 existing records from primary storage. [2025-10-08T22:41:46.886919] [INFO ] [MAIN ] PFO: Loaded 6048 primary data records. [2025-10-08T22:41:46.899030] [DEBUG] [LOCAL ] PFN: Loaded 22096 existing records from primary storage. [2025-10-08T22:41:46.918467] [INFO ] [MAIN ] PFN: Loaded 22096 primary data records. [2025-10-08T22:41:47.086675] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-08T22:41:47.158110] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-08T22:41:47.192258] [INFO ] [MAIN ] Derivative Progress: 1269/1771 symbols completed. PFL took 1.0s. Estimated remaining: 3m 13s. Rate: 155.9 symbols/min [2025-10-08T22:41:47.349053] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:47.552821] [DEBUG] [LOCAL ] PGP: Loaded 5659 existing records from primary storage. [2025-10-08T22:41:47.553019] [INFO ] [MAIN ] PGP: Loaded 5659 primary data records. [2025-10-08T22:41:47.916924] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:47.917439] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:47.919895] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22096 primary records. [2025-10-08T22:41:47.918999] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6048 primary records. [2025-10-08T22:41:47.920254] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-08T22:41:47.920345] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-08T22:41:47.951789] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-08T22:41:47.953033] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-08T22:41:47.955602] [INFO ] [MAIN ] Derivative Progress: 1270/1771 symbols completed. PFN took 1.1s. Estimated remaining: 3m 13s. Rate: 155.8 symbols/min [2025-10-08T22:41:47.956831] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:47.959355] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-08T22:41:47.960051] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-08T22:41:47.962665] [INFO ] [MAIN ] Derivative Progress: 1271/1771 symbols completed. PFO took 1.1s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-08T22:41:47.963139] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:47.969323] [DEBUG] [LOCAL ] PGZ: Loaded 5471 existing records from primary storage. [2025-10-08T22:41:47.969576] [INFO ] [MAIN ] PGZ: Loaded 5471 primary data records. [2025-10-08T22:41:48.095485] [DEBUG] [LOCAL ] PHD: Loaded 10753 existing records from primary storage. [2025-10-08T22:41:48.096621] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:48.097561] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5659 primary records. [2025-10-08T22:41:48.108133] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-08T22:41:48.108050] [INFO ] [MAIN ] PHD: Loaded 10753 primary data records. [2025-10-08T22:41:48.455757] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-08T22:41:48.472037] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-08T22:41:48.498943] [INFO ] [MAIN ] Derivative Progress: 1272/1771 symbols completed. PGP took 1.1s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-08T22:41:48.619142] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:48.651626] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:48.652536] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5471 primary records. [2025-10-08T22:41:48.652681] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-08T22:41:48.673741] [DEBUG] [LOCAL ] PHK: Loaded 26593 existing records from primary storage. [2025-10-08T22:41:48.675253] [INFO ] [MAIN ] PHK: Loaded 26593 primary data records. [2025-10-08T22:41:48.733446] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-08T22:41:48.747331] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-08T22:41:48.755671] [INFO ] [MAIN ] Derivative Progress: 1273/1771 symbols completed. PGZ took 0.8s. Estimated remaining: 3m 12s. Rate: 155.9 symbols/min [2025-10-08T22:41:48.794761] [DEBUG] [MAIN ] PHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:48.795694] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 10753 primary records. [2025-10-08T22:41:48.801121] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-10-08T22:41:48.883732] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-10-08T22:41:48.998494] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-10-08T22:41:49.001292] [INFO ] [MAIN ] Derivative Progress: 1274/1771 symbols completed. PHD took 1.0s. Estimated remaining: 3m 11s. Rate: 156.0 symbols/min [2025-10-08T22:41:49.025310] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:49.025970] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26593 primary records. [2025-10-08T22:41:49.026034] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-08T22:41:49.040851] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-08T22:41:49.040911] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-08T22:41:49.043166] [INFO ] [MAIN ] Derivative Progress: 1275/1771 symbols completed. PHK took 0.4s. Estimated remaining: 3m 11s. Rate: 156.1 symbols/min [2025-10-08T22:41:49.044022] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:49.043942] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:49.044148] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:49.052390] [DEBUG] [LOCAL ] PIM: Loaded 4802 existing records from primary storage. [2025-10-08T22:41:49.054865] [INFO ] [MAIN ] PIM: Loaded 4802 primary data records. [2025-10-08T22:41:49.129536] [DEBUG] [LOCAL ] PMM: Loaded 10630 existing records from primary storage. [2025-10-08T22:41:49.153532] [INFO ] [MAIN ] PMM: Loaded 10630 primary data records. [2025-10-08T22:41:49.213699] [DEBUG] [LOCAL ] PML: Loaded 21571 existing records from primary storage. [2025-10-08T22:41:49.262934] [INFO ] [MAIN ] PML: Loaded 21571 primary data records. [2025-10-08T22:41:50.042367] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:50.045169] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4802 primary records. [2025-10-08T22:41:50.045868] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-08T22:41:50.073117] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:50.085961] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21571 primary records. [2025-10-08T22:41:50.086373] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-08T22:41:50.087977] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:50.089159] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-08T22:41:50.090071] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10630 primary records. [2025-10-08T22:41:50.090273] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-08T22:41:50.090199] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-08T22:41:50.093080] [INFO ] [MAIN ] Derivative Progress: 1276/1771 symbols completed. PIM took 1.0s. Estimated remaining: 3m 11s. Rate: 155.9 symbols/min [2025-10-08T22:41:50.100515] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:50.122829] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-08T22:41:50.122104] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-08T22:41:50.122967] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-08T22:41:50.123069] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-08T22:41:50.125457] [INFO ] [MAIN ] Derivative Progress: 1277/1771 symbols completed. PMM took 1.1s. Estimated remaining: 3m 10s. Rate: 156.0 symbols/min [2025-10-08T22:41:50.127717] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:50.130274] [INFO ] [MAIN ] Derivative Progress: 1278/1771 symbols completed. PML took 1.1s. Estimated remaining: 3m 9s. Rate: 156.1 symbols/min [2025-10-08T22:41:50.130455] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:50.135724] [DEBUG] [LOCAL ] PMO: Loaded 10057 existing records from primary storage. [2025-10-08T22:41:50.136077] [INFO ] [MAIN ] PMO: Loaded 10057 primary data records. [2025-10-08T22:41:50.216095] [DEBUG] [LOCAL ] PNI: Loaded 6770 existing records from primary storage. [2025-10-08T22:41:50.221424] [INFO ] [MAIN ] PNI: Loaded 6770 primary data records. [2025-10-08T22:41:50.316964] [DEBUG] [LOCAL ] PPT: Loaded 19997 existing records from primary storage. [2025-10-08T22:41:50.416386] [INFO ] [MAIN ] PPT: Loaded 19997 primary data records. [2025-10-08T22:41:51.080176] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:51.081080] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10057 primary records. [2025-10-08T22:41:51.082259] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-08T22:41:51.102003] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-08T22:41:51.102475] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-08T22:41:51.104834] [INFO ] [MAIN ] Derivative Progress: 1279/1771 symbols completed. PMO took 1.0s. Estimated remaining: 3m 9s. Rate: 155.9 symbols/min [2025-10-08T22:41:51.105494] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:51.119075] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:51.119975] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6770 primary records. [2025-10-08T22:41:51.122049] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-08T22:41:51.152042] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-08T22:41:51.152225] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-08T22:41:51.154670] [INFO ] [MAIN ] Derivative Progress: 1280/1771 symbols completed. PNI took 1.0s. Estimated remaining: 3m 9s. Rate: 156.0 symbols/min [2025-10-08T22:41:51.154841] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:51.151574] [DEBUG] [LOCAL ] PRCS: Loaded 2741 existing records from primary storage. [2025-10-08T22:41:51.155523] [INFO ] [MAIN ] PRCS: Loaded 2741 primary data records. [2025-10-08T22:41:51.155464] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:51.167793] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19997 primary records. [2025-10-08T22:41:51.177452] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-08T22:41:51.280119] [DEBUG] [LOCAL ] PSF: Loaded 6974 existing records from primary storage. [2025-10-08T22:41:51.297900] [INFO ] [MAIN ] PSF: Loaded 6974 primary data records. [2025-10-08T22:41:51.406513] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-08T22:41:51.435729] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-08T22:41:51.468708] [INFO ] [MAIN ] Derivative Progress: 1281/1771 symbols completed. PPT took 1.3s. Estimated remaining: 3m 8s. Rate: 156.0 symbols/min [2025-10-08T22:41:51.590228] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:51.849934] [DEBUG] [MAIN ] PRCS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:41:51.851894] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2741 primary records. [2025-10-08T22:41:51.852122] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-08T22:41:51.867611] [DEBUG] [LOCAL ] PTY: Loaded 37470 existing records from primary storage. [2025-10-08T22:41:51.873530] [INFO ] [MAIN ] PTY: Loaded 37470 primary data records. [2025-10-08T22:41:51.938183] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-08T22:41:51.953492] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-08T22:41:51.962375] [INFO ] [MAIN ] Derivative Progress: 1282/1771 symbols completed. PRCS took 0.9s. Estimated remaining: 3m 8s. Rate: 156.0 symbols/min [2025-10-08T22:41:51.967811] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:52.045190] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:52.082229] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6974 primary records. [2025-10-08T22:41:52.209879] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-08T22:41:52.235491] [DEBUG] [LOCAL ] RA: Loaded 21855 existing records from primary storage. [2025-10-08T22:41:52.236144] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-08T22:41:52.236520] [INFO ] [MAIN ] RA: Loaded 21855 primary data records. [2025-10-08T22:41:52.237154] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-08T22:41:52.260388] [INFO ] [MAIN ] Derivative Progress: 1283/1771 symbols completed. PSF took 1.1s. Estimated remaining: 3m 8s. Rate: 156.0 symbols/min [2025-10-08T22:41:52.271785] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:52.434008] [DEBUG] [LOCAL ] RCS: Loaded 12029 existing records from primary storage. [2025-10-08T22:41:52.544426] [INFO ] [MAIN ] RCS: Loaded 12029 primary data records. [2025-10-08T22:41:52.658305] [DEBUG] [MAIN ] PTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:52.678599] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37470 primary records. [2025-10-08T22:41:52.682403] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-08T22:41:52.775173] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-10-08T22:41:52.775431] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-08T22:41:52.777719] [INFO ] [MAIN ] Derivative Progress: 1284/1771 symbols completed. PTY took 1.2s. Estimated remaining: 3m 7s. Rate: 156.0 symbols/min [2025-10-08T22:41:52.777875] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:52.916785] [DEBUG] [LOCAL ] RFI: Loaded 10472 existing records from primary storage. [2025-10-08T22:41:52.925058] [INFO ] [MAIN ] RFI: Loaded 10472 primary data records. [2025-10-08T22:41:52.962741] [DEBUG] [MAIN ] RA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:52.997592] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21855 primary records. [2025-10-08T22:41:53.024964] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-08T22:41:53.124764] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-10-08T22:41:53.236150] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-08T22:41:53.283162] [INFO ] [MAIN ] Derivative Progress: 1285/1771 symbols completed. RA took 1.3s. Estimated remaining: 3m 7s. Rate: 156.0 symbols/min [2025-10-08T22:41:53.292317] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:53.312430] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:53.314920] [DEBUG] [LOCAL ] RGT: Loaded 2713 existing records from primary storage. [2025-10-08T22:41:53.316031] [INFO ] [MAIN ] RGT: Loaded 2713 primary data records. [2025-10-08T22:41:53.315931] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12029 primary records. [2025-10-08T22:41:53.386323] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-08T22:41:53.478276] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-08T22:41:53.620008] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-08T22:41:53.635425] [INFO ] [MAIN ] Derivative Progress: 1286/1771 symbols completed. RCS took 1.4s. Estimated remaining: 3m 7s. Rate: 156.0 symbols/min [2025-10-08T22:41:53.636711] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:53.656607] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:53.658023] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10472 primary records. [2025-10-08T22:41:53.661262] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-08T22:41:53.681749] [DEBUG] [LOCAL ] RIV: Loaded 12476 existing records from primary storage. [2025-10-08T22:41:53.682532] [INFO ] [MAIN ] RIV: Loaded 12476 primary data records. [2025-10-08T22:41:53.747924] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-08T22:41:53.781858] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-08T22:41:53.792213] [INFO ] [MAIN ] Derivative Progress: 1287/1771 symbols completed. RFI took 1.0s. Estimated remaining: 3m 6s. Rate: 156.0 symbols/min [2025-10-08T22:41:53.805798] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:54.022732] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:54.023694] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2713 primary records. [2025-10-08T22:41:54.028583] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-08T22:41:54.051447] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-08T22:41:54.051624] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-08T22:41:54.052058] [DEBUG] [LOCAL ] RMT: Loaded 17357 existing records from primary storage. [2025-10-08T22:41:54.052265] [INFO ] [MAIN ] RMT: Loaded 17357 primary data records. [2025-10-08T22:41:54.055215] [INFO ] [MAIN ] Derivative Progress: 1288/1771 symbols completed. RGT took 0.8s. Estimated remaining: 3m 6s. Rate: 156.1 symbols/min [2025-10-08T22:41:54.378417] [DEBUG] [MAIN ] RIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:54.379308] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12476 primary records. [2025-10-08T22:41:54.380197] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-08T22:41:54.398268] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-10-08T22:41:54.398466] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-08T22:41:54.401020] [INFO ] [MAIN ] Derivative Progress: 1289/1771 symbols completed. RIV took 0.8s. Estimated remaining: 3m 5s. Rate: 156.1 symbols/min [2025-10-08T22:41:54.428406] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:54.429259] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17357 primary records. [2025-10-08T22:41:54.429337] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-08T22:41:54.451332] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-08T22:41:54.451392] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-08T22:41:54.453602] [INFO ] [MAIN ] Derivative Progress: 1290/1771 symbols completed. RMT took 0.6s. Estimated remaining: 3m 5s. Rate: 156.2 symbols/min [2025-10-08T22:41:54.454021] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:54.454078] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:54.454224] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:54.464237] [DEBUG] [LOCAL ] RSF: Loaded 4306 existing records from primary storage. [2025-10-08T22:41:54.464546] [INFO ] [MAIN ] RSF: Loaded 4306 primary data records. [2025-10-08T22:41:54.609879] [DEBUG] [LOCAL ] RNP: Loaded 16068 existing records from primary storage. [2025-10-08T22:41:54.610463] [DEBUG] [LOCAL ] RVT: Loaded 26433 existing records from primary storage. [2025-10-08T22:41:54.610566] [INFO ] [MAIN ] RVT: Loaded 26433 primary data records. [2025-10-08T22:41:54.610101] [INFO ] [MAIN ] RNP: Loaded 16068 primary data records. [2025-10-08T22:41:55.499080] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:55.500266] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4306 primary records. [2025-10-08T22:41:55.500460] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-08T22:41:55.520554] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-08T22:41:55.520780] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-08T22:41:55.523102] [INFO ] [MAIN ] Derivative Progress: 1291/1771 symbols completed. RSF took 1.1s. Estimated remaining: 3m 5s. Rate: 156.0 symbols/min [2025-10-08T22:41:55.523357] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:55.548862] [DEBUG] [MAIN ] RVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:55.548574] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:55.549808] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26433 primary records. [2025-10-08T22:41:55.550448] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16068 primary records. [2025-10-08T22:41:55.551756] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-08T22:41:55.552050] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-08T22:41:55.583626] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-08T22:41:55.585123] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-10-08T22:41:55.585300] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-08T22:41:55.585374] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-08T22:41:55.587636] [INFO ] [MAIN ] Derivative Progress: 1292/1771 symbols completed. RNP took 1.1s. Estimated remaining: 3m 4s. Rate: 156.1 symbols/min [2025-10-08T22:41:55.590093] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:55.590345] [INFO ] [MAIN ] Derivative Progress: 1293/1771 symbols completed. RVT took 1.1s. Estimated remaining: 3m 4s. Rate: 156.2 symbols/min [2025-10-08T22:41:55.590795] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:55.621860] [DEBUG] [LOCAL ] RYI: Loaded 21603 existing records from primary storage. [2025-10-08T22:41:55.622687] [INFO ] [MAIN ] RYI: Loaded 21603 primary data records. [2025-10-08T22:41:55.720284] [DEBUG] [LOCAL ] RYAN: Loaded 44657 existing records from primary storage. [2025-10-08T22:41:55.747196] [INFO ] [MAIN ] RYAN: Loaded 44657 primary data records. [2025-10-08T22:41:55.821621] [DEBUG] [LOCAL ] RYN: Loaded 45442 existing records from primary storage. [2025-10-08T22:41:55.893178] [INFO ] [MAIN ] RYN: Loaded 45442 primary data records. [2025-10-08T22:41:56.584060] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:56.585517] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21603 primary records. [2025-10-08T22:41:56.585782] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-08T22:41:56.605485] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-08T22:41:56.605869] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-08T22:41:56.608347] [INFO ] [MAIN ] Derivative Progress: 1294/1771 symbols completed. RYI took 1.0s. Estimated remaining: 3m 3s. Rate: 156.0 symbols/min [2025-10-08T22:41:56.608545] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:56.636128] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:56.637024] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45442 primary records. [2025-10-08T22:41:56.637228] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-08T22:41:56.643165] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:56.660730] [DEBUG] [LOCAL ] RZB: Loaded 6038 existing records from primary storage. [2025-10-08T22:41:56.661822] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-08T22:41:56.660480] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 44657 primary records. [2025-10-08T22:41:56.662028] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-08T22:41:56.664256] [INFO ] [MAIN ] Derivative Progress: 1295/1771 symbols completed. RYN took 1.1s. Estimated remaining: 3m 3s. Rate: 156.1 symbols/min [2025-10-08T22:41:56.661962] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-08T22:41:56.662108] [INFO ] [MAIN ] RZB: Loaded 6038 primary data records. [2025-10-08T22:41:56.676541] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:56.782749] [DEBUG] [LOCAL ] RZC: Loaded 6781 existing records from primary storage. [2025-10-08T22:41:56.789227] [INFO ] [MAIN ] RZC: Loaded 6781 primary data records. [2025-10-08T22:41:56.867815] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-08T22:41:56.897412] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-08T22:41:56.916116] [INFO ] [MAIN ] Derivative Progress: 1296/1771 symbols completed. RYAN took 1.4s. Estimated remaining: 3m 3s. Rate: 156.1 symbols/min [2025-10-08T22:41:56.925075] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:57.342531] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:57.343384] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6038 primary records. [2025-10-08T22:41:57.343741] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-08T22:41:57.373969] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-08T22:41:57.374157] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-08T22:41:57.376459] [INFO ] [MAIN ] Derivative Progress: 1297/1771 symbols completed. RZB took 0.8s. Estimated remaining: 3m 2s. Rate: 156.1 symbols/min [2025-10-08T22:41:57.376721] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:57.377627] [DEBUG] [LOCAL ] S: Loaded 53532 existing records from primary storage. [2025-10-08T22:41:57.380838] [INFO ] [MAIN ] S: Loaded 53532 primary data records. [2025-10-08T22:41:57.436074] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:57.468360] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6781 primary records. [2025-10-08T22:41:57.483914] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-08T22:41:57.549025] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-08T22:41:57.591725] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-08T22:41:57.712250] [INFO ] [MAIN ] Derivative Progress: 1298/1771 symbols completed. RZC took 1.0s. Estimated remaining: 3m 2s. Rate: 156.1 symbols/min [2025-10-08T22:41:57.712739] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:57.729627] [DEBUG] [LOCAL ] SA: Loaded 43887 existing records from primary storage. [2025-10-08T22:41:57.733112] [INFO ] [MAIN ] SA: Loaded 43887 primary data records. [2025-10-08T22:41:57.774887] [DEBUG] [LOCAL ] SABA: Loaded 9280 existing records from primary storage. [2025-10-08T22:41:57.794499] [INFO ] [MAIN ] SABA: Loaded 9280 primary data records. [2025-10-08T22:41:58.379510] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:58.382741] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53532 primary records. [2025-10-08T22:41:58.383224] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-08T22:41:58.405444] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-08T22:41:58.405838] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-08T22:41:58.408139] [INFO ] [MAIN ] Derivative Progress: 1299/1771 symbols completed. S took 1.5s. Estimated remaining: 3m 2s. Rate: 156.0 symbols/min [2025-10-08T22:41:58.408546] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:58.430428] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:58.431596] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9280 primary records. [2025-10-08T22:41:58.431798] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-08T22:41:58.462524] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-08T22:41:58.470977] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-08T22:41:58.473310] [INFO ] [MAIN ] Derivative Progress: 1300/1771 symbols completed. SABA took 0.8s. Estimated remaining: 3m 1s. Rate: 156.1 symbols/min [2025-10-08T22:41:58.473703] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:58.474335] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:58.475370] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 43887 primary records. [2025-10-08T22:41:58.475803] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-08T22:41:58.505749] [DEBUG] [LOCAL ] SAFE: Loaded 30306 existing records from primary storage. [2025-10-08T22:41:58.507391] [INFO ] [MAIN ] SAFE: Loaded 30306 primary data records. [2025-10-08T22:41:58.605545] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-08T22:41:58.610986] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-08T22:41:58.612074] [DEBUG] [LOCAL ] SAH: Loaded 21601 existing records from primary storage. [2025-10-08T22:41:58.614310] [INFO ] [MAIN ] Derivative Progress: 1301/1771 symbols completed. SA took 1.2s. Estimated remaining: 3m 1s. Rate: 156.2 symbols/min [2025-10-08T22:41:58.630868] [INFO ] [MAIN ] SAH: Loaded 21601 primary data records. [2025-10-08T22:41:58.634962] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:59.048588] [DEBUG] [LOCAL ] SAM: Loaded 21350 existing records from primary storage. [2025-10-08T22:41:59.072477] [INFO ] [MAIN ] SAM: Loaded 21350 primary data records. [2025-10-08T22:41:59.567902] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:59.568924] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30306 primary records. [2025-10-08T22:41:59.569141] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-08T22:41:59.605704] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:59.606805] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-08T22:41:59.607888] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 21601 primary records. [2025-10-08T22:41:59.606967] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-08T22:41:59.610312] [INFO ] [MAIN ] Derivative Progress: 1302/1771 symbols completed. SAFE took 1.2s. Estimated remaining: 3m 0s. Rate: 156.0 symbols/min [2025-10-08T22:41:59.610705] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:41:59.611073] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-08T22:41:59.647223] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-08T22:41:59.646550] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:41:59.647406] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-08T22:41:59.649993] [INFO ] [MAIN ] Derivative Progress: 1303/1771 symbols completed. SAH took 1.2s. Estimated remaining: 2m 60s. Rate: 156.1 symbols/min [2025-10-08T22:41:59.651095] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21350 primary records. [2025-10-08T22:41:59.651237] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-08T22:41:59.669455] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-08T22:41:59.669622] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-08T22:41:59.671764] [INFO ] [MAIN ] Derivative Progress: 1304/1771 symbols completed. SAM took 1.0s. Estimated remaining: 2m 59s. Rate: 156.2 symbols/min [2025-10-08T22:41:59.712411] [DEBUG] [LOCAL ] SAN: Loaded 52980 existing records from primary storage. [2025-10-08T22:41:59.712570] [INFO ] [MAIN ] SAN: Loaded 52980 primary data records. [2025-10-08T22:42:00.035603] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:00.036373] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52980 primary records. [2025-10-08T22:42:00.036441] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-08T22:42:00.052385] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-08T22:42:00.052486] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-08T22:42:00.054606] [INFO ] [MAIN ] Derivative Progress: 1305/1771 symbols completed. SAN took 0.4s. Estimated remaining: 2m 59s. Rate: 156.2 symbols/min [2025-10-08T22:42:00.055352] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:00.055280] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:00.055180] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:00.074597] [DEBUG] [LOCAL ] SAR: Loaded 16872 existing records from primary storage. [2025-10-08T22:42:00.074765] [INFO ] [MAIN ] SAR: Loaded 16872 primary data records. [2025-10-08T22:42:00.451455] [DEBUG] [LOCAL ] SAND: Loaded 51820 existing records from primary storage. [2025-10-08T22:42:00.454347] [INFO ] [MAIN ] SAND: Loaded 51820 primary data records. [2025-10-08T22:42:00.452598] [DEBUG] [LOCAL ] SAP: Loaded 49897 existing records from primary storage. [2025-10-08T22:42:00.455058] [INFO ] [MAIN ] SAP: Loaded 49897 primary data records. [2025-10-08T22:42:01.131568] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:01.133062] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16872 primary records. [2025-10-08T22:42:01.133246] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-08T22:42:01.151961] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-08T22:42:01.152573] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-08T22:42:01.154994] [INFO ] [MAIN ] Derivative Progress: 1306/1771 symbols completed. SAR took 1.1s. Estimated remaining: 2m 59s. Rate: 156.0 symbols/min [2025-10-08T22:42:01.155309] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:01.175217] [DEBUG] [MAIN ] SAND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:01.176203] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51820 primary records. [2025-10-08T22:42:01.176478] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-10-08T22:42:01.197998] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-10-08T22:42:01.210667] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-10-08T22:42:01.212730] [INFO ] [MAIN ] Derivative Progress: 1307/1771 symbols completed. SAND took 1.2s. Estimated remaining: 2m 58s. Rate: 156.1 symbols/min [2025-10-08T22:42:01.213026] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:01.221151] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:01.222328] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49897 primary records. [2025-10-08T22:42:01.222552] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-08T22:42:01.247748] [DEBUG] [LOCAL ] SB: Loaded 33034 existing records from primary storage. [2025-10-08T22:42:01.248553] [INFO ] [MAIN ] SB: Loaded 33034 primary data records. [2025-10-08T22:42:01.250284] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-08T22:42:01.250388] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-08T22:42:01.274088] [INFO ] [MAIN ] Derivative Progress: 1308/1771 symbols completed. SAP took 1.2s. Estimated remaining: 2m 58s. Rate: 156.2 symbols/min [2025-10-08T22:42:01.315043] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:01.434608] [DEBUG] [LOCAL ] SBI: Loaded 7410 existing records from primary storage. [2025-10-08T22:42:01.470234] [INFO ] [MAIN ] SBI: Loaded 7410 primary data records. [2025-10-08T22:42:01.596781] [DEBUG] [LOCAL ] SBH: Loaded 49785 existing records from primary storage. [2025-10-08T22:42:01.618302] [INFO ] [MAIN ] SBH: Loaded 49785 primary data records. [2025-10-08T22:42:02.222488] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:02.223968] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33034 primary records. [2025-10-08T22:42:02.224226] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-08T22:42:02.243341] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-08T22:42:02.244343] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-08T22:42:02.246576] [INFO ] [MAIN ] Derivative Progress: 1309/1771 symbols completed. SB took 1.1s. Estimated remaining: 2m 58s. Rate: 156.0 symbols/min [2025-10-08T22:42:02.247112] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:02.261065] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:02.262273] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7410 primary records. [2025-10-08T22:42:02.262516] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-08T22:42:02.298141] [DEBUG] [LOCAL ] SBR: Loaded 7598 existing records from primary storage. [2025-10-08T22:42:02.297739] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-08T22:42:02.298334] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-08T22:42:02.300747] [INFO ] [MAIN ] Derivative Progress: 1310/1771 symbols completed. SBI took 1.0s. Estimated remaining: 2m 57s. Rate: 156.1 symbols/min [2025-10-08T22:42:02.298419] [INFO ] [MAIN ] SBR: Loaded 7598 primary data records. [2025-10-08T22:42:02.312698] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:02.301359] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:02.337251] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49785 primary records. [2025-10-08T22:42:02.348240] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-08T22:42:02.438548] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-08T22:42:02.454428] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-08T22:42:02.471819] [INFO ] [MAIN ] Derivative Progress: 1311/1771 symbols completed. SBH took 1.3s. Estimated remaining: 2m 57s. Rate: 156.2 symbols/min [2025-10-08T22:42:02.487239] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:02.674935] [DEBUG] [LOCAL ] SBS: Loaded 49399 existing records from primary storage. [2025-10-08T22:42:02.673862] [DEBUG] [LOCAL ] SBSI: Loaded 14797 existing records from primary storage. [2025-10-08T22:42:02.675300] [INFO ] [MAIN ] SBSI: Loaded 14797 primary data records. [2025-10-08T22:42:02.675414] [INFO ] [MAIN ] SBS: Loaded 49399 primary data records. [2025-10-08T22:42:03.077819] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:03.195001] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7598 primary records. [2025-10-08T22:42:03.275632] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-08T22:42:03.421465] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-08T22:42:03.422016] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-08T22:42:03.424540] [INFO ] [MAIN ] Derivative Progress: 1312/1771 symbols completed. SBR took 1.2s. Estimated remaining: 2m 57s. Rate: 156.0 symbols/min [2025-10-08T22:42:03.425014] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:03.454992] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:03.468871] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14797 primary records. [2025-10-08T22:42:03.468078] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:03.469093] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-08T22:42:03.470708] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49399 primary records. [2025-10-08T22:42:03.471057] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-08T22:42:03.522797] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-08T22:42:03.524413] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-08T22:42:03.527215] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-08T22:42:03.527004] [INFO ] [MAIN ] Derivative Progress: 1313/1771 symbols completed. SBS took 1.2s. Estimated remaining: 2m 56s. Rate: 156.1 symbols/min [2025-10-08T22:42:03.527716] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-08T22:42:03.527532] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:03.530588] [INFO ] [MAIN ] Derivative Progress: 1314/1771 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 56s. Rate: 156.2 symbols/min [2025-10-08T22:42:03.546711] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:03.548967] [DEBUG] [LOCAL ] SBSW: Loaded 53079 existing records from primary storage. [2025-10-08T22:42:03.549232] [INFO ] [MAIN ] SBSW: Loaded 53079 primary data records. [2025-10-08T22:42:03.701136] [DEBUG] [LOCAL ] SCD: Loaded 13042 existing records from primary storage. [2025-10-08T22:42:03.706565] [INFO ] [MAIN ] SCD: Loaded 13042 primary data records. [2025-10-08T22:42:03.931860] [DEBUG] [LOCAL ] SCCO: Loaded 49592 existing records from primary storage. [2025-10-08T22:42:03.932136] [INFO ] [MAIN ] SCCO: Loaded 49592 primary data records. [2025-10-08T22:42:04.885091] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:04.886322] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53079 primary records. [2025-10-08T22:42:04.886696] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-08T22:42:04.905801] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-08T22:42:04.906258] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-08T22:42:04.910253] [INFO ] [MAIN ] Derivative Progress: 1315/1771 symbols completed. SBSW took 1.5s. Estimated remaining: 2m 55s. Rate: 155.9 symbols/min [2025-10-08T22:42:04.912954] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:04.928605] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:04.929833] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13042 primary records. [2025-10-08T22:42:04.930354] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-08T22:42:04.965821] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-08T22:42:04.966850] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-08T22:42:04.966755] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:04.970406] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49592 primary records. [2025-10-08T22:42:04.970624] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-08T22:42:04.969329] [INFO ] [MAIN ] Derivative Progress: 1316/1771 symbols completed. SCD took 1.4s. Estimated remaining: 2m 55s. Rate: 156.0 symbols/min [2025-10-08T22:42:04.972049] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:04.990443] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-08T22:42:04.990746] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-08T22:42:04.993448] [INFO ] [MAIN ] Derivative Progress: 1317/1771 symbols completed. SCCO took 1.5s. Estimated remaining: 2m 54s. Rate: 156.1 symbols/min [2025-10-08T22:42:04.993838] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:05.031363] [DEBUG] [LOCAL ] SCL: Loaded 14833 existing records from primary storage. [2025-10-08T22:42:05.046082] [INFO ] [MAIN ] SCL: Loaded 14833 primary data records. [2025-10-08T22:42:05.068089] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-08T22:42:05.121580] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-08T22:42:05.278563] [DEBUG] [LOCAL ] SCI: Loaded 46538 existing records from primary storage. [2025-10-08T22:42:05.319446] [INFO ] [MAIN ] SCI: Loaded 46538 primary data records. [2025-10-08T22:42:06.087019] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:06.091371] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14833 primary records. [2025-10-08T22:42:06.093179] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-08T22:42:06.129366] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:06.135029] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-08T22:42:06.135504] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-08T22:42:06.136139] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-08T22:42:06.139150] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-08T22:42:06.155404] [INFO ] [MAIN ] Derivative Progress: 1318/1771 symbols completed. SCL took 1.2s. Estimated remaining: 2m 54s. Rate: 155.9 symbols/min [2025-10-08T22:42:06.174708] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:06.176825] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46538 primary records. [2025-10-08T22:42:06.177497] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-08T22:42:06.188493] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-08T22:42:06.191962] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-08T22:42:06.194769] [INFO ] [MAIN ] Derivative Progress: 1319/1771 symbols completed. SCHW took 1.3s. Estimated remaining: 2m 54s. Rate: 156.0 symbols/min [2025-10-08T22:42:06.198101] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-08T22:42:06.198174] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-08T22:42:06.200703] [INFO ] [MAIN ] Derivative Progress: 1320/1771 symbols completed. SCI took 1.2s. Estimated remaining: 2m 53s. Rate: 156.1 symbols/min [2025-10-08T22:42:06.201231] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:06.201155] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:06.201077] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:06.213723] [DEBUG] [LOCAL ] SDHC: Loaded 10348 existing records from primary storage. [2025-10-08T22:42:06.213878] [INFO ] [MAIN ] SDHC: Loaded 10348 primary data records. [2025-10-08T22:42:06.342635] [DEBUG] [LOCAL ] SCM: Loaded 19886 existing records from primary storage. [2025-10-08T22:42:06.353973] [INFO ] [MAIN ] SCM: Loaded 19886 primary data records. [2025-10-08T22:42:06.535787] [DEBUG] [LOCAL ] SCS: Loaded 43480 existing records from primary storage. [2025-10-08T22:42:06.666897] [INFO ] [MAIN ] SCS: Loaded 43480 primary data records. [2025-10-08T22:42:07.201553] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:07.204213] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10348 primary records. [2025-10-08T22:42:07.207208] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-08T22:42:07.244138] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:07.247436] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19886 primary records. [2025-10-08T22:42:07.247561] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-08T22:42:07.246471] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-08T22:42:07.249136] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-08T22:42:07.251522] [INFO ] [MAIN ] Derivative Progress: 1321/1771 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 53s. Rate: 155.9 symbols/min [2025-10-08T22:42:07.263400] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:07.293068] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:07.295296] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43480 primary records. [2025-10-08T22:42:07.295819] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-08T22:42:07.298828] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-08T22:42:07.306691] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-08T22:42:07.309076] [INFO ] [MAIN ] Derivative Progress: 1322/1771 symbols completed. SCM took 1.1s. Estimated remaining: 2m 53s. Rate: 156.0 symbols/min [2025-10-08T22:42:07.318195] [DEBUG] [LOCAL ] SDHY: Loaded 10901 existing records from primary storage. [2025-10-08T22:42:07.309231] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:07.319090] [INFO ] [MAIN ] SDHY: Loaded 10901 primary data records. [2025-10-08T22:42:07.404013] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-08T22:42:07.427846] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-08T22:42:07.433507] [INFO ] [MAIN ] Derivative Progress: 1323/1771 symbols completed. SCS took 1.2s. Estimated remaining: 2m 52s. Rate: 156.1 symbols/min [2025-10-08T22:42:07.433783] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:07.693942] [DEBUG] [LOCAL ] SDRL: Loaded 41463 existing records from primary storage. [2025-10-08T22:42:07.694155] [INFO ] [MAIN ] SDRL: Loaded 41463 primary data records. [2025-10-08T22:42:08.028314] [DEBUG] [LOCAL ] SE: Loaded 53331 existing records from primary storage. [2025-10-08T22:42:08.036215] [INFO ] [MAIN ] SE: Loaded 53331 primary data records. [2025-10-08T22:42:08.042202] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:08.043087] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10901 primary records. [2025-10-08T22:42:08.043184] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-08T22:42:08.151605] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-08T22:42:08.177931] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-08T22:42:08.185738] [INFO ] [MAIN ] Derivative Progress: 1324/1771 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 52s. Rate: 156.0 symbols/min [2025-10-08T22:42:08.191145] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:08.412595] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:08.413938] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41463 primary records. [2025-10-08T22:42:08.414593] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-08T22:42:08.445010] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-08T22:42:08.445265] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-08T22:42:08.447742] [INFO ] [MAIN ] Derivative Progress: 1325/1771 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 52s. Rate: 156.0 symbols/min [2025-10-08T22:42:08.448056] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:08.490372] [DEBUG] [LOCAL ] SEE: Loaded 48187 existing records from primary storage. [2025-10-08T22:42:08.489607] [DEBUG] [LOCAL ] SEG: Loaded 13214 existing records from primary storage. [2025-10-08T22:42:08.485058] [DEBUG] [MAIN ] SE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:08.491445] [INFO ] [MAIN ] SEE: Loaded 48187 primary data records. [2025-10-08T22:42:08.491351] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53331 primary records. [2025-10-08T22:42:08.491728] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-10-08T22:42:08.497054] [INFO ] [MAIN ] SEG: Loaded 13214 primary data records. [2025-10-08T22:42:08.762311] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-10-08T22:42:08.934152] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-10-08T22:42:08.986466] [INFO ] [MAIN ] Derivative Progress: 1326/1771 symbols completed. SE took 1.6s. Estimated remaining: 2m 51s. Rate: 156.0 symbols/min [2025-10-08T22:42:08.987366] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:09.132873] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:09.133587] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13214 primary records. [2025-10-08T22:42:09.133780] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-08T22:42:09.152022] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-08T22:42:09.152499] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-08T22:42:09.154911] [INFO ] [MAIN ] Derivative Progress: 1327/1771 symbols completed. SEG took 0.7s. Estimated remaining: 2m 51s. Rate: 156.0 symbols/min [2025-10-08T22:42:09.159546] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:09.174802] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:09.176028] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48187 primary records. [2025-10-08T22:42:09.186674] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-08T22:42:09.203806] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-08T22:42:09.204067] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-08T22:42:09.206399] [INFO ] [MAIN ] Derivative Progress: 1328/1771 symbols completed. SEE took 1.0s. Estimated remaining: 2m 50s. Rate: 156.1 symbols/min [2025-10-08T22:42:09.220398] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:09.221914] [DEBUG] [LOCAL ] SEI: Loaded 49760 existing records from primary storage. [2025-10-08T22:42:09.222160] [INFO ] [MAIN ] SEI: Loaded 49760 primary data records. [2025-10-08T22:42:09.611913] [DEBUG] [LOCAL ] SEM: Loaded 42906 existing records from primary storage. [2025-10-08T22:42:09.612308] [INFO ] [MAIN ] SEM: Loaded 42906 primary data records. [2025-10-08T22:42:09.613389] [DEBUG] [LOCAL ] SEMR: Loaded 41795 existing records from primary storage. [2025-10-08T22:42:09.625271] [INFO ] [MAIN ] SEMR: Loaded 41795 primary data records. [2025-10-08T22:42:10.309370] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:10.310893] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49760 primary records. [2025-10-08T22:42:10.311130] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-08T22:42:10.333789] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-08T22:42:10.334344] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-08T22:42:10.336749] [INFO ] [MAIN ] Derivative Progress: 1329/1771 symbols completed. SEI took 1.3s. Estimated remaining: 2m 50s. Rate: 155.9 symbols/min [2025-10-08T22:42:10.337309] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:10.369563] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:10.370001] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:10.371833] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41795 primary records. [2025-10-08T22:42:10.372002] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-08T22:42:10.371013] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 42906 primary records. [2025-10-08T22:42:10.372514] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-08T22:42:10.404069] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-08T22:42:10.408460] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-08T22:42:10.412040] [INFO ] [MAIN ] Derivative Progress: 1330/1771 symbols completed. SEM took 1.3s. Estimated remaining: 2m 50s. Rate: 156.0 symbols/min [2025-10-08T22:42:10.408290] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-08T22:42:10.412354] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-08T22:42:10.412580] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:10.414764] [INFO ] [MAIN ] Derivative Progress: 1331/1771 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 49s. Rate: 156.1 symbols/min [2025-10-08T22:42:10.415602] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:10.435064] [DEBUG] [LOCAL ] SFB: Loaded 4199 existing records from primary storage. [2025-10-08T22:42:10.435329] [INFO ] [MAIN ] SFB: Loaded 4199 primary data records. [2025-10-08T22:42:10.542290] [DEBUG] [LOCAL ] SES: Loaded 51569 existing records from primary storage. [2025-10-08T22:42:10.553515] [INFO ] [MAIN ] SES: Loaded 51569 primary data records. [2025-10-08T22:42:10.750363] [DEBUG] [LOCAL ] SF: Loaded 41634 existing records from primary storage. [2025-10-08T22:42:10.902592] [INFO ] [MAIN ] SF: Loaded 41634 primary data records. [2025-10-08T22:42:11.437118] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:11.439154] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4199 primary records. [2025-10-08T22:42:11.439371] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-08T22:42:11.469080] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-08T22:42:11.474868] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:11.476043] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51569 primary records. [2025-10-08T22:42:11.475229] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-08T22:42:11.476531] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-08T22:42:11.478808] [INFO ] [MAIN ] Derivative Progress: 1332/1771 symbols completed. SFB took 1.1s. Estimated remaining: 2m 49s. Rate: 155.9 symbols/min [2025-10-08T22:42:11.479733] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:11.501039] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-08T22:42:11.501342] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-08T22:42:11.503908] [INFO ] [MAIN ] Derivative Progress: 1333/1771 symbols completed. SES took 1.2s. Estimated remaining: 2m 48s. Rate: 156.0 symbols/min [2025-10-08T22:42:11.516595] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:11.517375] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41634 primary records. [2025-10-08T22:42:11.523071] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-08T22:42:11.545700] [DEBUG] [LOCAL ] SFBS: Loaded 21095 existing records from primary storage. [2025-10-08T22:42:11.546450] [INFO ] [MAIN ] SFBS: Loaded 21095 primary data records. [2025-10-08T22:42:11.600048] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-08T22:42:11.613739] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-08T22:42:11.624941] [INFO ] [MAIN ] Derivative Progress: 1334/1771 symbols completed. SF took 1.2s. Estimated remaining: 2m 48s. Rate: 156.1 symbols/min [2025-10-08T22:42:11.921038] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:11.921769] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21095 primary records. [2025-10-08T22:42:11.921846] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-08T22:42:11.937532] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-10-08T22:42:11.937612] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-08T22:42:11.940080] [INFO ] [MAIN ] Derivative Progress: 1335/1771 symbols completed. SFBS took 0.5s. Estimated remaining: 2m 48s. Rate: 156.1 symbols/min [2025-10-08T22:42:11.940817] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:11.940982] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:11.940632] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:12.018154] [DEBUG] [LOCAL ] SGHC: Loaded 46532 existing records from primary storage. [2025-10-08T22:42:12.019093] [INFO ] [MAIN ] SGHC: Loaded 46532 primary data records. [2025-10-08T22:42:12.091255] [DEBUG] [LOCAL ] SFL: Loaded 45174 existing records from primary storage. [2025-10-08T22:42:12.128219] [DEBUG] [LOCAL ] SG: Loaded 53472 existing records from primary storage. [2025-10-08T22:42:12.135169] [INFO ] [MAIN ] SG: Loaded 53472 primary data records. [2025-10-08T22:42:12.127104] [INFO ] [MAIN ] SFL: Loaded 45174 primary data records. [2025-10-08T22:42:13.003240] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:13.004574] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 46532 primary records. [2025-10-08T22:42:13.004872] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-08T22:42:13.027133] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-08T22:42:13.039349] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-08T22:42:13.053860] [INFO ] [MAIN ] Derivative Progress: 1336/1771 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 47s. Rate: 155.9 symbols/min [2025-10-08T22:42:13.054857] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:13.055170] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:13.055617] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:13.056418] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53472 primary records. [2025-10-08T22:42:13.056525] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-08T22:42:13.057778] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45174 primary records. [2025-10-08T22:42:13.057960] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-08T22:42:13.096324] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-08T22:42:13.092126] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-08T22:42:13.095718] [DEBUG] [LOCAL ] SGU: Loaded 6597 existing records from primary storage. [2025-10-08T22:42:13.096492] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-08T22:42:13.099144] [INFO ] [MAIN ] SGU: Loaded 6597 primary data records. [2025-10-08T22:42:13.096615] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-08T22:42:13.099031] [INFO ] [MAIN ] Derivative Progress: 1337/1771 symbols completed. SFL took 1.2s. Estimated remaining: 2m 47s. Rate: 156.0 symbols/min [2025-10-08T22:42:13.145496] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:13.155617] [INFO ] [MAIN ] Derivative Progress: 1338/1771 symbols completed. SG took 1.2s. Estimated remaining: 2m 46s. Rate: 156.1 symbols/min [2025-10-08T22:42:13.166717] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:13.429666] [DEBUG] [LOCAL ] SHCO: Loaded 25465 existing records from primary storage. [2025-10-08T22:42:13.430314] [INFO ] [MAIN ] SHCO: Loaded 25465 primary data records. [2025-10-08T22:42:13.559275] [DEBUG] [LOCAL ] SHAK: Loaded 48826 existing records from primary storage. [2025-10-08T22:42:13.559766] [INFO ] [MAIN ] SHAK: Loaded 48826 primary data records. [2025-10-08T22:42:13.989115] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:14.111740] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6597 primary records. [2025-10-08T22:42:14.113169] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-08T22:42:14.135416] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-08T22:42:14.135603] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-08T22:42:14.137560] [INFO ] [MAIN ] Derivative Progress: 1339/1771 symbols completed. SGU took 1.1s. Estimated remaining: 2m 46s. Rate: 155.9 symbols/min [2025-10-08T22:42:14.138543] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:14.165360] [DEBUG] [MAIN ] SHCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:14.179849] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25465 primary records. [2025-10-08T22:42:14.180458] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-08T22:42:14.180927] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:14.183078] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48826 primary records. [2025-10-08T22:42:14.183261] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-08T22:42:14.217192] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-08T22:42:14.230548] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-08T22:42:14.234458] [INFO ] [MAIN ] Derivative Progress: 1340/1771 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 46s. Rate: 156.0 symbols/min [2025-10-08T22:42:14.232416] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-08T22:42:14.234929] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:14.234823] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-08T22:42:14.237547] [INFO ] [MAIN ] Derivative Progress: 1341/1771 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 45s. Rate: 156.1 symbols/min [2025-10-08T22:42:14.237796] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:14.261587] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-10-08T22:42:14.261951] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-10-08T22:42:14.413014] [DEBUG] [LOCAL ] SHG: Loaded 26285 existing records from primary storage. [2025-10-08T22:42:14.423528] [INFO ] [MAIN ] SHG: Loaded 26285 primary data records. [2025-10-08T22:42:14.736753] [DEBUG] [LOCAL ] SHO: Loaded 49577 existing records from primary storage. [2025-10-08T22:42:14.743736] [INFO ] [MAIN ] SHO: Loaded 49577 primary data records. [2025-10-08T22:42:15.282903] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:15.284974] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-10-08T22:42:15.285307] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-08T22:42:15.312056] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-08T22:42:15.312488] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-08T22:42:15.314551] [INFO ] [MAIN ] Derivative Progress: 1342/1771 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 45s. Rate: 155.9 symbols/min [2025-10-08T22:42:15.328862] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:15.329949] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:15.332757] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26285 primary records. [2025-10-08T22:42:15.335061] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-08T22:42:15.364994] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:15.368994] [DEBUG] [LOCAL ] SHOC: Loaded 3342 existing records from primary storage. [2025-10-08T22:42:15.370527] [INFO ] [MAIN ] SHOC: Loaded 3342 primary data records. [2025-10-08T22:42:15.370421] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49577 primary records. [2025-10-08T22:42:15.371330] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-08T22:42:15.411406] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-08T22:42:15.460367] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-08T22:42:15.491433] [INFO ] [MAIN ] Derivative Progress: 1343/1771 symbols completed. SHG took 1.3s. Estimated remaining: 2m 45s. Rate: 156.0 symbols/min [2025-10-08T22:42:15.512621] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:15.676950] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-08T22:42:15.695542] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-08T22:42:15.697907] [INFO ] [MAIN ] Derivative Progress: 1344/1771 symbols completed. SHO took 1.5s. Estimated remaining: 2m 44s. Rate: 156.0 symbols/min [2025-10-08T22:42:15.698798] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:15.741028] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:15.742088] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3342 primary records. [2025-10-08T22:42:15.742202] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-08T22:42:15.783437] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-08T22:42:15.783752] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-08T22:42:15.787220] [INFO ] [MAIN ] Derivative Progress: 1345/1771 symbols completed. SHOC took 0.5s. Estimated remaining: 2m 44s. Rate: 156.1 symbols/min [2025-10-08T22:42:15.784695] [DEBUG] [LOCAL ] SID: Loaded 42554 existing records from primary storage. [2025-10-08T22:42:15.787820] [INFO ] [MAIN ] SID: Loaded 42554 primary data records. [2025-10-08T22:42:15.787429] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:15.896810] [DEBUG] [LOCAL ] SHW: Loaded 50320 existing records from primary storage. [2025-10-08T22:42:15.909076] [INFO ] [MAIN ] SHW: Loaded 50320 primary data records. [2025-10-08T22:42:16.347030] [DEBUG] [LOCAL ] SIG: Loaded 45786 existing records from primary storage. [2025-10-08T22:42:16.378991] [INFO ] [MAIN ] SIG: Loaded 45786 primary data records. [2025-10-08T22:42:16.882528] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:16.884227] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42554 primary records. [2025-10-08T22:42:16.884340] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-08T22:42:16.916155] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:16.920149] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50320 primary records. [2025-10-08T22:42:16.919189] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-08T22:42:16.920561] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-08T22:42:16.924297] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-08T22:42:16.924026] [INFO ] [MAIN ] Derivative Progress: 1346/1771 symbols completed. SID took 1.2s. Estimated remaining: 2m 44s. Rate: 155.9 symbols/min [2025-10-08T22:42:16.926434] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:16.944208] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-08T22:42:16.945321] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-08T22:42:16.950021] [INFO ] [MAIN ] Derivative Progress: 1347/1771 symbols completed. SHW took 1.4s. Estimated remaining: 2m 43s. Rate: 156.0 symbols/min [2025-10-08T22:42:16.950344] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:16.964527] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:16.965536] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45786 primary records. [2025-10-08T22:42:16.965730] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-08T22:42:16.988225] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-08T22:42:16.988985] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-08T22:42:16.997685] [INFO ] [MAIN ] Derivative Progress: 1348/1771 symbols completed. SIG took 1.2s. Estimated remaining: 2m 43s. Rate: 156.1 symbols/min [2025-10-08T22:42:16.999806] [DEBUG] [LOCAL ] SII: Loaded 23684 existing records from primary storage. [2025-10-08T22:42:16.999964] [INFO ] [MAIN ] SII: Loaded 23684 primary data records. [2025-10-08T22:42:17.252388] [DEBUG] [LOCAL ] SILA: Loaded 30608 existing records from primary storage. [2025-10-08T22:42:17.321335] [INFO ] [MAIN ] SILA: Loaded 30608 primary data records. [2025-10-08T22:42:17.681342] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:17.684281] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 23684 primary records. [2025-10-08T22:42:17.684591] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-08T22:42:17.707352] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-08T22:42:17.707524] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-08T22:42:17.709756] [INFO ] [MAIN ] Derivative Progress: 1349/1771 symbols completed. SII took 0.8s. Estimated remaining: 2m 42s. Rate: 156.0 symbols/min [2025-10-08T22:42:17.725283] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:17.726031] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30608 primary records. [2025-10-08T22:42:17.726097] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-08T22:42:17.741606] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-08T22:42:17.741706] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-08T22:42:17.743562] [INFO ] [MAIN ] Derivative Progress: 1350/1771 symbols completed. SILA took 0.8s. Estimated remaining: 2m 42s. Rate: 156.1 symbols/min [2025-10-08T22:42:17.744260] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:17.744380] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:17.744187] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:17.808498] [DEBUG] [LOCAL ] SITC: Loaded 41578 existing records from primary storage. [2025-10-08T22:42:17.819267] [INFO ] [MAIN ] SITC: Loaded 41578 primary data records. [2025-10-08T22:42:17.809589] [DEBUG] [LOCAL ] SITE: Loaded 35253 existing records from primary storage. [2025-10-08T22:42:17.831247] [INFO ] [MAIN ] SITE: Loaded 35253 primary data records. [2025-10-08T22:42:18.058202] [DEBUG] [LOCAL ] SJM: Loaded 50116 existing records from primary storage. [2025-10-08T22:42:18.067489] [INFO ] [MAIN ] SJM: Loaded 50116 primary data records. [2025-10-08T22:42:18.914833] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:18.917890] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41578 primary records. [2025-10-08T22:42:18.918257] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-08T22:42:18.950180] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:18.951978] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35253 primary records. [2025-10-08T22:42:18.952567] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-08T22:42:18.952900] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-08T22:42:18.955139] [INFO ] [MAIN ] Derivative Progress: 1351/1771 symbols completed. SITC took 1.2s. Estimated remaining: 2m 42s. Rate: 155.9 symbols/min [2025-10-08T22:42:18.955424] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:18.952988] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-08T22:42:18.970202] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:18.979039] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50116 primary records. [2025-10-08T22:42:18.982866] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-08T22:42:19.008346] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-08T22:42:19.008914] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-08T22:42:19.011380] [INFO ] [MAIN ] Derivative Progress: 1352/1771 symbols completed. SJM took 1.3s. Estimated remaining: 2m 41s. Rate: 156.0 symbols/min [2025-10-08T22:42:19.012140] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:19.013288] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-08T22:42:19.013480] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-08T22:42:19.015524] [INFO ] [MAIN ] Derivative Progress: 1353/1771 symbols completed. SITE took 1.3s. Estimated remaining: 2m 41s. Rate: 156.1 symbols/min [2025-10-08T22:42:19.022410] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:19.024240] [DEBUG] [LOCAL ] SJT: Loaded 22517 existing records from primary storage. [2025-10-08T22:42:19.024809] [INFO ] [MAIN ] SJT: Loaded 22517 primary data records. [2025-10-08T22:42:19.135255] [DEBUG] [LOCAL ] SKIL: Loaded 6539 existing records from primary storage. [2025-10-08T22:42:19.165790] [INFO ] [MAIN ] SKIL: Loaded 6539 primary data records. [2025-10-08T22:42:19.459937] [DEBUG] [LOCAL ] SKE: Loaded 36311 existing records from primary storage. [2025-10-08T22:42:19.472360] [INFO ] [MAIN ] SKE: Loaded 36311 primary data records. [2025-10-08T22:42:20.076760] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:20.077935] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22517 primary records. [2025-10-08T22:42:20.081896] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-08T22:42:20.109497] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:20.111051] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6539 primary records. [2025-10-08T22:42:20.111729] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-08T22:42:20.115156] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-08T22:42:20.115440] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-08T22:42:20.124388] [INFO ] [MAIN ] Derivative Progress: 1354/1771 symbols completed. SJT took 1.2s. Estimated remaining: 2m 41s. Rate: 155.9 symbols/min [2025-10-08T22:42:20.128483] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:20.151480] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-08T22:42:20.152169] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-08T22:42:20.154280] [INFO ] [MAIN ] Derivative Progress: 1355/1771 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 40s. Rate: 156.0 symbols/min [2025-10-08T22:42:20.154467] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:20.152072] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:20.155556] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 36311 primary records. [2025-10-08T22:42:20.160669] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-08T22:42:20.160960] [DEBUG] [LOCAL ] SKLZ: Loaded 11603 existing records from primary storage. [2025-10-08T22:42:20.161178] [INFO ] [MAIN ] SKLZ: Loaded 11603 primary data records. [2025-10-08T22:42:20.283832] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-08T22:42:20.310156] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-08T22:42:20.336267] [INFO ] [MAIN ] Derivative Progress: 1356/1771 symbols completed. SKE took 1.3s. Estimated remaining: 2m 40s. Rate: 156.0 symbols/min [2025-10-08T22:42:20.370254] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:20.530341] [DEBUG] [LOCAL ] SKT: Loaded 42467 existing records from primary storage. [2025-10-08T22:42:20.531087] [INFO ] [MAIN ] SKT: Loaded 42467 primary data records. [2025-10-08T22:42:20.768294] [DEBUG] [LOCAL ] SKY: Loaded 38006 existing records from primary storage. [2025-10-08T22:42:20.904573] [INFO ] [MAIN ] SKY: Loaded 38006 primary data records. [2025-10-08T22:42:21.006500] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:21.031211] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11603 primary records. [2025-10-08T22:42:21.031394] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-08T22:42:21.254339] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-08T22:42:21.255700] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-08T22:42:21.257900] [INFO ] [MAIN ] Derivative Progress: 1357/1771 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 39s. Rate: 155.9 symbols/min [2025-10-08T22:42:21.258712] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:21.287116] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:21.288047] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42467 primary records. [2025-10-08T22:42:21.294456] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-08T22:42:21.297167] [DEBUG] [LOCAL ] SKYH: Loaded 16565 existing records from primary storage. [2025-10-08T22:42:21.309488] [INFO ] [MAIN ] SKYH: Loaded 16565 primary data records. [2025-10-08T22:42:21.391297] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-08T22:42:21.402243] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-08T22:42:21.404637] [INFO ] [MAIN ] Derivative Progress: 1358/1771 symbols completed. SKT took 1.3s. Estimated remaining: 2m 39s. Rate: 155.9 symbols/min [2025-10-08T22:42:21.421977] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:21.463917] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:21.498401] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38006 primary records. [2025-10-08T22:42:21.513064] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-08T22:42:21.673633] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-08T22:42:21.674373] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-08T22:42:21.676306] [INFO ] [MAIN ] Derivative Progress: 1359/1771 symbols completed. SKY took 1.3s. Estimated remaining: 2m 38s. Rate: 156.0 symbols/min [2025-10-08T22:42:21.691110] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:21.715343] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-08T22:42:21.715785] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-08T22:42:21.874505] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:21.894603] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16565 primary records. [2025-10-08T22:42:21.901077] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-08T22:42:21.944690] [DEBUG] [LOCAL ] SLF: Loaded 38750 existing records from primary storage. [2025-10-08T22:42:21.998351] [INFO ] [MAIN ] SLF: Loaded 38750 primary data records. [2025-10-08T22:42:22.012483] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-08T22:42:22.020448] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-08T22:42:22.023773] [INFO ] [MAIN ] Derivative Progress: 1360/1771 symbols completed. SKYH took 0.8s. Estimated remaining: 2m 38s. Rate: 156.0 symbols/min [2025-10-08T22:42:22.024063] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:22.560935] [DEBUG] [LOCAL ] SLG: Loaded 45182 existing records from primary storage. [2025-10-08T22:42:22.561671] [INFO ] [MAIN ] SLG: Loaded 45182 primary data records. [2025-10-08T22:42:22.624920] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:22.647668] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-08T22:42:22.666389] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-08T22:42:22.938897] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-08T22:42:22.939896] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-08T22:42:22.950559] [INFO ] [MAIN ] Derivative Progress: 1361/1771 symbols completed. SLB took 1.5s. Estimated remaining: 2m 38s. Rate: 155.8 symbols/min [2025-10-08T22:42:22.957549] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:22.957153] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:22.959036] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38750 primary records. [2025-10-08T22:42:22.959613] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-08T22:42:22.980163] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-08T22:42:22.980711] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-08T22:42:22.983409] [INFO ] [MAIN ] Derivative Progress: 1362/1771 symbols completed. SLF took 1.3s. Estimated remaining: 2m 37s. Rate: 155.9 symbols/min [2025-10-08T22:42:22.983742] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:23.002994] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:23.004034] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45182 primary records. [2025-10-08T22:42:23.004162] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-08T22:42:23.030800] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-08T22:42:23.030937] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-08T22:42:23.032966] [INFO ] [MAIN ] Derivative Progress: 1363/1771 symbols completed. SLG took 1.0s. Estimated remaining: 2m 37s. Rate: 156.0 symbols/min [2025-10-08T22:42:23.046543] [DEBUG] [LOCAL ] SLGN: Loaded 40575 existing records from primary storage. [2025-10-08T22:42:23.046825] [INFO ] [MAIN ] SLGN: Loaded 40575 primary data records. [2025-10-08T22:42:23.254024] [DEBUG] [LOCAL ] SLQT: Loaded 43514 existing records from primary storage. [2025-10-08T22:42:23.369231] [INFO ] [MAIN ] SLQT: Loaded 43514 primary data records. [2025-10-08T22:42:23.699920] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:23.701361] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40575 primary records. [2025-10-08T22:42:23.701497] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-08T22:42:23.721742] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-08T22:42:23.721866] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-08T22:42:23.724021] [INFO ] [MAIN ] Derivative Progress: 1364/1771 symbols completed. SLGN took 0.8s. Estimated remaining: 2m 37s. Rate: 155.9 symbols/min [2025-10-08T22:42:23.739821] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:23.740418] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43514 primary records. [2025-10-08T22:42:23.740478] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-08T22:42:23.755742] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-08T22:42:23.755811] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-08T22:42:23.758433] [INFO ] [MAIN ] Derivative Progress: 1365/1771 symbols completed. SLQT took 0.8s. Estimated remaining: 2m 36s. Rate: 156.0 symbols/min [2025-10-08T22:42:23.758937] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:23.759076] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:23.759201] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:23.773829] [DEBUG] [LOCAL ] SMBK: Loaded 8170 existing records from primary storage. [2025-10-08T22:42:23.774092] [INFO ] [MAIN ] SMBK: Loaded 8170 primary data records. [2025-10-08T22:42:23.887673] [DEBUG] [LOCAL ] SLVM: Loaded 27872 existing records from primary storage. [2025-10-08T22:42:23.906721] [INFO ] [MAIN ] SLVM: Loaded 27872 primary data records. [2025-10-08T22:42:24.346269] [DEBUG] [LOCAL ] SM: Loaded 52313 existing records from primary storage. [2025-10-08T22:42:24.524555] [INFO ] [MAIN ] SM: Loaded 52313 primary data records. [2025-10-08T22:42:24.897291] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:24.898631] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8170 primary records. [2025-10-08T22:42:24.898855] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-08T22:42:24.928212] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:24.929936] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27872 primary records. [2025-10-08T22:42:24.931065] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-08T22:42:24.956190] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-08T22:42:24.957039] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-08T22:42:24.957152] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-08T22:42:24.959901] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-08T22:42:24.962681] [INFO ] [MAIN ] Derivative Progress: 1366/1771 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 36s. Rate: 155.8 symbols/min [2025-10-08T22:42:24.966016] [INFO ] [MAIN ] Derivative Progress: 1367/1771 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 35s. Rate: 155.9 symbols/min [2025-10-08T22:42:24.965923] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:24.966902] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:24.987425] [DEBUG] [LOCAL ] SMC: Loaded 11264 existing records from primary storage. [2025-10-08T22:42:24.987998] [INFO ] [MAIN ] SMC: Loaded 11264 primary data records. [2025-10-08T22:42:25.048748] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:25.090796] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52313 primary records. [2025-10-08T22:42:25.150927] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-08T22:42:25.378962] [DEBUG] [LOCAL ] SMFG: Loaded 48189 existing records from primary storage. [2025-10-08T22:42:25.379976] [INFO ] [MAIN ] SMFG: Loaded 48189 primary data records. [2025-10-08T22:42:25.380111] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-08T22:42:25.392850] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-08T22:42:25.415701] [INFO ] [MAIN ] Derivative Progress: 1368/1771 symbols completed. SM took 1.7s. Estimated remaining: 2m 35s. Rate: 155.9 symbols/min [2025-10-08T22:42:25.416125] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:25.720408] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:25.721413] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11264 primary records. [2025-10-08T22:42:25.721983] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-08T22:42:25.746531] [DEBUG] [LOCAL ] SMG: Loaded 43618 existing records from primary storage. [2025-10-08T22:42:25.751288] [INFO ] [MAIN ] SMG: Loaded 43618 primary data records. [2025-10-08T22:42:25.863838] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-08T22:42:25.869462] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-08T22:42:25.892596] [INFO ] [MAIN ] Derivative Progress: 1369/1771 symbols completed. SMC took 0.9s. Estimated remaining: 2m 35s. Rate: 155.9 symbols/min [2025-10-08T22:42:25.906668] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:26.081688] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:26.082617] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48189 primary records. [2025-10-08T22:42:26.083872] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-08T22:42:26.108677] [DEBUG] [LOCAL ] SMHI: Loaded 13112 existing records from primary storage. [2025-10-08T22:42:26.109597] [INFO ] [MAIN ] SMHI: Loaded 13112 primary data records. [2025-10-08T22:42:26.208668] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-08T22:42:26.219827] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-08T22:42:26.222146] [INFO ] [MAIN ] Derivative Progress: 1370/1771 symbols completed. SMFG took 1.3s. Estimated remaining: 2m 34s. Rate: 155.9 symbols/min [2025-10-08T22:42:26.228815] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:26.484370] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:26.485401] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 43618 primary records. [2025-10-08T22:42:26.486316] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-08T22:42:26.508094] [DEBUG] [LOCAL ] SMP: Loaded 18965 existing records from primary storage. [2025-10-08T22:42:26.510170] [INFO ] [MAIN ] SMP: Loaded 18965 primary data records. [2025-10-08T22:42:26.590114] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-08T22:42:26.632091] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-08T22:42:26.639842] [INFO ] [MAIN ] Derivative Progress: 1371/1771 symbols completed. SMG took 1.2s. Estimated remaining: 2m 34s. Rate: 155.9 symbols/min [2025-10-08T22:42:26.645702] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:26.873363] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:26.875116] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 13112 primary records. [2025-10-08T22:42:26.875250] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-08T22:42:26.896503] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-08T22:42:26.896692] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-08T22:42:26.899347] [INFO ] [MAIN ] Derivative Progress: 1372/1771 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 34s. Rate: 155.9 symbols/min [2025-10-08T22:42:26.914274] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:26.934287] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:26.950145] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18965 primary records. [2025-10-08T22:42:26.950385] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-08T22:42:26.952070] [DEBUG] [LOCAL ] SMR: Loaded 53798 existing records from primary storage. [2025-10-08T22:42:26.959507] [INFO ] [MAIN ] SMR: Loaded 53798 primary data records. [2025-10-08T22:42:27.154213] [DEBUG] [LOCAL ] SMRT: Loaded 44025 existing records from primary storage. [2025-10-08T22:42:27.154360] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-08T22:42:27.184418] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-08T22:42:27.300214] [INFO ] [MAIN ] SMRT: Loaded 44025 primary data records. [2025-10-08T22:42:27.186890] [INFO ] [MAIN ] Derivative Progress: 1373/1771 symbols completed. SMP took 1.0s. Estimated remaining: 2m 33s. Rate: 155.9 symbols/min [2025-10-08T22:42:27.301272] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:27.622547] [DEBUG] [LOCAL ] SMWB: Loaded 32277 existing records from primary storage. [2025-10-08T22:42:27.623110] [INFO ] [MAIN ] SMWB: Loaded 32277 primary data records. [2025-10-08T22:42:27.760321] [DEBUG] [MAIN ] SMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:27.771593] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53798 primary records. [2025-10-08T22:42:27.771823] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-10-08T22:42:27.966929] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-10-08T22:42:27.967246] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-10-08T22:42:27.969766] [INFO ] [MAIN ] Derivative Progress: 1374/1771 symbols completed. SMR took 1.3s. Estimated remaining: 2m 33s. Rate: 155.8 symbols/min [2025-10-08T22:42:27.984387] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:27.986119] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44025 primary records. [2025-10-08T22:42:27.986508] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:27.986397] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-08T22:42:28.005351] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-08T22:42:28.005536] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-08T22:42:28.008111] [INFO ] [MAIN ] Derivative Progress: 1375/1771 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 32s. Rate: 155.9 symbols/min [2025-10-08T22:42:28.008908] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:28.027292] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:28.028361] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 32277 primary records. [2025-10-08T22:42:28.028572] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-08T22:42:28.065806] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-08T22:42:28.065979] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-08T22:42:28.068379] [INFO ] [MAIN ] Derivative Progress: 1376/1771 symbols completed. SMWB took 0.8s. Estimated remaining: 2m 32s. Rate: 156.0 symbols/min [2025-10-08T22:42:28.069137] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:28.078397] [DEBUG] [LOCAL ] SNA: Loaded 25697 existing records from primary storage. [2025-10-08T22:42:28.078604] [INFO ] [MAIN ] SNA: Loaded 25697 primary data records. [2025-10-08T22:42:28.191367] [DEBUG] [LOCAL ] SN: Loaded 49926 existing records from primary storage. [2025-10-08T22:42:28.210106] [INFO ] [MAIN ] SN: Loaded 49926 primary data records. [2025-10-08T22:42:28.739135] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-08T22:42:28.788795] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-08T22:42:29.123875] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:29.125325] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25697 primary records. [2025-10-08T22:42:29.125845] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-08T22:42:29.165298] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:29.166315] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49926 primary records. [2025-10-08T22:42:29.164714] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-08T22:42:29.166907] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-08T22:42:29.167010] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-08T22:42:29.170358] [INFO ] [MAIN ] Derivative Progress: 1377/1771 symbols completed. SNA took 1.2s. Estimated remaining: 2m 32s. Rate: 155.8 symbols/min [2025-10-08T22:42:29.171045] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:29.190434] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-08T22:42:29.190907] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-08T22:42:29.193435] [INFO ] [MAIN ] Derivative Progress: 1378/1771 symbols completed. SN took 1.2s. Estimated remaining: 2m 31s. Rate: 155.9 symbols/min [2025-10-08T22:42:29.197373] [DEBUG] [LOCAL ] SNDA: Loaded 4435 existing records from primary storage. [2025-10-08T22:42:29.197538] [INFO ] [MAIN ] SNDA: Loaded 4435 primary data records. [2025-10-08T22:42:29.327904] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:29.344463] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-08T22:42:29.358117] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-08T22:42:29.551109] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-08T22:42:29.551434] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-08T22:42:29.554143] [INFO ] [MAIN ] Derivative Progress: 1379/1771 symbols completed. SNAP took 1.5s. Estimated remaining: 2m 31s. Rate: 155.9 symbols/min [2025-10-08T22:42:29.577996] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:29.578775] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4435 primary records. [2025-10-08T22:42:29.578850] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-08T22:42:29.593616] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-08T22:42:29.593777] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-08T22:42:29.596183] [INFO ] [MAIN ] Derivative Progress: 1380/1771 symbols completed. SNDA took 0.4s. Estimated remaining: 2m 30s. Rate: 156.0 symbols/min [2025-10-08T22:42:29.597144] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:29.597045] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:29.597391] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:29.678916] [DEBUG] [LOCAL ] SNDR: Loaded 41104 existing records from primary storage. [2025-10-08T22:42:29.680438] [INFO ] [MAIN ] SNDR: Loaded 41104 primary data records. [2025-10-08T22:42:29.681174] [DEBUG] [LOCAL ] SNN: Loaded 44210 existing records from primary storage. [2025-10-08T22:42:29.712831] [INFO ] [MAIN ] SNN: Loaded 44210 primary data records. [2025-10-08T22:42:29.833354] [DEBUG] [LOCAL ] SNOW: Loaded 53593 existing records from primary storage. [2025-10-08T22:42:29.858602] [INFO ] [MAIN ] SNOW: Loaded 53593 primary data records. [2025-10-08T22:42:30.713883] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:30.714894] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41104 primary records. [2025-10-08T22:42:30.715124] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-08T22:42:30.749532] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:30.752470] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44210 primary records. [2025-10-08T22:42:30.752803] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-08T22:42:30.775272] [DEBUG] [MAIN ] SNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:30.775410] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-08T22:42:30.780450] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53593 primary records. [2025-10-08T22:42:30.781174] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-10-08T22:42:30.781272] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-08T22:42:30.785443] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-08T22:42:30.787396] [INFO ] [MAIN ] Derivative Progress: 1381/1771 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 30s. Rate: 155.8 symbols/min [2025-10-08T22:42:30.785590] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-08T22:42:30.787705] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:30.790229] [INFO ] [MAIN ] Derivative Progress: 1382/1771 symbols completed. SNN took 1.2s. Estimated remaining: 2m 30s. Rate: 155.9 symbols/min [2025-10-08T22:42:30.790719] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:30.809456] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-10-08T22:42:30.809573] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-10-08T22:42:30.811904] [INFO ] [MAIN ] Derivative Progress: 1383/1771 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 29s. Rate: 156.0 symbols/min [2025-10-08T22:42:30.812145] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:30.875054] [DEBUG] [LOCAL ] SNX: Loaded 40038 existing records from primary storage. [2025-10-08T22:42:30.875293] [INFO ] [MAIN ] SNX: Loaded 40038 primary data records. [2025-10-08T22:42:31.026956] [DEBUG] [LOCAL ] SNV: Loaded 48866 existing records from primary storage. [2025-10-08T22:42:31.027523] [INFO ] [MAIN ] SNV: Loaded 48866 primary data records. [2025-10-08T22:42:31.039363] [DEBUG] [LOCAL ] SO: Loaded 53609 existing records from primary storage. [2025-10-08T22:42:31.068012] [INFO ] [MAIN ] SO: Loaded 53609 primary data records. [2025-10-08T22:42:31.891682] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:31.892506] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 40038 primary records. [2025-10-08T22:42:31.892603] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-08T22:42:31.926994] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:31.929044] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53609 primary records. [2025-10-08T22:42:31.936589] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-08T22:42:31.944079] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-08T22:42:31.942945] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:31.952066] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48866 primary records. [2025-10-08T22:42:31.955762] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-08T22:42:31.957911] [INFO ] [MAIN ] Derivative Progress: 1384/1771 symbols completed. SNX took 1.2s. Estimated remaining: 2m 29s. Rate: 155.8 symbols/min [2025-10-08T22:42:31.961207] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-08T22:42:31.961345] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:31.962920] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-08T22:42:31.963430] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-08T22:42:31.965583] [INFO ] [MAIN ] Derivative Progress: 1385/1771 symbols completed. SO took 1.2s. Estimated remaining: 2m 29s. Rate: 155.9 symbols/min [2025-10-08T22:42:31.966043] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:31.982399] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-08T22:42:31.982487] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-08T22:42:31.984720] [INFO ] [MAIN ] Derivative Progress: 1386/1771 symbols completed. SNV took 1.2s. Estimated remaining: 2m 28s. Rate: 156.0 symbols/min [2025-10-08T22:42:31.984926] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:31.996938] [DEBUG] [LOCAL ] SOJC: Loaded 4981 existing records from primary storage. [2025-10-08T22:42:31.997231] [INFO ] [MAIN ] SOJC: Loaded 4981 primary data records. [2025-10-08T22:42:32.139909] [DEBUG] [LOCAL ] SOBO: Loaded 39274 existing records from primary storage. [2025-10-08T22:42:32.161943] [INFO ] [MAIN ] SOBO: Loaded 39274 primary data records. [2025-10-08T22:42:32.413367] [DEBUG] [LOCAL ] SOC: Loaded 50643 existing records from primary storage. [2025-10-08T22:42:32.427117] [INFO ] [MAIN ] SOC: Loaded 50643 primary data records. [2025-10-08T22:42:33.036581] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:33.037767] [INFO ] [MAIN ] SOJC: Generated 1793 derivative records from 4981 primary records. [2025-10-08T22:42:33.039926] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-08T22:42:33.056258] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1793 records). [2025-10-08T22:42:33.056692] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-08T22:42:33.058724] [INFO ] [MAIN ] Derivative Progress: 1387/1771 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 28s. Rate: 155.8 symbols/min [2025-10-08T22:42:33.058992] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:33.082501] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:33.083427] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50643 primary records. [2025-10-08T22:42:33.083554] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-08T22:42:33.101335] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:33.108880] [DEBUG] [LOCAL ] SOJD: Loaded 13003 existing records from primary storage. [2025-10-08T22:42:33.109625] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39274 primary records. [2025-10-08T22:42:33.109749] [INFO ] [MAIN ] SOJD: Loaded 13003 primary data records. [2025-10-08T22:42:33.113164] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-08T22:42:33.212445] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-08T22:42:33.237275] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-08T22:42:33.260583] [INFO ] [MAIN ] Derivative Progress: 1388/1771 symbols completed. SOC took 1.3s. Estimated remaining: 2m 27s. Rate: 155.8 symbols/min [2025-10-08T22:42:33.279940] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:33.341703] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-08T22:42:33.403753] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-08T22:42:33.439847] [INFO ] [MAIN ] Derivative Progress: 1389/1771 symbols completed. SOBO took 1.5s. Estimated remaining: 2m 27s. Rate: 155.9 symbols/min [2025-10-08T22:42:33.440239] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:33.445889] [DEBUG] [LOCAL ] SOJE: Loaded 9072 existing records from primary storage. [2025-10-08T22:42:33.447440] [INFO ] [MAIN ] SOJE: Loaded 9072 primary data records. [2025-10-08T22:42:33.575819] [DEBUG] [LOCAL ] SOL: Loaded 12994 existing records from primary storage. [2025-10-08T22:42:33.586470] [INFO ] [MAIN ] SOL: Loaded 12994 primary data records. [2025-10-08T22:42:34.079716] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:34.081166] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13003 primary records. [2025-10-08T22:42:34.081441] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-08T22:42:34.102996] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-08T22:42:34.103455] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-08T22:42:34.105435] [INFO ] [MAIN ] Derivative Progress: 1390/1771 symbols completed. SOJD took 1.0s. Estimated remaining: 2m 27s. Rate: 155.8 symbols/min [2025-10-08T22:42:34.105758] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:34.123040] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:34.123990] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9072 primary records. [2025-10-08T22:42:34.124247] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-08T22:42:34.154031] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:34.155637] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 12994 primary records. [2025-10-08T22:42:34.156296] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-08T22:42:34.158368] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-08T22:42:34.158686] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-08T22:42:34.167707] [INFO ] [MAIN ] Derivative Progress: 1391/1771 symbols completed. SOJE took 0.9s. Estimated remaining: 2m 26s. Rate: 155.9 symbols/min [2025-10-08T22:42:34.178078] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:34.186830] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-08T22:42:34.199073] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-08T22:42:34.201279] [INFO ] [MAIN ] Derivative Progress: 1392/1771 symbols completed. SOL took 0.8s. Estimated remaining: 2m 26s. Rate: 156.0 symbols/min [2025-10-08T22:42:34.201567] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:34.202540] [DEBUG] [LOCAL ] SOLV: Loaded 43920 existing records from primary storage. [2025-10-08T22:42:34.202814] [INFO ] [MAIN ] SOLV: Loaded 43920 primary data records. [2025-10-08T22:42:34.556678] [DEBUG] [LOCAL ] SON: Loaded 43020 existing records from primary storage. [2025-10-08T22:42:34.557021] [INFO ] [MAIN ] SON: Loaded 43020 primary data records. [2025-10-08T22:42:34.680860] [DEBUG] [LOCAL ] SONY: Loaded 53369 existing records from primary storage. [2025-10-08T22:42:34.682478] [INFO ] [MAIN ] SONY: Loaded 53369 primary data records. [2025-10-08T22:42:35.111377] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:35.128707] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43920 primary records. [2025-10-08T22:42:35.251155] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-08T22:42:35.274209] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-08T22:42:35.274600] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-08T22:42:35.276678] [INFO ] [MAIN ] Derivative Progress: 1393/1771 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 26s. Rate: 155.8 symbols/min [2025-10-08T22:42:35.290190] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:35.291073] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43020 primary records. [2025-10-08T22:42:35.291419] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-08T22:42:35.309713] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-08T22:42:35.309940] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-08T22:42:35.311880] [INFO ] [MAIN ] Derivative Progress: 1394/1771 symbols completed. SON took 1.1s. Estimated remaining: 2m 25s. Rate: 155.9 symbols/min [2025-10-08T22:42:35.326992] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:35.327547] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53369 primary records. [2025-10-08T22:42:35.327606] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-08T22:42:35.343011] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-08T22:42:35.343075] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-08T22:42:35.345242] [INFO ] [MAIN ] Derivative Progress: 1395/1771 symbols completed. SONY took 1.1s. Estimated remaining: 2m 25s. Rate: 156.0 symbols/min [2025-10-08T22:42:35.345701] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:35.345802] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:35.345925] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:35.355050] [DEBUG] [LOCAL ] SOR: Loaded 2879 existing records from primary storage. [2025-10-08T22:42:35.355292] [INFO ] [MAIN ] SOR: Loaded 2879 primary data records. [2025-10-08T22:42:35.407766] [DEBUG] [LOCAL ] SOS: Loaded 9141 existing records from primary storage. [2025-10-08T22:42:35.426605] [INFO ] [MAIN ] SOS: Loaded 9141 primary data records. [2025-10-08T22:42:35.628285] [DEBUG] [LOCAL ] SPB: Loaded 34211 existing records from primary storage. [2025-10-08T22:42:35.677123] [INFO ] [MAIN ] SPB: Loaded 34211 primary data records. [2025-10-08T22:42:36.349174] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:36.362137] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2879 primary records. [2025-10-08T22:42:36.362621] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-08T22:42:36.362941] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:36.364412] [INFO ] [MAIN ] SOS: Generated 1793 derivative records from 9141 primary records. [2025-10-08T22:42:36.370625] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-08T22:42:36.396040] [DEBUG] [LOCAL ] SOS: Derivative data saved (1793 records). [2025-10-08T22:42:36.396599] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-08T22:42:36.396750] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-08T22:42:36.396876] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-08T22:42:36.398797] [INFO ] [MAIN ] Derivative Progress: 1396/1771 symbols completed. SOR took 1.1s. Estimated remaining: 2m 24s. Rate: 155.8 symbols/min [2025-10-08T22:42:36.399078] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:36.401007] [INFO ] [MAIN ] Derivative Progress: 1397/1771 symbols completed. SOS took 1.1s. Estimated remaining: 2m 24s. Rate: 155.9 symbols/min [2025-10-08T22:42:36.409427] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:36.415335] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:36.416340] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34211 primary records. [2025-10-08T22:42:36.418455] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-08T22:42:36.439875] [DEBUG] [LOCAL ] SPE: Loaded 6289 existing records from primary storage. [2025-10-08T22:42:36.440220] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-08T22:42:36.440432] [INFO ] [MAIN ] SPE: Loaded 6289 primary data records. [2025-10-08T22:42:36.440381] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-08T22:42:36.463394] [INFO ] [MAIN ] Derivative Progress: 1398/1771 symbols completed. SPB took 1.1s. Estimated remaining: 2m 23s. Rate: 156.0 symbols/min [2025-10-08T22:42:36.488714] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:36.823349] [DEBUG] [LOCAL ] SPCE: Loaded 49933 existing records from primary storage. [2025-10-08T22:42:36.832252] [INFO ] [MAIN ] SPCE: Loaded 49933 primary data records. [2025-10-08T22:42:36.996596] [DEBUG] [LOCAL ] SPG: Loaded 50240 existing records from primary storage. [2025-10-08T22:42:37.020046] [INFO ] [MAIN ] SPG: Loaded 50240 primary data records. [2025-10-08T22:42:37.492578] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:37.494782] [INFO ] [MAIN ] SPE: Generated 1793 derivative records from 6289 primary records. [2025-10-08T22:42:37.495079] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-08T22:42:37.516822] [DEBUG] [LOCAL ] SPE: Derivative data saved (1793 records). [2025-10-08T22:42:37.519995] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-08T22:42:37.522921] [INFO ] [MAIN ] Derivative Progress: 1399/1771 symbols completed. SPE took 1.1s. Estimated remaining: 2m 23s. Rate: 155.8 symbols/min [2025-10-08T22:42:37.523197] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:37.537356] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:37.538793] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49933 primary records. [2025-10-08T22:42:37.539331] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-08T22:42:37.558459] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-08T22:42:37.558670] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-08T22:42:37.560748] [INFO ] [MAIN ] Derivative Progress: 1400/1771 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 23s. Rate: 155.9 symbols/min [2025-10-08T22:42:37.561009] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:37.587119] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:37.588085] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50240 primary records. [2025-10-08T22:42:37.588494] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-08T22:42:37.627765] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-08T22:42:37.625796] [DEBUG] [LOCAL ] SPH: Loaded 16887 existing records from primary storage. [2025-10-08T22:42:37.628064] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-08T22:42:37.628252] [INFO ] [MAIN ] SPH: Loaded 16887 primary data records. [2025-10-08T22:42:37.630803] [INFO ] [MAIN ] Derivative Progress: 1401/1771 symbols completed. SPG took 1.1s. Estimated remaining: 2m 22s. Rate: 156.0 symbols/min [2025-10-08T22:42:37.642311] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:37.777170] [DEBUG] [LOCAL ] SPGI: Loaded 45763 existing records from primary storage. [2025-10-08T22:42:37.804044] [INFO ] [MAIN ] SPGI: Loaded 45763 primary data records. [2025-10-08T22:42:38.081394] [DEBUG] [LOCAL ] SPHR: Loaded 40341 existing records from primary storage. [2025-10-08T22:42:38.093168] [INFO ] [MAIN ] SPHR: Loaded 40341 primary data records. [2025-10-08T22:42:38.649051] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:38.650429] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16887 primary records. [2025-10-08T22:42:38.651579] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-08T22:42:38.681948] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:38.686667] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45763 primary records. [2025-10-08T22:42:38.685787] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-08T22:42:38.687036] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-08T22:42:38.687134] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-08T22:42:38.689756] [INFO ] [MAIN ] Derivative Progress: 1402/1771 symbols completed. SPH took 1.1s. Estimated remaining: 2m 22s. Rate: 155.8 symbols/min [2025-10-08T22:42:38.690793] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:38.708857] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-08T22:42:38.709081] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-08T22:42:38.712824] [INFO ] [MAIN ] Derivative Progress: 1403/1771 symbols completed. SPGI took 1.2s. Estimated remaining: 2m 22s. Rate: 155.9 symbols/min [2025-10-08T22:42:38.713134] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:38.726453] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:38.727282] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40341 primary records. [2025-10-08T22:42:38.727471] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-08T22:42:38.745017] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-08T22:42:38.745136] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-08T22:42:38.747201] [INFO ] [MAIN ] Derivative Progress: 1404/1771 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 21s. Rate: 156.0 symbols/min [2025-10-08T22:42:38.747431] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:38.750532] [DEBUG] [LOCAL ] SPMC: Loaded 5333 existing records from primary storage. [2025-10-08T22:42:38.751118] [INFO ] [MAIN ] SPMC: Loaded 5333 primary data records. [2025-10-08T22:42:38.897536] [DEBUG] [LOCAL ] SPIR: Loaded 37392 existing records from primary storage. [2025-10-08T22:42:38.924851] [INFO ] [MAIN ] SPIR: Loaded 37392 primary data records. [2025-10-08T22:42:39.185879] [DEBUG] [LOCAL ] SPNT: Loaded 34716 existing records from primary storage. [2025-10-08T22:42:39.197979] [INFO ] [MAIN ] SPNT: Loaded 34716 primary data records. [2025-10-08T22:42:39.732011] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:39.733975] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5333 primary records. [2025-10-08T22:42:39.734243] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-08T22:42:39.770509] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:39.773311] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37392 primary records. [2025-10-08T22:42:39.773426] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-08T22:42:39.794522] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-08T22:42:39.798129] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-08T22:42:39.799638] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-08T22:42:39.803396] [INFO ] [MAIN ] Derivative Progress: 1405/1771 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 21s. Rate: 155.8 symbols/min [2025-10-08T22:42:39.817529] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-08T22:42:39.817147] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:39.820771] [INFO ] [MAIN ] Derivative Progress: 1406/1771 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 20s. Rate: 156.0 symbols/min [2025-10-08T22:42:39.821372] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:39.822128] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:39.823338] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34716 primary records. [2025-10-08T22:42:39.823999] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-08T22:42:39.842760] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-08T22:42:39.842893] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-08T22:42:39.845159] [INFO ] [MAIN ] Derivative Progress: 1407/1771 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 20s. Rate: 156.1 symbols/min [2025-10-08T22:42:39.845399] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:39.861570] [DEBUG] [LOCAL ] SPRU: Loaded 9534 existing records from primary storage. [2025-10-08T22:42:39.862017] [INFO ] [MAIN ] SPRU: Loaded 9534 primary data records. [2025-10-08T22:42:40.016985] [DEBUG] [LOCAL ] SPR: Loaded 41057 existing records from primary storage. [2025-10-08T22:42:40.046026] [INFO ] [MAIN ] SPR: Loaded 41057 primary data records. [2025-10-08T22:42:40.185999] [DEBUG] [LOCAL ] SPOT: Loaded 50455 existing records from primary storage. [2025-10-08T22:42:40.319514] [INFO ] [MAIN ] SPOT: Loaded 50455 primary data records. [2025-10-08T22:42:40.890517] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:40.893098] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9534 primary records. [2025-10-08T22:42:40.893851] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-08T22:42:40.910983] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-08T22:42:40.911157] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-08T22:42:40.913327] [INFO ] [MAIN ] Derivative Progress: 1408/1771 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 20s. Rate: 155.9 symbols/min [2025-10-08T22:42:40.933992] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:40.937461] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41057 primary records. [2025-10-08T22:42:40.938152] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-08T22:42:40.964012] [DEBUG] [MAIN ] SPOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:40.967977] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 50455 primary records. [2025-10-08T22:42:40.969035] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-08T22:42:40.969247] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-08T22:42:40.969172] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-10-08T22:42:40.971859] [INFO ] [MAIN ] Derivative Progress: 1409/1771 symbols completed. SPR took 1.2s. Estimated remaining: 2m 19s. Rate: 156.0 symbols/min [2025-10-08T22:42:40.987414] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-10-08T22:42:40.987480] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-10-08T22:42:40.990383] [INFO ] [MAIN ] Derivative Progress: 1410/1771 symbols completed. SPOT took 1.2s. Estimated remaining: 2m 19s. Rate: 156.1 symbols/min [2025-10-08T22:42:40.991138] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:40.991256] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:40.991040] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:41.014500] [DEBUG] [LOCAL ] SPXX: Loaded 9456 existing records from primary storage. [2025-10-08T22:42:41.014832] [INFO ] [MAIN ] SPXX: Loaded 9456 primary data records. [2025-10-08T22:42:41.085950] [DEBUG] [LOCAL ] SPXC: Loaded 23256 existing records from primary storage. [2025-10-08T22:42:41.113390] [INFO ] [MAIN ] SPXC: Loaded 23256 primary data records. [2025-10-08T22:42:41.367521] [DEBUG] [LOCAL ] SQM: Loaded 48630 existing records from primary storage. [2025-10-08T22:42:41.518559] [INFO ] [MAIN ] SQM: Loaded 48630 primary data records. [2025-10-08T22:42:42.055481] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:42.056803] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9456 primary records. [2025-10-08T22:42:42.057034] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-08T22:42:42.080594] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:42.081714] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23256 primary records. [2025-10-08T22:42:42.084669] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-08T22:42:42.101601] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-08T22:42:42.105608] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-08T22:42:42.106249] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-08T22:42:42.106390] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-08T22:42:42.108815] [INFO ] [MAIN ] Derivative Progress: 1411/1771 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 19s. Rate: 155.9 symbols/min [2025-10-08T22:42:42.110961] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:42.111066] [INFO ] [MAIN ] Derivative Progress: 1412/1771 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 18s. Rate: 156.0 symbols/min [2025-10-08T22:42:42.111897] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:42.131020] [DEBUG] [MAIN ] SQM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:42.131952] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48630 primary records. [2025-10-08T22:42:42.132241] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-08T22:42:42.157477] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-08T22:42:42.157758] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-08T22:42:42.161030] [INFO ] [MAIN ] Derivative Progress: 1413/1771 symbols completed. SQM took 1.2s. Estimated remaining: 2m 18s. Rate: 156.1 symbols/min [2025-10-08T22:42:42.161360] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:42.179586] [DEBUG] [LOCAL ] SQNS: Loaded 26949 existing records from primary storage. [2025-10-08T22:42:42.179833] [INFO ] [MAIN ] SQNS: Loaded 26949 primary data records. [2025-10-08T22:42:42.285841] [DEBUG] [LOCAL ] SR: Loaded 32604 existing records from primary storage. [2025-10-08T22:42:42.297357] [INFO ] [MAIN ] SR: Loaded 32604 primary data records. [2025-10-08T22:42:42.894264] [DEBUG] [LOCAL ] SRE: Loaded 53414 existing records from primary storage. [2025-10-08T22:42:42.895798] [INFO ] [MAIN ] SRE: Loaded 53414 primary data records. [2025-10-08T22:42:43.222820] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:43.224416] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 26949 primary records. [2025-10-08T22:42:43.224673] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-08T22:42:43.245623] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-08T22:42:43.245770] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-08T22:42:43.248105] [INFO ] [MAIN ] Derivative Progress: 1414/1771 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 17s. Rate: 155.9 symbols/min [2025-10-08T22:42:43.248282] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:43.264786] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:43.266349] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32604 primary records. [2025-10-08T22:42:43.266747] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-08T22:42:43.287208] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-08T22:42:43.287510] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-08T22:42:43.290935] [INFO ] [MAIN ] Derivative Progress: 1415/1771 symbols completed. SR took 1.2s. Estimated remaining: 2m 17s. Rate: 156.0 symbols/min [2025-10-08T22:42:43.291241] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:43.296561] [DEBUG] [LOCAL ] SREA: Loaded 10258 existing records from primary storage. [2025-10-08T22:42:43.296891] [INFO ] [MAIN ] SREA: Loaded 10258 primary data records. [2025-10-08T22:42:43.420871] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:43.422077] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53414 primary records. [2025-10-08T22:42:43.427598] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-08T22:42:43.666064] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-08T22:42:43.667312] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-08T22:42:43.670434] [INFO ] [MAIN ] Derivative Progress: 1416/1771 symbols completed. SRE took 1.5s. Estimated remaining: 2m 17s. Rate: 156.0 symbols/min [2025-10-08T22:42:43.672582] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:43.671934] [DEBUG] [LOCAL ] SRFM: Loaded 37831 existing records from primary storage. [2025-10-08T22:42:43.673073] [INFO ] [MAIN ] SRFM: Loaded 37831 primary data records. [2025-10-08T22:42:43.814611] [DEBUG] [LOCAL ] SRG: Loaded 15365 existing records from primary storage. [2025-10-08T22:42:43.820122] [INFO ] [MAIN ] SRG: Loaded 15365 primary data records. [2025-10-08T22:42:44.149781] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:44.164683] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10258 primary records. [2025-10-08T22:42:44.165891] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-08T22:42:44.227563] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-08T22:42:44.237632] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-08T22:42:44.240037] [INFO ] [MAIN ] Derivative Progress: 1417/1771 symbols completed. SREA took 1.0s. Estimated remaining: 2m 16s. Rate: 155.9 symbols/min [2025-10-08T22:42:44.251717] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:44.425297] [DEBUG] [LOCAL ] SRI: Loaded 26723 existing records from primary storage. [2025-10-08T22:42:44.426079] [INFO ] [MAIN ] SRI: Loaded 26723 primary data records. [2025-10-08T22:42:44.470305] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:44.495129] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 37831 primary records. [2025-10-08T22:42:44.521270] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-08T22:42:44.611291] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:44.630468] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 15365 primary records. [2025-10-08T22:42:44.632686] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-08T22:42:44.869291] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-08T22:42:44.866601] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-08T22:42:44.869540] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-08T22:42:44.869620] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-08T22:42:44.871797] [INFO ] [MAIN ] Derivative Progress: 1418/1771 symbols completed. SRG took 1.2s. Estimated remaining: 2m 16s. Rate: 155.8 symbols/min [2025-10-08T22:42:44.872032] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:44.874283] [INFO ] [MAIN ] Derivative Progress: 1419/1771 symbols completed. SRFM took 1.6s. Estimated remaining: 2m 15s. Rate: 155.9 symbols/min [2025-10-08T22:42:44.874679] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:44.887446] [DEBUG] [LOCAL ] SRV: Loaded 7374 existing records from primary storage. [2025-10-08T22:42:44.888025] [INFO ] [MAIN ] SRV: Loaded 7374 primary data records. [2025-10-08T22:42:45.105541] [DEBUG] [LOCAL ] SSB: Loaded 42616 existing records from primary storage. [2025-10-08T22:42:45.220859] [INFO ] [MAIN ] SSB: Loaded 42616 primary data records. [2025-10-08T22:42:45.278676] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:45.318015] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26723 primary records. [2025-10-08T22:42:45.333772] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-08T22:42:45.411924] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-08T22:42:45.437302] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-08T22:42:45.444382] [INFO ] [MAIN ] Derivative Progress: 1420/1771 symbols completed. SRI took 1.2s. Estimated remaining: 2m 15s. Rate: 155.9 symbols/min [2025-10-08T22:42:45.548814] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:45.579630] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:45.580478] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7374 primary records. [2025-10-08T22:42:45.580689] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-08T22:42:45.597487] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-08T22:42:45.597963] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-08T22:42:45.600021] [INFO ] [MAIN ] Derivative Progress: 1421/1771 symbols completed. SRV took 0.7s. Estimated remaining: 2m 15s. Rate: 156.0 symbols/min [2025-10-08T22:42:45.600220] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:45.631131] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:45.632018] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42616 primary records. [2025-10-08T22:42:45.636677] [DEBUG] [LOCAL ] SST: Loaded 11764 existing records from primary storage. [2025-10-08T22:42:45.636793] [INFO ] [MAIN ] SST: Loaded 11764 primary data records. [2025-10-08T22:42:45.636362] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-08T22:42:45.723531] [DEBUG] [LOCAL ] SSL: Loaded 41399 existing records from primary storage. [2025-10-08T22:42:45.735552] [INFO ] [MAIN ] SSL: Loaded 41399 primary data records. [2025-10-08T22:42:45.872174] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-08T22:42:45.938400] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-08T22:42:46.087332] [INFO ] [MAIN ] Derivative Progress: 1422/1771 symbols completed. SSB took 1.2s. Estimated remaining: 2m 14s. Rate: 155.9 symbols/min [2025-10-08T22:42:46.099297] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:46.301559] [DEBUG] [LOCAL ] SSTK: Loaded 25598 existing records from primary storage. [2025-10-08T22:42:46.316384] [INFO ] [MAIN ] SSTK: Loaded 25598 primary data records. [2025-10-08T22:42:46.317166] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:46.318389] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11764 primary records. [2025-10-08T22:42:46.318575] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-08T22:42:46.460277] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:46.474257] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41399 primary records. [2025-10-08T22:42:46.480845] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-08T22:42:46.516442] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-08T22:42:46.546978] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-08T22:42:46.710859] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-08T22:42:46.711094] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-08T22:42:46.555174] [INFO ] [MAIN ] Derivative Progress: 1423/1771 symbols completed. SST took 1.0s. Estimated remaining: 2m 14s. Rate: 155.9 symbols/min [2025-10-08T22:42:46.724822] [INFO ] [MAIN ] Derivative Progress: 1424/1771 symbols completed. SSL took 1.2s. Estimated remaining: 2m 13s. Rate: 156.0 symbols/min [2025-10-08T22:42:46.748779] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:46.749507] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25598 primary records. [2025-10-08T22:42:46.749574] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-08T22:42:46.764941] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-08T22:42:46.765007] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-08T22:42:46.767600] [INFO ] [MAIN ] Derivative Progress: 1425/1771 symbols completed. SSTK took 0.7s. Estimated remaining: 2m 13s. Rate: 156.1 symbols/min [2025-10-08T22:42:46.768227] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:46.768424] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:46.768158] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:46.793226] [DEBUG] [LOCAL ] STC: Loaded 17369 existing records from primary storage. [2025-10-08T22:42:46.793461] [INFO ] [MAIN ] STC: Loaded 17369 primary data records. [2025-10-08T22:42:47.121378] [DEBUG] [LOCAL ] STAG: Loaded 50089 existing records from primary storage. [2025-10-08T22:42:47.155923] [DEBUG] [LOCAL ] ST: Loaded 49807 existing records from primary storage. [2025-10-08T22:42:47.155095] [INFO ] [MAIN ] STAG: Loaded 50089 primary data records. [2025-10-08T22:42:47.156811] [INFO ] [MAIN ] ST: Loaded 49807 primary data records. [2025-10-08T22:42:47.807262] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:47.809239] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17369 primary records. [2025-10-08T22:42:47.809934] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-08T22:42:47.831188] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-08T22:42:47.831635] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-08T22:42:47.834103] [INFO ] [MAIN ] Derivative Progress: 1426/1771 symbols completed. STC took 1.1s. Estimated remaining: 2m 13s. Rate: 155.9 symbols/min [2025-10-08T22:42:47.834499] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:47.861913] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:47.863178] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50089 primary records. [2025-10-08T22:42:47.876250] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-08T22:42:47.877390] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:47.879768] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49807 primary records. [2025-10-08T22:42:47.895701] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-08T22:42:47.895388] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-08T22:42:47.905185] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-08T22:42:47.907625] [INFO ] [MAIN ] Derivative Progress: 1427/1771 symbols completed. STAG took 1.1s. Estimated remaining: 2m 12s. Rate: 156.0 symbols/min [2025-10-08T22:42:47.909270] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:47.938225] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-08T22:42:47.938399] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-08T22:42:47.939049] [DEBUG] [LOCAL ] STE: Loaded 35429 existing records from primary storage. [2025-10-08T22:42:47.941121] [INFO ] [MAIN ] Derivative Progress: 1428/1771 symbols completed. ST took 1.2s. Estimated remaining: 2m 12s. Rate: 156.1 symbols/min [2025-10-08T22:42:47.941543] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:47.941735] [INFO ] [MAIN ] STE: Loaded 35429 primary data records. [2025-10-08T22:42:48.044909] [DEBUG] [LOCAL ] STEL: Loaded 22835 existing records from primary storage. [2025-10-08T22:42:48.057189] [INFO ] [MAIN ] STEL: Loaded 22835 primary data records. [2025-10-08T22:42:48.316150] [DEBUG] [LOCAL ] STEM: Loaded 39032 existing records from primary storage. [2025-10-08T22:42:48.468500] [INFO ] [MAIN ] STEM: Loaded 39032 primary data records. [2025-10-08T22:42:49.001389] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:49.002967] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22835 primary records. [2025-10-08T22:42:49.003249] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-08T22:42:49.031059] [DEBUG] [MAIN ] STE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:49.035138] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-08T22:42:49.036095] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35429 primary records. [2025-10-08T22:42:49.036412] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-08T22:42:49.037552] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-08T22:42:49.047585] [INFO ] [MAIN ] Derivative Progress: 1429/1771 symbols completed. STEL took 1.1s. Estimated remaining: 2m 12s. Rate: 155.8 symbols/min [2025-10-08T22:42:49.052316] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:49.058593] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-08T22:42:49.058763] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-08T22:42:49.061134] [INFO ] [MAIN ] Derivative Progress: 1430/1771 symbols completed. STE took 1.2s. Estimated remaining: 2m 11s. Rate: 156.0 symbols/min [2025-10-08T22:42:49.061338] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:49.087283] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:49.088299] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 39032 primary records. [2025-10-08T22:42:49.094008] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-08T22:42:49.095409] [DEBUG] [LOCAL ] STEW: Loaded 16161 existing records from primary storage. [2025-10-08T22:42:49.095957] [INFO ] [MAIN ] STEW: Loaded 16161 primary data records. [2025-10-08T22:42:49.166899] [DEBUG] [LOCAL ] STK: Loaded 9582 existing records from primary storage. [2025-10-08T22:42:49.181608] [INFO ] [MAIN ] STK: Loaded 9582 primary data records. [2025-10-08T22:42:49.197622] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-08T22:42:49.252195] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-08T22:42:49.265096] [INFO ] [MAIN ] Derivative Progress: 1431/1771 symbols completed. STEM took 1.3s. Estimated remaining: 2m 11s. Rate: 156.0 symbols/min [2025-10-08T22:42:49.286859] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:49.783107] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:49.785288] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16161 primary records. [2025-10-08T22:42:49.802136] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-08T22:42:49.805109] [DEBUG] [LOCAL ] STLA: Loaded 53551 existing records from primary storage. [2025-10-08T22:42:49.817728] [INFO ] [MAIN ] STLA: Loaded 53551 primary data records. [2025-10-08T22:42:49.832018] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:49.853414] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9582 primary records. [2025-10-08T22:42:49.867871] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-08T22:42:49.895987] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-08T22:42:49.910988] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-08T22:42:49.913071] [INFO ] [MAIN ] Derivative Progress: 1432/1771 symbols completed. STEW took 0.9s. Estimated remaining: 2m 10s. Rate: 155.9 symbols/min [2025-10-08T22:42:49.925476] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-08T22:42:49.925594] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:49.955922] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-08T22:42:49.969726] [INFO ] [MAIN ] Derivative Progress: 1433/1771 symbols completed. STK took 0.9s. Estimated remaining: 2m 10s. Rate: 156.0 symbols/min [2025-10-08T22:42:49.970090] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:50.195946] [DEBUG] [LOCAL ] STN: Loaded 22841 existing records from primary storage. [2025-10-08T22:42:50.196559] [INFO ] [MAIN ] STN: Loaded 22841 primary data records. [2025-10-08T22:42:50.376472] [DEBUG] [LOCAL ] STM: Loaded 53571 existing records from primary storage. [2025-10-08T22:42:50.417901] [INFO ] [MAIN ] STM: Loaded 53571 primary data records. [2025-10-08T22:42:50.849314] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:50.899876] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53551 primary records. [2025-10-08T22:42:50.900223] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-08T22:42:50.918936] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-08T22:42:50.919620] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-08T22:42:50.922034] [INFO ] [MAIN ] Derivative Progress: 1434/1771 symbols completed. STLA took 1.6s. Estimated remaining: 2m 10s. Rate: 155.9 symbols/min [2025-10-08T22:42:50.922367] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:50.940160] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:50.940952] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22841 primary records. [2025-10-08T22:42:50.941156] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-08T22:42:50.958983] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-08T22:42:50.959180] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-08T22:42:50.961421] [INFO ] [MAIN ] Derivative Progress: 1435/1771 symbols completed. STN took 1.0s. Estimated remaining: 2m 9s. Rate: 156.0 symbols/min [2025-10-08T22:42:50.961873] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:50.979541] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:50.992074] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53571 primary records. [2025-10-08T22:42:50.992216] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-08T22:42:51.008463] [DEBUG] [LOCAL ] STRV: Loaded 11293 existing records from primary storage. [2025-10-08T22:42:51.013742] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-08T22:42:51.013845] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-08T22:42:51.012222] [INFO ] [MAIN ] STRV: Loaded 11293 primary data records. [2025-10-08T22:42:51.027531] [INFO ] [MAIN ] Derivative Progress: 1436/1771 symbols completed. STM took 1.1s. Estimated remaining: 2m 9s. Rate: 156.0 symbols/min [2025-10-08T22:42:51.058901] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:51.120131] [DEBUG] [LOCAL ] STNG: Loaded 43676 existing records from primary storage. [2025-10-08T22:42:51.131031] [INFO ] [MAIN ] STNG: Loaded 43676 primary data records. [2025-10-08T22:42:51.657586] [DEBUG] [LOCAL ] STT: Loaded 50951 existing records from primary storage. [2025-10-08T22:42:51.658090] [INFO ] [MAIN ] STT: Loaded 50951 primary data records. [2025-10-08T22:42:51.751806] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:51.793396] [INFO ] [MAIN ] STRV: Generated 1794 derivative records from 11293 primary records. [2025-10-08T22:42:51.861698] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-08T22:42:51.997844] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:51.999296] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43676 primary records. [2025-10-08T22:42:52.000224] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-08T22:42:52.003166] [DEBUG] [LOCAL ] STRV: Derivative data saved (1794 records). [2025-10-08T22:42:52.004095] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-08T22:42:52.006878] [INFO ] [MAIN ] Derivative Progress: 1437/1771 symbols completed. STRV took 1.0s. Estimated remaining: 2m 9s. Rate: 155.9 symbols/min [2025-10-08T22:42:52.007097] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:52.025588] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-08T22:42:52.026306] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-08T22:42:52.028892] [INFO ] [MAIN ] Derivative Progress: 1438/1771 symbols completed. STNG took 1.1s. Estimated remaining: 2m 8s. Rate: 156.0 symbols/min [2025-10-08T22:42:52.057455] [DEBUG] [MAIN ] STT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:52.058204] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 50951 primary records. [2025-10-08T22:42:52.058746] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-08T22:42:52.067289] [DEBUG] [LOCAL ] STVN: Loaded 26633 existing records from primary storage. [2025-10-08T22:42:52.067549] [INFO ] [MAIN ] STVN: Loaded 26633 primary data records. [2025-10-08T22:42:52.162174] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-10-08T22:42:52.180309] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-08T22:42:52.184807] [INFO ] [MAIN ] Derivative Progress: 1439/1771 symbols completed. STT took 1.1s. Estimated remaining: 2m 8s. Rate: 156.0 symbols/min [2025-10-08T22:42:52.398972] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:52.400010] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26633 primary records. [2025-10-08T22:42:52.400077] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-08T22:42:52.416115] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-08T22:42:52.416191] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-08T22:42:52.421530] [INFO ] [MAIN ] Derivative Progress: 1440/1771 symbols completed. STVN took 0.4s. Estimated remaining: 2m 7s. Rate: 156.1 symbols/min [2025-10-08T22:42:52.422194] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:52.422093] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:52.422522] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:52.427918] [DEBUG] [LOCAL ] STXD: Loaded 1238 existing records from primary storage. [2025-10-08T22:42:52.428235] [INFO ] [MAIN ] STXD: Loaded 1238 primary data records. [2025-10-08T22:42:52.451141] [DEBUG] [LOCAL ] STXE: Loaded 2097 existing records from primary storage. [2025-10-08T22:42:52.473844] [INFO ] [MAIN ] STXE: Loaded 2097 primary data records. [2025-10-08T22:42:53.090246] [DEBUG] [LOCAL ] STWD: Loaded 51938 existing records from primary storage. [2025-10-08T22:42:53.092434] [INFO ] [MAIN ] STWD: Loaded 51938 primary data records. [2025-10-08T22:42:53.405427] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:53.406312] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1238 primary records. [2025-10-08T22:42:53.406517] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-08T22:42:53.424121] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-08T22:42:53.424607] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-08T22:42:53.426826] [INFO ] [MAIN ] Derivative Progress: 1441/1771 symbols completed. STXD took 1.0s. Estimated remaining: 2m 7s. Rate: 155.9 symbols/min [2025-10-08T22:42:53.427541] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:53.441543] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:53.443128] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2097 primary records. [2025-10-08T22:42:53.443275] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-08T22:42:53.447275] [DEBUG] [LOCAL ] STXG: Loaded 2469 existing records from primary storage. [2025-10-08T22:42:53.457293] [INFO ] [MAIN ] STXG: Loaded 2469 primary data records. [2025-10-08T22:42:53.536957] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-08T22:42:53.547664] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-08T22:42:53.566267] [INFO ] [MAIN ] Derivative Progress: 1442/1771 symbols completed. STXE took 1.1s. Estimated remaining: 2m 7s. Rate: 156.0 symbols/min [2025-10-08T22:42:53.572246] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:53.798669] [DEBUG] [LOCAL ] STXK: Loaded 1514 existing records from primary storage. [2025-10-08T22:42:53.799043] [INFO ] [MAIN ] STXK: Loaded 1514 primary data records. [2025-10-08T22:42:53.799243] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:53.821249] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51938 primary records. [2025-10-08T22:42:53.852146] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-08T22:42:53.930377] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-08T22:42:53.930626] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-08T22:42:53.932816] [INFO ] [MAIN ] Derivative Progress: 1443/1771 symbols completed. STWD took 1.5s. Estimated remaining: 2m 6s. Rate: 156.0 symbols/min [2025-10-08T22:42:53.940100] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:54.149227] [DEBUG] [LOCAL ] STXT: Loaded 2495 existing records from primary storage. [2025-10-08T22:42:54.149673] [INFO ] [MAIN ] STXT: Loaded 2495 primary data records. [2025-10-08T22:42:54.280552] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:54.293453] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2469 primary records. [2025-10-08T22:42:54.304170] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-08T22:42:54.498175] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-08T22:42:54.498330] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-08T22:42:54.501295] [INFO ] [MAIN ] Derivative Progress: 1444/1771 symbols completed. STXG took 1.1s. Estimated remaining: 2m 6s. Rate: 155.9 symbols/min [2025-10-08T22:42:54.502748] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:54.523150] [DEBUG] [LOCAL ] STXV: Loaded 1545 existing records from primary storage. [2025-10-08T22:42:54.524049] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:42:54.525678] [INFO ] [MAIN ] STXV: Loaded 1545 primary data records. [2025-10-08T22:42:54.526496] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1514 primary records. [2025-10-08T22:42:54.547204] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-08T22:42:54.640435] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-08T22:42:54.643938] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-08T22:42:54.646211] [INFO ] [MAIN ] Derivative Progress: 1445/1771 symbols completed. STXK took 1.1s. Estimated remaining: 2m 5s. Rate: 156.0 symbols/min [2025-10-08T22:42:54.646472] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:54.893988] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:42:54.903568] [INFO ] [MAIN ] STXT: Generated 1792 derivative records from 2495 primary records. [2025-10-08T22:42:54.909375] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-08T22:42:54.925179] [DEBUG] [LOCAL ] STXT: Derivative data saved (1792 records). [2025-10-08T22:42:54.925627] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-08T22:42:54.928100] [INFO ] [MAIN ] Derivative Progress: 1446/1771 symbols completed. STXT took 1.0s. Estimated remaining: 2m 5s. Rate: 156.0 symbols/min [2025-10-08T22:42:54.928619] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:54.970371] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7728 incomplete bins [2025-10-08T22:42:54.971334] [INFO ] [MAIN ] STXV: Generated 1790 derivative records from 1545 primary records. [2025-10-08T22:42:54.971497] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-08T22:42:54.997501] [DEBUG] [LOCAL ] STZ: Loaded 52332 existing records from primary storage. [2025-10-08T22:42:55.000484] [INFO ] [MAIN ] STZ: Loaded 52332 primary data records. [2025-10-08T22:42:55.001431] [DEBUG] [LOCAL ] STXV: Derivative data saved (1790 records). [2025-10-08T22:42:55.001542] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-08T22:42:55.004011] [INFO ] [MAIN ] Derivative Progress: 1447/1771 symbols completed. STXV took 0.5s. Estimated remaining: 2m 5s. Rate: 156.1 symbols/min [2025-10-08T22:42:55.004250] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:55.199002] [DEBUG] [LOCAL ] SU: Loaded 53435 existing records from primary storage. [2025-10-08T22:42:55.211698] [INFO ] [MAIN ] SU: Loaded 53435 primary data records. [2025-10-08T22:42:55.505238] [DEBUG] [LOCAL ] SUI: Loaded 41672 existing records from primary storage. [2025-10-08T22:42:55.529526] [INFO ] [MAIN ] SUI: Loaded 41672 primary data records. [2025-10-08T22:42:56.060212] [DEBUG] [MAIN ] STZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:56.062076] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52332 primary records. [2025-10-08T22:42:56.062209] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-10-08T22:42:56.090170] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-10-08T22:42:56.104364] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-10-08T22:42:56.105151] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:56.107864] [INFO ] [MAIN ] Derivative Progress: 1448/1771 symbols completed. STZ took 1.5s. Estimated remaining: 2m 4s. Rate: 155.9 symbols/min [2025-10-08T22:42:56.109042] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53435 primary records. [2025-10-08T22:42:56.109371] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:56.109427] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-08T22:42:56.138123] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-08T22:42:56.138410] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-08T22:42:56.141516] [INFO ] [MAIN ] Derivative Progress: 1449/1771 symbols completed. SU took 1.2s. Estimated remaining: 2m 4s. Rate: 156.0 symbols/min [2025-10-08T22:42:56.141963] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:56.163976] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:56.164851] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41672 primary records. [2025-10-08T22:42:56.165050] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-08T22:42:56.200611] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-08T22:42:56.200928] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-08T22:42:56.203988] [INFO ] [MAIN ] Derivative Progress: 1450/1771 symbols completed. SUI took 1.2s. Estimated remaining: 2m 3s. Rate: 156.1 symbols/min [2025-10-08T22:42:56.204578] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:56.241519] [DEBUG] [LOCAL ] SUN: Loaded 37938 existing records from primary storage. [2025-10-08T22:42:56.241996] [INFO ] [MAIN ] SUN: Loaded 37938 primary data records. [2025-10-08T22:42:56.363802] [DEBUG] [LOCAL ] SUPV: Loaded 47466 existing records from primary storage. [2025-10-08T22:42:56.364112] [INFO ] [MAIN ] SUPV: Loaded 47466 primary data records. [2025-10-08T22:42:56.626590] [DEBUG] [LOCAL ] SUZ: Loaded 45553 existing records from primary storage. [2025-10-08T22:42:56.637349] [INFO ] [MAIN ] SUZ: Loaded 45553 primary data records. [2025-10-08T22:42:57.522572] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:57.523794] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37938 primary records. [2025-10-08T22:42:57.524119] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-08T22:42:57.551539] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-08T22:42:57.557632] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-08T22:42:57.558715] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:57.560712] [INFO ] [MAIN ] Derivative Progress: 1451/1771 symbols completed. SUN took 1.5s. Estimated remaining: 2m 3s. Rate: 155.8 symbols/min [2025-10-08T22:42:57.560868] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:57.561597] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 47466 primary records. [2025-10-08T22:42:57.562989] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-08T22:42:57.589471] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:57.590505] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45553 primary records. [2025-10-08T22:42:57.590846] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-08T22:42:57.607784] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-08T22:42:57.608406] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-08T22:42:57.611640] [INFO ] [MAIN ] Derivative Progress: 1452/1771 symbols completed. SUPV took 1.5s. Estimated remaining: 2m 3s. Rate: 155.9 symbols/min [2025-10-08T22:42:57.612309] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:57.625182] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-08T22:42:57.625370] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-08T22:42:57.627708] [INFO ] [MAIN ] Derivative Progress: 1453/1771 symbols completed. SUZ took 1.4s. Estimated remaining: 2m 2s. Rate: 156.0 symbols/min [2025-10-08T22:42:57.644575] [DEBUG] [LOCAL ] SVV: Loaded 39949 existing records from primary storage. [2025-10-08T22:42:57.644763] [INFO ] [MAIN ] SVV: Loaded 39949 primary data records. [2025-10-08T22:42:57.972099] [DEBUG] [LOCAL ] SW: Loaded 53184 existing records from primary storage. [2025-10-08T22:42:57.972365] [INFO ] [MAIN ] SW: Loaded 53184 primary data records. [2025-10-08T22:42:58.299934] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:58.300919] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39949 primary records. [2025-10-08T22:42:58.301323] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-08T22:42:58.320044] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-08T22:42:58.320389] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-08T22:42:58.322948] [INFO ] [MAIN ] Derivative Progress: 1454/1771 symbols completed. SVV took 0.8s. Estimated remaining: 2m 2s. Rate: 155.9 symbols/min [2025-10-08T22:42:58.338313] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:58.339050] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53184 primary records. [2025-10-08T22:42:58.339123] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-08T22:42:58.354690] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-08T22:42:58.354798] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-08T22:42:58.357763] [INFO ] [MAIN ] Derivative Progress: 1455/1771 symbols completed. SW took 0.7s. Estimated remaining: 2m 2s. Rate: 156.0 symbols/min [2025-10-08T22:42:58.358185] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:58.358281] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:58.358558] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:58.369665] [DEBUG] [LOCAL ] SWZ: Loaded 6101 existing records from primary storage. [2025-10-08T22:42:58.369857] [INFO ] [MAIN ] SWZ: Loaded 6101 primary data records. [2025-10-08T22:42:58.587403] [DEBUG] [LOCAL ] SWX: Loaded 31200 existing records from primary storage. [2025-10-08T22:42:58.706582] [INFO ] [MAIN ] SWX: Loaded 31200 primary data records. [2025-10-08T22:42:58.729361] [DEBUG] [LOCAL ] SWK: Loaded 52432 existing records from primary storage. [2025-10-08T22:42:58.747450] [INFO ] [MAIN ] SWK: Loaded 52432 primary data records. [2025-10-08T22:42:59.471750] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:59.472897] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6101 primary records. [2025-10-08T22:42:59.473099] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-08T22:42:59.494188] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-08T22:42:59.494881] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-08T22:42:59.497748] [INFO ] [MAIN ] Derivative Progress: 1456/1771 symbols completed. SWZ took 1.1s. Estimated remaining: 2m 1s. Rate: 155.8 symbols/min [2025-10-08T22:42:59.498302] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:59.521592] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:59.535633] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31200 primary records. [2025-10-08T22:42:59.535925] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:42:59.536847] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52432 primary records. [2025-10-08T22:42:59.537172] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-08T22:42:59.536925] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-08T22:42:59.568104] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-08T22:42:59.569989] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-08T22:42:59.582499] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-08T22:42:59.585217] [INFO ] [MAIN ] Derivative Progress: 1457/1771 symbols completed. SWK took 1.2s. Estimated remaining: 2m 1s. Rate: 155.9 symbols/min [2025-10-08T22:42:59.585409] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-08T22:42:59.588382] [INFO ] [MAIN ] Derivative Progress: 1458/1771 symbols completed. SWX took 1.2s. Estimated remaining: 2m 0s. Rate: 156.0 symbols/min [2025-10-08T22:42:59.588216] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:59.588575] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:42:59.604205] [DEBUG] [LOCAL ] SXC: Loaded 41425 existing records from primary storage. [2025-10-08T22:42:59.604460] [INFO ] [MAIN ] SXC: Loaded 41425 primary data records. [2025-10-08T22:42:59.683032] [DEBUG] [LOCAL ] SXI: Loaded 11669 existing records from primary storage. [2025-10-08T22:42:59.695439] [INFO ] [MAIN ] SXI: Loaded 11669 primary data records. [2025-10-08T22:43:00.046042] [DEBUG] [LOCAL ] SXT: Loaded 29829 existing records from primary storage. [2025-10-08T22:43:00.047021] [INFO ] [MAIN ] SXT: Loaded 29829 primary data records. [2025-10-08T22:43:00.589843] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:00.591103] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41425 primary records. [2025-10-08T22:43:00.591449] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-08T22:43:00.612777] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-08T22:43:00.625012] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-08T22:43:00.628849] [INFO ] [MAIN ] Derivative Progress: 1459/1771 symbols completed. SXC took 1.1s. Estimated remaining: 2m 0s. Rate: 155.8 symbols/min [2025-10-08T22:43:00.629050] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:00.626325] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:00.630468] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11669 primary records. [2025-10-08T22:43:00.630795] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-08T22:43:00.652008] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-08T22:43:00.665583] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-08T22:43:00.665393] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:00.669201] [INFO ] [MAIN ] Derivative Progress: 1460/1771 symbols completed. SXI took 1.1s. Estimated remaining: 1m 60s. Rate: 155.9 symbols/min [2025-10-08T22:43:00.670639] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:00.670445] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29829 primary records. [2025-10-08T22:43:00.670929] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-08T22:43:00.690475] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-08T22:43:00.708278] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-08T22:43:00.710749] [INFO ] [MAIN ] Derivative Progress: 1461/1771 symbols completed. SXT took 1.1s. Estimated remaining: 1m 59s. Rate: 156.0 symbols/min [2025-10-08T22:43:00.711178] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:00.733785] [DEBUG] [LOCAL ] SYF: Loaded 53446 existing records from primary storage. [2025-10-08T22:43:00.734091] [INFO ] [MAIN ] SYF: Loaded 53446 primary data records. [2025-10-08T22:43:01.095856] [DEBUG] [LOCAL ] SYK: Loaded 46882 existing records from primary storage. [2025-10-08T22:43:01.106132] [INFO ] [MAIN ] SYK: Loaded 46882 primary data records. [2025-10-08T22:43:01.202140] [DEBUG] [LOCAL ] SYY: Loaded 53234 existing records from primary storage. [2025-10-08T22:43:01.207819] [INFO ] [MAIN ] SYY: Loaded 53234 primary data records. [2025-10-08T22:43:01.826937] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:01.828443] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53446 primary records. [2025-10-08T22:43:01.828966] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-08T22:43:01.848565] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-08T22:43:01.849827] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-08T22:43:01.854421] [INFO ] [MAIN ] Derivative Progress: 1462/1771 symbols completed. SYF took 1.2s. Estimated remaining: 1m 59s. Rate: 155.8 symbols/min [2025-10-08T22:43:01.855012] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:01.869219] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:01.870015] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 46882 primary records. [2025-10-08T22:43:01.870210] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-08T22:43:01.904777] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:01.906028] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53234 primary records. [2025-10-08T22:43:01.906141] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-08T22:43:01.904330] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-10-08T22:43:01.907257] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-08T22:43:01.909980] [INFO ] [MAIN ] Derivative Progress: 1463/1771 symbols completed. SYK took 1.2s. Estimated remaining: 1m 59s. Rate: 155.9 symbols/min [2025-10-08T22:43:01.923476] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:01.930873] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-08T22:43:01.931196] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-08T22:43:01.933603] [INFO ] [MAIN ] Derivative Progress: 1464/1771 symbols completed. SYY took 1.2s. Estimated remaining: 1m 58s. Rate: 156.0 symbols/min [2025-10-08T22:43:01.934010] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:01.979312] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-08T22:43:01.979500] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-08T22:43:02.116005] [DEBUG] [LOCAL ] TAC: Loaded 42688 existing records from primary storage. [2025-10-08T22:43:02.127731] [INFO ] [MAIN ] TAC: Loaded 42688 primary data records. [2025-10-08T22:43:02.414731] [DEBUG] [LOCAL ] TAK: Loaded 49986 existing records from primary storage. [2025-10-08T22:43:02.434093] [INFO ] [MAIN ] TAK: Loaded 49986 primary data records. [2025-10-08T22:43:03.039969] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:03.041703] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-08T22:43:03.042600] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-08T22:43:03.080077] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:03.081785] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 42688 primary records. [2025-10-08T22:43:03.082295] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-08T22:43:03.084393] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-08T22:43:03.092450] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-08T22:43:03.103111] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-08T22:43:03.099594] [INFO ] [MAIN ] Derivative Progress: 1465/1771 symbols completed. T took 1.2s. Estimated remaining: 1m 58s. Rate: 155.8 symbols/min [2025-10-08T22:43:03.103404] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-08T22:43:03.107203] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:03.107378] [INFO ] [MAIN ] Derivative Progress: 1466/1771 symbols completed. TAC took 1.2s. Estimated remaining: 1m 57s. Rate: 155.9 symbols/min [2025-10-08T22:43:03.107591] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:03.124669] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:03.125483] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49986 primary records. [2025-10-08T22:43:03.125635] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-08T22:43:03.144582] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-08T22:43:03.144817] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-08T22:43:03.147427] [INFO ] [MAIN ] Derivative Progress: 1467/1771 symbols completed. TAK took 1.2s. Estimated remaining: 1m 57s. Rate: 156.0 symbols/min [2025-10-08T22:43:03.147815] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:03.186497] [DEBUG] [LOCAL ] TALO: Loaded 50854 existing records from primary storage. [2025-10-08T22:43:03.186730] [INFO ] [MAIN ] TALO: Loaded 50854 primary data records. [2025-10-08T22:43:03.422851] [DEBUG] [LOCAL ] TAL: Loaded 51818 existing records from primary storage. [2025-10-08T22:43:03.599715] [INFO ] [MAIN ] TAL: Loaded 51818 primary data records. [2025-10-08T22:43:03.620304] [DEBUG] [LOCAL ] TAP: Loaded 52922 existing records from primary storage. [2025-10-08T22:43:03.631998] [INFO ] [MAIN ] TAP: Loaded 52922 primary data records. [2025-10-08T22:43:04.282412] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:04.284481] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50854 primary records. [2025-10-08T22:43:04.285011] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-08T22:43:04.305781] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-08T22:43:04.306377] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-08T22:43:04.310245] [INFO ] [MAIN ] Derivative Progress: 1468/1771 symbols completed. TALO took 1.2s. Estimated remaining: 1m 57s. Rate: 155.8 symbols/min [2025-10-08T22:43:04.327756] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:04.328912] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51818 primary records. [2025-10-08T22:43:04.329781] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-08T22:43:04.358755] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:04.360163] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52922 primary records. [2025-10-08T22:43:04.360478] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-08T22:43:04.377388] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-08T22:43:04.377927] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-08T22:43:04.381096] [INFO ] [MAIN ] Derivative Progress: 1469/1771 symbols completed. TAL took 1.3s. Estimated remaining: 1m 56s. Rate: 155.9 symbols/min [2025-10-08T22:43:04.384084] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-08T22:43:04.384155] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-08T22:43:04.386525] [INFO ] [MAIN ] Derivative Progress: 1470/1771 symbols completed. TAP took 1.2s. Estimated remaining: 1m 56s. Rate: 156.0 symbols/min [2025-10-08T22:43:04.387031] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:04.387559] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:04.386976] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:04.405434] [DEBUG] [LOCAL ] TBB: Loaded 11692 existing records from primary storage. [2025-10-08T22:43:04.411835] [INFO ] [MAIN ] TBB: Loaded 11692 primary data records. [2025-10-08T22:43:04.497833] [DEBUG] [LOCAL ] TBI: Loaded 22436 existing records from primary storage. [2025-10-08T22:43:04.521579] [INFO ] [MAIN ] TBI: Loaded 22436 primary data records. [2025-10-08T22:43:04.581213] [DEBUG] [LOCAL ] TBBB: Loaded 35659 existing records from primary storage. [2025-10-08T22:43:04.647381] [INFO ] [MAIN ] TBBB: Loaded 35659 primary data records. [2025-10-08T22:43:05.545199] [DEBUG] [MAIN ] TBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:05.547633] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11692 primary records. [2025-10-08T22:43:05.547829] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-08T22:43:05.580592] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-08T22:43:05.581315] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:05.582081] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22436 primary records. [2025-10-08T22:43:05.582353] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-08T22:43:05.584680] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-08T22:43:05.584599] [INFO ] [MAIN ] Derivative Progress: 1471/1771 symbols completed. TBB took 1.2s. Estimated remaining: 1m 56s. Rate: 155.7 symbols/min [2025-10-08T22:43:05.585274] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:05.620584] [DEBUG] [LOCAL ] TBN: Loaded 3862 existing records from primary storage. [2025-10-08T22:43:05.606045] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-08T22:43:05.620741] [INFO ] [MAIN ] TBN: Loaded 3862 primary data records. [2025-10-08T22:43:05.621056] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-08T22:43:05.623689] [INFO ] [MAIN ] Derivative Progress: 1472/1771 symbols completed. TBI took 1.2s. Estimated remaining: 1m 55s. Rate: 155.8 symbols/min [2025-10-08T22:43:05.624127] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:05.624214] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:05.637044] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35659 primary records. [2025-10-08T22:43:05.657915] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-08T22:43:05.759115] [DEBUG] [LOCAL ] TCBX: Loaded 10176 existing records from primary storage. [2025-10-08T22:43:05.770565] [INFO ] [MAIN ] TCBX: Loaded 10176 primary data records. [2025-10-08T22:43:06.013550] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-08T22:43:06.036989] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-08T22:43:06.051069] [INFO ] [MAIN ] Derivative Progress: 1473/1771 symbols completed. TBBB took 1.7s. Estimated remaining: 1m 55s. Rate: 155.8 symbols/min [2025-10-08T22:43:06.051778] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:06.275446] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:43:06.276241] [INFO ] [MAIN ] TBN: Generated 1792 derivative records from 3862 primary records. [2025-10-08T22:43:06.276519] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-08T22:43:06.324420] [DEBUG] [MAIN ] TCBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:06.323995] [DEBUG] [LOCAL ] TBN: Derivative data saved (1792 records). [2025-10-08T22:43:06.340618] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10176 primary records. [2025-10-08T22:43:06.340921] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-08T22:43:06.341049] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-08T22:43:06.343119] [DEBUG] [LOCAL ] TD: Loaded 52354 existing records from primary storage. [2025-10-08T22:43:06.345510] [INFO ] [MAIN ] Derivative Progress: 1474/1771 symbols completed. TBN took 0.8s. Estimated remaining: 1m 54s. Rate: 155.9 symbols/min [2025-10-08T22:43:06.352721] [INFO ] [MAIN ] TD: Loaded 52354 primary data records. [2025-10-08T22:43:06.357170] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:06.466554] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-08T22:43:06.477914] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-08T22:43:06.490900] [INFO ] [MAIN ] Derivative Progress: 1475/1771 symbols completed. TCBX took 0.9s. Estimated remaining: 1m 54s. Rate: 155.9 symbols/min [2025-10-08T22:43:06.512092] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:06.728048] [DEBUG] [LOCAL ] TDC: Loaded 46558 existing records from primary storage. [2025-10-08T22:43:06.726955] [DEBUG] [LOCAL ] TDF: Loaded 6248 existing records from primary storage. [2025-10-08T22:43:06.728386] [INFO ] [MAIN ] TDF: Loaded 6248 primary data records. [2025-10-08T22:43:06.728290] [INFO ] [MAIN ] TDC: Loaded 46558 primary data records. [2025-10-08T22:43:07.457331] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:07.458799] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52354 primary records. [2025-10-08T22:43:07.458996] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-08T22:43:07.484273] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-08T22:43:07.484680] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-08T22:43:07.486926] [INFO ] [MAIN ] Derivative Progress: 1476/1771 symbols completed. TD took 1.4s. Estimated remaining: 1m 54s. Rate: 155.8 symbols/min [2025-10-08T22:43:07.487361] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:07.514616] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:07.528383] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6248 primary records. [2025-10-08T22:43:07.528720] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:07.529440] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46558 primary records. [2025-10-08T22:43:07.529588] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-08T22:43:07.529503] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-08T22:43:07.565532] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-08T22:43:07.568368] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-08T22:43:07.567485] [DEBUG] [LOCAL ] TDG: Loaded 22042 existing records from primary storage. [2025-10-08T22:43:07.571043] [INFO ] [MAIN ] TDG: Loaded 22042 primary data records. [2025-10-08T22:43:07.570945] [INFO ] [MAIN ] Derivative Progress: 1477/1771 symbols completed. TDF took 1.1s. Estimated remaining: 1m 53s. Rate: 155.8 symbols/min [2025-10-08T22:43:07.571283] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:07.638092] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-08T22:43:07.655425] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-08T22:43:07.668742] [INFO ] [MAIN ] Derivative Progress: 1478/1771 symbols completed. TDC took 1.3s. Estimated remaining: 1m 53s. Rate: 155.9 symbols/min [2025-10-08T22:43:07.668984] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:07.939120] [DEBUG] [LOCAL ] TDS: Loaded 42645 existing records from primary storage. [2025-10-08T22:43:07.939275] [INFO ] [MAIN ] TDS: Loaded 42645 primary data records. [2025-10-08T22:43:08.060468] [DEBUG] [LOCAL ] TDW: Loaded 45083 existing records from primary storage. [2025-10-08T22:43:08.066907] [INFO ] [MAIN ] TDW: Loaded 45083 primary data records. [2025-10-08T22:43:08.583610] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:08.585132] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22042 primary records. [2025-10-08T22:43:08.585279] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-08T22:43:08.608046] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-08T22:43:08.609178] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-08T22:43:08.613358] [INFO ] [MAIN ] Derivative Progress: 1479/1771 symbols completed. TDG took 1.1s. Estimated remaining: 1m 52s. Rate: 155.8 symbols/min [2025-10-08T22:43:08.615000] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:08.628884] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:08.629850] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42645 primary records. [2025-10-08T22:43:08.630089] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-08T22:43:08.646987] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-08T22:43:08.652922] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-08T22:43:08.655042] [INFO ] [MAIN ] Derivative Progress: 1480/1771 symbols completed. TDS took 1.1s. Estimated remaining: 1m 52s. Rate: 155.9 symbols/min [2025-10-08T22:43:08.655297] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:08.681576] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:08.681217] [DEBUG] [LOCAL ] TDY: Loaded 22410 existing records from primary storage. [2025-10-08T22:43:08.682378] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45083 primary records. [2025-10-08T22:43:08.682457] [INFO ] [MAIN ] TDY: Loaded 22410 primary data records. [2025-10-08T22:43:08.682672] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-08T22:43:08.723434] [DEBUG] [LOCAL ] TEAF: Loaded 7537 existing records from primary storage. [2025-10-08T22:43:08.749950] [INFO ] [MAIN ] TEAF: Loaded 7537 primary data records. [2025-10-08T22:43:08.816393] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-08T22:43:08.849588] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-08T22:43:08.864133] [INFO ] [MAIN ] Derivative Progress: 1481/1771 symbols completed. TDW took 1.2s. Estimated remaining: 1m 52s. Rate: 155.9 symbols/min [2025-10-08T22:43:08.901789] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:09.415074] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:09.416490] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22410 primary records. [2025-10-08T22:43:09.417796] [DEBUG] [LOCAL ] TECK: Loaded 53439 existing records from primary storage. [2025-10-08T22:43:09.430949] [INFO ] [MAIN ] TECK: Loaded 53439 primary data records. [2025-10-08T22:43:09.430882] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-08T22:43:09.431450] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:09.445164] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7537 primary records. [2025-10-08T22:43:09.467148] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-08T22:43:09.535667] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-08T22:43:09.550183] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-08T22:43:09.595141] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-08T22:43:09.599876] [INFO ] [MAIN ] Derivative Progress: 1482/1771 symbols completed. TDY took 1.0s. Estimated remaining: 1m 51s. Rate: 155.8 symbols/min [2025-10-08T22:43:09.610866] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-08T22:43:09.623511] [INFO ] [MAIN ] Derivative Progress: 1483/1771 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 51s. Rate: 155.9 symbols/min [2025-10-08T22:43:09.610783] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:09.868970] [DEBUG] [LOCAL ] TEF: Loaded 37117 existing records from primary storage. [2025-10-08T22:43:09.869316] [INFO ] [MAIN ] TEF: Loaded 37117 primary data records. [2025-10-08T22:43:09.946366] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:09.959418] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53439 primary records. [2025-10-08T22:43:09.964620] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-08T22:43:10.052526] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-08T22:43:10.052636] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-08T22:43:10.062760] [INFO ] [MAIN ] Derivative Progress: 1484/1771 symbols completed. TECK took 1.2s. Estimated remaining: 1m 50s. Rate: 155.9 symbols/min [2025-10-08T22:43:10.221077] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:10.221724] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37117 primary records. [2025-10-08T22:43:10.221788] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-08T22:43:10.236671] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-08T22:43:10.236743] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-08T22:43:10.239175] [INFO ] [MAIN ] Derivative Progress: 1485/1771 symbols completed. TEF took 0.6s. Estimated remaining: 1m 50s. Rate: 155.9 symbols/min [2025-10-08T22:43:10.239837] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:10.239726] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:10.240180] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:10.262374] [DEBUG] [LOCAL ] TEI: Loaded 21277 existing records from primary storage. [2025-10-08T22:43:10.271294] [INFO ] [MAIN ] TEI: Loaded 21277 primary data records. [2025-10-08T22:43:10.405633] [DEBUG] [LOCAL ] TEN: Loaded 30426 existing records from primary storage. [2025-10-08T22:43:10.406224] [INFO ] [MAIN ] TEN: Loaded 30426 primary data records. [2025-10-08T22:43:10.722493] [DEBUG] [LOCAL ] TEL: Loaded 51073 existing records from primary storage. [2025-10-08T22:43:10.734789] [INFO ] [MAIN ] TEL: Loaded 51073 primary data records. [2025-10-08T22:43:11.292368] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:11.306698] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21277 primary records. [2025-10-08T22:43:11.308008] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:11.309089] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30426 primary records. [2025-10-08T22:43:11.309274] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-08T22:43:11.310081] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-08T22:43:11.344104] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-08T22:43:11.345208] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-08T22:43:11.347478] [INFO ] [MAIN ] Derivative Progress: 1486/1771 symbols completed. TEI took 1.1s. Estimated remaining: 1m 50s. Rate: 155.8 symbols/min [2025-10-08T22:43:11.349853] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:11.350131] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-08T22:43:11.350349] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-08T22:43:11.360125] [INFO ] [MAIN ] Derivative Progress: 1487/1771 symbols completed. TEN took 1.1s. Estimated remaining: 1m 49s. Rate: 155.9 symbols/min [2025-10-08T22:43:11.365886] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:11.365758] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:11.367018] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51073 primary records. [2025-10-08T22:43:11.367081] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-08T22:43:11.388602] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-08T22:43:11.388738] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-08T22:43:11.391182] [INFO ] [MAIN ] Derivative Progress: 1488/1771 symbols completed. TEL took 1.2s. Estimated remaining: 1m 49s. Rate: 155.9 symbols/min [2025-10-08T22:43:11.398011] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:11.410207] [DEBUG] [LOCAL ] TEO: Loaded 22380 existing records from primary storage. [2025-10-08T22:43:11.410422] [INFO ] [MAIN ] TEO: Loaded 22380 primary data records. [2025-10-08T22:43:11.818620] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-10-08T22:43:11.818968] [INFO ] [MAIN ] TEVA: Loaded 53633 primary data records. [2025-10-08T22:43:11.819977] [DEBUG] [LOCAL ] TEX: Loaded 43978 existing records from primary storage. [2025-10-08T22:43:11.841760] [INFO ] [MAIN ] TEX: Loaded 43978 primary data records. [2025-10-08T22:43:12.521014] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:12.522698] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22380 primary records. [2025-10-08T22:43:12.524680] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-08T22:43:12.546970] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-08T22:43:12.548866] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-08T22:43:12.551293] [INFO ] [MAIN ] Derivative Progress: 1489/1771 symbols completed. TEO took 1.2s. Estimated remaining: 1m 49s. Rate: 155.7 symbols/min [2025-10-08T22:43:12.551833] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:12.565274] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:12.566286] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43978 primary records. [2025-10-08T22:43:12.567550] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-08T22:43:12.599451] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:12.600605] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53633 primary records. [2025-10-08T22:43:12.600784] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-08T22:43:12.628291] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-08T22:43:12.629533] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-08T22:43:12.629751] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-08T22:43:12.629830] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-08T22:43:12.632793] [INFO ] [MAIN ] Derivative Progress: 1490/1771 symbols completed. TEVA took 1.3s. Estimated remaining: 1m 48s. Rate: 155.8 symbols/min [2025-10-08T22:43:12.635114] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:12.635318] [INFO ] [MAIN ] Derivative Progress: 1491/1771 symbols completed. TEX took 1.2s. Estimated remaining: 1m 48s. Rate: 155.9 symbols/min [2025-10-08T22:43:12.635555] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:12.648401] [DEBUG] [LOCAL ] TFII: Loaded 33410 existing records from primary storage. [2025-10-08T22:43:12.648685] [INFO ] [MAIN ] TFII: Loaded 33410 primary data records. [2025-10-08T22:43:12.778104] [DEBUG] [LOCAL ] TFIN: Loaded 23527 existing records from primary storage. [2025-10-08T22:43:12.794574] [INFO ] [MAIN ] TFIN: Loaded 23527 primary data records. [2025-10-08T22:43:12.922814] [DEBUG] [LOCAL ] TFPM: Loaded 38574 existing records from primary storage. [2025-10-08T22:43:12.961038] [INFO ] [MAIN ] TFPM: Loaded 38574 primary data records. [2025-10-08T22:43:13.646166] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:13.648129] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 33410 primary records. [2025-10-08T22:43:13.648322] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-08T22:43:13.669611] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-08T22:43:13.670036] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-08T22:43:13.672277] [INFO ] [MAIN ] Derivative Progress: 1492/1771 symbols completed. TFII took 1.1s. Estimated remaining: 1m 47s. Rate: 155.7 symbols/min [2025-10-08T22:43:13.685227] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:13.685566] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:13.688158] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23527 primary records. [2025-10-08T22:43:13.688368] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-08T22:43:13.713813] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-08T22:43:13.718879] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-08T22:43:13.721103] [INFO ] [MAIN ] Derivative Progress: 1493/1771 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 47s. Rate: 155.8 symbols/min [2025-10-08T22:43:13.721321] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:13.719195] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:13.722348] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 38574 primary records. [2025-10-08T22:43:13.722748] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-08T22:43:13.752813] [DEBUG] [LOCAL ] TG: Loaded 10354 existing records from primary storage. [2025-10-08T22:43:13.753608] [INFO ] [MAIN ] TG: Loaded 10354 primary data records. [2025-10-08T22:43:13.827683] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-08T22:43:13.838428] [DEBUG] [LOCAL ] TFX: Loaded 36748 existing records from primary storage. [2025-10-08T22:43:13.837350] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-08T22:43:13.838604] [INFO ] [MAIN ] TFX: Loaded 36748 primary data records. [2025-10-08T22:43:13.841023] [INFO ] [MAIN ] Derivative Progress: 1494/1771 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 47s. Rate: 155.9 symbols/min [2025-10-08T22:43:13.858199] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:14.466023] [DEBUG] [LOCAL ] TGLS: Loaded 27549 existing records from primary storage. [2025-10-08T22:43:14.467908] [INFO ] [MAIN ] TGLS: Loaded 27549 primary data records. [2025-10-08T22:43:14.812514] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:14.814147] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 36748 primary records. [2025-10-08T22:43:14.813271] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:14.815456] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10354 primary records. [2025-10-08T22:43:14.816223] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-08T22:43:14.816894] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-08T22:43:14.842698] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-08T22:43:14.842836] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-08T22:43:14.848135] [INFO ] [MAIN ] Derivative Progress: 1495/1771 symbols completed. TFX took 1.2s. Estimated remaining: 1m 46s. Rate: 155.7 symbols/min [2025-10-08T22:43:14.848406] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:14.853106] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-08T22:43:14.853709] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-08T22:43:14.856307] [INFO ] [MAIN ] Derivative Progress: 1496/1771 symbols completed. TG took 1.1s. Estimated remaining: 1m 46s. Rate: 155.8 symbols/min [2025-10-08T22:43:14.856585] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:14.873289] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:14.874019] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27549 primary records. [2025-10-08T22:43:14.874187] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-08T22:43:14.890817] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-08T22:43:14.891011] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-08T22:43:14.893336] [INFO ] [MAIN ] Derivative Progress: 1497/1771 symbols completed. TGLS took 1.0s. Estimated remaining: 1m 45s. Rate: 155.9 symbols/min [2025-10-08T22:43:14.893694] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:14.934885] [DEBUG] [LOCAL ] TGS: Loaded 32929 existing records from primary storage. [2025-10-08T22:43:14.948360] [INFO ] [MAIN ] TGS: Loaded 32929 primary data records. [2025-10-08T22:43:14.964359] [DEBUG] [LOCAL ] TGNA: Loaded 48633 existing records from primary storage. [2025-10-08T22:43:14.992944] [INFO ] [MAIN ] TGNA: Loaded 48633 primary data records. [2025-10-08T22:43:15.585490] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-10-08T22:43:15.594137] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-10-08T22:43:15.999150] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:16.000861] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32929 primary records. [2025-10-08T22:43:16.001226] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:16.002011] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48633 primary records. [2025-10-08T22:43:16.000964] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-08T22:43:16.002136] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-08T22:43:16.033508] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-08T22:43:16.034594] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-08T22:43:16.038124] [INFO ] [MAIN ] Derivative Progress: 1498/1771 symbols completed. TGS took 1.2s. Estimated remaining: 1m 45s. Rate: 155.7 symbols/min [2025-10-08T22:43:16.040332] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-08T22:43:16.040541] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-08T22:43:16.042585] [INFO ] [MAIN ] Derivative Progress: 1499/1771 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 45s. Rate: 155.8 symbols/min [2025-10-08T22:43:16.057265] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:16.057848] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-10-08T22:43:16.057909] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-08T22:43:16.073551] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-08T22:43:16.073616] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-08T22:43:16.075676] [INFO ] [MAIN ] Derivative Progress: 1500/1771 symbols completed. TGT took 1.2s. Estimated remaining: 1m 44s. Rate: 155.9 symbols/min [2025-10-08T22:43:16.076185] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:16.076419] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:16.076340] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:16.084602] [DEBUG] [LOCAL ] THIR: Loaded 2284 existing records from primary storage. [2025-10-08T22:43:16.084915] [INFO ] [MAIN ] THIR: Loaded 2284 primary data records. [2025-10-08T22:43:16.400623] [DEBUG] [LOCAL ] THG: Loaded 21582 existing records from primary storage. [2025-10-08T22:43:16.411166] [INFO ] [MAIN ] THG: Loaded 21582 primary data records. [2025-10-08T22:43:16.554130] [DEBUG] [LOCAL ] THC: Loaded 47368 existing records from primary storage. [2025-10-08T22:43:16.603330] [INFO ] [MAIN ] THC: Loaded 47368 primary data records. [2025-10-08T22:43:17.071892] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7733 incomplete bins [2025-10-08T22:43:17.073152] [INFO ] [MAIN ] THIR: Generated 1785 derivative records from 2284 primary records. [2025-10-08T22:43:17.073427] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-08T22:43:17.096343] [DEBUG] [LOCAL ] THIR: Derivative data saved (1785 records). [2025-10-08T22:43:17.097613] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-08T22:43:17.099803] [INFO ] [MAIN ] Derivative Progress: 1501/1771 symbols completed. THIR took 1.0s. Estimated remaining: 1m 44s. Rate: 155.8 symbols/min [2025-10-08T22:43:17.100165] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:17.115286] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:17.116122] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21582 primary records. [2025-10-08T22:43:17.118260] [DEBUG] [LOCAL ] THLV: Loaded 1541 existing records from primary storage. [2025-10-08T22:43:17.118367] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-08T22:43:17.118899] [INFO ] [MAIN ] THLV: Loaded 1541 primary data records. [2025-10-08T22:43:17.217193] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-08T22:43:17.223263] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-08T22:43:17.225459] [INFO ] [MAIN ] Derivative Progress: 1502/1771 symbols completed. THG took 1.1s. Estimated remaining: 1m 44s. Rate: 155.8 symbols/min [2025-10-08T22:43:17.231389] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:17.323291] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:17.466115] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 47368 primary records. [2025-10-08T22:43:17.466779] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-08T22:43:17.496871] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-08T22:43:17.497531] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-08T22:43:17.500720] [INFO ] [MAIN ] Derivative Progress: 1503/1771 symbols completed. THC took 1.4s. Estimated remaining: 1m 43s. Rate: 155.9 symbols/min [2025-10-08T22:43:17.501014] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:17.517704] [DEBUG] [LOCAL ] THO: Loaded 41671 existing records from primary storage. [2025-10-08T22:43:17.517964] [INFO ] [MAIN ] THO: Loaded 41671 primary data records. [2025-10-08T22:43:17.681700] [DEBUG] [LOCAL ] THQ: Loaded 25201 existing records from primary storage. [2025-10-08T22:43:17.733194] [INFO ] [MAIN ] THQ: Loaded 25201 primary data records. [2025-10-08T22:43:17.745456] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:43:17.766100] [INFO ] [MAIN ] THLV: Generated 1793 derivative records from 1541 primary records. [2025-10-08T22:43:17.771408] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-08T22:43:18.205901] [DEBUG] [LOCAL ] THLV: Derivative data saved (1793 records). [2025-10-08T22:43:18.220524] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-08T22:43:18.224136] [INFO ] [MAIN ] Derivative Progress: 1504/1771 symbols completed. THLV took 1.1s. Estimated remaining: 1m 43s. Rate: 155.8 symbols/min [2025-10-08T22:43:18.224702] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:18.249004] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:18.249949] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41671 primary records. [2025-10-08T22:43:18.251003] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-08T22:43:18.268356] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-08T22:43:18.268684] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-08T22:43:18.270962] [INFO ] [MAIN ] Derivative Progress: 1505/1771 symbols completed. THO took 1.0s. Estimated remaining: 1m 42s. Rate: 155.9 symbols/min [2025-10-08T22:43:18.271362] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:18.299622] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:18.312122] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25201 primary records. [2025-10-08T22:43:18.312257] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-08T22:43:18.313438] [DEBUG] [LOCAL ] THS: Loaded 38450 existing records from primary storage. [2025-10-08T22:43:18.319178] [INFO ] [MAIN ] THS: Loaded 38450 primary data records. [2025-10-08T22:43:18.406843] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-08T22:43:18.419334] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-08T22:43:18.407293] [DEBUG] [LOCAL ] THW: Loaded 19674 existing records from primary storage. [2025-10-08T22:43:18.432750] [INFO ] [MAIN ] Derivative Progress: 1506/1771 symbols completed. THQ took 0.9s. Estimated remaining: 1m 42s. Rate: 155.9 symbols/min [2025-10-08T22:43:18.446509] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:18.432893] [INFO ] [MAIN ] THW: Loaded 19674 primary data records. [2025-10-08T22:43:18.992700] [DEBUG] [LOCAL ] TIMB: Loaded 35638 existing records from primary storage. [2025-10-08T22:43:18.993848] [INFO ] [MAIN ] TIMB: Loaded 35638 primary data records. [2025-10-08T22:43:19.334632] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:19.336393] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38450 primary records. [2025-10-08T22:43:19.336698] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-08T22:43:19.373975] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:19.373030] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-08T22:43:19.374537] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-08T22:43:19.376720] [INFO ] [MAIN ] Derivative Progress: 1507/1771 symbols completed. THS took 1.2s. Estimated remaining: 1m 42s. Rate: 155.8 symbols/min [2025-10-08T22:43:19.377688] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19674 primary records. [2025-10-08T22:43:19.377885] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:19.378687] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-08T22:43:19.397529] [DEBUG] [LOCAL ] TISI: Loaded 3473 existing records from primary storage. [2025-10-08T22:43:19.399284] [INFO ] [MAIN ] TISI: Loaded 3473 primary data records. [2025-10-08T22:43:19.525557] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-08T22:43:19.541565] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-08T22:43:19.547568] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:19.555235] [INFO ] [MAIN ] Derivative Progress: 1508/1771 symbols completed. THW took 1.3s. Estimated remaining: 1m 41s. Rate: 155.8 symbols/min [2025-10-08T22:43:19.575381] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 35638 primary records. [2025-10-08T22:43:19.578868] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:19.614723] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-08T22:43:19.789738] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-08T22:43:19.790452] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-08T22:43:19.792835] [INFO ] [MAIN ] Derivative Progress: 1509/1771 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 41s. Rate: 155.9 symbols/min [2025-10-08T22:43:19.793253] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:19.821536] [DEBUG] [LOCAL ] TIXT: Loaded 31936 existing records from primary storage. [2025-10-08T22:43:19.822041] [INFO ] [MAIN ] TIXT: Loaded 31936 primary data records. [2025-10-08T22:43:19.905991] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:19.906927] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3473 primary records. [2025-10-08T22:43:19.918127] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-08T22:43:20.173501] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-08T22:43:20.173882] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-08T22:43:20.189177] [INFO ] [MAIN ] Derivative Progress: 1510/1771 symbols completed. TISI took 0.8s. Estimated remaining: 1m 40s. Rate: 155.9 symbols/min [2025-10-08T22:43:20.191452] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:20.192984] [DEBUG] [LOCAL ] TJX: Loaded 53668 existing records from primary storage. [2025-10-08T22:43:20.194161] [INFO ] [MAIN ] TJX: Loaded 53668 primary data records. [2025-10-08T22:43:20.521529] [DEBUG] [LOCAL ] TK: Loaded 39226 existing records from primary storage. [2025-10-08T22:43:20.525018] [INFO ] [MAIN ] TK: Loaded 39226 primary data records. [2025-10-08T22:43:20.621915] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:20.641342] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31936 primary records. [2025-10-08T22:43:20.644792] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-08T22:43:20.862184] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-08T22:43:20.862464] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-08T22:43:20.866416] [INFO ] [MAIN ] Derivative Progress: 1511/1771 symbols completed. TIXT took 1.3s. Estimated remaining: 1m 40s. Rate: 155.8 symbols/min [2025-10-08T22:43:20.867826] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:20.888579] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:20.889530] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53668 primary records. [2025-10-08T22:43:20.889730] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-08T22:43:20.912361] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-08T22:43:20.912503] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-08T22:43:20.914567] [INFO ] [MAIN ] Derivative Progress: 1512/1771 symbols completed. TJX took 1.1s. Estimated remaining: 1m 40s. Rate: 155.9 symbols/min [2025-10-08T22:43:20.924040] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:20.941485] [DEBUG] [MAIN ] TK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:20.952864] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39226 primary records. [2025-10-08T22:43:20.953025] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-08T22:43:20.954098] [DEBUG] [LOCAL ] TKC: Loaded 39065 existing records from primary storage. [2025-10-08T22:43:20.954207] [INFO ] [MAIN ] TKC: Loaded 39065 primary data records. [2025-10-08T22:43:21.082217] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-08T22:43:21.108500] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-08T22:43:21.123979] [INFO ] [MAIN ] Derivative Progress: 1513/1771 symbols completed. TK took 0.9s. Estimated remaining: 1m 39s. Rate: 155.9 symbols/min [2025-10-08T22:43:21.293112] [DEBUG] [LOCAL ] TKO: Loaded 43861 existing records from primary storage. [2025-10-08T22:43:21.293334] [INFO ] [MAIN ] TKO: Loaded 43861 primary data records. [2025-10-08T22:43:21.615465] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:21.616527] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39065 primary records. [2025-10-08T22:43:21.617139] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-08T22:43:21.635546] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-08T22:43:21.636454] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-08T22:43:21.638684] [INFO ] [MAIN ] Derivative Progress: 1514/1771 symbols completed. TKC took 0.8s. Estimated remaining: 1m 39s. Rate: 155.9 symbols/min [2025-10-08T22:43:21.652704] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:21.653344] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43861 primary records. [2025-10-08T22:43:21.653406] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-08T22:43:21.669539] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-08T22:43:21.669602] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-08T22:43:21.672759] [INFO ] [MAIN ] Derivative Progress: 1515/1771 symbols completed. TKO took 0.7s. Estimated remaining: 1m 38s. Rate: 156.0 symbols/min [2025-10-08T22:43:21.673471] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:21.673585] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:21.673406] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:21.694534] [DEBUG] [LOCAL ] TLYS: Loaded 16495 existing records from primary storage. [2025-10-08T22:43:21.694845] [INFO ] [MAIN ] TLYS: Loaded 16495 primary data records. [2025-10-08T22:43:21.942229] [DEBUG] [LOCAL ] TKR: Loaded 39922 existing records from primary storage. [2025-10-08T22:43:21.915314] [DEBUG] [LOCAL ] TLK: Loaded 38832 existing records from primary storage. [2025-10-08T22:43:22.087732] [INFO ] [MAIN ] TKR: Loaded 39922 primary data records. [2025-10-08T22:43:22.096096] [INFO ] [MAIN ] TLK: Loaded 38832 primary data records. [2025-10-08T22:43:22.721590] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:22.722557] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16495 primary records. [2025-10-08T22:43:22.722934] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-08T22:43:22.741156] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-08T22:43:22.741503] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-08T22:43:22.743631] [INFO ] [MAIN ] Derivative Progress: 1516/1771 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 38s. Rate: 155.8 symbols/min [2025-10-08T22:43:22.744132] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:22.776663] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:22.771689] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:22.777501] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38832 primary records. [2025-10-08T22:43:22.778110] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39922 primary records. [2025-10-08T22:43:22.778264] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-08T22:43:22.778222] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-08T22:43:22.808431] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-08T22:43:22.810282] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-08T22:43:22.812813] [INFO ] [MAIN ] Derivative Progress: 1517/1771 symbols completed. TLK took 1.1s. Estimated remaining: 1m 38s. Rate: 155.9 symbols/min [2025-10-08T22:43:22.821411] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:22.824842] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-08T22:43:22.825005] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-08T22:43:22.827584] [INFO ] [MAIN ] Derivative Progress: 1518/1771 symbols completed. TKR took 1.2s. Estimated remaining: 1m 37s. Rate: 156.0 symbols/min [2025-10-08T22:43:22.828001] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:22.843331] [DEBUG] [LOCAL ] TM: Loaded 36372 existing records from primary storage. [2025-10-08T22:43:22.843706] [INFO ] [MAIN ] TM: Loaded 36372 primary data records. [2025-10-08T22:43:23.208129] [DEBUG] [LOCAL ] TMHC: Loaded 45297 existing records from primary storage. [2025-10-08T22:43:23.209508] [DEBUG] [LOCAL ] TME: Loaded 53178 existing records from primary storage. [2025-10-08T22:43:23.209774] [INFO ] [MAIN ] TME: Loaded 53178 primary data records. [2025-10-08T22:43:23.209842] [INFO ] [MAIN ] TMHC: Loaded 45297 primary data records. [2025-10-08T22:43:23.900290] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:23.901608] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36372 primary records. [2025-10-08T22:43:23.901783] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-08T22:43:23.929774] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-08T22:43:23.929999] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-08T22:43:23.934796] [INFO ] [MAIN ] Derivative Progress: 1519/1771 symbols completed. TM took 1.2s. Estimated remaining: 1m 37s. Rate: 155.8 symbols/min [2025-10-08T22:43:23.936991] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:23.969319] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:23.970247] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45297 primary records. [2025-10-08T22:43:23.968717] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:23.970518] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-08T22:43:23.973105] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53178 primary records. [2025-10-08T22:43:23.973794] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-08T22:43:24.008830] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-08T22:43:24.008048] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-08T22:43:24.008960] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-08T22:43:24.009287] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-08T22:43:24.011376] [INFO ] [MAIN ] Derivative Progress: 1520/1771 symbols completed. TME took 1.2s. Estimated remaining: 1m 37s. Rate: 155.9 symbols/min [2025-10-08T22:43:24.014544] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:24.014631] [INFO ] [MAIN ] Derivative Progress: 1521/1771 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 36s. Rate: 156.0 symbols/min [2025-10-08T22:43:24.015216] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:24.031096] [DEBUG] [LOCAL ] TNC: Loaded 14618 existing records from primary storage. [2025-10-08T22:43:24.031321] [INFO ] [MAIN ] TNC: Loaded 14618 primary data records. [2025-10-08T22:43:24.263636] [DEBUG] [LOCAL ] TNET: Loaded 28274 existing records from primary storage. [2025-10-08T22:43:24.265123] [DEBUG] [LOCAL ] TMO: Loaded 52421 existing records from primary storage. [2025-10-08T22:43:24.378540] [INFO ] [MAIN ] TNET: Loaded 28274 primary data records. [2025-10-08T22:43:24.378444] [INFO ] [MAIN ] TMO: Loaded 52421 primary data records. [2025-10-08T22:43:25.067953] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:25.069603] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14618 primary records. [2025-10-08T22:43:25.070048] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-08T22:43:25.090186] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-08T22:43:25.090751] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-08T22:43:25.093124] [INFO ] [MAIN ] Derivative Progress: 1522/1771 symbols completed. TNC took 1.1s. Estimated remaining: 1m 36s. Rate: 155.8 symbols/min [2025-10-08T22:43:25.093388] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:25.113053] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:25.117465] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28274 primary records. [2025-10-08T22:43:25.117615] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-08T22:43:25.140797] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:25.148636] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-08T22:43:25.148812] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-08T22:43:25.148530] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52421 primary records. [2025-10-08T22:43:25.149075] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-08T22:43:25.151878] [INFO ] [MAIN ] Derivative Progress: 1523/1771 symbols completed. TNET took 1.1s. Estimated remaining: 1m 35s. Rate: 155.9 symbols/min [2025-10-08T22:43:25.152398] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:25.182136] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-08T22:43:25.182414] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-08T22:43:25.185711] [INFO ] [MAIN ] Derivative Progress: 1524/1771 symbols completed. TMO took 1.2s. Estimated remaining: 1m 35s. Rate: 156.0 symbols/min [2025-10-08T22:43:25.186090] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:25.200827] [DEBUG] [LOCAL ] TNK: Loaded 35169 existing records from primary storage. [2025-10-08T22:43:25.201388] [INFO ] [MAIN ] TNK: Loaded 35169 primary data records. [2025-10-08T22:43:25.421973] [DEBUG] [LOCAL ] TNL: Loaded 41743 existing records from primary storage. [2025-10-08T22:43:25.568968] [INFO ] [MAIN ] TNL: Loaded 41743 primary data records. [2025-10-08T22:43:25.694527] [DEBUG] [LOCAL ] TOL: Loaded 50750 existing records from primary storage. [2025-10-08T22:43:25.700824] [INFO ] [MAIN ] TOL: Loaded 50750 primary data records. [2025-10-08T22:43:26.295446] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:26.297594] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35169 primary records. [2025-10-08T22:43:26.298493] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-08T22:43:26.337773] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:26.339125] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41743 primary records. [2025-10-08T22:43:26.339543] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-08T22:43:26.339762] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-08T22:43:26.339850] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-08T22:43:26.342988] [INFO ] [MAIN ] Derivative Progress: 1525/1771 symbols completed. TNK took 1.2s. Estimated remaining: 1m 35s. Rate: 155.8 symbols/min [2025-10-08T22:43:26.343381] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:26.376011] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:26.377576] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50750 primary records. [2025-10-08T22:43:26.378082] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-08T22:43:26.389822] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-08T22:43:26.391852] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-08T22:43:26.397853] [INFO ] [MAIN ] Derivative Progress: 1526/1771 symbols completed. TNL took 1.2s. Estimated remaining: 1m 34s. Rate: 155.8 symbols/min [2025-10-08T22:43:26.399868] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:26.404130] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-08T22:43:26.404252] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-08T22:43:26.407842] [INFO ] [MAIN ] Derivative Progress: 1527/1771 symbols completed. TOL took 1.2s. Estimated remaining: 1m 34s. Rate: 155.9 symbols/min [2025-10-08T22:43:26.408223] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:26.457624] [DEBUG] [LOCAL ] TPB: Loaded 25571 existing records from primary storage. [2025-10-08T22:43:26.473111] [INFO ] [MAIN ] TPB: Loaded 25571 primary data records. [2025-10-08T22:43:26.512937] [DEBUG] [LOCAL ] TOST: Loaded 53683 existing records from primary storage. [2025-10-08T22:43:26.563895] [INFO ] [MAIN ] TOST: Loaded 53683 primary data records. [2025-10-08T22:43:26.590720] [DEBUG] [LOCAL ] TPC: Loaded 38968 existing records from primary storage. [2025-10-08T22:43:26.623081] [INFO ] [MAIN ] TPC: Loaded 38968 primary data records. [2025-10-08T22:43:27.449727] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:27.451045] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 25571 primary records. [2025-10-08T22:43:27.451471] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-08T22:43:27.471901] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-08T22:43:27.473076] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-08T22:43:27.475277] [INFO ] [MAIN ] Derivative Progress: 1528/1771 symbols completed. TPB took 1.1s. Estimated remaining: 1m 34s. Rate: 155.8 symbols/min [2025-10-08T22:43:27.488260] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:27.489266] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53683 primary records. [2025-10-08T22:43:27.489717] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-08T22:43:27.504582] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:27.514540] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38968 primary records. [2025-10-08T22:43:27.518686] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-08T22:43:27.521858] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-08T22:43:27.522305] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-08T22:43:27.525243] [INFO ] [MAIN ] Derivative Progress: 1529/1771 symbols completed. TOST took 1.2s. Estimated remaining: 1m 33s. Rate: 155.9 symbols/min [2025-10-08T22:43:27.543102] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-08T22:43:27.543339] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-08T22:43:27.547010] [INFO ] [MAIN ] Derivative Progress: 1530/1771 symbols completed. TPC took 1.1s. Estimated remaining: 1m 33s. Rate: 155.9 symbols/min [2025-10-08T22:43:27.547793] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:27.547873] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:27.547677] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:27.566893] [DEBUG] [LOCAL ] TPL: Loaded 12301 existing records from primary storage. [2025-10-08T22:43:27.567169] [INFO ] [MAIN ] TPL: Loaded 12301 primary data records. [2025-10-08T22:43:27.908236] [DEBUG] [LOCAL ] TPH: Loaded 44861 existing records from primary storage. [2025-10-08T22:43:27.909842] [INFO ] [MAIN ] TPH: Loaded 44861 primary data records. [2025-10-08T22:43:27.968197] [DEBUG] [LOCAL ] TPR: Loaded 53443 existing records from primary storage. [2025-10-08T22:43:27.987272] [INFO ] [MAIN ] TPR: Loaded 53443 primary data records. [2025-10-08T22:43:28.594913] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:28.596527] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12301 primary records. [2025-10-08T22:43:28.597066] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-08T22:43:28.618863] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-08T22:43:28.619148] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-08T22:43:28.621826] [INFO ] [MAIN ] Derivative Progress: 1531/1771 symbols completed. TPL took 1.1s. Estimated remaining: 1m 32s. Rate: 155.8 symbols/min [2025-10-08T22:43:28.622407] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:28.641324] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:28.643452] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53443 primary records. [2025-10-08T22:43:28.643607] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-08T22:43:28.680418] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-08T22:43:28.679545] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:28.681313] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44861 primary records. [2025-10-08T22:43:28.680619] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-08T22:43:28.683408] [INFO ] [MAIN ] Derivative Progress: 1532/1771 symbols completed. TPR took 1.1s. Estimated remaining: 1m 32s. Rate: 155.9 symbols/min [2025-10-08T22:43:28.683671] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:28.683508] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-08T22:43:28.706410] [DEBUG] [LOCAL ] TPVG: Loaded 27010 existing records from primary storage. [2025-10-08T22:43:28.709382] [INFO ] [MAIN ] TPVG: Loaded 27010 primary data records. [2025-10-08T22:43:28.751457] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-08T22:43:28.761971] [DEBUG] [LOCAL ] TPYP: Loaded 7913 existing records from primary storage. [2025-10-08T22:43:28.775311] [INFO ] [MAIN ] TPYP: Loaded 7913 primary data records. [2025-10-08T22:43:28.795624] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-08T22:43:28.830732] [INFO ] [MAIN ] Derivative Progress: 1533/1771 symbols completed. TPH took 1.3s. Estimated remaining: 1m 32s. Rate: 155.9 symbols/min [2025-10-08T22:43:28.895018] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:29.212787] [DEBUG] [LOCAL ] TPZ: Loaded 4854 existing records from primary storage. [2025-10-08T22:43:29.338463] [INFO ] [MAIN ] TPZ: Loaded 4854 primary data records. [2025-10-08T22:43:29.696195] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:29.698553] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27010 primary records. [2025-10-08T22:43:29.699682] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-08T22:43:29.728298] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:29.731269] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7913 primary records. [2025-10-08T22:43:29.731506] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-08T22:43:29.752171] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-08T22:43:29.754173] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-08T22:43:29.757153] [INFO ] [MAIN ] Derivative Progress: 1534/1771 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 31s. Rate: 155.8 symbols/min [2025-10-08T22:43:29.757375] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:29.754952] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-08T22:43:29.766229] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-08T22:43:29.774169] [INFO ] [MAIN ] Derivative Progress: 1535/1771 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 31s. Rate: 155.9 symbols/min [2025-10-08T22:43:29.774537] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:43:29.775454] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 4854 primary records. [2025-10-08T22:43:29.775577] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:29.775871] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-08T22:43:29.803072] [DEBUG] [LOCAL ] TRAK: Loaded 9567 existing records from primary storage. [2025-10-08T22:43:29.810197] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-10-08T22:43:29.811477] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-08T22:43:29.814317] [INFO ] [MAIN ] Derivative Progress: 1536/1771 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 30s. Rate: 156.0 symbols/min [2025-10-08T22:43:29.814524] [INFO ] [MAIN ] TRAK: Loaded 9567 primary data records. [2025-10-08T22:43:29.814457] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:29.815026] [DEBUG] [LOCAL ] TR: Loaded 18758 existing records from primary storage. [2025-10-08T22:43:29.826586] [INFO ] [MAIN ] TR: Loaded 18758 primary data records. [2025-10-08T22:43:30.098616] [DEBUG] [LOCAL ] TRC: Loaded 15664 existing records from primary storage. [2025-10-08T22:43:30.127804] [INFO ] [MAIN ] TRC: Loaded 15664 primary data records. [2025-10-08T22:43:30.838013] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:30.851775] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18758 primary records. [2025-10-08T22:43:30.852331] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:30.852072] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-08T22:43:30.854828] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9567 primary records. [2025-10-08T22:43:30.855030] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-08T22:43:30.886551] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-08T22:43:30.887742] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-08T22:43:30.890334] [INFO ] [MAIN ] Derivative Progress: 1537/1771 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 30s. Rate: 155.8 symbols/min [2025-10-08T22:43:30.890723] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:30.891352] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-08T22:43:30.892277] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-08T22:43:30.895141] [INFO ] [MAIN ] Derivative Progress: 1538/1771 symbols completed. TR took 1.1s. Estimated remaining: 1m 30s. Rate: 155.9 symbols/min [2025-10-08T22:43:30.895407] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:30.912995] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:30.913731] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15664 primary records. [2025-10-08T22:43:30.913871] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-08T22:43:30.931291] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-08T22:43:30.931556] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-08T22:43:30.934321] [INFO ] [MAIN ] Derivative Progress: 1539/1771 symbols completed. TRC took 1.1s. Estimated remaining: 1m 29s. Rate: 156.0 symbols/min [2025-10-08T22:43:30.934594] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:30.994072] [DEBUG] [LOCAL ] TRGP: Loaded 50804 existing records from primary storage. [2025-10-08T22:43:30.994838] [INFO ] [MAIN ] TRGP: Loaded 50804 primary data records. [2025-10-08T22:43:31.107941] [DEBUG] [LOCAL ] TRN: Loaded 36813 existing records from primary storage. [2025-10-08T22:43:31.113828] [INFO ] [MAIN ] TRN: Loaded 36813 primary data records. [2025-10-08T22:43:31.090514] [DEBUG] [LOCAL ] TREX: Loaded 49905 existing records from primary storage. [2025-10-08T22:43:31.124949] [INFO ] [MAIN ] TREX: Loaded 49905 primary data records. [2025-10-08T22:43:32.009305] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:32.010683] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50804 primary records. [2025-10-08T22:43:32.010998] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-08T22:43:32.063071] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:32.062536] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:32.063938] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-08T22:43:32.064805] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49905 primary records. [2025-10-08T22:43:32.065616] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-08T22:43:32.065518] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36813 primary records. [2025-10-08T22:43:32.066089] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-08T22:43:32.066016] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-08T22:43:32.068246] [INFO ] [MAIN ] Derivative Progress: 1540/1771 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 29s. Rate: 155.8 symbols/min [2025-10-08T22:43:32.070147] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:32.100476] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-08T22:43:32.100805] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-08T22:43:32.104067] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-08T22:43:32.104186] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-08T22:43:32.103497] [INFO ] [MAIN ] Derivative Progress: 1541/1771 symbols completed. TREX took 1.2s. Estimated remaining: 1m 29s. Rate: 155.9 symbols/min [2025-10-08T22:43:32.107029] [INFO ] [MAIN ] Derivative Progress: 1542/1771 symbols completed. TRN took 1.2s. Estimated remaining: 1m 28s. Rate: 156.0 symbols/min [2025-10-08T22:43:32.106973] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:32.107207] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:32.149764] [DEBUG] [LOCAL ] TRNO: Loaded 43954 existing records from primary storage. [2025-10-08T22:43:32.176924] [INFO ] [MAIN ] TRNO: Loaded 43954 primary data records. [2025-10-08T22:43:32.310443] [DEBUG] [LOCAL ] TRP: Loaded 52151 existing records from primary storage. [2025-10-08T22:43:32.317076] [DEBUG] [LOCAL ] TROX: Loaded 51979 existing records from primary storage. [2025-10-08T22:43:32.322467] [INFO ] [MAIN ] TRP: Loaded 52151 primary data records. [2025-10-08T22:43:32.350989] [INFO ] [MAIN ] TROX: Loaded 51979 primary data records. [2025-10-08T22:43:33.139594] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:33.140629] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43954 primary records. [2025-10-08T22:43:33.140838] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-08T22:43:33.175007] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:33.176794] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52151 primary records. [2025-10-08T22:43:33.175944] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-08T22:43:33.177672] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-08T22:43:33.177481] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-08T22:43:33.179752] [INFO ] [MAIN ] Derivative Progress: 1543/1771 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 28s. Rate: 155.8 symbols/min [2025-10-08T22:43:33.193485] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:33.201631] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51979 primary records. [2025-10-08T22:43:33.205363] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-08T22:43:33.223960] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-08T22:43:33.224263] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-08T22:43:33.226621] [INFO ] [MAIN ] Derivative Progress: 1544/1771 symbols completed. TROX took 1.1s. Estimated remaining: 1m 27s. Rate: 155.9 symbols/min [2025-10-08T22:43:33.228421] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-08T22:43:33.228488] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-08T22:43:33.230826] [INFO ] [MAIN ] Derivative Progress: 1545/1771 symbols completed. TRP took 1.1s. Estimated remaining: 1m 27s. Rate: 156.0 symbols/min [2025-10-08T22:43:33.231209] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:33.231311] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:33.231776] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:33.274086] [DEBUG] [LOCAL ] TRTX: Loaded 37485 existing records from primary storage. [2025-10-08T22:43:33.274230] [INFO ] [MAIN ] TRTX: Loaded 37485 primary data records. [2025-10-08T22:43:33.486010] [DEBUG] [LOCAL ] TRV: Loaded 47501 existing records from primary storage. [2025-10-08T22:43:33.614383] [DEBUG] [LOCAL ] TRU: Loaded 51337 existing records from primary storage. [2025-10-08T22:43:33.614667] [INFO ] [MAIN ] TRU: Loaded 51337 primary data records. [2025-10-08T22:43:33.626035] [INFO ] [MAIN ] TRV: Loaded 47501 primary data records. [2025-10-08T22:43:34.336009] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:34.337108] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37485 primary records. [2025-10-08T22:43:34.337282] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-08T22:43:34.355939] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-08T22:43:34.356164] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-08T22:43:34.358500] [INFO ] [MAIN ] Derivative Progress: 1546/1771 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 27s. Rate: 155.8 symbols/min [2025-10-08T22:43:34.358908] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:34.376318] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:34.378805] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51337 primary records. [2025-10-08T22:43:34.379151] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-08T22:43:34.404146] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:34.405383] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47501 primary records. [2025-10-08T22:43:34.405849] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-08T22:43:34.424405] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-08T22:43:34.425203] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-08T22:43:34.427714] [INFO ] [MAIN ] Derivative Progress: 1547/1771 symbols completed. TRU took 1.2s. Estimated remaining: 1m 26s. Rate: 155.9 symbols/min [2025-10-08T22:43:34.428621] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:34.430773] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-08T22:43:34.430977] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-08T22:43:34.433670] [INFO ] [MAIN ] Derivative Progress: 1548/1771 symbols completed. TRV took 1.2s. Estimated remaining: 1m 26s. Rate: 156.0 symbols/min [2025-10-08T22:43:34.434097] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:34.455451] [DEBUG] [LOCAL ] TSI: Loaded 7500 existing records from primary storage. [2025-10-08T22:43:34.455883] [INFO ] [MAIN ] TSI: Loaded 7500 primary data records. [2025-10-08T22:43:34.581396] [DEBUG] [LOCAL ] TS: Loaded 51684 existing records from primary storage. [2025-10-08T22:43:34.581695] [INFO ] [MAIN ] TS: Loaded 51684 primary data records. [2025-10-08T22:43:34.766232] [DEBUG] [LOCAL ] TSE: Loaded 27896 existing records from primary storage. [2025-10-08T22:43:34.885033] [INFO ] [MAIN ] TSE: Loaded 27896 primary data records. [2025-10-08T22:43:35.432255] [DEBUG] [MAIN ] TSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:35.433236] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 7500 primary records. [2025-10-08T22:43:35.434361] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-08T22:43:35.465173] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:35.465266] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-08T22:43:35.465476] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-08T22:43:35.467399] [INFO ] [MAIN ] Derivative Progress: 1549/1771 symbols completed. TSI took 1.0s. Estimated remaining: 1m 25s. Rate: 155.8 symbols/min [2025-10-08T22:43:35.467855] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:35.469092] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51684 primary records. [2025-10-08T22:43:35.469251] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-08T22:43:35.501069] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:35.502441] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27896 primary records. [2025-10-08T22:43:35.502574] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-08T22:43:35.504348] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-08T22:43:35.511756] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-08T22:43:35.515280] [INFO ] [MAIN ] Derivative Progress: 1550/1771 symbols completed. TS took 1.2s. Estimated remaining: 1m 25s. Rate: 155.9 symbols/min [2025-10-08T22:43:35.518224] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:35.522759] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-08T22:43:35.531934] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-08T22:43:35.534847] [INFO ] [MAIN ] Derivative Progress: 1551/1771 symbols completed. TSE took 1.1s. Estimated remaining: 1m 25s. Rate: 156.0 symbols/min [2025-10-08T22:43:35.535216] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:35.549774] [DEBUG] [LOCAL ] TSLX: Loaded 35390 existing records from primary storage. [2025-10-08T22:43:35.549918] [INFO ] [MAIN ] TSLX: Loaded 35390 primary data records. [2025-10-08T22:43:35.920397] [DEBUG] [LOCAL ] TSN: Loaded 52958 existing records from primary storage. [2025-10-08T22:43:35.921972] [INFO ] [MAIN ] TSN: Loaded 52958 primary data records. [2025-10-08T22:43:35.923153] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-08T22:43:35.959569] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-08T22:43:36.613218] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:36.614941] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35390 primary records. [2025-10-08T22:43:36.615050] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-08T22:43:36.637664] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-08T22:43:36.639124] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-08T22:43:36.641980] [INFO ] [MAIN ] Derivative Progress: 1552/1771 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 24s. Rate: 155.8 symbols/min [2025-10-08T22:43:36.642340] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:36.663080] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:36.663979] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52958 primary records. [2025-10-08T22:43:36.664233] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-08T22:43:36.688414] [DEBUG] [LOCAL ] TSQ: Loaded 11745 existing records from primary storage. [2025-10-08T22:43:36.690002] [INFO ] [MAIN ] TSQ: Loaded 11745 primary data records. [2025-10-08T22:43:36.748353] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:36.770484] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-08T22:43:36.783070] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-08T22:43:36.799298] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-08T22:43:36.809677] [INFO ] [MAIN ] Derivative Progress: 1553/1771 symbols completed. TSN took 1.3s. Estimated remaining: 1m 24s. Rate: 155.8 symbols/min [2025-10-08T22:43:36.813362] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:36.813199] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-08T22:43:37.036979] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-08T22:43:37.037172] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-08T22:43:37.039754] [INFO ] [MAIN ] Derivative Progress: 1554/1771 symbols completed. TSM took 1.5s. Estimated remaining: 1m 24s. Rate: 155.9 symbols/min [2025-10-08T22:43:37.040144] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:37.079727] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:37.080797] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11745 primary records. [2025-10-08T22:43:37.080877] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-08T22:43:37.120774] [DEBUG] [LOCAL ] TT: Loaded 47467 existing records from primary storage. [2025-10-08T22:43:37.121564] [INFO ] [MAIN ] TT: Loaded 47467 primary data records. [2025-10-08T22:43:37.158767] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-08T22:43:37.197110] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-08T22:43:37.240013] [DEBUG] [LOCAL ] TTC: Loaded 42048 existing records from primary storage. [2025-10-08T22:43:37.250363] [INFO ] [MAIN ] Derivative Progress: 1555/1771 symbols completed. TSQ took 0.6s. Estimated remaining: 1m 23s. Rate: 155.9 symbols/min [2025-10-08T22:43:37.255126] [INFO ] [MAIN ] TTC: Loaded 42048 primary data records. [2025-10-08T22:43:37.266109] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:37.840627] [DEBUG] [LOCAL ] TTE: Loaded 51598 existing records from primary storage. [2025-10-08T22:43:37.841205] [INFO ] [MAIN ] TTE: Loaded 51598 primary data records. [2025-10-08T22:43:37.853916] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:43:37.865945] [INFO ] [MAIN ] TT: Generated 1793 derivative records from 47467 primary records. [2025-10-08T22:43:37.866339] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-08T22:43:37.953408] [DEBUG] [LOCAL ] TT: Derivative data saved (1793 records). [2025-10-08T22:43:37.965164] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-08T22:43:37.974712] [INFO ] [MAIN ] Derivative Progress: 1556/1771 symbols completed. TT took 1.2s. Estimated remaining: 1m 23s. Rate: 155.8 symbols/min [2025-10-08T22:43:37.978764] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:38.248413] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:38.250058] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 42048 primary records. [2025-10-08T22:43:38.250983] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-08T22:43:38.294527] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-08T22:43:38.294867] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-08T22:43:38.298041] [INFO ] [MAIN ] Derivative Progress: 1557/1771 symbols completed. TTC took 1.3s. Estimated remaining: 1m 22s. Rate: 155.9 symbols/min [2025-10-08T22:43:38.298257] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:38.295607] [DEBUG] [LOCAL ] TTI: Loaded 45959 existing records from primary storage. [2025-10-08T22:43:38.298762] [INFO ] [MAIN ] TTI: Loaded 45959 primary data records. [2025-10-08T22:43:38.439032] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:38.466794] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51598 primary records. [2025-10-08T22:43:38.475346] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-08T22:43:38.655671] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-08T22:43:38.656689] [DEBUG] [LOCAL ] TU: Loaded 49844 existing records from primary storage. [2025-10-08T22:43:38.657457] [INFO ] [MAIN ] TU: Loaded 49844 primary data records. [2025-10-08T22:43:38.656991] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-08T22:43:38.659816] [INFO ] [MAIN ] Derivative Progress: 1558/1771 symbols completed. TTE took 1.4s. Estimated remaining: 1m 22s. Rate: 155.9 symbols/min [2025-10-08T22:43:38.971139] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:38.971866] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45959 primary records. [2025-10-08T22:43:38.972023] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-08T22:43:38.988968] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-08T22:43:38.989175] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-08T22:43:38.991736] [INFO ] [MAIN ] Derivative Progress: 1559/1771 symbols completed. TTI took 1.0s. Estimated remaining: 1m 22s. Rate: 155.9 symbols/min [2025-10-08T22:43:39.010816] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:39.011400] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49844 primary records. [2025-10-08T22:43:39.011458] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-08T22:43:39.026448] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-08T22:43:39.026509] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-08T22:43:39.028517] [INFO ] [MAIN ] Derivative Progress: 1560/1771 symbols completed. TU took 0.7s. Estimated remaining: 1m 21s. Rate: 156.0 symbols/min [2025-10-08T22:43:39.028941] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:39.029210] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:39.029087] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:39.036390] [DEBUG] [LOCAL ] TVC: Loaded 3319 existing records from primary storage. [2025-10-08T22:43:39.036593] [INFO ] [MAIN ] TVC: Loaded 3319 primary data records. [2025-10-08T22:43:39.383548] [DEBUG] [LOCAL ] TV: Loaded 42009 existing records from primary storage. [2025-10-08T22:43:39.383830] [INFO ] [MAIN ] TV: Loaded 42009 primary data records. [2025-10-08T22:43:39.396259] [DEBUG] [LOCAL ] TUYA: Loaded 45953 existing records from primary storage. [2025-10-08T22:43:39.421139] [INFO ] [MAIN ] TUYA: Loaded 45953 primary data records. [2025-10-08T22:43:39.985506] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:39.986816] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3319 primary records. [2025-10-08T22:43:39.986921] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-08T22:43:40.004810] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-10-08T22:43:40.005304] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-08T22:43:40.007738] [INFO ] [MAIN ] Derivative Progress: 1561/1771 symbols completed. TVC took 1.0s. Estimated remaining: 1m 21s. Rate: 155.8 symbols/min [2025-10-08T22:43:40.008228] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:40.015048] [DEBUG] [LOCAL ] TVE: Loaded 2772 existing records from primary storage. [2025-10-08T22:43:40.015482] [INFO ] [MAIN ] TVE: Loaded 2772 primary data records. [2025-10-08T22:43:40.120759] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:40.134442] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 42009 primary records. [2025-10-08T22:43:40.137705] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-08T22:43:40.391044] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-08T22:43:40.391814] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-08T22:43:40.394128] [INFO ] [MAIN ] Derivative Progress: 1562/1771 symbols completed. TV took 1.4s. Estimated remaining: 1m 20s. Rate: 155.8 symbols/min [2025-10-08T22:43:40.394728] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:40.410174] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:40.411338] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45953 primary records. [2025-10-08T22:43:40.411438] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-08T22:43:40.429928] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-08T22:43:40.430272] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-08T22:43:40.432393] [INFO ] [MAIN ] Derivative Progress: 1563/1771 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 20s. Rate: 155.9 symbols/min [2025-10-08T22:43:40.432829] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:40.471762] [DEBUG] [LOCAL ] TWI: Loaded 34088 existing records from primary storage. [2025-10-08T22:43:40.472505] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:40.472601] [INFO ] [MAIN ] TWI: Loaded 34088 primary data records. [2025-10-08T22:43:40.473460] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2772 primary records. [2025-10-08T22:43:40.485955] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-08T22:43:40.591313] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-08T22:43:40.597434] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-08T22:43:40.609195] [INFO ] [MAIN ] Derivative Progress: 1564/1771 symbols completed. TVE took 0.6s. Estimated remaining: 1m 20s. Rate: 156.0 symbols/min [2025-10-08T22:43:40.624903] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:40.738931] [DEBUG] [LOCAL ] TWN: Loaded 3195 existing records from primary storage. [2025-10-08T22:43:40.854935] [INFO ] [MAIN ] TWN: Loaded 3195 primary data records. [2025-10-08T22:43:40.967573] [DEBUG] [LOCAL ] TWLO: Loaded 52762 existing records from primary storage. [2025-10-08T22:43:40.986359] [INFO ] [MAIN ] TWLO: Loaded 52762 primary data records. [2025-10-08T22:43:41.521489] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:41.522913] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34088 primary records. [2025-10-08T22:43:41.523263] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-08T22:43:41.542605] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-08T22:43:41.542956] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-08T22:43:41.545091] [INFO ] [MAIN ] Derivative Progress: 1565/1771 symbols completed. TWI took 1.2s. Estimated remaining: 1m 19s. Rate: 155.8 symbols/min [2025-10-08T22:43:41.548146] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:41.562335] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:41.563155] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3195 primary records. [2025-10-08T22:43:41.563301] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-08T22:43:41.580761] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-08T22:43:41.581041] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-08T22:43:41.583346] [INFO ] [MAIN ] Derivative Progress: 1566/1771 symbols completed. TWN took 1.0s. Estimated remaining: 1m 19s. Rate: 155.9 symbols/min [2025-10-08T22:43:41.583618] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:41.600735] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:41.601635] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52762 primary records. [2025-10-08T22:43:41.601850] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-08T22:43:41.618752] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-08T22:43:41.619114] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-08T22:43:41.621340] [INFO ] [MAIN ] Derivative Progress: 1567/1771 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 18s. Rate: 156.0 symbols/min [2025-10-08T22:43:41.621609] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:41.649047] [DEBUG] [LOCAL ] TX: Loaded 23363 existing records from primary storage. [2025-10-08T22:43:41.649336] [INFO ] [MAIN ] TX: Loaded 23363 primary data records. [2025-10-08T22:43:41.780871] [DEBUG] [LOCAL ] TWO: Loaded 48554 existing records from primary storage. [2025-10-08T22:43:41.820901] [INFO ] [MAIN ] TWO: Loaded 48554 primary data records. [2025-10-08T22:43:42.055317] [DEBUG] [LOCAL ] TXNM: Loaded 43437 existing records from primary storage. [2025-10-08T22:43:42.074389] [INFO ] [MAIN ] TXNM: Loaded 43437 primary data records. [2025-10-08T22:43:42.659136] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:42.660324] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23363 primary records. [2025-10-08T22:43:42.660424] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-08T22:43:42.691901] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:42.694182] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48554 primary records. [2025-10-08T22:43:42.694360] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-08T22:43:42.695733] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-08T22:43:42.703289] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-08T22:43:42.706974] [INFO ] [MAIN ] Derivative Progress: 1568/1771 symbols completed. TX took 1.1s. Estimated remaining: 1m 18s. Rate: 155.8 symbols/min [2025-10-08T22:43:42.713816] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:42.716244] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-08T22:43:42.716734] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-08T22:43:42.719127] [INFO ] [MAIN ] Derivative Progress: 1569/1771 symbols completed. TWO took 1.2s. Estimated remaining: 1m 18s. Rate: 155.9 symbols/min [2025-10-08T22:43:42.731962] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:42.732777] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:42.733466] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 43437 primary records. [2025-10-08T22:43:42.733765] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-08T22:43:42.757191] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-08T22:43:42.761079] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-08T22:43:42.761003] [DEBUG] [LOCAL ] TY: Loaded 7605 existing records from primary storage. [2025-10-08T22:43:42.763216] [INFO ] [MAIN ] Derivative Progress: 1570/1771 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 17s. Rate: 156.0 symbols/min [2025-10-08T22:43:42.769683] [INFO ] [MAIN ] TY: Loaded 7605 primary data records. [2025-10-08T22:43:42.769846] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:42.770281] [DEBUG] [LOCAL ] TXO: Loaded 19142 existing records from primary storage. [2025-10-08T22:43:42.812730] [INFO ] [MAIN ] TXO: Loaded 19142 primary data records. [2025-10-08T22:43:42.996782] [DEBUG] [LOCAL ] TYG: Loaded 13922 existing records from primary storage. [2025-10-08T22:43:43.030236] [INFO ] [MAIN ] TYG: Loaded 13922 primary data records. [2025-10-08T22:43:43.715176] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:43.727711] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:43.728765] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7605 primary records. [2025-10-08T22:43:43.728951] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-08T22:43:43.729529] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 19142 primary records. [2025-10-08T22:43:43.730238] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-08T22:43:43.770821] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:43.772316] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13922 primary records. [2025-10-08T22:43:43.772675] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-08T22:43:43.788105] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-08T22:43:43.788216] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-08T22:43:43.788303] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-08T22:43:43.791633] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-08T22:43:43.794218] [INFO ] [MAIN ] Derivative Progress: 1571/1771 symbols completed. TY took 1.1s. Estimated remaining: 1m 17s. Rate: 155.8 symbols/min [2025-10-08T22:43:43.800721] [INFO ] [MAIN ] Derivative Progress: 1572/1771 symbols completed. TXO took 1.1s. Estimated remaining: 1m 17s. Rate: 155.9 symbols/min [2025-10-08T22:43:43.800579] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:43.800824] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-08T22:43:43.801120] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-08T22:43:43.800966] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:43.803322] [INFO ] [MAIN ] Derivative Progress: 1573/1771 symbols completed. TYG took 1.0s. Estimated remaining: 1m 16s. Rate: 156.0 symbols/min [2025-10-08T22:43:43.829115] [DEBUG] [LOCAL ] TYL: Loaded 22342 existing records from primary storage. [2025-10-08T22:43:43.829352] [INFO ] [MAIN ] TYL: Loaded 22342 primary data records. [2025-10-08T22:43:44.179282] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-08T22:43:44.192532] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-08T22:43:44.508595] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:44.509524] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22342 primary records. [2025-10-08T22:43:44.509813] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-08T22:43:44.526045] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-08T22:43:44.526111] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-08T22:43:44.528240] [INFO ] [MAIN ] Derivative Progress: 1574/1771 symbols completed. TYL took 0.7s. Estimated remaining: 1m 16s. Rate: 155.9 symbols/min [2025-10-08T22:43:44.542723] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:44.543247] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-08T22:43:44.543306] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-08T22:43:44.558751] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-08T22:43:44.558812] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-08T22:43:44.560741] [INFO ] [MAIN ] Derivative Progress: 1575/1771 symbols completed. U took 0.8s. Estimated remaining: 1m 15s. Rate: 156.0 symbols/min [2025-10-08T22:43:44.561148] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:44.561231] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:44.561421] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:44.570593] [DEBUG] [LOCAL ] UAN: Loaded 5432 existing records from primary storage. [2025-10-08T22:43:44.570750] [INFO ] [MAIN ] UAN: Loaded 5432 primary data records. [2025-10-08T22:43:44.904017] [DEBUG] [LOCAL ] UA: Loaded 50445 existing records from primary storage. [2025-10-08T22:43:44.904325] [INFO ] [MAIN ] UA: Loaded 50445 primary data records. [2025-10-08T22:43:44.974904] [DEBUG] [LOCAL ] UAA: Loaded 53508 existing records from primary storage. [2025-10-08T22:43:44.995419] [INFO ] [MAIN ] UAA: Loaded 53508 primary data records. [2025-10-08T22:43:45.535073] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:45.536834] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5432 primary records. [2025-10-08T22:43:45.537588] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-08T22:43:45.557787] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-08T22:43:45.559529] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-08T22:43:45.562305] [INFO ] [MAIN ] Derivative Progress: 1576/1771 symbols completed. UAN took 1.0s. Estimated remaining: 1m 15s. Rate: 155.9 symbols/min [2025-10-08T22:43:45.562606] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:45.576927] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:45.577937] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50445 primary records. [2025-10-08T22:43:45.578095] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-08T22:43:45.608742] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:45.610421] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53508 primary records. [2025-10-08T22:43:45.610610] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-08T22:43:45.610682] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-08T22:43:45.610833] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-08T22:43:45.612844] [INFO ] [MAIN ] Derivative Progress: 1577/1771 symbols completed. UA took 1.1s. Estimated remaining: 1m 15s. Rate: 156.0 symbols/min [2025-10-08T22:43:45.613093] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:45.631623] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-08T22:43:45.631943] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-08T22:43:45.634611] [INFO ] [MAIN ] Derivative Progress: 1578/1771 symbols completed. UAA took 1.1s. Estimated remaining: 1m 14s. Rate: 156.0 symbols/min [2025-10-08T22:43:45.648014] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:45.675752] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-08T22:43:45.676118] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-08T22:43:45.874903] [DEBUG] [LOCAL ] UBS: Loaded 52336 existing records from primary storage. [2025-10-08T22:43:45.907170] [INFO ] [MAIN ] UBS: Loaded 52336 primary data records. [2025-10-08T22:43:46.093757] [DEBUG] [LOCAL ] UCB: Loaded 37776 existing records from primary storage. [2025-10-08T22:43:46.112788] [INFO ] [MAIN ] UCB: Loaded 37776 primary data records. [2025-10-08T22:43:46.666396] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:46.667419] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-08T22:43:46.667713] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-08T22:43:46.685734] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-08T22:43:46.687343] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-08T22:43:46.689730] [INFO ] [MAIN ] Derivative Progress: 1579/1771 symbols completed. UBER took 1.1s. Estimated remaining: 1m 14s. Rate: 155.9 symbols/min [2025-10-08T22:43:46.690128] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:46.703992] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:46.704807] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52336 primary records. [2025-10-08T22:43:46.704993] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-08T22:43:46.722984] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-08T22:43:46.724998] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-08T22:43:46.727215] [INFO ] [MAIN ] Derivative Progress: 1580/1771 symbols completed. UBS took 1.1s. Estimated remaining: 1m 13s. Rate: 156.0 symbols/min [2025-10-08T22:43:46.727519] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:46.741204] [DEBUG] [MAIN ] UCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:46.741938] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37776 primary records. [2025-10-08T22:43:46.742003] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-08T22:43:46.773260] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-08T22:43:46.773528] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-08T22:43:46.776753] [INFO ] [MAIN ] Derivative Progress: 1581/1771 symbols completed. UCB took 1.1s. Estimated remaining: 1m 13s. Rate: 156.1 symbols/min [2025-10-08T22:43:46.777102] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:46.807553] [DEBUG] [LOCAL ] UDR: Loaded 51890 existing records from primary storage. [2025-10-08T22:43:46.807818] [INFO ] [MAIN ] UDR: Loaded 51890 primary data records. [2025-10-08T22:43:46.867821] [DEBUG] [LOCAL ] UFI: Loaded 8134 existing records from primary storage. [2025-10-08T22:43:46.907938] [DEBUG] [LOCAL ] UE: Loaded 42577 existing records from primary storage. [2025-10-08T22:43:46.908097] [INFO ] [MAIN ] UE: Loaded 42577 primary data records. [2025-10-08T22:43:46.895688] [INFO ] [MAIN ] UFI: Loaded 8134 primary data records. [2025-10-08T22:43:47.751048] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:47.752197] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8134 primary records. [2025-10-08T22:43:47.759788] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-08T22:43:47.772161] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:47.776775] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51890 primary records. [2025-10-08T22:43:47.776880] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-08T22:43:47.794590] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-08T22:43:47.795381] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-08T22:43:47.802007] [INFO ] [MAIN ] Derivative Progress: 1582/1771 symbols completed. UFI took 1.0s. Estimated remaining: 1m 13s. Rate: 155.9 symbols/min [2025-10-08T22:43:47.802223] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:47.804323] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-08T22:43:47.804590] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-08T22:43:47.806913] [INFO ] [MAIN ] Derivative Progress: 1583/1771 symbols completed. UDR took 1.1s. Estimated remaining: 1m 12s. Rate: 156.0 symbols/min [2025-10-08T22:43:47.807285] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:47.820694] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:47.821635] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42577 primary records. [2025-10-08T22:43:47.821764] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-08T22:43:47.837798] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-08T22:43:47.838014] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-08T22:43:47.843443] [INFO ] [MAIN ] Derivative Progress: 1584/1771 symbols completed. UE took 1.1s. Estimated remaining: 1m 12s. Rate: 156.1 symbols/min [2025-10-08T22:43:47.843607] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:47.879026] [DEBUG] [LOCAL ] UHAL: Loaded 16732 existing records from primary storage. [2025-10-08T22:43:47.879169] [INFO ] [MAIN ] UHAL: Loaded 16732 primary data records. [2025-10-08T22:43:48.009233] [DEBUG] [LOCAL ] UGP: Loaded 42933 existing records from primary storage. [2025-10-08T22:43:48.028199] [INFO ] [MAIN ] UGP: Loaded 42933 primary data records. [2025-10-08T22:43:48.044507] [DEBUG] [LOCAL ] UGI: Loaded 50564 existing records from primary storage. [2025-10-08T22:43:48.136926] [INFO ] [MAIN ] UGI: Loaded 50564 primary data records. [2025-10-08T22:43:49.167336] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:49.168399] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16732 primary records. [2025-10-08T22:43:49.168672] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-08T22:43:49.189980] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-08T22:43:49.190760] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-08T22:43:49.194623] [INFO ] [MAIN ] Derivative Progress: 1585/1771 symbols completed. UHAL took 1.4s. Estimated remaining: 1m 12s. Rate: 155.8 symbols/min [2025-10-08T22:43:49.196266] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:49.243698] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:49.244990] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50564 primary records. [2025-10-08T22:43:49.244020] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:49.245235] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-08T22:43:49.245910] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42933 primary records. [2025-10-08T22:43:49.256931] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-08T22:43:49.293284] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-08T22:43:49.294585] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-08T22:43:49.297458] [INFO ] [MAIN ] Derivative Progress: 1586/1771 symbols completed. UGI took 1.5s. Estimated remaining: 1m 11s. Rate: 155.9 symbols/min [2025-10-08T22:43:49.297971] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-08T22:43:49.298094] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:49.310047] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-08T22:43:49.312373] [INFO ] [MAIN ] Derivative Progress: 1587/1771 symbols completed. UGP took 1.5s. Estimated remaining: 1m 11s. Rate: 156.0 symbols/min [2025-10-08T22:43:49.312993] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:49.314351] [DEBUG] [LOCAL ] UHS: Loaded 40581 existing records from primary storage. [2025-10-08T22:43:49.314428] [INFO ] [MAIN ] UHS: Loaded 40581 primary data records. [2025-10-08T22:43:49.440066] [DEBUG] [LOCAL ] UHT: Loaded 10003 existing records from primary storage. [2025-10-08T22:43:49.445888] [INFO ] [MAIN ] UHT: Loaded 10003 primary data records. [2025-10-08T22:43:49.477317] [DEBUG] [LOCAL ] UI: Loaded 13339 existing records from primary storage. [2025-10-08T22:43:49.580864] [INFO ] [MAIN ] UI: Loaded 13339 primary data records. [2025-10-08T22:43:50.392472] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:50.393880] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 40581 primary records. [2025-10-08T22:43:50.394661] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-08T22:43:50.422543] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-08T22:43:50.427676] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-08T22:43:50.430092] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:50.429700] [INFO ] [MAIN ] Derivative Progress: 1588/1771 symbols completed. UHS took 1.2s. Estimated remaining: 1m 10s. Rate: 155.8 symbols/min [2025-10-08T22:43:50.431811] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10003 primary records. [2025-10-08T22:43:50.432118] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-08T22:43:50.463342] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:50.464961] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 13339 primary records. [2025-10-08T22:43:50.465516] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-08T22:43:50.465421] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-08T22:43:50.466046] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-08T22:43:50.468819] [INFO ] [MAIN ] Derivative Progress: 1589/1771 symbols completed. UHT took 1.2s. Estimated remaining: 1m 10s. Rate: 155.9 symbols/min [2025-10-08T22:43:50.484698] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-08T22:43:50.484859] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-08T22:43:50.487340] [INFO ] [MAIN ] Derivative Progress: 1590/1771 symbols completed. UI took 1.2s. Estimated remaining: 1m 10s. Rate: 156.0 symbols/min [2025-10-08T22:43:50.487976] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:50.487910] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:50.487858] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:50.566542] [DEBUG] [LOCAL ] UIS: Loaded 36941 existing records from primary storage. [2025-10-08T22:43:50.568409] [INFO ] [MAIN ] UIS: Loaded 36941 primary data records. [2025-10-08T22:43:50.590451] [DEBUG] [LOCAL ] ULS: Loaded 39447 existing records from primary storage. [2025-10-08T22:43:50.614119] [INFO ] [MAIN ] ULS: Loaded 39447 primary data records. [2025-10-08T22:43:50.795483] [DEBUG] [LOCAL ] UL: Loaded 53068 existing records from primary storage. [2025-10-08T22:43:50.825351] [INFO ] [MAIN ] UL: Loaded 53068 primary data records. [2025-10-08T22:43:51.627165] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:51.626885] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:51.628531] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36941 primary records. [2025-10-08T22:43:51.629195] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39447 primary records. [2025-10-08T22:43:51.629294] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-08T22:43:51.629510] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-08T22:43:51.676828] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-08T22:43:51.675322] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:51.677869] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53068 primary records. [2025-10-08T22:43:51.679510] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-08T22:43:51.678424] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-08T22:43:51.679712] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-08T22:43:51.681728] [INFO ] [MAIN ] Derivative Progress: 1591/1771 symbols completed. UIS took 1.2s. Estimated remaining: 1m 9s. Rate: 155.8 symbols/min [2025-10-08T22:43:51.682090] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-08T22:43:51.681917] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:51.684825] [INFO ] [MAIN ] Derivative Progress: 1592/1771 symbols completed. ULS took 1.2s. Estimated remaining: 1m 9s. Rate: 155.9 symbols/min [2025-10-08T22:43:51.685031] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:51.704119] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-08T22:43:51.704317] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-08T22:43:51.707420] [INFO ] [MAIN ] Derivative Progress: 1593/1771 symbols completed. UL took 1.2s. Estimated remaining: 1m 8s. Rate: 156.0 symbols/min [2025-10-08T22:43:51.707802] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:51.733538] [DEBUG] [LOCAL ] UNF: Loaded 12125 existing records from primary storage. [2025-10-08T22:43:51.746348] [INFO ] [MAIN ] UNF: Loaded 12125 primary data records. [2025-10-08T22:43:51.885534] [DEBUG] [LOCAL ] UMH: Loaded 33843 existing records from primary storage. [2025-10-08T22:43:51.885885] [INFO ] [MAIN ] UMH: Loaded 33843 primary data records. [2025-10-08T22:43:51.892403] [DEBUG] [LOCAL ] UMC: Loaded 52718 existing records from primary storage. [2025-10-08T22:43:51.908326] [INFO ] [MAIN ] UMC: Loaded 52718 primary data records. [2025-10-08T22:43:52.808374] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:52.811002] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 12125 primary records. [2025-10-08T22:43:52.811136] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-08T22:43:52.829476] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-08T22:43:52.829931] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-08T22:43:52.831785] [INFO ] [MAIN ] Derivative Progress: 1594/1771 symbols completed. UNF took 1.1s. Estimated remaining: 1m 8s. Rate: 155.8 symbols/min [2025-10-08T22:43:52.832031] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:52.865716] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:52.865964] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:52.867000] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52718 primary records. [2025-10-08T22:43:52.867802] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 33843 primary records. [2025-10-08T22:43:52.868131] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-08T22:43:52.868060] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-08T22:43:52.901734] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-08T22:43:52.902819] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-08T22:43:52.913832] [INFO ] [MAIN ] Derivative Progress: 1595/1771 symbols completed. UMC took 1.2s. Estimated remaining: 1m 8s. Rate: 155.9 symbols/min [2025-10-08T22:43:52.914501] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-08T22:43:52.914746] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-08T22:43:52.914902] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:52.917762] [INFO ] [MAIN ] Derivative Progress: 1596/1771 symbols completed. UMH took 1.2s. Estimated remaining: 1m 7s. Rate: 156.0 symbols/min [2025-10-08T22:43:52.918098] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:52.937136] [DEBUG] [LOCAL ] UNFI: Loaded 42346 existing records from primary storage. [2025-10-08T22:43:52.937348] [INFO ] [MAIN ] UNFI: Loaded 42346 primary data records. [2025-10-08T22:43:53.301792] [DEBUG] [LOCAL ] UNM: Loaded 48187 existing records from primary storage. [2025-10-08T22:43:53.302429] [INFO ] [MAIN ] UNM: Loaded 48187 primary data records. [2025-10-08T22:43:53.357094] [DEBUG] [LOCAL ] UNH: Loaded 53803 existing records from primary storage. [2025-10-08T22:43:53.379785] [INFO ] [MAIN ] UNH: Loaded 53803 primary data records. [2025-10-08T22:43:53.848954] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:53.868857] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42346 primary records. [2025-10-08T22:43:53.886574] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-08T22:43:54.027920] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-08T22:43:54.028522] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-08T22:43:54.031383] [INFO ] [MAIN ] Derivative Progress: 1597/1771 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 7s. Rate: 155.8 symbols/min [2025-10-08T22:43:54.031795] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:54.039903] [DEBUG] [LOCAL ] UNMA: Loaded 3550 existing records from primary storage. [2025-10-08T22:43:54.041115] [INFO ] [MAIN ] UNMA: Loaded 3550 primary data records. [2025-10-08T22:43:54.165614] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:54.183363] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48187 primary records. [2025-10-08T22:43:54.195221] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-08T22:43:54.390969] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:54.408284] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53803 primary records. [2025-10-08T22:43:54.410926] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-08T22:43:54.414769] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-08T22:43:54.426592] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-08T22:43:54.430625] [INFO ] [MAIN ] Derivative Progress: 1598/1771 symbols completed. UNM took 1.5s. Estimated remaining: 1m 7s. Rate: 155.8 symbols/min [2025-10-08T22:43:54.431255] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:54.436330] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-08T22:43:54.436781] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-08T22:43:54.439228] [INFO ] [MAIN ] Derivative Progress: 1599/1771 symbols completed. UNH took 1.5s. Estimated remaining: 1m 6s. Rate: 155.9 symbols/min [2025-10-08T22:43:54.440244] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:54.461982] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-08T22:43:54.462717] [INFO ] [MAIN ] UNMA: Generated 1792 derivative records from 3550 primary records. [2025-10-08T22:43:54.462845] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-08T22:43:54.479884] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1792 records). [2025-10-08T22:43:54.480074] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-08T22:43:54.482432] [INFO ] [MAIN ] Derivative Progress: 1600/1771 symbols completed. UNMA took 0.5s. Estimated remaining: 1m 6s. Rate: 155.9 symbols/min [2025-10-08T22:43:54.492810] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:54.524105] [DEBUG] [LOCAL ] UP: Loaded 43707 existing records from primary storage. [2025-10-08T22:43:54.524391] [INFO ] [MAIN ] UP: Loaded 43707 primary data records. [2025-10-08T22:43:54.637876] [DEBUG] [LOCAL ] UNP: Loaded 53309 existing records from primary storage. [2025-10-08T22:43:54.658805] [INFO ] [MAIN ] UNP: Loaded 53309 primary data records. [2025-10-08T22:43:55.039998] [DEBUG] [LOCAL ] UPS: Loaded 53717 existing records from primary storage. [2025-10-08T22:43:55.055668] [INFO ] [MAIN ] UPS: Loaded 53717 primary data records. [2025-10-08T22:43:55.594618] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:55.596198] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 43707 primary records. [2025-10-08T22:43:55.596591] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-08T22:43:55.626092] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:55.628266] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53309 primary records. [2025-10-08T22:43:55.628455] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-08T22:43:55.642319] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-08T22:43:55.642570] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-08T22:43:55.649354] [INFO ] [MAIN ] Derivative Progress: 1601/1771 symbols completed. UP took 1.2s. Estimated remaining: 1m 5s. Rate: 155.8 symbols/min [2025-10-08T22:43:55.651424] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:55.654236] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-08T22:43:55.654508] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-08T22:43:55.670091] [INFO ] [MAIN ] Derivative Progress: 1602/1771 symbols completed. UNP took 1.2s. Estimated remaining: 1m 5s. Rate: 155.8 symbols/min [2025-10-08T22:43:55.667917] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:55.670368] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:55.671478] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53717 primary records. [2025-10-08T22:43:55.671698] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-08T22:43:55.689503] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-08T22:43:55.689720] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-08T22:43:55.692963] [INFO ] [MAIN ] Derivative Progress: 1603/1771 symbols completed. UPS took 1.2s. Estimated remaining: 1m 5s. Rate: 155.9 symbols/min [2025-10-08T22:43:55.740605] [DEBUG] [LOCAL ] USA: Loaded 36029 existing records from primary storage. [2025-10-08T22:43:55.740811] [INFO ] [MAIN ] USA: Loaded 36029 primary data records. [2025-10-08T22:43:55.746557] [DEBUG] [LOCAL ] URI: Loaded 35216 existing records from primary storage. [2025-10-08T22:43:55.806816] [INFO ] [MAIN ] URI: Loaded 35216 primary data records. [2025-10-08T22:43:56.377184] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:56.378408] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36029 primary records. [2025-10-08T22:43:56.379344] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-08T22:43:56.406836] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:56.409779] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 35216 primary records. [2025-10-08T22:43:56.411187] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-08T22:43:56.412254] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-08T22:43:56.413027] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-08T22:43:56.415233] [INFO ] [MAIN ] Derivative Progress: 1604/1771 symbols completed. USA took 0.7s. Estimated remaining: 1m 4s. Rate: 155.8 symbols/min [2025-10-08T22:43:56.430458] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-08T22:43:56.430580] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-08T22:43:56.432803] [INFO ] [MAIN ] Derivative Progress: 1605/1771 symbols completed. URI took 0.8s. Estimated remaining: 1m 4s. Rate: 155.9 symbols/min [2025-10-08T22:43:56.433347] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:56.433450] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:56.433562] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:56.461899] [DEBUG] [LOCAL ] USAC: Loaded 21606 existing records from primary storage. [2025-10-08T22:43:56.462087] [INFO ] [MAIN ] USAC: Loaded 21606 primary data records. [2025-10-08T22:43:56.688183] [DEBUG] [LOCAL ] USFD: Loaded 51161 existing records from primary storage. [2025-10-08T22:43:56.693305] [INFO ] [MAIN ] USFD: Loaded 51161 primary data records. [2025-10-08T22:43:56.917316] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-08T22:43:56.944044] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-08T22:43:57.516242] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:57.518443] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21606 primary records. [2025-10-08T22:43:57.518702] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-08T22:43:57.559988] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:57.561439] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51161 primary records. [2025-10-08T22:43:57.561611] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-08T22:43:57.564533] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-08T22:43:57.564708] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-08T22:43:57.575870] [INFO ] [MAIN ] Derivative Progress: 1606/1771 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 155.8 symbols/min [2025-10-08T22:43:57.580702] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:57.585077] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-08T22:43:57.585279] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-08T22:43:57.588019] [INFO ] [MAIN ] Derivative Progress: 1607/1771 symbols completed. USFD took 1.2s. Estimated remaining: 1m 3s. Rate: 155.8 symbols/min [2025-10-08T22:43:57.600791] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:57.601833] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:57.603109] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-08T22:43:57.603309] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-08T22:43:57.625961] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-08T22:43:57.629851] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-08T22:43:57.632064] [INFO ] [MAIN ] Derivative Progress: 1608/1771 symbols completed. USB took 1.2s. Estimated remaining: 1m 3s. Rate: 155.9 symbols/min [2025-10-08T22:43:57.632389] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:57.647765] [DEBUG] [LOCAL ] USNA: Loaded 17668 existing records from primary storage. [2025-10-08T22:43:57.648349] [DEBUG] [LOCAL ] USPH: Loaded 17025 existing records from primary storage. [2025-10-08T22:43:57.648453] [INFO ] [MAIN ] USPH: Loaded 17025 primary data records. [2025-10-08T22:43:57.660150] [INFO ] [MAIN ] USNA: Loaded 17668 primary data records. [2025-10-08T22:43:57.938864] [DEBUG] [LOCAL ] UTF: Loaded 30148 existing records from primary storage. [2025-10-08T22:43:57.949781] [INFO ] [MAIN ] UTF: Loaded 30148 primary data records. [2025-10-08T22:43:58.679274] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:58.681433] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17025 primary records. [2025-10-08T22:43:58.682120] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-08T22:43:58.714558] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:58.716325] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17668 primary records. [2025-10-08T22:43:58.716665] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-08T22:43:58.717676] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-08T22:43:58.718542] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-08T22:43:58.720705] [INFO ] [MAIN ] Derivative Progress: 1609/1771 symbols completed. USPH took 1.1s. Estimated remaining: 1m 2s. Rate: 155.8 symbols/min [2025-10-08T22:43:58.731771] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:58.737234] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-08T22:43:58.737461] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-08T22:43:58.740047] [INFO ] [MAIN ] Derivative Progress: 1610/1771 symbols completed. USNA took 1.2s. Estimated remaining: 1m 2s. Rate: 155.8 symbols/min [2025-10-08T22:43:58.740206] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:58.757116] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:58.757976] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 30148 primary records. [2025-10-08T22:43:58.758212] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-08T22:43:58.786797] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-08T22:43:58.792389] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-08T22:43:58.794750] [INFO ] [MAIN ] Derivative Progress: 1611/1771 symbols completed. UTF took 1.2s. Estimated remaining: 1m 2s. Rate: 155.9 symbols/min [2025-10-08T22:43:58.795932] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:58.795804] [DEBUG] [LOCAL ] UTL: Loaded 11598 existing records from primary storage. [2025-10-08T22:43:58.796195] [INFO ] [MAIN ] UTL: Loaded 11598 primary data records. [2025-10-08T22:43:58.903797] [DEBUG] [LOCAL ] UTI: Loaded 40585 existing records from primary storage. [2025-10-08T22:43:58.911809] [INFO ] [MAIN ] UTI: Loaded 40585 primary data records. [2025-10-08T22:43:59.237413] [DEBUG] [LOCAL ] UTZ: Loaded 44598 existing records from primary storage. [2025-10-08T22:43:59.238016] [INFO ] [MAIN ] UTZ: Loaded 44598 primary data records. [2025-10-08T22:43:59.783349] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:59.785216] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11598 primary records. [2025-10-08T22:43:59.786087] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-08T22:43:59.806573] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-08T22:43:59.814963] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-08T22:43:59.821941] [INFO ] [MAIN ] Derivative Progress: 1612/1771 symbols completed. UTL took 1.1s. Estimated remaining: 1m 1s. Rate: 155.8 symbols/min [2025-10-08T22:43:59.822269] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:59.823521] [DEBUG] [MAIN ] UTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:59.824340] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40585 primary records. [2025-10-08T22:43:59.824492] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-08T22:43:59.857448] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-08T22:43:59.858073] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-08T22:43:59.858012] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:43:59.860396] [INFO ] [MAIN ] Derivative Progress: 1613/1771 symbols completed. UTI took 1.1s. Estimated remaining: 1m 1s. Rate: 155.9 symbols/min [2025-10-08T22:43:59.861198] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44598 primary records. [2025-10-08T22:43:59.861467] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-08T22:43:59.862188] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:43:59.893597] [DEBUG] [LOCAL ] UVV: Loaded 22680 existing records from primary storage. [2025-10-08T22:43:59.894782] [INFO ] [MAIN ] UVV: Loaded 22680 primary data records. [2025-10-08T22:43:59.908575] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-08T22:43:59.918776] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-08T22:43:59.933043] [INFO ] [MAIN ] Derivative Progress: 1614/1771 symbols completed. UTZ took 1.1s. Estimated remaining: 1m 0s. Rate: 155.9 symbols/min [2025-10-08T22:43:59.959085] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:00.098124] [DEBUG] [LOCAL ] UZD: Loaded 6412 existing records from primary storage. [2025-10-08T22:44:00.121034] [INFO ] [MAIN ] UZD: Loaded 6412 primary data records. [2025-10-08T22:44:00.351171] [DEBUG] [LOCAL ] UWMC: Loaded 52853 existing records from primary storage. [2025-10-08T22:44:00.357729] [INFO ] [MAIN ] UWMC: Loaded 52853 primary data records. [2025-10-08T22:44:00.970544] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:00.972317] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22680 primary records. [2025-10-08T22:44:00.972692] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-08T22:44:01.006597] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:01.007838] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6412 primary records. [2025-10-08T22:44:01.008547] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-08T22:44:01.009212] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-08T22:44:01.009587] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-08T22:44:01.012337] [INFO ] [MAIN ] Derivative Progress: 1615/1771 symbols completed. UVV took 1.2s. Estimated remaining: 1m 0s. Rate: 155.8 symbols/min [2025-10-08T22:44:01.027808] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-08T22:44:01.025436] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:01.030108] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-08T22:44:01.032560] [INFO ] [MAIN ] Derivative Progress: 1616/1771 symbols completed. UZD took 1.1s. Estimated remaining: 59.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:01.032889] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:01.047867] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:01.048753] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52853 primary records. [2025-10-08T22:44:01.050862] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-08T22:44:01.057787] [DEBUG] [LOCAL ] UZF: Loaded 6338 existing records from primary storage. [2025-10-08T22:44:01.073318] [INFO ] [MAIN ] UZF: Loaded 6338 primary data records. [2025-10-08T22:44:01.072936] [DEBUG] [LOCAL ] UZE: Loaded 7448 existing records from primary storage. [2025-10-08T22:44:01.094412] [INFO ] [MAIN ] UZE: Loaded 7448 primary data records. [2025-10-08T22:44:01.318840] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-08T22:44:01.360781] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-08T22:44:01.436224] [INFO ] [MAIN ] Derivative Progress: 1617/1771 symbols completed. UWMC took 1.6s. Estimated remaining: 59.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:01.462756] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:01.783413] [DEBUG] [MAIN ] UZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:01.797193] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6338 primary records. [2025-10-08T22:44:01.799234] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-10-08T22:44:01.798996] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:01.816351] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7448 primary records. [2025-10-08T22:44:01.816498] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-08T22:44:01.818582] [DEBUG] [LOCAL ] V: Loaded 53752 existing records from primary storage. [2025-10-08T22:44:01.819130] [INFO ] [MAIN ] V: Loaded 53752 primary data records. [2025-10-08T22:44:01.866624] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-08T22:44:01.882673] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-08T22:44:01.890067] [INFO ] [MAIN ] Derivative Progress: 1618/1771 symbols completed. UZE took 0.9s. Estimated remaining: 58.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:01.913307] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-10-08T22:44:01.932963] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-10-08T22:44:01.946045] [INFO ] [MAIN ] Derivative Progress: 1619/1771 symbols completed. UZF took 0.9s. Estimated remaining: 58.5s. Rate: 155.9 symbols/min [2025-10-08T22:44:02.211209] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:02.211867] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53752 primary records. [2025-10-08T22:44:02.211930] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-08T22:44:02.228138] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-08T22:44:02.228199] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-08T22:44:02.230204] [INFO ] [MAIN ] Derivative Progress: 1620/1771 symbols completed. V took 0.8s. Estimated remaining: 58.1s. Rate: 155.9 symbols/min [2025-10-08T22:44:02.231196] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:02.231381] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:02.231068] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:02.304343] [DEBUG] [LOCAL ] VAC: Loaded 34252 existing records from primary storage. [2025-10-08T22:44:02.305888] [INFO ] [MAIN ] VAC: Loaded 34252 primary data records. [2025-10-08T22:44:02.371765] [DEBUG] [LOCAL ] VAL: Loaded 50235 existing records from primary storage. [2025-10-08T22:44:02.384682] [INFO ] [MAIN ] VAL: Loaded 50235 primary data records. [2025-10-08T22:44:02.393798] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-08T22:44:02.445937] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-08T22:44:03.329022] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:03.331769] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34252 primary records. [2025-10-08T22:44:03.332513] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-08T22:44:03.361288] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:03.363705] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50235 primary records. [2025-10-08T22:44:03.364706] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-08T22:44:03.362666] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-08T22:44:03.364850] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-08T22:44:03.368545] [INFO ] [MAIN ] Derivative Progress: 1621/1771 symbols completed. VAC took 1.1s. Estimated remaining: 57.8s. Rate: 155.7 symbols/min [2025-10-08T22:44:03.369405] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:03.394923] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:03.396272] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-08T22:44:03.399863] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-08T22:44:03.401262] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-08T22:44:03.402435] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-08T22:44:03.416504] [DEBUG] [LOCAL ] VATE: Loaded 5259 existing records from primary storage. [2025-10-08T22:44:03.416300] [INFO ] [MAIN ] Derivative Progress: 1622/1771 symbols completed. VAL took 1.2s. Estimated remaining: 57.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:03.420474] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:03.419818] [INFO ] [MAIN ] VATE: Loaded 5259 primary data records. [2025-10-08T22:44:03.534844] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-08T22:44:03.523111] [DEBUG] [LOCAL ] VBF: Loaded 6925 existing records from primary storage. [2025-10-08T22:44:03.535260] [INFO ] [MAIN ] VBF: Loaded 6925 primary data records. [2025-10-08T22:44:03.535738] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-08T22:44:03.538067] [INFO ] [MAIN ] Derivative Progress: 1623/1771 symbols completed. VALE took 1.3s. Estimated remaining: 57.0s. Rate: 155.9 symbols/min [2025-10-08T22:44:03.571523] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:03.920125] [DEBUG] [LOCAL ] VCV: Loaded 13580 existing records from primary storage. [2025-10-08T22:44:03.955904] [INFO ] [MAIN ] VCV: Loaded 13580 primary data records. [2025-10-08T22:44:04.440841] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:04.442303] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5259 primary records. [2025-10-08T22:44:04.442535] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-08T22:44:04.468059] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:04.469470] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 6925 primary records. [2025-10-08T22:44:04.470306] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-08T22:44:04.486677] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-08T22:44:04.487865] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-08T22:44:04.490110] [INFO ] [MAIN ] Derivative Progress: 1624/1771 symbols completed. VATE took 1.1s. Estimated remaining: 56.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:04.490869] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:04.494447] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-08T22:44:04.494993] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-08T22:44:04.497232] [INFO ] [MAIN ] Derivative Progress: 1625/1771 symbols completed. VBF took 1.1s. Estimated remaining: 56.2s. Rate: 155.8 symbols/min [2025-10-08T22:44:04.497431] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:04.519457] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:04.520202] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13580 primary records. [2025-10-08T22:44:04.520364] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-08T22:44:04.534684] [DEBUG] [LOCAL ] VEL: Loaded 12445 existing records from primary storage. [2025-10-08T22:44:04.539046] [INFO ] [MAIN ] VEL: Loaded 12445 primary data records. [2025-10-08T22:44:04.575221] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-08T22:44:04.614733] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-08T22:44:04.662748] [INFO ] [MAIN ] Derivative Progress: 1626/1771 symbols completed. VCV took 1.1s. Estimated remaining: 55.8s. Rate: 155.9 symbols/min [2025-10-08T22:44:04.663625] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:04.921705] [DEBUG] [LOCAL ] VEEV: Loaded 47169 existing records from primary storage. [2025-10-08T22:44:04.931210] [INFO ] [MAIN ] VEEV: Loaded 47169 primary data records. [2025-10-08T22:44:05.273241] [DEBUG] [LOCAL ] VET: Loaded 44003 existing records from primary storage. [2025-10-08T22:44:05.274191] [INFO ] [MAIN ] VET: Loaded 44003 primary data records. [2025-10-08T22:44:05.444357] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:05.445767] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 12445 primary records. [2025-10-08T22:44:05.493631] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-08T22:44:05.652870] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:05.654201] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47169 primary records. [2025-10-08T22:44:05.655183] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-08T22:44:05.656120] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-08T22:44:05.656335] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-08T22:44:05.659340] [INFO ] [MAIN ] Derivative Progress: 1627/1771 symbols completed. VEL took 1.2s. Estimated remaining: 55.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:05.659817] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:05.679852] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-08T22:44:05.680015] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-08T22:44:05.682270] [INFO ] [MAIN ] Derivative Progress: 1628/1771 symbols completed. VEEV took 1.2s. Estimated remaining: 55.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:05.682919] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:05.704475] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:05.708616] [DEBUG] [LOCAL ] VGI: Loaded 5188 existing records from primary storage. [2025-10-08T22:44:05.708436] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44003 primary records. [2025-10-08T22:44:05.708764] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-08T22:44:05.709442] [INFO ] [MAIN ] VGI: Loaded 5188 primary data records. [2025-10-08T22:44:05.854493] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-08T22:44:05.866697] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-08T22:44:05.869491] [INFO ] [MAIN ] Derivative Progress: 1629/1771 symbols completed. VET took 1.2s. Estimated remaining: 54.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:05.895997] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:05.971795] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-08T22:44:06.090544] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-08T22:44:06.211890] [DEBUG] [LOCAL ] VGM: Loaded 18526 existing records from primary storage. [2025-10-08T22:44:06.212606] [INFO ] [MAIN ] VGM: Loaded 18526 primary data records. [2025-10-08T22:44:06.745009] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:06.747564] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5188 primary records. [2025-10-08T22:44:06.747704] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-08T22:44:06.769573] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-08T22:44:06.770037] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-08T22:44:06.772275] [INFO ] [MAIN ] Derivative Progress: 1630/1771 symbols completed. VGI took 1.1s. Estimated remaining: 54.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:06.772501] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:06.786291] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:06.787187] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53607 primary records. [2025-10-08T22:44:06.787279] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-08T22:44:06.805211] [DEBUG] [LOCAL ] VHI: Loaded 2718 existing records from primary storage. [2025-10-08T22:44:06.806104] [INFO ] [MAIN ] VHI: Loaded 2718 primary data records. [2025-10-08T22:44:06.851450] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:06.852408] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18526 primary records. [2025-10-08T22:44:06.892750] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-08T22:44:06.892812] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-08T22:44:06.905060] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-08T22:44:06.929732] [INFO ] [MAIN ] Derivative Progress: 1631/1771 symbols completed. VFC took 1.3s. Estimated remaining: 53.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:06.930077] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:07.191106] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-08T22:44:07.199994] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-08T22:44:07.202359] [INFO ] [MAIN ] Derivative Progress: 1632/1771 symbols completed. VGM took 1.3s. Estimated remaining: 53.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:07.202562] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:07.273622] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:07.275825] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2718 primary records. [2025-10-08T22:44:07.276030] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-08T22:44:07.277841] [DEBUG] [LOCAL ] VICI: Loaded 53650 existing records from primary storage. [2025-10-08T22:44:07.278058] [INFO ] [MAIN ] VICI: Loaded 53650 primary data records. [2025-10-08T22:44:07.402946] [DEBUG] [LOCAL ] VIK: Loaded 52453 existing records from primary storage. [2025-10-08T22:44:07.414829] [INFO ] [MAIN ] VIK: Loaded 52453 primary data records. [2025-10-08T22:44:07.462986] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-08T22:44:07.552025] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-08T22:44:07.603802] [INFO ] [MAIN ] Derivative Progress: 1633/1771 symbols completed. VHI took 0.8s. Estimated remaining: 53.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:07.940715] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:07.941537] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53650 primary records. [2025-10-08T22:44:07.941724] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-08T22:44:07.971463] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:07.972701] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52453 primary records. [2025-10-08T22:44:07.972979] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-08T22:44:07.974516] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-08T22:44:07.974877] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-08T22:44:07.985198] [INFO ] [MAIN ] Derivative Progress: 1634/1771 symbols completed. VICI took 1.1s. Estimated remaining: 52.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:07.992908] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-08T22:44:07.992977] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-08T22:44:07.994670] [INFO ] [MAIN ] Derivative Progress: 1635/1771 symbols completed. VIK took 0.8s. Estimated remaining: 52.3s. Rate: 155.9 symbols/min [2025-10-08T22:44:07.995339] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:07.995241] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:07.995420] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:08.067945] [DEBUG] [LOCAL ] VIST: Loaded 46177 existing records from primary storage. [2025-10-08T22:44:08.068207] [INFO ] [MAIN ] VIST: Loaded 46177 primary data records. [2025-10-08T22:44:08.204037] [DEBUG] [LOCAL ] VIRT: Loaded 46775 existing records from primary storage. [2025-10-08T22:44:08.205011] [INFO ] [MAIN ] VIRT: Loaded 46775 primary data records. [2025-10-08T22:44:08.204888] [DEBUG] [LOCAL ] VIPS: Loaded 51234 existing records from primary storage. [2025-10-08T22:44:08.226341] [INFO ] [MAIN ] VIPS: Loaded 51234 primary data records. [2025-10-08T22:44:09.146937] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:09.148387] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46177 primary records. [2025-10-08T22:44:09.148599] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-08T22:44:09.169962] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-08T22:44:09.171239] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-08T22:44:09.173891] [INFO ] [MAIN ] Derivative Progress: 1636/1771 symbols completed. VIST took 1.2s. Estimated remaining: 52.0s. Rate: 155.7 symbols/min [2025-10-08T22:44:09.188532] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:09.187920] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:09.197166] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46775 primary records. [2025-10-08T22:44:09.197274] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-08T22:44:09.203839] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:09.205438] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51234 primary records. [2025-10-08T22:44:09.213249] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-08T22:44:09.234930] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-08T22:44:09.239337] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-08T22:44:09.239577] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-08T22:44:09.242975] [INFO ] [MAIN ] Derivative Progress: 1637/1771 symbols completed. VIPS took 1.2s. Estimated remaining: 51.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:09.243215] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-08T22:44:09.245876] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:09.246400] [INFO ] [MAIN ] Derivative Progress: 1638/1771 symbols completed. VIRT took 1.3s. Estimated remaining: 51.2s. Rate: 155.9 symbols/min [2025-10-08T22:44:09.247198] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:09.276348] [DEBUG] [LOCAL ] VKQ: Loaded 17454 existing records from primary storage. [2025-10-08T22:44:09.290858] [INFO ] [MAIN ] VKQ: Loaded 17454 primary data records. [2025-10-08T22:44:09.331275] [DEBUG] [LOCAL ] VIV: Loaded 44856 existing records from primary storage. [2025-10-08T22:44:09.366356] [INFO ] [MAIN ] VIV: Loaded 44856 primary data records. [2025-10-08T22:44:09.436337] [DEBUG] [LOCAL ] VLN: Loaded 29689 existing records from primary storage. [2025-10-08T22:44:09.454027] [INFO ] [MAIN ] VLN: Loaded 29689 primary data records. [2025-10-08T22:44:10.290551] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:10.305777] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17454 primary records. [2025-10-08T22:44:10.306724] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-08T22:44:10.307099] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:10.316267] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44856 primary records. [2025-10-08T22:44:10.320583] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-08T22:44:10.350086] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-08T22:44:10.351685] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-08T22:44:10.351355] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:10.353912] [INFO ] [MAIN ] Derivative Progress: 1639/1771 symbols completed. VKQ took 1.1s. Estimated remaining: 50.9s. Rate: 155.7 symbols/min [2025-10-08T22:44:10.355916] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 29689 primary records. [2025-10-08T22:44:10.356422] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:10.356277] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-08T22:44:10.371526] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-08T22:44:10.371705] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-08T22:44:10.378206] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-08T22:44:10.374025] [INFO ] [MAIN ] Derivative Progress: 1640/1771 symbols completed. VIV took 1.2s. Estimated remaining: 50.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:10.378455] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-08T22:44:10.381101] [INFO ] [MAIN ] Derivative Progress: 1641/1771 symbols completed. VLN took 1.1s. Estimated remaining: 50.0s. Rate: 155.9 symbols/min [2025-10-08T22:44:10.381339] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:10.378635] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:10.391363] [DEBUG] [LOCAL ] VLT: Loaded 4527 existing records from primary storage. [2025-10-08T22:44:10.391805] [INFO ] [MAIN ] VLT: Loaded 4527 primary data records. [2025-10-08T22:44:10.605306] [DEBUG] [LOCAL ] VLRS: Loaded 40181 existing records from primary storage. [2025-10-08T22:44:10.625630] [INFO ] [MAIN ] VLRS: Loaded 40181 primary data records. [2025-10-08T22:44:10.775225] [DEBUG] [LOCAL ] VLO: Loaded 53081 existing records from primary storage. [2025-10-08T22:44:10.804333] [INFO ] [MAIN ] VLO: Loaded 53081 primary data records. [2025-10-08T22:44:11.442399] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:11.444071] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4527 primary records. [2025-10-08T22:44:11.444297] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-08T22:44:11.465027] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-08T22:44:11.466412] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-08T22:44:11.469479] [INFO ] [MAIN ] Derivative Progress: 1642/1771 symbols completed. VLT took 1.1s. Estimated remaining: 49.7s. Rate: 155.7 symbols/min [2025-10-08T22:44:11.470083] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:11.487790] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:11.488711] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 40181 primary records. [2025-10-08T22:44:11.488776] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-08T22:44:11.527345] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:11.529178] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53081 primary records. [2025-10-08T22:44:11.529288] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-08T22:44:11.541691] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-08T22:44:11.544909] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-08T22:44:11.547538] [INFO ] [MAIN ] Derivative Progress: 1643/1771 symbols completed. VLRS took 1.2s. Estimated remaining: 49.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:11.559471] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:11.565864] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-08T22:44:11.566074] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-08T22:44:11.568508] [INFO ] [MAIN ] Derivative Progress: 1644/1771 symbols completed. VLO took 1.2s. Estimated remaining: 48.9s. Rate: 155.9 symbols/min [2025-10-08T22:44:11.568797] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:11.585116] [DEBUG] [LOCAL ] VLTO: Loaded 46089 existing records from primary storage. [2025-10-08T22:44:11.585570] [INFO ] [MAIN ] VLTO: Loaded 46089 primary data records. [2025-10-08T22:44:11.745758] [DEBUG] [LOCAL ] VMI: Loaded 15305 existing records from primary storage. [2025-10-08T22:44:11.779943] [INFO ] [MAIN ] VMI: Loaded 15305 primary data records. [2025-10-08T22:44:11.827387] [DEBUG] [LOCAL ] VMC: Loaded 42896 existing records from primary storage. [2025-10-08T22:44:11.884883] [INFO ] [MAIN ] VMC: Loaded 42896 primary data records. [2025-10-08T22:44:12.726098] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:12.727296] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46089 primary records. [2025-10-08T22:44:12.727816] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-08T22:44:12.753462] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-08T22:44:12.754091] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-08T22:44:12.756110] [INFO ] [MAIN ] Derivative Progress: 1645/1771 symbols completed. VLTO took 1.3s. Estimated remaining: 48.6s. Rate: 155.7 symbols/min [2025-10-08T22:44:12.756984] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:12.773479] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:44:12.775426] [INFO ] [MAIN ] VMI: Generated 1793 derivative records from 15305 primary records. [2025-10-08T22:44:12.775589] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-08T22:44:12.797928] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:12.803404] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42896 primary records. [2025-10-08T22:44:12.803495] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-08T22:44:12.826104] [DEBUG] [LOCAL ] VMI: Derivative data saved (1793 records). [2025-10-08T22:44:12.826996] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-08T22:44:12.829808] [INFO ] [MAIN ] Derivative Progress: 1646/1771 symbols completed. VMI took 1.3s. Estimated remaining: 48.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:12.830466] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:12.842089] [DEBUG] [LOCAL ] VMO: Loaded 20901 existing records from primary storage. [2025-10-08T22:44:12.843058] [INFO ] [MAIN ] VMO: Loaded 20901 primary data records. [2025-10-08T22:44:12.876953] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-08T22:44:12.891323] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-08T22:44:12.906148] [INFO ] [MAIN ] Derivative Progress: 1647/1771 symbols completed. VMC took 1.3s. Estimated remaining: 47.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:12.906629] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:12.906480] [DEBUG] [LOCAL ] VNCE: Loaded 8493 existing records from primary storage. [2025-10-08T22:44:12.956847] [INFO ] [MAIN ] VNCE: Loaded 8493 primary data records. [2025-10-08T22:44:13.497858] [DEBUG] [LOCAL ] VNO: Loaded 48848 existing records from primary storage. [2025-10-08T22:44:13.600068] [INFO ] [MAIN ] VNO: Loaded 48848 primary data records. [2025-10-08T22:44:14.015771] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:14.018892] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20901 primary records. [2025-10-08T22:44:14.020081] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-08T22:44:14.050586] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-08T22:44:14.051021] [DEBUG] [MAIN ] VNCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:14.051936] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 8493 primary records. [2025-10-08T22:44:14.052029] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-08T22:44:14.052087] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-10-08T22:44:14.056307] [INFO ] [MAIN ] Derivative Progress: 1648/1771 symbols completed. VMO took 1.3s. Estimated remaining: 47.4s. Rate: 155.7 symbols/min [2025-10-08T22:44:14.072425] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-10-08T22:44:14.072682] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-10-08T22:44:14.074681] [INFO ] [MAIN ] Derivative Progress: 1649/1771 symbols completed. VNCE took 1.2s. Estimated remaining: 47.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:14.090989] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:14.091714] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48848 primary records. [2025-10-08T22:44:14.091782] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-08T22:44:14.109606] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-08T22:44:14.109733] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-08T22:44:14.112081] [INFO ] [MAIN ] Derivative Progress: 1650/1771 symbols completed. VNO took 1.2s. Estimated remaining: 46.6s. Rate: 155.9 symbols/min [2025-10-08T22:44:14.112702] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:14.112837] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:14.112616] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:14.125550] [DEBUG] [LOCAL ] VOC: Loaded 9006 existing records from primary storage. [2025-10-08T22:44:14.125754] [INFO ] [MAIN ] VOC: Loaded 9006 primary data records. [2025-10-08T22:44:14.373671] [DEBUG] [LOCAL ] VOYA: Loaded 42245 existing records from primary storage. [2025-10-08T22:44:14.399072] [INFO ] [MAIN ] VOYA: Loaded 42245 primary data records. [2025-10-08T22:44:14.399819] [DEBUG] [LOCAL ] VNT: Loaded 43632 existing records from primary storage. [2025-10-08T22:44:14.405434] [INFO ] [MAIN ] VNT: Loaded 43632 primary data records. [2025-10-08T22:44:15.173848] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:15.174969] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9006 primary records. [2025-10-08T22:44:15.175185] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-08T22:44:15.194456] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-08T22:44:15.195901] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-08T22:44:15.199037] [INFO ] [MAIN ] Derivative Progress: 1651/1771 symbols completed. VOC took 1.1s. Estimated remaining: 46.2s. Rate: 155.7 symbols/min [2025-10-08T22:44:15.199867] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:15.215107] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:15.216247] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42245 primary records. [2025-10-08T22:44:15.216566] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-08T22:44:15.242436] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-08T22:44:15.261806] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-08T22:44:15.261571] [DEBUG] [LOCAL ] VPG: Loaded 17071 existing records from primary storage. [2025-10-08T22:44:15.262192] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:15.265419] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43632 primary records. [2025-10-08T22:44:15.264414] [INFO ] [MAIN ] Derivative Progress: 1652/1771 symbols completed. VOYA took 1.2s. Estimated remaining: 45.8s. Rate: 155.8 symbols/min [2025-10-08T22:44:15.264700] [INFO ] [MAIN ] VPG: Loaded 17071 primary data records. [2025-10-08T22:44:15.265727] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-08T22:44:15.265883] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:15.366294] [DEBUG] [LOCAL ] VPV: Loaded 5408 existing records from primary storage. [2025-10-08T22:44:15.372893] [INFO ] [MAIN ] VPV: Loaded 5408 primary data records. [2025-10-08T22:44:15.512235] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-08T22:44:15.570164] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-08T22:44:15.601378] [INFO ] [MAIN ] Derivative Progress: 1653/1771 symbols completed. VNT took 1.5s. Estimated remaining: 45.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:15.605111] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:16.011124] [DEBUG] [LOCAL ] VRE: Loaded 35071 existing records from primary storage. [2025-10-08T22:44:16.011796] [INFO ] [MAIN ] VRE: Loaded 35071 primary data records. [2025-10-08T22:44:16.200581] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:16.212448] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5408 primary records. [2025-10-08T22:44:16.226526] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-08T22:44:16.233441] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:16.360295] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17071 primary records. [2025-10-08T22:44:16.361132] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-08T22:44:16.381986] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-08T22:44:16.382436] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-08T22:44:16.385148] [INFO ] [MAIN ] Derivative Progress: 1654/1771 symbols completed. VPV took 1.1s. Estimated remaining: 45.1s. Rate: 155.7 symbols/min [2025-10-08T22:44:16.386831] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:16.390451] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-08T22:44:16.390537] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-08T22:44:16.392497] [INFO ] [MAIN ] Derivative Progress: 1655/1771 symbols completed. VPG took 1.2s. Estimated remaining: 44.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:16.392838] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:16.413298] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:16.414256] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35071 primary records. [2025-10-08T22:44:16.414519] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-08T22:44:16.426951] [DEBUG] [LOCAL ] VRTS: Loaded 9303 existing records from primary storage. [2025-10-08T22:44:16.427214] [INFO ] [MAIN ] VRTS: Loaded 9303 primary data records. [2025-10-08T22:44:16.607958] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-08T22:44:16.618674] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-08T22:44:16.649900] [INFO ] [MAIN ] Derivative Progress: 1656/1771 symbols completed. VRE took 1.0s. Estimated remaining: 44.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:16.757874] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-08T22:44:16.756431] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:16.771969] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-08T22:44:17.143035] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:17.157409] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9303 primary records. [2025-10-08T22:44:17.158930] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-08T22:44:17.159904] [DEBUG] [LOCAL ] VSCO: Loaded 52746 existing records from primary storage. [2025-10-08T22:44:17.161168] [INFO ] [MAIN ] VSCO: Loaded 52746 primary data records. [2025-10-08T22:44:17.288484] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-08T22:44:17.299085] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-08T22:44:17.344063] [INFO ] [MAIN ] Derivative Progress: 1657/1771 symbols completed. VRTS took 1.0s. Estimated remaining: 43.9s. Rate: 155.7 symbols/min [2025-10-08T22:44:17.520536] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:17.558964] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:17.560610] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-08T22:44:17.560875] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-08T22:44:17.579715] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-08T22:44:17.579996] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-08T22:44:17.581994] [INFO ] [MAIN ] Derivative Progress: 1658/1771 symbols completed. VRT took 1.2s. Estimated remaining: 43.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:17.582220] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:17.604002] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:17.604736] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52746 primary records. [2025-10-08T22:44:17.604849] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-08T22:44:17.632880] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-08T22:44:17.633034] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-08T22:44:17.635639] [INFO ] [MAIN ] Derivative Progress: 1659/1771 symbols completed. VSCO took 0.9s. Estimated remaining: 43.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:17.636274] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:17.652219] [DEBUG] [LOCAL ] VSH: Loaded 48244 existing records from primary storage. [2025-10-08T22:44:17.652371] [INFO ] [MAIN ] VSH: Loaded 48244 primary data records. [2025-10-08T22:44:17.818688] [DEBUG] [LOCAL ] VST: Loaded 53713 existing records from primary storage. [2025-10-08T22:44:17.881780] [INFO ] [MAIN ] VST: Loaded 53713 primary data records. [2025-10-08T22:44:18.080870] [DEBUG] [LOCAL ] VSTS: Loaded 48958 existing records from primary storage. [2025-10-08T22:44:18.111558] [INFO ] [MAIN ] VSTS: Loaded 48958 primary data records. [2025-10-08T22:44:18.625688] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:18.627267] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48244 primary records. [2025-10-08T22:44:18.627532] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-08T22:44:18.645175] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-08T22:44:18.645295] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-08T22:44:18.647496] [INFO ] [MAIN ] Derivative Progress: 1660/1771 symbols completed. VSH took 1.1s. Estimated remaining: 42.8s. Rate: 155.7 symbols/min [2025-10-08T22:44:18.648114] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:18.666210] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:18.666969] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53713 primary records. [2025-10-08T22:44:18.667154] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-08T22:44:18.699974] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-08T22:44:18.699782] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:18.700759] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48958 primary records. [2025-10-08T22:44:18.709798] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-08T22:44:18.709936] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-08T22:44:18.712551] [INFO ] [MAIN ] Derivative Progress: 1661/1771 symbols completed. VST took 1.1s. Estimated remaining: 42.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:18.712735] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:18.728061] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-08T22:44:18.728860] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-08T22:44:18.730905] [INFO ] [MAIN ] Derivative Progress: 1662/1771 symbols completed. VSTS took 1.1s. Estimated remaining: 42.0s. Rate: 155.9 symbols/min [2025-10-08T22:44:18.731169] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:18.745698] [DEBUG] [LOCAL ] VTEX: Loaded 42978 existing records from primary storage. [2025-10-08T22:44:18.745991] [INFO ] [MAIN ] VTEX: Loaded 42978 primary data records. [2025-10-08T22:44:18.935292] [DEBUG] [LOCAL ] VTMX: Loaded 17558 existing records from primary storage. [2025-10-08T22:44:19.056380] [INFO ] [MAIN ] VTMX: Loaded 17558 primary data records. [2025-10-08T22:44:19.192787] [DEBUG] [LOCAL ] VTLE: Loaded 48266 existing records from primary storage. [2025-10-08T22:44:19.193692] [INFO ] [MAIN ] VTLE: Loaded 48266 primary data records. [2025-10-08T22:44:19.747262] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:19.748710] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 42978 primary records. [2025-10-08T22:44:19.748917] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-08T22:44:19.770010] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-08T22:44:19.770236] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-08T22:44:19.772333] [INFO ] [MAIN ] Derivative Progress: 1663/1771 symbols completed. VTEX took 1.1s. Estimated remaining: 41.6s. Rate: 155.7 symbols/min [2025-10-08T22:44:19.790034] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:19.790909] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17558 primary records. [2025-10-08T22:44:19.791057] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-08T22:44:19.820299] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:19.821189] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48266 primary records. [2025-10-08T22:44:19.821683] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-08T22:44:19.823209] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-08T22:44:19.823282] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-08T22:44:19.825442] [INFO ] [MAIN ] Derivative Progress: 1664/1771 symbols completed. VTMX took 1.1s. Estimated remaining: 41.2s. Rate: 155.8 symbols/min [2025-10-08T22:44:19.840464] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-08T22:44:19.840526] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-08T22:44:19.842464] [INFO ] [MAIN ] Derivative Progress: 1665/1771 symbols completed. VTLE took 1.1s. Estimated remaining: 40.8s. Rate: 155.9 symbols/min [2025-10-08T22:44:19.842982] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:19.842829] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:19.842898] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:19.853707] [DEBUG] [LOCAL ] VTN: Loaded 6991 existing records from primary storage. [2025-10-08T22:44:19.853834] [INFO ] [MAIN ] VTN: Loaded 6991 primary data records. [2025-10-08T22:44:19.996311] [DEBUG] [LOCAL ] VTOL: Loaded 19500 existing records from primary storage. [2025-10-08T22:44:20.052065] [INFO ] [MAIN ] VTOL: Loaded 19500 primary data records. [2025-10-08T22:44:20.484741] [DEBUG] [LOCAL ] VTR: Loaded 52768 existing records from primary storage. [2025-10-08T22:44:20.495130] [INFO ] [MAIN ] VTR: Loaded 52768 primary data records. [2025-10-08T22:44:20.707914] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:20.805180] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 6991 primary records. [2025-10-08T22:44:20.815065] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-08T22:44:20.836500] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-08T22:44:20.836772] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-08T22:44:20.838805] [INFO ] [MAIN ] Derivative Progress: 1666/1771 symbols completed. VTN took 1.0s. Estimated remaining: 40.5s. Rate: 155.7 symbols/min [2025-10-08T22:44:20.839223] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:20.858081] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:20.860256] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19500 primary records. [2025-10-08T22:44:20.861181] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-08T22:44:20.902955] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:20.904909] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52768 primary records. [2025-10-08T22:44:20.905253] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-08T22:44:20.930220] [DEBUG] [LOCAL ] VTS: Loaded 30151 existing records from primary storage. [2025-10-08T22:44:20.929702] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-08T22:44:20.930385] [INFO ] [MAIN ] VTS: Loaded 30151 primary data records. [2025-10-08T22:44:20.930986] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-08T22:44:20.935039] [INFO ] [MAIN ] Derivative Progress: 1667/1771 symbols completed. VTOL took 1.1s. Estimated remaining: 40.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:20.935354] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:20.975761] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-08T22:44:20.998203] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-08T22:44:21.009328] [INFO ] [MAIN ] Derivative Progress: 1668/1771 symbols completed. VTR took 1.2s. Estimated remaining: 39.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:21.014705] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:21.262320] [DEBUG] [LOCAL ] VVR: Loaded 31529 existing records from primary storage. [2025-10-08T22:44:21.275298] [INFO ] [MAIN ] VVR: Loaded 31529 primary data records. [2025-10-08T22:44:21.405501] [DEBUG] [LOCAL ] VVV: Loaded 50287 existing records from primary storage. [2025-10-08T22:44:21.405770] [INFO ] [MAIN ] VVV: Loaded 50287 primary data records. [2025-10-08T22:44:21.956323] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:21.958157] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30151 primary records. [2025-10-08T22:44:21.958554] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-08T22:44:21.976580] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-08T22:44:21.977252] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-08T22:44:21.979482] [INFO ] [MAIN ] Derivative Progress: 1669/1771 symbols completed. VTS took 1.1s. Estimated remaining: 39.3s. Rate: 155.7 symbols/min [2025-10-08T22:44:21.980307] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:22.000474] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:22.001515] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31529 primary records. [2025-10-08T22:44:22.001675] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-08T22:44:22.034673] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-08T22:44:22.036445] [DEBUG] [LOCAL ] VVX: Loaded 22935 existing records from primary storage. [2025-10-08T22:44:22.036586] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-08T22:44:22.036697] [INFO ] [MAIN ] VVX: Loaded 22935 primary data records. [2025-10-08T22:44:22.051251] [INFO ] [MAIN ] Derivative Progress: 1670/1771 symbols completed. VVR took 1.1s. Estimated remaining: 38.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:22.072274] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:22.087677] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:22.093626] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50287 primary records. [2025-10-08T22:44:22.099308] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-08T22:44:22.375236] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-08T22:44:22.385553] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-08T22:44:22.387970] [INFO ] [MAIN ] Derivative Progress: 1671/1771 symbols completed. VVV took 1.4s. Estimated remaining: 38.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:22.389225] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:22.418223] [DEBUG] [LOCAL ] VYX: Loaded 48554 existing records from primary storage. [2025-10-08T22:44:22.418812] [INFO ] [MAIN ] VYX: Loaded 48554 primary data records. [2025-10-08T22:44:22.756036] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:22.765994] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 22935 primary records. [2025-10-08T22:44:22.780887] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-08T22:44:22.785370] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-08T22:44:22.786015] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-08T22:44:22.930043] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-08T22:44:22.955174] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-08T22:44:22.976843] [INFO ] [MAIN ] Derivative Progress: 1672/1771 symbols completed. VVX took 1.0s. Estimated remaining: 38.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:23.115827] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:23.150233] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:23.151226] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48554 primary records. [2025-10-08T22:44:23.151398] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-08T22:44:23.203191] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-08T22:44:23.204943] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-08T22:44:23.207587] [INFO ] [MAIN ] Derivative Progress: 1673/1771 symbols completed. VYX took 1.1s. Estimated remaining: 37.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:23.208098] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:23.224147] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:23.225163] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-08T22:44:23.239481] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-08T22:44:23.243096] [DEBUG] [LOCAL ] W: Loaded 53441 existing records from primary storage. [2025-10-08T22:44:23.250518] [INFO ] [MAIN ] W: Loaded 53441 primary data records. [2025-10-08T22:44:23.287470] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-08T22:44:23.287687] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-08T22:44:23.290018] [INFO ] [MAIN ] Derivative Progress: 1674/1771 symbols completed. VZ took 0.9s. Estimated remaining: 37.3s. Rate: 155.9 symbols/min [2025-10-08T22:44:23.299741] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:23.676076] [DEBUG] [LOCAL ] WAB: Loaded 44034 existing records from primary storage. [2025-10-08T22:44:23.683236] [INFO ] [MAIN ] WAB: Loaded 44034 primary data records. [2025-10-08T22:44:23.778394] [DEBUG] [LOCAL ] WAL: Loaded 45173 existing records from primary storage. [2025-10-08T22:44:23.804998] [INFO ] [MAIN ] WAL: Loaded 45173 primary data records. [2025-10-08T22:44:24.337479] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:24.339757] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53441 primary records. [2025-10-08T22:44:24.339925] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-08T22:44:24.362275] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-08T22:44:24.362814] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-08T22:44:24.365318] [INFO ] [MAIN ] Derivative Progress: 1675/1771 symbols completed. W took 1.2s. Estimated remaining: 37.0s. Rate: 155.7 symbols/min [2025-10-08T22:44:24.365702] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:24.384564] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:24.388027] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44034 primary records. [2025-10-08T22:44:24.388306] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-08T22:44:24.410699] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:24.417437] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-08T22:44:24.417671] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-08T22:44:24.419799] [INFO ] [MAIN ] Derivative Progress: 1676/1771 symbols completed. WAB took 1.2s. Estimated remaining: 36.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:24.421117] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:24.420954] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45173 primary records. [2025-10-08T22:44:24.421912] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-08T22:44:24.446942] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-08T22:44:24.447210] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-08T22:44:24.449451] [INFO ] [MAIN ] Derivative Progress: 1677/1771 symbols completed. WAL took 1.1s. Estimated remaining: 36.2s. Rate: 155.9 symbols/min [2025-10-08T22:44:24.449930] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:24.463113] [DEBUG] [LOCAL ] WAT: Loaded 35446 existing records from primary storage. [2025-10-08T22:44:24.463924] [INFO ] [MAIN ] WAT: Loaded 35446 primary data records. [2025-10-08T22:44:24.584858] [DEBUG] [LOCAL ] WBX: Loaded 11011 existing records from primary storage. [2025-10-08T22:44:24.590676] [INFO ] [MAIN ] WBX: Loaded 11011 primary data records. [2025-10-08T22:44:24.892258] [DEBUG] [LOCAL ] WBS: Loaded 48657 existing records from primary storage. [2025-10-08T22:44:24.910829] [INFO ] [MAIN ] WBS: Loaded 48657 primary data records. [2025-10-08T22:44:25.523970] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:25.525480] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35446 primary records. [2025-10-08T22:44:25.525583] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-08T22:44:25.556046] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:25.558424] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 11011 primary records. [2025-10-08T22:44:25.558873] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-08T22:44:25.561386] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-08T22:44:25.567852] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-08T22:44:25.570928] [INFO ] [MAIN ] Derivative Progress: 1678/1771 symbols completed. WAT took 1.2s. Estimated remaining: 35.8s. Rate: 155.7 symbols/min [2025-10-08T22:44:25.578462] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-08T22:44:25.578545] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-08T22:44:25.580712] [INFO ] [MAIN ] Derivative Progress: 1679/1771 symbols completed. WBX took 1.1s. Estimated remaining: 35.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:25.595528] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:25.596102] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48657 primary records. [2025-10-08T22:44:25.596163] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-08T22:44:25.611228] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-08T22:44:25.611289] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-08T22:44:25.613403] [INFO ] [MAIN ] Derivative Progress: 1680/1771 symbols completed. WBS took 1.2s. Estimated remaining: 35.0s. Rate: 155.9 symbols/min [2025-10-08T22:44:25.613843] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:25.613965] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:25.614055] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:25.640160] [DEBUG] [LOCAL ] WD: Loaded 23126 existing records from primary storage. [2025-10-08T22:44:25.640367] [INFO ] [MAIN ] WD: Loaded 23126 primary data records. [2025-10-08T22:44:25.968152] [DEBUG] [LOCAL ] WCC: Loaded 39121 existing records from primary storage. [2025-10-08T22:44:25.981788] [INFO ] [MAIN ] WCC: Loaded 39121 primary data records. [2025-10-08T22:44:26.011379] [DEBUG] [LOCAL ] WCN: Loaded 47963 existing records from primary storage. [2025-10-08T22:44:26.031154] [INFO ] [MAIN ] WCN: Loaded 47963 primary data records. [2025-10-08T22:44:26.648501] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:26.649926] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23126 primary records. [2025-10-08T22:44:26.650378] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-08T22:44:26.673011] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-08T22:44:26.673333] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-08T22:44:26.675416] [INFO ] [MAIN ] Derivative Progress: 1681/1771 symbols completed. WD took 1.1s. Estimated remaining: 34.7s. Rate: 155.7 symbols/min [2025-10-08T22:44:26.675707] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:26.694246] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:26.696585] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 39121 primary records. [2025-10-08T22:44:26.697751] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-08T22:44:26.728331] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:26.729557] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47963 primary records. [2025-10-08T22:44:26.729932] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-08T22:44:26.738162] [DEBUG] [LOCAL ] WDH: Loaded 17977 existing records from primary storage. [2025-10-08T22:44:26.738901] [INFO ] [MAIN ] WDH: Loaded 17977 primary data records. [2025-10-08T22:44:26.826506] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-08T22:44:26.858577] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-08T22:44:26.860964] [INFO ] [MAIN ] Derivative Progress: 1682/1771 symbols completed. WCN took 1.2s. Estimated remaining: 34.3s. Rate: 155.7 symbols/min [2025-10-08T22:44:26.850314] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-08T22:44:26.861126] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:26.865144] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-08T22:44:26.868758] [INFO ] [MAIN ] Derivative Progress: 1683/1771 symbols completed. WCC took 1.3s. Estimated remaining: 33.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:26.869006] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:27.088107] [DEBUG] [LOCAL ] WDI: Loaded 21097 existing records from primary storage. [2025-10-08T22:44:27.097918] [INFO ] [MAIN ] WDI: Loaded 21097 primary data records. [2025-10-08T22:44:27.245881] [DEBUG] [LOCAL ] WDS: Loaded 43104 existing records from primary storage. [2025-10-08T22:44:27.274740] [INFO ] [MAIN ] WDS: Loaded 43104 primary data records. [2025-10-08T22:44:27.543932] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:27.551423] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 17977 primary records. [2025-10-08T22:44:27.561860] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-08T22:44:27.813918] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-08T22:44:27.814421] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-08T22:44:27.816698] [INFO ] [MAIN ] Derivative Progress: 1684/1771 symbols completed. WDH took 1.1s. Estimated remaining: 33.5s. Rate: 155.7 symbols/min [2025-10-08T22:44:27.816981] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:27.837889] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:27.838998] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21097 primary records. [2025-10-08T22:44:27.842828] [DEBUG] [LOCAL ] WEA: Loaded 7462 existing records from primary storage. [2025-10-08T22:44:27.842937] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-08T22:44:27.843029] [INFO ] [MAIN ] WEA: Loaded 7462 primary data records. [2025-10-08T22:44:27.963825] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-08T22:44:27.969471] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-08T22:44:27.971600] [INFO ] [MAIN ] Derivative Progress: 1685/1771 symbols completed. WDI took 1.1s. Estimated remaining: 33.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:27.982279] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:28.183328] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:28.184141] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43104 primary records. [2025-10-08T22:44:28.184348] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-08T22:44:28.220298] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-08T22:44:28.220495] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-08T22:44:28.223457] [INFO ] [MAIN ] Derivative Progress: 1686/1771 symbols completed. WDS took 1.4s. Estimated remaining: 32.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:28.224000] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:28.237261] [DEBUG] [LOCAL ] WEAV: Loaded 41861 existing records from primary storage. [2025-10-08T22:44:28.237842] [INFO ] [MAIN ] WEAV: Loaded 41861 primary data records. [2025-10-08T22:44:28.415623] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:28.434028] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7462 primary records. [2025-10-08T22:44:28.439600] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-08T22:44:28.593181] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-08T22:44:28.607446] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-08T22:44:28.610991] [INFO ] [MAIN ] Derivative Progress: 1687/1771 symbols completed. WEA took 0.8s. Estimated remaining: 32.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:28.612573] [DEBUG] [LOCAL ] WEC: Loaded 52168 existing records from primary storage. [2025-10-08T22:44:28.612754] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:28.612862] [INFO ] [MAIN ] WEC: Loaded 52168 primary data records. [2025-10-08T22:44:28.944347] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:28.945612] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 41861 primary records. [2025-10-08T22:44:28.946008] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-08T22:44:28.963537] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-08T22:44:28.963675] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-08T22:44:28.965834] [INFO ] [MAIN ] Derivative Progress: 1688/1771 symbols completed. WEAV took 1.0s. Estimated remaining: 32.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:28.966128] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:28.989157] [DEBUG] [LOCAL ] WELL: Loaded 52339 existing records from primary storage. [2025-10-08T22:44:28.989468] [INFO ] [MAIN ] WELL: Loaded 52339 primary data records. [2025-10-08T22:44:29.335485] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:29.337988] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52168 primary records. [2025-10-08T22:44:29.338360] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-08T22:44:29.354739] [DEBUG] [LOCAL ] WES: Loaded 48275 existing records from primary storage. [2025-10-08T22:44:29.355236] [INFO ] [MAIN ] WES: Loaded 48275 primary data records. [2025-10-08T22:44:29.493967] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-08T22:44:29.499735] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-08T22:44:29.508059] [INFO ] [MAIN ] Derivative Progress: 1689/1771 symbols completed. WEC took 1.3s. Estimated remaining: 31.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:29.542911] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:29.748184] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:29.749037] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52339 primary records. [2025-10-08T22:44:29.749272] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-08T22:44:29.769825] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-08T22:44:29.769985] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-08T22:44:29.772070] [INFO ] [MAIN ] Derivative Progress: 1690/1771 symbols completed. WELL took 1.2s. Estimated remaining: 31.2s. Rate: 155.8 symbols/min [2025-10-08T22:44:29.783685] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:29.823501] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:29.823860] [DEBUG] [LOCAL ] WF: Loaded 10780 existing records from primary storage. [2025-10-08T22:44:29.824186] [INFO ] [MAIN ] WF: Loaded 10780 primary data records. [2025-10-08T22:44:29.825063] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48275 primary records. [2025-10-08T22:44:29.825994] [DEBUG] [LOCAL ] WEX: Loaded 33689 existing records from primary storage. [2025-10-08T22:44:29.837404] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-08T22:44:29.857708] [INFO ] [MAIN ] WEX: Loaded 33689 primary data records. [2025-10-08T22:44:29.957108] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-08T22:44:30.024303] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-08T22:44:30.072670] [INFO ] [MAIN ] Derivative Progress: 1691/1771 symbols completed. WES took 1.1s. Estimated remaining: 30.8s. Rate: 155.8 symbols/min [2025-10-08T22:44:30.098838] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:30.522426] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:30.524887] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 33689 primary records. [2025-10-08T22:44:30.525047] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-08T22:44:30.546741] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-08T22:44:30.550863] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-08T22:44:30.551157] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:30.551936] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10780 primary records. [2025-10-08T22:44:30.555560] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-08T22:44:30.555690] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-08T22:44:30.556480] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-08T22:44:30.578862] [INFO ] [MAIN ] Derivative Progress: 1692/1771 symbols completed. WEX took 1.0s. Estimated remaining: 30.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:30.594536] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:30.676254] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-08T22:44:30.692286] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-08T22:44:30.723056] [INFO ] [MAIN ] Derivative Progress: 1693/1771 symbols completed. WF took 0.9s. Estimated remaining: 30.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:30.882458] [DEBUG] [LOCAL ] WFG: Loaded 24788 existing records from primary storage. [2025-10-08T22:44:30.882618] [INFO ] [MAIN ] WFG: Loaded 24788 primary data records. [2025-10-08T22:44:31.202761] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:31.203606] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-08T22:44:31.203774] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-08T22:44:31.221185] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-08T22:44:31.221434] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-08T22:44:31.223709] [INFO ] [MAIN ] Derivative Progress: 1694/1771 symbols completed. WFC took 1.1s. Estimated remaining: 29.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:31.238379] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:31.238948] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24788 primary records. [2025-10-08T22:44:31.239035] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-08T22:44:31.254227] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-08T22:44:31.254286] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-08T22:44:31.256122] [INFO ] [MAIN ] Derivative Progress: 1695/1771 symbols completed. WFG took 0.7s. Estimated remaining: 29.3s. Rate: 155.9 symbols/min [2025-10-08T22:44:31.256584] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:31.256638] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:31.256511] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:31.328872] [DEBUG] [LOCAL ] WH: Loaded 45268 existing records from primary storage. [2025-10-08T22:44:31.330636] [INFO ] [MAIN ] WH: Loaded 45268 primary data records. [2025-10-08T22:44:31.342473] [DEBUG] [LOCAL ] WGO: Loaded 38466 existing records from primary storage. [2025-10-08T22:44:31.409576] [DEBUG] [LOCAL ] WHD: Loaded 40002 existing records from primary storage. [2025-10-08T22:44:31.426831] [INFO ] [MAIN ] WHD: Loaded 40002 primary data records. [2025-10-08T22:44:31.421588] [INFO ] [MAIN ] WGO: Loaded 38466 primary data records. [2025-10-08T22:44:32.318086] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:32.318990] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45268 primary records. [2025-10-08T22:44:32.319184] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-08T22:44:32.353476] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:32.354560] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40002 primary records. [2025-10-08T22:44:32.354635] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-08T22:44:32.379546] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:32.380519] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 38466 primary records. [2025-10-08T22:44:32.379069] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-08T22:44:32.380897] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-08T22:44:32.382454] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-08T22:44:32.385017] [INFO ] [MAIN ] Derivative Progress: 1696/1771 symbols completed. WH took 1.1s. Estimated remaining: 28.9s. Rate: 155.7 symbols/min [2025-10-08T22:44:32.385413] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:32.402009] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-08T22:44:32.402821] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-08T22:44:32.406011] [INFO ] [MAIN ] Derivative Progress: 1697/1771 symbols completed. WHD took 1.1s. Estimated remaining: 28.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:32.409201] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:32.410072] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-08T22:44:32.410484] [DEBUG] [LOCAL ] WHG: Loaded 3243 existing records from primary storage. [2025-10-08T22:44:32.410609] [INFO ] [MAIN ] WHG: Loaded 3243 primary data records. [2025-10-08T22:44:32.421787] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-08T22:44:32.456511] [INFO ] [MAIN ] Derivative Progress: 1698/1771 symbols completed. WGO took 1.2s. Estimated remaining: 28.1s. Rate: 155.9 symbols/min [2025-10-08T22:44:32.470727] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:32.572088] [DEBUG] [LOCAL ] WIA: Loaded 4969 existing records from primary storage. [2025-10-08T22:44:32.727771] [INFO ] [MAIN ] WIA: Loaded 4969 primary data records. [2025-10-08T22:44:32.852198] [DEBUG] [LOCAL ] WHR: Loaded 48375 existing records from primary storage. [2025-10-08T22:44:32.863043] [INFO ] [MAIN ] WHR: Loaded 48375 primary data records. [2025-10-08T22:44:33.352338] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:33.353933] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3243 primary records. [2025-10-08T22:44:33.354758] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-08T22:44:33.372075] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-08T22:44:33.372400] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-08T22:44:33.374427] [INFO ] [MAIN ] Derivative Progress: 1699/1771 symbols completed. WHG took 1.0s. Estimated remaining: 27.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:33.374750] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:33.394960] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:33.397488] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4969 primary records. [2025-10-08T22:44:33.397604] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-08T22:44:33.403677] [DEBUG] [LOCAL ] WINN: Loaded 11534 existing records from primary storage. [2025-10-08T22:44:33.413452] [INFO ] [MAIN ] WINN: Loaded 11534 primary data records. [2025-10-08T22:44:33.458928] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:33.471956] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48375 primary records. [2025-10-08T22:44:33.497860] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-08T22:44:33.521435] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-08T22:44:33.521565] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-08T22:44:33.534096] [INFO ] [MAIN ] Derivative Progress: 1700/1771 symbols completed. WIA took 1.1s. Estimated remaining: 27.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:33.534500] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:33.576083] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-08T22:44:33.605970] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-08T22:44:33.629215] [INFO ] [MAIN ] Derivative Progress: 1701/1771 symbols completed. WHR took 1.2s. Estimated remaining: 26.9s. Rate: 155.9 symbols/min [2025-10-08T22:44:33.747585] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:33.799474] [DEBUG] [LOCAL ] WIW: Loaded 20456 existing records from primary storage. [2025-10-08T22:44:33.801381] [INFO ] [MAIN ] WIW: Loaded 20456 primary data records. [2025-10-08T22:44:33.917017] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:44:33.911512] [DEBUG] [LOCAL ] WIT: Loaded 52402 existing records from primary storage. [2025-10-08T22:44:33.923741] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11534 primary records. [2025-10-08T22:44:33.931801] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-08T22:44:33.931707] [INFO ] [MAIN ] WIT: Loaded 52402 primary data records. [2025-10-08T22:44:34.234419] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-10-08T22:44:34.252455] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-08T22:44:34.266015] [INFO ] [MAIN ] Derivative Progress: 1702/1771 symbols completed. WINN took 0.9s. Estimated remaining: 26.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:34.283312] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:34.484842] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:34.485709] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20456 primary records. [2025-10-08T22:44:34.485971] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-08T22:44:34.511329] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-08T22:44:34.512587] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-08T22:44:34.514700] [INFO ] [MAIN ] Derivative Progress: 1703/1771 symbols completed. WIW took 0.8s. Estimated remaining: 26.2s. Rate: 155.9 symbols/min [2025-10-08T22:44:34.515614] [DEBUG] [LOCAL ] WK: Loaded 37192 existing records from primary storage. [2025-10-08T22:44:34.516121] [INFO ] [MAIN ] WK: Loaded 37192 primary data records. [2025-10-08T22:44:34.515981] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:34.659538] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:34.712171] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52402 primary records. [2025-10-08T22:44:34.727742] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-08T22:44:34.858728] [DEBUG] [LOCAL ] WKC: Loaded 34635 existing records from primary storage. [2025-10-08T22:44:34.861741] [INFO ] [MAIN ] WKC: Loaded 34635 primary data records. [2025-10-08T22:44:34.863090] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-08T22:44:34.863184] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-08T22:44:34.865250] [INFO ] [MAIN ] Derivative Progress: 1704/1771 symbols completed. WIT took 1.3s. Estimated remaining: 25.8s. Rate: 155.9 symbols/min [2025-10-08T22:44:34.901605] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:35.191481] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:35.193333] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37192 primary records. [2025-10-08T22:44:35.193684] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-08T22:44:35.212533] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-08T22:44:35.226458] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-08T22:44:35.229906] [DEBUG] [LOCAL ] WLK: Loaded 45538 existing records from primary storage. [2025-10-08T22:44:35.228747] [INFO ] [MAIN ] Derivative Progress: 1705/1771 symbols completed. WK took 0.9s. Estimated remaining: 25.4s. Rate: 155.9 symbols/min [2025-10-08T22:44:35.230156] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:35.230302] [INFO ] [MAIN ] WLK: Loaded 45538 primary data records. [2025-10-08T22:44:35.335818] [DEBUG] [LOCAL ] WLKP: Loaded 6909 existing records from primary storage. [2025-10-08T22:44:35.339220] [INFO ] [MAIN ] WLKP: Loaded 6909 primary data records. [2025-10-08T22:44:35.692260] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:35.694275] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34635 primary records. [2025-10-08T22:44:35.705165] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-08T22:44:35.783191] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-08T22:44:35.802458] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-08T22:44:35.805506] [INFO ] [MAIN ] Derivative Progress: 1706/1771 symbols completed. WKC took 1.3s. Estimated remaining: 25.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:35.805694] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:35.979025] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:35.980675] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45538 primary records. [2025-10-08T22:44:35.980748] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-08T22:44:36.006253] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-08T22:44:36.007043] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-08T22:44:36.008995] [INFO ] [MAIN ] Derivative Progress: 1707/1771 symbols completed. WLK took 1.1s. Estimated remaining: 24.6s. Rate: 155.9 symbols/min [2025-10-08T22:44:36.010383] [DEBUG] [LOCAL ] WLY: Loaded 29488 existing records from primary storage. [2025-10-08T22:44:36.010733] [INFO ] [MAIN ] WLY: Loaded 29488 primary data records. [2025-10-08T22:44:36.010566] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:36.107732] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:36.120408] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6909 primary records. [2025-10-08T22:44:36.129114] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-08T22:44:36.356215] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-08T22:44:36.356379] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-08T22:44:36.358804] [INFO ] [MAIN ] Derivative Progress: 1708/1771 symbols completed. WLKP took 1.1s. Estimated remaining: 24.3s. Rate: 155.9 symbols/min [2025-10-08T22:44:36.379874] [DEBUG] [LOCAL ] WM: Loaded 50985 existing records from primary storage. [2025-10-08T22:44:36.381223] [INFO ] [MAIN ] WM: Loaded 50985 primary data records. [2025-10-08T22:44:36.687524] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:36.696416] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29488 primary records. [2025-10-08T22:44:36.696520] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-08T22:44:36.716037] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-08T22:44:36.716584] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-08T22:44:36.718437] [INFO ] [MAIN ] Derivative Progress: 1709/1771 symbols completed. WLY took 0.9s. Estimated remaining: 23.9s. Rate: 155.9 symbols/min [2025-10-08T22:44:36.736176] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:36.736782] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50985 primary records. [2025-10-08T22:44:36.736845] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-08T22:44:36.757032] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-08T22:44:36.757228] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-08T22:44:36.759387] [INFO ] [MAIN ] Derivative Progress: 1710/1771 symbols completed. WM took 0.7s. Estimated remaining: 23.5s. Rate: 156.0 symbols/min [2025-10-08T22:44:36.759928] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:36.760174] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:36.760098] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:36.784827] [DEBUG] [LOCAL ] WMK: Loaded 14571 existing records from primary storage. [2025-10-08T22:44:36.785059] [INFO ] [MAIN ] WMK: Loaded 14571 primary data records. [2025-10-08T22:44:36.975166] [DEBUG] [LOCAL ] WMS: Loaded 39565 existing records from primary storage. [2025-10-08T22:44:37.009929] [INFO ] [MAIN ] WMS: Loaded 39565 primary data records. [2025-10-08T22:44:37.211919] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-08T22:44:37.224862] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-08T22:44:37.794394] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:37.796081] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14571 primary records. [2025-10-08T22:44:37.796438] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-08T22:44:37.831424] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-08T22:44:37.832180] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:37.833413] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39565 primary records. [2025-10-08T22:44:37.832276] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-08T22:44:37.834019] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-08T22:44:37.837831] [INFO ] [MAIN ] Derivative Progress: 1711/1771 symbols completed. WMK took 1.1s. Estimated remaining: 23.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:37.864409] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:37.866279] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:37.867706] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-08T22:44:37.868025] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-08T22:44:37.870419] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-08T22:44:37.879177] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-08T22:44:37.884385] [INFO ] [MAIN ] Derivative Progress: 1712/1771 symbols completed. WMS took 1.1s. Estimated remaining: 22.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:37.885071] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:37.890087] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-08T22:44:37.890162] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-08T22:44:37.892118] [INFO ] [MAIN ] Derivative Progress: 1713/1771 symbols completed. WMB took 1.1s. Estimated remaining: 22.3s. Rate: 156.0 symbols/min [2025-10-08T22:44:37.892404] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:37.966025] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-08T22:44:37.964779] [DEBUG] [LOCAL ] WNC: Loaded 38808 existing records from primary storage. [2025-10-08T22:44:37.966340] [INFO ] [MAIN ] WNC: Loaded 38808 primary data records. [2025-10-08T22:44:37.966277] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-08T22:44:38.170261] [DEBUG] [LOCAL ] WNS: Loaded 39858 existing records from primary storage. [2025-10-08T22:44:38.208817] [INFO ] [MAIN ] WNS: Loaded 39858 primary data records. [2025-10-08T22:44:38.938366] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:38.951777] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38808 primary records. [2025-10-08T22:44:38.951997] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-08T22:44:38.953032] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:38.954219] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-08T22:44:38.954391] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-08T22:44:38.998756] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-08T22:44:38.999190] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-08T22:44:38.999508] [DEBUG] [MAIN ] WNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:39.001857] [INFO ] [MAIN ] Derivative Progress: 1714/1771 symbols completed. WNC took 1.1s. Estimated remaining: 22.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:39.002624] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:39.004394] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39858 primary records. [2025-10-08T22:44:39.004706] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-10-08T22:44:39.006107] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-08T22:44:39.006453] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-08T22:44:39.008547] [INFO ] [MAIN ] Derivative Progress: 1715/1771 symbols completed. WMT took 1.1s. Estimated remaining: 21.6s. Rate: 155.9 symbols/min [2025-10-08T22:44:39.009064] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:39.032131] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-10-08T22:44:39.032274] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-10-08T22:44:39.034604] [INFO ] [MAIN ] Derivative Progress: 1716/1771 symbols completed. WNS took 1.1s. Estimated remaining: 21.2s. Rate: 156.0 symbols/min [2025-10-08T22:44:39.034982] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:39.063538] [DEBUG] [LOCAL ] WOR: Loaded 24680 existing records from primary storage. [2025-10-08T22:44:39.063996] [INFO ] [MAIN ] WOR: Loaded 24680 primary data records. [2025-10-08T22:44:39.142928] [DEBUG] [LOCAL ] WOW: Loaded 30408 existing records from primary storage. [2025-10-08T22:44:39.169498] [INFO ] [MAIN ] WOW: Loaded 30408 primary data records. [2025-10-08T22:44:39.582911] [DEBUG] [LOCAL ] WPC: Loaded 48324 existing records from primary storage. [2025-10-08T22:44:39.606730] [INFO ] [MAIN ] WPC: Loaded 48324 primary data records. [2025-10-08T22:44:40.080835] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:40.082445] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24680 primary records. [2025-10-08T22:44:40.082680] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-08T22:44:40.114611] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:40.116764] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 30408 primary records. [2025-10-08T22:44:40.116871] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-08T22:44:40.120900] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-08T22:44:40.121315] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-08T22:44:40.130546] [INFO ] [MAIN ] Derivative Progress: 1717/1771 symbols completed. WOR took 1.1s. Estimated remaining: 20.8s. Rate: 155.8 symbols/min [2025-10-08T22:44:40.135384] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:40.155018] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:40.156362] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48324 primary records. [2025-10-08T22:44:40.156703] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-08T22:44:40.158530] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-08T22:44:40.165995] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-08T22:44:40.168389] [INFO ] [MAIN ] Derivative Progress: 1718/1771 symbols completed. WOW took 1.2s. Estimated remaining: 20.4s. Rate: 155.9 symbols/min [2025-10-08T22:44:40.173621] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:40.177796] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-08T22:44:40.178090] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-08T22:44:40.180400] [INFO ] [MAIN ] Derivative Progress: 1719/1771 symbols completed. WPC took 1.1s. Estimated remaining: 20.0s. Rate: 156.0 symbols/min [2025-10-08T22:44:40.180681] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:40.247345] [DEBUG] [LOCAL ] WPP: Loaded 34089 existing records from primary storage. [2025-10-08T22:44:40.247495] [INFO ] [MAIN ] WPP: Loaded 34089 primary data records. [2025-10-08T22:44:40.343742] [DEBUG] [LOCAL ] WPM: Loaded 52738 existing records from primary storage. [2025-10-08T22:44:40.349108] [INFO ] [MAIN ] WPM: Loaded 52738 primary data records. [2025-10-08T22:44:40.392846] [DEBUG] [LOCAL ] WRB: Loaded 50677 existing records from primary storage. [2025-10-08T22:44:40.444138] [INFO ] [MAIN ] WRB: Loaded 50677 primary data records. [2025-10-08T22:44:41.520793] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:41.522731] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34089 primary records. [2025-10-08T22:44:41.523098] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-08T22:44:41.585609] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:41.592929] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:41.593922] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52738 primary records. [2025-10-08T22:44:41.595037] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50677 primary records. [2025-10-08T22:44:41.595766] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-08T22:44:41.595451] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-08T22:44:41.597828] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-08T22:44:41.622795] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-08T22:44:41.629672] [INFO ] [MAIN ] Derivative Progress: 1720/1771 symbols completed. WPP took 1.5s. Estimated remaining: 19.7s. Rate: 155.7 symbols/min [2025-10-08T22:44:41.630774] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:41.636328] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-08T22:44:41.637069] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-08T22:44:41.636837] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-08T22:44:41.639850] [INFO ] [MAIN ] Derivative Progress: 1721/1771 symbols completed. WRB took 1.5s. Estimated remaining: 19.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:41.640000] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-08T22:44:41.642558] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:41.642673] [INFO ] [MAIN ] Derivative Progress: 1722/1771 symbols completed. WPM took 1.5s. Estimated remaining: 18.9s. Rate: 155.9 symbols/min [2025-10-08T22:44:41.643480] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:41.703155] [DEBUG] [LOCAL ] WS: Loaded 23537 existing records from primary storage. [2025-10-08T22:44:41.704008] [INFO ] [MAIN ] WS: Loaded 23537 primary data records. [2025-10-08T22:44:41.770025] [DEBUG] [LOCAL ] WRBY: Loaded 50712 existing records from primary storage. [2025-10-08T22:44:41.826603] [INFO ] [MAIN ] WRBY: Loaded 50712 primary data records. [2025-10-08T22:44:42.049385] [DEBUG] [LOCAL ] WSM: Loaded 49319 existing records from primary storage. [2025-10-08T22:44:42.202327] [INFO ] [MAIN ] WSM: Loaded 49319 primary data records. [2025-10-08T22:44:42.773858] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:42.773596] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:42.775811] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23537 primary records. [2025-10-08T22:44:42.774919] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50712 primary records. [2025-10-08T22:44:42.776024] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-08T22:44:42.775928] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-08T22:44:42.810050] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-08T22:44:42.810149] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-08T22:44:42.810787] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-08T22:44:42.813685] [INFO ] [MAIN ] Derivative Progress: 1723/1771 symbols completed. WRBY took 1.2s. Estimated remaining: 18.5s. Rate: 155.7 symbols/min [2025-10-08T22:44:42.810684] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-08T22:44:42.816266] [INFO ] [MAIN ] Derivative Progress: 1724/1771 symbols completed. WS took 1.2s. Estimated remaining: 18.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:42.832335] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:42.832977] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 49319 primary records. [2025-10-08T22:44:42.833040] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-08T22:44:42.848394] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-08T22:44:42.848463] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-08T22:44:42.850406] [INFO ] [MAIN ] Derivative Progress: 1725/1771 symbols completed. WSM took 1.2s. Estimated remaining: 17.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:42.850844] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:42.850904] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:42.851019] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:42.883740] [DEBUG] [LOCAL ] WSO: Loaded 25075 existing records from primary storage. [2025-10-08T22:44:42.883882] [INFO ] [MAIN ] WSO: Loaded 25075 primary data records. [2025-10-08T22:44:42.955610] [DEBUG] [LOCAL ] WSR: Loaded 22909 existing records from primary storage. [2025-10-08T22:44:42.964556] [INFO ] [MAIN ] WSR: Loaded 22909 primary data records. [2025-10-08T22:44:43.044763] [DEBUG] [LOCAL ] WST: Loaded 36892 existing records from primary storage. [2025-10-08T22:44:43.095370] [INFO ] [MAIN ] WST: Loaded 36892 primary data records. [2025-10-08T22:44:43.894038] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:43.894934] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25075 primary records. [2025-10-08T22:44:43.895090] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-08T22:44:43.919725] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:43.923540] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22909 primary records. [2025-10-08T22:44:43.923979] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-08T22:44:43.924888] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-08T22:44:43.925585] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-08T22:44:43.927841] [INFO ] [MAIN ] Derivative Progress: 1726/1771 symbols completed. WSO took 1.1s. Estimated remaining: 17.3s. Rate: 155.7 symbols/min [2025-10-08T22:44:43.935386] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:43.947205] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-08T22:44:43.947466] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-08T22:44:43.949687] [INFO ] [MAIN ] Derivative Progress: 1727/1771 symbols completed. WSR took 1.1s. Estimated remaining: 16.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:43.949920] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:43.963579] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:43.964619] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36892 primary records. [2025-10-08T22:44:43.964912] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-08T22:44:43.981672] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-08T22:44:43.981851] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-08T22:44:43.983944] [INFO ] [MAIN ] Derivative Progress: 1728/1771 symbols completed. WST took 1.1s. Estimated remaining: 16.6s. Rate: 155.9 symbols/min [2025-10-08T22:44:43.984170] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:44.027246] [DEBUG] [LOCAL ] WT: Loaded 47891 existing records from primary storage. [2025-10-08T22:44:44.039279] [INFO ] [MAIN ] WT: Loaded 47891 primary data records. [2025-10-08T22:44:44.070558] [DEBUG] [LOCAL ] WTI: Loaded 44135 existing records from primary storage. [2025-10-08T22:44:44.082631] [INFO ] [MAIN ] WTI: Loaded 44135 primary data records. [2025-10-08T22:44:44.416624] [DEBUG] [LOCAL ] WTRG: Loaded 50969 existing records from primary storage. [2025-10-08T22:44:44.538685] [INFO ] [MAIN ] WTRG: Loaded 50969 primary data records. [2025-10-08T22:44:45.005845] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:45.011451] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:45.013639] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47891 primary records. [2025-10-08T22:44:45.012348] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44135 primary records. [2025-10-08T22:44:45.014453] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-08T22:44:45.013937] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-08T22:44:45.046187] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-08T22:44:45.046833] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-08T22:44:45.049432] [INFO ] [MAIN ] Derivative Progress: 1729/1771 symbols completed. WTI took 1.1s. Estimated remaining: 16.2s. Rate: 155.7 symbols/min [2025-10-08T22:44:45.050623] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:45.054906] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-08T22:44:45.055231] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-08T22:44:45.057723] [INFO ] [MAIN ] Derivative Progress: 1730/1771 symbols completed. WT took 1.1s. Estimated remaining: 15.8s. Rate: 155.8 symbols/min [2025-10-08T22:44:45.057928] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:45.074528] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:45.075245] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50969 primary records. [2025-10-08T22:44:45.075388] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-08T22:44:45.101861] [DEBUG] [LOCAL ] WTS: Loaded 17746 existing records from primary storage. [2025-10-08T22:44:45.103939] [INFO ] [MAIN ] WTS: Loaded 17746 primary data records. [2025-10-08T22:44:45.104046] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-08T22:44:45.146716] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-08T22:44:45.160746] [INFO ] [MAIN ] Derivative Progress: 1731/1771 symbols completed. WTRG took 1.2s. Estimated remaining: 15.4s. Rate: 155.9 symbols/min [2025-10-08T22:44:45.191190] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:45.417191] [DEBUG] [LOCAL ] WTTR: Loaded 44656 existing records from primary storage. [2025-10-08T22:44:45.425997] [INFO ] [MAIN ] WTTR: Loaded 44656 primary data records. [2025-10-08T22:44:45.763932] [DEBUG] [LOCAL ] WU: Loaded 53462 existing records from primary storage. [2025-10-08T22:44:45.764438] [INFO ] [MAIN ] WU: Loaded 53462 primary data records. [2025-10-08T22:44:46.127801] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:46.128634] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 17746 primary records. [2025-10-08T22:44:46.128965] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-08T22:44:46.151563] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-10-08T22:44:46.151713] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-08T22:44:46.153865] [INFO ] [MAIN ] Derivative Progress: 1732/1771 symbols completed. WTS took 1.1s. Estimated remaining: 15.0s. Rate: 155.7 symbols/min [2025-10-08T22:44:46.154002] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:46.169199] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:46.170452] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44656 primary records. [2025-10-08T22:44:46.170747] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-08T22:44:46.190941] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-08T22:44:46.191118] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-08T22:44:46.200787] [INFO ] [MAIN ] Derivative Progress: 1733/1771 symbols completed. WTTR took 1.1s. Estimated remaining: 14.6s. Rate: 155.8 symbols/min [2025-10-08T22:44:46.206306] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:46.206553] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:46.207464] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53462 primary records. [2025-10-08T22:44:46.207803] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-08T22:44:46.224688] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-08T22:44:46.224883] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-08T22:44:46.227003] [INFO ] [MAIN ] Derivative Progress: 1734/1771 symbols completed. WU took 1.0s. Estimated remaining: 14.2s. Rate: 155.9 symbols/min [2025-10-08T22:44:46.227234] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:46.262174] [DEBUG] [LOCAL ] WWW: Loaded 49239 existing records from primary storage. [2025-10-08T22:44:46.262344] [INFO ] [MAIN ] WWW: Loaded 49239 primary data records. [2025-10-08T22:44:46.448429] [DEBUG] [LOCAL ] XFLT: Loaded 29925 existing records from primary storage. [2025-10-08T22:44:46.471254] [INFO ] [MAIN ] XFLT: Loaded 29925 primary data records. [2025-10-08T22:44:46.481751] [DEBUG] [LOCAL ] WY: Loaded 53138 existing records from primary storage. [2025-10-08T22:44:46.539972] [INFO ] [MAIN ] WY: Loaded 53138 primary data records. [2025-10-08T22:44:47.269888] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:47.271185] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49239 primary records. [2025-10-08T22:44:47.271669] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-08T22:44:47.291618] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-08T22:44:47.293946] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-08T22:44:47.298176] [INFO ] [MAIN ] Derivative Progress: 1735/1771 symbols completed. WWW took 1.1s. Estimated remaining: 13.9s. Rate: 155.7 symbols/min [2025-10-08T22:44:47.298599] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:47.323817] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:47.325418] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:47.325224] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29925 primary records. [2025-10-08T22:44:47.325540] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-08T22:44:47.326666] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53138 primary records. [2025-10-08T22:44:47.326833] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-08T22:44:47.355860] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-08T22:44:47.356278] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-08T22:44:47.358574] [INFO ] [MAIN ] Derivative Progress: 1736/1771 symbols completed. XFLT took 1.1s. Estimated remaining: 13.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:47.359344] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:47.363729] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-08T22:44:47.363892] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-08T22:44:47.366196] [INFO ] [MAIN ] Derivative Progress: 1737/1771 symbols completed. WY took 1.2s. Estimated remaining: 13.1s. Rate: 155.9 symbols/min [2025-10-08T22:44:47.366564] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:47.413383] [DEBUG] [LOCAL ] XHR: Loaded 43665 existing records from primary storage. [2025-10-08T22:44:47.413600] [INFO ] [MAIN ] XHR: Loaded 43665 primary data records. [2025-10-08T22:44:47.564917] [DEBUG] [LOCAL ] XPER: Loaded 30107 existing records from primary storage. [2025-10-08T22:44:47.575880] [INFO ] [MAIN ] XPER: Loaded 30107 primary data records. [2025-10-08T22:44:47.865519] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-08T22:44:47.893355] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-08T22:44:48.462029] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:48.463123] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43665 primary records. [2025-10-08T22:44:48.463626] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-08T22:44:48.500455] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:48.501711] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-08T22:44:48.502208] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-08T22:44:48.503126] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30107 primary records. [2025-10-08T22:44:48.505381] [INFO ] [MAIN ] Derivative Progress: 1738/1771 symbols completed. XHR took 1.2s. Estimated remaining: 12.7s. Rate: 155.7 symbols/min [2025-10-08T22:44:48.505533] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-08T22:44:48.526012] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-08T22:44:48.526307] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-08T22:44:48.528983] [INFO ] [MAIN ] Derivative Progress: 1739/1771 symbols completed. XPER took 1.2s. Estimated remaining: 12.3s. Rate: 155.8 symbols/min [2025-10-08T22:44:48.542250] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:48.543007] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-08T22:44:48.543072] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-08T22:44:48.559248] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-08T22:44:48.559330] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-08T22:44:48.561439] [INFO ] [MAIN ] Derivative Progress: 1740/1771 symbols completed. XOM took 1.2s. Estimated remaining: 11.9s. Rate: 155.9 symbols/min [2025-10-08T22:44:48.561897] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:48.562105] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:48.562043] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:48.624564] [DEBUG] [LOCAL ] XPOF: Loaded 37639 existing records from primary storage. [2025-10-08T22:44:48.624802] [INFO ] [MAIN ] XPOF: Loaded 37639 primary data records. [2025-10-08T22:44:48.747241] [DEBUG] [LOCAL ] XPO: Loaded 47785 existing records from primary storage. [2025-10-08T22:44:48.751192] [INFO ] [MAIN ] XPO: Loaded 47785 primary data records. [2025-10-08T22:44:48.841330] [DEBUG] [LOCAL ] XPEV: Loaded 53634 existing records from primary storage. [2025-10-08T22:44:48.877708] [INFO ] [MAIN ] XPEV: Loaded 53634 primary data records. [2025-10-08T22:44:49.615313] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:49.616909] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37639 primary records. [2025-10-08T22:44:49.617148] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-08T22:44:49.648860] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:49.651180] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 47785 primary records. [2025-10-08T22:44:49.651773] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-08T22:44:49.672264] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-08T22:44:49.673553] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-10-08T22:44:49.686451] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-08T22:44:49.689520] [INFO ] [MAIN ] Derivative Progress: 1741/1771 symbols completed. XPO took 1.1s. Estimated remaining: 11.6s. Rate: 155.7 symbols/min [2025-10-08T22:44:49.686528] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-08T22:44:49.692262] [INFO ] [MAIN ] Derivative Progress: 1742/1771 symbols completed. XPOF took 1.1s. Estimated remaining: 11.2s. Rate: 155.8 symbols/min [2025-10-08T22:44:49.692160] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:49.691555] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:49.693992] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53634 primary records. [2025-10-08T22:44:49.692542] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:49.694290] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-08T22:44:49.712330] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-08T22:44:49.712680] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-08T22:44:49.714615] [INFO ] [MAIN ] Derivative Progress: 1743/1771 symbols completed. XPEV took 1.2s. Estimated remaining: 10.8s. Rate: 155.9 symbols/min [2025-10-08T22:44:49.714974] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:49.749955] [DEBUG] [LOCAL ] XYF: Loaded 28288 existing records from primary storage. [2025-10-08T22:44:49.750301] [INFO ] [MAIN ] XYF: Loaded 28288 primary data records. [2025-10-08T22:44:49.872330] [DEBUG] [LOCAL ] XPRO: Loaded 45859 existing records from primary storage. [2025-10-08T22:44:49.872587] [INFO ] [MAIN ] XPRO: Loaded 45859 primary data records. [2025-10-08T22:44:50.442509] [DEBUG] [LOCAL ] XYL: Loaded 47900 existing records from primary storage. [2025-10-08T22:44:50.451563] [INFO ] [MAIN ] XYL: Loaded 47900 primary data records. [2025-10-08T22:44:50.787035] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:50.788846] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 28288 primary records. [2025-10-08T22:44:50.790162] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-08T22:44:50.826134] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:50.829729] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45859 primary records. [2025-10-08T22:44:50.831702] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-08T22:44:50.842224] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-08T22:44:50.846634] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-08T22:44:50.849972] [INFO ] [MAIN ] Derivative Progress: 1744/1771 symbols completed. XYF took 1.2s. Estimated remaining: 10.4s. Rate: 155.7 symbols/min [2025-10-08T22:44:50.851944] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:50.853774] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-08T22:44:50.854392] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-08T22:44:50.857366] [INFO ] [MAIN ] Derivative Progress: 1745/1771 symbols completed. XPRO took 1.2s. Estimated remaining: 10.0s. Rate: 155.8 symbols/min [2025-10-08T22:44:50.857913] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:50.875089] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:50.875882] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47900 primary records. [2025-10-08T22:44:50.876087] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-08T22:44:50.892659] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-08T22:44:50.901004] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-08T22:44:50.902899] [INFO ] [MAIN ] Derivative Progress: 1746/1771 symbols completed. XYL took 1.2s. Estimated remaining: 9.6s. Rate: 155.9 symbols/min [2025-10-08T22:44:50.903276] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:50.918056] [DEBUG] [LOCAL ] YALA: Loaded 37037 existing records from primary storage. [2025-10-08T22:44:50.918216] [INFO ] [MAIN ] YALA: Loaded 37037 primary data records. [2025-10-08T22:44:51.250499] [DEBUG] [LOCAL ] YELP: Loaded 45425 existing records from primary storage. [2025-10-08T22:44:51.259357] [INFO ] [MAIN ] YELP: Loaded 45425 primary data records. [2025-10-08T22:44:51.379972] [DEBUG] [LOCAL ] YETI: Loaded 52467 existing records from primary storage. [2025-10-08T22:44:51.386070] [INFO ] [MAIN ] YETI: Loaded 52467 primary data records. [2025-10-08T22:44:51.892617] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:51.893873] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37037 primary records. [2025-10-08T22:44:51.894060] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-08T22:44:51.915329] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-08T22:44:51.916504] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-08T22:44:51.918592] [INFO ] [MAIN ] Derivative Progress: 1747/1771 symbols completed. YALA took 1.1s. Estimated remaining: 9.2s. Rate: 155.7 symbols/min [2025-10-08T22:44:51.919112] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:51.934301] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:51.935109] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45425 primary records. [2025-10-08T22:44:51.935253] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-08T22:44:51.955903] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:51.963357] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52467 primary records. [2025-10-08T22:44:51.964548] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-08T22:44:51.964429] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-08T22:44:51.965280] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-08T22:44:51.968058] [INFO ] [MAIN ] Derivative Progress: 1748/1771 symbols completed. YELP took 1.1s. Estimated remaining: 8.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:51.975743] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:51.985151] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-08T22:44:51.985322] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-08T22:44:51.987205] [INFO ] [MAIN ] Derivative Progress: 1749/1771 symbols completed. YETI took 1.1s. Estimated remaining: 8.5s. Rate: 155.9 symbols/min [2025-10-08T22:44:51.987405] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:52.023036] [DEBUG] [LOCAL ] YEXT: Loaded 43106 existing records from primary storage. [2025-10-08T22:44:52.023345] [INFO ] [MAIN ] YEXT: Loaded 43106 primary data records. [2025-10-08T22:44:52.292922] [DEBUG] [LOCAL ] YMM: Loaded 52596 existing records from primary storage. [2025-10-08T22:44:52.402357] [DEBUG] [LOCAL ] YOU: Loaded 49690 existing records from primary storage. [2025-10-08T22:44:52.402604] [INFO ] [MAIN ] YMM: Loaded 52596 primary data records. [2025-10-08T22:44:52.402694] [INFO ] [MAIN ] YOU: Loaded 49690 primary data records. [2025-10-08T22:44:53.020928] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:53.022039] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43106 primary records. [2025-10-08T22:44:53.022216] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-08T22:44:53.042352] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-08T22:44:53.042741] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-08T22:44:53.045375] [INFO ] [MAIN ] Derivative Progress: 1750/1771 symbols completed. YEXT took 1.1s. Estimated remaining: 8.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:53.046447] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:53.077675] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:53.078750] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52596 primary records. [2025-10-08T22:44:53.078086] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:53.078818] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-08T22:44:53.079605] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49690 primary records. [2025-10-08T22:44:53.080410] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-08T22:44:53.108453] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-08T22:44:53.108570] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-08T22:44:53.111239] [INFO ] [MAIN ] Derivative Progress: 1751/1771 symbols completed. YMM took 1.1s. Estimated remaining: 7.7s. Rate: 155.8 symbols/min [2025-10-08T22:44:53.111489] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:53.119096] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-08T22:44:53.119325] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-08T22:44:53.121326] [INFO ] [MAIN ] Derivative Progress: 1752/1771 symbols completed. YOU took 1.1s. Estimated remaining: 7.3s. Rate: 155.9 symbols/min [2025-10-08T22:44:53.124173] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:53.143345] [DEBUG] [LOCAL ] YRD: Loaded 11994 existing records from primary storage. [2025-10-08T22:44:53.143485] [INFO ] [MAIN ] YRD: Loaded 11994 primary data records. [2025-10-08T22:44:53.296795] [DEBUG] [LOCAL ] YPF: Loaded 50525 existing records from primary storage. [2025-10-08T22:44:53.324632] [INFO ] [MAIN ] YPF: Loaded 50525 primary data records. [2025-10-08T22:44:53.325182] [DEBUG] [LOCAL ] YSG: Loaded 25279 existing records from primary storage. [2025-10-08T22:44:53.354846] [INFO ] [MAIN ] YSG: Loaded 25279 primary data records. [2025-10-08T22:44:54.168558] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:54.169836] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11994 primary records. [2025-10-08T22:44:54.170346] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-08T22:44:54.206961] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-08T22:44:54.207218] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-08T22:44:54.206507] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:54.220572] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50525 primary records. [2025-10-08T22:44:54.219768] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:54.222458] [INFO ] [MAIN ] Derivative Progress: 1753/1771 symbols completed. YRD took 1.1s. Estimated remaining: 6.9s. Rate: 155.7 symbols/min [2025-10-08T22:44:54.222769] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-08T22:44:54.223516] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25279 primary records. [2025-10-08T22:44:54.224464] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-08T22:44:54.252400] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-08T22:44:54.252940] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-08T22:44:54.255606] [INFO ] [MAIN ] Derivative Progress: 1754/1771 symbols completed. YSG took 1.1s. Estimated remaining: 6.5s. Rate: 155.8 symbols/min [2025-10-08T22:44:54.256938] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-08T22:44:54.257002] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-08T22:44:54.259051] [INFO ] [MAIN ] Derivative Progress: 1755/1771 symbols completed. YPF took 1.2s. Estimated remaining: 6.2s. Rate: 155.9 symbols/min [2025-10-08T22:44:54.259425] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:54.259602] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:54.259543] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:54.327340] [DEBUG] [LOCAL ] YUMC: Loaded 52603 existing records from primary storage. [2025-10-08T22:44:54.340364] [INFO ] [MAIN ] YUMC: Loaded 52603 primary data records. [2025-10-08T22:44:54.476219] [DEBUG] [LOCAL ] ZBH: Loaded 50845 existing records from primary storage. [2025-10-08T22:44:54.476517] [INFO ] [MAIN ] ZBH: Loaded 50845 primary data records. [2025-10-08T22:44:54.477857] [DEBUG] [LOCAL ] YUM: Loaded 51198 existing records from primary storage. [2025-10-08T22:44:54.495117] [INFO ] [MAIN ] YUM: Loaded 51198 primary data records. [2025-10-08T22:44:55.320936] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:55.322053] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52603 primary records. [2025-10-08T22:44:55.322171] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-08T22:44:55.353464] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:55.355457] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50845 primary records. [2025-10-08T22:44:55.355871] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-08T22:44:55.356597] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-08T22:44:55.356811] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-08T22:44:55.359520] [INFO ] [MAIN ] Derivative Progress: 1756/1771 symbols completed. YUMC took 1.1s. Estimated remaining: 5.8s. Rate: 155.8 symbols/min [2025-10-08T22:44:55.359933] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:55.387360] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-08T22:44:55.393186] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-08T22:44:55.393530] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:55.395536] [INFO ] [MAIN ] Derivative Progress: 1757/1771 symbols completed. ZBH took 1.1s. Estimated remaining: 5.4s. Rate: 155.8 symbols/min [2025-10-08T22:44:55.396591] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51198 primary records. [2025-10-08T22:44:55.396937] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-08T22:44:55.396863] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:55.425211] [DEBUG] [LOCAL ] ZEPP: Loaded 18238 existing records from primary storage. [2025-10-08T22:44:55.425952] [INFO ] [MAIN ] ZEPP: Loaded 18238 primary data records. [2025-10-08T22:44:55.439635] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-08T22:44:55.449459] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-08T22:44:55.467160] [INFO ] [MAIN ] Derivative Progress: 1758/1771 symbols completed. YUM took 1.2s. Estimated remaining: 5.0s. Rate: 155.9 symbols/min [2025-10-08T22:44:55.487262] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:55.777158] [DEBUG] [LOCAL ] ZETA: Loaded 53609 existing records from primary storage. [2025-10-08T22:44:55.786931] [INFO ] [MAIN ] ZETA: Loaded 53609 primary data records. [2025-10-08T22:44:55.909355] [DEBUG] [LOCAL ] ZGN: Loaded 40720 existing records from primary storage. [2025-10-08T22:44:55.932584] [INFO ] [MAIN ] ZGN: Loaded 40720 primary data records. [2025-10-08T22:44:56.535032] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:44:56.537398] [INFO ] [MAIN ] ZEPP: Generated 1793 derivative records from 18238 primary records. [2025-10-08T22:44:56.537874] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-08T22:44:56.562498] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1793 records). [2025-10-08T22:44:56.563072] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-08T22:44:56.565929] [INFO ] [MAIN ] Derivative Progress: 1759/1771 symbols completed. ZEPP took 1.2s. Estimated remaining: 4.6s. Rate: 155.7 symbols/min [2025-10-08T22:44:56.566277] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:56.583486] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:56.584516] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53609 primary records. [2025-10-08T22:44:56.584673] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-08T22:44:56.603611] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-08T22:44:56.616671] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-08T22:44:56.616966] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:56.627893] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40720 primary records. [2025-10-08T22:44:56.630152] [INFO ] [MAIN ] Derivative Progress: 1760/1771 symbols completed. ZETA took 1.2s. Estimated remaining: 4.2s. Rate: 155.8 symbols/min [2025-10-08T22:44:56.628042] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-08T22:44:56.630511] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:56.649565] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-08T22:44:56.658485] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-08T22:44:56.661857] [INFO ] [MAIN ] Derivative Progress: 1761/1771 symbols completed. ZGN took 1.2s. Estimated remaining: 3.8s. Rate: 155.9 symbols/min [2025-10-08T22:44:56.662618] [DEBUG] [LOCAL ] ZH: Loaded 25762 existing records from primary storage. [2025-10-08T22:44:56.663395] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:56.663555] [INFO ] [MAIN ] ZH: Loaded 25762 primary data records. [2025-10-08T22:44:57.042531] [DEBUG] [LOCAL ] ZIM: Loaded 53502 existing records from primary storage. [2025-10-08T22:44:57.043857] [DEBUG] [LOCAL ] ZIP: Loaded 43870 existing records from primary storage. [2025-10-08T22:44:57.044167] [INFO ] [MAIN ] ZIP: Loaded 43870 primary data records. [2025-10-08T22:44:57.043991] [INFO ] [MAIN ] ZIM: Loaded 53502 primary data records. [2025-10-08T22:44:57.661414] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:57.663859] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 25762 primary records. [2025-10-08T22:44:57.664830] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-08T22:44:57.687202] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-08T22:44:57.687612] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-08T22:44:57.689907] [INFO ] [MAIN ] Derivative Progress: 1762/1771 symbols completed. ZH took 1.1s. Estimated remaining: 3.5s. Rate: 155.7 symbols/min [2025-10-08T22:44:57.690561] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:57.724892] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:57.726161] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43870 primary records. [2025-10-08T22:44:57.726263] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-08T22:44:57.725437] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:57.727113] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53502 primary records. [2025-10-08T22:44:57.727714] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-08T22:44:57.763790] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-08T22:44:57.764378] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-08T22:44:57.766315] [INFO ] [MAIN ] Derivative Progress: 1763/1771 symbols completed. ZIP took 1.1s. Estimated remaining: 3.1s. Rate: 155.8 symbols/min [2025-10-08T22:44:57.766891] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:57.781979] [DEBUG] [LOCAL ] ZK: Loaded 39135 existing records from primary storage. [2025-10-08T22:44:57.782633] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-08T22:44:57.782848] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-08T22:44:57.782922] [INFO ] [MAIN ] ZK: Loaded 39135 primary data records. [2025-10-08T22:44:57.784899] [INFO ] [MAIN ] Derivative Progress: 1764/1771 symbols completed. ZIM took 1.2s. Estimated remaining: 2.7s. Rate: 155.9 symbols/min [2025-10-08T22:44:57.794730] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:57.859557] [DEBUG] [LOCAL ] ZKH: Loaded 7652 existing records from primary storage. [2025-10-08T22:44:57.889006] [INFO ] [MAIN ] ZKH: Loaded 7652 primary data records. [2025-10-08T22:44:58.454353] [DEBUG] [LOCAL ] ZTO: Loaded 49554 existing records from primary storage. [2025-10-08T22:44:58.456324] [INFO ] [MAIN ] ZTO: Loaded 49554 primary data records. [2025-10-08T22:44:58.788993] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:58.806249] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:44:58.791250] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39135 primary records. [2025-10-08T22:44:58.806408] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-08T22:44:58.808012] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7652 primary records. [2025-10-08T22:44:58.808533] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-08T22:44:58.838332] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-10-08T22:44:58.838735] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-08T22:44:58.841673] [INFO ] [MAIN ] Derivative Progress: 1765/1771 symbols completed. ZKH took 1.1s. Estimated remaining: 2.3s. Rate: 155.7 symbols/min [2025-10-08T22:44:58.842205] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:58.846930] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-08T22:44:58.849308] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-08T22:44:58.852294] [INFO ] [MAIN ] Derivative Progress: 1766/1771 symbols completed. ZK took 1.2s. Estimated remaining: 1.9s. Rate: 155.8 symbols/min [2025-10-08T22:44:58.852755] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:58.866542] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:58.867261] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49554 primary records. [2025-10-08T22:44:58.867426] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-08T22:44:58.893313] [DEBUG] [LOCAL ] ZTR: Loaded 16796 existing records from primary storage. [2025-10-08T22:44:58.894013] [INFO ] [MAIN ] ZTR: Loaded 16796 primary data records. [2025-10-08T22:44:58.914711] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-08T22:44:58.914792] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-08T22:44:58.916882] [INFO ] [MAIN ] Derivative Progress: 1767/1771 symbols completed. ZTO took 1.1s. Estimated remaining: 1.5s. Rate: 155.9 symbols/min [2025-10-08T22:44:58.923882] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:44:59.176810] [DEBUG] [LOCAL ] ZTS: Loaded 53076 existing records from primary storage. [2025-10-08T22:44:59.285440] [DEBUG] [LOCAL ] ZVIA: Loaded 35417 existing records from primary storage. [2025-10-08T22:44:59.299698] [INFO ] [MAIN ] ZVIA: Loaded 35417 primary data records. [2025-10-08T22:44:59.299899] [INFO ] [MAIN ] ZTS: Loaded 53076 primary data records. [2025-10-08T22:44:59.965468] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:44:59.966690] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16796 primary records. [2025-10-08T22:44:59.966784] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-08T22:44:59.986093] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-08T22:44:59.986531] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-08T22:44:59.988616] [INFO ] [MAIN ] Derivative Progress: 1768/1771 symbols completed. ZTR took 1.1s. Estimated remaining: 1.2s. Rate: 155.7 symbols/min [2025-10-08T22:45:00.008215] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-08T22:45:00.009184] [INFO ] [MAIN ] ZTS: Generated 1793 derivative records from 53076 primary records. [2025-10-08T22:45:00.009269] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-08T22:45:00.043852] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1793 records). [2025-10-08T22:45:00.043147] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:45:00.044771] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35417 primary records. [2025-10-08T22:45:00.044882] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-08T22:45:00.044981] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-08T22:45:00.047474] [INFO ] [MAIN ] Derivative Progress: 1769/1771 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 155.8 symbols/min [2025-10-08T22:45:00.063688] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-08T22:45:00.063844] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-08T22:45:00.065921] [INFO ] [MAIN ] Derivative Progress: 1770/1771 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.4s. Rate: 155.9 symbols/min [2025-10-08T22:45:00.066256] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-08T22:45:00.124210] [DEBUG] [LOCAL ] ZWS: Loaded 42273 existing records from primary storage. [2025-10-08T22:45:00.124360] [INFO ] [MAIN ] ZWS: Loaded 42273 primary data records. [2025-10-08T22:45:00.487464] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-08T22:45:00.488158] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42273 primary records. [2025-10-08T22:45:00.488223] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-08T22:45:00.504297] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-08T22:45:00.504360] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-08T22:45:00.507142] [INFO ] [MAIN ] Derivative Progress: 1771/1771 symbols completed. ZWS took 0.4s. Estimated remaining: 0.0s. Rate: 155.9 symbols/min [2025-10-08T22:45:00.507839] [INFO ] [MAIN ] Parallel derivative generation completed in 11m 22s [2025-10-08T22:45:00.507934] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (1771/1771 symbols) [2025-10-08T22:45:01.158367] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (1771/1771 @ 100.00%)' [2025-10-08T22:45:01.159054] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-08T22:45:01.160184] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-08T22:45:01.160497] [INFO ] [STATE ] Last completion updated: 2025-10-08T22:45:01.160271